Soil acidification and declining fertility are widespread in sub‐Saharan Africa. Nutrient depletion is mainly related to nutrient mining driven by biomass removal without replenishment of nutrients through use of fertilisers. Concomitant acidification is due to the high ash alkalinity of harvested biomass. We determined the nutrient content and ash alkalinity of biomass of the main crops produced in smallholder mixed crop–livestock farming systems in the Malagasy Highlands of Madagascar and calculated the soil acidification/alkalinisation occurring through biomass transfer. Samples of rice and forage were collected from 70 rice plots and 91 cultivated forage plots, and 70 manure samples were collected from farms. Nutrient exports induced by crop harvesting resulted in annual losses of 57 kg nitrogen (N), 6 kg (phosphorus) P and 33 kg potassium (K) ha–1 for rice (grain + straw), and 31–51 kg N, 8–9 kg P and 29–57 kg K ha–1 for each forage cut (with three cuts per year on average). The ash alkalinity of samples, calculated as the difference between cation and anion contents, was 49–100 cmolc kg–1 for forage crops, 31 cmolc kg–1 for rice straw, and only 4 cmolc kg–1 for rice grains. Biomass removal caused a loss of nutrients and an increase in soil acidity. Owing to low nutrient retention efficiency during the handling and storage of manure, the traditional input of manure at 5 t fresh matter ha–1 is insufficient to balance nutrient and alkalinity losses in Malagasy mixed crop–livestock farming systems. Maintaining productive and sustainable mixed crop–livestock farming systems requires greater attention to ensuring a nutrient balance at both plot and farm levels.