Arbuscular mycorrhizal fungi (AMF) are key drivers of soil functioning. They interact with multiple soil parameters, notably, phosphorus (P). In this work, AMF communities of native plants grown spontaneously on former mining sites either enriched (P sites) or not enriched with P (nP sites) by mining cuttings of rock phosphate (RP) were studied. No significant differences were observed in the root mycorrhizal rates of the plants when comparing P and nP sites. The assessment of AMF diversity and community structure using Illumina MiSeq metabarcoding and targeting 18S rDNA in roots and rhizospheric soils showed a total of 318 Amplicon Sequence Variants (ASVs) of Glomeromycota phylum. No significant difference in the diversity was found between P and nP sites. Glomeraceae species were largely dominant, formed a fungal core of 26 ASVs, and were persistent and abundant in all sites. In the P soils, eight ASVs were identified by indicator species analysis. A trend towards an increase in Diversisporaceae and Claroideoglomeraceae and a reduction in Paraglomeraceae and Glomeraceae were noticed. These results provide new insights into AMF ecology in former RP mining sites; they document that P concentration is a driver of AMF community structures in soils enriched in RP long term but also suggest an influence of land disturbance, ecosystem self-restoration, and AMF life history strategies as drivers of AMF community profiles.