Here, we assessed the relative influence of wheat genotype, agricultural practices (conventional vs organic) and soil type on the rhizosphere microbiome. We characterized the prokaryotic (archaea and bacteria) and eukaryotic (fungi and protists) communities in soils from four different countries (Cameroon, France, Italy, Senegal) and determined if a rhizosphere core microbiome existed across these different countries. The wheat genotype had a limited effect on the rhizosphere microbiome (2% of variance) as the majority of the microbial taxa were consistently associated to multiple wheat genotypes grown in the same soil. Large differences in taxa richness and in community structure were observed between the eight soils studied (57% variance) and the two agricultural practices (10% variance). Despite these differences between soils, we observed that 177 taxa (2 archaea, 103 bacteria, 41 fungi and 31 protists) were consistently detected in the rhizosphere, constituting a core microbiome. In addition to being prevalent, these core taxa were highly abundant and collectively represented 50% of the reads in our data set. Based on these results, we identify a list of key taxa as future targets of culturomics, metagenomics and wheat synthetic microbiomes. Additionally, we show that protists are an integral part of the wheat holobiont that is currently overlooked.