The aerial surface of the plant (phyllosphere) is the habitat of complex microbial communities. These communities may have profound effects on host plant health and its performance traits. When breeding new cultivars, i.e. the aerial component of a grape plant, one can simply ignore the phyllosphere in breeding schemes if its composition is mainly dependent on the environment. It is considered an important component if the genotype is the main driver of the phyllosphere composition. In order to answer this question, we have analysed several factors influencing the structure of the phyllosphere microbial community. Using amplicon sequencing of the 16S rRNA gene and of the internal transcribed spacer (ITS), we explored the microbial diversity at genus level for both bacteria and fungi present in the phyllosphere of leaves and grape berries. We analysed it on different grape taxonomic level (between five Vitis species or a set of Vitis vinifera cultivars chosen to represent the three genetic pools of the species), for different years and on five commercially important varieties of Vitis vinifera that were sampled from three different French terroirs. Our results indicated the presence of complex microbial diversity and assemblages in the phyllosphere. A significant effect of several factors (organ, grape species, growing year and terroir) on taxa abundance was observed with varying degrees of effect. At a given location, genotypes have an impact on microbial assemblage in the phyllosphere of leaf and berries, most pronounced on fruits but the effect of terroir was much stronger than the cultivar identity when the leaf phyllosphere of five grapevine varieties grown in different agro-climatic zones was compared. Limitations of the study as well as implied consequences of this work will be discussed.