Purpose: The aim of this study was to investigate the prevalence of subretinal drusenoid deposits (SDD) and to identify associated factors in an elderly population. Methods: The participants of the population-based Montrachet study underwent an exhaustive ophthalmologic examination, including color fundus photography and macular spectral domain-optical coherence tomography (SD-OCT), coupled with infrared reflectance imaging. The presence of SDD and other age-related macular degeneration lesions, according to the European Eye Epidemiology SD-OCT classification of macular diseases, and subfoveal choroidal thickness were recorded. Moreover, the association of SDD and both clinical and demographic factors as well as plasma levels of vitamin E and lutein/zeaxanthin (L/Z) were analyzed. Results: The mean age of patients was 82.3 ± 3.8 years and 62.7% were female. The prevalence of SDD was 18.1% (n = 205) in the subjects with at least one eye interpretable (n = 1135). In multivariate analysis, SDD was positively associated with increasing age (OR, 4.6; 95% CI, 2.8–7.7; P < 0.001 for subjects aged >85 years), female sex (OR, 1.7; 95% CI, 1.2–2.4; P = 0.005), and plasma L/Z level (OR, 1.2; 95% CI, 1.0–1.5; P = 0.039), and negatively associated with lipid-lowering drugs use (OR, 0.5; 95% CI, 0.3–0.9; P = 0.014 for statin medications) and subfoveal choroidal thickness (OR, 0.8; 95% CI, 0.7–0.9; P = 0.002). Conclusions: The prevalence of SDD was high in subjects older than 75 years, more frequent in women, and was associated with a thinner choroid. The association with lipid-lowering drugs deserves further investigation.