The contribution of the diet to potentially toxic trace element exposure in pregnancy has been rarely addressed. The objective of the present study was to determine the association between the maternal diet during pregnancy and biomarkers of exposure for arsenic (As), mercury (Hg) and lead (Pb) at delivery. As was assessed in maternal urine, Hg in maternal hair, and Pb in cord blood, as a proxy for in utero exposure. Based on 2995 women from the ELFE nationwide birth cohort, higher scores for dietary patterns considered healthy were associated with higher concentrations of As and Hg in maternal matrices. Levels of cord blood Pb were inconsistently associated with dietary patterns considered healthy, and lower with a dietary pattern driven by milk and breakfast cereals. Lower levels of Hg were associated with higher Western dietary pattern scores. In conclusion, higher levels of maternal urinary As and hair Hg are associated with diets considered as “Healthy”, while cord blood Pb was not strongly correlated with dietary exposure.