This study aimed to characterize paternal diet during the peri-conception period and its associated characteristics. These cross-sectional analyses were based on 998 fathers from the French nationwide ELFE birth cohort recruited in 2011. Fathers’ diet before mothers’ pregnancies was assessed by a 46-item food frequency questionnaire. Six exploratory dietary patterns were identified by principal component analysis: “Diverse diet”, “Balanced”, “Alcohol”, “Snacking”, “Bread and cheese”, and “Processed products”. Older age was related to higher scores for the “Balanced”, “Alcohol”, and “Snacking” patterns, and high education level with high scores on the “Balanced” pattern and low scores on the “Processed products” pattern. Unemployment and having a first child were related to high scores on the “Alcohol” pattern. Smoking was positively related to “Alcohol” and “Processed products” patterns. A restrictive diet was associated with high scores on the “Balanced” and “Processed products” patterns and low scores on “Alcohol”, “Snacking”, and “Bread and cheese” patterns. Maternal dietary patterns, identified in a previous analysis, were moderately and positively related to the similar patterns among fathers. These findings are important for screening fathers at risk of a suboptimal diet and for accounting for this factor in future studies to examine the specific influence of paternal diet on a child’s health and development.