Rural forests, i.e. farm forests and trees outside forests (TOF), are part of traditional agroforestry systems in many European regions. Yet, the industrialization of agriculture has induced the decline of rural forests and promoted a physical and functional separation between trees and agriculture. Despite the recent promotion of TOF in the Common Agriculture Policy (CAP), most farmers do not reinforce them in their farms. In order to understand farmers’ attitudes towards rural forests, we conducted 19 face-to-face interviews in southwestern France. Farmers identified 32 positive contributions, including 29 ecosystem services (ES), associated with rural forests. Similarly, they emphasized 25 negative contributions, including 21 ecosystem disservices (EDS). Contributions varied with the type of forested area. For instance, hedgerows had high levels of positive and negative contributions, while woods had high levels of positive and low levels of negative contributions. Finally, farmers identified 19 stakeholders and institutions, especially the CAP, that influenced rural forest management. In focusing on the balance between positive and negative contributions, our study enabled us to uncover the complex rationale of local rural forest management. Ecosystem disservices and CAP policies tended to discourage farmers to reinforce rural forests in their farms. Taking into account farmers’ rationale and perceptions may give invaluable information to better target public policies.