Transgenerational reprogramming of DNA methylation is important for transposon silencing and epigenetic inheritance. A stochastic regulation of methylation states in the germline may lead to epigenetic variation and the formation of epialleles that contribute to phenotypic variation. In Arabidopsis thaliana inbred lines, the frequency of single base variation of DNA methylation is much higher than genetic mutation and, interestingly, variable epialleles are pre-methylated in the male germline. However, these same alleles are targeted for demethylation in the pollen vegetative nucleus, by a mechanism that seems to contribute to the accumulation of small RNAs that reinforce transcriptional gene silencing in the gametes. These observations are paving the way toward understanding the extent of epigenetic reprogramming in higher plants, and the mechanisms regulating the stability of acquired epigenetic states across generations.