Agroforestry, the integration of trees, crops, and animals, is expected to increase environmental sustainability of fruit production compared to traditional orchards. Virtual experiments with models would allow the performance and sustainability of these systems to be evaluated in a range of pedoclimatic and management scenarios, taking into account the interactions of fruit trees with crops. The models should represent tree and crop growth in 3D, run simulations over the whole life cycle of the orchard, and account for management practices that influence tree-crop interactions. We reviewed existing fruit tree and agroforestry models and have proposed a decision tree to guide future modellers in choosing a model that meets their simulation objectives. None of the reviewed models met all requirements, but we identified improvements that could be made to two existing models to accurately simulate temperate fruit tree based agroforestry systems.