In recent years, climate impact assessments of relevance to the agricultural and forestry sectors have received considerable attention. Current ecosystem models commonly capture the effect of a warmer climate on biomass production, but they rarely sufficiently capture potential losses caused by pests, pathogens and extreme weather events. In addition, alternative management regimes may not be integrated in the models. A way to improve the quality of climate impact assessments is to increase the science-stakeholder collaboration, and in a two-way dialog link empirical experience and impact modelling with policy and strategies for sustainable management. In this paper we give a brief overview of different ecosystem modelling methods, discuss how to include ecological and management aspects, and highlight the importance of science-stakeholder communication. By this, we hope to stimulate a discussion among the science-stakeholder communities on how to quantify the potential for climate change adaptation by improving the realism in the models.