Genetic resources of forest trees are considered as a key factor for the persistence of forest ecosystems because the ability of tree species to survive under changing climate depends strongly on their intraspecific variation in climate response. Therefore, utilizing available genetic variation in climate response and planting alternative provenances suitable for future climatic conditions is considered as an important adaptation measure for forestry. On the other hand, the distribution of adaptive genetic diversity of many tree species is still unknown and the predicted shift of ecological zones and species’ distribution may threaten forest genetic resources that are important for adaptation. Here, we use Norway spruce in Austria as a case study to demonstrate the genetic variation in climate response and to analyse the existing network of genetic conservation units for its effectiveness to safeguard the hotspots of adaptive and neutral genetic diversity of this species. An analysis of the climate response of 480 provenances, clustered into 9 groups of climatically similar provenances, revealed high variation among provenance groups. The most productive and promising provenance clusters for future climates originate from three regions that today depict the warmest and driest areas of the natural spruce distribution in Austria. Gap analysis of the Austrian genetic conservation units in the EUFGIS Portal suggests adequate coverage of the genetic hotspots in southern parts of Austria, but not in eastern and northern Austria. Therefore conservation measures and sustainable utilization of the valuable genetic resources in these regions need to be expanded to cover their high adaptive genetic variation and local adaptation to a warmer climate. The study shows that current conservation efforts need to be evaluated for their effectiveness to protect genetic resources that are important for the survival of trees in a future climate.