Thermal tolerance range, based on temperatures that result in incapacitating effects, influences species' distributions and has been used to predict species' response to increasing temperature. Reproductive performance may also be negatively affected at less extreme temperatures, but such sublethal heat-induced sterility has been relatively ignored in studies addressing the potential effects of, and ability of species' to respond to, predicted climate warming. The few studies examining the link between increased temperature and reproductive performance typically focus on adults, although effects can vary between life history stages. Here we assessed how sublethal heat stress during development impacted subsequent adult fertility and its plasticity, both of which can provide the raw material for evolutionary responses to increased temperature. We quantified phenotypic and genetic variation in fertility of Drosophila melanogaster reared at standardized densities in three temperatures (25, 27, and 29°C) from a set of lines of the Drosophila Genetic Reference Panel (DGRP). We found little phenotypic variation at the two lower temperatures with more variation at the highest temperature and for plasticity. Males were more affected than females. Despite reasonably large broad-sense heritabilities, a genome-wide association study found little evidence for additive genetic variance and no genetic variants were robustly linked with reproductive performance at specific temperatures or for phenotypic plasticity. We compared results on heat-induced male sterility with other DGRP results on relevant fitness traits measured after abiotic stress and found an association between male susceptibility to sterility and male lifespan reduction following oxidative stress. Our results suggest that sublethal stress during development has profound negative consequences on male adult reproduction, but despite phenotypic variation in a population for this response, there is limited evolutionary potential, either through adaptation to a specific developmental temperature or plasticity in response to developmental heat-induced sterility.