Significance Ecosystems’ feedback to climate change remains a source of uncertainty in global models that project future climate conditions. That uncertainty rests largely on how much soil carbon will be lost as microbial respiration and how that loss varies across ecosystems. Although there has been a large emphasis on microbial temperature responses, how soil microorganisms respond to changes in moisture remains poorly understood. Here we show that historical rainfall controls soil respiration responses to current moisture. This finding was robust, with historical climate repeatedly limiting current respiration regardless of alterations to soil moisture, rainfall, or the arrival of new taxa. This study highlights the importance that legacies in microbial responses to climate change can have in future ecosystem responses.