In recent decades, droughts, deforestation and wildfires have become recurring phenomena that have heavily affected both human activities and natural ecosystems in Amazonia. The time needed for an ecosystem to recover from carbon losses is a crucial metric to evaluate disturbance impacts on forests. However, little is known about the impacts of these disturbances, alone and synergistically, on forest recovery time and the resulting spatiotemporal patterns at the regional scale. In this study, we combined the 3-PG forest growth model, remote sensing and field derived equations, to map the Amazonia-wide (3 km of spatial resolution) impact and recovery time of aboveground biomass (AGB) after drought, fire and a combination of logging and fire. Our results indicate that AGB decreases by 4%, 19% and 46% in forests affected by drought, fire and logging + fire, respectively, with an average AGB recovery time of 27 years for drought, 44 years for burned and 63 years for logged + burned areas and with maximum values reaching 184 years in areas of high fire intensity. Our findings provide two major insights in the spatial and temporal patterns of drought and wildfire in the Amazon: (1) the recovery time of the forests takes longer in the southeastern part of the basin, and, (2) as droughts and wildfires become more frequent—since the intervals between the disturbances are getting shorter than the rate of forest regeneration—the long lasting damage they cause potentially results in a permanent and increasing carbon losses from these fragile ecosystems.