Large quantities of carbon are stored in alpine grassland of the Tibetan Plateau, which is extremely sensitive to climate change. However, it remains unclear whether soil organic matter (SOM) in different layers responds to climate change analogously, and whether microbial communities play vital roles in SOM turnover of topsoil. In this study we measured and collected SOM turnover by the 14C method in alpine grassland to test climatic effects on SOM turnover in soil profiles. Edaphic properties and microbial communities in the northwestern Qinghai Lake were investigated to explore microbial influence on SOM turnover. SOM turnover in surface soil (0–10 cm) was more sensitive to precipitation than that in subsurface layers (10–40 cm). Precipitation also imposed stronger effects on the composition of microbial communities in the surface layer than that in deeper soil. At the 5–10 cm depth, the SOM turnover rate was positively associated with the bacteria/fungi biomass ratio and the relative abundance of Acidobacteria, both of which are related to precipitation. Partial correlation analysis suggested that increased precipitation could accelerate the SOM turnover rate in topsoil by structuring soil microbial communities. Conversely, carbon stored in deep soil would be barely affected by climate change. Our results provide valuable insights into the dynamics and storage of SOM in alpine grasslands under future climate scenarios.