Understanding vegetation changes and their driving forces in global alpine areas is critical in the context of climate change. We aimed to reveal the changing trend in global alpine vegetation from 1981 to 2015 using the least squares regression method and Mann-Kendall (MK) test. The area-of-influence dominated by anthropogenic activity and natural factors was determined in an area with significant vegetation change by residual analysis; the primary driving force of vegetation change in the area-of-influence dominated by natural factors was identified using the partial correlation method. The results showed that (1) the vegetation in the global alpine area exhibited a browning trend from 1981 to 2015 on the annual scale; however, a greening trend was observed from May to July on the month scale. (2) The influence of natural factors was greater than that of anthropogenic activities, and the positive impact of natural factors was greater than the negative impact. (3) Among the factors that were often considered as the main natural factors, the contribution of albedo to significant changes in vegetation were greater than that of temperature, precipitation, soil moisture, and sunshine duration. This study provides a scientific basis for the protection of vegetation and sustainable development in alpine regions.