Determining the driving climatic factors at critical periods and potential legacy effects is crucial for grassland productivity predictions on the Qinghai–Tibet Plateau (QTP). However, studies with limited and ex situ ground samples from highly heterogeneous alpine meadows brought great uncertainties. This study determined the key climatic factors at critical plant developmental stages and the impact of previous plant growth status for interannual aboveground net primary productivity (ANPP) variations in different QTP grassland types. We hypothesize that the impact of climatic factors on grassland productivity varies in different periods and different vegetation types, while its legacy effects are not great. Pixel-based partial least squares regression was used to associate interannual ANPP with precipitation and air temperature at different developmental stages and prior-year ANPP from 2000 to 2019 using remote sensing techniques. Results indicated different findings from previous studies. Precipitation at the reproductive stage (July–August) was the most prominent controlling factor for ANPP which was also significantly affected by precipitation and temperature at the withering (September–October) and dormant stage (November–February), respectively. The influence of precipitation was more significant in alpine meadows than in alpine steppes, while the differentiated responses to climatic factors were attributed to differences in water consumption at different developmental stages induced by leaf area changes, bud sprouting, growth, and protection from frost damage. The prior-year ANPP showed a non-significant impact on ANPP of current year, except for alpine steppes, and this impact was much less than that of current-year climatic factors, which may be attributed to the reduced annual ANPP variations related to the inter-annual carbon circulation of alpine perennial herbaceous plants and diverse root/shoot ratios in different vegetation types. These findings can assist in improving the interannual ANPP predictions on the QTP under global climate change.