Ecologically fragile areas typically overlap with impoverished zones, rendering them susceptible to a vicious cycle of ecological degradation and poverty aggravation. Reasonable and diversified ecological compensation methods are closely associated with improved livelihood resilience among rural households in sandy areas. Building on this, we take three leagues and cities in Inner Mongolia with severe sandy desertification as the study area. OLS regression and mediating effect models are employed to examine the impact of diversified ecological compensation methods on the livelihood resilience of rural households in sandy areas, as well as the underlying mechanisms and heterogeneity. The results demonstrate that (1) diversified ecological compensation methods exert a significant positive effect on the livelihood resilience of rural households in sandy areas; (2) perceived fairness and livelihood diversity mediate the association between diversified ecological compensation methods and the livelihood resilience of rural households in sandy areas; (3) the effects of diversified ecological compensation methods on the livelihood resilience of rural households in sandy areas vary significantly across compensation modalities, beneficiary groups, and regions. Specifically, capacity-building compensation exerts a significantly stronger effect than direct-transfer compensation; poverty-alleviated households benefit more than general households; and the effects are significantly stronger in western Inner Mongolia than in eastern Inner Mongolia. Therefore, in optimizing ecological compensation policies in sandy areas, it is suggested to enhance the embedding depth of industrial and technical compensation, and to explore differentiated compensation pathways based on regional market capacity and household group characteristics, thereby promoting sustainable livelihood development for rural households in sandy areas.