Traditional grass-roofed dwellings are important components of Chinese vernacular architecture. Building a comprehensive nationwide database of traditional grass-roofed dwellings is crucial for the inherence of this cultural heritage and its traditional ecological technologies. This study proposes classifying traditional Chinese grass-roofed dwellings into three types according to recognizable appearance features. Based on the YOLOv8 deep learning framework, a recognition model is constructed to recognize and spatially locate various grass-roofed dwellings from the image dataset on a county-level. Further, by conducting spatial overlap analysis with a variety of natural and socio-environmental factors on ArcGIS, their influences on the distribution pattern of traditional grass-roofed dwellings were examined. The study findings are as follows: (1) Traditional grass-roofed dwellings are concentrated on the southeast side of the Hu Line with different distribution patterns according to their types. (2) The natural environment influences the original construction and distribution of traditional grass-roofed dwellings in terms of the growth of grass resources and the ecological adaptability of grass material. (3) The development of economy, population, and urbanization pose challenges to the retention of grass-roofed dwellings. This research provides useful references for the precise preservation of various grass-roofed dwellings and introduced a novel approach for the classification of traditional buildings.