As the protection layer of world natural heritage sites, the buffer zone should enable economic development while protecting the environment. To carry out agricultural activities in the buffer zone, it is necessary to balance agricultural development and environmental protection. In addition, the development of agroforestry has the benefits of developing the economy, maintaining biodiversity, and protecting the environment. In order to promote the coordination of environmental protection and community economic development, it is particularly important to scientifically select agroforestry planting patterns in the buffer zone of world natural heritage sites. This study utilized a mixed-methods research approach that included qualitative and quantitative research. Taking the buffer zone of Shibing Karst Heritage Site in southern China as an example, based on the seven agroforestry planting patterns surveyed in the buffer zone of the world natural heritage site, the four dimensions of net output value, carbon emission, environmental cost, and comprehensive livelihood score of different agroforestry planting patterns were calculated. The sorting scores of the values were calculated as Borda numbers. The sorting scores of the seven agroforestry planting patterns were B(A1) = 17, B(A2) = 18, B(A3) = 8, B(A4) = 8, B(A5) = 14, B(A6) = 12, and B(A7) = 7. The results showed that the priority sequence of seven agroforestry patterns was A2 > A1 > A5 > A6 > A3 = A4 > A7. A2 was the best among the seven agroforestry planting patterns, and A7 ranked last. The results can provide a quantitative evaluation basis for scientific optimization of agroforestry development planting patterns, and provide a reference for promoting the protection of world natural heritage.