Rich in history and culture, heritage sites often evoke stirring emotions and memories. We analyzed historical poetry using grounded theory and high-frequency word and semantic analysis to construct historic landscape images (HLIs) of the West Lake UNESCO World Heritage Site in Hangzhou, China. GPS trajectory data were used to identify hot and cold tourist spots and understand the site’s intra-attraction tourist behaviors (IATBs). Finally, we analyzed the HLI–IATB relationship. We found that the tourist distribution was uneven, and different attractions had different visitor behaviors. Our findings should inform future heritage site management—and neighboring cities—about the benefits of using HLIs to predict attraction visitors’ behaviors and leveraging those insights to optimize multiple-attraction sites proportionally. Such projections can provide new perspectives for heritage studies, landscape planning, and tourism image-making.