The prediction and control of passenger flow in scenic spots is very important to the traffic management and safety of scenic spots. This study aims to predict the passenger flow of a scenic spot based on the passenger flow of the bus and subway stations around the scenic spots. We propose a passenger flow prediction model based on graph convolutional network–recurrent neural network (GCN–RNN). First, a “graph” is constructed according to the geographical relationship between the scenic spot and the surrounding bus and subway stations. Then, characteristics of surrounding areas of bus and subway stations are constructed based on the crowd behavior analysis, and these are then used as the node-information of the “graph”. Last, the GCN–RNN model is used to extract the temporal and spatial characteristics of the passenger flow data of the scenic spot to realize the prediction. The experimental results show that the proposed model is effective in passenger flow prediction in scenic spots.