In order to accurately characterize the temperature dependence of the high-temperature performance of asphalt pavement surface layer materials, this paper studies the effects of temperature, load, and number of actions on the high-temperature anti-rutting performance of asphalt pavement surface layer materials (AC-13 and AC-16 mixtures), based on indoor rutting tests, and constructs a high-temperature performance temperature-dependent model and rutting prediction model for surface layer materials. The results show that as the temperature increases, the dynamic stability of the mixture decreases in an S-shaped curve, and the rut depth increases exponentially. The temperature-dependent model transition temperatures for the dynamic stability of 70#, 50#, 30#, SBS, and HMB asphalt mixtures are 39 °C, 44 °C, 46 °C, 56 °C, and 56 °C, respectively. The dynamic stability of modified asphalt mixtures is significantly higher than that of base asphalt mixtures. The depth of wheel ruts is affected by temperature, load, and the number of actions. The variation ranges of the load index k_P, the temperature index k_T, and the number of actions index k_N are 0.727–1.222, 1.926–2.177, and 0.133–0.295, respectively. The correlation coefficients of the wheel rut prediction model are all above 0.95, and the depth of wheel ruts can be predicted by the model.