Students majoring in physical education are the main source of physical education teachers in Chinese schools, and they are the main body in achieving the function of physical education in schools. The improvement of their altruistic behavior helps enhance the educational literacy of outstanding physical education teachers. This study conducted a questionnaire survey on 310 students majoring in physical education from 5 universities in 5 selected regions using the General Interpersonal Communication Objective Scale, Interpersonal Reactivity Index-C, the “responsibility” subscale of the Big Five Inventory Questionnaire, and the Altruistic Behavior of College Students questionnaire. We performed correlation analysis, mediation effect analysis, and moderation effect analysis on the data using SPSS 24.0 and MPLUS 7.4. Empathy partially mediates 30% of the total effect between interpersonal relationships and altruistic behavior; social responsibility has a moderating effect on empathy and altruistic behavior, with higher levels of responsibility having a greater moderating effect. Interpersonal relationships, empathy, and a sense of responsibility affect the current, recent, and long-term states of altruistic behavior, respectively. To improve students’ altruistic behavior throughout the entire process, schools should develop training systems specifically for interpersonal relationships, empathy, and social responsibility.