The effects of alloying elements (Si, Cr, Mo) on the solution and diffusion of oxygen (O) atoms at the grain boundary of iron (Fe) Σ5(310)/[001] are investigated by the simulations of ab initio density functional theory (DFT). It is found that Si, Mo and Cr prefer to segregate to the grain boundary, and further affect the solution and diffusion of O atoms at Fe grain boundaries. The segregated Cr promotes the solution of O, while Si and Mo inhibit the solution of O at the grain boundary. Meanwhile, Cr and Si accelerate the diffusion of O, and Mo retards the diffusion of O in the grain boundary. Further analysis indicates that the effects are closely related to the interactions between the alloying elements and O atoms, which are determined by the competition between the distortion of local structure and the charge transfer between local atoms. Finally, the effects of alloying elements on the O concentration distribution near the grain boundary are explored by employing the Langmuir–McLean models. This work not only provides insights into the effects of alloying elements on the solution and diffusion of O at grain boundaries, but also provides parameters of the atomic interactions for the initial oxidation simulation on a large scale, which relates to the growth of oxide in polycrystalline systems with various grain sizes at experimental temperatures.