Laboratory simulation of aging cannot restore the complex aging behavior of bitumen well. The objective of study is to reveal the role of various field aging factors on the aging process of virgin bitumen and SBS(Styrene–Butadiene–Styrene)-modified bitumen. The influence of different field aging factors on aging behavior of virgin bitumen and SBS-modified bitumen were discussed. To achieve this goal, three different field aging styles were used to carry out field aging of virgin bitumen and SBS-modified bitumen. The aging behavior of the two types of bitumen were characterized based on rheological performance, and the influence degree of various aging factors on the rheological performance of bitumen was quantitatively analyzed through the contribution rates. The findings indicated that field aging had an obvious influence on the rheological performance of the two types of bitumen, which showed that the complex modulus, G-R parameter and stiffness modulus increased, and creep rate decreased. The contribution rates significantly indicated the degree of influence of hot oxygen, light and other factors (wind, water, dust, etc.) on the two types of bitumen. Among them, hot oxygen was the main factor leading to the aging of two types of bitumen. The virgin bitumen was not sensitive to aging caused by light, and the aging of SBS-modified bitumen was greatly affected by light. Other field aging factors (wind, water, dust, etc.) led to the aging of virgin bitumen to a certain extent, but inhibited the aging of SBS-modified bitumen.