This study, part of the NCHRP 9–45 Project, analyzed the effect of mineral filler properties on asphalt mastic and the rutting potential of asphaltic mixture. The mineral filler properties were characterized by four tests: Rigden voids (RV), fineness modulus (FM), calcium oxide (CaO) content, and methylene blue value. The rheological properties of asphalt binder and mastic were characterized with the use of apparent viscosity and multiple stress creep recovery tests. Dynamic modulus and flow number tests were conducted to examine the asphaltic mixture rutting potential. The tested mixtures included several variables: four asphalt binder types, including virgin and polymer modified; two aggregate gradations; and a selected group of fillers. The study concluded that asphalt mastic performance was significantly affected by the fractional voids in the filler and possibly by the CaO content and FM. This effect, however, depended on binder type. On the one hand, the styrene–butadiene–styrene modified binder showed the strongest effect as a result of the mineral filler inclusion when tested as mastic. On the other hand, RV and CaO content showed relatively greater correlation with the mixture rutting potential, as compared with other filler properties. Addition of RV improved the prediction models for dynamic modulus and flow number. The effect of RV on the mixture rutting potential was more pronounced for the coarse mixture than for the fine mixture.