In vehicle GNSS/INS integrated navigation, robust and adaptive algorithms have become one of the key technologies for achieving a comprehensive PNT due to their ability to control the gross errors of the observation model and dynamic model. The Sage–Husa algorithm is widely used in optimizing the Kalman filter due to its ability to estimate the observation or state covariance without prior information. However, the quality of observations in complex environments is prone to large fluctuations, so the averaging method is not suitable for dynamic navigation. To solve this problem, this article designs a double window structure and introduces a time-dependent fading weighted factor. At the same time, a logarithmic form factor constructor is proposed in order to avoid anomalies in the robust and adaptive factor. The traditional innovation adaptive filter is improved and turned into a multi-factor adaptive filter. In this paper, an improved fault detection algorithm is used to combine a robust algorithm with an adaptive algorithm to adapt to different gross errors in different scenarios. The experimental results of complex scenarios show that the position RMSE of the improved algorithm in the east, north, and height directions is 0.68 m, 0.71 m, and 1.05 m, respectively, which are reduced by 39.3%, 39.3%, and 70.3% compared to the EKF.