In the field of surveying and mapping, inertial sensor deterministic errors are poorly understood, and error calibration and compensation are not carried out. Thus, in this study, the effects of three types of deterministic errors (i.e., bias, scale factor error, and installation error) in a conventional inertial measurement unit (IMU) error model on a navigation system are theoretically deduced and verified by simulation. Subsequently, navigation experiments are carried out to investigate the effects of the three deterministic errors on the navigation system. The experimental results show that the gyro bias has the strongest influence on the navigation and positioning accuracy of the system. Consequently, we designed a two-position continuous calibration scheme to calibrate the IMU. The calibration scheme can simultaneously calibrate the bias error of the gyroscope and the accelerometer. When calibrating the bias error of the 0.005°/h order of magnitude, the maximum relative error is 13.16%, and the rest of the calibration relative errors are less than 10%, which verifies the effectiveness of the calibration path designed in this paper. The system is compensated by using the IMU bias calibration results, and the navigation experiment results show that the position accuracy and heading accuracy are improved by 72.68% and 79.65%, respectively, through the calibration and compensation of IMU bias error. Therefore, the position and heading accuracy of the system will be greatly improved by calibrating and compensating the bias error through the two-position calibration path before the IMU is used.