The implementation principle of a typical three-pulse cold atom interference gyroscope is introduced in this paper. Based on its configuration and current research status, the problems of cold atom interference gyro are pointed out. The data-rate is insufficient, and it is difficult to achieve high dynamic measurement. Then, based on these two limitations, a novel design of the monitoring navigation system of the cold atom interference gyroscope (CAIG) and an intermediate-grade inertial measurement unit (IMU) was proposed to obtain the long-term position result without GPS signals, such as the Inertial Navigation System (INS) in underwater vehicles. While the CAIG was used as the external gyro, the bias of IMU and the misalignment angle between the CAIG-frame and the IMU-frame are obtained through filtering technique. The simulation test and field test demonstrated the improvements of the long-term positioning accuracy of the INS.