Foot-mounted inertial pedestrian positioning (FIPP) plays an important role for facilitating pedestrian activities. It is suitable for indoor environment applications where global navigation satellite systems are unavailable such as during firefighting and military actions. However, the positioning error of FIPP can increase rapidly due to the measurement noise of the sensors. Zero Velocity Update (ZUPT) is an error correction method proposed to solve this accumulative error. However, the heading misalignment angle, which results in a continuous increase in the positioning error, cannot be estimated by ZUPT. In order to solve this problem, the improved ZUPT based on the Improved Attitude Algorithm (IAA) according to accelerometer measurements is proposed in this paper. When a pedestrian is in the stance phase, the horizontal attitude is estimated by using accelerometer measurements. According to the relationship between the heading misalignment angle and horizontal attitude, the heading misalignment angle is obtained by a series of mathematical derivations. By taking the velocity error and the attitude misalignment angle as observations, the heading misalignment angle and positioning error can be estimated and compensated for through the Kalman filter. Finally, we use MTI-G710 sensor manufactured by XSENS for the actual test and the experiment results show that the proposed method is effectively correct.