Piezoelectric actuators are widely used in the field of micro- and nanopositioning due to their high frequency response, high stiffness, and high resolution. However, piezoelectric actuators have hysteresis nonlinearity, which severely affects their positioning accuracy. As the driving frequency increases, the performance of piezoelectric actuators further degrades. In addition, the impact of force on piezoelectric actuators cannot be ignored in practical applications. Dynamic hysteresis with force-voltage coupling makes the hysteresis phenomenon more complicated when force and driving voltage are both applied to the piezoelectric actuator. Existing hysteresis models are complicated, or inaccurate in describing dynamic hysteresis with force-voltage coupling. To solve this problem, a force-voltage-coupled Prandtl–Ishlinskii (FVPI) model is proposed in this paper. First, the influence of driving frequency and dynamic force on the output displacement of the piezoelectric actuators are analyzed. Then, the accuracy of the FVPI model is verified through experiments. Finally, a force integrated direct inverse (F-DI) compensator based on the FVPI model is designed. The experimental results from this study show that the F-DI compensator can effectively suppress dynamic hysteresis with force-voltage coupling of piezoelectric actuators. This model can improve the positioning accuracy of piezoelectric actuators, thereby improving the working accuracy of the micro- or nano-operating system.