Various tools have been developed to model the aerodynamics of flapping wings. In particular, quasi-steady models, which are considerably faster and easier to solve than the Navier–Stokes equations, are often utilized in the study of flight dynamics of flapping wing flyers. However, the accuracy of the quasi-steady models has not been properly documented. The objective of this study is to assess the accuracy of a quasi-steady model by comparing the resulting aerodynamic forces against three-dimensional (3D) Navier–Stokes solutions. The same wing motion is prescribed at a fruit fly scale. The pitching amplitude, axis, and duration are varied. Comparison of the aerodynamic force coefficients suggests that the quasi-steady model shows significant discrepancies under extreme pitching motions, i.e., the pitching motion is large, quick, and occurs about the leading or trailing edge. The differences are as large as 1.7 in the cycle-averaged lift coefficient. The quasi-steady model performs well when the kinematics are mild, i.e., the pitching motion is small, long, and occurs near the mid-chord with a small difference in the lift coefficient of 0.01. Our analysis suggests that the main source for the error is the inaccuracy of the rotational lift term and the inability to model the wing-wake interaction in the quasi-steady model.