Considering mismatched disturbances, aerodynamic interference, chattering, and actuator failure in the attitude control of the quadrotor unmanned aerial vehicle (UAV), this paper establishes a new quadrotor UAV model with mismatched disturbances, based on quaternion, and designs a fault tolerant controller. First, in order to reduce the chattering of the traditional reaching law, a new reaching law based on the sigmoid function is introduced into the design. Second, the sliding mode control and backstepping control methods are adopted, based on the new fractional-order sliding mode surface when the faults occur in quadrotor UAV actuators, and parameters in the sliding mode control are adaptively adjusted. The simulation results show that the fault tolerant control method can control the attitude of UAV quickly and achieve good robustness.