In this work, a reconfigurable ultra-wideband transmissive terahertz polarization rotator based on graphene metamaterial is proposed that can switch between two states of polarization rotation within a broad terahertz band by changing the Fermi level of graphene. The proposed reconfigurable polarization rotator is based on a two-dimensional periodic array of multilayer graphene metamaterial structure, which is composed of metal grating, graphene grating, silicon dioxide thin film, and a dielectric substrate. The graphene metamaterial can achieve high co-polarized transmission of a linearly polarized incident wave at the off-state of the graphene grating without applying the bias voltage. Once the specially designed bias voltage is applied to change the Fermi level of graphene, the polarization rotation angle of linearly polarized waves is switched to 45° by the graphene metamaterial at the on-state. The working frequency band with 45-degree linear polarized transmission remaining above 0.7 and the polarization conversion ratio (PCR) above 90% is from 0.35 to 1.75 THz, and the relative bandwidth reaches 133.3% of the central working frequency. Furthermore, even with oblique incidence at large angles, the proposed device retains high-efficiency conversion in a broad band. The proposed graphene metamaterial offers a novel approach for the design of a terahertz tunable polarization rotator and is expected to be applied in the applications of terahertz wireless communication, imaging, and sensing.