Currently, fixed-parameter proportional–integral–derivative (PID) control is widely adopted by the governor of hydropower units (HPUs), which causes regulation performance to deteriorate during variable operating conditions. To solve this problem, a novel particle swarm optimization-based fuzzy PID (PSO-FPID) is proposed for the frequency regulation of HPUs. The segment linearization model of HPU is first established to reflect the changes in the operating conditions. On this basis, FPID is designed based on expert experience. The PID control parameters are optimized using PSO under different operating conditions to determine the optimal initial values of the FPID controller. To verify the effectiveness of the proposed PSO-FPID, its performance is compared and analyzed with the actual PID, FPID, and particle swarm optimization-based PID (PSO-PID) in the MATLAB/Simulink platform. The results show that the average adjust time of PSO-FPID is 16.60 s less than that of PID, 18.05 s less than that of FPID, and 0.23 s less than that of PSO-PID. PSO-FPID can maintain better control performance than the other methods under most operating conditions.