In the vehicle-to-everything scenario, the fuel cell bus can accurately obtain the surrounding traffic information, and quickly optimize the energy management problem while controlling its own safe and efficient driving. This paper proposes an energy management strategy (EMS) that considers speed control based on deep reinforcement learning (DRL) in complex traffic scenarios. Using SUMO simulation software (Version 1.15.0), a two-lane urban expressway is designed as a traffic scenario, and a hydrogen fuel cell bus speed control and energy management system is designed through the soft actor–critic (SAC) algorithm to effectively reduce the equivalent hydrogen consumption and fuel cell output power fluctuation while ensuring the safe, efficient and smooth driving of the vehicle. Compared with the SUMO–IDM car-following model, the average speed of vehicles is kept the same, and the average acceleration and acceleration change value decrease by 10.22% and 11.57% respectively. Compared with deep deterministic policy gradient (DDPG), the average speed is increased by 1.18%, and the average acceleration and acceleration change value are decreased by 4.82% and 5.31% respectively. In terms of energy management, the hydrogen consumption of SAC–OPT-based energy management strategy reaches 95.52% of that of the DP algorithm, and the fluctuation range is reduced by 32.65%. Compared with SAC strategy, the fluctuation amplitude is reduced by 15.29%, which effectively improves the durability of fuel cells.

In the context of intelligent and connected transportation, obtaining the real-time vehicle status and comprehensive traffic data is crucial for addressing challenges related to speed optimization and energy regulation in intricate transportation situations. This paper introduces a control method for the speed optimization and energy management of a fuel cell hybrid bus (FCHB) based on the Deep Deterministic Policy Gradient (DDPG) algorithm. The strategy framework is built on a dual-objective optimization deep reinforcement learning (D-DRL) architecture, which integrates traffic signal information into the energy management framework, in addition to conventional state spaces to guide control decisions. The aim is to achieve “green wave” traffic while minimizing hydrogen consumption. To validate the effectiveness of the proposed strategy, simulation tests were conducted using the SUMO platform. The results show that in terms of speed planning, the difference between the maximum and minimum speeds of the FCHB was reduced by 21.66% compared with the traditional Intelligent Driver Model (IDM), while the acceleration and its variation were reduced by 8.89% and 13.21%, respectively. In terms of the hydrogen fuel efficiency, the proposed strategy achieved 95.71% of the performance level of the dynamic programming (DP) algorithm. The solution proposed in this paper is of great significance for improving passenger comfort and FCHB economy.