With the increasing penetration of renewable energy and flexible loads in smart grids, a more complicated power system with high uncertainty is gradually formed, which brings about great challenges to smart grid operations. Traditional optimization methods usually require accurate mathematical models and parameters and cannot deal well with the growing complexity and uncertainty. Fortunately, the widespread popularity of advanced meters makes it possible for smart grid to collect massive data, which offers opportunities for data-driven artificial intelligence methods to address the optimal operation and control issues. Therein, deep reinforcement learning (DRL) has attracted extensive attention for its excellent performance in operation problems with high uncertainty. To this end, this article presents a comprehensive literature survey on DRL and its applications in smart grid operations. First, a detailed overview of DRL, from fundamental concepts to advanced models, is conducted in this article. Afterward, we review various DRL techniques as well as their extensions developed to cope with emerging issues in the smart grid, including optimal dispatch, operational control, electricity market, and other emerging areas. In addition, an application-oriented survey of DRL in smart grid is presented to identify difficulties for future research. Finally, essential challenges, potential solutions, and future research directions concerning the DRL applications in smart grid are also discussed.
In recent years, hydrogen fueling electric vehicles (H2EVs) have developed rapidly and drawn much attention. Indeed, the prevalence of H2EVs may introduce a notable interaction between the power network (PN) and the transportation network (TN) via the hydrogen fueling station (HFS). Therefore, it is worth investigating the efficient interaction of PN and HFSs under the constraints of coupled power flow in the PN and traffic flow in the TN. To this end, this article establishes the operation model of HFSs coupled power-traffic system, in order to investigate their impact relationship. Then, a collaborative operation framework with peer-to-peer (P2P) energy trading is proposed to promote the interactive efficiency between the PN and the HFS, considering both energy and reserve. On this basis, the P2P energy trading strategy with dynamic pricing and arbitrage prevention mechanism is developed to further reduce the total operation cost and ensure the fairness of the transaction. Case studies on the HFS-coupled power-traffic system verify the effectiveness of our proposed operation model and the collaborative framework considering P2P energy trading, which results in a lower operation cost, compared with the independent operation and collaborative operation without P2P energy trading, respectively.