As an emerging energy carrier, hydrogen presents a potential opportunity to increase the flexibility and resiliency of the integrated power and transportation system having ultrahigh penetration of renewable generation. This article studies a conceptual integrated energy-mobility system (IEMS) based on renewable-to-hydrogen stations (RHSs) and tank truck fleets. In an RHS, the renewables power the grid while also charge a hydrogen energy storage unit that can perform power-to-hydrogen (P2H) and hydrogen-to-power (H2P) operations. Besides, using tank truck fleets, the RHS will distribute its surplus hydrogen products to local consumers, e.g., refueling stations serving hydrogen fuel cell vehicles. The operation framework of the IEMS is analyzed. And some preprocessing technologies are developed to reduce modeling complexity. Then, a joint optimal scheduling model, involving renewable generationcontract, P2H, and H2P of the RHS, hydrogen product demands of the local consumers, and vehicle routing problem (VRP) of the truck fleets, is established. Afterwards, the formulated problem is solved by a heuristic method based on the exhaustive search and genetic algorithm. Numerical results verify the effectiveness of the joint optimal scheduling model and illustrate that the IEMS has the potentials to promote hydrogen-integrated transportation and power systems.
The deregulated active distribution network (ADN) would incorporate numerous autonomous stakeholders, including some emerging distributed virtual alliances (DVAs) like virtual microgrids and virtual power plants. Those DVAs would autonomously participate in energy market trading through bidding among themselves and dispatching conducted by the ADN. In this paper, the optimal bidding and dispatching model for DVAs and ADN in the day-ahead market is first developed as a stochastic dynamic programming model with the risk of misconduct considered, and then re-formulated as a Markov Decision Process to be solved by a new Distributed Robust Multi-Agent Deep Deterministic Policy Gradient algorithm based on the concept of robust Nash equilibrium (RNE). This algorithm is a fully distributed online optimization that would converge to RNE. It is an effective risk-averse method to obtain the optimal bidding strategies of DVAs and the optimal dispatching decisions of distribution system operator (DSO). Its high computational performance is demonstrated in the case studies, and the strategic decisions of DVAs and DSO are thoroughly analyzed.
2 September 2021 in IEEE Transactions on Industry Applications
Under the pressure of climate change, hydrogen has been advocated as a promising energy carrier to achieve low-carbon integration of urban transportation network (UTN) and power distribution network (PDN). In this article, the control strategy based on hydrogen refueling service fee (HRSF) is proposed for the smart city department to guide hydrogen fuel cell electric vehicles (HFCEVs) in selecting the hydrogen refueling stations. Correspondingly, the HRSF-based coordinated operation model is established to minimize the total of UTN travel cost, PDN operation cost, and the environmental cost, while the nodal carbon intensity restriction, the uncertainties of renewable distributed generators output, and origin-destination traffic demand are also taken into account. Afterward, the proposed model is solved by the decentralized alternative direction method of multipliers algorithm, and verified on the hydrogen-integrated UTN and PDN in Sioux Falls. Numerical results demonstrate that popularizing HFCEVs contributes to emission reduction, and the HRSF-based coordinated operation strategy is effective in reducing the overall emissions, promoting renewable energy accommodation, and improving the holistic operation efficiency of the hydrogen-integrated UTN and PDN.
In this letter, the evolutionary game theory (EGT) with replication dynamic equations (RDEs) is adopted to explicitly determine the factors affecting energy providers’ (EPs) willingness of using the market power to uplift the price in the bidding procedure, which could be simulated using the win-or-learn-fast policy hill climbing (WoLF-PHC) algorithm as a multi-agent reinforcement learning (MARL) method. Firstly, empirical and numerical connections between WoLF-PHC and RDEs is proved. Then, by formulating RDEs of the bidding procedure, three factors affecting the bidding strategy preference are revealed, including the load demand, severity of congestion, and the price cap. Finally, the impact of these factors on the converged bidding price is demonstrated in case studies, by simulating the bidding procedure driven by WoLF-PHC.
30 November 2022 in IEEE Transactions on Power Systems
The joint Peer-to-Peer (P2P) electricity market (EM) and carbon emission auction market (CEAM) among prosumer microgrids (MGs) in the distribution network is a promising paradigm to facilitate the participation of distributed energy resources (DERs) and incentivize the decarbonization. In this market, MGs will modify their bidding strategies to be adaptive to other rival MGs' for profit maximization. Such modification will converge to the Nash Equilibrium Point (NEP), where each MG cannot obtain more profits by modifying its strategy subject to the fixed strategy of other rival MGs. In this paper, the NEP under such a joint market paradigm is investigated, in which MGs will trade electricity in the EM and purchase carbon emission quotas (CEQs) in the CEAM. In addition, MGs must adjust their bidding strategies considering penalties due to deviations between day-ahead (DA) scheduling and real-time (RT) procurement caused by uncertainties of net load, as well as the price fluctuation in the CEAM. The NEP is estimated by a novel Multi-agent Deep Deterministic Policy Gradient (MADDPG) algorithm, and the risk mitigation is achieved by incorporating the conditional value-at-risk (CVaR) constraint. The computational performance and effectiveness of risk mitigation of this proposed algorithm, and the obtained NEP in the joint EM and CEAM, are analyzed in the case studies.