The integration of large-scale distributed generators into active distribution networks (ADNs) will aggravate voltage fluctuations, which can affect the secure operation of power grids seriously. In this article, we investigate a cooperated voltage regulation problem of ADNs. Specifically, we first formulate a two-timescale voltage regulation problem considering the coordination of various hybrid devices while reducing the power loss of the whole ADNs. Given that the aforementioned problem is challenging to solve directly, we reformulate it as bilevel Markov games. Then, we propose a hierarchical multi-agent attention-based deep reinforcement learning algorithm to solve them. To be specific, the upper level Markov game is solved by a discrete multi-actor-attention-critic (MAAC) algorithm, and the lower level Markov game is solved by a continuous MAAC algorithm. In addition, the two-timescale coordination between upper level and lower level agents is implemented through the information exchange of rewards during the training process. Simulation results show that the proposed algorithm has good effectiveness, robustness, and scalability in voltage regulation.
18 October 2023 in IEEE Transactions on Network Science and Engineering
In this paper, we study the dynamic of cascading failure iterating between physical power grid and communication network, and further propose the attack strategy to locate the critical nodes which can seriously damage the cyber-physical power systems. First, the coupling connection between physical power grid and communication network is modeled, along with the power flow of physical power grid and the data flow of communication network. Then, the zone-based coupling model is proposed to detail the failure cascading in systems and its impact on coupled networks. Third, based on electrical and structural characteristic, the criticality of nodes is defined to devise attack strategy to locate the vulnerability of systems. The simulation has analyzed the impact of failure nodes on coupled networks and verified the effectiveness of proposed attack strategy.
Due to the fluctuation of renewable energy, the uncertainty of electrical loads, and the complexity of networked microgrids, it is challenging to dispatch multiple resources to minimize the operating cost of multi-microgrid system (MMGS). In this article, a fog-assisted operating cost minimization problem of MMGS is investigated with the consideration of source-grid-load-storage-computing coordination. Since there are strong couplings among multiple resources, it is difficult to solve the problem directly. Therefore, the above problem is reformulated as a Markov game. Then, a novel energy management algorithm is proposed to solve Markov game based on multiagent deep reinforcement learning. It is worth mentioning that the proposed energy management algorithm can support local real-time decisions for each microgrid without knowing any prior knowledge of uncertain parameters and private information of other microgrids. Simulation results indicate that the proposed algorithm can reduce the long-term cost of each microgrid by 0.09 $\%$ –8.02 $\%$ compared with baselines.
22 February 2023 in International Journal of Electrical Power & Energy Systems
With the widespread proliferation of electric vehicles (EVs), optimizing the operation of EV charging stations (EVCSs) has become increasingly important. Strategic charging prices can influence both revenue and service efficiency, while differentiated pricing for different EVs can further help mitigate overstay issues. Moreover, under the concept of the peer-to-peer (P2P) sharing economy, energy, and carbon (E&C) allowance trading among EVCSs presents a significant opportunity to reduce both operational costs and carbon emissions. However, limited research has examined such interactions and the specific economic and environmental impacts of joint E&C trading in multi-EVCS systems. In this article, we investigate a joint differentiated pricing and E&C trading problem for multiple EVCSs, aiming to maximize both economic and environmental benefits. Specifically, we first formulate a total revenue-maximization problem that incorporates anxiety-differentiated pricing and P2P E&C trading among multiple interconnected EVCSs. We then propose an operational algorithm to solve the problem based on Nash bargaining and the alternating direction method of multipliers (ADMM), which can protect privacy and mitigate communication barriers among EVCSs. Simulation results demonstrate that the proposed algorithm can simultaneously improve revenue and achieve low-carbon goals.