Ding Liu

Dr. Ding Liu

orcid

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
2 February 2023 in Sensors
Verified
Journal Article
Open access
PDF file
DLDing Liu
Ding Liu
PZPeng Zeng
Peng Zeng
SCShijie Cui
Shijie Cui
CSChunhe Song
Chunhe Song
The rapid development of electric vehicle (EV) technology and the consequent charging demand have brought challenges to the stable operation of distribution networks (DNs). The problem of the collaborative optimization of the charging scheduling of EVs and voltage control of the DN is intractable because the uncertainties of both EVs and the DN need to be considered. In this paper, we propose a deep reinforcement learning (DRL) approach to coordinate EV charging scheduling and distribution network voltage control. The DRL-based strategy contains two layers, the upper layer aims to reduce the operating costs of power generation of distributed generators and power consumption of EVs, and the lower layer controls the Volt/Var devices to maintain the voltage stability of the distribution network. We model the coordinate EV charging scheduling and voltage control problem in the distribution network as a Markov decision process (MDP). The model considers uncertainties of charging process caused by the charging behavior of EV users, as well as the uncertainty of uncontrollable load, system dynamic electricity price and renewable energy generation. Since the model has a dynamic state space and mixed action outputs, a framework of deep deterministic policy gradient (DDPG) is adopted to train the two-layer agent and the policy network is designed to output discrete and continuous control actions. Simulation and numerical results on the IEEE-33 bus test system demonstrate the effectiveness of the proposed method in collaborative EV charging scheduling and distribution network voltage stabilization.

30 March 2023 in Frontiers in Energy Research
Verified
Journal Article
Open access
DLDing Liu
Ding Liu
CZChuanzhi Zang
Chuanzhi Zang
PZPeng Zeng
Peng Zeng
WLWanting Li
Wanting Li
XWXin Wang
Xin Wang
SXShuqing Xu
Shuqing Xu
The electric power grid is changing from a traditional power system to a modern, smart, and integrated power system. Microgrids (MGs) play a vital role in combining distributed renewable energy resources (RESs) with traditional electric power systems. Intermittency, randomness, and volatility constitute the disadvantages of distributed RESs. MGs with high penetrations of renewable energy and random load demand cannot ignore these uncertainties, making it difficult to operate them effectively and economically. To realize the optimal scheduling of MGs, a real-time economic energy management strategy based on deep reinforcement learning (DRL) is proposed in this paper. Different from traditional model-based approaches, this strategy is learning based, and it has no requirements for an explicit model of uncertainty. Taking into account the uncertainties in RESs, load demand, and electricity prices, we formulate a Markov decision process for the real-time economic energy management problem of MGs. The objective is to minimize the daily operating cost of the system by scheduling controllable distributed generators and energy storage systems. In this paper, a deep deterministic policy gradient (DDPG) is introduced as a method for resolving the Markov decision process. The DDPG is a novel policy-based DRL approach with continuous state and action spaces. The DDPG is trained to learn the characteristics of uncertainties of the load, RES output, and electricity price using historical data from real power systems. The effectiveness of the proposed approach is validated through the designed simulation experiments. In the second experiment of our designed simulation, the proposed DRL method is compared to DQN, SAC, PPO, and MPC methods, and it is able to reduce the operating costs by 29.59%, 17.39%, 6.36%, and 9.55% on the June test set and 30.96%, 18.34%, 5.73%, and 10.16% on the November test set, respectively. The numerical results validate the practical value of the proposed DRL algorithm in addressing economic operation issues in MGs, as it demonstrates the algorithm’s ability to effectively leverage the energy storage system to reduce the operating costs across a range of scenarios.

1 January 2022 in SSRN Electronic Journal
Verified
Preprint
Open access
PDF file
DLDing Liu
Ding Liu
CZChuanzhi Zang
Chuanzhi Zang
PZPeng Zeng
Peng Zeng
WLWanting Li
Wanting Li
XWXin Wang
Xin Wang
SXShuqing Xu
Shuqing Xu
Electric power grids are changing from traditional power systems to modern smart integrated power systems. The microgrid (MG) plays a vital role in this process through the integration of distributed renewable energy resources (RESs) and energy storage systems (ESSs). However, wind and solar radiation are characterized by intermittence, randomness and fluctuation. These uncertainties cannot be ignored in microgrids with high penetration of RES and random load demand, which challenges the effective and economic management of MGs. To achieve real-time economically optimal scheduling of microgrids, we proposed a real-time energy management strategy. Unlike traditional model-based approaches, this strategy is learning-based and does not need the knowledge of system uncertainties. The energy management problem of a microgrid is formulated as a Markov decision process (MDP) solved using policybased deep reinforcement learning (DRL). In the proposed RL-based approach, two different neural networks are used. One takes the real-time system state of the microgrid as inputs and makes the decision to obtain the optimal control policy