Shijie Cui

Shijie Cui

Auto-generated profile, based on publicly available information

Shijie Cui


Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
2 February 2023 in Sensors
Verified
Journal Article
Open access
PDF file
DLDing Liu
Ding Liu
PZPeng Zeng
Peng Zeng
SCShijie Cui
Shijie Cui
CSChunhe Song
Chunhe Song
The rapid development of electric vehicle (EV) technology and the consequent charging demand have brought challenges to the stable operation of distribution networks (DNs). The problem of the collaborative optimization of the charging scheduling of EVs and voltage control of the DN is intractable because the uncertainties of both EVs and the DN need to be considered. In this paper, we propose a deep reinforcement learning (DRL) approach to coordinate EV charging scheduling and distribution network voltage control. The DRL-based strategy contains two layers, the upper layer aims to reduce the operating costs of power generation of distributed generators and power consumption of EVs, and the lower layer controls the Volt/Var devices to maintain the voltage stability of the distribution network. We model the coordinate EV charging scheduling and voltage control problem in the distribution network as a Markov decision process (MDP). The model considers uncertainties of charging process caused by the charging behavior of EV users, as well as the uncertainty of uncontrollable load, system dynamic electricity price and renewable energy generation. Since the model has a dynamic state space and mixed action outputs, a framework of deep deterministic policy gradient (DDPG) is adopted to train the two-layer agent and the policy network is designed to output discrete and continuous control actions. Simulation and numerical results on the IEEE-33 bus test system demonstrate the effectiveness of the proposed method in collaborative EV charging scheduling and distribution network voltage stabilization.

7 February 2022 in Neural Computing and Applications
Verified
Journal Article
Closed access
PDF file
PZPeng Zeng
Peng Zeng
SCShijie Cui
Shijie Cui
CSChunhe Song
Chunhe Song
ZWZhongfeng Wang
Zhongfeng Wang
GLGuangye Li
Guangye Li

17 June 2022 in Soft Computing
Verified
Journal Article
Closed access
PDF file
SCShijie Cui
Shijie Cui
PZPeng Zeng
Peng Zeng
CSChunhe Song
Chunhe Song
ZWZhongfeng Wang
Zhongfeng Wang
GLGuangye Li
Guangye Li

27 December 2023 in Biomimetics
Verified
Journal Article
Open access
PDF file
XDXiaoting Dong
Xiaoting Dong
GWguangxi wan
guangxi wan
PZPeng Zeng
Peng Zeng
CSChunhe Song
Chunhe Song
SCShijie Cui
Shijie Cui
The robot task sequencing problem and trajectory planning problem are two important issues in the robotic optimization domain and are solved sequentially in two separate levels in traditional studies. This paradigm disregards the potential synergistic impact between the two problems, resulting in a local optimum solution. To address this problem, this paper formulates a co-optimization model that integrates the task sequencing problem and trajectory planning problem into a holistic problem, abbreviated as the robot TSTP problem. To solve the TSTP problem, we model the optimization process as a Markov decision process and propose a deep reinforcement learning (DRL)-based method to facilitate problem solving. To validate the proposed approach, multiple test cases are used to verify the feasibility of the TSTP model and the solving capability of the DRL method. The real-world experimental results demonstrate that the DRL method can achieve a 30.54% energy savings compared to the traditional evolution algorithm, and the computational time required by the proposed DRL method is much shorter than those of the evolutionary algorithms. In addition, when adopting the TSTP model, a 18.22% energy reduction can be achieved compared to using the sequential optimization model.

16 March 2026 in Energies
Verified
Journal Article
Open access
PDF file
DBDONG BIAO
DONG BIAO
SCShijie Cui
Shijie Cui
XWXiaohui Wang
Xiaohui Wang
The real-time economic dispatch of microgrids (MGs) is challenged by the high penetration of renewable energy and the resulting source–load uncertainties. Conventional optimization-based scheduling methods rely heavily on accurate probabilistic models and often suffer from high computational burdens, which limits their real-time applicability. To address these challenges, a data-driven deep reinforcement learning (DRL) framework is proposed for real-time microgrid energy management. The MG dispatch problem is formulated as a Markov decision process (MDP), and a Deep Deterministic Policy Gradient (DDPG) algorithm is adopted to efficiently handle the high-dimensional continuous action space of distributed generators and energy storage systems (ESS). The system state incorporates renewable generation, load demand, electricity price, and ESS operational conditions, while the reward function is designed as the negative of the operational cost with penalty terms for constraint violations. A continuous-action policy network is developed to directly generate control commands without action discretization, enabling smooth and flexible scheduling. Simulation studies are conducted on an extended European low-voltage microgrid test system under both deterministic and stochastic operating scenarios. The proposed approach is compared with model-based methods (MPC and MINLP) and representative DRL algorithms (SAC and PPO). The results show that the proposed DDPG-based strategy achieves competitive economic performance, fast convergence, and good adaptability to different initial ESS conditions. In stochastic environments, the proposed method maintains operating costs close to the optimal MINLP reference while significantly reducing the online computational time. These findings demonstrate that the proposed framework provides an efficient and practical solution for the real-time economic dispatch of microgrids with high renewable penetration.

19 March 2025 in Sustainability
Verified
Journal Article
Open access
PDF file
XWXiaohui Wang
Xiaohui Wang
SCShijie Cui
Shijie Cui
QDQingwei Dong
Qingwei Dong
Driven by policy incentives and economic pressures, energy-intensive industries are increasingly focusing on energy cost reductions amid the rapid adoption of renewable energy. However, the existing studies often isolate photovoltaic-energy storage system (PV-ESS) configurations from detailed load scheduling, limiting industrial park energy management. To address this, we propose a two-layer cooperative optimization approach (TLCOA). The upper layer employs a genetic algorithm (GA) to optimize the PV capacity and energy storage sizing through natural selection and crossover operations, while the lower layer utilizes mixed integer linear programming (MILP) to derive cost-minimized scheduling strategies under time-of-use tariffs. Multi-process parallel computing accelerates the fitness evaluations, resolving high-dimensional industrial data challenges. Multi-process parallel computing is introduced to accelerate fitness evaluations, effectively addressing the challenges posed by high-dimensional industrial data. Validated with real power market data, the TLCOA demonstrated rapid adaptation to load fluctuations while achieving a 23.68% improvement in computational efficiency, 1.73% reduction in investment costs, 7.55% decrease in power purchase costs, and 8.79% enhancement in renewable energy utilization compared to traditional methods. This integrated framework enables cost-effective PV-ESS deployment and adaptive energy management in industrial facilities, offering actionable insights for renewable integration and scalable energy optimization.