Haipeng Xiao

Haipeng Xiao

Auto-generated profile, based on publicly available information

Haipeng Xiao

National Key Laboratory of Electromagnetic Energy, Naval University of Engineering, Wuhan, China

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
29 November 2024 in IEEE Internet of Things Journal
Verified
Journal Article
Closed access
HXHaipeng Xiao
Haipeng Xiao
LFLijun Fu
Lijun Fu
CSChengya Shang
Chengya Shang
YLYunfeng Lin
Yunfeng Lin
YFYaxiang Fan
Yaxiang Fan
In recent years, with the development of ship intelligence and unmanned technology, autonomous path planning of unmanned surface vehicle (USV) has become very important. However, most of the existing studies ignore the limitation of the endurance and speed of USV to voyage, and only consider the course planning at the fixed speed. To this end, we propose a path planning method based on deep reinforcement learning (DRL): Firstly, we establish a USV motion model. Then, we propose a new USV energy consumption model. Existing research typically builds USV energy consumption model by considering the combined effects of currents, winds, and waves, which needs precise ocean data and involves a complex modeling process. Moreover, it fail to account for the influence of USV’s own speed on energy consumption. In contrast, based on the relationship between speed, marine environment, and propulsion load, we propose a new USV energy consumption model. This model simplifies the modeling process and links USV energy consumption with sailing speed and ocean environmental conditions. Next, the original Soft-Actor-Critic (SAC) algorithm use the Multi-Layer Perceptron (MLP) as the action network. However, Convolutional Neural Networks (CNN) excel in capturing spatial and local features. Compared to MLP, CNN have stronger information acquisition capabilities. Therefore, we propose a model (FRCF) that combines fully connected layers with CNN to replace MLP as the action network of the SAC agent, aiming to enhance the agent’s convergence speed and performance. Finally, utilizing SAC with FRCF as the action network (SAC-FRCF), along with the motion models and the new USV energy consumption model, we achieved multi-objective cooperative intelligent path planning for energy, speed, and heading. Unlike traditional path planning methods that control the USV heading based on discrete heading angular, we adjust USV speed and heading based on continuous acceleration and angular velocity. Meanwhile, we impose constraints on the USV’s speed, heading angle, acceleration, and angular velocity to ensure that its motion complies with kinematic constraints. Experimental results show that SAC-FRCF reduces the exploration time by 46.40% and has stronger convergence performance as well as better path planning effect compared with SAC algorithm using MLP as action network (SAC-MLP). Compared with SAC-MLP without considering the optimal energy consumption, it reduces the energy consumption by 28.38%. The experimental results verify the effectiveness and superiority of the proposed method. Furthermore, the method we propose exhibits significant advantages over traditional path planning methods. In addition, our proposed method demonstrates significant superiority compared to existing path planning methods, and its robustness and adaptability also have been verified in a more complex environment.

15 August 2024 in IEEE Transactions on Energy Conversion
Verified
Journal Article
Closed access
HXHaipeng Xiao
Haipeng Xiao
LFLijun Fu
Lijun Fu
CSChengya Shang
Chengya Shang
YFYaxiang Fan
Yaxiang Fan
XBXianqiang Bao
Xianqiang Bao
XXXinghua Xu
Xinghua Xu
The existing data-driven methods for the state of health (SOH) prediction of lithium-ion battery are limited by the data quantity, resulting in insufficient generalization performance, prediction accuracy and prediction stability. To tackle this challenge, this paper proposes a novel model, namely the CNN-MMHA, for SOH prediction. The CNN-MMHA incorporates mask mechanisms and multi-head attention mechanisms (MHA) to effectively capture the interdependencies within time series data (i.e. MMHA). Simultaneously, the utilization of the data conversion module and convolutional neural network (CNN) enables the capture of temporal sequences and local characteristics of battery states, accordingly enhancing the predictive ability of MMHA. In this study, This paper execute a sequence of simulation experiments on NASA and CALCE data sets, where this paper compare the performance of a variety of models: Multilayer Perceptron (MLP), Long Short-Term Memory Network (LSTM), CNN, CNN-LSTM, MMHA, and CNN-MMHA respectively. The results demonstrate that the proposed model yields optimal convergence and generalization performance. Furthermore, it has the utmost prediction accuracy and stability. Ultimately, the exceptional performance and real-world applicability of the proposed model are corroborated through its experiments on the real battery.

16 November 2023 in IEEE Transactions on Transportation Electrification
Verified
Journal Article
Closed access
CSChengya Shang
Chengya Shang
LFLijun Fu
Lijun Fu
XBXianqiang Bao
Xianqiang Bao
HXHaipeng Xiao
Haipeng Xiao
XXXinghua Xu
Xinghua Xu
LLLufeng Liu
Lufeng Liu
When a fault occurs, driven by the reconfiguration strategy, the topology of ship power system (SPS) will be changed to isolate the fault area and restore the lost load. However, traditional optimization methods have limitations, such as getting stuck in suboptimal solutions or not offering real-time solutions. This paper proposes a novel deep reinforcement learning (DRL) method to address the dynamic fault reconfiguration problem in real-time for SPS. While considering the load priorities, the fault reconfiguration model is formulated with the goal of the maximum weighted load power and the minimum switching action. Then, a deep Q network (DQN) combined with action mask mechanism, what is called DQN-Mask algorithm, is applied to optimize the switch action. The proposed method enables end-to-end control from the fault node data to the switch sequences, and has migration capability in different scenarios. Two case studies are analyzed based on historical fault datasets of medium voltage DC (MVDC) SPS. The numerical results verify the effectiveness, real-time performance, migration and scalability of the proposed DQN-Mask algorithm.

8 May 2024 in IEEE Transactions on Transportation Electrification
Verified
Journal Article
Closed access
HXHaipeng Xiao
Haipeng Xiao
LFLijun Fu
Lijun Fu
CSChengya Shang
Chengya Shang
XBXianqiang Bao
Xianqiang Bao
XXXinghua Xu
Xinghua Xu
Ship optimization scheduling, using deep reinforcement learning (DRL), has been extensively researched and implemented. Notably, the deep Q-learning algorithm (DQN) has achieved successful deployment within the optimization scheduling domain. However, there is currently almost no research on compressing and accelerating DQN-based All-Electric Ships (AES) energy scheduling models. This paper proposes a DQN knowledge distillation (DQN-KD) compression algorithm that incorporates the teacher replay memory pool (T-rpm) learning mechanism for compression problem of the DQN-based optimization scheduling model of AES. The DQN-KD algorithm can effectively transfer the knowledge of teacher agent to student agent, and further improve the training efficiency and performance of student agent using the T-rpm learning mechanism. The experimental results conduct on the AES system demonstrate that our proposed compression method is highly effective. Comparing with the teacher model, the Parameters, FLOP and Memory of the student model are significantly reduced by 87.7%, 92.61% and 88.3% respectively. Interestingly, despite these significant reductions, the student agent only experiences a marginal increase of 0.33% in economic consumption compared to the teacher agent. Furthermore, when the Parameters of the student agent are further reduced by 47.5%, and FLOPs by 50.4%, along with a 47.3% reduction in Memory, the resulting increase in economic consumption is only 0.59% compared to the teacher agent. Importantly, even with these notable reductions, the compressed agent maintained strong generalization performance.

5 September 2025 in Engineering Applications of Artificial Intelligence
Verified
Journal Article
Closed access
HXHaipeng Xiao
Haipeng Xiao
LFLijun Fu
Lijun Fu
CSChengya Shang
Chengya Shang
YLYunfeng Lin
Yunfeng Lin
LYLongfei Yue
Longfei Yue
YFYaxiang Fan
Yaxiang Fan

4 March 2024 in IEEE Transactions on Transportation Electrification
Verified
Journal Article
Closed access
CSChengya Shang
Chengya Shang
LFLijun Fu
Lijun Fu
HXHaipeng Xiao
Haipeng Xiao
XBXianqiang Bao
Xianqiang Bao
XXXinghua Xu
Xinghua Xu
The variability in sailing environment and load demand, along with seasonal fluctuations in port electricity prices, present significant challenges for operating ship power systems (SPSs) in all-electric ships (AESs). However, traditional single-task deep reinforcement learning (DRL) struggles to cope with the high randomness of SPS operation scenarios. This paper proposes a novel real-time joint optimization method for power generation and voyage scheduling in SPSs that considers operating scene clustering and multi-task DRL (MTDRL). A unified triplet is used to describe operational uncertainty, and the SPS operation scenes are clustered. Then, the importance weighted actor-learner architecture (IMPALA) combined with random network distillation mechanism (RND), what is called IMPALA-RND algorithm, is applied to minimize operational costs by adjusting power generation and voyage scheduling. The proposed method can achieve differentiated learning for clustered multi-task operational scenes and enhance the agent’s capability to explore unknown states. A case study is analyzed based on historical operational datasets of four-DG SPS. Numerical results verify the superiority and real-time performance of the proposed algorithm for joint optimization in multi-task operation scenarios.