Pengming Zhu

Pengming Zhu

Auto-generated profile, based on publicly available information

Pengming Zhu

College of Intelligence Science and Technology, National University of Defense Technology, Changsha, China

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
17 August 2020 in IEEE Access
Verified
Journal Article
Open access
PZPengming Zhu
Pengming Zhu
WDWei Dai
Wei Dai
WYWeijia Yao
Weijia Yao
JMJunchong Ma
Junchong Ma
ZZZhiwen Zeng
Zhiwen Zeng
Huimin LuHuimin Lu
Huimin Lu
In this paper, we apply deep reinforcement learning (DRL) to solve the flocking control problem of multi-robot systems in complex environments with dynamic obstacles. Starting from the traditional flocking model, we propose a DRL framework for implementing multi-robot flocking control, eliminating the tedious work of modeling and control designing. We adopt the multi-agent deep deterministic policy gradient (MADDPG) algorithm, which additionally uses the information of multiple robots in the learning process to better predict the actions that robots will take. To address the problems such as low learning efficiency and slow convergence speed of the MADDPG algorithm, this paper studies a prioritized experience replay (PER) mechanism and proposes the Prioritized Experience Replay-MADDPG (PER-MADDPG) algorithm. Based on the temporal difference (TD) error, a priority evaluation function is designed to determine which experiences are sampled preferentially from the replay buffer. In the end, the simulation results verify the effectiveness of the proposed algorithm. It has a faster convergence speed and enables the robot group to complete the flocking task in the environment with obstacles.

17 March 2022 in Applied Intelligence
Verified
Journal Article
Closed access
PDF file
ZZZhiqian Zhou
Zhiqian Zhou
PZPengming Zhu
Pengming Zhu
ZZZhiwen Zeng
Zhiwen Zeng
JXJunhao Xiao
Junhao Xiao
Huimin LuHuimin Lu
Huimin Lu
ZZZongtan Zhou
Zongtan Zhou

7 September 2021 in Applied Sciences
Verified
Journal Article
Open access
PDF file
ZZZhiwen Zhang
Zhiwen Zhang
CSchenghao shi
chenghao shi
PZPengming Zhu
Pengming Zhu
ZZZhiwen Zeng
Zhiwen Zeng
HZHui Zhang
Hui Zhang
In this paper, we address the problem of autonomous exploration in unknown environments for ground mobile robots with deep reinforcement learning (DRL). To effectively explore unknown environments, we construct an exploration graph considering historical trajectories, frontier waypoints, landmarks, and obstacles. Meanwhile, to take full advantage of the spatiotemporal feature and historical information in the autonomous exploration task, we propose a novel network called Spatiotemporal Neural Network on Graph (Graph-STNN). Specifically, the proposed Graph-STNN extracts the spatial feature using graph convolutional network (GCN) and the temporal feature using temporal convolutional network (TCN). Then, gated recurrent unit (GRU) is performed to synthesize the spatial feature, the temporal feature, and the historical state information into the current state feature. Combined with DRL, our Graph-STNN helps estimation of the optimal target point through extracted hybrid features. The simulation experiment shows that our approach is more effective than the GCN-based approach and the information entropy-based approach. Moreover, Graph-STNN also performs better generalization ability than GCN-based, information entropy-based, and random methods. Finally, we validate our approach on the simulation platform Stage with the actual robot model.

14 April 2025 in IEEE Robotics and Automation Letters
Verified
Journal Article
Open access
PZPengming Zhu
Pengming Zhu
ZZZhiwen Zeng
Zhiwen Zeng
WYWeijia Yao
Weijia Yao
WDWei Dai
Wei Dai
Huimin LuHuimin Lu
Huimin Lu
ZZZongtan Zhou
Zongtan Zhou
In recent years, there has been a significant amount of research on algorithms and control methods for distributed collaborative robots. However, the emergence of collective behavior in a swarm is still difficult to predict and control. Nevertheless, human interaction with the swarm helps render the swarm more predictable and controllable, as human operators can utilize intuition or knowledge that is not always available to the swarm. Therefore, this letter designs the Dynamic Visualization Research Platform for Multimodal Human-Swarm Interaction (DVRP-MHSI), which is an innovative open system that can perform real-time dynamic visualization and is specifically designed to accommodate a multitude of interaction modalities (such as brain-computer, eye-tracking, electromyographic, and touch-based interfaces), thereby expediting progress in human-swarm interaction research. Specifically, the platform consists of custom-made low-cost omnidirectional wheeled mobile robots, multitouch screens and two workstations. In particular, the mutitouch screens can recognize human gestures and the shapes of objects placed on them, and they can also dynamically render diverse scenes. One of the workstations processes communication information within robots and the other one implements human-robot interaction methods. The development of DVRP-MHSI frees researchers from hardware or software details and allows them to focus on versatile swarm algorithms and human-swarm interaction methods without being limited to predefined and static scenarios, tasks, and interfaces. The effectiveness and potential of the platform for human-swarm interaction studies are validated by several demonstrative experiments.

28 September 2021 in Applied Sciences
Verified
Journal Article
Open access
PDF file
CGCe Guo
Ce Guo
PZPengming Zhu
Pengming Zhu
ZZZhiqian Zhou
Zhiqian Zhou
LLLin Lang
Lin Lang
ZZZhiwen Zeng
Zhiwen Zeng
Huimin LuHuimin Lu
Huimin Lu
This paper focuses on generating distributed flocking strategies via imitation learning. The primary motivation is to improve the swarm robustness and achieve better consistency while respecting the communication constraints. This paper first proposes a quantitative metric of swarm robustness based on entropy evaluation. Then, the graph importance consistency is also proposed, which is one of the critical goals of the flocking task. Moreover, the importance-correlated directed graph convolutional networks (IDGCNs) are constructed for multidimensional feature extraction and structure-related aggregation of graph data. Next, by employing IDGCNs-based imitation learning, a distributed and scalable flocking strategy is obtained, and its performance is very close to the centralized strategy template while considering communication constraints. To speed up and simplify the training process, we train the flocking strategy with a small number of agents and set restrictions on communication. Finally, various simulation experiments are executed to verify the advantages of the obtained strategy in terms of realizing the swarm consistency and improving the swarm robustness. The results also show that the performance is well maintained while the scale of agents expands (tested with 20, 30, 40 robots).

17 February 2025 in arXiv
Verified
Preprint
Open access
PDF file
PZPengming Zhu
Pengming Zhu
ZZZongtan Zhou
Zongtan Zhou
WYWeijia Yao
Weijia Yao
WDWei Dai
Wei Dai
ZZZhiwen Zeng
Zhiwen Zeng
Huimin LuHuimin Lu
Huimin Lu
Human-multi-robot shared control leverages human decision-making and robotic autonomy to enhance human-robot collaboration. While widely studied, existing systems often adopt a leader-follower model, limiting robot autonomy to some extent. Besides, a human is required to directly participate in the motion control of robots through teleoperation, which significantly burdens the operator. To alleviate these two issues, we propose a layered shared control computing framework using human-influenced guiding vector fields (HI-GVF) for human-robot collaboration. HI-GVF guides the multi-robot system along a desired path specified by the human. Then, an intention field is designed to merge the human and robot intentions, accelerating the propagation of the human intention within the multi-robot system. Moreover, we give the stability analysis of the proposed model and use collision avoidance based on safety barrier certificates to fine-tune the velocity. Eventually, considering the firefighting task as an example scenario, we conduct simulations and experiments using multiple human-robot interfaces (brain-computer interface, myoelectric wristband, eye-tracking), and the results demonstrate that our proposed approach boosts the effectiveness and performance of the task.