Lei Chen

Dr. Lei Chen


Research Focus & Metrics

Academic Career Length

10Years (2017-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
18 August 2017 in IEEE Transactions on Systems, Man, and Cybernetics: Systems
Verified
Journal Article
Closed access
LCLei Chen
Lei Chen
XYXinghuo Yu
Xinghuo Yu
CSChangyin Sun
Changyin Sun
This paper proposes a sampled data-based modeling approach for complex network systems. A compression method, known as characteristic modeling, is used to construct microscopic models from macroscopic observations. Based on this model, a novel control method is also developed to achieve network synchronization. The proposed approach can reduce both the complexity of microscopic dynamics and overall networks. Its application to pinning control design validates the effectiveness of this approach.

5 November 2024 in IEEE Transactions on Automation Science and Engineering
Verified
Journal Article
Closed access
QWQizhen Wu
Qizhen Wu
KLKexin Liu
Kexin Liu
LCLei Chen
Lei Chen
JLJinhu Lü
Jinhu Lü
In swarm robotics, confrontation including the pursuit–evasion game is a key scenario. High uncertainty caused by unknown opponents’ strategies, dynamic obstacles, and insufficient training complicates the action space into a hybrid decision process. Although the deep reinforcement learning method is significant for swarm confrontation since it can handle various sizes, as an end–to–end implementation, it cannot deal with the hybrid process. Here, we propose a novel hierarchical reinforcement learning approach consisting of a target allocation layer, a path planning layer, and the underlying dynamic interaction mechanism between the two layers, which indicates the quantified uncertainty. It decouples the hybrid process into discrete allocation and continuous planning layers, with a probabilistic ensemble model to quantify the uncertainty and regulate the interaction frequency adaptively. Furthermore, to overcome the unstable training process introduced by the two layers, we design an integration training method including pre–training and cross–training, which enhances the training efficiency and stability. Experiment results in both comparison, ablation, and real–robot studies validate the effectiveness and generalization performance of our proposed approach. In our defined experiments with twenty to forty agents, the win rate of the proposed method reaches around ninety percent, outperforming other traditional methods Note to Practitioners —With artificial intelligence rapidly developing, robots will play a significant role in the future. Especially, the swarm formed by many robots holds promising potential in civil and military applications. Promoting the swarm into games or battles is rather riveting. The reinforcement learning method provides a plausible solution to realize the battle of robotic swarms. There are still some issues that need to be addressed. On one hand, we focus on the uncertainty caused by the battlefield nature and the environment which limits our ability for the implementation of swarms. On the other hand, we solve the problem that the decision process combined with commands and actions is a hybrid system, which cannot be directly reflected in the confrontation of swarms. Overall, our approaches throw light on artificial general intelligence and also reveal a solution to interpretable intelligence.

10 January 2022 in Symmetry
Verified
Journal Article
Open access
PDF file
LXLong Xu
Long Xu
WXWei Xiong
Wei Xiong
MZMinghao Zhou
Minghao Zhou
LCLei Chen
Lei Chen
Dynamic traffic monitoring is a critical part of industrial communication network cybersecurity, which can be used to analyze traffic behavior and identify anomalies. In this paper, industrial networks are modeled by a dynamic fluid-flow model of TCP behavior. The model can be described as a class of systems with unmeasurable states. In the system, anomalies and normal variants are represented by the queuing dynamics of additional traffic flow (ATF) and can be considered as a disturbance. The novel contributions are described as follows: (1) a novel continuous terminal sliding-mode observer (TSMO) is proposed for such systems to estimate the disturbance for traffic monitoring; (2) in TSMO, a novel output injection strategy is proposed using the finite-time stability theory to speed up convergence of the internal dynamics; and (3) a full-order sliding-mode-based mechanism is developed to generate a smooth output injection signal for real-time estimations, which is directly used for anomaly detection. To verify the effectiveness of the proposed approach, the real traffic profiles from the Center for Applied Internet Data Analysis (CAIDA) DDoS attack datasets are used.

13 November 2023 in Drones
Verified
Journal Article
Open access
PDF file
ZDZhaoqi Dong
Zhaoqi Dong
QWQizhen Wu
Qizhen Wu
LCLei Chen
Lei Chen
Swarm models hold significant importance as they provide the collective behavior of self-organized systems. Boids model is a fundamental framework for studying emergent behavior in swarms systems. It addresses problems related to simulating the emergent behavior of autonomous agents, such as alignment, cohesion, and repulsion, to imitate natural flocking movements. However, traditional models of Boids often lack pinning and the adaptability to quickly adapt to the dynamic environment. To address this limitation, we introduce reinforcement learning into the framework of Boids to solve the problem of disorder and the lack of pinning. The aim of this approach is to enable drone swarms to quickly and effectively adapt to dynamic external environments. We propose a method based on the Q-learning network to improve the cohesion and repulsion parameters in the Boids model to achieve continuous obstacle avoidance and maximize spatial coverage in the simulation scenario. Additionally, we introduce a virtual leader to provide pinning and coordination stability, reflecting the leadership and coordination seen in drone swarms. To validate the effectiveness of this method, we demonstrate the model’s capabilities through empirical experiments with drone swarms, and show the practicality of the RL-Boids framework.

8 April 2024 in IEEE Intelligent Systems
Verified
Journal Article
Closed access
QWQizhen Wu
Qizhen Wu
KLKexin Liu
Kexin Liu
LCLei Chen
Lei Chen
Reinforcement learning suffers from limitations in real practices primarily due to the number of required interactions with virtual environments. It results in a challenging problem because we are implausible to obtain a local optimal strategy with only a few attempts for many learning methods. Hereby, we design an improved reinforcement learning method based on model predictive control that models the environment through a data–driven approach. Based on the learned environment model, it performs multi–step prediction to estimate the value function and optimize the policy. The method demonstrates higher learning efficiency, faster convergent speed of strategies tending to the local optimal value, and less sample capacity space required by experience replay buffers. Experimental results, both in classic databases and in a dynamic obstacle avoidance scenario for an unmanned aerial vehicle, validate the proposed approaches.

7 August 2019 in IEEE Transactions on Systems, Man, and Cybernetics: Systems
Verified
Journal Article
Closed access
LCLei Chen
Lei Chen
XYXinghuo Yu
Xinghuo Yu
XXXin Xin
Xin Xin
CSChangyin Sun
Changyin Sun
In this paper, characteristic model-based modeling and control approaches for complex dynamical networks based on sampled data are studied. It shows that the characteristic model, in which underline network topological structures are simplified, can provide a straightforward and implicit description for network dynamics. The induced parameter estimation method can further make the model adaptive and purely data-driven. Moreover, a control law based on this model is also proposed to govern the network dynamics. Finally, the theoretical results are verified through numerical simulations of modeling and stabilizing a dynamical network.