Hengsheng Chen

Hengsheng Chen

Auto-generated profile, based on publicly available information

Hengsheng Chen

Co-first authors

Research Focus & Metrics

Academic Career Length

2Years (2025-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
25 October 2025 in ACM Computing Surveys
Verified
Journal Article
Open access
HCHengsheng Chen
Hengsheng Chen
YLYuanguo Lin
Yuanguo Lin
MFMingjian Fu
Mingjian Fu
LYLina Yao
Lina Yao
MSMichael Sheng
Michael Sheng
In recent years, Unmanned Aerial Vehicles (UAVs) have attracted a lot of attention due to their flexibility and mobility. However, due to the increasingly complex environments faced by UAVs and the rising demands on UAV systems, traditional UAV control methods can no longer efficiently control the UAV under multi-constraint situations. Reinforcement Learning (RL), as an emerging robot control technology, is well suited to the needs of UAV systems in terms of its ability to interact with and learn from the environment. Therefore, RL-based UAV systems are gradually becoming a new trend in research. Nonetheless, as a new research field, it faces some challenges. To fully grasp the landscape of RL-based UAV systems, it is paramount to provide a comprehensive overview and analysis of the existing specific RL methods applied to UAV systems. In this survey, we first provide a comprehensive overview and summary of the application of RL in different UAV scenarios based on the classification of RL methods. After that, based on the existing relevant literature, we conduct a systematic analysis of the challenges and recent advancements when applying RL to UAV systems. Finally, we discuss the potential research directions for RL-based UAV systems.

28 January 2025 in TechRxiv
Verified
Preprint
Open access
HCHengsheng Chen
Hengsheng Chen
YLYuanguo Lin
Yuanguo Lin
MFMingjian Fu
Mingjian Fu
LYLina Yao
Lina Yao
QSQuan Z Sheng
Quan Z Sheng
In recent years, Unmanned Aerial Vehicles (UAVs) have attracted a lot of attention due to their flexibility and high mobility. Nowadays, UAVs have been widely used in various fields, such as military fields and social fields. However, due to the increasingly complex environments faced by UAVs and the rising demands on UAV systems, traditional UAV control methods are no longer able to achieve efficient control of UAVs under multi-constraint situations. Reinforcement Learning (RL), as an emerging robot control technology, is well suited to the needs of UAV systems in terms of its ability to interact with and learn from the environment. Therefore RL-based UAV systems are gradually becoming a new trend in research. Nonetheless, as a new research field, it faces many challenges, such as high dimensional spaces and dynamic environments. It is necessary to provide a comprehensive overview and analysis of existing specific RL methods applied to UAV systems, and to understand the challenges as well as possible solutions for RL-based UAV systems. In this paper, we first provide a comprehensive overview and summary of the application of RL in different UAV application scenarios based on the classification of RL methods. After that, we systematically analyze the challenges and solutions faced by RL applied to UAV systems given the existing relevant literature. Finally, we discuss the potential research directions for RL-based UAV systems.