Yuanqiang Ma

Yuanqiang Ma

Auto-generated profile, based on publicly available information

Yuanqiang Ma

School of Automation, Northwestern Polytechnical University, Xian, China

Research Focus & Metrics

Academic Career Length

2Years (2025-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
22 October 2025 in IEEE Transactions on Vehicular Technology
Verified
Journal Article
Closed access
XXXiaojun Xing
Xiaojun Xing
YMYuanqiang Ma
Yuanqiang Ma
YLYichen Lei
Yichen Lei
YLYan Li
Yan Li
Bing XiaoBing Xiao
Bing Xiao
Traditional trajectory planning algorithms for multi-UAVs face challenges such as difficulty in establishing cooperative mechanisms and poor adaptability to dynamic obstacle environments. To address these limitations, an enhanced reinforcement learning algorithm, based on the multi-agent deep deterministic policy gradient algorithm (MADDPG) and attention mechanism, is proposed for multi-UAV rendezvous trajectory planning in unknown complex environments. Firstly, the algorithm innovatively introduces an attention mechanism in deep learning into the centralized critic network of the MADDPG, enabling the model to dynamically adjust attention in complex environments and enhance learning efficiency; secondly, a dense reward function model based on guiding points is developed, combining attractive and repulsive forces, effectively addressing the issue of sparse rewards, accelerating the algorithm's convergence rate, and bettering policy learning efficiency; thirdly, an Ornstein-Uhlenbeck (OU) noise network is incorporated to well balance exploration and exploitation during the training process; finally, in the static obstacle environment, dynamic obstacle environment and extended composite scenarios, this algorithm was compared with MADDPG, MATD3, and IDDPG. The results show that the improved algorithm can effectively avoid collisions, successfully rendezvous at the target point, and achieve the minimum decision steps, the shortest trajectory length and the highest rendezvous success rate. Especially in scenarios with multiple dynamic obstacles, the improved algorithm can adjust the UAV flight path in real-time and successfully avoid all dynamic obstacles.