Yuan Wang

Dr. Yuan Wang


Research Focus & Metrics

Academic Career Length

11Years (2016-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
3 March 2022 in Computational Intelligence and Neuroscience
Verified
Journal Article
Open access
PDF file
YWYuan Wang
Yuan Wang
XZXiwen Zhang
Xiwen Zhang
ZRZhou Rong
Zhou Rong
TSTang Shangqin
Tang Shangqin
ZHZhou Huan
Zhou Huan
DWDing Wei
Ding Wei
With the rapid development of unmanned combat aerial vehicle (UCAV)-related technologies, UCAVs are playing an increasingly important role in military operations. It has become an inevitable trend in the development of future air combat battlefields that UCAVs complete air combat tasks independently to acquire air superiority. In this paper, the UCAV maneuver decision problem in continuous action space is studied based on the deep reinforcement learning strategy optimization method. The UCAV platform model of continuous action space was established. Focusing on the problem of insufficient exploration ability of Ornstein–Uhlenbeck (OU) exploration strategy in the deep deterministic policy gradient (DDPG) algorithm, a heuristic DDPG algorithm was proposed by introducing heuristic exploration strategy, and then a UCAV air combat maneuver decision method based on a heuristic DDPG algorithm is proposed. The superior performance of the algorithm is verified by comparison with different algorithms in the test environment, and the effectiveness of the decision method is verified by simulation of air combat tasks with different difficulty and attack modes.

19 October 2016 in Advances in Mechanical Engineering
Verified
Journal Article
Open access
YWYuan Wang
Yuan Wang
CHChangqiang Huang
Changqiang Huang
CTChuanlin Tang
Chuanlin Tang
This article investigates the problem of designing a novel maneuvering decision-making method for the unmanned combat aerial vehicle. The design objective is to promote the real-time ability of decision-making method and solve the problem of uncertainty caused by incomplete target information. On the basis of statistics theory, a robust maneuvering decision method with self-adaptive target intention prediction is proposed. The robustness design is embedded in the membership function of the situation parameters. The reachable set theory and adaptive adjustment mechanism of the target state weight are used in the target intention prediction to promote the real-time ability. Simulations are conducted under the condition that the enemy aircraft perform both non-maneuvering and combat maneuvering. The results verify the good properties of the decision-making method, which can extend the survival time of the unmanned combat aerial vehicle when the enemy aircraft attacks, and short the taking position and attack time of the unmanned combat aerial vehicle when the enemy aircraft evades.

18 September 2024 in IEEE Transactions on Aerospace and Electronic Systems
Verified
Journal Article
Closed access
XZXiwen Zhang
Xiwen Zhang
SZShanghong Zhao
Shanghong Zhao
YWYuan Wang
Yuan Wang
XWXiang Wang
Xiang Wang
XSXinkang Song
Xinkang Song
JLJianjia Li
Jianjia Li
The utilization of unmanned aerial vehicles (UAVs) as relays significantly enhances the availability of aeronautical free space optical (FSO) /radio frequency (RF) communication links. In this paper, a trajectory optimized scheme that maximizes the energy efficiency of the UAV relay is proposed. The focus of our study lies in the maximization of energy efficiency for UAVs, taking into account practical constraints in aeronautical FSO/RF communication networks, particularly the obstruction caused by moving clouds and the required data rates. Based on the cloud modeling, a feasible deployment area for UAVs that ensures line-of-sight (LOS) communication is obtained. Especially, we derive a theoretical model of propulsion energy consumption for fixed-wing UAV at variable altitudes for three-dimensional (3D) trajectory optimization. Accordingly, an energy efficient Trajectory Planning Gaining-sharing Knowledge (TPGSK) is presented to address this issue, and its effectiveness is tested. Through this algorithm, the trajectories that maximum data rate, minimum energy consumption, and optimal energy efficiency are presented, taking into consideration cloud movement. Furthermore, we find optimized energy efficiency values in various atmospheric environments. The numerical results demonstrate that the proposed design achieves significantly higher energy efficiency for the UAV-assisted hybrid FSO/RF network in comparison to other benchmark schemes

19 August 2023 in Applied Sciences
Verified
Journal Article
Open access
PDF file
YWYujie Wei
Yujie Wei
HZHongpeng Zhang
Hongpeng Zhang
YWYuan Wang
Yuan Wang
CHChangqiang Huang
Changqiang Huang
Maneuver decision-making is essential for autonomous air combat. However, previous methods usually make decisions to aim at the target instead of hitting the target and use discrete action spaces instead of continuous action spaces. While these simplifications make maneuver decision-making easier, they also make maneuver decision-making more unrealistic. Meanwhile, previous studies usually rely on handcrafted reward functions, which are troublesome to design. Therefore, to solve these problems, we propose an automatic curriculum reinforcement learning method that enables agents to maneuver effectively in air combat from scratch. On the basis of curriculum reinforcement learning, maneuver decision-making is divided into a series of sub-tasks from easy to difficult. Thus, agents can gradually learn how to complete a series of sub-tasks, from easy to difficult without handcrafted reward functions. The ablation studies show that automatic curriculum learning is essential for reinforcement learning; namely, agents cannot make effective decisions without curriculum learning. Simulations show that, after training, agents are able to make effective decisions given different states, including tracking, attacking, and escaping, which are both rational and interpretable.

19 July 2023 in IEEE Access
Verified
Journal Article
Open access
YWYujie Wei
Yujie Wei
HZHongpeng Zhang
Hongpeng Zhang
YWYuan Wang
Yuan Wang
CHChangqiang Huang
Changqiang Huang
Reinforcement learning is an effective approach for solving decision-making problems. However, when using reinforcement learning to solve maneuver decision-making with sparse rewards, it costs too much time for training, and the final performance may not be satisfactory. In order to overcome the shortcomings, the method for maneuver decision-making based on curriculum learning and reinforcement learning is proposed. First, three curricula are designed to address the maneuver decision-making problem: angle curriculum, distance curriculum and hybrid curriculum. They are proposed according to the intuition that closer destinations are easier to arrive at. Then, they are used to train agents and compared with the original method without any curriculum. The training results show that angle curriculum can increase the speed and stability of training, and improve the performance of maneuver decision-making; distance curriculum can increase the speed and stability of agent training; hybrid curriculum is not better than the other curricula, because it makes the agent get stuck at the local optimum. The simulation results show that after training, the agent can handle the situations where targets come from different directions, and the maneuver decision-makings are rational, effective, and interpretable, whereas the method without curriculum is invalid.

2 December 2024 in Drones
Verified
Journal Article
Open access
PDF file
XZXiwen Zhang
Xiwen Zhang
SZShanghong Zhao
Shanghong Zhao
YWYuan Wang
Yuan Wang
HHHang Hu
Hang Hu
GYGalvin Yang
Galvin Yang
JLJianjia Li
Jianjia Li
Free-space optical (FSO) communication with unmanned aerial vehicles (UAVs) as relays is a promising technology for future aeronautical communication systems. In this paper, a multiple UAV-based aeronautical communication system is proposed, wherein a hybrid FSO/radio frequency (RF) link is established to connect the Airborne Warning and Control System (AWACS) with the mobile ground station (GS). Initially, we consider the velocity variance of both AWACS and the mobile GS, along with the influence of the Doppler effect. Furthermore, four relay selection modes are proposed, and exact closed expressions are derived for the end-to-end outage probability and bit error rate (BER) of the considered system. Numerical simulations demonstrate the impact of velocity variance variation on system performance. Additionally, we analyze the applicability of these four relay modes under different platform mobility characteristics through simulation results, while discussing the optimal numbers and the deployment altitude of UAVs. Finally, effective design guidelines that can be useful for aeronautical communication system designers are presented.