Nowadays, unmanned aerial vehicles (UAVs) pose a significant challenge to air defense systems. Unmanned combat aerial vehicles (UCAVs) have been proven to be an effective method to counter the threat of UAVs in application. Therefore, maneuver decision-making has become the crucial technology to achieve autonomous air combat for UCAVs. In order to solve the problem of maneuver decision-making, an autonomous model of UCAVs based on the deep reinforcement learning method was proposed in this paper. Firstly, the six-degree-of-freedom (DoF) dynamic model was built in three-dimensional space, and the continuous actions of tangential overload, normal overload, and roll angle were selected as the maneuver inputs. Secondly, to improve the convergence speed for the deep reinforcement learning method, the idea of “scenario-transfer training” was introduced into the twin delayed deep deterministic (TD3) policy gradient algorithm, the results showing that the improved algorithm could cut off about 60% of the training time. Thirdly, for the “nose-to-nose turns”, which is one of the classical maneuvers for experienced pilots, the optimal maneuver generated by the proposed method was analyzed. The results showed that the maneuver strategy obtained by the proposed method was highly consistent with that made by experienced fighter pilots. This is also the first time in a public article that compared the maneuver decisions made by the deep reinforcement learning method with experienced fighter pilots. This research can provide some meaningful references to generate autonomous decision-making strategies for UCAVs.
In response to the saturated attacks by low, slow, and small UAV swarms, there is currently a lack of effective countermeasures. Counter-UAV swarm technology is an important issue that urgently requires breakthroughs. This paper conducts research on a mid–short-range hard-kill counter-swarm scenario where fewer swarms confront multiple swarms and stronger swarms confront weaker swarms. The requirement is for counter-swarm UAVs to quickly penetrate the swarm at mid–short range and collide with as many incoming UAVs as possible to destroy them. To address the sparse solution space problem, an improved genetic algorithm that integrates multiple strategies is adopted to calculate the spatial density distribution of the incoming swarm. A baseline is identified through gradient descent that maximizes the density integral in a straight-line direction. Based on this baseline, the solution space for single strikes on the swarm is filtered. During the solution process, an elite strategy is introduced to prevent the overall degradation of the population performance. Additionally, the feasibility of the flight trajectory needs to be assessed. A piecewise cubic spline interpolation method is used to optimize the flight trajectory, minimizing the maximum curvature. Ultimately, multiple counter-swarm UAV targets within the swarm and their corresponding trajectories are obtained.
Considering the dynamic RCS characteristics of stealthy UAVs, we proposed a stealthy UAV path planning algorithm based on the Double Deep Q-Network (DDQN). By introducing the reinforcement learning model that can interact with the environment, the stealth UAV adjusts the path planning strategy through the rewards obtained from the environment to design the optimal path in real-time. Specifically, by considering the effect of RCS from different angles on the detection probability of the air defense radar, the stealth UAV realizes the iterative optimization of the path planning scheme to improve the reliability of the penetration path. Under the guidance of a goal-directed composite reward function proposed, the convergence speed of the stealth UAV path planning algorithm is improved. The simulation results show that the stealth UAV can reach the target position with the optimal path while avoiding the threat zone.
With the development of electronic warfare technology, the intelligent jammer dramatically reduces the performance of traditional radar anti-jamming methods. A key issue is how to actively adapt radar to complex electromagnetic environments and design anti-jamming strategies to deal with intelligent jammers. The space of the electromagnetic environment is dynamically changing, and the transmitting power of the jammer and frequency diversity array (FDA) radar in each frequency band is continuously adjustable. Both can learn the optimal strategy by interacting with the electromagnetic environment. Considering that the competition between the FDA radar and the jammer is a confrontation process of two agents, we find the optimal power allocation strategy for both sides by using the multi-agent deep deterministic policy gradient (MADDPG) algorithm based on multi-agent reinforcement learning (MARL). Finally, the simulation results show that the power allocation strategy of the FDA radar and the jammer can converge and effectively improve the performance of the FDA radar and the jammer in the intelligent countermeasure environment.
This paper introduces a swift method for intercepting the state trajectory of large-scale invading drone swarms using quadrotor drones. The research primarily concentrates on the design and computation of multi-target interception trajectories, with an analysis of the trajectory state constraints inherent to multi-target interception tasks. Utilizing Pontryagin’s principle of motion, we have designed computationally efficient motion primitives for multi-target interception scenarios. These motion primitives’ durations have informed the design of cost matrices for multi-target interception tasks. In contrast to static planar scenarios, the cost matrix in dynamic scenarios displays significant asymmetry, correlating with the speed and spatial distribution of the targets. We have proposed an algorithmic framework based on three genetic operators for solving multi-target interception trajectories, offering certain advantages in terms of solution accuracy and speed compared to other optimization algorithms. Simulation results from large-scale dynamic target interception scenarios indicate that for an interception task involving 50 targets, the average solution time for trajectories is a mere 3.7 s. Using the methods proposed in this paper, we conducted a comparative analysis of factors affecting the performance of interception trajectories in various target interception scenarios. This study represents the first instance in existing public research where precise evaluations have been made on the trajectories of drone interceptions against large-scale flying targets. This research lays the groundwork for further exploration into game-theoretic adversarial cluster interception methods.
The random fluctuations in inlet flow represent a common uncertainty in aero-engine compressors, necessitating the control of its effects through blade optimization design. To account for the impact of inlet flow fluctuations on performance in blade design optimization, an efficient multi-objective adaptive robust aerodynamic design optimization (ARADO) method is proposed. The optimization method employs a novel sparse polynomial chaos expansion (PCE) and the advanced noisy Gaussian process regression (NGPR) technique is used to establish an initial stochastic surrogate model (SSM) containing statistical moments of aerodynamic performance. By introducing advanced sparse signal processing concepts, the sparce PCE significantly enhances the efficiency of acquiring each training sample for SSM. During the optimization process, the initial SSM autonomously updates based on historical optimization data, without requiring high precision across the entire design space. Compared to traditional model-based aerodynamic robust optimizations, the proposed ARADO method exhibits a faster convergence speed and achieves a superior average level of the optimal solution set. It also better balances various optimization objectives, concentrating the space distribution of optimal solutions closer to the average level. Ultimately, the ARADO is applied to the aerodynamic robust design of a high-load compressor airfoil across all operating incidences. The optimization results enhance aerodynamic performance while reducing performance diversity, thus aligning more closely with practical engineering requirements. Through data analysis of the optimal solutions, robust design guidelines for blade aerodynamic shapes are obtained, along with insights into the flow mechanisms that enhance aerodynamic robustness.