As defense technology develops, it is essential to study the pursuit–evasion (PE) game problem in hypersonic vehicles, especially in the situation where a head-on scenario is created. Under a head-on situation, the hypersonic vehicle’s speed advantage is offset. This paper, therefore, establishes the scenario and model for the two sides of attack and defense, using the twin delayed deep deterministic (TD3) gradient strategy, which has a faster convergence speed and reduces over-estimation. In view of the flight state–action value function, the decision framework for escape control based on the actor–critic method is constructed, and the solution method for a deep reinforcement learning model based on the TD3 gradient network is presented. Simulation results show that the proposed strategy enables the hypersonic vehicle to evade successfully, even under an adverse head-on scene. Moreover, the programmed maneuver strategy of the hypersonic vehicle is improved, transforming it into an intelligent maneuver strategy.
As the missions and environments of unmanned aerial vehicles (UAVs) become increasingly complex in both space and time, it is essential to investigate the dynamic task assignment problem of heterogeneous multi-UAVs aiming at ground targets in an uncertain environment. Considering that most of these existing tasking methods are limited to static allocation in a deterministic environment, this paper firstly constructs the fuzzy multiconstraint programming model for heterogeneous multi-UAV dynamic task assignment based on binary interval theory, taking into account the effects of uncertain factors like target location information, mission execution time, and the survival probability of UAVs. Then, the dynamic task allocation strategy is designed, consisting of two components: dynamic time slice setting and the four-dimensional information grey wolf optimization (4DI-GWO) algorithm. The dynamic time slices create the dynamic adjustment of solving frequency and effect, and the 4DI-GWO algorithm is improved by designing the four-dimensional information strategy that expands population diversity and enhances global search capability and other strategies. The numerical analysis shows that the proposed strategy can effectively solve the dynamic task assignment problem of heterogeneous multi-UAVs under an uncertain environment, and the optimization of fitness values demonstrates improvements of 5~30% in comparison with other optimization algorithms.
Given the rapid advancements in kinetic pursuit technology, this paper introduces an innovative maneuvering strategy, denoted as LSRC-TD3, which integrates line-of-sight (LOS) angle rate correction with deep reinforcement learning (DRL) for high-speed unmanned aerial vehicle (UAV) pursuit–evasion (PE) game scenarios, with the aim of effectively evading high-speed and high-dynamic pursuers. In the challenging situations of the game, where both speed and maximum available overload are at a disadvantage, the playing field of UAVs is severely compressed, and the difficulty of evasion is significantly increased, placing higher demands on the strategy and timing of maneuvering to change orbit. While considering evasion, trajectory constraint, and energy consumption, we formulated the reward function by combining “terminal” and “process” rewards, as well as “strong” and “weak” incentive guidance to reduce pre-exploration difficulty and accelerate convergence of the game network. Additionally, this paper presents a correction factor for LOS angle rate into the double-delay deterministic gradient strategy (TD3), thereby enhancing the sensitivity of high-speed UAVs to changes in LOS rate, as well as the accuracy of evasion timing, which improves the effectiveness and adaptive capability of the intelligent maneuvering strategy. The Monte Carlo simulation results demonstrate that the proposed method achieves a high level of evasion performance—integrating energy optimization with the requisite miss distance for high-speed UAVs—and accomplishes efficient evasion under highly challenging PE game scenarios.
Given the limitations of escape maneuvers and decoy deployment of combat aircraft under missile attacks; active defense dramatically improves the survival chances by launching active defense missiles to intercept incoming missiles. Different from previous work, this paper implemented impact angle constraints on the defense missile to achieve a better defense effect. The low-cost active defense missile with limited maneuverability is considered to cooperate with the aircraft through three mechanisms, namely two-way cooperation without any predetermined strategy, one-way cooperation with the defense missile employing a linear guidance strategy, and one-way cooperation with independent evasion maneuver for the target. Three optimal cooperative guidance strategies with impact angle constraints were investigated. Finally, a nonlinear two-dimensional model for agents with first-order autopilot dynamics was simulated to verify the performance of the proposed strategies. The simulation results indicated that the cooperative mechanism directly affects the available range of impact angles, and the constraints of a big impact angle can be realized by introducing the nonlinear model parameters and considering the angle variation between the velocity vector and the initial line-of-sight. Furthermore, the two-way cooperative mechanism achieves the best performance and more flexible solutions to accommodate different vehicle maximum overload limits.
With the development and strengthening of interception measures, the traditional penetration methods of high-speed unmanned aerial vehicles (UAVs) are no longer able to meet the penetration requirements in diversified and complex combat scenarios. Due to the advancement of Artificial Intelligence technology in recent years, intelligent penetration methods have gradually become promising solutions. In this paper, a penetration strategy for high-speed UAVs based on improved Deep Reinforcement Learning (DRL) is proposed, in which Long Short-Term Memory (LSTM) networks are incorporated into a classical Soft Actor–Critic (SAC) algorithm. A three-dimensional (3D) planar engagement scenario of a high-speed UAV facing two interceptors with strong maneuverability is constructed. According to the proposed LSTM-SAC approach, the reward function is designed based on the criteria for successful penetration, taking into account energy and flight range constraints. Then, an intelligent penetration strategy is obtained by extensive training, which utilizes the motion states of both sides to make decisions and generate the penetration overload commands for the high-speed UAV. The simulation results show that compared with the classical SAC algorithm, the proposed algorithm has a training efficiency improvement of 75.56% training episode reduction. Meanwhile, the LSTM-SAC approach achieves a successful penetration rate of more than 90% in hypothetical complex scenarios, with a 40% average increase compared with the conventional programmed penetration methods.
1 October 2024 in Journal of Systems Engineering and Electronics
To solve the problem that multiple missiles should simultaneously attack unmeasurable maneuvering targets, a guidance law with temporal consistency constraint based on the super-twisting observer is proposed. Firstly, the relative motion equations between multiple missiles and targets are established, and the topological model among multiple agents is considered. Secondly, based on the temporal consistency constraint, a cooperative guidance law for simultaneous arrival with finite-time convergence is derived. Finally, the unknown target maneuvering is regarded as bounded interference. Based on the second-order sliding mode theory, a super-twisting sliding mode observer is devised to observe and track the bounded interference, and the stability of the observer is proved. Compared with the existing research, this approach only needs to obtain the sliding mode variable which simplifies the design process. The simulation results show that the designed cooperative guidance law for maneuvering targets achieves the expected effect. It ensures successful cooperative attacks, even when confronted with strong maneuvering targets.