As defense technology develops, it is essential to study the pursuit–evasion (PE) game problem in hypersonic vehicles, especially in the situation where a head-on scenario is created. Under a head-on situation, the hypersonic vehicle’s speed advantage is offset. This paper, therefore, establishes the scenario and model for the two sides of attack and defense, using the twin delayed deep deterministic (TD3) gradient strategy, which has a faster convergence speed and reduces over-estimation. In view of the flight state–action value function, the decision framework for escape control based on the actor–critic method is constructed, and the solution method for a deep reinforcement learning model based on the TD3 gradient network is presented. Simulation results show that the proposed strategy enables the hypersonic vehicle to evade successfully, even under an adverse head-on scene. Moreover, the programmed maneuver strategy of the hypersonic vehicle is improved, transforming it into an intelligent maneuver strategy.
Given the rapid advancements in kinetic pursuit technology, this paper introduces an innovative maneuvering strategy, denoted as LSRC-TD3, which integrates line-of-sight (LOS) angle rate correction with deep reinforcement learning (DRL) for high-speed unmanned aerial vehicle (UAV) pursuit–evasion (PE) game scenarios, with the aim of effectively evading high-speed and high-dynamic pursuers. In the challenging situations of the game, where both speed and maximum available overload are at a disadvantage, the playing field of UAVs is severely compressed, and the difficulty of evasion is significantly increased, placing higher demands on the strategy and timing of maneuvering to change orbit. While considering evasion, trajectory constraint, and energy consumption, we formulated the reward function by combining “terminal” and “process” rewards, as well as “strong” and “weak” incentive guidance to reduce pre-exploration difficulty and accelerate convergence of the game network. Additionally, this paper presents a correction factor for LOS angle rate into the double-delay deterministic gradient strategy (TD3), thereby enhancing the sensitivity of high-speed UAVs to changes in LOS rate, as well as the accuracy of evasion timing, which improves the effectiveness and adaptive capability of the intelligent maneuvering strategy. The Monte Carlo simulation results demonstrate that the proposed method achieves a high level of evasion performance—integrating energy optimization with the requisite miss distance for high-speed UAVs—and accomplishes efficient evasion under highly challenging PE game scenarios.
Given the limitations of escape maneuvers and decoy deployment of combat aircraft under missile attacks; active defense dramatically improves the survival chances by launching active defense missiles to intercept incoming missiles. Different from previous work, this paper implemented impact angle constraints on the defense missile to achieve a better defense effect. The low-cost active defense missile with limited maneuverability is considered to cooperate with the aircraft through three mechanisms, namely two-way cooperation without any predetermined strategy, one-way cooperation with the defense missile employing a linear guidance strategy, and one-way cooperation with independent evasion maneuver for the target. Three optimal cooperative guidance strategies with impact angle constraints were investigated. Finally, a nonlinear two-dimensional model for agents with first-order autopilot dynamics was simulated to verify the performance of the proposed strategies. The simulation results indicated that the cooperative mechanism directly affects the available range of impact angles, and the constraints of a big impact angle can be realized by introducing the nonlinear model parameters and considering the angle variation between the velocity vector and the initial line-of-sight. Furthermore, the two-way cooperative mechanism achieves the best performance and more flexible solutions to accommodate different vehicle maximum overload limits.
1 October 2024 in Journal of Systems Engineering and Electronics
To solve the problem that multiple missiles should simultaneously attack unmeasurable maneuvering targets, a guidance law with temporal consistency constraint based on the super-twisting observer is proposed. Firstly, the relative motion equations between multiple missiles and targets are established, and the topological model among multiple agents is considered. Secondly, based on the temporal consistency constraint, a cooperative guidance law for simultaneous arrival with finite-time convergence is derived. Finally, the unknown target maneuvering is regarded as bounded interference. Based on the second-order sliding mode theory, a super-twisting sliding mode observer is devised to observe and track the bounded interference, and the stability of the observer is proved. Compared with the existing research, this approach only needs to obtain the sliding mode variable which simplifies the design process. The simulation results show that the designed cooperative guidance law for maneuvering targets achieves the expected effect. It ensures successful cooperative attacks, even when confronted with strong maneuvering targets.
In view of the problem that path planning and trajectory tracking are rarely solved simultaneously in the current research, which hinders their practical implementation, this paper focuses on enhancing the autonomous flight planning capability of unmanned aerial vehicles (UAVs) by investigating integrated path planning and trajectory tracking technologies. The autonomous flight process is divided into two sub-problems: waypoint designing/optimizing and waypoint tracking. Firstly, an improved DB-RRT* algorithm is proposed for waypoint planning to make the algorithm have higher planning efficiency, better optimization results, and overcome the defects of accidental and low reliability of single RRT* planning results. Secondly, the scheme of “offline design + online flight” is adopted to lead the UAV to fly online according to the waypoints’ instructions by using the sliding mode guidance based on angle constraint with finite-time convergence so that it can fly to the destination autonomously. In order to check the performance of the proposed algorithm, a variety of simulations are conducted to verify the feasibility of the proposed algorithm.