In this study, an adaptive impact-time-control cooperative guidance law based on deep reinforcement learning considering field-of-view (FOV) constraints is proposed for high-speed UAVs with time-varying velocity. Firstly, a reinforcement learning framework for the high-speed UAVs’ guidance problem is established. The optimization objective is to maximize the impact velocity; and the constraints for impact time, dive attacking, and FOV are considered simultaneously. The time-to-go estimation method is improved so that it can be applied to high-speed UAVs with time-varying velocity. Then, in order to improve the applicability and robustness of the agent, environmental uncertainties, including aerodynamic parameter errors, observation noise, and target random maneuvers, are incorporated into the training process. Furthermore, inspired by the algorithm, the recurrent layer is introduced into both the policy and value network. In this way, the agent can automatically adapt to different mission scenarios by updating the hidden states of the recurrent layer. In addition, a compound reward function is designed to train the agent to satisfy the requirements of impact-time control and dive attack simultaneously. Finally, the effectiveness and robustness of the proposed guidance law are validated through numerical simulations conducted across a wide range of scenarios.
To realize the error parameter estimation of strap-down inertial navigation system (SINS) and improve the navigation accuracy for aircraft, a hybrid improved restricted Boltzmann machine BP neural network (IRBM-BPNN) approach, which combines restricted Boltzmann machine (RBM) and BP neural network (BPNN), is proposed to forecast the inertial measurement unit (IMU) instrument errors and initial alignment errors of SINS. Firstly, the error generation mechanism of SINS is analyzed, and initial alignment error model and IMU instrument error model are established. Secondly, an unsupervised RBM method is introduced to initialize BPNN to improve the forecast performance of the neural network. The RBM-BPNN model is constructed through the information fusion of SINS/GPS/CNS integrated navigation system by using the sum of position deviation, the sum of velocity deviation and the sum of attitude deviation as the inputs and by using the error parameters of SINS as the outputs. The RBM-BPNN structure is improved to enhance its forecast accuracy, and the pulse signal is increased as the input of the neural network. Finally, we conduct simulation experiments to forecast and compensate the error parameters of the proposed IRBM-BPNN method. Simulation results show that the artificial neural network method is feasible and effective in forecasting SINS error parameters, and the forecast accuracy of SINS error parameters can be effectively improved by combining RBM and BPNN methods and improving the neural network structure. The proposed IRBM-BPNN method has the optimal forecast accuracy of SINS error parameters and navigation accuracy of aircraft compared with the radial basis function neural network method and BPNN method.
This paper addresses the challenge of ineffective coordination between terminal maneuvering and precision strike capabilities in hypersonic unmanned aerial vehicles (UAVs). To resolve this issue, an intelligent spiral maneuver trajectory generation method utilizing a virtual trajectory framework is proposed. Initially, a relative motion model between the UAV and the virtual center of mass (VCM) is established based on the geometric principles of the Archimedean spiral. Subsequently, the interaction dynamics between the VCM and the target are formulated as a Markov decision process (MDP). A deep reinforcement learning (DRL) approach, employing the proximal policy optimization (PPO) algorithm, is implemented to train a policy network capable of end-to-end virtual trajectory generation. Ultimately, the relative spiral motion is superimposed onto the generated virtual trajectory to synthesize a composite spiral maneuvering trajectory. The simulation results demonstrate that the proposed method achieves expansive spiral maneuvering ranges while ensuring precise target strikes.