This paper presents an integrated decision-making and control framework of morphing flight vehicles with variable-span wings in the glide phase. The proposed framework comprehensively consists of morphing strategy, attitude control and online aerodynamic uncertainties estimate, thus outperforms existing works at its capacity of adequately considering the interaction between morphing mechanism and control design. Furthermore, the introduction of deep deterministic policy gradient (DDPG) algorithm has the effect of reducing the dependence on a precise model to some extent. By introducing aerodynamic uncertainties into the training environment and employing estimate, the framework enhances decision-making adaptability. Additionally, the decision-making method is designed to optimal a comprehensive performance index including lift-to-drag ratio and attitude tracking effect, thus ensuring the physical realisability. The effectiveness of decision-making and control is validated by simulation results.
A data-driven nonlinear control approach, called error dynamics-based dual heuristic dynamic programming (ED-DHP), is proposed for air vehicle attitude control. To solve the optimal tracking control problem, the augmented system is defined by the derived error dynamics and reference trajectory so that the actor neural network can learn the feedforward and feedback control terms at the same time. During the online self-learning process, the actor neural network learns the control policy by minimizing the augmented system’s value function. The input dynamics identified by the recursive least square (RLS) and output of the critic neural network are used to update the actor neural network. In addition, the total uncertainty term of the error dynamics is also identified by RLS, which can compensate for the uncertainty caused by inaccurate modeling, parameter perturbation, and so on. The outputs of ED-DHP include the rough trim surface, feedforward and feedback terms from the actor neural network, and the compensation. Based on this control scheme, the complete knowledge of system dynamics and the reference trajectory dynamics are not needed, and offline learning is unnecessary. To verify the self-learning ability of ED-DHP, two numerical experiments are carried out based on the established morphing air vehicle model. One is sinusoidal signal tracking at a fixed operating point, and the other is guidance command tracking with a morphing process at variable operating points. The simulation results demonstrate the good performance of ED-DHP for online self-learning attitude control and validate the robustness of the proposed scheme
22 March 2025 in Engineering Applications of Artificial Intelligence