14 July 2023 in IEEE Transactions on Systems, Man, and Cybernetics: Systems
In path planning and guidance algorithms for vehicles, such as unmanned aerial vehicles (UAVs) and missiles, it is essential and imperative to account for obstacle avoidance in complicated flight environment (e.g., no-fly zones). This article presents a novel safe guidance scheme with the guarantee of critical obstacle avoidance for intercepting maneuvering targets. First, the engagement of the missile and the target is formulated as nonlinear planer pursuit-evasion dynamics, and the interaction between the obstacle and the missile are determined. Then, the maneuvering target knowledge is estimated online by the extended disturbance observer (EDO) and incorporated into a separated feedback term of the input channel for the implementation of an approximately optimal actor–critic guidance law framework. To render the safety, the obstacle is thought as constraint objects and mathematically described by high-order control barrier functions (HO-CBFs). Furthermore, HO-CBFs are synthesized with the proposed guidance framework to intercept the maneuvering target with obstacle settings. Finally, numerical simulations under various types of nonstationary targets are performed to illustrate the feasibility and effectiveness of the proposed scheme.
30 May 2022 in IEEE Transactions on Aerospace and Electronic Systems
In this study, a state-following-kernel-based reinforcement learning (RL) method with an extended disturbance observer is proposed, whose application to a missile-target interception system is considered. Firstly, the missile-target engagement is formulated as a vertical planar pursuit-evasion problem. The target maneuver is then estimated by an extended disturbance observer in real time, which leads to 10 an infinite-horizon optimal regulation problem. Next, utilizing the local state approximation ability of state-following kernels, the critic neural network (NN) and actor NN for synchronous iteration are constructed to calculate the approximate optimal guidance policy. The states and NN weights are proven to be uniformly ultimately bounded (UUB) using the Lyapunov method. Finally, numerical simulations against different types of nonstationary targets are effectively tested, and the results highlight the role 15 of state-following kernels in the value function and policy approximation.
1 December 2021 in Aerospace Science and Technology
19 October 2020 in IEEE Access
In this study, an adaptive online data-driven tracking controller for a highly flexible aircraft (HFA) was developed. This control design innovatively combines integral reinforcement learning (IRL) and the optimal control theory to ensure asymptotic tracking performance, even when system dynamics information is difficult to obtain. As online data collection may cause partially observable control problems, this study also incorporates a class of state parameterization method in the proposed controller in order to deal with partial observability. Finally, the proposed controller is demonstrated via a simulation of the longitudinal dynamics of a HFA model.
10 January 2025 in IEEE Transactions on Aerospace and Electronic Systems
In this paper, a class of barrier function based safe homing guidance laws are proposed for maneuvering target interception in complex multiple moving environment. First, the kinematics of the interceptor-target-obstacle system in multiple obstacle scenarios were derived. Subsequently, drawing insights from real-world obstacle detection information, two distinct obstacle avoidance functions are devised: a relative distance-dominated obstacle function and a line-of-sight (LOS)-dominated obstacle function. The resulting obstacle avoidance function generates the corresponding safety constraints on the guidance input, leading to a final guidance law that combines a nominal guidance law with the corresponding deviation term induced by the obstacle function. Leveraging the flexibility of the proposed algorithm, it is extended to scenarios involving multiple dynamic obstacles. Finally, extensive simulations are conducted to facilitate a comparative analysis for the proposed method.