11 February 2025 in IEEE Transactions on Cybernetics
This article concerns the secure containment control problem for multiple autonomous aerial vehicles. The cyber attacker can manipulate control commands, resulting in containment failure in the position loop. Within a zero-sum graphical game framework, secure containment controllers and malicious attackers are regarded as game players, and the attack-defense process is recast as a min-max optimization problem. Acquiring optimal distributed secure control policies requires solving the game-related Hamilton-Jacobi–Isaacs (HJI) equations. Based on the critic-only neural network (NN) structure, the reinforcement learning (RL) method is employed in solving coupled HJI equations. The fixed-time convergence technique is introduced to improve the convergence rate of RL, and the experience replay mechanism is utilized to relax the persistence of excitation condition. The associated NN convergence and closed-loop stability are analyzed. In the attitude loop, the optimal feedback control law is obtained by solving Hamilton-Jacobi–Bellman equations using the fixed-time convergent RL method. The simulation example and the quadrotor experiment are given to show the effectiveness of the proposed scheme.
20 October 2023 in IEEE Robotics and Automation Letters
This letter proposes an adaptive calibration scheme that integrates Ultra-Wideband (UWB) anchor position estimation and adaptive path planning for Unmanned Aerial Vehicles (UAVs). A closed-form solution, independent of the initial guess of the UWB anchor positions, is rigorously derived, in the UWB anchor position estimation algorithm. Additionally, the covariance of the localization error is provided to adaptively evaluate accuracy. Based on the derived covariance, a path planning strategy is designed for the calibration phase. This strategy enables the UAV to adaptively plan its next best sampling point by optimizing the norm of the covariance matrix, with the convergence of the norm indicating the completion of the calibration phase. Simulation and experiments are carried out to verify the proposed method. Simulations with various parameters are implemented to compare the performance of different methods. In the experiment, a prototype system consisting of an easily deployable multi-UWB anchor base and a vision navigation enabled UAV is designed and realized. The system is then applied in the performance evaluation for the entire UWB-aided vision navigation task. The results of the simulations and experiments validate the effectiveness of the proposed adaptive calibration scheme. The integration of UWB anchor position estimation, path planning, and the vision navigation system leads to improved localization accuracy, efficient calibration completion, and enhanced performance in UWB-aided vision navigation tasks.