In this paper, the important topic of cooperative searches for multi-dynamic targets in unknown sea areas by unmanned aerial vehicles (UAVs) is studied based on a reinforcement learning (RL) algorithm. A novel multi-UAV sea area search map is established, in which models of the environment, UAV dynamics, target dynamics, and sensor detection are involved. Then, the search map is updated and extended using the concept of the territory awareness information map. Finally, according to the search efficiency function, a reward and punishment function is designed, and an RL method is used to generate a multi-UAV cooperative search path online. The simulation results show that the proposed algorithm could effectively perform the search task in the sea area with no prior information.
5 January 2017 in International Journal of Robust and Nonlinear Control
This paper is concerned with sampled-data leader following consensus of multiple unmanned surface vehicle (MUSV) systems with random switching network topologies and wave-induced disturbance. By modelling the switching of network topologies with the use of a Markov process and considering the effect of wave-induced disturbance, a new sampled-data consensus control protocol is proposed. By employing an appropriate Lyapunov-Krosovskii function method and the weak infinitesimal operation, a novel stability criterion is derived, which ensures that the MUSV system can reach robustly leader-following consensus with H∞ performance satisfied. Based on this criterion, the Markov dependent switching consensus controller gains are obtained by solving a set of linear matrix inequalities. Finally, an illustrative example is given to verify the effectiveness of the proposed control scheme for MUSV systems.
In order to enhance the anti-submarine capability of multi-unmanned aerial vehicles (multi-UAVs) in the unknown sea environment and improve the search efficiency, in this paper, we propose a rule-inspired-multi-ant colony (RI-MAC)-based UAV cooperative search algorithm. First, a special sea area anti-submarine search model is established, including an association rule-driven target probability map (TPM) model, a UAV kinematics model, and a sensor model. The novel model has the characteristics of rule linkage, which effectively improves the accuracy of target detection probability in unknown environments. Secondly, according to the established search model, a multi-objective utility function based on association rules is derived. In order to solve the problem of multi-objective optimization, an RI-MAC algorithm based on association rules is proposed, and a pheromone update method using threat avoidance is designed to optimize the search path of multi-UAVs. Finally, a simulation experiment is conducted to verify the effectiveness and superiority of the proposed search algorithm.
17 June 2022 in Optimal Control Applications and Methods
This paper is concerned with robust nonlinear control for multiple unmanned surface vessel (MUSV) systems. Firstly, a mixed nonlinear model was built, in which the probabilistic actuator and fault time-varying communication delay was considered. On the basis of the new model, a robust nonlinear control approach by utilizing Lyapunov-Krosovskii functional is proposed, which can robustly stabilize the MUSV system with a given level of disturbance attenuation ensure the MUSV can track well. Furthermore, additional conditions were established for the designed controller to guaranteeing mesh stability. Eventually, the superiority and effectiveness of the proposed control strategies are verified by numerical simulation.