As an emerging direction of multi-agent collaborative control technology, multiple autonomous underwater vehicle (multi-AUV) cooperative area search technology has played an important role in civilian fields such as marine resource exploration and development, marine rescue, and marine scientific expeditions, as well as in military fields such as mine countermeasures and military underwater reconnaissance. At present, as we continue to explore the ocean, the environment in which AUVs perform search tasks is mostly unknown, with many uncertainties such as obstacles, which places high demands on the autonomous decision-making capabilities of AUVs. Moreover, considering the limited detection capability of a single AUV in underwater environments, while the area searched by the AUV is constantly expanding, a single AUV cannot obtain global state information in real time and can only make behavioral decisions based on local observation information, which adversely affects the coordination between AUVs and the search efficiency of multi-AUV systems. Therefore, in order to face increasingly challenging search tasks, we adopt multi-agent reinforcement learning (MARL) to study the problem of multi-AUV cooperative area search from the perspective of improving autonomous decision-making capabilities and collaboration between AUVs. First, we modeled the search task as a decentralized partial observation Markov decision process (Dec-POMDP) and established a search information map. Each AUV updates the information map based on sonar detection information and information fusion between AUVs, and makes real-time decisions based on this to better address the problem of insufficient observation information caused by the weak perception ability of AUVs in underwater environments. Secondly, we established a multi-AUV cooperative area search system (MACASS), which employs a search strategy based on multi-agent reinforcement learning. The system combines various AUVs into a unified entity using a distributed control approach. During the execution of search tasks, each AUV can make action decisions based on sonar detection information and information exchange among AUVs in the system, utilizing the MARL-based search strategy. As a result, AUVs possess enhanced autonomy in decision-making, enabling them to better handle challenges such as limited detection capabilities and insufficient observational information.

The three-dimensional (3D) path following problem of an underactuated autonomous underwater vehicle with ocean currents disturbances is addressed in this paper. Firstly, the motion equation under the ocean currents disturbance is established, and the dynamic model of 3D tracking error is constructed based on virtual guidance method. Then, a finite-time control scheme based on super-twisting observer and command filtered backstepping technology is proposed. We adopt super-twisting observer based on finite-time theory to observe the ocean currents disturbances for improving the system robust. A command filtered backstepping is proposed to replace the differential process in the conventional backstepping method for avoiding the differential expansion problem. The filter compensation loop is designed to ensure the accuracy of the filtered signal, and the anti-integration saturation link is designed considering the influence of integral saturation. Lyapunov stability theory is used to prove the stability of the underactuated AUV. Simulation studies are conducted to show the effectiveness and robustness of the controller.

This paper proposes a fusion algorithm based on state-tracking collision detection and the simulated annealing potential field (SCD-SAPF) to address the challenges of obstacle avoidance for autonomous underwater vehicles (AUVs) in dynamic environments. Navigating AUVs in complex underwater environments requires robust autonomous obstacle avoidance capabilities. The SCD-SAPF algorithm aims to accurately assess collision risks and efficiently plan avoidance trajectories. The algorithm introduces an SCD model for proactive collision risk assessment, predicting collision risks between AUVs and dynamic obstacles. Additionally, it proposes a simulated annealing (SA) algorithm to optimize trajectory planning in a simulated annealing potential field (SAPF), integrating the SCD model with the SAPF algorithm to guide AUVs in obstacle avoidance by generating optimal heading and velocity outputs. Extensive simulation experiments demonstrate the effectiveness and robustness of the algorithm in various dynamic scenarios, enabling the early avoidance of dynamic obstacles and outperforming traditional methods. This research provides an accurate collision risk assessment and efficient obstacle avoidance trajectory planning, offering an innovative approach to the field of underwater robotics and supporting the enhancement of AUV autonomy and reliability in practical applications.