In this paper, the three-dimensional (3D) path tracking control of an autonomous underwater vehicle (AUV) under the action of sea currents was researched. A novel reward function was proposed to improve learning ability and a disturbance observer was developed to observe the disturbance caused by currents. Based on existing models, the dynamic and kinematic models of the AUV were established. Deep Deterministic Policy Gradient, a deep reinforcement learning, was employed for designing the path tracking controller. Compared with the backstepping sliding mode controller, the controller proposed in this article showed excellent performance, at least in the particular study developed in this article. The improved reward function and the disturbance observer were also found to work well with improving path tracking performance.

The three-dimensional (3D) path following problem of an underactuated autonomous underwater vehicle with ocean currents disturbances is addressed in this paper. Firstly, the motion equation under the ocean currents disturbance is established, and the dynamic model of 3D tracking error is constructed based on virtual guidance method. Then, a finite-time control scheme based on super-twisting observer and command filtered backstepping technology is proposed. We adopt super-twisting observer based on finite-time theory to observe the ocean currents disturbances for improving the system robust. A command filtered backstepping is proposed to replace the differential process in the conventional backstepping method for avoiding the differential expansion problem. The filter compensation loop is designed to ensure the accuracy of the filtered signal, and the anti-integration saturation link is designed considering the influence of integral saturation. Lyapunov stability theory is used to prove the stability of the underactuated AUV. Simulation studies are conducted to show the effectiveness and robustness of the controller.

Collaborative search with multiple Autonomous Underwater Vehicles (AUVs) significantly enhances search efficiency compared to the use of a single AUV, facilitating the rapid completion of extensive search tasks. However, challenges arise in underwater environments characterized by weak communication and dynamic complexities. In large marine areas, the limited endurance of a single AUV makes it impossible to cover the entire area, necessitating a collaborative approach using multiple AUVs. Addressing the limited prior information available in uncertain marine environments, this paper proposes a map-construction method using fuzzy clustering based on regional importance. Furthermore, a collaborative search method for large marine areas has been designed using a policy-iteration-based reinforcement learning algorithm. Through continuous sensing and interaction during the marine search process, multiple AUVs constantly update the map of regional importance and iteratively optimize the collaborative search strategy to achieve higher search gains. Simulation results confirm the effective utilization of limited information in uncertain environments and demonstrate enhanced search gains in collaborative scenarios.

The long-range autonomous underwater vehicle is a new underwater vehicle with capability of stereoscopic observation of the ocean over a wide range of time series. This article proposed a novel control strategy for the long-range autonomous underwater vehicle considering the energy consumption. The vertical motion model of long-range autonomous underwater vehicle and the mathematical model of energy consumption of motion actuators are established in this article, and the maneuverability simulation experiments were carried out to analyze its motion and energy consumption characteristics. A hybrid controller based on human simulating intelligent control and S-plane control is designed. Considering the moment caused by the asymmetry of the hull in motion, an adaptive dynamic control allocation strategy is designed. Simulation experiments are conducted to demonstrate the performance of the scheme proposed.