This study proposed the 3D path planning of an autonomous underwater vehicle (AUV) by using the hierarchical deep Q network (HDQN) combined with the prioritized experience replay. The path planning task was divided into three layers, which realized the dimensionality reduction of state space and solved the problem of dimension disaster. An artificial potential field was used to design the positive rewards of the algorithm to shorten the training time. According to the different requirements of the task, this study modified the rewards in the training process to obtain different paths. The path planning simulation and field tests were carried out. The results of the tests corroborated that the training time of the proposed method was shorter than that of the traditional method. The path obtained by simulation training was proved to be safe and effective.

This research aims to solve the safe navigation problem of autonomous underwater vehicles (AUVs) in deep ocean, which is a complex and changeable environment with various mountains. When an AUV reaches the deep sea navigation, it encounters many underwater canyons, and the hard valley walls threaten its safety seriously. To solve the problem on the safe driving of AUV in underwater canyons and address the potential of AUV autonomous obstacle avoidance in uncertain environments, an improved AUV path planning algorithm based on the deep deterministic policy gradient (DDPG) algorithm is proposed in this work. This method refers to an end-to-end path planning algorithm that optimizes the strategy directly. It takes sensor information as input and driving speed and yaw angle as outputs. The path planning algorithm can reach the predetermined target point while avoiding large-scale static obstacles, such as valley walls in the simulated underwater canyon environment, as well as sudden small-scale dynamic obstacles, such as marine life and other vehicles. In addition, this research aims at the multi-objective structure of the obstacle avoidance of path planning, modularized reward function design, and combined artificial potential field method to set continuous rewards. This research also proposes a new algorithm called deep SumTree-deterministic policy gradient algorithm (SumTree-DDPG), which improves the random storage and extraction strategy of DDPG algorithm experience samples. According to the importance of the experience samples, the samples are classified and stored in combination with the SumTree structure, high-quality samples are extracted continuously, and SumTree-DDPG algorithm finally improves the speed of the convergence model. Finally, this research uses Python language to write an underwater canyon simulation environment and builds a deep reinforcement learning simulation platform on a high-performance computer to conduct simulation learning training for AUV. Data simulation verified that the proposed path planning method can guide the under-actuated underwater robot to navigate to the target without colliding with any obstacles. In comparison with the DDPG algorithm, the stability, training’s total reward, and robustness of the improved Sumtree-DDPG algorithm planner in this study are better.

In this paper, the three-dimensional (3D) path tracking control of an autonomous underwater vehicle (AUV) under the action of sea currents was researched. A novel reward function was proposed to improve learning ability and a disturbance observer was developed to observe the disturbance caused by currents. Based on existing models, the dynamic and kinematic models of the AUV were established. Deep Deterministic Policy Gradient, a deep reinforcement learning, was employed for designing the path tracking controller. Compared with the backstepping sliding mode controller, the controller proposed in this article showed excellent performance, at least in the particular study developed in this article. The improved reward function and the disturbance observer were also found to work well with improving path tracking performance.

This paper aims to focus on the path planning problem of AUV in the marine environment. As well as considering the path length and safe obstacle avoidance, ocean currents should not be ignored as the main factor affecting the navigation energy consumption of AUV. At the same time, the path should satisfy the mobility constraint of AUV; otherwise, the path is inaccessible to AUV. For the above problems, this paper presents a path planning algorithm based on an improved particle swarm (EPA-PSO); the fitness function is designed based on path length, energy consumption, and mobility constraints. The updated law of particle velocity and the initialization law of particles are improved, and the possible optimal solutions are stored in the feasible solution set; finally, the optimal solutions are obtained by comparison. The local jumping ability is given to the particle swarm so that the particles can jump out of the local optimal solution. The path planning simulation experiment is compared with the traditional PSO algorithm. The results show that the EPA-PSO algorithm proposed in this paper can be used in the AUV three-dimensional path planning process. It can effectively save energy and make the navigation path of AUV satisfy the requirements of maneuverability. The field experiment was completed in Shanghai, China, and the experiment proved that it was feasible to obtain a path satisfying the maneuverability constraints with optimal energy consumption for the problems studied in this paper.

The design, control, and implementation of an autonomous underwater vehicle (AUV) for collecting hydrological information from plateau rivers and lakes are presented in this paper. The hardware and software structures of the control system were previously described. A novel sliding mode controller (SMC) with combinational reaching law of vertical hovering motion is proposed to improve the robustness and stability. The S-plane control, a nonlinear controller with little parameters, is used in the horizontal motion. Besides, the navigation strategy based on the dead-reckoning algorithm, a path tracking based on the light-of-sight (LOS) algorithm, and a control allocation strategy considering saturation are present. Finally, experiments were performed in a tank and in a river in the Qinghai–Tibet Plateau to prove the feasibility and reliability of the AUV system.

A water conveyance tunnel is narrow and enclosed with a complex distribution of flow field. The performance of sensors such as Doppler log, magnetic compass, sonar, and depth gauge used by conventional underwater vehicles in the tunnel is greatly affected and can even fail. Aiming at the special operating environment and operational requirements of water conveyance tunnels, this paper designed an architecture suitable for pressurized water conveyance tunnel-detection autonomous underwater vehicles (AUVs). The tunnel-detection AUV (called AUV-T in this paper) with the architecture proposed in this paper could easily and smoothly complete inspection tasks in water conveyance tunnels, and field tests have verified the effectiveness of the architecture. Since an AUV in a water conveyance tunnel cannot go to the surface to rescue itself, in order to ensure its safety we designed the heterogeneous dual-CPU (Central Processing Unit) hot redundancy system based on dual communication lines. The reliability analysis showed that the system can significantly reduce the probability of AUV failure and ensure that the AUV can still be recovered even if it fails in the tunnel.