Underwater vehicles performing sampling tasks often encounter significant buoyancy variations due to payload adjustments and environmental changes, which severely challenge the stability and accuracy of controllers. To address this issue, this paper proposes a hybrid control framework that integrates Proximal Policy Optimization (PPO) with adaptive PID tuning. The framework employs PPO to dynamically adjust PID parameters online while incorporating output saturation, stepwise quantization, and dead zone filtering to ensure control safety and actuator longevity. A dual-error state representation—combining instantaneous error and its derivative—along with actuator command buffering is introduced to compensate for system lag and inertia. Comparative simulations and experimental tests demonstrate that the proposed method achieves faster convergence, lower steady-state error, and smoother control signals compared to both conventional PID and pure PPO-based control. The framework is validated through pool tests and field trials, confirming its robustness under realistic hydrodynamic disturbances. This work provides a practical and safe solution for adaptive depth control of sampling-capable AUVs operating in dynamic underwater environments.

We propose a data-driven, model-free adaptive sliding mode control (MFASMC) approach to address the Haidou-1 ARV under-actuated motion control problem with uncertainties, including external disturbances and parameter perturbations. Firstly, we analyzed the two main difficulties in the motion control of Haidou-1 ARV. Secondly, in order to address these problems, a MFASMC control method was introduced. It is combined by a model-free adaptive control (MFAC) method and a sliding mode control (SMC) method. The main advantage of the MFAC method is that it relies only on the real-time measurement data of an ARV instead of any mathematical modeling information, and the SMC method guarantees the MFAC method’s fast convergence and low overshooting. The proposed MFASMC control method can maneuver Haidou-1 ARV cruising at the desired forward speed, heading, and depth, even when the dynamic parameters of the ARV vary widely and external disturbances exist. It also addresses the problem of under-actuated motion control for the Haidou-1 ARV. Finally, the simulation results, including comparisons with a PID method and the MFAC method, demonstrate the effectiveness of our proposed method.