The collision avoidance in real-time is crucial for unmanned surface vehicles (USVs) in a complex environment. Traditional methods make it hard to ensure the balance of control decisions. To balance safety and practicality, a collision avoidance algorithm based on deep reinforcement learning (DRL) and a two-level incentive reward based on the principle of complementarity is proposed. To address the vital sparse reward problem of Deep Deterministic Policy Gradient (DDPG), the trajectory evaluation function of the dynamic window algorithm (DWA) is referred to construct the primary reward strategy, and a secondary incentive reward is constructed based on velocity obstacle (VO) to eliminate potential collision risks. To improve the efficiency of training, the electronic chart (EC) and Unity3D are used to build an immersive simulation platform. Based on it, simulations are made to verify the performance. In addition, field experiments are first conducted in various encounter scenarios to verify the effectiveness. The results show that it can take safe collision avoidance actions and get practical paths in various situations.
Autonomous collision avoidance technology is the core of unmanned surface vehicles (USVs). Deep reinforcement learning (DRL) is a new approach to avoid collision for USVs. However, most research is based on the assumption of a fixed number of obstacles and ignores the collision prediction to improve safety. To address this problem, a novel “prediction-decision” collision avoidance model based on the deep deterministic policy gradient (DDPG) is proposed. First, a radiation-shaped state space is designed to make the DDPG that can be used in time-varying scenarios with stochastic obstacles. Then, the velocity obstacle (VO) is combined with the state space for training to realize the collision prediction. Subsequently, reward functions are designed using a reward-shaping technique to improve training efficiency and safety. Finally, virtual simulation experiments based on Unity3D and field tests are conducted to verify the algorithm’s performance. The results show that it can take safe collision avoidance actions in unknown environments and with generalization ability.
10 October 2024 in IEEE Transactions on Industrial Electronics
Autonomous berthing is the last crucial step in achieving full autonomy for unmanned surface vehicles (USVs). It can be transformed into a trajectory-tracking problem. A novel autonomous berthing controller based on fixed-time generalized super-twisting is proposed and the unknown disturbance and model nonlinearity are also considered. First, the fixed-time integral sliding mode surface is designed to solve the inherent singularity problem of long-time convergence. The convergence time is bounded by a constant, independent of the initial conditions. Furthermore, a new generalized super-twisting sliding mode controller is developed and a nonsmooth term is adopted to substitute the generally used discontinuous term to eliminate the chattering. In addition, the stability of the closed-loop system is analyzed and verified by a new Lyapunov function designed. Moreover, the simulations and field tests are conducted to verify its performance. The results show that the control scheme proposed outperforms the comparative control schemes.
The design, simulation, and testing of intelligent trajectory-tracking control in narrow waters are essential issues for unmanned surface vehicles (USVs). Due to limited actuators, spatial constraints, and obstacles in narrow waters, the reference trajectory for USVs has various curves. This presents significant challenges to the accuracy and computational load of trajectory tracking. Therefore, a novel event-triggered-based nonlinear model predictive control with artificial reference trajectory (ENMPC-ART) method is proposed. The artificial reference decision variables are integrated into the quadratic trajectory planning of reference trajectory and motion control of USVs to reduce the cross-track error. An event-triggered mechanism is designed to improve NMPCs efficiency. Further, a cyber-physical simulation test framework based on virtual reality is designed to verify the algorithms performance and enhance the immersion. Finally, the proposed ENMPC-ART shows significant improvements through virtual simulations and field tests, such as the maximum cross-track error being reduced by 16% and the computation time being reduced by 20.2%.
16 October 2024 in Colloids and Surfaces A: Physicochemical and Engineering Aspects