This paper proposes an evaluating and mapping methodology of terrain traversability for off-road navigation of autonomous vehicles in unstructured environments. Terrain features are extracted from RGB images and 3D point clouds to create a traversal cost map. The cost map is then employed to plan safe trajectories. Bayesian generalized kernel inference is employed to assess unknown grid attributes due to the sparse raw point cloud data. A Kalman filter also creates density local elevation maps in real time by fusing multiframe information. Consequently, the terrain semantic mapping procedure considers the uncertainty of semantic segmentation and the impact of sensor noise. A Bayesian filter is used to update the surface semantic information in a probabilistic manner. Ultimately, the elevation map is utilized to extract geometric characteristics, which are then integrated with the probabilistic semantic map. This combined map is then used in conjunction with the extended motion primitive planner to plan the most effective trajectory. The experimental results demonstrate that the autonomous vehicles obtain a success rate enhancement ranging from 4.4% to 13.6% and a decrease in trajectory roughness ranging from 5.1% to 35.8% when compared with the most developed outdoor navigation algorithms. Additionally, the autonomous vehicles maintain a terrain surface selection accuracy of over 85% during the navigation process.
This paper investigates a novel reinforcement learning (RL)-based quadratic programming (QP) method for the safety-critical trajectory tracking control of autonomous underwater vehicles (AUVs). The proposed approach addresses the substantial challenge posed by model uncertainty, which may hinder the safety and performance of AUVs operating in complex underwater environments. The RL framework can learn the inherent model uncertainties that affect the constraints in Control Barrier Functions (CBFs) and Control Lyapunov Functions (CLFs). These learned uncertainties are subsequently integrated for formulating a novel RL-CBF-CLF Quadratic Programming (RL-CBF-CLF-QP) controller. Corresponding simulations are demonstrated under diverse trajectory tracking scenarios with high levels of model uncertainties. The simulation results show that the proposed RL-CBF-CLF-QP controller can significantly improve the safety and accuracy of the AUV’s tracking performance.