Due to the complexity of the ocean environment, an autonomous underwater vehicle (AUV) is disturbed by obstacles when performing tasks. Therefore, the research on underwater obstacle detection and avoidance is particularly important. Based on the images collected by a forward-looking sonar on an AUV, this article proposes an obstacle detection and avoidance algorithm. First, a deep learning-based obstacle candidate area detection algorithm is developed. This algorithm uses the You Only Look Once (YOLO) v3 network to determine obstacle candidate areas in a sonar image. Then, in the determined obstacle candidate areas, the obstacle detection algorithm based on the improved threshold segmentation algorithm is used to detect obstacles accurately. Finally, using the obstacle detection results obtained from the sonar images, an obstacle avoidance algorithm based on deep reinforcement learning (DRL) is developed to plan a reasonable obstacle avoidance path of an AUV. Experimental results show that the proposed algorithms improve obstacle detection accuracy and processing speed of sonar images. At the same time, the proposed algorithms ensure AUV navigation safety in a complex obstacle environment.
Underwater dynamic target tracking technology has a wide application prospect in marine resource exploration, underwater engineering operations, naval battlefield monitoring, and underwater precision guidance. Aiming at the underwater dynamic target tracking problem, an autonomous underwater vehicle tracking control method based on trajectory prediction is studied. First, a deep learning-based target detection algorithm is developed. For the image collected by the multibeam forward-looking sonar image, this algorithm uses the YOLO v3 network to determine the target in a sonar image and obtain the position of the target. Then, a time profit Elman neural network (TPENN) is constructed to predict the trajectory information of the dynamic target. Compared with an ordinary Elman neural network, its accuracy of dynamic target prediction is increased. Finally, underwater tracking of the dynamic target is realized using the model predictive controller (MPC), and the tracking result is stable and reliable. Through simulations and experiment, the proposed underwater dynamic target tracking control method is demonstrated to be effective and feasible.
The autonomous underwater vehicle (AUV) is widely used to search for unknown targets in the complex underwater environment. Due to the unpredictability of the underwater environment, this paper combines the traditional frontier exploration method with deep reinforcement learning (DRL) to enable the AUV to explore the unknown underwater environment autonomously. In this paper, a grid map of the search environment is built by the grid method. The designed asynchronous advantage actor-critic (A3C) network structure is used in the traditional frontier exploration method for target search tasks. This network structure enables the AUV to learn from its own experience and generate search strategies for the various unknown environment. At the same time, DRL and dual-stream Q-learning algorithms are used for AUV navigation to further optimize the search path. The simulations and experiments in an unknown underwater environment with different layouts show that the proposed algorithm can accomplish target search tasks with a high success rate, and it can adapt to different environments. In addition, compared to other search methods, the frontier exploration algorithm based on DRL can search a wider environment faster, which results in a higher search efficiency and reduced search time.
In the research of multi-robot systems, multi-AUV (multiple autonomous underwater vehicles) cooperative target hunting is a hot issue. In order to improve the target hunting efficiency of multi-AUV, a multi-AUV hunting algorithm based on dynamic prediction for the trajectory of the moving target is proposed in this article. Firstly, with moving of the target, sample points are updated dynamically to predict the possible position of a target in a short period time by using the fitting of a polynomial, and the safe domain of the moving target, which is a denied area for the hunting AUVs, is built to avoid the target’s escape when it detects AUVs. Secondly, the method of negotiation is adopted to allocate appropriate desired hunting points for each AUV. Finally, the AUVs arrive at desired hunting points rapidly through deep reinforcement learning (DRL) algorithm to achieve hunting the moving target. The simulations show that hunting AUVs can surround the moving target of which the trajectory is unknown rapidly and accurately by the algorithm in the 3D environment with complex obstacles and results obtained is satisfactory.
1 July 2019 in International Journal of Advanced Robotic Systems
As one of the challenging tasks of multiple autonomous underwater vehicles systems, the realization of target hunting is the great significance. The multiple autonomous underwater vehicle target hunting is studied in this article. In some research, because the hunting members cannot reach the hunting point at the same time, the hunting time is long or the target escapes. To improve the efficiency of the target hunting, the leader–follower formation algorithm is introduced. Firstly, the task is assigned based on the distance between the autonomous underwater vehicle and the target. Then, the autonomous underwater vehicles with the same task are formed based on leader–follower mode, and the formation is kept to track the target. In the final capture phase, multiple autonomous underwater vehicle system use angle matching algorithm to round up target. The simulation results show that the proposed algorithm can effectively accomplish the target hunting task, save the hunting time, and avoid the target escape. Compared with the bioinspired neural network algorithm, the proposed algorithm shows better performance.
1 January 2021 in Intelligent Automation and Soft Computing
As one of the classical problems in autonomous underwater vehicle (AUV) research, path planning has obtained a lot of research results. Many studies have focused on planning an optimal path for AUVs. These optimal paths are sometimes too close to obstacles. In the real environment, it is difficult for AUVs to avoid obstacles according to such an optimal path. To solve the safety problem of AUV path planning in a dynamic uncertain environment, an algorithm combining a bio-inspired neural network and potential field is proposed. Based on the environmental information, the bio-inspired neural network plans the optimal path for the AUV. The potential field function adjusts the path planned by the bio-inspired neural network so that the actual AUV can avoid obstacles. The proposed approach for AUV path planning with safety consideration is capable of planning a real-time “comfortable” trajectory by overcoming either “too close” or “too far” shortcomings. Simulation and experimental results show that the proposed algorithm considers both AUV security and path rationality. The planned path can meet the need for collision-free navigation of AUVs in a dynamic, uncertain environment.