This research focuses on the adaptive navigation of maritime autonomous surface ships (MASSs) in an uncertain environment. To achieve intelligent obstacle avoidance of MASSs in a port, an autonomous navigation decision-making model based on hierarchical deep reinforcement learning is proposed. The model is mainly composed of two layers: the scene division layer and an autonomous navigation decision-making layer. The scene division layer mainly quantifies the sub-scenarios according to the International Regulations for Preventing Collisions at Sea (COLREG). This research divides the navigational situation of a ship into entities and attributes based on the ontology model and Protégé language. In the decision-making layer, we designed a deep Q-learning algorithm utilizing the environmental model, ship motion space, reward function, and search strategy to learn the environmental state in a quantized sub-scenario to train the navigation strategy. Finally, two sets of verification experiments of the deep reinforcement learning (DRL) and improved DRL algorithms were designed with Rizhao port as a study case. Moreover, the experimental data were analyzed in terms of the convergence trend, iterative path, and collision avoidance effect. The results indicate that the improved DRL algorithm could effectively improve the navigation safety and collision avoidance.
24 June 2021 in IEEE Transactions on Instrumentation and Measurement
A reliable obstacle detection system is crucial for autonomous surface vehicles (ASVs) to realize fully autonomous navigation with no need of human intervention. However, the current detection methods have particular drawbacks, such as poor detection for small objects, low estimation accuracy caused by water surface reflection, and a high rate of false-positive on water-sky interference. Therefore, we propose a new encoder–decoder structured deep semantic segmentation network, which is a water obstacle detection network based on image segmentation (WODIS), to solve the abovementioned problems. The first design feature of WODIS utilizes the use of an encoder network to extract high-level data based on different sampling rates. In order to improve obstacle detection at sea–sky line areas, an attention refine module (ARM) activated by both global average pooling and max pooling to capture high-level information has been designed and integrated into WODIS. In addition, a feature fusion module (FFM) is introduced to help concatenate the multidimensional high-level features in the decoder network. The WODIS is tested and cross-validated using four different types of maritime datasets with the results demonstrating that the mean intersection over union (mIoU) of WODIS can achieve superior segmentation effects for sea-level obstacles to values as high as 91.3%.
1 September 2017 in Journal of Waterway, Port, Coastal, and Ocean Engineering
Because of the increasing size and amount of vessels, it is important to efficiently manage vessel scheduling in ports. This study aims to assess the effects of channel and berth resources on the operation efficiency of ports using a multiobjective vessel scheduling optimization model. Using the minimum total scheduling time and the waiting time of the vessels as input, the model is for a one-way channel considering the safety, efficiency, and fairness of the scheduling. To solve the scheduling problem, the multiobjective genetic algorithm (MOGA) was used. A scheduling trial for 20 vessels at certain peak hours at a port is simulated. The MOGA simulation obtained eight Pareto optimal solutions, which are vessel scheduling schemes. Compared with the first-come, first-served (FCFS) scheduling method, the capacity conversion times of vessels inbound and outbound can be reduced ninefold, and the total scheduling time can be reduced by more than 40%.
Unmanned surface vehicles (USVs) are receiving increasing attention in recent years from both academia and industry. To make a high-level autonomy for USVs, the environment situational awareness is a key capability. However, due to the richness of the features in marine environments, as well as the complexity of the environment influenced by sun glare and sea fog, the development of a reliable situational awareness system remains a challenging problem that requires further studies. This paper, therefore, proposes a new deep semantic segmentation model together with a Simple Linear Iterative Clustering (SLIC) algorithm, for an accurate perception for various maritime environments. More specifically, powered by the SLIC algorithm, the new segmentation model can achieve refined results around obstacle edges and improved accuracy for water surface obstacle segmentation. The overall structure of the new model employs an encoder–decoder layout, and a superpixel refinement is embedded before final outputs. Three publicly available maritime image datasets are used in this paper to train and validate the segmentation model. The final output demonstrates that the proposed model can provide accurate results for obstacle segmentation.