This paper presents a multimodal maritime dataset and the data collection procedure used to gather it, which aims to facilitate autonomous navigation in restricted water environments. The dataset comprises measurements obtained using various perception and navigation sensors, including a stereo camera, an infrared camera, an omnidirectional camera, three LiDARs, a marine radar, a global positioning system, and an attitude heading reference system. The data were collected along a 7.5-km-long route that includes a narrow canal, inner and outer ports, and near-coastal areas in Pohang, South Korea. The collection was conducted under diverse weather and visual conditions. The dataset and its detailed description are available for free download at https://sites.google.com/view/pohang-canal-dataset .
This letter presents a robust data association method for fusing camera and marine radar measurements in order to automatically detect surface ships and determine their locations with respect to the observing ship. In the preprocessing step for sensor fusion, convolutional neural networks are used to perform feature extraction from camera images and semantic segmentation from radar images. The correspondences between the camera and radar image features are optimized using a pair of geometric parameters, and the positions of all the matched object features are determined. The proposed method enables robust data association even without accurate calibration and alignment between the camera and radar measurements. The feasibility and performance of the proposed method are demonstrated using an experimental dataset obtained in a real coastal environment.
22 September 2023 in IEEE/ASME Transactions on Mechatronics
In this article, we describe the development process of autonomous navigation capabilities of a small cruise boat operating in a canal environment and present the results of a field experiment conducted in the Pohang Canal, South Korea. Nonlinear model predictive control (NMPC) was used for the online trajectory planning and tracking control of the cruise boat in a narrow passage in the canal. To consider the nonlinear characteristics of boat dynamics, system identification was performed using experimental data from various test maneuvers, such as acceleration–deceleration and zigzag trials. To efficiently represent the obstacle structures in the canal environment, we parameterized the canal walls as line segments with point cloud data, captured by an onboard LiDAR sensor, and considered them as constraints for obstacle avoidance. The proposed method was implemented in a single NMPC layer, and its real-world performance was verified through experimental runs in the Pohang Canal.
4 July 2023 in IEEE Robotics and Automation Letters
This letter presents an integrated navigation and control strategy for an autonomous surface vehicle (ASV) to operate in narrow waterways without relying on GPS. The proposed method uses a camera and a light detection and ranging (LiDAR) sensor to detect navigable regions in the waterway. A deep learning-based semantic segmentation algorithm is applied to detect the navigable region in camera images, and the segmented region is projected onto the water surface using planar homography. A line-detection algorithm is also introduced to improve the reliability of detecting navigable regions from LiDAR measurements. A safe collision-free path for the ASV is generated within the navigable regions using model predictive control-based local path planning and control algorithms. The performance and practical utility of the proposed method were demonstrated through field experiments using a small cruise boat, modified as an autonomous surface vehicle.
22 August 2023 in IEEE Journal of Oceanic Engineering
This article addresses autonomous collision avoidance in restricted waterways in compliance with maritime navigation rules. Since waterways may have diverse shapes, it is not straightforward to design a generic approach that can be applied to all types of waterways. In this article, we propose a shape-invariant coordinate system and a systematic collision avoidance procedure that complies with maritime navigation rules. The waterway space is defined using the coordinates in the along-track and cross-track directions to efficiently represent various types of waterway shapes. An automatic collision avoidance algorithm is designed and applied to the transformed coordinate system, which additionally takes into account the compliance with maritime traffic rules in restricted waterways. The performance of the proposed approach is evaluated in diverse types of waterways by performing Monte Carlo simulations, and the simulation results are presented and discussed.