To overcome the shortcomings of the traditional manual detection of underwater targets in side-scan sonar (SSS) images, a real-time automatic target recognition (ATR) method is proposed in this paper. This method consists of image preprocessing, sampling, ATR by integration of the transformer module and YOLOv5s (that is, TR–YOLOv5s), and target localization. By considering the target-sparse and feature-barren characteristics of SSS images, a novel TR–YOLOv5s network and a down-sampling principle are put forward, and the attention mechanism is introduced in the method to meet the requirements of accuracy and efficiency for underwater target recognition. Experiments verified the proposed method achieved 85.6% mean average precision (mAP) and 87.8% macro-F2 score, and brought 12.5% and 10.6% gains compared with the YOLOv5s network trained from scratch, and had the real-time recognition speed of about 0.068 s per image.
Determining the altitude of side-scan sonar (SSS) above the seabed is critical to correct the geometric distortions in the sonar images. Usually, a technology named bottom tracking is applied to estimate the distance between the sonar and the seafloor. However, the traditional methods for bottom tracking often require pre-defined thresholds and complex optimization processes, which make it difficult to achieve ideal results in complex underwater environments without manual intervention. In this paper, a universal automatic bottom tracking method is proposed based on semantic segmentation. First, the waterfall images generated from SSS backscatter sequences are labeled as water column (WC) and seabed parts, then split into specific patches to build the training dataset. Second, a symmetrical information synthesis module (SISM) is designed and added to DeepLabv3+, which not only weakens the strong echoes in the WC area, but also gives the network the capability of considering the symmetry characteristic of bottom lines, and most importantly, the independent module can be easily combined with any other neural networks. Then, the integrated network is trained with the established dataset. Third, a coarse-to-fine segmentation strategy with the well-trained model is proposed to segment the SSS waterfall images quickly and accurately. Besides, a fast bottom line search algorithm is proposed to further reduce the time consumption of bottom tracking. Finally, the proposed method is validated by the data measured with several commonly used SSSs in various underwater environments. The results show that the proposed method can achieve the bottom tracking accuracy of 1.1 pixels of mean error and 1.26 pixels of standard deviation at the speed of 2128 ping/s, and is robust to interference factors.
With the increasing number of underwater pipeline investigation activities, the research on automatic pipeline detection is of great significance. At this stage, object detection algorithms based on Deep Learning (DL) are widely used due to their abilities to deal with various complex scenarios. However, DL algorithms require massive representative samples, which are difficult to obtain for pipeline detection with sub-bottom profiler (SBP) data. In this paper, a zero-shot pipeline detection method is proposed. First, an efficient sample synthesis method based on SBP imaging principles is proposed to generate samples. Then, the generated samples are used to train the YOLOv5s network and a pipeline detection strategy is developed to meet the real-time requirements. Finally, the trained model is tested with the measured data. In the experiment, the trained model achieved a mAP@0.5 of 0.962, and the mean deviation of the predicted pipeline position is 0.23 pixels with a standard deviation of 1.94 pixels in the horizontal direction and 0.34 pixels with a standard deviation of 2.69 pixels in the vertical direction. In addition, the object detection speed also met the real-time requirements. The above results show that the proposed method has the potential to completely replace the manual interpretation and has very high application value.
Horizon picking from sub-bottom profiler (SBP) images has great significance in marine shallow strata studies. However, the mainstream automatic picking methods cannot handle multiples well, and there is a need to set a group of parameters manually. Considering the constant increase in the amount of SBP data and the high efficiency of deep learning (DL), we proposed a physicals-combined DL method to pick the horizons from SBP images. We adopted the DeeplabV3+ net to extract the horizons and multiples from SBP images. We generated a training dataset from the Jiaozhou Bay survey (Shandong, China) and the Zhujiang estuary survey (Guangzhou, China) to increase the applicability of the trained model. After the DL processing, we proposed a simulated Radon transform method to eliminate the surface-related multiples from the prediction by combining the designed pseudo-Radon transform and correlation analysis. We verified the proposed method using actual data (not involved in the training dataset) from Jiaozhou Bay and Zhujiang estuary. The positions of picked horizons are accurate, and multiples are suppressed.
To obtain the mudflat topography when existing measuring systems and data processing methods are impracticable under special conditions, this paper presents a hovercraft-borne LiDAR (light detection and ranging) system and a novel comprehensive filtering method. The system is based on a hovercraft and equipped with a laser scanner and a POS (position and orientation system). The filtering method firstly segments the point cloud into different segments by combining the geometric and intensity information, then fitting the ground surface by cloth simulation method, and finally synthetically extracts the ground points with three constraints. These constraints are the distance of the point to the fitting surface, the normal difference between the point and the fitting surface, and the proportion of the possible ground points in the total points of each segment. The effectiveness of the measurement system and the development of the post-processing results were verified on the basis of field measurements, in which a total filtering error of 0.3% and the elevation accuracy of 6.4 cm were obtained. The proposed system and methods provide a new way for efficient and accurate topographic survey on mudflats.