3-D imaging sonar is crucial in the exploration of marine resources, and the development of portable device with high-imaging quality and high-real-time performance is the general trend. However, traditional framework methods are limited by the huge amount of computation brought by high-quality imaging, making it difficult to implement in engineering. To address this issue, we develop 3-D real-time sonar system in an algorithm-hardware co-designed way. An ultrawideband distributed and parallel subarray beamforming algorithm (UWB-DPS) is proposed for 3-D acoustic imaging. This is a multistage array time-frequency beamforming method under a distributed parallel computing architecture. Based on this, we propose field-programmable gate array (FPGA)-based accelerator. It divides a large sonar receiving planar array into multiple parallel subarrays, and complete the beamforming in two stages, which can reduce the calculation load and speeds up 3-D imaging. For engineering implementation, we optimized the sparseness of the planar transducer array, with a sparse rate as high as 97.7%. The experimental results show that the calculation amount of the proposed UWB-DPS algorithm is reduced to 1/5.7 of the traditional framework algorithm, the imaging performance is effectively improved, and the FPGA-based accelerator outperforms the CPU software implementation by 935 $\times $ .
Forward-looking sonar is a technique widely used for underwater detection. However, most sonar images have underwater noise and low resolution due to their acoustic properties. In recent years, the semantic segmentation model U-Net has shown excellent segmentation performance, and it has great potential in forward-looking sonar image segmentation. However, forward-looking sonar images are affected by noise, which prevents the existing U-Net model from segmenting small objects effectively. Therefore, this study presents a forward-looking sonar semantic segmentation model called Feature Pyramid U-Net with Attention (FPUA). This model uses residual blocks to improve the training depth of the network. To improve the segmentation accuracy of the network for small objects, a feature pyramid module combined with an attention structure is introduced. This improves the model’s ability to learn deep semantic and shallow detail information. First, the proposed model is compared against other deep learning models and on two datasets, of which one was collected in a tank environment and the other was collected in a real marine environment. To further test the validity of the model, a real forward-looking sonar system was devised and employed in the lake trials. The results show that the proposed model performs better than the other models for small-object and few-sample classes and that it is competitive in semantic segmentation of forward-looking sonar images.
Side scan sonar (SSS) is a multi–purpose ocean sensing technology, but due to the complex engineering and variable underwater environment, its research process often faces many uncertain obstacles. A sonar simulator can provide reasonable research conditions for guiding development and fault diagnosis, by simulating the underwater acoustic propagation and sonar principle to restore the actual experimental scenarios. However, the current open–source sonar simulators gradually lag behind mainstream sonar technology; therefore, they cannot be of sufficient assistance, especially due to their low computational efficiency and unsuitable high–speed mapping simulation. This paper presents a sonar simulator based on a two–level network architecture, which has a flexible task scheduling system and extensible data interaction organization. The echo signal fitting algorithm proposes a polyline path model to accurately capture the propagation delay of the backscattered signal under high–speed motion deviation. The large–scale virtual seabed is the operational nemesis of the conventional sonar simulators; therefore, a modeling simplification algorithm based on a new energy function is developed to optimize the simulator efficiency. This paper arranges several seabed models to test the above simulation algorithms, and finally compares the actual experiment results to prove the application value of this sonar simulator.
20 June 2022 in IEEE Transactions on Instrumentation and Measurement
The development of 3-D underwater imaging systems is restricted by the high hardware costs associated with the use of a large number of transducers, as well as poor image quality due to degrading noise. This report presents the design of a low-complexity 3-D underwater imaging system that can generate high-quality images. In particular, a complex-weight sparse synthesis method for a large planar array is presented to reduce the number of active elements. Then, a denoising network referred to as an asymmetric-pyramid globe residual network is proposed to enhance the acoustic images generated by the sparse planar arrays. This method can perceive the entirety of the 3-D acoustic images for denoising and effectively reduce the degradation effects due to speckle noise and sidelobes. The simulation results demonstrate that the resulting image quality is higher than that achieved using previously developed networks in terms of the peak signal-to-noise ratio and structural similarity index. To validate the proposed system further, an actual system based on the proposed methods was devised and tested via lake-based trials. The experimental results demonstrate the notable improvements obtained considering the sparsity rate and image quality relative to those presented in the previous literature.
1 January 2025 in IEEE Transactions on Instrumentation and Measurement
Imaging sonar plays a critical role in deep-sea exploration and surveying tasks, with miniaturization and high precision being the developmental trends. Traditional designs often focus on adopting sparse arrays to reduce system complexity, but fail to consider the challenges posed by non-ideal underwater environments, especially the degradation of sonar images caused by varying sound velocities and defocusing, along with the harsh requirements for hardware design imposed by extremely high water pressures. To address this issue, we propose a novel design of deep-sea imaging sonar system with universal-scene sparse array (USSA). At the algorithmic level, we propose the USSA and introduce a novel simulated annealing energy function that enhances beamforming performance in both far-field and near-field conditions across a wide range of sound velocities, achieving at least a 3.21 dB reduction in the highest sidelobe in the near field compared to traditional methods. Simultaneously, we propose a velocity-based direct image correction method, which can directly rectify sonar image distortions caused by mismatches between the actual and expected sound velocities, and the structural similarity index measure (SSIM) is improved by at least 5.1%. In terms of hardware, to accommodate the algorithm’s pursuit of universal-scene applicability, we propose a field-programmable gate array (FPGA)-based hybrid system architecture and a pressuretolerant design. This hardware system features reconfigurability and enhanced universal-scene adaptability, providing a reliable platform for algorithm implementation. Based on these concepts, we fabricated a prototype. During a sea trial in the South China Sea, the prototype mounted on a deep-sea crawler and deployed at a depth of 4098 meters under the sea, produced satisfactory images.