15 September 2023 in Ocean Engineering
9 March 2023 in IEEE Transactions on Geoscience and Remote Sensing
Underwater acoustic signal denoising technology aims to overcome the challenge of recovering valuable ship target signals from noisy audios by suppressing underwater background noise. Traditional statistical-based denoising techniques are difficult to be applied effectively in complex underwater environments, especially in the case of extremely low signal-to-noise ratios (SNRs). To address these problems, we propose a noise-aware deep learning model with fullband-subband attention network (NAFSA-Net) for underwater acoustic signal denoising. NAFSA-Net adopts an encoder to extract the feature representation of the input audio. Subsequently, the noise subnet and the target subnet are designed to estimate the noise component and the target component simultaneously. Specifically, some stacked fullband-subband attention (FSA) blocks are deployed in each subnet to capture both global dependencies and fine-grained local dependencies of features. Furthermore, we introduce an interaction module to transmit auxiliary information from the noise subnet to the target subnet. Finally, we propose an improved weight SI-SNR loss function to optimize the training of our model. Experimental results show that our proposed NAFSA-Net substantially outperforms traditional methods and competitive DNN-based solutions in denoising underwater noisy signals with very low SNRs. More importantly, our proposals achieve equally excellent performance on both unseen datasets, which indicates that NAFSA-Net can be a more robust choice for real-world underwater acoustic denoising systems.
10 May 2023 in IEEE/ACM Transactions on Audio, Speech, and Language Processing
Underwater acoustic signal denoising is a challenging task due to the complexity of the underwater environment. Most of the existing methods cannot effectively cope with the problem of underwater acoustic signal (UWAS) denoising at low signal-to-noise ratios (SNRs). According to the characteristics of UWAS, a novel idea is proposed to simultaneously model latent features from both the time and frequency dimensions of complex-valued spectrum in a dual-branch self-attention network, namely DBSA-Net. In this model, both magnitude and phase information in the complex spectrum are enhanced from different dimensions by two branches. Specifically, DBSA-Net is an encoder-decoder based network with several global-local-self-attention (GL-SA) blocks distributed on dual branches between encoder and decoder. Each GL-SA block incorporates global self-attention and local self-attention to capture distant context and fine-grained local dependencies along the temporal and frequency dimensions. Moreover, we also design an information interaction module between two branches to exchange complementary information. This interaction module together with a merge block fuse features extracted from different dimensions, thus enhancing the capability of our model to learn the target signal features. Extensive experiments are conducted to evaluate our model on a publicly available dataset. Results of the ablation experiments show that the different modules of DBSA-Net play their respective roles in improving denoising performance and are empirically valid. In both the seen ships and unseen ships scenarios, the proposed DBSA-Net outperforms existing approaches by a large margin on various evaluation metrics.
16 November 2023 in IEEE Transactions on Geoscience and Remote Sensing
Underwater acoustic signal recognition systems face challenges in achieving high accuracy when processing complex data with low signal-to-noise ratio (SNR) in underwater environments, leading to limited noise robustness. Conventional approaches typically employ pre-trained denoising models for preprocessing noisy signals. However, due to disparate optimization goals between denoising and recognition models, denoising methods might introduce signal distortion, hampering effective enhancement of system accuracy. To address this issue, this paper proposes a novel joint training framework with cross-attention fusion for robust underwater acoustic signal recognition (UASR), called CAF-JT. CAF-JT consists of a denoising module, a recognition module, and the CAF module. It addresses the mismatch problem arising from different optimization directions by jointly training the denoising frontend and the recognition backend. Additionally, inspired by the multi-condition training (MCT) method, the CAF module is designed to fuse characteristics from both denoised and noisy audio, thus incorporating noise information. This fusion mechanism enables the model to better adapt to the characteristics of the noisy environment and enhance its noise robustness. Furthermore, to improve the performance of UASR, TF-Transformer blocks are incorporated into both the denoising module and the recognition module to capture the spatio-temporal distribution of spectral features. The proposed approach is evaluated on two open-source underwater acoustic signal datasets, namely ShipsEar and DeepShip. Extensive experimental demonstrate the superiority of CAF-JT over conventional joint training approaches, showcasing its improved noise robustness. Particularly in low SNR conditions, CAF-JT achieves the best average recognition rates of 94.84% and 93.61% on the two datasets, respectively.