As one of the main sources of remote sensing big data, synthetic aperture radar (SAR) can provide all-day and all-weather Earth image acquisition. However, speckle noise in SAR images brings a notable limitation for its big data applications, including image analysis and interpretation. Deep learning has been demonstrated as an advanced method and technology for SAR image despeckling. Most existing deep-learning-based methods adopt supervised learning and use synthetic speckled images to train the despeckling networks. This is because they need clean images as the references, and it is hard to obtain purely clean SAR images in real-world conditions. However, significant differences between synthetic speckled and real SAR images cause the domain gap problem. In other words, they cannot show superior performance for despeckling real SAR images as they do for synthetic speckled images. Inspired by recent studies on self-supervised denoising, we propose an advanced SAR image despeckling method by virtue of Bernoulli-sampling-based self-supervised deep learning, called SSD-SAR-BS. By only using real speckled SAR images, Bernoulli-sampled speckled image pairs (input–target) were obtained as the training data. Then, a multiscale despeckling network was trained on these image pairs. In addition, a dropout-based ensemble was introduced to boost the network performance. Extensive experimental results demonstrated that our proposed method outperforms the state-of-the-art for speckle noise suppression on both synthetic speckled and real SAR datasets (i.e., Sentinel-1 and TerraSAR-X).
17 January 2024 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Synthetic aperture radar (SAR) images are often affected by a type of multiplicative noise known as “speckle” due to their active imaging characteristics.This property complicates the processing and interpretation of SAR images. While deep learning techniques have demonstrated success in despeckling many models are tailored to specific noise levels. This specificity can limit a model's ability to generalize to real SAR images with varying noise levels, potentially leading to over-smoothing or over-focusing on specific details. To address these challenges, we present the Adaptive Noise Estimation and Despeckling Network (ANED-Net). This network consists of a noise-level estimation phase and a noise-level-guided non-blind denoising phase. During the non-blind denoising phase, we develop a Noise Feature-Guided Denoising Network (NFGDN). This network integrates a hierarchical encoder-decoder denoising module based on the Transformer block (T-unet) and a Denoising Enhancement Control (DEC) block. Together, they skillfully capture both local and global dependencies inherent in SAR images, facilitating effective noise removal. Furthermore, we also introduce a Deep-attention mechanism to counteract the attentional collapse observed when the Transformer is extended in depth, enhancing the network's feature extraction capability and strengthening the model's denoising performance. Extensive tests on synthetic and real images show that ANED-Net is robust to different noise scenarios. It effectively mitigates speckle noise even at unspecified levels, and outperforms many established methods.
13 October 2023 in IEEE Transactions on Geoscience and Remote Sensing
Synthetic aperture radar (SAR) images often suffer from speckle noise, which can degrade their visual quality and affect downstream applications. Recently, supervised and self-supervised methods have been proposed by virtue of deep learning with synthetic “noisy-clean” image pairs or only real noisy images as training data, respectively. Among these methods, by avoiding artifact problems in real SAR image denoising, self-supervised methods solve the domain gap problem of supervised methods and hence have attracted significant attention. However, existing self-supervised denoising methods essentially rely on pixel information of images and ignore corresponding semantic information, which makes them challenging to remove speckle noise while retaining detailed features. To this end, we propose a segmentation-guided semantic-aware self-supervised denoising method for SAR images, namely SARDeSeg, where a segmentation network is incorporated with a denoising network and guides it to learn and be aware of the semantic information of the input noisy SAR images. Additionally, a wavelet transform-based connector is introduced to efficiently transmit semantic information between the denoising network and the segmentation network, together with an edge-aware smoothing loss to improve speckle noise suppression while preserving edge features. Experimental results demonstrate that the proposed SARDeSeg outperforms state-of-the-art denoising methods for SAR images, particularly in preserving detailed edge features.
Oriented remote sensing object detection (ORSOD) has gained increasing significance in both military and civilian applications due to the necessity of accurately identifying objects with varying shapes and orientations in remote sensing data. Traditional ORSOD methods often employ fixed label assignment strategies to differentiate between positive and negative samples. However, most of them frequently overlook the impact of object shape on sample quality, leading to an imbalanced distribution of positive samples and exacerbating the inconsistency between classification and regression tasks, thereby limiting detection performance. To address these challenges, we propose a novel shape-dependent assignment (SDA) method that dynamically differentiates positive and negative samples based on object shape. It introduces a new metric for evaluating sample box quality by considering angular differences relative to ground truth (GT) boxes and adjusts the sample scoring threshold according to the aspect ratio of each GT box. In addition, we present a DIoU-adaptive weighting (DAW) module that enhances the interaction between classification and regression tasks by leveraging the distance-IoU metric. This approach not only balances the quantity of samples but also improves their quality, enabling more effective training schemes for samples of varying qualities. We validate our proposed methods through extensive experiments on three challenging ORSOD datasets: DOTA-1.0, HRSC2016, and UCAS-AOD. The results demonstrate that our approach achieves significant improvements, especially for objects with large aspect ratios.