Recently, methods based on deep learning have been successfully applied to ship detection for synthetic aperture radar (SAR) images. However, most current ship detection networks rely too much on the anchor mechanism. These methods have low accuracy and poor generalization ability for multiscale ship detection. To solve the aforementioned problems, an anchor-free framework for multiscale ship detection in SAR images based on a balance attention network (BANet) is proposed. First, due to the diversity of scales and rotation angles of ships, deformable convolution is introduced to build a local attention module (LAM) to better obtain local information of ships and effectively enhance the robustness of the network. Second, a nonlocal attention module (NLAM) is designed to extract the nonlocal features of the SAR image, so as to balance the local features and nonlocal features acquired by the entire network. Finally, the feature pyramid network (FPN) is used to detect ships of different sizes at different scales. The detection results on three datasets demonstrate that the detection precision of our method is higher than that of all comparison methods, and this method achieves the most advanced performance.
Coherent noise often interferes with synthetic aperture radar (SAR), which has a huge impact on subsequent processing and analysis. This paper puts forward a novel algorithm involving the convolutional neural network (CNN) and guided filtering for SAR image denoising, which combines the advantages of model-based optimization and discriminant learning and considers how to obtain the best image information and improve the resolution of the images. The advantages of proposed method are that, firstly, an SAR image is filtered via five different level denoisers to obtain five denoised images, in which the efficient and effective CNN denoiser prior is employed. Later, a guided filtering-based fusion algorithm is used to integrate the five denoised images into a final denoised image. The experimental results indicate that the algorithm cannot eliminate noise, but it does improve the visual effect of the image significantly, allowing it to outperform some recent denoising methods in this field.
16 November 2022 in IEEE Transactions on Geoscience and Remote Sensing
Deep learning-based detection methods have achieved great success in ship target detection in synthetic aperture radar (SAR) images. However, due to the interference of imaging mechanism, speckle noise, and sea and land clutter, ship detection in SAR images still suffers from difficult interpretation. It is found that most ship detection algorithms focus on object-level detection while ignoring pixel-level information. In order to further improve the recognition effectiveness and positioning accuracy of ships in SAR images, we present a novel ship detection method based on a feature interaction network (FINet) in SAR images from the perspective of object-level and pixel-level. FINet consists of an object-level detection network and a pixel-level detection network. The information of the two branches is fused through the feature interaction module (FIM), and then the object-level information and pixel-level information are enhanced by the feature guidance module (FGM). Finally, FINet utilizes object-level and pixel-level detection heads for prediction and regression to obtain object-level classification accuracy, positioning bounding box coordinates, and pixel-level binary classification results. The experimental results demonstrate that the classification effectiveness and localization accuracy of FINet are better than those of the comparison algorithms, and FINet achieves the best performance.
5 February 2024 in IEEE Transactions on Geoscience and Remote Sensing
Synthetic aperture radar (SAR) tends to be seriously affected by speckle noise due to its inherent imaging characteristics, which brings great challenges to the high-level visualization task of SAR images. Therefore, speckle suppression plays a crucial role in remote sensing image processing. Attention-based SAR image denoising algorithms frequently struggle to capture rich feature information and face challenges in balancing the trade-off between denoising and preserving texture details. To solve the above problems, this paper constructs a local and global dual-branch network (LG-DBNet) for SAR image denoising. This network can effectively suppress speckle noise while fully retaining the detail information of the original image. Firstly, the shallow features are extracted through simple convolution. Then, a dual-branch structure constructed using different attention modules is used to extract deep features from SAR images. Specifically, one branch performs local deep feature extraction of an image through a hybrid attention module built by a convolutional neural network (CNN), while the other branch utilizes a superposition of self-attention mechanisms for global deep feature extraction of the image. Finally, the final denoised image is generated through global residual learning. LG-DBNet can effectively extract the local and global image information through the dual-branch structure, and further focus on the noise information, which can better retain the texture information of the image while effectively denoising. The experimental results show that compared with the state-of-the-art SAR image denoising algorithms, the proposed algorithm not only improves on various objective indexes, but also shows great advantages in the visual effect after denoising.
As speckle seriously restricts the applications of remote sensing images in many fields, the ability to efficiently and effectively suppress speckle in a coherent imaging system is indispensable. In order to overcome the over-smoothing problem caused by the speckle suppression algorithm based on classical sparse representation, we propose a non-local speckle suppression algorithm that combines the non-local prior knowledge of the image into the sparse representation. The proposed algorithm first applies shearlet to sparsely represent the input image. We then incorporate the non-local priors as constraints into the image sparse representation de-noising problem. The denoised image is obtained by utilizing an alternating minimization algorithm to solve the corresponding constrained de-noising problem. The experimental results show that the proposed algorithm can not only significantly remove speckle noise, but also improve the visual effect and retain the texture information of the image better.
8 March 2024 in IEEE Transactions on Geoscience and Remote Sensing
Synthetic aperture radar (SAR) target detection has extensively utilized convolutional neural networks (CNNs). Nonetheless, CNN-based methods often achieve favorable detection accuracy at the cost of high model complexity, hindering deployment of the algorithm in real-time application scenarios, such as maritime rescue and military decision making. To deal with this problem, we are the first to propose an ultra-lightweight object detector named Ulit-BiDet for SAR images, which incorporates binary neural network with very low storage and computation costs. First, we creatively design a performance and cost-scalable binary backbone that adapts to the diverse resources and computational capacities on practical devices. Then, the backbone structure is optimized with a new Non-Local Module to enhance semantic contextual information, thereby alleviating false detections caused by the interference from land clutter and sea clutter. Third, considering the SAR imaging mechanism, the interference near the ship boundary with similar scattering power probably affects the localization accuracy due to the interfered object-related contour information. To tackle the localization issue, we uniquely propose to utilize valuable and extra object-related contour semantics to guide representation learning of ship targets. The scheme compels the model to generate features that highlight object contour, thereby promoting accurate boundary localization in ship target detection. We validated the robustness of the proposed network in three mostly-cited publicly available datasets. Experimental results demonstrate that our model achieves 97.2%, 95.2%, and 77.3% detection accuracy with only 1.27M parameters and 0.22G OPs on SSDD, SAR-Ship, and AIR–SARShip2.0 ship detection datasets, respectively.