Deep learning has attracted increasing attention across a number of disciplines in recent years. In the field of remote sensing, ship detection based on deep learning for synthetic aperture radar (SAR) imagery is replacing traditional methods as a mainstream research method. The multiple scales of ship objects make the detection of ship targets a challenging task in SAR images. This paper proposes a new methodology for better detection of multi-scale ship objects in SAR images, which is based on YOLOv5 with a small model size (YOLOv5s), namely the multi-scale ship detection network (MSSDNet). We construct two modules in MSSDNet: the CSPMRes2 (Cross Stage Partial network with Modified Res2Net) module for improving feature representation capability and the FC-FPN (Feature Pyramid Network with Fusion Coefficients) module for fusing feature maps adaptively. Firstly, the CSPMRes2 module introduces modified Res2Net (MRes2) with a coordinate attention module (CAM) for multi-scale features extraction in scale dimension, then the CSPMRes2 module will be used as a basic module in the depth dimension of the MSSDNet backbone. Thus, our backbone of MSSDNet has the capabilities of features extraction in both depth and scale dimensions. In the FC-FPN module, we set a learnable fusion coefficient for each feature map participating in fusion, which helps the FC-FPN module choose the best features to fuse for multi-scale objects detection tasks. After the feature fusion, we pass the output through the CSPMRes2 module for better feature representation. The performance evaluation for this study is conducted using an RTX2080Ti GPU, and two different datasets: SSDD and SARShip are used. These experiments on SSDD and SARShip datasets confirm that MSSDNet leads to superior multi-scale ship detection compared with the state-of-the-art methods. Moreover, in comparisons of network model size and inference time, our MSSDNet also has huge advantages with related methods.
Convolutional neural networks (CNNs) have achieved milestones in object detection of synthetic aperture radar (SAR) images. Recently, vision transformers and their variants have shown great promise in detection tasks. However, ship detection in SAR images remains a substantial challenge because of the characteristics of strong scattering, multi-scale, and complex backgrounds of ship objects in SAR images. This paper proposes an enhancement Swin transformer detection network, named ESTDNet, to complete the ship detection in SAR images to solve the above problems. We adopt the Swin transformer of Cascade-R-CNN (Cascade R-CNN Swin) as a benchmark model in ESTDNet. Based on this, we built two modules in ESTDNet: the feature enhancement Swin transformer (FESwin) module for improving feature extraction capability and the adjacent feature fusion (AFF) module for optimizing feature pyramids. Firstly, the FESwin module is employed as the backbone network, aggregating contextual information about perceptions before and after the Swin transformer model using CNN. It uses single-point channel information interaction as the primary and local spatial information interaction as the secondary for scale fusion based on capturing visual dependence through self-attention, which improves spatial-to-channel feature expression and increases the utilization of ship information from SAR images. Secondly, the AFF module is a weighted selection fusion of each high-level feature in the feature pyramid with its adjacent shallow-level features using learnable adaptive weights, allowing the ship information of SAR images to be focused on the feature maps at more scales and improving the recognition and localization capability for ships in SAR images. Finally, the ablation study conducted on the SSDD dataset validates the effectiveness of the two components proposed in the ESTDNet detector. Moreover, the experiments executed on two public datasets consisting of SSDD and SARShip demonstrate that the ESTDNet detector outperforms the state-of-the-art methods, which provides a new idea for ship detection in SAR images.
16 December 2022 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Sparse representation (SR)-based approaches and collaborative representation (CR)-based methods are proved to be effective to detect the anomalies in a hyperspectral image (HSI). Nevertheless, the existing methods for achieving hyperspectral anomaly detection (HAD) generally only consider one of them, failing to comprehensively exploit them to further promote the detection performance. To address the issue, a novel HAD method, which integrates both sparse representation and collaborative representation (SRCR), is proposed in this paper. To be specific, a SR model, whose overcomplete dictionary is generated by means of the density-based clustering algorithm and superpixel segmen-tation method, is firstly constructed for each pixel in an HSI. Then, for each pixel in an HSI, the used atoms in SR model are sifted to form the background dictionary corresponding to the CR model. To fully exploit both SR and CR information, we further combine the residual features obtained from both SR and CR model by the nonlinear transformation function to generate the response map. Finally, to preserve contour information of the objects, a post-processing operation with guided filter is imposed into the response map to acquire the detection result. Experiments conducted on simulated and real data sets demonstrate that the proposed SRCR outperforms the state-of-the-art methods.
1 May 2023 in IEEE Geoscience and Remote Sensing Letters
Hyperspectral anomaly detection (HAD) is a challenging task in hyperspectral image processing, which is to capture the anomaly by spectral and spatial information without prior knowledge. Recently, some isolation forest (IF) methods in the HAD are proposed to achieve good accuracy. However, these methods build isolation trees by the global pixels and single band partition, and the way limits the utilization of spectral-spatial information, resulting in suffering from poor performance in detecting hard anomalies. To this end, a novel two-stream isolation forest based on deep features is proposed for HAD in this article, and it fully exploits the spectral and spatial information to enhance the sensitivity of anomalies. Specifically, the IF model combined with the neural network is first introduced for the HAD, by which deep spectral features are utilized to better guide the construction of IFs. Meanwhile, based on spatial characteristics, the model of two-stream IF is proposed, which is global and local weighted IF. Moreover, to further mine spatial information, the morphological attribute filter and Gaussian filter are applied to generate the spatial detection map, and the spatial result and the two-steam IF spectral result are fused through the nonlinear transformation to obtain the final result. Finally, the experimental results on five hyperspectral data sets demonstrate that the proposed method is superior to other state-of-the-art methods.
Low rank and sparse representation (LRSR) with dual-dictionaries-based methods for detecting anomalies in hyperspectral images (HSIs) are proven to be effective. However, the potential anomaly dictionary is vulnerable to being contaminated by the background pixels in the above methods, and this limits the effect of hyperspectral anomaly detection (HAD). In this paper, a dual dictionaries construction method via two-stage complementary decision (DDC–TSCD) for HAD is proposed. In the first stage, an adaptive inner window–based saliency detection was proposed to yield a coarse binary map, acting as the indicator to select pure background pixels. For the second stage, a background estimation network was designed to generate a fine binary map. Finally, the coarse binary map and fine binary map worked together to construct a pure background dictionary and potential anomaly dictionary in the guidance of the superpixels derived from the first stage. The experiments conducted on public datasets (i.e., HYDICE, Pavia, Los Angeles, San Diego-I, San Diego-II and Texas Coast) demonstrate that DDC–TSCD achieves satisfactory AUC values, which are separately 0.9991, 0.9951, 0.9968, 0.9923, 0.9986 and 0.9969, as compared to four typical methods and three state-of-the-art methods.
The imaging process of real-world images is inevitably polluted by noise, which affects the visual quality and subsequent processing of images. How to restore image details while removing noise has always been a challenging problem. The existing complementary learning strategies combine the advantages of both denoised image learning and noise learning, and have good denoised effects. However, these methods which are based on a single GAN(generative adversarial network), suffer from complex network structure, difficulty in training and further improvement. Therefore, we propose the Dual-GAN complementary learning (DGCL) strategy based on modular complementary learning strategy. The method based on this strategy has been verified on the real-world image denoising datasets (PolyU and SIDD). The results show that this strategy has better performance compared with similar denoising algorithm in terms of visual quality and quantitative measurement, and this strategy shows the potential to further improve the performance by improving a module in the strategy.