Fine-grained classification of ship targets is an important task in remote sensing, having numerous applications in military reconnaissance and sea surveillance. Due to the influence of various imaging factors, ship targets in remote sensing images have considerable inter-class similarity and intra-class difference, which brings significant challenges to fine-grained classification. In response, we developed a contrastive learning network based on causal attention (C2Net) to improve the model’s fine-grained identification ability from local details. The asynchronous feature learning mode of “decoupling + aggregation” is adopted to reduce the mutual influence between local features and improve the quality of local features. In the decoupling stage, the feature vectors of each part of the ship targets are de-correlated using a decoupling function to prevent feature adhesion. Considering the possibility of false associations between results and features, the decoupled part is designed based on the counterfactual causal attention network to enhance the model’s predictive logic. In the aggregation stage, the local attention weight learned in the decoupling stage is used to carry out feature fusion on the trunk feature weight. Then, the proposed feature re-association module is used to re-associate and integrate the target local information contained in the fusion feature to obtain the target feature vector. Finally, the aggregation function is used to complete the clustering process of the target feature vectors and fine-grained classification is realized. Using two large-scale datasets, the experimental results show that the proposed C2Net method had better fine-grained classification than other methods.
The extensive application of unmanned aerial vehicle (UAV) technology has increased academic interest in object detection algorithms for UAV images. Nevertheless, these algorithms present issues such as low accuracy, inadequate stability, and insufficient pre-training model utilization. Therefore, a high-quality object detection method based on a performance-improved object detection baseline and pretraining algorithm is proposed. To fully extract global and local feature information, a hybrid backbone based on the combination of convolutional neural network (CNN) and vision transformer (ViT) is constructed using an excellent object detection method as the baseline network for feature extraction. This backbone is then combined with a more stable and generalizable optimizer to obtain high-quality object detection results. Because the domain gap between natural and UAV aerial photography scenes hinders the application of mainstream pre-training models to downstream UAV image object detection tasks, this study applies the masked image modeling (MIM) method to aerospace remote sensing datasets with a lower volume than mainstream natural scene datasets to produce a pre-training model for the proposed method and further improve UAV image object detection accuracy. Experimental results for two UAV imagery datasets show that the proposed method achieves better object detection performance compared to state-of-the-art (SOTA) methods with fewer pre-training datasets and parameters.
2 April 2024 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Synthetic aperture radar automatic target recognition (SAR-ATR) models based on deep neural networks (DNNs) are vulnerable to attacks of adversarial examples. Universal adversarial attack algorithms can help evaluate and improve the robustness of the SAR-ATR models and have become a research hotspot. However, current universal adversarial attack algorithms have limitations. First, considering the difficulty in obtaining information on the attacking SAR-ATR models, there is an urgent need to design a universal adversarial attack algorithm under a black-box scenario. Second, given the difficulty of acquiring SAR images, the effectiveness of attacks under small-sample conditions requires improvement. To address these limitations, this study proposed a black-box universal adversarial attack algorithm: Transferable Universal Adversarial Network (TUAN). Based on the idea of the generative adversarial network, we implemented the game of generator and attenuator to improve the transferability of universal adversarial perturbation (UAP). We designed loss functions for the generator and attenuator respectively, which can effectively improve the success rate of black-box attacks and the stealthiness of attacks. Additionally, U-Net was used as a network structure of generator and attenuator to fully learn the distribution of examples, thereby enhancing the attack success rate under small-sample conditions. TUAN attained a higher black-box attack success rate and superior stealthiness than up-to-date UAP algorithms in non-targeted and targeted attacks.
Change detection using synthetic aperture radar (SAR) multi-temporal images only detects the change area and generates no information such as change type, which limits its development. This study proposed a new unsupervised application of SAR images that can recognize the change type of the area. First, a regionally restricted principal component analysis k-mean (RRPCA-Kmean) clustering algorithm, combining principal component analysis, k-mean clustering, and mathematical morphology composition, was designed to obtain pre-classification results in combination with change type vectors. Second, a lightweight MobileNet was designed based on the results of the first stage to perform the reclassification of the pre-classification results and obtain the change recognition results of the changed regions. The experimental results using SAR datasets with different resolutions show that the method can guarantee change recognition results with good change detection correctness.
17 November 2022 in IEEE Geoscience and Remote Sensing Letters
Change detection in synthetic aperture radar (SAR) images has garnered significant research interest. However, to date, only the change area can be obtained, which seriously restricts further development of SAR image applications. To solve this problem, this paper proposes a change type recognition method for SAR images based on a statistical bidirectional long short-term memory (LSTM) network. The proposed method can obtain the changed area and identify the land type change between pairs of SAR images. Considering the statistical characteristics and sample number of SAR images, change detection and type recognition are realized in a unified framework. First, feature extraction is performed through the statistical features of the original SAR image and difference image (DI). Then, a bidirectional LSTM network is used to identify the change types and obtain the change detection results under the small sample deep learning network. On two sets of medium-low resolution SAR image data and one set of GaoFen-3 high-resolution real SAR image data, our method produced high-quality results under small sample conditions.
27 November 2024 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Synthetic aperture radar (SAR) automatic target recognition (ATR) systems based on deep neural network models are vulnerable to adversarial examples. Existing SAR adversarial attack algorithms require access to the network structure, parameters, and training data, which are often inaccessible in real-world scenarios. To address this problem, this study proposes an intermediate layer feature attack algorithm that does not rely on training data for the adversary model. Electromagnetic simulation is used to obtain the simulated SAR local data domain during the training stage. A lightweight generator, TinyResNet, is introduced to quickly construct adversarial examples through a one-step mapping process. In addition, the transferability of these examples across different models is improved by eliminating the intermediate layer features of the model. Finally, a domain-agnostic feature attention module is utilized to reduce discrepancies between different data domains from a model perspective, further improving the transferability of adversarial examples across domains. Experimental results on five SAR datasets of ground vehicles, ships, and scene types demonstrate that the proposed algorithm outperforms 13 mainstream adversarial attack algorithms in terms of cross-model and cross-data domain transferability. In particular, the proposed method improves the cross-domain attack success rate by 43.74%–48.88% on the MSTAR dataset.