The vulnerability of deep neural networks against adversarial attacks, i.e ., imperceptible adversarial perturbations can easily give rise to wrong predictions, poses a huge threat to the security of their real-world deployments. In this paper, a novel Adversarial Detection method via Disentangling Natural images and Perturbations (ADDNP) is proposed. Compared to natural images that can typically be modeled by lower-dimensional subspaces or manifolds, the distributions of adversarial perturbations are much more complex, e.g ., one normal example’s adversarial counterparts generated by different attack strategies can be significantly distinct. The proposed ADDNP exploits such distinct properties for the detection of adversarial attacks amongst normal examples. Specifically, we use a dual-branch disentangling framework to encode natural images and perturbations of inputs separately, followed by joint reconstruction. During inference, the reconstruction discrepancy (RD) measured in the learned latent feature space is used as an indicator of adversarial perturbations. The proposed ADDNP algorithm is evaluated on three popular datasets, i.e ., CIFAR-10, CIFAR-100, and mini ImageNet with increasing data complexity, across multiple popular attack strategies. Compared to the existing and state-of-the-art detection methods, ADDNP has demonstrated promising performance on adversarial detection, with significant improvements on more challenging datasets.
Synthetic aperture radar (SAR) provides an all-weather and all-time imaging platform, which is more reliable than electro-optical (EO) remote sensing imagery under extreme weather/lighting conditions. While many large-scale EO-based remote sensing datasets have been released for computer vision tasks, there are few publicly available SAR image datasets due to the high costs associated with acquisition and labeling. Recent works have applied deep learning methods for image translation between SAR and EO. However, the effectiveness of those techniques on high-resolution images has been hindered by a common limitation. Non-linear geometric distortions, induced by different imaging principles of optical and radar sensors, have caused insufficient pixel-wise correspondence between an EO-SAR patch pair. Such a phenomenon is not prominent in low-resolution EO-SAR datasets, e.g., SEN1-2, one of the most frequently used datasets, and thus has been seldom discussed. To address this issue, a new dataset SN6-SAROPT with sub-meter resolution is introduced, and a novel image translation algorithm designed to tackle geometric distortions adaptively is proposed in this paper. Extensive experiments have been conducted to evaluate the proposed algorithm, and the results have validated its superiority over other methods for both SAR to EO (S2E) and EO to SAR (E2S) tasks, especially for urban areas in high-resolution images.
In this study, we tackle the task of road segmentation from Synthetic Aperture Radar (SAR) imagery, which is vital for remote sensing applications including urban planning and disaster management. Despite its significance, SAR-based road segmentation is hindered by the scarcity of high-resolution, annotated SAR datasets and the distinct characteristics of SAR imagery, which differ significantly from more commonly used electro-optical (EO) imagery. To overcome these challenges, we introduce a multi-source data approach, creating the HybridSAR Road Dataset (HSRD). This dataset includes the SpaceNet 6 Road (SN6R) dataset, derived from high-resolution SAR images and OSM road data, as well as the DG-SAR and SN3-SAR datasets, synthesized from existing EO datasets. We adapt an off-the-shelf road segmentation network from the optical to the SAR domain through an enhanced training framework that integrates both real and synthetic data. Our results demonstrate that the HybridSAR Road Dataset and the adapted network significantly enhance the accuracy and robustness of SAR road segmentation, paving the way for future advancements in remote sensing.