Heterogeneous change detection (HCD) is a process to determine the change information by analyzing heterogeneous images of the same geographic location taken at different times, which plays an important role in remote sensing applications such as disaster response and environmental monitoring. However, the different imaging mechanisms result in different visual appearances in heterogeneous images, making it difficult to accurately detect changes through direct comparison. To address this problem, we propose a novel self-supervised dual-branch framework (ICSF) for HCD that incorporates inter-modal and cross-modal learning. First, in the inter-modal branch, we perform the contrastive learning on heterogeneous images within their respective modalities to learn the robust and discriminative features, rather than relying on the raw spectral or spatial information from these images. Second, in the cross-modal branch, we perform cross-modal reconstruction to ensure the obtained features exhibit consistent comparability, thereby facilitating the extraction of rich information of the real changes within the images. Next, the difference images (DIs) computed from both branches are further refined using a superpixel segmentation strategy to preserve the consistency of differences within the same ground object. Experimental results on five public datasets with different modality combinations and change events demonstrate the effectiveness of the proposed approach in comparison to ten state-of-the-art methods, achieving the best performance with an average overall accuracy of 95.88% and an average Kappa coefficient of 74.20%.
26 February 2024 in IEEE Geoscience and Remote Sensing Letters
Change detection in synthetic aperture radar (SAR) images is a vital application in remote sensing image processing. Existing unsupervised SAR change detection methods often rely on pre-classification to generate pseudo-labels for classifying the image regions into three classes: nochanged, changed, and uncertain. However, these methods do not fully exploit the pseudo-labels by focusing only on changed and nochanged regions. In this letter, we propose a wavelet transform-based multi-scale self-supervised network (WS 2 Net), which maximizes the utilization of pseudo-labels and incorporates discriminative feature learning. First, we employ clustering as pre-classification to obtain the aforementioned pseudo-labels. Second, we propose a self-supervised triple loss inspired by contrastive and representation learning. This loss comprises the nochanged and changed losses in the feature domain along with the uncertain loss in the source domain. Furthermore, to extract valuable information from SAR images and to improve the noise robustness of the network, we design a wavelet transform-based multi-scale feature extraction module. Finally, a difference image is generated by comparing the features output from the network, which can be further analyzed through segmentation to obtain the final change map. Comparative experiments are conducted with five state-of-the-art methods on three public SAR data sets, showing that the proposed WS 2 Net achieves the best performance with an average percent correct classification of 97.89% and an average kappa coefficient of 90.24%.
Hyperspectral image (HSI) classification plays a key role in the field of earth observation missions. Recently, transformer-based approaches have been widely used for HSI classification due to their ability to model long-range sequences. However, these methods face two main challenges. First, they treat HSI as linear vectors, disregarding their 3D attributes and spatial structure. Second, the repeated concatenation of encoders leads to information loss and gradient vanishing. To overcome these challenges, we propose a new solution called the multi-level feature extraction network (MLFEN). MLFEN consists of two sub-networks: the hybrid convolutional attention module (HCAM) and the enhanced dense vision transformer (EDVT). HCAM incorporates a band shift strategy to eliminate the edge effect of convolution and utilizes hybrid convolutional blocks to capture the 3D properties and spatial structure of HSI. Additionally, an attention module is introduced to identify strongly discriminative features. EDVT reconfigures the organization of original encoders by incorporating dense connections and adaptive feature fusion components, enabling faster propagation of information and mitigating the problem of gradient vanishing. Furthermore, we propose a novel sparse loss function to better fit the data distribution. Extensive experiments conducted on three public datasets demonstrate the significant advancements achieved by MLFEN.
20 April 2026 in ISPRS Journal of Photogrammetry and Remote Sensing