29 December 2025 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Due to the substantial domain gaps in Remote Sensing (RS) images that are characterized by variabilities such as location, wavelength, and sensor type, Remote Sensing Domain Generalization (RSDG) has emerged as a critical and valuable research frontier, focusing on developing models that generalize effectively across diverse scenarios. However, research in this area remains underexplored: (1) Current cross-domain methods primarily focus on Domain Adaptation (DA), which adapts models to predefined domains rather than to unseen ones; (2) Few studies target the RSDG issue, especially for semantic segmentation tasks. Existing related models are developed for specific unknown domains, struggling with issues of underfitting on other unseen scenarios; (3) Existing RS foundation models tend to prioritize in-domain performance over cross-domain generalization. To this end, we introduce the first vision foundation model for RSDG semantic segmentation, CrossEarth. CrossEarth demonstrates strong cross-domain generalization through a specially designed data-level Earth-Style Injection pipeline and a model-level Multi-Task Training pipeline. In addition, for the semantic segmentation task, we have curated an RSDG benchmark comprising 32 semantic segmentation scenarios across various regions, spectral bands, platforms, and climates, providing comprehensive evaluations of the generalizability of future RSDG models. Extensive experiments on this collection demonstrate the superiority of CrossEarth over existing state-of-the-art methods.
17 October 2024 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Semantic segmentation models experience a significant performance degradation due to domain shifts between the source and target domains. This issue is particularly prevalent in remote sensing imagery, where a semantic segmentation model trained on images from one satellite is tested on images from another. Previous research has often overlooked the role of data augmentation in enhancing a model's adaptability to target domains. In contrast, this paper proposes a novel self-training framework that incorporates data augmentation at both the input and feature levels, yielding excellent results. Specifically, we introduce a regularized online self-training framework that effectively addresses the challenges of overconfidence and class imbalance inherent in self-training. Based on this framework, we implement two robust data augmentation strategies at the input and feature levels to facilitate the learning of cross-domain invariant knowledge. At the input level, we employ a large-scale domain mixing strategy, termed Multi-Domain Mixing (MDM), to enhance the model's generalization capability. At the feature level, we introduce Masked Feature Augmentation (MFA), a masking-based perturbation technique applied to the semantic features of the target domain. This approach enhances the consistency of teacher-student network predictions in the target domain feature space, thereby improving the robustness of the model's recognition of target domain features. The integration of the proposed self-training framework with dual-level data augmentation culminates in our innovative STDA method. Extensive experimental results on the ISPRS semantic segmentation benchmark demonstrate that STDA outperforms existing stateof-the-art methods, showcasing its effectiveness.