28 October 2025 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Vision Language Foundation Models based on CLIP architecture for remote sensing primarily rely on short text captions, which often result in incomplete semantic representations. Although longer captions convey richer information, existing models struggle to process them effectively because of limited textencoding capacity, and there remains a shortage of resources that align remote sensing images with both short text and long text captions. To address this gap, we introduce DGTRSD, a dual-granularity remote sensing image-text dataset, where each image is paired with both a short text caption and a long text description, providing a solid foundation for dual-granularity semantic modeling. Based on this, we further propose DGTRS-CLIP, a dual-granularity curriculum learning framework that combines short text and long text supervision to achieve dual-granularity semantic alignment. Extensive experiments on four typical zero-shot tasks: long text cross-modal retrieval, short text cross-modal retrieval, image classification, and semantic localization demonstrate that DGTRS-CLIP consistently outperforms existing methods across all tasks. The code has been open-sourced and is available at https://github.com/MitsuiChen14/DGTRS.
27 January 2026 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Open-vocabulary segmentation (OVS) allows models to segment any categories based on text prompts, overcoming the limitations of traditional closed-set methods. Open-vocabulary segmentation (OVS) in remote sensing is limited by its reliance on standard RGB images. This prevents models from using valuable information from other spectral bands, such as Near-Infrared (NIR). This paper proposes MovSeg, a framework for multispectral open-vocabulary segmentation. Our method efficiently integrates 4-band (RGB+NIR) data into a pre-trained vision-language model. MovSeg introduces two components: a Multispectral Input Adaptation (MIA) module and a Spatial-Channel Adaptive Tuning (SCAT) strategy. The MIA module adapts the input layer to process 4-band data. It uses a weight-copying strategy for initialization and a WindowECA mechanism to re-weight spectral channels. The SCAT strategy is a parameter-efficient strategy that uses a hybrid of LoRA and Adapters to fine-tune deep features with low computational cost. Experiments on three multispectral datasets show that MovSeg outperforms existing general-domain and remote sensing OVS methods. The model achieves significant gains on NIR-sensitive classes, confirming its ability to exploit the extra spectral data. The codes will be coming soon.
1 January 2026 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
1 January 2026 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing