10 January 2025 in IEEE Transactions on Circuits and Systems for Video Technology
Object detection is a fundamental task in computer vision that involves accurately locating and classifying objects within images or video frames. In remote sensing, this task is particularly challenging due to the high resolution, multi-scale features, and diverse ground object characteristics inherent in satellite and UAV imagery. These challenges necessitate more advanced approaches for effective object detection in such environments. While deep learning methods have achieved remarkable success in remote sensing object detection, they typically rely on large amounts of labeled data. Acquiring sufficient labeled data, particularly for novel or rare objects, is both challenging and time-consuming in remote sensing scenarios, limiting the generalization capabilities of existing models. To address these challenges, few-shot learning (FSL) has emerged as a promising approach, aiming to enable models to learn new classes from limited labeled examples. Building on this concept, few-shot object detection (FSOD) specifically targets object detection challenges in data-limited conditions. However, the generalization capability of FSOD models, particularly in remote sensing, is often constrained by the complex and diverse characteristics of the objects present in such environments. In this paper, we propose the Generalization-Enhanced Few-Shot Object Detection (GE-FSOD) model to improve the generalization capability in remote sensing FSOD tasks. Our model introduces three key innovations: the Cross-Level Fusion Pyramid Attention Network (CFPAN) for enhanced multi-scale feature representation, the Multi-Stage Refinement Region Proposal Network (MRRPN) for more accurate region proposals, and the Generalized Classification Loss (GCL) for improved classification performance in few-shot scenarios. GE-FSOD demonstrates superior robustness and accuracy in remote sensing FSOD tasks through these enhancements. Extensive experiments on the DIOR and NWPU VHR-10 datasets show that our model achieves state-of-the-art performance, significantly advancing the field of few-shot object detection in remote sensing. The source code is available at (https://github.com/leenamx/GE-FSOD).
12 January 2026 in IEEE Geoscience and Remote Sensing Magazine
Recent progress in vision-language models (VLMs) has demonstrated impressive capabilities across a variety of tasks in the natural image domain. Motivated by these advancements, the remote sensing community has begun to adopt VLMs for remote sensing vision-language tasks, including image captioning, scene understanding, and visual question answering (VQA). However, existing remote sensing VLMs typically rely on closed-set scene understanding and focus on generic scene descriptions, yet lack the ability to incorporate external knowledge. This limitation hinders their capacity for semantic reasoning over complex or context-dependent queries that involve domain-specific or world knowledge. To address these challenges, we first introduced a multimodal remote sensing world knowledge (RSWK) dataset, which comprises high-resolution satellite imagery and detailed textual descriptions for 14,820 well-known landmarks across 16 categories from 184 countries, integrating both remote sensing domain knowledge and broader world knowledge. Building upon this dataset, we proposed a novel remote sensing retrieval-augmented generation (RS-RAG) framework, which consists of two key components. The multimodal knowledge vector database (MKVD) construction module encodes remote sensing imagery and associated textual knowledge into a unified vector space. The knowledge retrieval and response generation module retrieves and reranks relevant knowledge based on image and/or text queries and incorporates the retrieved content into a knowledge-augmented prompt to guide the VLM in producing contextually grounded responses. We validate the effectiveness of RS-RAG on our designed benchmark covering three vision-language tasks: image captioning, image classification, and VQA, where RS-RAG significantly outperformed state-of-the-art baselines. By bridging remote sensing imagery and comprehensive knowledge, RS-RAG empowers remote sensing VLMs with enhanced contextual reasoning, enabling them to generate more accurate, informative, and semantically grounded outputs across a wide range of tasks.