Huiyang Hu

Huiyang Hu

Auto-generated profile, based on publicly available information

Huiyang Hu

Chinese Academy of Sciences

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
4 December 2024 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
PWPeijin Wang
Peijin Wang
HHHuiyang Hu
Huiyang Hu
BTBoyuan Tong
Boyuan Tong
ZZZiqi Zhang
Ziqi Zhang
FYFanglong Yao
Fanglong Yao
XSXian Sun
Xian Sun
Recently, multi-modal large language models (MLLMs) have shown excellent reasoning capabilities in various fields. Most of the existing remote sensing MLLMs solve image-level text generation problems (e.g., image captioning), but ignore the core issues of object-level recognition, location and multi-temporal changes in the field of remote sensing. In this paper, we propose RingMoGPT, a multi-modal foundation model that unifies vision, language, and localization. Based on the idea of domain adaption, RingMoGPT can complete training by fine-tuning only a few parameters. To make the model capable of object detection and change captioning, we further propose a Location- and Instruction-aware Q-Former and a change detection module, respectively. To improve the performance of RingMoGPT, we carefully design the pre-training dataset and the instruction-tuning dataset. The pre-training dataset contains over a half million high-quality image and text pairs, which are generated through a low-cost and efficient data generation paradigm. The instruction-tuning dataset contains more than 1.6 million question-answer pairs, including 6 downstream tasks: scene classification, object detection, visual question answering, image captioning, grounded image captioning, and change captioning. Our experiments show that RingMoGPT performs well on 6 tasks, especially its ability to analyze multi-temporal data changes and identify dense objects. We also verified the model under zero-shot setting, and the results show that the proposed RingMoGPT also has good generalization ability in the face of new data.

29 August 2025 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
PWPeijin Wang
Peijin Wang
HCHao Chang
Hao Chang
HHHuiyang Hu
Huiyang Hu
XLXin Li
Xin Li
XLXiaorui Liu
Xiaorui Liu
XSXian Sun
Xian Sun
Previous studies on remote sensing foundation models have demonstrated the representational ability of convolutional neural networks (CNNs) and vision transformers (ViTs). However, these models either focus on single-sensor data, thereby overlooking complementary information across sensors, or they increase the computational complexity in pursuit of a global receptive field. In this manuscript, we introduce RingMamba, a novel multi-sensor RS foundation model that excels in both performance and efficiency. To achieve unified representation learning for multi-sensor data, we propose a multi-sensor self-supervised pre-training framework that integrates generative and contrastive learning strategies based on texture feature constraints, enabling unsupervised training of massive multi-sensor data. Considering the multi-angle and multi-size distribution of instances, we also propose an Asymmetric Scan and Scan Couple block to achieve multi-directional scanning and recognition. We validate the performance of the model on multimodal semantic segmentation, scene classification, object detection, and change detection tasks using nine public datasets. The experimental results shows leading performance across these tasks. Additionally, we evaluate the computational consumption of the model for classification tasks under different input sizes. The results show that our model maintains leading performance with higher throughput and lower FLOPs, especially under high-resolution inputs, making it more suitable for the remote sensing field.

1 November 2026 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
HHHuiyang Hu
Huiyang Hu
PWPeijin Wang
Peijin Wang
YFYingchao Feng
Yingchao Feng
KWKaiwen Wei
Kaiwen Wei
WYWenxin Yin
Wenxin Yin
XSXian Sun
Xian Sun
Remote sensing (RS) images from multiple modalities and platforms exhibit diverse details due to differences in sensor characteristics and imaging perspectives. Existing visionlanguage research in RS largely relies on relatively homogeneous data sources. Moreover, they still remain limited to conventional visual perception tasks such as classification or captioning. As a result, these methods fail to serve as a unified and standalone framework capable of effectively handling RS imagery from diverse sources in real-world applications. To address these issues, we propose RingMo-Agent, a model designed to handle multimodal and multi-platform data that performs perception and reasoning tasks based on user textual instructions. Compared with existing models, RingMo-Agent 1) is supported by a largescale vision-language dataset named RS-VL3M, comprising over 3 million image-text pairs, spanning optical, SAR, and infrared (IR) modalities collected from both satellite and UAV platforms, covering perception and challenging reasoning tasks; 2) learns modality adaptive representations by incorporating separated embedding layers to construct isolated features for heterogeneous modalities and reduce cross-modal interference; 3) functions as an agent-based framework equipped with external tool-use capabilities, employing a reinforcement learning-optimized trajectory decoding mechanism that integrates visual grounding tools for long-horizon embodied navigation tasks. Extensive experiments on various RS vision-language tasks demonstrate that RingMo- Agent not only proves effective in both visual understanding and sophisticated analytical tasks, but also exhibits strong generalizability across different platforms and sensing modalities.