yuxiang cai

Dr. yuxiang cai

orcid

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 January 2022 in Remote Sensing
Verified
Journal Article
Open access
PDF file
YCyuxiang cai
yuxiang cai
YYYingchun Yang
Yingchun Yang
QZQiyi Zheng
Qiyi Zheng
ZSZhengwei Shen
Zhengwei Shen
YSYongheng Shang
Yongheng Shang
ZSZhongtian Shi
Zhongtian Shi
When segmenting massive amounts of remote sensing images collected from different satellites or geographic locations (cities), the pre-trained deep learning models cannot always output satisfactory predictions. To deal with this issue, domain adaptation has been widely utilized to enhance the generalization abilities of the segmentation models. Most of the existing domain adaptation methods, which based on image-to-image translation, firstly transfer the source images to the pseudo-target images, adapt the classifier from the source domain to the target domain. However, these unidirectional methods suffer from the following two limitations: (1) they do not consider the inverse procedure and they cannot fully take advantage of the information from the other domain, which is also beneficial, as confirmed by our experiments; (2) these methods may fail in the cases where transferring the source images to the pseudo-target images is difficult. In this paper, in order to solve these problems, we propose a novel framework BiFDANet for unsupervised bidirectional domain adaptation in the semantic segmentation of remote sensing images. It optimizes the segmentation models in two opposite directions. In the source-to-target direction, BiFDANet learns to transfer the source images to the pseudo-target images and adapts the classifier to the target domain. In the opposite direction, BiFDANet transfers the target images to the pseudo-source images and optimizes the source classifier. At test stage, we make the best of the source classifier and the target classifier, which complement each other with a simple linear combination method, further improving the performance of our BiFDANet. Furthermore, we propose a new bidirectional semantic consistency loss for our BiFDANet to maintain the semantic consistency during the bidirectional image-to-image translation process. The experiments on two datasets including satellite images and aerial images demonstrate the superiority of our method against existing unidirectional methods.

27 December 2021 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
ZCZhenqian Chen
Zhenqian Chen
YSYongheng Shang
Yongheng Shang
APAndre Python
Andre Python
YCyuxiang cai
yuxiang cai
JYJianwei Yin
Jianwei Yin
Instance segmentation is an important method for high-resolution remote sensing images (HRRSIs) analysis. Traditional instance segmentation algorithms are not suitable to analyze complex HRRSIs that exhibit: 1) various shapes and sizes of targets; 2) a large number of small targets; and 3) data with long tail distribution. Here we introduce DB-BlendMask, an efficient and accurate instance segmentation method that can accommodate complex HRRSIs. It is composed of size balance coefficient (SBC), class balance module (CBM), and decomposed attention blender module (DA-Blender module). SBC consists of a fair weight allocation strategy for positive samples in object detection. CBM combines classification obtained in object detection stage to guide the semantic feature extraction. Complementary to a traditional convolutional neural network (CNN) architecture, DA-Blender module has the ability to considerably compress space complexity of attention and merge attention with semantic feature to generate the instance mask. We compare the performance of DB-BlendMask with a benchmark Mask R-CNN on two typical datasets, iSAID, and ISPRS Postdam. We obtain an average detection precision of 39.2% on iSAID and 63.6% on ISPRS Postdam, which corresponds to an improvement of 2.5% and 2.7%, respectively, compared to the benchmark in a real-time scenario.

31 August 2022 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
YCyuxiang cai
yuxiang cai
YYYingchun Yang
Yingchun Yang
YSYongheng Shang
Yongheng Shang
ZCZhenqian Chen
Zhenqian Chen
ZSZhengwei Shen
Zhengwei Shen
JYJianwei Yin
Jianwei Yin
When segmenting the continuous proliferation of unlabeled remotely sensed images, unsupervised domain adaptation (UDA) has become one of the most critical techniques and achieved significant performance. But, in fact, there still exists a large performance gap between the existing UDA frameworks and supervised learning methods, for the majority of UDA frameworks do not consider the intra-domain gap in the target domain. In this article, to further minimize the complex intra-domain shift within the target domain in remote sensing, we propose a novel iterative intra-domain adaptation framework (IterDANet), which conducts inter-domain adaptation (InterDA), entropy-based ranking (ER), and iterative intra-domain adaptation (IntraDA). Specifically, first, to enhance the performance of InterDA built upon generative adversarial network (GAN)-based image-to-image (I2I) translation, we propose a new generator selection strategy (GSS) to assess and choose a well-trained generator for the inter-domain classifier. Then, to produce more accurate pseudolabels for IntraDA, we propose a new pseudolabel generation strategy (PLGS) to remove both high-entropy and low-confident pixels in predicted maps of inter-domain classifier. Finally, to better reduce the intra-domain gap, we propose to cluster all the target images into multiple subdomains using ER and iteratively align the cleanest subdomain with other noisy subdomains. The extensive experiments on the benchmark dataset, which includes cross-city aerial images, highlight the superiority and effectiveness of our IterDANet against the state-of-the-art UDA frameworks.

26 December 2022 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
YCyuxiang cai
yuxiang cai
YYYingchun Yang
Yingchun Yang
YSYongheng Shang
Yongheng Shang
ZSZhengwei Shen
Zhengwei Shen
JYJianwei Yin
Jianwei Yin
Unsupervised domain adaptation (UDA) has become an important technique for cross-domain semantic segmentation (SS) in remote sensing community and obtained remarkable results. However, when transferring from high-resolution (HR) remote sensing images to low-resolution (LR) images, the existing UDA frameworks always fail to segment the LR target images, especially for small objects (e.g., cars), due to the severe spatial resolution shift problem. In this paper, to improve the segmentation ability of UDA models for LR target images and small objects, we propose a novel multi-task domain adaptation network (DASRSNet) for SS of remote sensing images with the aid of super-resolution (SR). The proposed DASRSNet contains domain adaptation for semantic segmentation (DASS) branch, domain adaptation for super-resolution (DASR) branch and feature affinity (FA) module. Specifically, the DASS and DASR branches share the same encoder to extract the domain-invariant features for the target and source domains, and these two branches utilize different decoders and discriminators to conduct cross-domain SS task and SR task, which align the domain shift in output space and image space respectively. Finally, FA module, which involves the proposed FA loss, is applied to enhance the affinity of SS features and SR features for both source and target domains. The experimental results on the cross-city aerial datasets demonstrate the effectiveness and superiority of our DASRSNet against the recent UDA models.

18 June 2025 in IEEE Geoscience and Remote Sensing Magazine
Verified
Journal Article
Closed access
ZZZilun Zhang
Zilun Zhang
HSHaozhan Shen
Haozhan Shen
TZTiancheng Zhao
Tiancheng Zhao
ZGZian Guan
Zian Guan
BCBin Chen
Bin Chen
JYJianwei Yin
Jianwei Yin
Ultrahigh resolution (UHR) remote sensing imagery (RSI) (e.g. 10,000 × 10,000 pixels) poses a significant challenge for current RS vision-language models (RSVLMs). If one chooses to resize the UHR image to the standard input image size, the extensive spatial and contextual information that UHR images contain will be neglected. Otherwise, the original size of these images often exceeds the token limits of standard RSVLMs, making it difficult to process the entire image and capture long-range dependencies to answer the query based on the abundant visual context. In this article, we introduce ImageRAG for RS, a framework to address the complexities of analyzing UHR RSI with a little training requirement. By transforming the UHR RS image analysis task to the image’s long-context selection task, we design an innovative image contextual retrieval mechanism based on the retrieval-augmented generation (RAG) technique, denoted as ImageRAG. ImageRAG’s core innovation lies in its ability to selectively retrieve and focus on the most relevant portions of the UHR image as visual contexts that pertain to a given query. Fast path and slow path modes are proposed in this framework to handle this task efficiently and effectively. ImageRAG allows RSVLMs to manage extensive context and spatial information from UHR RSI, ensuring that the analysis is both accurate and efficient. The code will be released at https://github.com/om-ai-lab/ImageRAG.

28 October 2024
Verified
Conference Paper
Open access
YCyuxiang cai
yuxiang cai
YSYongheng Shang
Yongheng Shang
JYJianwei Yin
Jianwei Yin
Unsupervised domain adaptation (UDA) has been a crucial way for cross-domain semantic segmentation of remote sensing images and reached apparent advents. However, most existing efforts focus on single source single target domain adaptation, which don't explicitly consider the serious domain shift between multiple source and target domains in real applications, especially inter-domain shift between various target domains and intra-domain shift within each target domain. In this paper, to address simultaneous inter-domain shift and intra-domain shift for multiple target domains, we propose a novel unsupervised, multistage, multisource and multitarget domain adaptation network (MultiDAN), which involves multisource and multitarget domain adaptation (MSMTDA), entropy-based clustering (EC) and multistage domain adaptation (MDA). Specifically, MSMTDA learns feature-level multiple adversarial strategies to alleviate complex domain shift between multiple target and source domains. Then, EC clusters the various target domains into multiple subdomains based on entropy of target predictions of MSMTDA. Besides, we propose a new pseudo label update strategy (PLUS) to dynamically produce more accurate pseudo labels for MDA. Finally, MDA aligns the clean subdomains, including pseudo labels generated by PLUS, with other noisy subdomains in the output space via the proposed multistage adaptation algorithm (MAA). The extensive experiments on the benchmark remote sensing datasets highlight the superiority of our MultiDAN against recent state-of-the-art UDA methods.