Yuan Zhiqiang

Dr. Yuan Zhiqiang

University of Chinese Academy of Sciences,, Beijing, China
orcid

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
20 May 2021 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
YZYuan Zhiqiang
Yuan Zhiqiang
WZWenkai zhang
Wenkai zhang
KFKun Fu
Kun Fu
XLXuan Li
Xuan Li
CDChubo Deng
Chubo Deng
XSXian Sun
Xian Sun
Remote sensing (RS) cross-modal text–image retrieval has attracted extensive attention for its advantages of flexible input and efficient query. However, traditional methods ignore the characteristics of multiscale and redundant targets in RS image, leading to the degradation of retrieval accuracy. To cope with the problem of multiscale scarcity and target redundancy in RS multimodal retrieval task, we come up with a novel asymmetric multimodal feature matching network (AMFMN). Our model adapts to multiscale feature inputs, favors multisource retrieval methods, and can dynamically filter redundant features. AMFMN employs the multiscale visual self-attention (MVSA) module to extract the salient features of RS image and utilizes visual features to guide the text representation. Furthermore, to alleviate the positive samples ambiguity caused by the strong intraclass similarity in RS image, we propose a triplet loss function with dynamic variable margin based on prior similarity of sample pairs. Finally, unlike the traditional RS image-text dataset with coarse text and higher intraclass similarity, we construct a fine-grained and more challenging Remote sensing Image-Text Match dataset (RSITMD), which supports RS image retrieval through keywords and sentence separately and jointly. Experiments on four RS text–image datasets demonstrate that the proposed model can achieve state-of-the-art performance in cross-modal RS text–image retrieval task.

31 March 2022 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
YZYuan Zhiqiang
Yuan Zhiqiang
WZWenkai zhang
Wenkai zhang
CTChangyuan Tian
Changyuan Tian
XRXuee Rong
Xuee Rong
ZZZhengyuan Zhang
Zhengyuan Zhang
XSXian Sun
Xian Sun
Cross-modal remote sensing text-image retrieval (RSCTIR) has recently become an urgent research hotspot due to its ability of enabling fast and flexible information extraction on remote sensing (RS) images. However, current RSCTIR methods mainly focus on global features of RS images, which leads to the neglect of local features that reflect target relationships and saliency. In this article, we first propose a novel RSCTIR framework based on global and local information (GaLR), and design a multi-level information dynamic fusion (MIDF) module to efficaciously integrate features of different levels. MIDF leverages local information to correct global information, utilizes global information to supplement local information, and uses the dynamic addition of the two to generate prominent visual representation. To alleviate the pressure of the redundant targets on the graph convolution network (GCN) and to improve the model’s attention on salient instances during modeling local features, the denoised representation matrix and the enhanced adjacency matrix (DREA) are devised to assist GCN in producing superior local representations. DREA not only filters out redundant features with high similarity, but also obtains more powerful local features by enhancing the features of prominent objects. Finally, to make full use of the information in the similarity matrix during inference, we come up with a plug-and-play multivariate rerank (MR) algorithm. The algorithm utilizes the $k$ nearest neighbors of the retrieval results to perform a reverse search, and improves the performance by combining multiple components of bidirectional retrieval. Extensive experiments on public datasets strongly demonstrate the state-of-the-art performance of GaLR methods on the RSCTIR task. The code of GaLR method, MR algorithm, and corresponding files have been made available at: https://github.com/xiaoyuan1996/GaLR .

29 October 2021 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
YZYuan Zhiqiang
Yuan Zhiqiang
WZWenkai zhang
Wenkai zhang
XRXuee Rong
Xuee Rong
XLXuan Li
Xuan Li
JCJialiang Chen
Jialiang Chen
XSXian Sun
Xian Sun
Remote sensing (RS) crossmodal text-image retrieval has become a research hotspot in recent years for its application in semantic localization. However, since multiple inferences on slices are demanded in semantic localization, designing a crossmodal retrieval model with less computation but well performance becomes an emergent and challenging task. In this article, considering the characteristics of multi-scale and target redundancy in RS, a concise but effective crossmodal retrieval model (LW-MCR) is designed. The proposed model incorporates multi-scale information and dynamically filters out redundant features when encoding RS image, while text features are obtained via lightweight group convolution. To improve the retrieval performance of LW-MCR, we come up with a novel hidden supervised optimization method based on knowledge distillation. This method enables the proposed model to acquire dark knowledge of the multi-level layers and representation layers in the teacher network, which significantly improves the accuracy of our lightweight model. Finally, on the basis of contrast learning, we present a method employing unlabeled data to boost the performance of RS retrieval model further. The experiment results on four RS image-text datasets demonstrate the efficiency of LW-MCR in RS crossmodal retrieval (RSCR) tasks. We have released some codes of the semantic localization and made it open to access at https://github.com/xiaoyuan1996/retrievalSystem .

28 September 2022 in Remote Sensing
Verified
Journal Article
Open access
PDF file
Jinzhe LiuJinzhe Liu
Jinzhe Liu
YZYuan Zhiqiang
Yuan Zhiqiang
ZPZhaoying Pan
Zhaoying Pan
YFYiqun Fu
Yiqun Fu
LLLi Liu
Li Liu
BLBin Lü
Bin Lü
Remote sensing super-resolution (RSSR) aims to improve remote sensing (RS) image resolution while providing finer spatial details, which is of great significance for high-quality RS image interpretation. The traditional RSSR is based on the optimization method, which pays insufficient attention to small targets and lacks the ability of model understanding and detail supplement. To alleviate the above problems, we propose the generative Diffusion Model with Detail Complement (DMDC) for RS super-resolution. Firstly, unlike traditional optimization models with insufficient image understanding, we introduce the diffusion model as a generation model into RSSR tasks and regard low-resolution images as condition information to guide image generation. Next, considering that generative models may not be able to accurately recover specific small objects and complex scenes, we propose the detail supplement task to improve the recovery ability of DMDC. Finally, the strong diversity of the diffusion model makes it possibly inappropriate in RSSR, for this purpose, we come up with joint pixel constraint loss and denoise loss to optimize the direction of inverse diffusion. The extensive qualitative and quantitative experiments demonstrate the superiority of our method in RSSR with small and dense targets. Moreover, the results from direct transfer to different datasets also prove the superior generalization ability of DMDC.

3 November 2022 in International Journal of Applied Earth Observation and Geoinformation
Verified
Journal Article
Open access
YZYuan Zhiqiang
Yuan Zhiqiang
WZWenkai Zhang
Wenkai Zhang
CTChangyuan Tian
Changyuan Tian
YMYongqiang Mao
Yongqiang Mao
RZRuixue Zhou
Ruixue Zhou
XSXian Sun
Xian Sun

19 April 2023 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
YZYuan Zhiqiang
Yuan Zhiqiang
CHChongyang Hao
Chongyang Hao
RZRuixue Zhou
Ruixue Zhou
JCJialiang Chen
Jialiang Chen
MYMiao Yu
Miao Yu
XSXian Sun
Xian Sun
In this paper, we propose an efficient remote sensing fake sample generation (RSFSG) framework based on the diffusion model, so as to generate controllable samples consistent with real scenes. Firstly, in order to alleviate the huge time consumption caused by the large parameters of the diffusion model, we come up with a multi-frequency dynamic knowledge distillation based on the consistent power spectrum of predicted Gaussian noise. The proposed multi-frequency knowledge transfer balances the ununiform output of the lightweight model by learning different frequency outputs during diffusion process at different stages. Secondly, to address the problem of slow training of diffusion models, we propose a progressive training strategy (PTS), inspired by the fitting mechanism of deep networks from low to high frequencies. PTS enables fast fitting of diffusion models by enabling the model to learn from low frequency information such as color at low resolution, and gradually move to high resolution images full of details such as texture. The established above two method achieve well generation performance under lightweight parameters, within almost half of the training time consumption. Extensive evaluations demonstrate that the proposed model significantly outperforms the state-of-the-art methods on RS controllable fake sample generation. With in our knowledge, we are the first work to introduce the diffusion model into the RSFSG task and obtain well performance, the code and the corresponding pre-trained files have released at Link.