Yeqing Sun

Yeqing Sun

Auto-generated profile, based on publicly available information

Yeqing Sun

College of Electrical and Information Engineering, National Engineering Research Center of Robot Visual Perception and Control Technology, Hunan University, Changsha, China

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
23 December 2024 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
MLMin Liu
Min Liu
ZZZhu Zhang
Zhu Zhang
YBYuan Bian
Yuan Bian
XWXueping Wang
Xueping Wang
YSYeqing Sun
Yeqing Sun
YWYaonan Wang
Yaonan Wang
Visible-infrared person re-identification (VI-ReID) seeks to identify and match individuals across visible and infrared ranges within intelligent monitoring environments. Most current approaches predominantly explore a two-stream network structure that extract global or rigidly split part features and introduce an extra modality for image compensation to guide networks reducing the huge differences between the two modalities. However, these methods are sensitive to misalignment caused by pose/viewpoint variations and additional noises produced by extra modality generating. Within the confines of this articles, we clearly consider addresses above issues and propose a Cross-modality Semantic Consistency Learning (CSCL) network to excavate the semantic consistent features in different modalities by utilizing human semantic information. Specifically, a Parsing-aligned Attention Module (PAM) is introduced to filter out the irrelevant noises with channel-wise attention and dynamically highlight the semantic-aware representations across modalities in different stages of the network. Then, a Semantic-guided Part Alignment Module (SPAM) is introduced, aimed at efficiently producing a collection of semantic-aligned fine-grained features. This is achieved by incorporating parsing loss and division loss constraints, ultimately enhancing the overall person representation. Finally, an Identity-aware Center Mining (ICM) loss is presented to reduce the distribution between modality centers within classes, thereby further alleviating intra-class modality discrepancies. Extensive experiments indicate that CSCL outperforms the state-of-the-art methods on the SYSU-MM01 and RegDB datasets. Notably, the Rank-1/mAP accuracy on the SYSU-MM01 dataset can achieve 75.72%/72.08%.

3 April 2024 in IEEE Transactions on Instrumentation and Measurement
Verified
Journal Article
Closed access
MLMin Liu
Min Liu
YSYeqing Sun
Yeqing Sun
XWXueping Wang
Xueping Wang
YBYuan Bian
Yuan Bian
ZZZhu Zhang
Zhu Zhang
YWYaonan Wang
Yaonan Wang
Visible-infrared object re-identification (VI-ReID) is the task of identifying the same object across cameras with different modalities. It is more challenging than the common ReID task since the complex intra-class interference and large modality divergence. Existing works mainly tend to adopt the instance-level or modality-center-level metric learning to extract the global features or rigid local features without considering modality alignment comprehensively, leading to a limited capacity of modality-invariant feature learning. In response to these challenges, a new approach for VI-ReID called Pose-guided Modality-invariant Feature Alignment (PMFA) is proposed, which can simultaneously eliminate the intra-class interference in each modality and bridge the gap between different modalities. Specifically, a Pose-guided Feature Enhancement (PFE) block is presented to enhance feature discrimination by introducing person key part features, which can eliminate the intra-class interference effectively and guide the ReID model to learn cross-modality consistent features of the same person at the same time. Besides, a Modal Feature Alignment Learning (MFAL) method is proposed to address the substantial modality differences from two perspectives, i.e ., aligning feature distributions and hierarchical aggregation. The design not only narrows the modality gap from an explicit distribution discrepancy perspective but also comprehensively considers both intra-modality and inter-modality constraints. Comprehensive experiments conducted on two challenging datasets demonstrate the superiority of the PMFA approach compared to the latest state-of-the-art methods. Particularly on the SYSU-MM01 dataset, the PMFA approach can achieve 74.22% for Rank-1 accuracy and 70.27% for mAP score, respectively. The source code is available at https://github.com/syq2021/PMFA.