Guofeng Yi

Guofeng Yi

Auto-generated profile, based on publicly available information

Guofeng Yi

Anhui Province Key Laboratory of Multimodal Cognitive Computation, School of Computer Science and Technology, Anhui University, Hefei, China

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
5 July 2024 in IEEE Transactions on Affective Computing
Verified
Journal Article
Closed access
CFCunhang Fan
Cunhang Fan
KZKang Zhu
Kang Zhu
TJTao Jianhua
Tao Jianhua
GYGuofeng Yi
Guofeng Yi
JXJun Xue
Jun Xue
ZLZhao Lv
Zhao Lv
Recently, multimodal fusion efforts have achieved remarkable success in Multimodal Sentiment Analysis (MSA). However,most of the existing methods are based on model-level fusion, and the challenge of heterogeneity between modalities is not well resolved. Heterogeneity lies in the different feature distributions and distinct representation spaces among different modalities. To mitigate this problem, we propose that fusion is a progressive process, and we introduce a novel multi-level contrastive learning and multi-layer convolution fusion (MCL-MCF) method for MSA. Due to the relationships among multimodal data, the fusion process that involves single-modal to single-modal, single-modal to bimodal or trimodal, and higher-level fused modality semantic consistency is divided into three levels. The first-level contrast learning alleviates heterogeneity between unimodal modalities at the early level ofmultimodal feature fusion. The second-level contrast learning mitigates heterogeneity between unimodal and fused modalities. At the third level, we introduce a tensor convolution fusion (TCF) module that extracts high-level semantic features from the fused modalities and mitigates heterogeneity at the higher feature level through contrastive learning. To simulate fusion as a progressive process, MCF is proposed to fuse shallow and deep features to model complex relationships among modalities. Experiments on three public datasetsshow our approach's state-of-the-art performance.

29 October 2023
Verified
Conference Paper
Open access
GYGuofeng Yi
Guofeng Yi
YYYuguang Yang
Yuguang Yang
YPYu Pan
Yu Pan
YCYuhang Cao
Yuhang Cao
JYJixun Yao
Jixun Yao
HLHeng Lu
Heng Lu