Xinhui Hu

Xinhui Hu

Auto-generated profile, based on publicly available information

Xinhui Hu

Hithink RoyalFlush AI Research Institute, HangZhou, China

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
29 October 2023
Verified
Conference Paper
Open access
JTJingguang Tian
Jingguang Tian
DHDesheng Hu
Desheng Hu
XSXiaohan Shi
Xiaohan Shi
JHJiajun He
Jiajun He
XLXingfeng Li
Xingfeng Li
XHXinhui Hu
Xinhui Hu
Multimodal emotion recognition is the task of identifying and understanding emotions by integrating information from multiple modalities, such as audio, visual, and textual data. However, the scarcity of labeled data poses a significant challenge for this task. To this end, this paper proposes a novel approach via a semi-supervised learning framework by incorporating consensus decision-making and label correction methods. Firstly, we employ supervised learning on the trimodal input data to establish robust initial models. Secondly, we generate reliable pseudo-labels for unlabelled data by leveraging consensus decision-making and label correction methods. Thirdly, we train the model in a supervised manner using both labeled and pseudo-labeled data. Moreover, the process of generating pseudo-labels and semi-supervised learning can be iterated to refine the model further. Experimental results on the MER 2023 dataset show the effectiveness of our proposed framework, achieving significant improvement on the MER-MULTI, MER-NOISE, and MER-SEMI subsets, respectively.