Xingfeng Li

Xingfeng Li

Auto-generated profile, based on publicly available information

Xingfeng Li

Faculty of Data Science, City University of Macau, Macao, China

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
20 January 2020 in IEEE Access
Verified
Journal Article
Open access
ZPzhichao peng
zhichao peng
XLXingfeng Li
Xingfeng Li
ZZZhi ZHU
Zhi ZHU
MUMasashi Unoki
Masashi Unoki
JDJianwu Dang
Jianwu Dang
MAMasato Akagi
Masato Akagi
Emotion information from speech can effectively help robots understand speaker’s intentions in natural human-robot interaction. The human auditory system can easily track temporal dynamics of emotion by perceiving the intensity and fundamental frequency of speech, and focus on the salient emotion regions. Therefore, speech emotion recognition combined with the auditory mechanism and attention mechanism may be an effective way. Some previous studies used auditory-based static features to identify emotion while ignoring the emotion dynamics. Some other studies used attention models to capture the salient regions of emotion while ignoring cognitive continuity. To fully utilize the auditory and attention mechanism, we first investigate temporal modulation cues from auditory front-ends and then propose a joint deep learning model that combines 3D convolutions and attention-based sliding recurrent neural networks (ASRNNs) for emotion recognition. Our experiments on the IEMOCAP and MSP-IMPROV datasets indicate that the proposed method can be effectively used to recognize the emotions of speech from temporal modulation cues. The subjective evaluation shows that the attention patterns of the attention model are basically consistent with human behaviors in recognizing the emotions.

1 July 2019 in Speech Communication
Verified
Journal Article
Closed access
XLXingfeng Li
Xingfeng Li
MAMasato Akagi
Masato Akagi

6 January 2024 in Computers in Biology and Medicine
Verified
Journal Article
Closed access
HDHao Duan
Hao Duan
YZYu Zhang
Yu Zhang
HQHaoye Qiu
Haoye Qiu
XFXiuhao Fu
Xiuhao Fu
CLChunling Liu
Chunling Liu
Feifei CuiFeifei Cui
Feifei Cui

26 June 2023 in IEEE/ACM Transactions on Audio, Speech, and Language Processing
Verified
Journal Article
Closed access
XLXingfeng Li
Xingfeng Li
XSXiaohan Shi
Xiaohan Shi
DHDesheng Hu
Desheng Hu
YLYongwei Li
Yongwei Li
FBFanyu Bu
Fanyu Bu
MAMasato Akagi
Masato Akagi
This research presents a music theory-inspired acoustic representation (hereafter, MTAR) to address improved speech emotion recognition. The recognition of emotion in speech and music is developed in parallel, yet a relatively limited understanding of MTAR for interpreting speech emotions is involved. In the present study, we use music theory to study representative acoustics associated with emotion in speech from vocal emotion expressions and auditory emotion perception domains. In experiments assessing the role and effectiveness of the proposed representation in classifying discrete emotion categories and predicting continuous emotion dimensions, it shows promising performance compared with extensively used features for emotion recognition based on the spectrogram, Mel-spectrogram, Mel-frequency cepstral coefficients, VGGish, and the large baseline feature sets of the INTERSPEECH challenges. This proposal opens up a novel research avenue in developing a computational acoustic representation of speech emotion via music theory.

16 May 2025 in IEEE Transactions on Audio, Speech and Language Processing
Verified
Journal Article
Open access
KLKai Li
Kai Li
KZKhalid Zaman
Khalid Zaman
XLXingfeng Li
Xingfeng Li
MAMasato Akagi
Masato Akagi
JDJianwu Dang
Jianwu Dang
MUMasashi Unoki
Masashi Unoki
Early detection of factory machinery malfunctions is crucial in industrial applications. In machine anomalous sound detection (ASD), different machines exhibit unique vibration-frequency ranges based on their physical properties. Meanwhile, the human auditory system is adept at tracking both temporal and spectral dynamics of machine sounds. Consequently, integrating the computational auditory models of the human auditory system with machine-specific properties can be an effective approach to machine ASD. We first quantified the frequency importances of four types of machines using the Fisher ratio (F-ratio). The quantified frequency importances were then used to design machine-specific non-uniform filterbanks (NUFBs), which extract the log non-uniform spectrum (LNS) feature. The designed NUFBs have a narrower bandwidth and higher filter distribution density in frequency regions with relatively high F-ratios. Finally, spectral and temporal modulation representations derived from the LNS feature were proposed. These proposed LNS feature and modulation representations are input into an autoencoder neural-network-based detector for ASD. The quantification results from the training set of the Malfunctioning Industrial Machine Investigation and Inspection dataset with a signal-to-noise (SNR) of 6 dB reveal that the distinguishing information between normal and anomalous sounds of different machines is encoded non-uniformly in the frequency domain. By highlighting these important frequency regions using NUFBs, the LNS feature can significantly enhance performance using the metric of AUC (area under the receiver operating characteristic curve) under various SNR conditions. Furthermore, modulation representations can further improve performance. Specifically, temporal modulation is effective for fans, pumps, and sliders, while spectral modulation is particularly effective for valves.

29 October 2023
Verified
Conference Paper
Open access
JTJingguang Tian
Jingguang Tian
DHDesheng Hu
Desheng Hu
XSXiaohan Shi
Xiaohan Shi
JHJiajun He
Jiajun He
XLXingfeng Li
Xingfeng Li
XHXinhui Hu
Xinhui Hu
Multimodal emotion recognition is the task of identifying and understanding emotions by integrating information from multiple modalities, such as audio, visual, and textual data. However, the scarcity of labeled data poses a significant challenge for this task. To this end, this paper proposes a novel approach via a semi-supervised learning framework by incorporating consensus decision-making and label correction methods. Firstly, we employ supervised learning on the trimodal input data to establish robust initial models. Secondly, we generate reliable pseudo-labels for unlabelled data by leveraging consensus decision-making and label correction methods. Thirdly, we train the model in a supervised manner using both labeled and pseudo-labeled data. Moreover, the process of generating pseudo-labels and semi-supervised learning can be iterated to refine the model further. Experimental results on the MER 2023 dataset show the effectiveness of our proposed framework, achieving significant improvement on the MER-MULTI, MER-NOISE, and MER-SEMI subsets, respectively.