27 July 2025 in Neural Networks
7 May 2026 in IEEE Transactions on Affective Computing
Emotion recognition based on multi-modal physiological signals has recently attracted significant attention. However, challenges remain in multimodal fusion, handling individual differences, and managing the large model sizes in this domain. To address these challenges, we propose a lightweight cross-subject multi-modal emotion recognition model, tiny-MMDNet. This model reduces model parameters by employing a dynamic low-rank approximation technique within a multi-level disentangling framework. Specifically, tiny-MMDNet consists of a modality-level disentangling module and a subject-level disentangling module. The modality-level disentangling module projects the raw multi-modal physiological signals into modality-invariant and modality-specific subspaces, capturing both modality-invariant and modality-specific features. Meanwhile, the subject-level disentangling module separates subject-shared and subject-private features within the modality-level features to enhance cross-subject emotion recognition. Furthermore, tiny-MMDNet dynamically compresses the model through dynamic low-rank approximation, reducing model parameters while maintaining performance. Experimental results demonstrate that tiny-MMDNet achieves superior cross-subject recognition accuracy and effective model compression on public available multi-modal emotion datasets, outperforming current state-of-the-art models.