Aiming at the shortcomings of EEG emotion recognition models in feature representation granularity and spatiotemporal dependence modeling, a multimodal emotion recognition model integrating multi-scale feature representation and attention mechanism is proposed. The model consists of a feature extraction module, feature fusion module, and classification module. The feature extraction module includes a multi-stream network module for extracting shallow EEG features and a dual-scale attention module for extracting shallow EOG features. The multi-scale and multi-granularity feature fusion improves the richness and discriminability of multimodal feature representation. Experimental results on two datasets show that the proposed model outperforms the existing model.

Music emotion recognition (MER) is a critical task in the field of music information retrieval. However, most MER research relies solely on single-scale music spectrograms and fails to consider the complementary effects of spectrograms at different scales. Meanwhile, fully extracting emotion-related information from spectrograms remains a major challenge in MER. In this paper, we propose a hybrid attention model based on multi-resolution spectrograms, named MSMHA. The MSMHA model takes multi-scale Mel-spectrograms as inputs, and each input is fed into a well-designed hybrid attention network. The designed attention network successively includes a low-level feature extraction module, a local feature extraction module based on window attention, a channel attention-based long skip connection module, a high-level feature extraction module, and a branch classifier. After being processed by the hybrid attention network, each branch can fully extract emotion-related semantic features from a spectrogram of the specific resolution and output an emotion-classification probability. Finally, a decision-level weighted fusion strategy is applied to the multi-branch outputs to generate the final classification results. The experimental results on the PMEmo dataset demonstrate that our model is both promising and effective, achieving classification accuracies of 90.9%, 86.36%, and 79.87% on the binary-arousal, binary-valence, and four-quadrant dimensions, respectively. Ablation studies further confirm the effectiveness of both the multi-resolution spectrogram inputs and each module of the hybrid attention network.

Redundant channels, sparse electrode topology, and insufficient cross-layer feature fusion limit electroencephalography (EEG)-based emotion recognition. This study proposes the Topology-Aware Dual-Bridge Fusion Network (TDBF-Net), a compact framework that integrates adaptive channel selection, topology-aware sparse convolution, and bidirectional bridge fusion. First, sample entropy, dispersion entropy, and fuzzy entropy are fused to estimate channel importance, while particle swarm optimization (PSO) learns the entropy weights and an elbow-based criterion determines the retained channel subset. Second, differential entropy (DE) features from the $\theta$, $\alpha$, $\beta$, and $\gamma$ bands are mapped to an $8\times 9$ sparse topological tensor according to electrode locations. A fixed spatial validity mask is applied before and after convolution to suppress invalid responses from zero-padded regions and preserve real electrode topology. Third, a dual-bridge fusion module recalibrates shallow and deep features in both directions through channel attention and gated fusion, and a bidirectional long short-term memory network (BiLSTM) further captures short-term temporal dependencies. Subject-dependent experiments on the SJTU Emotion EEG Dataset (SEED) and the Database for Emotion Analysis using Physiological Signals (DEAP) show that TDBF-Net achieves $97.62\%$ ± $1.59\%$ accuracy on SEED and $98.46\%$ ± $0.94\%$ and $98.14\%$ ± $0.77\%$ on DEAP valence and arousal, respectively. Paired DEAP ablations support topology and bridge contributions for valence, whereas the corresponding arousal differences are not significant. Selector controls, robustness tests, computational profiling, and held-out visualizations further characterize the method’s compression, cost, and interpretability. The evidence supports TDBF-Net as an effective subject-dependent framework while leaving subject-independent and cross-dataset generalization for future validation.