27 March 2024 in IEEE Transactions on Computational Social Systems
In this article, we propose a new unsupervised domain adaptation (DA) method called layer-adapted implicit distribution alignment networks (LIDANs) to address the challenge of cross-corpus speech emotion recognition (SER). LIDAN extends our previous ICASSP work, deep implicit distribution alignment networks (DIDANs), whose key contribution lies in the introduction of a novel regularization term called implicit distribution alignment (IDA). This term allows DIDAN trained on source (training) speech samples to remain applicable to predicting emotion labels for target (testing) speech samples, regardless of corpus variance in cross-corpus SER. To further enhance this method, we extend IDA to layer-adapted IDA (LIDA), resulting in LIDAN. This layer-adapted extension consists of three modified IDA terms that consider emotion labels at different levels of granularity. These terms are strategically arranged within different fully connected layers in LIDAN, aligning with the increasing emotion-discriminative abilities with respect to the layer depth. This arrangement enables LIDAN to more effectively learn emotion-discriminative and corpus-invariant features for SER across various corpora compared to DIDAN. It is also worthy to mention that unlike most existing methods that rely on estimating statistical moments to describe preassumed explicit distributions, both IDA and LIDA take a different approach. They utilize an idea of target sample reconstruction to directly bridge the feature distribution gap without making assumptions about their distribution type. As a result, DIDAN and LIDAN can be viewed as implicit cross-corpus SER methods. To evaluate LIDAN, we conducted extensive cross-corpus SER experiments on EmoDB, eNTERFACE, and CASIA corpora. The experimental results demonstrate that LIDAN surpasses recent state-of-theart explicit unsupervised DA methods in tackling cross-corpus SER tasks.
20 December 2025 in Expert Systems with Applications
17 March 2026 in IEEE Transactions on Computational Social Systems
P300-based brain–computer interfaces (BCIs) enable direct communication between the brain and external devices by decoding P300 potentials, playing a vital role in rehabilitation and cognitive neuroscience research. Accurate detection of P300 potentials is essential for the successful implementation of P300-based BCIs. Current mainstream P300 detection algorithms are based on multichannel electroencephalogram (EEG) signals, and while promising detection results have been achieved, they still suffer from the following issues: 1) insufficient exploitation of the distinct and characteristic overall temporal trend of P300 potentials; and 2) oversimplified aggregation of multichannel EEG information without effectively utilizing the non-Euclidean topological relationships between EEG channels. To address the above issues, we propose a trend-aware multiscale spatial-temporal graph convolutional neural network (TMSGCN) for P300 detection. Specifically, to effectively capture the long-term temporal trend of P300 potentials to improve detection robustness, we explicitly extract the trend component from raw EEG signals along time dimension and utilize it to assist the identification of P300 potentials. Subsequently, a multiscale temporal convolution module (MTCM) is applied to extract multitime scale amplitude features from the processed EEG signals, serving as input for an adaptive graph convolution module (AGCM). The AGCM effectively models the intricate inter-channel relationships as a graph by complementarily considering the structural and functional connectivity of human brain, thereby capturing more discriminative and informative spatial features related to P300 potentials. Extensive experiments on three datasets demonstrate the superiority of TMSGCN over other state-of-the-art P300 detection methods. Furthermore, the results of ablation study and visualization experiments indicate the effectiveness of each component in TMSGCN.