Multichannel electroencephalogram (EEG) is an array signal that represents brain neural networks and can be applied to characterize information propagation patterns for different emotional states. To reveal these inherent spatial graph features and increase the stability of emotion recognition, we propose an effective emotion recognition model that performs multicategory emotion recognition with multiple emotion-related spatial network topology patterns (MESNPs) by learning discriminative graph topologies in EEG brain networks. To evaluate the performance of our proposed MESNP model, we conducted single-subject and multisubject four-class classification experiments on two public datasets, MAHNOB-HCI and DEAP. Compared with existing feature extraction methods, the MESNP model significantly enhances the multiclass emotional classification performance in the single-subject and multisubject conditions. To evaluate the online version of the proposed MESNP model, we designed an online emotion monitoring system. We recruited 14 participants to conduct the online emotion decoding experiments. The average online experimental accuracy of the 14 participants was 84.56%, indicating that our model can be applied in affective brain–computer interface (aBCI) systems. The offline and online experimental results demonstrate that the proposed MESNP model effectively captures discriminative graph topology patterns and significantly improves emotion classification performance. Moreover, the proposed MESNP model provides a new scheme for extracting features from strongly coupled array signals.
5 June 2024 in IEEE Transactions on Neural Networks and Learning Systems
Benefiting from the high-temporal resolution of electroencephalogram (EEG), EEG-based emotion recognition has become one of the hotspots of affective computing. For EEG-based emotion recognition systems, it is crucial to utilize state-of-the-art learning strategies to automatically learn emotion-related brain cognitive patterns from emotional EEG signals, and the learned stable cognitive patterns effectively ensure the robustness of the emotion recognition system. In this work, to realize the efficient decoding of emotional EEG, we propose a graph learning system Graph Convolutional Network framework with Brain network initial inspiration and Fused attention mechanism (BF-GCN) inspired by the brain cognitive mechanism to automatically learn graph patterns from emotional EEG and improve the performance of EEG emotion recognition. In the proposed BF-GCN, three graph branches, i.e., cognition-inspired functional graph branch, data-driven graph branch, and fused common graph branch, are first elaborately designed to automatically learn emotional cognitive graph patterns from emotional EEG signals. And then, the attention mechanism is adopted to further capture the brain activation graph patterns that are related to emotion cognition to achieve an efficient representation of emotional EEG signals. Essentially, the proposed BF-CGN model is a cognition-inspired graph learning neural network model, which utilizes the spectral graph filtering theory in the automatic learning and extracting of emotional EEG graph patterns. To evaluate the performance of the BF-GCN graph learning system, we conducted subject-dependent and subject-independent experiments on two public datasets, i.e., SEED and SEED-IV. The proposed BF-GCN graph learning system has achieved 97.44% (SEED) and 89.55% (SEED-IV) in subject-dependent experiments, and the results in subject-independent experiments have achieved 92.72% (SEED) and 82.03% (SEED-IV), respectively. The state-of-the-art performance indicates that the proposed BF-GCN graph learning system has a robust performance in EEG-based emotion recognition, which provides a promising direction for affective computing.
The accurate identification of an attention deficit hyperactivity disorder (ADHD) subject has remained a challenge for both neuroscience research and clinical diagnosis. Unfortunately, the traditional methods concerning the classification model and feature extraction usually depend on the single-channel model and static measurements (i.e., functional connectivity, FC) in the small, homogenous single-site dataset, which is limited and may cause the loss of intrinsic information in functional MRI (fMRI). In this study, we proposed a new two-stage network structure by combing a separated channel convolutional neural network (SC-CNN) with an attention-based network (SC-CNN-attention) to discriminate ADHD and healthy controls on a large-scale multi-site database (5 sites and n = 1019). To utilize both intrinsic temporal feature and the interactions of temporal dependent in whole-brain resting-state fMRI, in the first stage of our proposed network structure, a SC- CNN is used to learn the temporal feature of each brain region, and an attention network in the second stage is adopted to capture temporal dependent features among regions and extract fusion features. Using a “leave-one-site-out” cross-validation framework, our proposed method obtained a mean classification accuracy of 68.6% on five different sites, which is higher than those reported in previous studies. The classification results demonstrate that our proposed network is robust to data variants and is also replicated across sites. The combination of the SC-CNN with the attention network is powerful to capture the intrinsic fMRI information to discriminate ADHD across multi-site resting-state fMRI data.
Autism spectrum disorder (ASD) is a common neurodevelopmental disorder and early diagnosis is crucial for effective treatment. Stable and effective biomarkers are essential for understanding the underlying causes of the disorder and improving diagnostic accuracy. Electroencephalography (EEG) signals have proven to be reliable biomarkers for diagnosing ASD. Extracting stable connectivity patterns from EEG signals helps ensure robustness in ASD diagnostic systems. In this study, we propose a hybrid graph convolutional network framework called Rest-HGCN, which utilizes resting-state EEG signals to capture differential patterns of brain connectivity between normal children and ASD patients using graph learning strategies. The Rest-HGCN combines brain network analysis techniques and data-driven strategies to extract discriminative graph features from resting-state EEG signals. By automatically extracting differential graph patterns from these signals, the Rest-HGCN achieves reliable ASD diagnosis. To evaluate the performance of Rest-HGCN, we conducted ASD diagnosis experiments using k-fold cross-validation on the public ABC-CT resting EEG dataset. The proposed Rest-HGCN model achieved accuracies of 87.12 % and 85.32 % in single-subject and cross-experiment analyses, respectively. The results suggest that Rest-HGCN can effectively capture discriminant graph patterns from resting EEG signals and achieve robust ASD diagnosis. This may provide an effective and convenient tool for clinical ASD diagnosis.
18 July 2023 in IEEE Transactions on Neural Networks and Learning Systems
Granger causality-based effective brain connectivity provides a powerful tool to probe the neural mechanism for information processing and the potential features for brain computer interfaces. However, in real applications, traditional Granger causality is prone to the influence of outliers, such as inevitable ocular artifacts, resulting in unreasonable brain linkages and the failure to decipher inherent cognition states. In this work, motivated by constructing the sparse causality brain networks under the strong physiological outlier noise conditions, we proposed a dual Laplacian Granger causality analysis (DLap-GCA) by imposing Laplacian distributions on both model parameters and residuals. In essence, the first Laplacian assumption on residuals will resist the influence of outliers in electroencephalogram (EEG) on causality inference, and the second Laplacian assumption on model parameters will sparsely characterize the intrinsic interactions among multiple brain regions. Through simulation study, we quantitatively verified its effectiveness in suppressing the influence of complex outliers, the stable capacity for model estimation, and sparse network inference. The application to motor-imagery (MI) EEG further reveals that our method can effectively capture the inherent hemispheric lateralization of MI tasks with sparse patterns even under strong noise conditions. The MI classification based on the network features derived from the proposed approach shows higher accuracy than other existing traditional approaches, which is attributed to the discriminative network structures being captured in a timely manner by DLap-GCA even under the single-trial online condition. Basically, these results consistently show its robustness to the influence of complex outliers and the capability of characterizing representative brain networks for cognition information processing, which has the potential to offer reliable network structures for both cognitive studies and future brain–computer interface (BCI) realization.
26 September 2024 in IEEE Transactions on Systems, Man, and Cybernetics: Systems
Electroencephalogram (EEG) brain network embodies the brain’s coordination and interaction mechanism, and the transformations of emotional states are usually accompanied with changes in brain network spatial topologies. To effectively characterize emotions, in this work, we propose a cognition-inspired graph embedding model in the L1-norm space (L1-CGE) to learn an optimal low-dimensional embedded manifold for emotional brain networks. In the L1-CGE, the original brain networks are first encoded in the affinity space with the proposed cognition-inspired metric to construct the latent geometry manifold structure of emotional brain networks, and then the graph learning objective function is defined in the L1-norm space to obtain the optimal low-dimensional representations of brain networks. Essentially, the modularized community structures of emotional brain networks can be effectively emphasized by the L1-CGE to realize an effective depiction for emotions. Compared with existing methods, the L1-CGE model has achieved state-of-the-art performance on three public emotional EEG datasets in off-line conditions. Besides, the robust real-time experimental results have been achieved with the on-line emotion decoding system designed with L1-CGE. Both off-and on-line experimental results consistently demonstrate that the proposed L1-CGE is promising to provide a potential solution for the real-time affective brain–computer interface (aBCI) system.