Anxiety is a complex emotional state that has a great impact on people's physical and mental health. Effectively identifying different anxiety states is very important. By inducing various anxiety states with electroencephalograph (EEG) recording, comprehensive EEG features (frequency and time domain features, statistical and nonlinear features) were extracted from different EEG bands and brain locations. Next, correlation analysis was performed for feature selection. And different classifiers were applied to classify four anxiety levels using different features alone or together to explore their anxiety recognition ability. Based on our dataset, the highest accuracy of identifying four anxiety states reached approximately 62.56% using the Support Vector Machine (SVM), which improved the classification accuracy compared with previous studies. The results also revealed the importance of EEG linear features (especially for features including total power, mean square and variance) in anxiety recognition. Furthermore, it suggested that EEG features in the beta band and the frontal lobe contributed to anxiety recognition more than the features in the other bands or other brain locations. In short, this study improves the accuracy of multi-level anxiety recognition and helps in choosing better features for anxiety recognition, which lay the foundation for the detection of continuous anxiety changes.
23 October 2023 in IEEE Journal of Biomedical and Health Informatics
Neural decoding aims to extract information from neurons' activities to reveal how the brain functions. Due to the inherent spatial and temporal characteristics of brain signals, spatio-temporal computing has become a hot topic for neural decoding. However, the extant spatio-temporal decoding methods usually use static brain topology, ignoring the dynamic patterns of the interaction between brain regions. Further, they do not identify the hierarchical organization of brain topology, leading to only superficial insight into brain spatio-temporal interactions. Therefore, here we propose a novel framework, the Multi-Scale Spatio-Temporal framework with Adaptive Brain Topology Learning (MSST-ABTL), for neural decoding. It includes two new capabilities to enhance spatio-temporal decoding: i) ABTL module, which learns dynamic brain topology while updating specific patterns of brain regions, ii) MSST module, which captures the association of spatial pattern and temporal evolution, and further enhances the interpretability of the learned dynamic topology from multi-scale perspective. We evaluated the framework on the public Human Connectome Project (HCP) dataset (resting-state and task-related fMRI data). The extensive experiments show that the proposed MSST-ABTL outperforms state-of-the-art methods on four evaluation metrics, and also can renew the neuroscientific discoveries in the brain's hierarchical patterns.
21 May 2025 in IEEE Transactions on Circuits and Systems for Video Technology
Research on emotion recognition in conversations emphasises the importance of complex relationships between conversational context and multimodality. Graph-based methods, particularly hypergraph-based methods have shown promise in capturing these relationships. However, challenges persist in avoiding redundant context while capturing essential information for optimal context embeddings and fully leveraging cross-modal complementarities for sufficient fusion. In contrast, the human brain flexibly retrieves relevant memories and integrates multi-modal data for accurate recognition. Based on this superiority, we propose BrainyHGNN, a brain-inspired hypergraph neural network. It integrates a Dynamic Memory Selector for contextual hyperedges, mimicking selective memory retrieval mechanisms for adaptive and modality-specific context retrieval. HierSensNet is designed for multi-modal hyperedges, mirroring hierarchical cross-modal interaction mechanisms to ensure effective multimodal fusion. Experimental results on two benchmark datasets validate the superior performance of BrainyHGNN, confirming the effectiveness of its innovative approach. This work highlights the potential of brain-inspired methods to advance flexible context retrieval and sufficient multimodal fusion, presenting a promising direction for future research in this domain.
In the era of digital transformation, organizations are seeking innovative approaches to enhance employee training effectiveness. This study proposes a data-driven online-merge-offline teaching method for new employee training at State Grid, aiming to optimize the learning experience and accelerate knowledge retention. The proposed approach combines digital platforms and traditional offline training methods to create a comprehensive training program. Leveraging advanced data analytics techniques, learner data is collected and analyzed to identify individual strengths and weaknesses, enabling customized training content delivery. Online modules provide employees with interactive multimedia resources, including video lectures, simulations, and quizzes, fostering self-paced learning and engagement. Real-time monitoring enables trainers to track learners' progress and provide timely feedback and support. Offline components, such as workshops and group discussions, facilitate collaboration, problem-solving, and practical application of knowledge. Through a seamless combination of online and offline activities, employees can reinforce their learning and acquire hands-on skills. Moreover, the data-driven approach allows trainers to continually evaluate training effectiveness and make necessary adjustments based on learner performance analysis. This iterative process ensures the optimization of training outcomes. Preliminary results indicate that the data-driven online-merge-offline teaching method has significantly improved the efficiency and effectiveness of new employee training at State Grid. Enhanced engagement, personalized learning experiences, and practical skill development contribute to a skilled workforce. Future research could explore the scalability and adaptability of this approach in other industries and organizations.