A brain-computer interface (BCI) is a non-muscular communication technology that provides an information exchange channel for our brains and external devices. During the decades, BCI has made noticeable progress and has been applied in many fields. One of the most traditional BCI applications is the BCI speller. This article primarily discusses the progress of research into P300 BCI spellers and reviews four types of P300 spellers: single-modal P300 spellers, P300 spellers based on multiple brain patterns, P300 spellers with multisensory stimuli, and P300 spellers with multiple intelligent techniques. For each type of P300 speller, we further review several representative P300 spellers, including their design principles, paradigms, algorithms, experimental performance, and corresponding advantages. We particularly emphasized the paradigm design ideas, including the overall layout, individual symbol shapes and stimulus forms. Furthermore, several important issues and research guidance for the P300 speller were identified. We hope that this review can assist researchers in learning the new ideas of these novel P300 spellers and enhance their practical application capability.
13 December 2021 in IEEE Transactions on Affective Computing
Emotion regulation plays a vital role in human beings daily lives by helping them deal with social problems and protects mental and physical health. However, objective evaluation of the efficacy of emotion regulation and assessment of the improvement in emotion regulation ability at the individual level remain challenging. In this study, we leveraged neurofeedback training to design a real-time EEG-based brain-computer interface (BCI) system for users to effectively regulate their emotions. Twenty healthy subjects performed 10 BCI-based neurofeedback training sessions to regulate their emotion towards a specific emotional state (positive, negative, or neutral), while their EEG signals were analyzed in real time via machine learning to predict their emotional states. The prediction results were presented as feedback on the screen to inform the subjects of their immediate emotional state, based on which the subjects could update their strategies for emotion regulation. The experimental results indicated that the subjects improved their ability to regulate these emotions through our BCI neurofeedback training. Further EEG-based spectrum analysis revealed how each emotional state was related to specific EEG patterns, which were progressively enhanced through long-term training. These results together suggested that long-term EEG-based neurofeedback training could be a promising tool for helping people with emotional or mental disorders.
25 September 2024 in IEEE Transactions on Biomedical Engineering
Objective: Attention regulation is an essential ability in daily life that affects learning and work efficiency and is closely related to mental health. The effectiveness of brain-computer interface (BCI) systems in attention regulation has been proven, but most of these systems rely on bulky and expensive equipment and are still in the experimental stage. This study proposes a wearable BCI system for real-time attention regulation and cognitive monitoring. Methods: The BCI system integrates a wearable single-channel electroencephalogram (EEG) headband with wireless data streaming for real-time analysis. Twenty healthy subjects participated in the long-term attention regulation experiment and were evenly divided into an experimental group and a control group based on the presence of real-time neurofeedback. The neurofeedback is represented by output value of attention, which calculated from single-channel EEG data. Before and after the regulation sessions, baseline assessments were conducted for each subject, incorporating multi-channel EEG data analysis and cognitive behavioral evaluations, to verify the effectiveness of system for attention regulation. Results: The online experimental results indicate that the average attention level in the experimental group increased from 0.625 to 0.812, while no significant improvement was observed in the control group. Further comparative analysis revealed the reasons for the enhancement of attention regulation ability in terms of both brain network patterns and cognitive performance. Significance: The proposed wearable BCI system is effective at improving attention regulation ability and could be a promising tool for assisting people with attention disorders.
14 April 2023 in IEEE Transactions on Instrumentation and Measurement
P300 brain-computer interfaces (BCIs) have significant potential for detecting and assessing residual consciousness in patients with disorders of consciousness (DoC) but are limited by insufficient data collected from them. In this study, a multiple scale convolutional few-shot learning network (MSCNN-FSL) was proposed to detect and recognize small sample P300 signals. A multiple scale convolutional neural network (MSCNN) was developed to learn different scale features from different scales of receptive fields to obtain more information from electroencephalograms (EEG). Then, a prototypical network with cosine distance was introduced as a classifier to classify and small sample P300 signals. The MSCNN-FSL was evaluated in two independent online BCI experiments. In the first P300 speller experiment, the presented network achieves good character recognition performance with average accuracies of 98.02%±1.70%. In the second experiment, eight healthy controls achieved photo recognition performance with average accuracies of 98.75%±1.49% and three of the twelve DoC patients achieved more than 64% online accuracies with significance. Our results indicated that the proposed MSCNN-FSL could correctly assess the three patients who may have residual consciousness but were misdiagnosed by the Coma Recovery Scale-Revised (CRS-R). Clinical evaluation after two months did prove our BCI assessment results for the three patients.
10 October 2022 in IEEE Transactions on Cognitive and Developmental Systems
In this study, a hybrid brain-computer interface (BCI) system combining P300 potential and emotion patterns was proposed to improve the performance of awareness detection. Two video clips were flashed randomly to evoke the P300 potential, while a laughing or crying video clip was used to induce the corresponding emotion pattern. The subjects were asked to concentrate on the laughing or crying video clip cued by the instruction and to count the flashes of the corresponding video clip. Two layers of classification were developed. In the first layer, P300 detection and emotion recognition were performed separately using two support vector machine (SVM) classifiers. Specifically, the activation, spatial and connection patterns were fused in emotion recognition. In the second layer, the SVM scores of P300 detection and emotion recognition were fed into another SVM classifier to determine which video clip the subjects responded to. Six healthy subjects and eight patients with disorders of consciousness (DOC) were involved in the command-following experiment. The results showed that the accuracy of the hybrid BCI system was better than those of the single-modality systems. Furthermore, three patients were able to perform tasks (66%-72%) using our hybrid BCI, which indicated their residual awareness and emotion-related abilities.
For patients with disorders of consciousness, such as unresponsive wakefulness syndrome (UWS) patients and minimally conscious state (MCS) patients, their long treatment cycle and high cost commonly put a heavy burden on the patient’s family and society. Therefore, it is vital to accurately diagnose and predict consciousness recovery for such patients. In this paper, we explored the role of the P300 signal based on an audiovisual BCI in the classification and prognosis prediction of patients with disorders of consciousness. This experiment included 18 patients: 10 UWS patients and 8 MCS- patients. At the three-month follow-up, we defined patients with an improved prognosis (from UWS to MCS-, from UWS to MCS+, or from MCS- to MCS+) as “improved patients” and those who stayed in UWS/MCS as “not improved patients”. First, we compared and analyzed different types of patients, and the results showed that the P300 detection accuracy rate of “improved” patients was significantly higher than that of “not improved” patients. Furthermore, the P300 detection accuracy of traumatic brain injury (TBI) patients was significantly higher than that of non-traumatic brain injury (NTBI, including acquired brain injury and cerebrovascular disease) patients. We also found that there was a positive linear correlation between P300 detection accuracy and CRS-R score, and patients with higher P300 detection accuracy were likely to achieve higher CRS-R scores. In addition, we found that the patients with higher P300 detection accuracies tend to have better prognosis in this audiovisual BCI. These findings indicate that the detection accuracy of P300 is significantly correlated with the level of consciousness, etiology, and prognosis of patients. P300 can be used to represent the preservation level of consciousness in clinical neurophysiology and predict the possibility of recovery in patients with disorders of consciousness.