Objectives: The temporal and spatial information of electroencephalogram (EEG) signals is crucial for recognizing features in emotion classification models, but it excessively relies on manual feature extraction. The transformer model has the capability of performing automatic feature extraction; however, its potential has not been fully explored in the classification of emotion-related EEG signals. To address these challenges, the present study proposes a novel model based on transformer and convolutional neural networks (TCNN) for EEG spatial–temporal (EEG ST) feature learning to automatic emotion classification. Methods: The proposed EEG ST-TCNN model utilizes position encoding (PE) and multi-head attention to perceive channel positions and timing information in EEG signals. Two parallel transformer encoders in the model are used to extract spatial and temporal features from emotion-related EEG signals, and a CNN is used to aggregate the EEG’s spatial and temporal features, which are subsequently classified using Softmax. Results: The proposed EEG ST-TCNN model achieved an accuracy of 96.67% on the SEED dataset and accuracies of 95.73%, 96.95%, and 96.34% for the arousal–valence, arousal, and valence dimensions, respectively, for the DEAP dataset. Conclusions: The results demonstrate the effectiveness of the proposed ST-TCNN model, with superior performance in emotion classification compared to recent relevant studies. Significance: The proposed EEG ST-TCNN model has the potential to be used for EEG-based automatic emotion recognition.
Neurofeedback training (NFT) is a non-invasive, safe, and effective method of regulating the nerve state of the brain. Presently, NFT is widely used to prevent and rehabilitate brain diseases and improve an individual’s external performance. Among the various NFT methods, NFT to improve sport performance (SP-NFT) has become an important research and application focus worldwide. Several studies have shown that the method is effective in improving brain function and motor control performance. However, appropriate reviews and prospective directions for this technology are lacking. This paper proposes an SP-NFT classification method based on user experience, classifies and discusses various SP-NFT research schemes reported in the existing literature, and reviews the technical principles, application scenarios, and usage characteristics of different SP-NFT schemes. Several key issues in SP-NFT development, including the factors involved in neural mechanisms, scheme selection, learning basis, and experimental implementation, are discussed. Finally, directions for the future development of SP-NFT, including SP-NFT based on other electroencephalograph characteristics, SP-NFT integrated with other technologies, and SP-NFT commercialization, are suggested. These discussions are expected to provide some valuable ideas to researchers in related fields.
Previous literature on shooting performance neurofeedback training (SP-NFT) to enhance performance usually focused on changes in behavioral indicators, but research on the physiological features of SP-NFT is lacking. To explore the effects of SP-NFT on trainability and neuroplasticity, we conducted a study in which 45 healthy participants were randomly divided into three groups: based on sensory-motor rhythm of C3, Cz and C4 (SMR group), based on alpha rhythm of T3 and T4 (Alpha group), and no NFT (control group). The training was performed for six sessions for 3 weeks. Before and after the SP-NFT, we evaluated changes in shooting performance and resting electroencephalography (EEG) frequency power, participant’s subjective task appraisal, neurofeedback trainability score, and EEG feature. Statistical analysis showed that the shooting performance of the participants in the SMR group improved significantly, the participants in the Alpha group decreased, and that of participants in the control group have no change. Meanwhile, the resting EEG power features of the two NFT groups changed specifically after training. The training process data showed that the training difficulty was significantly lower in the SMR group than in the Alpha group. Both NFT groups could improve the neurofeedback trainability scores and change the feedback features by means of their mind strategy. These results may provide evidence of trainability and neuroplasticity for SP-NFT, suggesting that the SP-NFT is effective in brain regulation and thus provide a potential method to improve shooting performance.
Brain–computer interfaces (BCIs) are a new technology that subverts traditional human–computer interaction, where the control signal source comes directly from the user’s brain. When a general BCI is used for practical applications, it is difficult for it to meet the needs of different individuals because of the differences among individual users in physiological and mental states, sensations, perceptions, imageries, cognitive thinking activities, and brain structures and functions. For this reason, it is necessary to customize personalized BCIs for specific users. So far, few studies have elaborated on the key scientific and technical issues involved in personalized BCIs. In this study, we will focus on personalized BCIs, give the definition of personalized BCIs, and detail their design, development, evaluation methods and applications. Finally, the challenges and future directions of personalized BCIs are discussed. It is expected that this study will provide some useful ideas for innovative studies and practical applications of personalized BCIs.
Although brain-computer interface (BCI) is considered a revolutionary advancement in human-computer interaction and has achieved significant progress, a considerable gap remains between the current technological capabilities and their practical applications. To promote the translation of BCI into practical applications, the gold standard for online evaluation for classification algorithms of BCI has been proposed in some studies. However, few studies have proposed a more comprehensive evaluation method for the entire online BCI system, and it has not yet received sufficient attention from the BCI research and development community. Therefore, the qualitative leap from analyzing and modeling for offline BCI data to the construction of online BCI systems and optimizing their performance is elaborated, and then user-centred is emphasized, and then the comprehensive evaluation methods for translating BCI into practical applications are detailed and reviewed in the article, including the evaluation of the usability (including effectiveness and efficiency of systems), the evaluation of the user satisfaction (including BCI-related aspects, etc.), and the evaluation of the usage (including the match between the system and user, etc.) of online BCI systems. Finally, the challenges faced in the evaluation of the usability and user satisfaction of online BCI systems, the efficacy of online BCI systems, and the integration of BCI and artificial intelligence (AI) and/or virtual reality (VR) and other technologies to enhance the intelligence and user experience of the system are discussed. It is expected that the evaluation methods for online BCI systems elaborated in this review will promote the translation of BCI into practical applications.
Brain signal patterns generated in the central nervous system of brain-computer interface (BCI) users are closely related to BCI paradigms and neural coding. In BCI systems, BCI paradigms and neural coding are critical elements for BCI research. However, so far there have been few references that clearly and systematically elaborated on the definition and design principles of the BCI paradigm as well as the definition and modeling principles of BCI neural coding. Therefore, these contents are expounded and the existing main BCI paradigms and neural coding are introduced in the review. Finally, the challenges and future research directions of BCI paradigm and neural coding were discussed, including user-centered design and evaluation for BCI paradigms and neural coding, revolutionizing the traditional BCI paradigms, breaking through the existing techniques for collecting brain signals and combining BCI technology with advanced AI technology to improve brain signal decoding performance. It is expected that the review will inspire innovative research and development of the BCI paradigm and neural coding.