As electroencephalography (EEG) is nonlinear and nonstationary in nature, an imperative challenge for brain-computer interfaces (BCIs) is to construct a robust classifier that can survive for a long time and monitor the brain state stably. To this end, this research aims to improve BCI performance by incorporation of electroencephalographic and cerebral hemodynamic patterns. A motor imagery (MI)-BCI based visual-haptic neurofeedback training (NFT) experiment was designed with sixteen participants. EEG and functional near infrared spectroscopy (fNIRS) signals were simultaneously recorded before and after this transient NFT. Cortical activation was significantly improved after repeated and continuous NFT through time-frequency and topological analysis. A classifier calibration strategy, weighted EEG-fNIRS patterns (WENP), was proposed, in which elementary classifiers were constructed by using both the EEG and fNIRS information and then integrated into a strong classifier with their independent accuracy-based weight assessment. The results revealed that the classifier constructed on integrating EEG and fNIRS patterns was significantly superior to that only with independent information (~10% and ~18% improvement respectively), reaching ~89% in mean classification accuracy. The WENP is a classifier calibration strategy that can effectively improve the performance of the MI-BCI and could also be used to other BCI paradigms. These findings validate that our proposed methods are feasible and promising for optimizing conventional motor training methods and clinical rehabilitation.

Stroke caused by cerebral infarction or hemorrhage can lead to motor dysfunction. The recovery of motor function is vital for patients with stroke in daily activities. Traditional rehabilitation of stroke generally depends on physical practice under passive affected limbs movement. Motor imagery-based brain computer interface (MI-BCI) combined with functional electrical stimulation (FES) is a potential active neural rehabilitation technology for patients with stroke recently, which complements traditional passive rehabilitation methods. As the predecessor of BCI technology, neurofeedback training (NFT) is a psychological process that feeds back neural activities online to users for self-regulation. In this work, BCI-based NFT were proposed to promote the active repair and reconstruction of the whole nerve conduction pathway and motor function. We designed and implemented a multimodal, training type motor NFT system (BCI-NFT-FES) by integrating the visual, auditory, and tactile multisensory pathway feedback mode and using the joint detection of electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS). The results indicated that after 4 weeks of training, the clinical scale score, event-related desynchronization (ERD) of EEG patterns, and cerebral oxygen response of patients with stroke were enhanced obviously. This study preliminarily verified the clinical effectiveness of the long-term NFT system and the prospect of motor function rehabilitation.

Action planning is an important decision-making process, which can be specially affected by environment. Response selection during action planning has been demonstrated to be modulated by tVNS. Therefore, tVNS shows a great potential for modulating the action planning process. We aimed to explore the tVNS-induced effect on action planning in behavioural and electrophysiology. Twenty-eight participants were randomly divided into two groups (active group and sham group). A single-blind, sham-controlled between-subject design was applied to explore the effect of online-tVNS (i.e., tVNS overlapping with the task) on action planning paradigm. We measured and compared reaction time (RT) and movement-related cortical potentials (MRCPs) before and after tVNS between active and sham groups. As compared to sham group, for the ipsilateral hand/contralateral hemisphere relative to the stimulated side, active tVNS significantly reduced the reaction time and decreased the MRCP amplitude mainly in the challenging tasks. Our results indicate that tVNS can produce a lateralization effect on action planning, especially plays an important role in the more challenging tasks as reflected both in the behavioural and electrophysiological results.

Brain-computer interface (BCI)-based motor rehabilitation feedback training system can facilitate motor function reconstruction, but its rehabilitation mechanism with suitable training protocol is unclear, which affects the application effect. To this end, we probed the electroencephalographic (EEG) activations induced by motor imagery (MI) and action observation (AO) to provide an effective method to optimize motor feedback training. We grouped subjects according to their alpha–band sensorimotor cortical excitability under MI and AO conditions, and investigated the EEG response under the same paradigm between groups and different motor paradigms within group, respectively. The results showed that there were significant differences in sensorimotor activations between two groups of subjects. Specifically, the group with weaker MI induced EEG features, could achieve stronger sensorimotor activations in AO than that of other conditions. The group with stronger MI induced EEG features, could achieve stronger sensorimotor activations in the MI+AO than that of other conditions. We also explored their classification and brain network differences, which might try to explain the EEG mechanism in different individuals and help stroke patients to choose appropriate subject-specific motor training paradigm for their rehabilitation and better treatment outcomes.

Objective: Motor imagery (MI) based brain- computer interface (BCI) has been widely studied as an effective way to enhance motor learning and promote motor recovery. However, the accuracy of MI-BCI heavily depends on whether subjects can perform MI tasks correctly, which largely limits the general application of MI-BCI. To overcome this limitation, a training strategy based on the combination of MI and sensory threshold somatosensory electrical stimulation (MI+st-SES) is proposed in this study. Methods: Thirty healthy subjects were recruited and randomly divided into SES group and control group. Both groups performed left-hand and right-hand MI tasks in three consecutive blocks. The main difference between two groups lies in the second block, where subjects in SES group received the st-SES during MI tasks whereas the control group performed MI tasks only. Results: The results showed that the SES group had a significant improvement in event-related desynchronization (ERD) of alpha rhythm after the training session of MI+st-SES (left-hand: F(2,27) = 9.98, p <0.01; right-hand: F(2, 27) = 10.43, p <0.01). The classification accuracy between left- and right-hand MI in the SES group was also significantly improved following MI+st-SES training (F(2,27) = 6.46, p <0.01). In contrary, there was no significant difference between the first and third blocks in the control group (F(2,27) = 0.18, p = 0.84). The functional connectivity based on weighted pairwise phase consistency (wPPC) over the sensorimotor area also showed an increase after the MI+st-SES training. Conclusion and Significance: Our findings indicate that training based on MI+st-SES is a promising way to foster MI performance and assist subjects in achieving efficient BCI control.