Objective . In recent years, brain–computer interface (BCI) systems based on electroencephalography (EEG) have developed rapidly. However, the decoding of voluntary finger pre-movements from EEG is still a challenge for BCIs. This study aimed to analyze the pre-movement EEG features in time and frequency domains and design an efficient method to decode the movement-related patterns. Approach . In this study, we first investigated the EEG features induced by the intention of left and right finger movements. Specifically, the movement-related cortical potential (MRCP) and event-related desynchronization (ERD) features were extracted using discriminative canonical pattern matching (DCPM) and common spatial patterns (CSP), respectively. Then, the two types of features were classified by two fisher discriminant analysis (FDA) classifiers, respectively. Their decision values were further assembled to facilitate the classification. To verify the validity of the proposed method, a private dataset containing 12 subjects and a public dataset from BCI competition II were used for estimating the classification accuracy. Main results . As a result, for the private dataset, the combination of DCPM and CSP achieved an average accuracy of 80.96%, which was 5.08% higher than the single DCPM method ( p < 0.01) and 10.23% higher than the single CSP method ( p < 0.01). Notably, the highest accuracy could achieve 91.5% for the combination method. The test accuracy of dataset IV of BCI competition II was 90%, which was equal to the best result in the existing literature. Significance . The results demonstrate the MRCP and ERD features of pre-movements contain significantly discriminative information, which are complementary to each other, and thereby could be well recognized by the proposed combination method of DCPM and CSP. Therefore, this study provides a promising approach for the decoding of pre-movement EEG patterns, which is significant for the development of BCIs.
Objective. Deep learning (DL) models have been proven to be effective in decoding motor imagery (MI) signals in Electroencephalogram (EEG) data. However, DL models’ success relies heavily on large amounts of training data, whereas EEG data collection is laborious and time-consuming. Recently, cross-dataset transfer learning has emerged as a promising approach to meet the data requirements of DL models. Nevertheless, transferring knowledge across datasets involving different MI tasks remains a significant challenge in cross-dataset transfer learning, limiting the full utilization of valuable data resources. Approach: This study proposes a pre-training-based cross-dataset transfer learning method inspired by Hard Parameter Sharing in multi-task learning. Different datasets with distinct MI paradigms are considered as different tasks, classified with shared feature extraction layers and individual task-specific layers to allow cross-dataset classification with one unified model. Then, Pre-training and fine-tuning are employed to transfer knowledge across datasets. We also designed four fine-tuning schemes and conducted extensive experiments on them. Main results: The results showed that compared to models without pre-training, models with pre-training achieved a maximum increase in accuracy of 7.76%. Moreover, when limited training data were available, the pre-training method significantly improved DL model’s accuracy by 27.34% at most. The experiments also revealed that pre-trained models exhibit faster convergence and remarkable robustness. The training time per subject could be reduced by up to 102.83 s, and the variance of classification accuracy decreased by 75.22% at best. Significance: This study represents the first comprehensive investigation of the cross-dataset transfer learning method between two datasets with different MI tasks. The proposed pre-training method requires only minimal fine-tuning data when applying DL models to new MI paradigms, making MI-Brain–computer interface more practical and user-friendly.
28 January 2016 in Journal of NeuroEngineering and Rehabilitation
A number of studies have been done on movement imagination of motor sequences with a single limb. However, brain oscillatory patterns induced by movement imagination of motor sequences involving multiple limbs have not been reported in recent years. The goal of the present study was to verify the feasibility of application of motor sequences involving multiple limbs to brain-computer interface (BCI) systems based on motor imagery (MI). The changes of EEG patterns and the inter-influence between movements associated with the imagination of motor sequences were also investigated. The experiment, where 12 healthy subjects participated, involved one motor sequence with a single limb and three kinds of motor sequences with two or three limbs. The activity involved mental simulation, imagining playing drums with two conditions (60 and 30 beats per minute for the first and second conditions, respectively). Movement imagination of different limbs in the sequence contributed to time-variant event-related desynchronization (ERD) patterns within both mu and beta rhythms, which was more obvious for the second condition compared with the first condition. The ERD values of left/right hand imagery with prior hand imagery were significantly larger than those with prior foot imagery, while the phase locking values (PLVs) between central electrodes and the mesial frontocentral electrode of non-initial movement were significantly larger than those of the initial movement during imagination of motor sequences for both conditions. Classification results showed that the power spectral density (PSD) based method outperformed the multi-class common spatial patterns (multi-CSP) based method: The highest accuracies were 82.86 % and 91.43 %, and the mean values were 65 % and 74.14 % for the first and second conditions, respectively. This work implies that motor sequences involving multiple limbs can be utilized to build a multimodal classification paradigm in MI-based BCI systems, and that prior movement imagination can result in the changes of neural activities in motor areas during subsequent movement imagination in the process of limb switching.
11 September 2017 in Journal of NeuroEngineering and Rehabilitation
Motor imagery (MI) induced EEG patterns are widely used as control signals for brain-computer interfaces (BCIs). Kinetic and kinematic factors have been proved to be able to change EEG patterns during motor execution and motor imagery. However, to our knowledge, there is still no literature reporting an effective online MI-BCI using kinetic factor regulated EEG oscillations. This study proposed a novel MI-BCI paradigm in which users can online output multiple commands by imagining clenching their right hand with different force loads. Eleven subjects participated in this study. During the experiment, they were asked to imagine clenching their right hands with two different force loads (30% maximum voluntary contraction (MVC) and 10% MVC). Multi-Common spatial patterns (Multi-CSPs) and support vector machines (SVMs) were used to build the classifier for recognizing three commands corresponding to high load MI, low load MI and relaxed status respectively. EMG were monitored to avoid voluntary muscle activities during the BCI operation. The event-related spectral perturbation (ERSP) method was used to analyse EEG variation during multiple load MI tasks. All subjects were able to drive BCI systems using motor imagery of different force loads in online experiments. We achieved an average online accuracy of 70.9%, with the highest accuracy of 83.3%, which was much higher than the chance level (33%). The event-related desynchronization (ERD) phenomenon during high load tasks was significantly higher than it was during low load tasks both in terms of intensity at electrode positions C3 (p < 0.05) and spatial distribution. This paper demonstrated the feasibility of the proposed MI-BCI paradigm based on multi-force loads on the same limb through online studies. This paradigm could not only enlarge the command set of MI-BCI, but also provide a promising approach to rehabilitate patients with motor disabilities.
Objective. Brain–computer interfaces (BCIs) enable a direct communication pathway between the human brain and external devices, without relying on the traditional peripheral nervous and musculoskeletal systems. Motor imagery (MI)-based BCIs have attracted significant interest for their potential in motor rehabilitation. However, current algorithms fail to account for the cross-session variability of electroencephalography signals, limiting their practical application. Approach. We proposed a Riemannian geometry-based adaptive boosting and voting ensemble (RAVE) algorithm to address this issue. Our approach segmented the MI period into multiple sub-datasets using a sliding window approach and extracted features from each sub-dataset using Riemannian geometry. We then trained adaptive boosting (AdaBoost) ensemble learning classifiers for each sub-dataset, with the final BCI output determined by majority voting of all classifiers. We tested our proposed RAVE algorithm and eight other competing algorithms on four datasets (Pan2023, BNCI001-2014, BNCI001-2015, BNCI004-2015). Main results. Our results showed that, in the cross-session scenario, the RAVE algorithm outperformed the eight other competing algorithms significantly under different within-session training sample sizes. Compared to traditional algorithms that involved a large number of training samples, the RAVE algorithm achieved similar or even better classification performance on the datasets (Pan2023, BNCI001-2014, BNCI001-2015), even when it did not use or only used a small number of within-session training samples. Significance. These findings indicate that our cross-session decoding strategy could enable MI-BCI applications that require no or minimal training process.