Brain–computer interfaces (BCIs) have demonstrated the potential to provide paralyzed individuals with new means of communication, but an electroencephalography (EEG)-based endogenous BCI has never been successfully used for communication with a patient in a completely locked-in state (CLIS). In this study, we investigated the possibility of using an EEG-based endogenous BCI paradigm for online binary communication by a patient in CLIS. A female patient in CLIS participated in this study. She had not communicated even with her family for more than one year with complete loss of motor function. Offline and online experiments were conducted to validate the feasibility of the proposed BCI system. In the offline experiment, we determined the best combination of mental tasks and the optimal classification strategy leading to the best performance. In the online experiment, we investigated whether our BCI system could be potentially used for real-time communication with the patient. An online classification accuracy of 87.5% was achieved when Riemannian geometry-based classification was applied to real-time EEG data recorded while the patient was performing one of two mental-imagery tasks for 5 s. Our results suggest that an EEG-based endogenous BCI has the potential to be used for online communication with a patient in CLIS.
17 August 2020 in IEEE Transactions on Neural Systems and Rehabilitation Engineering
Previous studies have shown the superior performance of hybrid electroencephalography (EEG)/near-infrared spectroscopy (NIRS) brain-computer interfaces (BCIs). However, it has been veiled whether the use of a hybrid EEG/NIRS modality can provide better performance for a brain switch that can detect the onset of the intention to turn on a BCI. In this study, we developed such a hybrid EEG/NIRS brain switch and compared its performance with single modality EEG- and NIRS-based brain switch respectively, in terms of true positive rate (TPR), false positive rate (FPR), onset detection time (ODT), and information transfer rate (ITR). In an offline analysis, the performance of a hybrid EEG/NIRS brain switch was found significantly improved over that of EEG- and NIRS-based brain switches in general in particular a significantly lower FPR was observed for the hybrid EEG/NIRS brain switch. A pseudo-online analysis was additionally performed to confirm the feasibility of implementing an online BCI system with our hybrid EEG/NIRS brain switch. The overall trend of pseudo-online analysis results generally coincided with that of the offline analysis results. No significant difference in all performance measures was also found between offline and pseudo online analysis schemes when the amount of training data was same, with one exception for the ITRs of an EEG brain switch. These offline and pseudo-online results demonstrate that a hybrid EEG/NIRS brain switch can be used to provide a better onset detection performance than that of a single neuroimaging modality.
A brain–computer interface (BCI) has been extensively studied to develop a novel communication system for disabled people using their brain activities. An asynchronous BCI system is more realistic and practical than a synchronous BCI system, in that, BCI commands can be generated whenever the user wants. However, the relatively low performance of an asynchronous BCI system is problematic because redundant BCI commands are required to correct false-positive operations. To significantly reduce the number of false-positive operations of an asynchronous BCI system, a two-step approach has been proposed using a brain-switch that first determines whether the user wants to use an asynchronous BCI system before the operation of the asynchronous BCI system. This study presents a systematic review of the state-of-the-art brain-switch techniques and future research directions. To this end, we reviewed brain-switch research articles published from 2000 to 2019 in terms of their (a) neuroimaging modality, (b) paradigm, (c) operation algorithm, and (d) performance.
Some patients suffering from severe neuromuscular diseases have difficulty controlling not only their bodies but also their eyes. Since these patients have difficulty gazing at specific visual stimuli or keeping their eyes open for a long time, they are unable to use the typical steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) systems. In this study, we introduce a new paradigm for SSVEP-based BCI, which can be potentially suitable for disabled individuals with impaired oculomotor function. The proposed electroencephalography (EEG)-based BCI system allows users to express their binary intentions without needing to open their eyes. A pair of glasses with two light emitting diodes flickering at different frequencies was used to present visual stimuli to participants with their eyes closed, and we classified the recorded EEG patterns in the online experiments conducted with five healthy participants and one patient with severe amyotrophic lateral sclerosis (ALS). Through offline experiments performed with 11 participants, we confirmed that human SSVEP could be modulated by visual selective attention to a specific light stimulus penetrating through the eyelids. Furthermore, the recorded EEG patterns could be classified with accuracy high enough for use in a practical BCI system. After customizing the parameters of the proposed SSVEP-based BCI paradigm based on the offline analysis results, binary intentions of five healthy participants were classified in real time. The average information transfer rate of our online experiments reached 10.83 bits min(-1). A preliminary online experiment conducted with an ALS patient showed a classification accuracy of 80%. The results of our offline and online experiments demonstrated the feasibility of our proposed SSVEP-based BCI paradigm. It is expected that our 'eyes-closed' SSVEP-based BCI system can be potentially used for communication of disabled individuals with impaired oculomotor function.
Background: A steady-state visual-evoked potential (SSVEP) is a brain response to visual stimuli modulated at certain frequencies; it has been widely used in electroencephalography (EEG)-based brain–computer interface research. However, there are few published SSVEP datasets for brain–computer interface. In this study, we obtained a new SSVEP dataset based on measurements from 30 participants, performed on 2 days; our dataset complements existing SSVEP datasets: (i) multi-band SSVEP datasets are provided, and all 3 possible frequency bands (low, middle, and high) were used for SSVEP stimulation; (ii) multi-day datasets are included; and (iii) the EEG datasets include simultaneously obtained physiological measurements, such as respiration, electrocardiography, electromyography, and head motion (accelerator). Findings: To validate our dataset, we estimated the spectral powers and classification performance for the EEG (SSVEP) datasets and created an example plot to visualize the physiological time-series data. Strong SSVEP responses were observed at stimulation frequencies, and the mean classification performance of the middle frequency band was significantly higher than the low- and high-frequency bands. Other physiological data also showed reasonable results. Conclusions: Our multi-band, multi-day SSVEP datasets can be used to optimize stimulation frequencies because they enable simultaneous investigation of the characteristics of the SSVEPs evoked in each of the 3 frequency bands, and solve session-to-session (day-to-day) transfer problems by enabling investigation of the non-stationarity of SSVEPs measured on different days. Additionally, auxiliary physiological data can be used to explore the relationship between SSVEP characteristics and physiological conditions, providing useful information for optimizing experimental paradigms to achieve high performance.