Significance: Brain–computer interface (BCI) technology provides a new communication channel. However, current applications have been severely limited by low communication speed. This study reports a noninvasive brain speller that achieved a multifold increase in information transfer rate compared with other existing systems. Based on extremely precise coding of frequency and phase in single-trial steady-state visual evoked potentials, this study developed a new joint frequency-phase modulation method and a user-specific decoding algorithm to implement synchronous modulation and demodulation of electroencephalograms. The resulting speller obtained high spelling rates up to 60 characters (∼12 words) per minute. The proposed methodological framework of high-speed BCI can lead to numerous applications in both patients with motor disabilities and healthy people.
19 April 2017 in IEEE Transactions on Biomedical Engineering
Objective: This study proposes and evaluates a novel data-driven spatial filtering approach for enhancing steady-state visual evoked potentials (SSVEPs) detection toward a high-speed brain-computer interface (BCI) speller. Methods: Task-related component analysis (TRCA), which can enhance reproducibility of SSVEPs across multiple trials, was employed to improve the signal-to-noise ratio (SNR) of SSVEP signals by removing background electroencephalographic (EEG) activities. An ensemble method was further developed to integrate TRCA filters corresponding to multiple stimulation frequencies. This study conducted a comparison of BCI performance between the proposed TRCA-based method and an extended canonical correlation analysis (CCA)-based method using a 40-class SSVEP dataset recorded from 12 subjects. An online BCI speller was further implemented using a cue-guided target selection task with 20 subjects and a free-spelling task with 10 of the subjects. Results: The offline comparison results indicate that the proposed TRCA-based approach can significantly improve the classification accuracy compared with the extended CCA-based method. Furthermore, the online BCI speller achieved averaged information transfer rates (ITRs) of 325.33 ± 38.17 bits/min with the cue-guided task and 198.67 ± 50.48 bits/min with the free-spelling task. Conclusion: This study validated the efficiency of the proposed TRCA-based method in implementing a high-speed SSVEP-based BCI. Significance: The high-speed SSVEP-based BCIs using the TRCA method have great potential for various applications in communication and control.
Canonical correlation analysis (CCA) has been widely used in the detection of the steady-state visual evoked potentials (SSVEPs) in brain-computer interfaces (BCIs). The standard CCA method, which uses sinusoidal signals as reference signals, was first proposed for SSVEP detection without calibration. However, the detection performance can be deteriorated by the interference from the spontaneous EEG activities. Recently, various extended methods have been developed to incorporate individual EEG calibration data in CCA to improve the detection performance. Although advantages of the extended CCA methods have been demonstrated in separate studies, a comprehensive comparison between these methods is still missing. This study performed a comparison of the existing CCA-based SSVEP detection methods using a 12-class SSVEP dataset recorded from 10 subjects in a simulated online BCI experiment. Classification accuracy and information transfer rate (ITR) were used for performance evaluation. The results suggest that individual calibration data can significantly improve the detection performance. Furthermore, the results showed that the combination method based on the standard CCA and the individual template based CCA (IT-CCA) achieved the highest performance.
20 September 2021 in IEEE Transactions on Neural Systems and Rehabilitation Engineering
A brain-computer interface (BCI) provides a direct communication channel between a brain and an external device. Steady-state visual evoked potential based BCI (SSVEP-BCI) has received increasing attention due to its high information transfer rate, which is accomplished by individual calibration for frequency recognition. Task-related component analysis (TRCA) is a recent and state-of-the-art method for individually calibrated SSVEP-BCIs. However, in TRCA, the spatial filter learned from each stimulus may be redundant and temporal information is not fully utilized. To address this issue, this paper proposes a novel method, i.e., task-discriminant component analysis (TDCA), to further improve the performance of individually calibrated SSVEP-BCI. The performance of TDCA was evaluated by two publicly available benchmark datasets, and the results demonstrated that TDCA outperformed ensemble TRCA and other competing methods by a significant margin. An offline and online experiment testing 12 subjects further validated the effectiveness of TDCA. The present study provides a new perspective for designing decoding methods in individually calibrated SSVEP-BCI and presents insight for its implementation in high-speed brain speller applications.
30 January 2018 in IEEE Transactions on Biomedical Engineering
$Goal:$ Traditional visual brain-computer interfaces (BCIs) preferred to use large-size stimuli to attract the user's attention and elicit distinct electroencephalography (EEG) features. However, the visual stimuli are of no interest to the users as they just serve as the hidden codes behind the characters. Furthermore, using stronger visual stimuli could cause visual fatigue and other adverse symptoms to users. Therefore, it's imperative for visual BCIs to use small and inconspicuous visual stimuli to code characters. $Methods:$ This study developed a new BCI speller based on miniature asymmetric visual evoked potentials (aVEPs), which encodes thirty-two characters with a space-code division multiple access (SCDMA) scheme and decodes EEG features with a discriminative canonical pattern matching (DCPM) algorithm. Notably, the visual stimulus used in this study only subtended 0.5° of visual angle and was placed outside the fovea vision on the lateral side, which could only induce a miniature potential about 0.5 μV in amplitude and about -16.5 dB in signal-to-noise rate (SNR). Twelve subjects were recruited to use the miniature aVEP speller in both offline and online tests. $Results:$ Information transfer rates up to 63.33 bits/min could be achieved from online tests. $Conclusion:$ Experimental results demonstrate the feasibility of using very small and inconspicuous visual stimuli to implement an efficient BCI system, even though the elicited EEG features are very weak. $Significance:$ The proposed innovative technique can broaden the category of BCIs and strengthen the brain-computer communication.
3 March 2020 in IEEE Transactions on Biomedical Engineering
Objective: Recently, electroencephalography (EEG)- based brain-computer interfaces (BCIs) have made tremendous progress in increasing communication speed. However, current BCI systems could only implement a small number of command codes, which hampers their applicability. Methods: This study developed a high-speed hybrid BCI system containing as many as 108 instructions, which were encoded by concurrent P300 and steady-state visual evoked potential (SSVEP) features and decoded by an ensemble task-related component analysis method. Notably, besides the frequency-phase-modulated SSVEP and time-modulated P300 features as contained in the traditional hybrid P300 and SSVEP features, this study found two new distinct EEG features for the concurrent P300 and SSVEP features, i.e. time-modulated SSVEP and frequency-phase- modulated P300. Ten subjects spelled in both offline and online cued-guided spelling experiments. Other ten subjects took part in online copy-spelling experiments. Results: Offline analyses demonstrate that the concurrent P300 and SSVEP features can provide adequate classification information to correctly select the target from 108 characters in 1.7 seconds. Online cued-guided spelling and copy-spelling tests further show that the proposed BCI system can reach an average information transfer rate (ITR) of 172.46±32.91 bits/min and 164.69±33.32 bits/min respectively, with a peak value of 238.41 bits/min (The demo video of online copy-spelling is enclosed and can be found at https://www.youtube.com/watch?v=EW2Q08oHSBo). Conclusion: We expand a BCI instruction set to over 100 command codes with high-speed in an efficient manner, which significantly improves the degree of freedom of BCIs. Significance: This study hold promise for broadening the applications of BCI systems.