18 August 2020 in IEEE Sensors Journal
Electroencephalograph (EEG) has been widely applied for brain-computer interface (BCI) which enables paralyzed people to directly communicate with and control external devices, due to its portability, high temporal resolution, ease of use and low cost. Of various EEG paradigms, steady-state visual evoked potential (SSVEP)-based BCI system which uses multiple visual stimuli (such as LEDs or boxes on a computer screen) flickering at different frequencies has been widely explored in the past decades due to its fast communication rate and high signal-to-noise ratio. In this article, we review the current research in SSVEP-based BCI, focusing on the data analytics that enables continuous, accurate detection of SSVEPs and thus high information transfer rate. The main technical challenges, including signal pre-processing, spectrum analysis, signal decomposition, spatial filtering in particular canonical correlation analysis and its variations, and classification techniques are described in this article. Research challenges and opportunities in spontaneous brain activities, mental fatigue, transfer learning as well as hybrid BCI are also discussed.
1 March 2023 in IEEE Transactions on Neural Systems and Rehabilitation Engineering
Steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) have been substantially studied in recent years due to their fast communication rate and high signal-to-noise ratio. The transfer learning is typically utilized to improve the performance of SSVEP-based BCIs with auxiliary data from the source domain. This study proposed an inter-subject transfer learning method for enhancing SSVEP recognition performance through transferred templates and transferred spatial filters. In our method, the spatial filter was trained via multiple covariance maximization to extract SSVEP-related information. The relationships between the training trial, the individual template, and the artificially constructed reference are involved in the training process. The spatial filters are applied to the above templates to form two new transferred templates, and the transferred spatial filters are obtained accordingly via the least-square regression. The contribution scores of different source subjects can be calculated based on the distance between the source subject and the target subject. Finally, a four-dimensional feature vector is constructed for SSVEP detection. To demonstrate the effectiveness of the proposed method, a publicly available dataset and a self-collected dataset were employed for performance evaluation. The extensive experimental results validated the feasibility of the proposed method for improving SSVEP detection.
25 August 2023 in IEEE Transactions on Neural Systems and Rehabilitation Engineering
Steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) have been extensively studied due to many benefits, such as non-invasiveness, high information transfer rate, and ease of use. SSVEP-based BCI has been investigated in various applications by projecting brain signals to robot control commands. However, the movement direction and speed are generally fixed and prescribed, neglecting the user’s requirement for velocity changes during practical implementations. In this study, we proposed a velocity modulation method based on stimulus brightness for controlling the robotic arm in the SSVEP-based BCI system. A stimulation interface was designed, incorporating flickers, target and a cursor workspace. The synchronization of the cursor and robotic arm does not require the subject’s eye switch between the stimuli and the robot. The feature vector consists of the characteristics of the signal and the classification result. Subsequently, the Gaussian mixture model (GMM) and Bayesian inference were used to calculate the posterior probabilities that the signal came from a high or low brightness flicker. A brain-actuated speed function was designed by incorporating the posterior probability difference. Finally, the historical velocity was considered to determine the final velocity. To demonstrate the effectiveness of the proposed method, online experiments, including single- and multi-target reaching tasks, were conducted. The extensive experimental results validated the feasibility of the proposed method in reducing reaching time and achieving proximity to the target.
27 January 2022 in IEEE Transactions on Instrumentation and Measurement
Many spatial filtering methods have been proposed to enhance the target identification performance for the steady-state visual evoked potential (SSVEP)-based brain–computer interface (BCI). The existing approaches tend to learn spatial filter parameters of a certain target using only the training data from the same stimulus, and they rarely consider the information from other stimuli or the volume conduction problem during the training process. In this article, we propose a novel multi-objective optimization-based high-pass spatial filtering method to improve the SSVEP detection accuracy and robustness. The filters are derived via maximizing the correlation between the training signal and the individual template from the same target whilst minimizing the correlation between the signal from other targets and the template. The optimization will also be subject to the constraint that the sum of filter elements is zero. The evaluation study on two self-collected SSVEP datasets (including 12 and four frequencies, respectively) shows that the proposed method outperformed the compared methods such as canonical correlation analysis (CCA), multiset CCA (MsetCCA), sum of squared correlations (SSCOR), and task-related component analysis (TRCA). The proposed method was also verified on a public 40-class SSVEP benchmark dataset recorded from 35 subjects. The experimental results have demonstrated the effectiveness of the proposed approach for enhancing the SSVEP detection performance.
9 June 2023 in IEEE Transactions on Instrumentation and Measurement
The brain-computer interface (BCI) enables paralyzed people to directly communicate with and operate peripheral equipment. The steady-state visual evoked potential (SSVEP)-based BCI system has been extensively investigated in recent years due to its fast communication rate and high signal-to-noise ratio. Many present SSVEP recognition methods determine the target class via finding the largest correlation coefficient. However, the classification performance usually degrades when the largest coefficient is not significantly different from the rest of the values. This study proposed a Bayesian-based classification confidence estimation method to enhance the target recognition performance of SSVEP-based BCI systems. In our method, the differences between the largest and the other values generated by a basic target identification method are used to define a feature vector during the training process. The Gaussian mixture model (GMM) is then employed to estimate the probability density functions of feature vectors for both correct and wrong classifications. Subsequently, the posterior probabilities of being an accurate and false classification are calculated via Bayesian inference in the test procedure. A classification confidence value (CCValue) is presented based on two posterior probabilities to estimate the classification confidence. Finally, the decision-making rule can determine whether the present classification result should be accepted or rejected. Extensive evaluation studies were performed on an open-access benchmark dataset and a self-collected dataset. The experimental results demonstrated the effectiveness and feasibility of the proposed method for improving the reliability of SSVEP-based BCI systems.
25 December 2024 in Advanced Intelligent Systems
This work proposes an offline‐cascade‐online (OCO) estimation algorithm, achieving the distal trajectory estimation in unstructured working space and with long‐term visual occlusion. The OCO estimation algorithm cascades a backpropagation (BP)‐based offline learning network and a radial basis function (RBF)‐based online learning network, realizing the prior estimation and error compensation, respectively. The BP network is pretrained offline based on the data collected in free spaces, while the RBF network could be updated online by the least squares method with the historical data in unstructured working spaces to avoid the local optimum problem. Furthermore, a modified loss function consisting of three terms is proposed for the RBF network to improve the estimated distal trajectories’ accuracy, smoothness, and stability in complex unstructured environments. Experimental results indicate that the proposed OCO estimation algorithm achieves a high level of accuracy, with an average relative estimation error of 1.36% in two types of unstructured environments with visual occlusion. Meanwhile, the accuracy of the proposed algorithm is improved by more than 30% in the trajectory estimation of two consecutive loops, demonstrating its outstanding online learning ability. Moreover, experiments on another type of continuum manipulator have also validated its high transferability and strong robustness.