14 August 2023 in IEEE Transactions on Neural Systems and Rehabilitation Engineering
In steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs), various spatial filtering methods based on individual calibration data have been proposed to alleviate the interference of spontaneous activities in SSVEP signals for enhancing the SSVEP detection performance. However, the time-consuming calibration session would increase the visual fatigue of subjects and reduce the usability of the BCI system. The key idea of this study is to propose a cross-subject transfer method based on domain generalization, which transfers the domain-invariant spatial filters and templates learned from source subjects to the target subject with no access to the EEG data from the target subject. The transferred spatial filters and templates are obtained by maximizing the intra- and inter-subject correlations using the SSVEP data corresponding to the target and its neighboring stimuli. For SSVEP detection of the target subject, four types of correlation coefficients are calculated to construct the feature vector. Experimental results estimated with three SSVEP datasets show that the proposed cross-subject transfer method improves the SSVEP detection performance compared to state-of-art methods. The satisfactory results demonstrate that the proposed method provides an effective transfer learning strategy requiring no tedious data collection process for new users, holding the potential of promoting practical applications of SSVEP-based BCI.
24 March 2022 in IEEE Transactions on Neural Systems and Rehabilitation Engineering
Due to the high robustness to artifacts, steady-state visual evoked potential (SSVEP) has been widely applied to construct high-speed brain-computer interfaces (BCIs). Thus far, many spatial filtering methods have been proposed to enhance the target identification performance for SSVEP-based BCIs, and task-related component analysis (TRCA) is among the most effective ones. In this paper, we further extend TRCA and propose a new method called Latency Aligning TRCA (LA-TRCA), which aligns visual latencies on channels to obtain accurate phase information from task-related signals. Based on the SSVEP wave propagation theory, SSVEP spreads from posterior occipital areas over the cortex with a fixed phase velocity. Via estimation of the phase velocity using phase shifts of channels, the visual latencies on different channels can be determined for inter-channel alignment. TRCA is then applied to aligned data epochs for target recognition. For the validation purpose, the classification performance comparison between the proposed LA-TRCA and TRCA-based expansions were performed on two different SSVEP datasets. The experimental results illustrated that the proposed LA-TRCA method outperformed the other TRCA-based expansions, which thus demonstrated the effectiveness of the proposed approach for enhancing the SSVEP detection performance.
4 November 2022 in IEEE Transactions on Instrumentation and Measurement
Various spatial filters have been proposed to enhance the target identification performance of steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs). The current methods only extract the target-related information from the corresponding stimulus to learn the spatial filter parameter. However, the SSVEP data from neighboring stimuli also contain frequency information of the target stimulus, which could be utilized to further improve the target identification performance. In this paper, we propose a new method incorporating SSVEPs from the neighboring stimuli to strengthen the target-related frequency information. First, The spatial filter is obtained by maximizing the summation of covariances of SSVEP data corresponding to the target and its neighboring stimuli. Then the correlation features between spatially filtered templates and test data are calculated for target detection. For the performance evaluation, we implemented the offline experiment using the 40-class benchmark dataset from 35 subjects and the 12-target self-collected dataset from 11 subjects. Compared with the state-of-art spatial filtering methods, the proposed method showed superiority in classification accuracy and information transfer rate (ITR). The comparison results demonstrate the effectiveness of the proposed spatial filter for target identification in SSVEP-based BCIs.
7 March 2024 in IEEE Transactions on Instrumentation and Measurement
To achieve a high information transfer rate (ITR) in steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs), current decoding methods require extensive calibration efforts to train the model parameters for each stimulus. To facilitate the calibration process, this study proposed a cross-stimulus transfer method, which learns the common spatial filter and impulse response from a few source stimuli and then transfers them to a new target stimulus for SSVEP feature extraction. First, the common spatial filter and impulse response are obtained by minimizing the deviation between the spatially filtered source SSVEPs and the constructed SSVEP templates. Then, the feature vector comprised of two correlation coefficients is utilized for target recognition, one is the correlation coefficient between the spatially filtered target SSVEPs and the constructed templates, and the other is the canonical correlation coefficient between the spatially filtered target SSVEPs and the reference signals. For the performance evaluation, the target recognition performance of the proposed method was compared with state-of-art methods on two public SSVEP datasets and a self-collected SSVEP dataset. Results showed that the proposed method can obtain higher performance with fewer source stimuli and training blocks, demonstrating the proposed cross-stimulus transfer method has the capability of fast calibration of the SSVEP-based BCIs.
12 June 2024 in IEEE Transactions on Instrumentation and Measurement
Depressive disorder has become a common problem among higher education students, but it often gets undiagnosed and untreated due to unrecognized symptoms, poor access to medical resources, and fear of stigma. To improve the situation, automatic depression detection would be essential. In this paper, we explore the feasibility of depression detection in higher education students using their behavioral data automatically collected by the University system. First, a DeepFM network, which can not only take discrete-continuous mixed features as its input but also can learn linear and nonlinear relations between the input and the output, is presented for depression detection. A modified focal loss function (MFL) is then proposed to alleviate data imbalance impact caused by the fact that the proportion of healthy students outweighs those diagnosed with depression significantly. To verify the effectiveness of the proposed method, behavioral data from 3218 students were collected, of which 179 were diagnosed with depression by university psychologists using PHQ-9 scale scores. 5-fold cross-validations are performed, and the experiment results have illustrated that DeepFM obtains the highest average accuracy compared to Multilayer Perceptron (MLP), Factorisation Neural Network (FNN), and Product-based Neural Network (PNN), demonstrating the effectiveness of the proposed framework for depression detection among university students.
26 June 2024 in IEEE Transactions on Neural Systems and Rehabilitation Engineering
Various training-based spatial filtering methods have been proposed to decode steady-state visual evoked potentials (SSVEPs) efficiently. However, these methods require extensive calibration data to obtain valid spatial filters and temporal templates. The time-consuming data collection and calibration process would reduce the practicality of SSVEP-based brain-computer interfaces (BCIs). Therefore, we propose a temporally local weighting-based phase-locked time-shift (TLW-PLTS) data augmentation method to augment training data for calculating valid spatial filters and temporal templates. In this method, the sliding window strategy using the SSVEP response period as a time-shift step is to generate the augmented data, and the time filter which maximises the temporally local covariance between the original template signal and the sine-cosine reference signal is used to suppress the temporal noise in the augmented data. For the performance evaluation, the TLW-PLTS method was incorporated with state-of-the-art training-based spatial filtering methods to calculate classification accuracies and information transfer rates (ITRs) using three SSVEP datasets. Compared with state-of-the-art training-based spatial filtering methods and other data augmentation methods, the proposed TLW-PLTS method demonstrates superior decoding performance with fewer calibration data, which is promising for the development of fast-calibration BCIs.