A preponderance of brain–computer interface (BCI) publications proposing artificial neural networks for motor imagery (MI) electroencephalography (EEG) signal classification utilize one of the BCI Competition datasets. However, these databases encompass MI EEG data from a limited number of subjects, typically less than or equal to 10. Furthermore, the algorithms usually include only bandpass filtering as a means of reducing noise and increasing signal quality. In this study, we conducted a comparative analysis of five renowned neural networks (Shallow ConvNet, Deep ConvNet, EEGNet, EEGNet Fusion, and MI-EEGNet) utilizing open-access databases with a larger subject pool in conjunction with the BCI Competition IV 2a dataset to obtain statistically significant results. We employed the FASTER algorithm to eliminate artifacts from the EEG as a signal processing step and explored the potential for transfer learning to enhance classification results on artifact-filtered data. Our objective was to rank the neural networks; hence, in addition to classification accuracy, we introduced two supplementary metrics: accuracy improvement from chance level and the effect of transfer learning. The former is applicable to databases with varying numbers of classes, while the latter can underscore neural networks with robust generalization capabilities. Our metrics indicated that researchers should not disregard Shallow ConvNet and Deep ConvNet as they can outperform later published members of the EEGNet family.
27 November 2022 in Signal, Image and Video Processing
This paper proposes a novel convolutional neural network (CNN) fusion method for electroencephalography (EEG) motor imagery (MI) signal classification. The method is named MFBF, which stands for multifrequency band fusion. The MFBF method relies on filtering the input signal with different frequency bands and feeding each band signal to a duplicate of a CNN model; then, all duplicates are concatenated to form a fusion model. This paper also introduces the second release of Coleeg software, which is used for evaluation. The MFBF method has the advantage of the flexibility of choosing any model and any number of frequency bands. In the experimental evaluation, the CNN1D model and three frequency bands were used to form the CNN1D_MFBF model, and it was evaluated against the EEGNet_fusion model on three different datasets, which are: Physionet, BCI competition IV-2a, and a dataset from the Hungarian Academy of Sciences Research Centre for Natural Sciences (MTA-TTK). The CNN1D_MFBF model had comparable or better accuracy results with less than one-fifth of the training time, which is a significant advantage for the proposed method.
Background/Objectives: Accurately classifying Electroencephalography (EEG) signals is essential for the effective operation of Brain-Computer Interfaces (BCI), which is needed for reliable neurorehabilitation applications. However, many factors in the processing pipeline can influence classification performance. The objective of this study is to assess the effects of different processing steps on classification accuracy in EEG-based BCI systems. Methods: This study explores the impact of various processing techniques and stages, including the FASTER algorithm for artifact rejection (AR), frequency filtering, transfer learning, and cropped training. The Physionet dataset, consisting of four motor imagery classes, was used as input due to its relatively large number of subjects. The raw EEG was tested with EEGNet and Shallow ConvNet. To examine the impact of adding a spatial dimension to the input data, we also used the Multi-branch Conv3D Net and developed two new models, Conv2D Net and Conv3D Net. Results: Our analysis showed that classification accuracy can be affected by many factors at every stage. Applying the AR method, for instance, can either enhance or degrade classification performance, depending on the subject and the specific network architecture. Transfer learning was effective in improving the performance of all networks for both raw and artifact-rejected data. However, the improvement in classification accuracy for artifact-rejected data was less pronounced compared to unfiltered data, resulting in reduced precision. For instance, the best classifier achieved 46.1% accuracy on unfiltered data, which increased to 63.5% with transfer learning. In the filtered case, accuracy rose from 45.5% to only 55.9% when transfer learning was applied. An unexpected outcome regarding frequency filtering was observed: networks demonstrated better classification performance when focusing on lower-frequency components. Higher frequency ranges were more discriminative for EEGNet and Shallow ConvNet, but only when cropped training was applied. Conclusions: The findings of this study highlight the complex interaction between processing techniques and neural network performance, emphasizing the necessity for customized processing approaches tailored to specific subjects and network architectures.
We present our Brain-Computer Interface (BCI) System, developed for the BCI discipline of Cybathlon 2020 competition. In the BCI discipline, subjects with tetraplegia are required to control a computer game with mental commands. The absolute of the Fast-Fourier Transformation amplitude was calculated as a feature (FFTabs) from one-second-long electroencephalographic (EEG) signals. To extract the final features, we introduced two methods, namely the Feature Average, where the average of the FFTabs for a specific frequency band was calculated, and the Feature Range, which was based on generating multiple Feature Averages for non-overlapping 2 Hz wide frequency bins. The resulting features were fed to a Support Vector Machine classifier. The algorithms were tested on the PhysioNet database and our dataset, which contains 16 offline experiments recorded with 2 tetraplegic subjects. 27 gameplay trials (out of 59) with our tetraplegic subjects reached the 240-second qualification time limit. The Feature Average of canonical frequency bands (alpha, beta, gamma, and theta) were compared with our suggested range30 and range40 methods. On the PhysioNet dataset, the range40 method combined with an ensemble SVM classifier significantly reached the highest accuracy level (0.4607), with a 4-class classification, and outperformed the state-of-the-art EEGNet.
Most of the Brain-Computer Interface (BCI) publications, which propose artificial neural networks for Motor Imagery (MI) Electroencephalography (EEG) signal classification, are presented using one of the BCI Competition datasets. However, these databases contain MI EEG data from less than or equal to 10 subjects . In addition, these algorithms usually include only bandpass filtering to reduce noise and increase signal quality. In this article, we compared 5 well-known neural networks (Shallow ConvNet, Deep ConvNet, EEGNet, EEGNet Fusion, MI-EEGNet) using open-access databases with many subjects next to the BCI Competition 4 2a dataset to acquire statistically significant results. We removed artifacts from the EEG using the FASTER algorithm as a signal processing step. Moreover, we investigated whether transfer learning can further improve the classification results on artifact filtered data. We aimed to rank the neural networks; therefore, next to the classification accuracy, we introduced two additional metrics: the accuracy improvement from chance level and the effect of transfer learning. The former can be used with different class-numbered databases, while the latter can highlight neural networks with sufficient generalization abilities. Our metrics showed that the researchers should not avoid Shallow ConvNet and Deep ConvNet because they can perform better than the later published ones from the EEGNet family.