Brain-computer interface (BCI) systems allow users to communicate with external devices by translating neural signals into real-time commands. Convolutional neural networks (CNNs) have been effectively utilized for decoding motor imagery electroencephalography (MI-EEG) signals in BCIs. However, traditional CNN-based methods face challenges such as individual variability in EEG signals and the limited receptive fields of CNNs. This study presents the Multi-Scale Convolutional Transformer (MSCFormer) model that integrates multiple CNN branches for multi-scale feature extraction and a Transformer module to capture global dependencies, followed by a fully connected layer for classification. The multi-branch multi-scale CNN structure effectively addresses individual variability in EEG signals, enhancing the model’s generalization capabilities, while the Transformer encoder strengthens global feature integration and improves decoding performance. Extensive experiments on the BCI IV-2a and IV-2b datasets show that MSCFormer achieves average accuracies of 82.95% (BCI IV-2a) and 88.00% (BCI IV-2b), with kappa values of 0.7726 and 0.7599 in five-fold cross-validation, surpassing several state-of-the-art methods. These results highlight MSCFormer’s robustness and accuracy, underscoring its potential in EEG-based BCI applications. The code has been released in https://github.com/snailpt/MSCFormer.
12 April 2024 in Computational and Structural Biotechnology Journal
Fully supervised learning methods necessitate a substantial volume of labelled training instances, a process that is typically both labour-intensive and costly. In the realm of medical image analysis, this issue is further amplified, as annotated medical images are considerably more scarce than their unlabelled counterparts. Consequently, leveraging unlabelled images to extract meaningful underlying knowledge presents a formidable challenge in medical image analysis. This paper introduces a simple triple-view unsupervised representation learning model (SimTrip) combined with a triple-view architecture and loss function, aiming to learn meaningful inherent knowledge efficiently from unlabelled data with small batch size. With the meaningful representation extracted from unlabelled data, our model demonstrates exemplary performance across two medical image datasets. It achieves this using only partial labels and outperforms other state-of-the-art methods. The method we present herein offers a novel paradigm for unsupervised representation learning, establishing a baseline that is poised to inspire the development of more intricate SimTrip-based methods across a spectrum of computer vision applications. Code and user guide are released at https://github.com/JerryRollingUp/SimTripSystem, the system also runs at http://43.131.9.159:5000/.
A motor imagery (MI) brain-computer interface (BCI) plays an important role in the neurological rehabilitation training for stroke patients. Electroencephalogram (EEG)-based MI BCI has high temporal resolution, which is convenient for real-time BCI control. Therefore, we focus on EEG-based MI BCI in this paper. The identification of MI EEG signals is always quite challenging. Due to high inter-session/subject variability, each subject should spend long and tedious calibration time in collecting amounts of labeled samples for a subject-specific model. To cope with this problem, we present a supervised selective cross-subject transfer learning (sSCSTL) approach which simultaneously makes use of the labeled samples from target and source subjects based on Riemannian tangent space. Since the covariance matrices representing the multi-channel EEG signals belong to the smooth Riemannian manifold, we perform the Riemannian alignment to make the covariance matrices from different subjects close to each other. Then, all aligned covariance matrices are converted into the Riemannian tangent space features to train a classifier in the Euclidean space. To investigate the role of unlabeled samples, we further propose semi-supervised and unsupervised versions which utilize the total samples and unlabeled samples from target subject, respectively. Sequential forward floating search (SFFS) method is executed for source selection. All our proposed algorithms transfer the labeled samples from most suitable source subjects into the feature space of target subject. Experimental results on two publicly available MI datasets demonstrated that our algorithms outperformed several state-of-the-art algorithms using small number of the labeled samples from target subject, especially for good target subjects.
Objective: This study aims to develop a predictive model for the risk of major adverse events (MAEs) in type A aortic dissection (AAAD) patients with malnutrition after surgery, utilizing machine learning (ML) algorithms.Methods: We retrospectively collected clinical data from AAAD patients with malnutrition who underwent surgical treatment at our center. Through least absolute shrinkage and selection operator (LASSO) regression analysis, we screened for preoperative and intraoperative characteristic variables. Based on the random forest (RF) algorithm, we constructed a ML predictive model, and further evaluated and interpreted this model.Results: Through LASSO regression analysis and univariate analysis, we ultimately selected seven feature variables for modeling. After comparing six different ML models, we confirmed that the RF model demonstrated the best predictive performance in this dataset. Subsequently, we constructed a model using the RF algorithm to predict the risk of postoperative MAEs in AAAD patients with malnutrition. The test set results indicated that this model has excellent predictive efficacy and clinical applicability. Finally, we employed the Shapley additive explanations (SHAP) method to further interpret the predictions of this model.Conclusion: We have successfully constructed a risk prediction model for postoperative MAEs in AAAD patients with malnutrition using the RF algorithm, and we have interpreted the model through the SHAP method. This model aids clinicians in early identification of high-risk patients for MAEs, thereby potentially mitigating adverse clinical outcomes associated with malnutrition.
Multi-modal magnetic resonance imaging (MRI) segmentation of brain tumors is a hot topic in brain tumor processing research in recent years, which can make full use of the feature information of different modalities in MRI images, so that tumors can be segmented more effectively. In this article, convolutional neural networks (CNN) is used as a tool to improve the efficiency and effectiveness of segmentation. Based on this, Dense-ResUNet, a multi-modal MRI image segmentation model for brain tumors is created. The Dense-ResUNet consists of a series of nested dense convolutional blocks and a U-Net shaped model with residual connections. The nested dense convolutional blocks can bridge the semantic disparity between the feature maps of the encoder and decoder before fusion and make full use of different levels of features. The residual blocks and skip connection can extract pixel information from the image and skip the link to solve the traditional deep traditional CNN network problem. The experiment results show that our Dense-ResUNet can effectively help to extract the brain tumor and has great clinical research and application value.
Cell instances segmentation in cervical cytology images have crucial importance for cancer screening and automatic biomedical image analysis. However, that the highly overlapping cells cause ambiguous boundaries makes accurate cell segmentation still a challenging task. This paper proposes a novel transformer-based neural network to segment overlapping cervical cells, by using the technique of denoising with Mask2Former. The model optimization includes two aspects. One is that class embeddings of ground truth categories are used as extra content queries to transformer decoder. The other is that noised ground truth masks are fed into each layer of transformer decoder and then the model is trained to reconstruct the original masks. Compared with the best result on ISBI2014 dataset, the proposed model obtains performance improvement by \(3.4\%\) on DSC, \(2.3\%\) on TPRp and \(2\%\) on FNRo, respectively. Especially, the masks predicted by our model are more precise than other methods and our previous models. Those results show that the proposed method could be effective in segmenting overlapping cells and help pathologists detect cell lesions.