Pandemic-related sleep disorders affect human physical and mental health. The artificial intelligence (AI) based sleep staging with multimodal electrophysiological signals help people diagnose and treat sleep disorders. However, the existing AI-based methods could not capture more discriminative modalities and adaptively correlate these multimodal features. This paper introduces a multimodal attention network (MMASleepNet) to efficiently extract, perceive and fuse multimodal features of electrophysiological signals. The MMASleepNet has a multi-branch feature extraction (MBFE) module followed by an attention-based feature fusing (AFF) module. In the MBFE module, branches are designed to extract multimodal signals' temporal and spectral features. Each branch has two-stream convolutional networks with a unique kernel to perceive features of different time scales. The AFF module contains a modal-wise squeeze and excitation (SE) block to adjust the weights of modalities with more discriminative features and a Transformer encoder (TE) to generate attention matrices and extract the inter-dependencies among multimodal features. Our MMASleepNet outperforms state-of-the-art models in terms of different evaluation matrices on the datasets of Sleep-EDF and ISRUC-Sleep. The implementation code is available at: https://github.com/buptantEEG/MMASleepNet/.
1 September 2021 in Biomedical Signal Processing and Control
Stable and accurate electroencephalogram (EEG) signal acquisition is fundamental in non-invasive brain-computer interface (BCI) technology. Commonly used EEG acquisition systems' hardware and software are usually closed-source. Its inability to flexible expansion and secondary development is a major obstacle to real-time BCI research. This paper presents the Beijing University of Posts and Telecommunications EEG Acquisition Tool System named BEATS. It implements a comprehensive system from hardware to software, composed of the analog front end, microprocessor, and software platform. BEATS is capable of collecting 32-channel EEG signals at a guaranteed sampling rate of 4 kHz with wireless transmission. Compared to state-of-the-art systems used in many EEG fields, it displays a better sampling rate. Using techniques including direct memory access, first in first out, and timer, the precision and stability of the acquisition are ensured at the microsecond level. An evaluation is conducted during 24 hours of continuous acquisitions. There are no packet losses and the average maximum delay is only 0.07 s/h. Moreover, as an open-source system, BEATS provides detailed design files, and adopts a plug-in structure and easy-to-access materials, which makes it can be quickly reproduced. Schematics, source code, and other materials of BEATS are available at https://github.com/buptantEEG/BEATS .
16 January 2023 in IEEE Transactions on Neural Systems and Rehabilitation Engineering
High-frequency activity (HFA) in intracranial electroencephalography recordings are diagnostic biomarkers for refractory epilepsy. Clinical utilities based on HFA have been extensively examined. HFA often exhibits different spatial patterns corresponding to specific states of neural activation, which will potentially improve epileptic tissue localization. However, research on quantitative measurement and separation of such patterns is still lacking. In this paper, spatial pattern clustering of HFA (SPC-HFA) is developed. The process is composed of three steps: (1) feature extraction: skewness which quantifies the intensity of HFA is extracted; (2) clustering: k-means clustering is applied to separate column vectors within the feature matrix into intrinsic spatial patterns; (3) localization: the determination of epileptic tissue is performed based on the cluster centroid with HFA expanding to the largest spatial extent. Experiments were conducted on a public iEEG dataset with 20 patients. Compared with existing localization methods, SPC-HFA demonstrates improvement (Cohen’s d > 0.2) and ranks top in 10 out of 20 patients in terms of the area under the curve. In addition, after extending SPC-HFA to high-frequency oscillation detection algorithms, corresponding localization results also improve with effect size Cohen’s d ≥ 0.48. Therefore, SPC-HFA can be utilized to guide clinical and surgical treatment of refractory epilepsy.
Stable and accurate electroencephalogram (EEG) signal acquisition is fundamental in non-invasive brain-computer interface (BCI) technology. Commonly used EEG acquisition system’s hardware and software are usually closed-source. Its inability to flexible expansion and secondary development is a major obstacle to real-time BCI research. This paper presents the Beijing University of Posts and Telecommunications EEG Acquisition Tool System named BEATS. It implements a comprehensive system from hardware to software, composed of the analog front-end, microprocessor, and software platform. BEATS is capable of collecting 32-channel EEG signals at a guaranteed sampling rate of 4k Hz with wireless transmission. Compared to state-of-the-art systems used in many EEG fields, it displays a better sampling rate. Using techniques including direct memory access, first in first out, and timer, the precision and stability of the acquisition are ensured at the microsecond level. An evaluation is conducted during 24 hours of continuous acquisitions. The data loss is 0 packets and the average maximum delay is only 0.07 s/h. Moreover, as an open source system, BEATS provides detailed design files, and adopts a plug-in structure and easy-to-access materials, which makes it can be quickly reproduced. Schematics, source code, and other materials of BEATS are available at https://github.com/buptantEEG/BEATS.