16 July 2025 in Neural Networks
11 July 2024 in IEEE Journal of Biomedical and Health Informatics
Sleep staging is essential for sleep assessment and plays an important role in disease diagnosis, which refers to the classification of sleep epochs into different sleep stages. Polysomnography (PSG), consisting of many different physiological signals, e.g. electroencephalogram (EEG) and electrooculogram (EOG), is a gold standard for sleep staging. Although existing studies have achieved high performance on automatic sleep staging from PSG, there are still some limitations: 1) they focus on local features but ignore global features within each sleep epoch, and 2) they ignore cross-modality context relationship between EEG and EOG. In this paper, we propose CareSleepNet, a novel hybrid deep learning network for automatic sleep staging from PSG recordings. Specifically, we first design a multi-scale Convolutional-Transformer Epoch Encoder to encode both local salient wave features and global features within each sleep epoch. Then, we devise a Cross-Modality Context Encoder based on co-attention mechanism to model cross-modality context relationship between different modalities. Next, we use a Transformer-based Sequence Encoder to capture the sequential relationship among sleep epochs. Finally, the learned feature representations are fed into an epoch-level classifier to determine the sleep stages. We collected a private sleep dataset, SSND, and use two public datasets, Sleep-EDF-153 and ISRUC to evaluate the performance of CareSleepNet. The experiment results show that our CareSleepNet achieves the state-of-the-art performance on the three datasets. Moreover, we conduct ablation studies and attention visualizations to prove the effectiveness of each module and to analyze the influence of each modality.
6 September 2023 in IEEE Transactions on Neural Systems and Rehabilitation Engineering
Narcolepsy is a sleep disorder affecting millions of people worldwide and causes serious public health problems. It is hard for doctors to correctly and objectively diagnose narcolepsy. Polysomnography (PSG) recordings, a gold standard for sleep monitoring and quality measurement, can provide abundant and objective cues for the narcolepsy diagnosis. There have been some studies on automatic narcolepsy diagnosis using PSG recordings. However, the sleep stage information, an important cue for narcolepsy diagnosis, has not been fully utilized. For example, some studies have not considered the sleep stage information to diagnose narcolepsy. Although some studies consider the sleep stage information, the stages are manually scored by experts, which is time-consuming and subjective. And the framework using sleep stages scored automatically for narcolepsy diagnosis is designed in a two-phase learning manner, where sleep staging in the first phase and diagnosis in the second phase, causing cumulative error and degrading the performance. To address these challenges, we propose a novel end-to-end framework for automatic narcolepsy diagnosis using PSG recordings. In particular, adopting the idea of multi-task learning, we take the sleep staging as our auxiliary task, and then combine the sleep stage related features with narcolepsy related features for our primary task of narcolepsy diagnosis. We collected a dataset of PSG recordings from 77 participants and evaluated our framework on it. Both of the sleep stage features and the end-to-end fashion contribute to diagnosis performance. Moreover, we do a comprehensive analysis on the relationship between sleep stages and narcolepsy, correlation of different channels, predictive ability of different sensing data, and diagnosis results in subject level.
24 March 2024 in Proceedings of the AAAI Conference on Artificial Intelligence
Automatic sleep staging is essential for sleep assessment and disorder diagnosis. Most existing methods depend on one specific dataset and are limited to be generalized to other unseen datasets, for which the training data and testing data are from the same dataset. In this paper, we introduce domain generalization into automatic sleep staging and propose the task of generalizable sleep staging which aims to improve the model generalization ability to unseen datasets. Inspired by existing domain generalization methods, we adopt the feature alignment idea and propose a framework called SleepDG to solve it. Considering both of local salient features and sequential features are important for sleep staging, we propose a Multi-level Feature Alignment combining epoch-level and sequence-level feature alignment to learn domain-invariant feature representations. Specifically, we design an Epoch-level Feature Alignment to align the feature distribution of each single sleep epoch among different domains, and a Sequence-level Feature Alignment to minimize the discrepancy of sequential features among different domains. SleepDG is validated on five public datasets, achieving the state-of-the-art performance.
18 April 2024 in IEEE Transactions on Neural Systems and Rehabilitation Engineering
Polysomnography (PSG) recordings have been widely used for sleep staging in clinics, containing multiple modality signals (i.e., EEG and EOG). Recently, many studies have combined EEG and EOG modalities for sleep staging, since they are the most and the second most powerful modality for sleep staging among PSG recordings, respectively. However, EEG is complex to collect and sensitive to environment noise or other body activities, imbedding its use in clinical practice. Comparatively, EOG is much more easily to be obtained. In order to make full use of the powerful ability of EEG and the easy collection of EOG, we propose a novel framework to simplify multimodal sleep staging with a single EOG modality. It still performs well with only EOG modality in the absence of the EEG. Specifically, we first model the correlation between EEG and EOG, and then based on the correlation we generate multimodal features with time and frequency guided generators by adopting the idea of generative adversarial learning. We collected a real-world sleep dataset containing 67 recordings and used other four public datasets for evaluation. Compared with other existing sleep staging methods, our framework performs the best when solely using the EOG modality. Moreover, under our framework, EOG provides a comparable performance to EEG.
25 April 2022 in Journal of Seismology