Deep learning models for detecting episodes of atrial fibrillation (AF) using rhythm information in long-term ambulatory ECG recordings have shown high performance. However, the rhythm-based approach does not take advantage of the morphological information conveyed by the different ECG waveforms, particularly the f-waves. As a result, the performance of such models may be inherently limited. To address this limitation, we have developed a deep learning model, named RawECGNet, to detect episodes of AF and atrial flutter (AFl) using the raw, single-lead ECG. We compare the generalization performance of RawECGNet on two external data sets that account for distribution shifts in geography, ethnicity, and lead position. RawECGNet is further benchmarked against a state-of-the-art deep learning model, named ArNet2, which utilizes rhythm information as input. Using RawECGNet, the results for the different leads in the external test sets in terms of the F1 score were 0.91-0.94 in RBDB and 0.93 in SHDB, compared to 0.89-0.91 in RBDB and 0.91 in SHDB for ArNet2. The results highlight RawECGNet as a high-performance, generalizable algorithm for detection of AF and AFl episodes, exploiting information on both rhythm and morphology.
25 January 2023 in IEEE Transactions on Biomedical Engineering
Objective: Over the past few years, deep learning (DL) has been used extensively in research for 12-lead electrocardiogram (ECG) analysis. However, it is unclear whether the explicit or implicit claims made on DL superiority to the more classical feature engineering (FE) approaches, based on domain knowledge, hold. In addition, it remains unclear whether combining DL with FE may improve performance over a single modality. Methods: To address these research gaps and in-line with recent major experiments, we revisited three tasks: cardiac arrhythmia diagnosis (multiclass-multilabel classification), atrial fibrillation risk prediction (binary classification), and age estimation (regression). We used an overall dataset of 2.3M 12-lead ECG recordings to train the following models for each task: i) a random forest taking FE as input; ii) an end-to-end DL model; and iii) a merged model of FE+DL. Results: FE yielded comparable results to DL while necessitating significantly less data for the two classification tasks. DL outperformed FE for the regression task. For all tasks, merging FE with DL did not improve performance over DL alone. These findings were confirmed on the additional PTB-XL dataset. Conclusion: We found that for traditional 12-lead ECG based diagnosis tasks, DL did not yield a meaningful improvement over FE, while it improved significantly the nontraditional regression task. We also found that combining FE with DL did not improve over DL alone, which suggests that the FE was redundant with the features learned by DL. Significance: Our findings provides important recommendations on 12-lead ECG based machine learning strategy and data regime to choose for a given task. When looking at maximizing performance as the end goal, if the task is nontraditional and a large dataset is available then DL is preferable. If the task is a classical one and/or a small dataset is available then a FE approach may be the better choice.
3 April 2024 in European Heart Journal - Digital Health
Aims: Ventricular tachycardia (VT) is a dangerous cardiac arrhythmia that can lead to sudden cardiac death. Early detection and management of VT is thus of high clinical importance. We hypothesize that it is possible to identify patients with VT during sinus rhythm by leveraging a continuous 24 h Holter electrocardiogram and artificial intelligence. Methods and results: We analysed a retrospective Holter data set from the Rambam Health Care Campus, Haifa, Israel, which included 1773 Holter recordings from 1570 non-VT patients and 52 recordings from 49 VT patients. Morphological and heart rate variability features were engineered from the raw electrocardiogram signal and fed, together with demographical features, to a data-driven model for the task of classifying a patient as either VT or non-VT. The model obtained an area under the receiving operative curve of 0.76 ± 0.07. Feature importance suggested that the proportion of premature ventricular beats and beat-to-beat interval variability was discriminative of VT, while demographic features were not. Conclusion: This original study demonstrates the feasibility of VT identification from sinus rhythm in Holter.
While circadian phenotypes of paroxysmal atrial fibrillation (AF) have been observed in patient cohorts, differences in parameter definition and methodological limitations have left the existence and clinical relevance of distinct AF circadian phenotypes unclear. We hypothesize that paroxysmal AF comprises multiple circadian phenotypes (‘chronophenotypes’), each associated with different survival outcomes and population characteristics. We analyzed 24 h Holter recordings and clinical data from 58 995 examinations collected in 20 primary care facilities in Israel. AF episodes were detected using ArNet2, a deep learning model for AF detection trained on over 51 000 h of Holter recordings. Unsupervised hierarchical clustering was then applied to identify different chronophenotypes of AF based on the short-term AF burden. Each chronophenotype was further characterized by demographic, clinical, and treatment differences, including survival outcomes. The analysis resulted in the following distinct chronophenotypes: Nocturnal-to-Morning (12 AM–10 AM), Evening-to-Early Morning (3 PM-4 AM), and Daytime (9 AM-7 PM). These chronophenotypes were associated with different AF burden and clinical outcomes. The Evening-to-Early Morning chronophenotype was associated with a higher AF burden (
0.001) than the other paroxysmal AF chronophenotypes. However, the Nocturnal-to-Morning and Daytime chronophenotypes were associated with a higher risk of mortality; Daytime was also associated with a higher risk of heart failure. The study introduces a new approach to discovering chronophenotypes from Holter recordings. The results support the existence of distinct AF chronophenotypes, which are associated with significantly different average AF burden (
0.001) and clinical outcomes. The open-source implementation is publicly available at https://github.com/aim-lab/AFtoolkit.
A major challenge in translating medical AI systems into clinical practice is their limited generalization. In the field of physiological time series analysis, we propose a fine-tuning framework that leverages multiple small annotated datasets from diverse domains to improve out-of-distribution generalization performance (OOD-GP). Through an ablation study, we demonstrate the performance of our framework by evaluating the role of incorporating a greater number of independent datasets for tine-tuning to improve OOD-GP. Our experiments involve thirteen publicly available electrocardiogram and electroencephalogram datasets across four distinct tasks. In addition, we develop a method to measure the alignment of the latent space of target domains. We use this method to interpret our results, suggesting that multi-source domain training facilitates the learning of robust cross-domain features while minimizing learning of shortcut features. To support further research, we provide reproducible source code, establishing a framework and benchmark for studies on OOD-GP (https://github.com/EranZvuloni/MSD-generalization).
Heart failure (HF) affects 11.8% of adults aged 65 and older, reducing quality of life and longevity. Preventing HF can reduce morbidity and mortality. We hypothesized that artificial intelligence (AI) applied to 24-hour single-lead electrocardiogram (ECG) data could predict the risk of HF within five years. To research this, the Technion-Leumit Holter ECG (TLHE) dataset, including 69,663 recordings from 47,729 patients, collected over 20 years, was used. Our deep learning model, DeepHHF, trained on 24-hour ECG recordings, achieved an area under the receiver operating characteristic curve of 0.80 that outperformed a model using 30-second segments and a clinical score. High-risk individuals identified by DeepHHF had a two-fold chance of hospitalization or death incidents. Explainability analysis showed DeepHHF focused on arrhythmias and heart abnormalities. This study highlights the feasibility of deep learning to model 24-hour continuous ECG data, capturing paroxysmal events essential for reliable risk prediction. Artificial intelligence applied to single-lead Holter ECG is non-invasive, inexpensive, and widely accessible, making it a promising tool for HF risk prediction.