Rutger R. van de Leur

Rutger R. van de Leur

Auto-generated profile, based on publicly available information

Rutger R. van de Leur

Department of Cardiology, University Medical Center Utrecht, Utrecht, the Netherlands

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 February 2021 in Circulation: Arrhythmia and Electrophysiology
Verified
Journal Article
Open access
PDF file
RLRutger R. van de Leur
Rutger R. van de Leur
KTKarim Taha
Karim Taha
MBMax N. Bos
Max N. Bos
JHJeroen F. van der Heijden
Jeroen F. van der Heijden
Deepak GuptaDeepak Gupta
Deepak Gupta
RERené van Es
René van Es
Background: ECG interpretation requires expertise and is mostly based on physician recognition of specific patterns, which may be challenging in rare cardiac diseases. Deep neural networks (DNNs) can discover complex features in ECGs and may facilitate the detection of novel features which possibly play a pathophysiological role in relatively unknown diseases. Using a cohort of PLN (phospholamban) p.Arg14del mutation carriers, we aimed to investigate whether a novel DNN-based approach can identify established ECG features, but moreover, we aimed to expand our knowledge on novel ECG features in these patients. Methods: A DNN was developed on 12-lead median beat ECGs of 69 patients and 1380 matched controls and independently evaluated on 17 patients and 340 controls. Differentiating features were visualized using Guided Gradient Class Activation Mapping++. Novel ECG features were tested for their diagnostic value by adding them to a logistic regression model including established ECG features. Results: The DNN showed excellent discriminatory performance with a c-statistic of 0.95 (95% CI, 0.91–0.99) and sensitivity and specificity of 0.82 and 0.93, respectively. Visualizations revealed established ECG features (low QRS voltages and T-wave inversions), specified these features (eg, R- and T-wave attenuation in V2/V3) and identified novel PLN-specific ECG features (eg, increased PR-duration). The logistic regression baseline model improved significantly when augmented with the identified features ( P <0.001). Conclusions: A DNN-based feature detection approach was able to discover and visualize disease-specific ECG features in PLN mutation carriers and revealed yet unidentified features. This novel approach may help advance diagnostic capabilities in daily practice.

7 November 2022 in European Heart Journal
Verified
Journal Article
Open access
PDF file
PWPhilippe C Wouters
Philippe C Wouters
RLRutger R van de Leur
Rutger R van de Leur
MVMelle B Vessies
Melle B Vessies
ASAntonius M.W. Van Stipdonk
Antonius M.W. Van Stipdonk
MGMohammed Ali Ghossein
Mohammed Ali Ghossein
RERené van Es
René van Es
This study aims to identify and visualize electrocardiogram (ECG) features using an explainable deep learning–based algorithm to predict cardiac resynchronization therapy (CRT) outcome. Its performance is compared with current guideline ECG criteria and QRSAREA. A deep learning algorithm, trained on 1.1 million ECGs from 251 473 patients, was used to compress the median beat ECG, thereby summarizing most ECG features into only 21 explainable factors (FactorECG). Pre-implantation ECGs of 1306 CRT patients from three academic centres were converted into their respective FactorECG. FactorECG predicted the combined clinical endpoint of death, left ventricular assist device, or heart transplantation [c-statistic 0.69, 95% confidence interval (CI) 0.66–0.72], significantly outperforming QRSAREA and guideline ECG criteria [c-statistic 0.61 (95% CI 0.58–0.64) and 0.57 (95% CI 0.54–0.60), P < 0.001 for both]. The addition of 13 clinical variables was of limited added value for the FactorECG model when compared with QRSAREA (Δ c-statistic 0.03 vs. 0.10). FactorECG identified inferolateral T-wave inversion, smaller right precordial S- and T-wave amplitude, ventricular rate, and increased PR interval and P-wave duration to be important predictors for poor outcome. An online visualization tool was created to provide interactive visualizations (https://crt.ecgx.ai). Requiring only a standard 12-lead ECG, FactorECG held superior discriminative ability for the prediction of clinical outcome when compared with guideline criteria and QRSAREA, without requiring additional clinical variables. End-to-end automated visualization of ECG features allows for an explainable algorithm, which may facilitate rapid uptake of this personalized decision-making tool in CRT. First, an artificial intelligence algorithm (variational auto-encoder) was pretrained on 1.1 million electrocardiograms (ECGs) to learn the underlying continuous factors that generate the ECG (i.e. the FactorECG). In this process, the variational auto-encoder (VAE) learns to reconstruct ECGs as accurately as possible using only 21 continuous factors without any human input. In the training phase, the pre-procedural median beat ECGs of 1306 cardiac resynchronization therapy (CRT) patients were each converted into their FactorECG. These 21 factors were subsequently used as input in a Cox model to predict the primary composite endpoint of left ventricular assist device implantation, heart transplantation and all-cause death, and the secondary endpoint of echocardiographic response. FactorECG significantly improved outcome prediction following CRT when compared with the current guidelines and QRSAREA. The algorithm is explainable by using the decoder to visualize the effect of the ECG factors that significantly predicted outcome on the median beat ECG morphology. Here, for example, the influence of Factor 9 (F9) is visualized, where higher values represent a more left bundle branch block-like ECG morphology and lower values, a more right bundle branch block-like morphology. CRT, cardiac resynchronization therapy; DNN, deep neural network; ECG, electrocardiogram; HTx, heart transplantation; LVAD, left ventricular assist device.

8 May 2021 in European Heart Journal - Digital Health
Verified
Journal Article
Open access
PDF file
JVJeroen F Vranken
Jeroen F Vranken
RLRutger R van de Leur
Rutger R van de Leur
DGDeepak K Gupta
Deepak K Gupta
LOLuis E Juarez Orozco
Luis E Juarez Orozco
RHRutger J Hassink
Rutger J Hassink
RERené van Es
René van Es
Automated interpretation of electrocardiograms (ECGs) using deep neural networks (DNNs) has gained much attention recently. While the initial results have been encouraging, limited attention has been paid to whether such results can be trusted, which is paramount for their clinical implementation. This study aims to systematically investigate uncertainty estimation techniques for automated classification of ECGs using DNNs and to gain insight into its utility through a clinical simulation. On a total of 526 656 ECGs from three different datasets, six different methods for estimation of aleatoric and epistemic uncertainty were systematically investigated. The methods were evaluated based on ranking, calibration, and robustness against out-of-distribution data. Furthermore, a clinical simulation was performed where increasing uncertainty thresholds were applied to achieve a clinically acceptable performance. Finally, the correspondence between the uncertainty of ECGs and the lack of interpretational agreement between cardiologists was estimated. Results demonstrated the largest benefit when modelling both epistemic and aleatoric uncertainty. Notably, the combination of variational inference with Bayesian decomposition and ensemble with auxiliary output outperformed the other methods. The clinical simulation showed that the accuracy of the algorithm increased as uncertain predictions were referred to the physician. Moreover, high uncertainty in DNN-based ECG classification strongly corresponded with a lower diagnostic agreement in cardiologist’s interpretation (P < 0.001). Uncertainty estimation is warranted in automated DNN-based ECG classification and its accurate estimation enables intermediate quality control in the clinical implementation of deep learning. This is an important step towards the clinical applicability of automated ECG diagnosis using DNNs.

23 February 2024 in Heart Rhythm
Verified
Journal Article
Open access
RLRutger R. van de Leur
Rutger R. van de Leur
RBRemco de Brouwer
Remco de Brouwer
HBHidde Bleijendaal
Hidde Bleijendaal
TVTom E. Verstraelen
Tom E. Verstraelen
BMBelend Mahmoud
Belend Mahmoud
RERené van Es
René van Es
Phospholamban (PLN) p.(Arg14del) variant carriers are at risk of developing malignant ventricular arrhythmias (MVA). Accurate risk stratification allows for timely implantation of intracardiac defibrillators (ICD) and is currently performed using a multimodality prediction model. This study aims to investigate whether an explainable deep learning-based approach allows for risk prediction using only electrocardiogram (ECG) data. A total of 679 PLN p.(Arg14del) carriers without MVA at baseline were identified. A deep learning-based variational auto-encoder, trained on 1.1 million ECGs, was used to convert the 12-lead baseline ECG into its FactorECG, a compressed version of the ECG which summarizes it into 32 explainable factors. Prediction models were developed using Cox regression. The deep learning-based ECG-only approach was able to predict MVA with a c-statistic of 0.79 [95% CI 0.76 - 0.83], comparable to the current prediction model (c-statistic 0.83 [95% CI 0.79 - 0.88], p = 0.064) and outperforming a model based on conventional ECG parameters (low voltage ECG and negative T waves; c-statistic 0.65 [95% CI 0.58 - 0.73], p < 0.001). Clinical simulations showed that a two-step approach, with ECG-only screening followed by a full work-up, resulted in 60% less additional diagnostics, while outperforming the use of the multimodal prediction model in all patients. A visualization tool was created to provide interactive visualizations (https://pln.ecgx.ai). Our deep learning-based algorithm based on ECG data only accurately predicts the occurrence of MVA in PLN p.(Arg14del) carriers, enabling more efficient stratification of patients that need additional diagnostic testing and follow-up.

7 July 2023 in JMIR Cardio
Verified
Journal Article
Open access
AZAlejandra Zepeda-Echavarria
Alejandra Zepeda-Echavarria
RLRutger R van de Leur
Rutger R van de Leur
MSMeike van Sleuwen
Meike van Sleuwen
RHRutger J Hassink
Rutger J Hassink
TWThierry X Wildbergh
Thierry X Wildbergh
RERené van Es
René van Es
Background: Electrocardiograms (ECGs) are used by physicians to record, monitor, and diagnose the electrical activity of the heart. Recent technological advances have allowed ECG devices to move out of the clinic and into the home environment. There is a great variety of mobile ECG devices with the capabilities to be used in home environments. Objective: This scoping review aimed to provide a comprehensive overview of the current landscape of mobile ECG devices, including the technology used, intended clinical use, and available clinical evidence. Methods: We conducted a scoping review to identify studies concerning mobile ECG devices in the electronic database PubMed. Secondarily, an internet search was performed to identify other ECG devices available in the market. We summarized the devices’ technical information and usability characteristics based on manufacturer data such as datasheets and user manuals. For each device, we searched for clinical evidence on the capabilities to record heart disorders by performing individual searches in PubMed and ClinicalTrials.gov, as well as the Food and Drug Administration (FDA) 510(k) Premarket Notification and De Novo databases. Results: From the PubMed database and internet search, we identified 58 ECG devices with available manufacturer information. Technical characteristics such as shape, number of electrodes, and signal processing influence the capabilities of the devices to record cardiac disorders. Of the 58 devices, only 26 (45%) had clinical evidence available regarding their ability to detect heart disorders such as rhythm disorders, more specifically atrial fibrillation. Conclusions: ECG devices available in the market are mainly intended to be used for the detection of arrhythmias. No devices are intended to be used for the detection of other cardiac disorders. Technical and design characteristics influence the intended use of the devices and use environments. For mobile ECG devices to be intended to detect other cardiac disorders, challenges regarding signal processing and sensor characteristics should be solved to increase their detection capabilities. Devices recently released include the use of other sensors on ECG devices to increase their detection capabilities.

21 March 2022 in European Heart Journal - Digital Health
Verified
Journal Article
Open access
PDF file
KSKlaske R Siegersma
Klaske R Siegersma
RLRutger R van de Leur
Rutger R van de Leur
NON Charlotte Onland-Moret
N Charlotte Onland-Moret
DLDavid A Leon
David A Leon
EDErnest Diez-Benavente
Ernest Diez-Benavente
RERené van Es
René van Es
Aims: Incorporation of sex in study design can lead to discoveries in medical research. Deep neural networks (DNNs) accurately predict sex based on the electrocardiogram (ECG) and we hypothesized that misclassification of sex is an important predictor for mortality. Therefore, we first developed and validated a DNN that classified sex based on the ECG and investigated the outcome. Second, we studied ECG drivers of DNN-classified sex and mortality. Methods and results: A DNN was trained to classify sex based on 131 673 normal ECGs. The algorithm was validated on internal (68 500 ECGs) and external data sets (3303 and 4457 ECGs). The survival of sex (mis)classified groups was investigated using time-to-event analysis and sex-stratified mediation analysis of ECG features. The DNN successfully distinguished female from male ECGs {internal validation: area under the curve (AUC) 0.96 [95% confidence interval (CI): 0.96, 0.97]; external validations: AUC 0.89 (95% CI: 0.88, 0.90), 0.94 (95% CI: 0.93, 0.94)}. Sex-misclassified individuals (11%) had a 1.4 times higher mortality risk compared with correctly classified peers. The ventricular rate was the strongest mediating ECG variable (41%, 95% CI: 31%, 56%) in males, while the maximum amplitude of the ST segment was strongest in females (18%, 95% CI: 11%, 39%). Short QRS duration was associated with higher mortality risk. Conclusion: Deep neural networks accurately classify sex based on ECGs. While the proportion of ECG-based sex misclassifications is low, it is an interesting biomarker. Investigation of the causal pathway between misclassification and mortality uncovered new ECG features that might be associated with mortality. Increased emphasis on sex as a biological variable in artificial intelligence is warranted.