Elfi M. Verheul

Elfi M. Verheul

Auto-generated profile, based on publicly available information

Elfi M. Verheul

Center for Medical Decision Making, Department of Public Health, Erasmus University Medical Center, Rotterdam, The Netherlands.

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
30 December 2024 in BJS Open
Verified
Journal Article
Open access
EVElfi M Verheul
Elfi M Verheul
DKDavid van Klaveren
David van Klaveren
HLHester F Lingsma
Hester F Lingsma
EVElvira Vos
Elvira Vos
MHMarije J Hoornweg
Marije J Hoornweg
YVYvonne L J Vissers
Yvonne L J Vissers
Background: Comparison of quality indicators can improve quality of care. However, case-mix adjustment is deemed essential. The aim of this study was to develop and validate case-mix adjustment models and to evaluate the effect of case-mix adjustment for the quality indicators related to complications after breast cancer surgery. Methods: Multivariable logistic regression with backward selection (P < 0.1) was used to develop case-mix models in patients undergoing breast cancer surgery (all types, breast-conserving surgery, mastectomy with or without immediate reconstruction) in the Netherlands (NABON Breast Cancer Audit). High-impact complications were defined as Clavien Dindo grade ≥3. Model performance was assessed using the area under the receiver operating characteristic curve (AUC), corrected for optimism with bootstrap validation. Observed-to-expected plots were used to visualize the difference between unadjusted and case-mix adjusted hospital performance (hospital shifts). Results: In total 32 084 patients from 72 hospitals treated in 2021–2022 were included. A between-hospital variation in complication rates was observed for all surgeries (interquartile range 2.4–6.0%), breast-conserving surgery (interquartile range 1.4–3.4%), and mastectomy with (interquartile range 9.4–9.1%) and without reconstruction (interquartile range 3.3–9.7%). Of the considered variables, body mass index, smoking, multifocality and neoadjuvant therapy were weakly associated with complications. However, surgery type was strongly related to complications (AUC 0.70), resulting in noticeable hospital shifts in the quality indicator scores comprising all surgeries. After stratification for surgery type, no evident hospital shifts were observed after case-mix correction. Conclusion: For valid comparison of complication rates after breast cancer surgery between hospitals, stratification by surgery type is crucial. Subsequently, the evaluated patient and tumour characteristics have a negligible effect on the hospital variation.

1 October 2025 in International Journal of Health Policy and Management
Verified
Journal Article
Closed access
EVElfi M. Verheul
Elfi M. Verheul
MLMargrietha van der Linde
Margrietha van der Linde
HLHester F. Lingsma
Hester F. Lingsma
EVElvira Vos
Elvira Vos
SSSabine Siesling
Sabine Siesling
LKLinetta B. Koppert
Linetta B. Koppert
Background: Quality indicators (QIs) are widely used to benchmark hospital performance and improve quality of care but are often based on expert opinion rather than data-driven assessment. This study aims to evaluate QIs, using a framework that assesses four criteria: Feasibility, discriminative ability, validity, and reliability. Methods: We used data from the Dutch breast cancer registry (NABON Breast Cancer Audit, NBCA) and included all surgically treated breast cancer patients in the Netherlands between 2021-2023. Eighteen QIs were evaluated. Feasibility was determined by QI numerator completeness, with >90% data availability considered feasible. Discriminative ability was assessed by between-hospital variation in QI scores, where an interquartile range (IQR) >10% indicated good discrimination. Validity was evaluated by the impact of case-mix adjustment and considered low when (pseudo-) R² 75% was considered high. Results: After exclusion of one QI with feasibility <1%, feasibility ranged from 80.2%-100%, and 15 QIs were feasible. Overall, the IQR ranged from 1 to 36, with 8 QIs having an IQR higher than 10, indicating good discriminative ability. The (pseudo-)R² ranged from 0.01-0.53, with 11 QIs showing low case-mix impact. Rankability ranged from 0-69%, with none of the QIs having a high rankability. None of the QIs met all preset criteria, but six QIs met at least three out of four criteria. Conclusion: The QIs employed by the Dutch breast cancer registry fulfilled most criteria, but rankability is a concern and requires specific attention, especially for public reporting. Our results show the importance of considering feasibility, discriminative ability, validity, and reliability when evaluating QIs, and these should also be taken into account when developing new QIs.

16 December 2025 in The Breast
Verified
Journal Article
Open access
LVLara W.A. Vreven
Lara W.A. Vreven
EVElfi M. Verheul
Elfi M. Verheul
MMMarissa C. van Maaren
Marissa C. van Maaren
FDFrank Doornkamp
Frank Doornkamp
RSRobert-Jan Schipper
Robert-Jan Schipper
AVAdri C. Voogd
Adri C. Voogd
PREDICT Breast is a clinical decision-support tool estimating prognosis and the absolute benefit of adjuvant systemic therapies in early breast cancer. PREDICT v2.2 is recommended in Dutch guidelines. Both v2.2 and the recently updated v3.1 have not been validated in the Dutch population. This study compares the predictive performance of PREDICT v3.1 and v2.2 for 10-year OS in Dutch breast cancer patients. Women diagnosed between 2005 and 2013 with primary invasive breast cancer were selected from the Netherlands Cancer Registry. Ten-year OS predictions from v2.2 and v3.1 were compared with observed OS for the overall cohort and 36 subgroups defined by oestrogen receptor (ER) status, HER2-status, age, and tumour stage. Discrimination (ability to distinguish patients with different outcomes) and calibration (agreement between predicted and observed outcomes) of both models were assessed. Among 101,282 patients, both versions showed moderate discrimination (AUC v2.2 = 0.768; v3.1 = 0.775) and calibration (v2.2 intercept: 0.07; slope: 1.09; v3.1 intercept: 0.12, slope: 1.00). V3.1 slightly overestimated (1.9%), whereas v2.2 slightly underestimated (1.6%) 10-year OS. Across subgroups, v3.1 generally outperformed v2.2 except in patients aged >75 years, where v2.2 provided more accurate estimates. In ER-/HER- patients aged 50-75 years, v3.1 overestimated (1.5-2.8%) and v2.2 underestimated (2.8-5.3%) 10-year OS. Both PREDICT v2.2 and v3.1 accurately predict 10-year OS in Dutch breast cancer patients, with small differences between versions that vary by subgroup. No single model is optimal for all patients highlighting the need for subgroup-specific recalibration and careful interpretation when applying PREDICT.

17 April 2026 in Breast Cancer Research and Treatment
Verified
Journal Article
Open access
EVElfi M. Verheul
Elfi M. Verheul
FDFrank Doornkamp
Frank Doornkamp
IPIurii Petrov
Iurii Petrov
SSSabine Siesling
Sabine Siesling
HLHester F. Lingsma
Hester F. Lingsma
TPTeresa Puértolas
Teresa Puértolas
Purpose: PREDICT Breast is an online tool that provides survival predictions for patients with early-stage breast cancer, for different treatments after surgery. External validation is essential to assess model performance across populations and healthcare settings. We aimed to externally validate PREDICT using clinical practice data from the Netherlands, Sweden, and Slovenia. Methods: We validated PREDICT in national populations ( Netherlands, N = 221,636; Sweden, N = 84,928) and in two specific subgroups: patients with invasive lobular breast cancer (ILC) (Netherlands, N = 26,834; Sweden, N = 10,563; Slovenia, N = 341) and patients aged ≤ 40 years (Netherlands, N = 9995; Sweden, N = 2694) . We assessed discrimination with the 10-year area under the curve (AUC) and calibration of 10-year mortality predictions through calibration plots, intercepts and slopes. Results: PREDICT v3.1 discriminated well in the national populations (Netherlands AUC 0.75, 95% CI 0.75–0.76; Sweden 0.75, 95% CI 0.75–0.76), with similar discrimination in ILC patients (Netherlands 0.76, 95% CI 0.74–0.76; Sweden 0.75, 95% CI 0.73–0.77; Slovenia 0.78, 95% CI 0.71–0.83). Calibration showed slight underestimation of mortality risk in the Netherlands (intercept 0.13; slope 1.01), and was near perfect in the Swedish population (intercept 0.04; slope 1.05). Amongst ILC patients, we observed some underestimation of mortality (Netherlands intercept 0.20; Sweden intercept 0.10; Slovenia intercept 0.02). In young patients, miscalibration was observed (Netherlands, intercept 0.21, slope 0.79; Sweden, intercept 0.08, slope 0.85). Conclusion: PREDICT v3.1 is generally well calibrated and suitable for clinical use in the evaluated European populations. Efforts to improve PREDICT should focus on more accurate predictions for younger patients.

10 February 2026 in European Journal of Surgical Oncology
Verified
Journal Article
Open access
EVElfi M. Verheul
Elfi M. Verheul
MKMaria Margarete Karsten
Maria Margarete Karsten
PGPimrapat Gebert
Pimrapat Gebert
LDLea Doppelbauer
Lea Doppelbauer
SBSimona Borstnar
Simona Borstnar
MWMichel W. Wouters
Michel W. Wouters
Predictions of Health-Related Quality of Life (HRQoL) outcomes could support realistic recovery expectations after breast cancer (BC) surgery. We aimed to develop and validate prediction models for HRQoL outcomes after BC surgery. We used three datasets of BC patients from Berlin, Germany; Ljubljana, Slovenia; and Rotterdam; Netherlands. We included non-metastasised patients who were surgically treated for an initial diagnosis of BC and completed pre- and postoperative validated questionnaires. We used linear mixed models to analyse 15 domains of the EORTC QLQ-C30 and EORTC QLQ-BR23 over a two-year horizon. Baseline domain score (measured pre-operatively), age, BMI, smoking, TN stage, receptor status, neoadjuvant chemotherapy, axillary surgery and surgery type (breast-conserving, mastectomy, and immediate implant-based reconstruction) were included as predictors. Predictive performance at validation was assessed by the proportion of variance explained (marginal R2; mR2). We included N = 795 patients from Germany for development and N = 623 from Slovenia and N = 417 from Netherlands for validation. The largest proportion of variance was explained by the prediction models for sexual functioning (SF, mR2 35%), physical functioning (PF, mR2 29%), body image (BI, mR2 26%), and cognitive functioning (CF, mR2 25%). The models captured meaningfully different trends over time for different outcomes and surgery types. The predictive performance of the models was largely driven by the baseline domain score. Performance was reasonable at external validation, with r2 values of 19-33% for PF, 10-17% for CF, 15-18% for BI, and 22-28% for SF, although some other outcomes (e.g. breast symptoms and role functioning) showed miscalibration, indicating a need for recalibration. HRQoL after breast cancer surgery can be predicted using simple models with baseline domain scores and surgery type, demonstrating a new opportunity for Patient-Reported Outcome Measures (PROMs) in personalized care.

30 December 2021 in HAND
Verified
Journal Article
Open access
PDF file
KOKamilcan Oflazoglu
Kamilcan Oflazoglu
EVElfi M. Verheul
Elfi M. Verheul
TPTaylor M. Pong
Taylor M. Pong
MRMarco J. F. P. Ritt
Marco J. F. P. Ritt
HRHinne Rakhorst
Hinne Rakhorst
NCNeal C. Chen
Neal C. Chen
Background: The aim was to determine the threshold Quick Disabilities of the Arm, Shoulder, and Hand (QuickDASH) score that estimates a diagnosis of major depression in patients with fingertip injuries in American and Dutch patients. Methods: In this observational cross-sectional study, 112 patients with a recent fingertip injury measured symptoms of depression with the Patient Health Questionnaire and upper extremity disability with the QuickDASH. Results: In the US cohort, 8 of 56 patients had an estimated diagnosis of major depression. A threshold value of QuickDASH of 50 showed a sensitivity of 88% and a specificity of 81%, with a negative predicting value (NPV) of 95% for an estimated diagnosis of major depression. In the Dutch cohort, 7 of 56 patients had an estimated diagnosis of major depression. The same threshold score of 50 had a sensitivity of 71%, a specificity of 63%, and an NPV of 94%. Conclusions: We have found a correlation between experienced loss of function and an estimated diagnosis of major depression in patients with a fingertip injury. Referral to the primary care physician for further evaluation of depression in these patients is advised.