Sjoerd de Vries

Sjoerd de Vries

Auto-generated profile, based on publicly available information

Sjoerd de Vries

Department of Information and Computing Sciences, Utrecht University, Utrecht, The Netherlands

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
8 May 2024 in Journal of Clinical Epidemiology
Verified
Journal Article
Open access
HRHannah M. la Roi-Teeuw
Hannah M. la Roi-Teeuw
FRFlorien S. van Royen
Florien S. van Royen
AHAnne De Hond
Anne De Hond
AZAnum Zahra
Anum Zahra
SVSjoerd de Vries
Sjoerd de Vries
KLKim Luijken
Kim Luijken
Clinical prediction models provide risks of health outcomes that can inform patients and support medical decisions. However, most models never make it to actual implementation in practice. A commonly heard reason for this lack of implementation is that prediction models are often not externally validated. While we generally encourage external validation, we argue that an external validation is often neither sufficient nor required as an essential step before implementation. As such, any available external validation should not be perceived as a license for model implementation. We clarify this argument by discussing 3 common misconceptions about external validation. We argue that there is not one type of recommended validation design, not always a necessity for external validation, and sometimes a need for multiple external validations. The insights from this paper can help readers to consider, design, interpret, and appreciate external validation studies.

19 May 2022 in Computers in Biology and Medicine
Verified
Journal Article
Open access
SVSjoerd de Vries
Sjoerd de Vries
TDThijs Ten Doesschate
Thijs Ten Doesschate
JTJoan E.E. Totté
Joan E.E. Totté
JHJudith W. Heutz
Judith W. Heutz
YLYvette G.T. Loeffen
Yvette G.T. Loeffen
EBEdwin Boel
Edwin Boel
Urinary Tract Infections (UTIs) are among the most frequently occurring infections in the hospital. Urinalysis and urine culture are the main tools used for diagnosis. Whereas urinalysis is sufficiently sensitive for detecting UTI, it has a relatively low specificity, leading to unnecessary treatment with antibiotics and the risk of increasing antibiotic resistance. We performed an evaluation of the current diagnostic process with an expert-based label for UTI as outcome, retrospectively established using data from the Electronic Health Records. We found that the combination of urinalysis results with the Gram stain and other readily available parameters can be used effectively for predicting UTI. Based on the obtained information, we engineered a clinical decision support system (CDSS) using the reliable semi-supervised ensemble learning (RESSEL) method, and found it to be more accurate than urinalysis or the urine culture for prediction of UTI. The CDSS provides clinicians with this prediction within hours of ordering a culture and thereby enables them to hold off on prematurely prescribing antibiotics for UTI while awaiting the culture results.

28 October 2024 in The Journal of Pathology: Clinical Research
Verified
Journal Article
Open access
NSNikolas Stathonikos
Nikolas Stathonikos
MAMarc Aubreville
Marc Aubreville
SVSjoerd de Vries
Sjoerd de Vries
FWFrauke Wilm
Frauke Wilm
CBChristof Albert Bertram
Christof Albert Bertram
PDPaul J van Diest
Paul J van Diest
Mitotic count (MC) is the most common measure to assess tumor proliferation in breast cancer patients and is highly predictive of patient outcomes. It is, however, subject to inter‐ and intraobserver variation and reproducibility challenges that may hamper its clinical utility. In past studies, artificial intelligence (AI)‐supported MC has been shown to correlate well with traditional MC on glass slides. Considering the potential of AI to improve reproducibility of MC between pathologists, we undertook the next validation step by evaluating the prognostic value of a fully automatic method to detect and count mitoses on whole slide images using a deep learning model. The model was developed in the context of the Mitosis Domain Generalization Challenge 2021 (MIDOG21) grand challenge and was expanded by a novel automatic area selector method to find the optimal mitotic hotspot and calculate the MC per 2 mm2. We employed this method on a breast cancer cohort with long‐term follow‐up from the University Medical Centre Utrecht (N = 912) and compared predictive values for overall survival of AI‐based MC and light‐microscopic MC, previously assessed during routine diagnostics. The MIDOG21 model was prognostically comparable to the original MC from the pathology report in uni‐ and multivariate survival analysis. In conclusion, a fully automated MC AI algorithm was validated in a large cohort of breast cancer with regard to retained prognostic value compared with traditional light‐microscopic MC.

14 May 2025 in International Journal of Data Science and Analytics
Verified
Journal Article
Open access
PDF file
SVSjoerd de Vries
Sjoerd de Vries
DTDirk Thierens
Dirk Thierens
In many real-world classification tasks, label noise is an unavoidable issue that adversely affects the generalization error of machine learning models. Additionally, evaluating how methods handle such noise is complicated, as the effect label noise has on their performance cannot be accurately quantified without clean labels. Existing research on label noise typically relies on either noisy or oversimplified simulated data as a baseline, into which additional noise with known properties is injected. In this paper, we introduce SYNLABEL, a framework designed to address these limitations by creating noiseless datasets informed by real-world data. SYNLABEL supports defining a pre-specified or learned function as the ground truth function, which can then be used for generating new clean labels. Furthermore, by repeatedly resampling values for selected features within the domain of the function, evaluating the function and aggregating the resulting labels, each data point can be assigned a soft label or label distribution. These distributions capture the inherent uncertainty present in many real-world datasets and enable the direct injection and quantification of label noise. The generated datasets serve as a clean baseline of adjustable complexity, into which various types of noise can be introduced. Additionally, they facilitate research into soft label learning and related applications. We demonstrate the application of SYNLABEL, showcasing its ability to precisely quantify label noise and its improvement over existing methodologies.

1 May 2025 in Digital Health
Verified
Journal Article
Open access
CLCarlos de Miguel Llorente
Carlos de Miguel Llorente
SVSjoerd de Vries
Sjoerd de Vries
PBPetra Bor
Petra Bor
LVLaura Veerhoek
Laura Veerhoek
JBJan Willem Van de Berg
Jan Willem Van de Berg
KVKarin Valkenet
Karin Valkenet
Background: Early detection of postsurgical complications is critical for improving surgical outcomes, yet current monitoring methods are invasive, time-consuming, and may delay intervention. Advances in machine learning (ML) and artificial intelligence (AI) enable using real-time data, such as accelerometer-derived physical activity, as potential early warning signs. This exploratory study evaluated whether activity trends can predict postsurgical complications in oncology patients using ML models. Methods: Usual care data from a surgical oncology ward (October 2020–December 2024) were analyzed. Three classifiers were evaluated—Random Forest (RF), eXtreme Gradient Boosting (XGB), and Logistic Regression (LR)—within a nested cross-validation framework. Two modeling strategies were compared: (1) training/testing without undersampling and (2) training with undersampling at varying factors to balance complication versus noncomplication days. Models were assessed for next-day complication prediction using area under the ROC curve (AUC), precision, recall, and F1-score with bootstrap confidence intervals. Results: Data were collected from 965 patients, of whom 189 were included. The best performance for RF was observed at an undersampling factor of 1 (AUC = 0.66, 95% confidence interval (CI) 0.64–0.67; recall = 0.63, 95% CI 0.27–0.91; precision = 0.05, 95% CI 0.03–0.07). LR achieved its highest AUC without undersampling (0.68, 95% CI 0.67–0.69), while XGB performed consistently lower (AUC ≈ 0.63–0.64). Conclusions: This exploratory study showed that postoperative activity trends alone were insufficient to predict complications after major oncological surgery. Combining accelerometer, physiological, and laboratory data may improve predictive accuracy and overall clinical value in perioperative care.

24 September 2024 in arXiv
Verified
Preprint
Open access
PDF file
SVSjoerd de Vries
Sjoerd de Vries
DTDirk Thierens
Dirk Thierens
In supervised machine learning, models are typically trained using data with hard labels, i.e., definite assignments of class membership. This traditional approach, however, does not take the inherent uncertainty in these labels into account. We investigate whether incorporating label uncertainty, represented as discrete probability distributions over the class labels -- known as soft labels -- improves the predictive performance of classification models. We first demonstrate the potential value of soft label learning (SLL) for estimating model parameters in a simulation experiment, particularly for limited sample sizes and imbalanced data. Subsequently, we compare the performance of various wrapper methods for learning from both hard and soft labels using identical base classifiers. On real-world-inspired synthetic data with clean labels, the SLL methods consistently outperform hard label methods. Since real-world data is often noisy and precise soft labels are challenging to obtain, we study the effect that noisy probability estimates have on model performance. Alongside conventional noise models, our study examines four types of miscalibration that are known to affect human annotators. The results show that SLL methods outperform the hard label methods in the majority of settings. Finally, we evaluate the methods on a real-world dataset with confidence scores, where the SLL methods are shown to match the traditional methods for predicting the (noisy) hard labels while providing more accurate confidence estimates.