Joris A. H. de Groot

Joris A. H. de Groot

Auto-generated profile, based on publicly available information

Joris A. H. de Groot

Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands

Research Focus & Metrics

Academic Career Length

19Years (2008-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
14 October 2014 in PLOS Medicine
Verified
Journal Article
Open access
PDF file
KMKarel G. M. Moons
Karel G. M. Moons
JGJoris A. H. de Groot
Joris A. H. de Groot
WBWalter Bouwmeester
Walter Bouwmeester
YVYvonne Vergouwe
Yvonne Vergouwe
SMSusan Mallett
Susan Mallett
GCGary S. Collins
Gary S. Collins
Carl Moons and colleagues provide a checklist and background explanation for critically appraising and extracting data from systematic reviews of prognostic and diagnostic prediction modelling studies. Please see later in the article for the Editors' Summary

19 March 2014 in BMC Medical Research Methodology
Verified
Journal Article
Open access
PDF file
GCGary S Collins
Gary S Collins
JGJoris A de Groot
Joris A de Groot
SDSusan Dutton
Susan Dutton
OOOmar Omar
Omar Omar
MSMilensu Shanyinde
Milensu Shanyinde
DADouglas G Altman
Douglas G Altman
Before considering whether to use a multivariable (diagnostic or prognostic) prediction model, it is essential that its performance be evaluated in data that were not used to develop the model (referred to as external validation). We critically appraised the methodological conduct and reporting of external validation studies of multivariable prediction models. We conducted a systematic review of articles describing some form of external validation of one or more multivariable prediction models indexed in PubMed core clinical journals published in 2010. Study data were extracted in duplicate on design, sample size, handling of missing data, reference to the original study developing the prediction models and predictive performance measures. 11,826 articles were identified and 78 were included for full review, which described the evaluation of 120 prediction models. in participant data that were not used to develop the model. Thirty-three articles described both the development of a prediction model and an evaluation of its performance on a separate dataset, and 45 articles described only the evaluation of an existing published prediction model on another dataset. Fifty-seven percent of the prediction models were presented and evaluated as simplified scoring systems. Sixteen percent of articles failed to report the number of outcome events in the validation datasets. Fifty-four percent of studies made no explicit mention of missing data. Sixty-seven percent did not report evaluating model calibration whilst most studies evaluated model discrimination. It was often unclear whether the reported performance measures were for the full regression model or for the simplified models. The vast majority of studies describing some form of external validation of a multivariable prediction model were poorly reported with key details frequently not presented. The validation studies were characterised by poor design, inappropriate handling and acknowledgement of missing data and one of the most key performance measures of prediction models i.e. calibration often omitted from the publication. It may therefore not be surprising that an overwhelming majority of developed prediction models are not used in practice, when there is a dearth of well-conducted and clearly reported (external validation) studies describing their performance on independent participant data.

24 November 2016 in BMC Medical Research Methodology
Verified
Journal Article
Open access
PDF file
MSMaarten van Smeden
Maarten van Smeden
JGJoris A. H. de Groot
Joris A. H. de Groot
KMKarel G. M. Moons
Karel G. M. Moons
GCGary S. Collins
Gary S. Collins
DADouglas G. Altman
Douglas G. Altman
JRJohannes B. Reitsma
Johannes B. Reitsma
Ten events per variable (EPV) is a widely advocated minimal criterion for sample size considerations in logistic regression analysis. Of three previous simulation studies that examined this minimal EPV criterion only one supports the use of a minimum of 10 EPV. In this paper, we examine the reasons for substantial differences between these extensive simulation studies. The current study uses Monte Carlo simulations to evaluate small sample bias, coverage of confidence intervals and mean square error of logit coefficients. Logistic regression models fitted by maximum likelihood and a modified estimation procedure, known as Firth’s correction, are compared. The results show that besides EPV, the problems associated with low EPV depend on other factors such as the total sample size. It is also demonstrated that simulation results can be dominated by even a few simulated data sets for which the prediction of the outcome by the covariates is perfect (‘separation’). We reveal that different approaches for identifying and handling separation leads to substantially different simulation results. We further show that Firth’s correction can be used to improve the accuracy of regression coefficients and alleviate the problems associated with separation. The current evidence supporting EPV rules for binary logistic regression is weak. Given our findings, there is an urgent need for new research to provide guidance for supporting sample size considerations for binary logistic regression analysis.

21 November 2013 in American Journal of Epidemiology
Verified
Journal Article
Open access
PDF file
MSMaarten van Smeden
Maarten van Smeden
CNChristiana A. Naaktgeboren
Christiana A. Naaktgeboren
JRJohannes B. Reitsma
Johannes B. Reitsma
KMKarel G. M. Moons
Karel G. M. Moons
JGJoris A. H. de Groot
Joris A. H. de Groot
Latent class models (LCMs) combine the results of multiple diagnostic tests through a statistical model to obtain estimates of disease prevalence and diagnostic test accuracy in situations where there is no single, accurate reference standard. We performed a systematic review of the methodology and reporting of LCMs in diagnostic accuracy studies. This review shows that the use of LCMs in such studies increased sharply in the past decade, notably in the domain of infectious diseases (overall contribution: 59%). The 64 reviewed studies used a range of differently specified parametric latent variable models, applying Bayesian and frequentist methods. The critical assumption underlying the majority of LCM applications (61%) is that the test observations must be independent within 2 classes. Because violations of this assumption can lead to biased estimates of accuracy and prevalence, performing and reporting checks of whether assumptions are met is essential. Unfortunately, our review shows that 28% of the included studies failed to report any information that enables verification of model assumptions or performance. Because of the lack of information on model fit and adequate evidence “external” to the LCMs, it is often difficult for readers to judge the validity of LCM-based inferences and conclusions reached.

1 June 2013 in Journal of Thrombosis and Haemostasis
Verified
Journal Article
Closed access
JHJ.M.T. Hendriksen
J.M.T. Hendriksen
GGG.J. Geersing
G.J. Geersing
KMK.G.M. Moons
K.G.M. Moons
JGJ.A.H. de Groot
J.A.H. de Groot

8 September 2017 in eLife
Verified
Journal Article
Open access
PZPetrus Zwetsloot
Petrus Zwetsloot
MNMira Van Der Naald
Mira Van Der Naald
ESEmily S Sena
Emily S Sena
DHDavid W Howells
David W Howells
JIJoanna IntHout
Joanna IntHout
KWKimberley E Wever
Kimberley E Wever
Meta-analyses are increasingly used for synthesis of evidence from biomedical research, and often include an assessment of publication bias based on visual or analytical detection of asymmetry in funnel plots. We studied the influence of different normalisation approaches, sample size and intervention effects on funnel plot asymmetry, using empirical datasets and illustrative simulations. We found that funnel plots of the Standardized Mean Difference (SMD) plotted against the standard error (SE) are susceptible to distortion, leading to overestimation of the existence and extent of publication bias. Distortion was more severe when the primary studies had a small sample size and when an intervention effect was present. We show that using the Normalised Mean Difference measure as effect size (when possible), or plotting the SMD against a sample size-based precision estimate, are more reliable alternatives. We conclude that funnel plots using the SMD in combination with the SE are unsuitable for publication bias assessments and can lead to false-positive results.