Joie Ensor
Auto-generated profile, based on publicly available information

Joie Ensor

Department of Applied Health Sciences, School of Health Sciences, College of Medicine and Health, University of Birmingham, Birmingham, UK

Research Focus & Metrics

Academic Career Length

14Years (2013-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
18 March 2020 in BMJ
Verified
Journal Article
Closed access
PDF file
RRRichard D Riley
Richard D Riley
JEJoie Ensor
Joie Ensor
KSKym I E Snell
Kym I E Snell
FHFrank E Harrell
Frank E Harrell
GMGlen P Martin
Glen P Martin
MSMaarten van Smeden
Maarten van Smeden
Clinical prediction models aim to predict outcomes in individuals, to inform diagnosis or prognosis in healthcare. Hundreds of prediction models are published in the medical literature each year, yet many are developed using a dataset that is too small for the total number of participants or outcome events. This leads to inaccurate predictions and consequently incorrect healthcare decisions for some individuals. In this article, the authors provide guidance on how to calculate the sample size required to develop a clinical prediction model.

24 October 2018 in Statistics in Medicine
Verified
Journal Article
Open access
PDF file
RRRichard D Riley
Richard D Riley
KSKym Ie Snell
Kym Ie Snell
JEJoie Ensor
Joie Ensor
DBDanielle L Burke
Danielle L Burke
FJFrank E Harrell Jr
Frank E Harrell Jr
GCGary S Collins
Gary S Collins
When designing a study to develop a new prediction model with binary or time‐to‐event outcomes, researchers should ensure their sample size is adequate in terms of the number of participants (n) and outcome events (E) relative to the number of predictor parameters (p) considered for inclusion. We propose that the minimum values ofnandE(and subsequently the minimum number of events per predictor parameter, EPP) should be calculated to meet the following three criteria: (i) small optimism in predictor effect estimates as defined by a global shrinkage factor of≥0.9, (ii) small absolute difference of≤0.05 in the model's apparent and adjusted Nagelkerke'sR2, and (iii) precise estimation of the overall risk in the population. Criteria (i) and (ii) aim to reduce overfitting conditional on a chosenp, and require prespecification of the model's anticipated Cox‐SnellR2, which we show can be obtained from previous studies. The values ofnandEthat meet all three criteria provides the minimum sample size required for model development. Upon application of our approach, a new diagnostic model for Chagas disease requires an EPP of at least 4.8 and a new prognostic model for recurrent venous thromboembolism requires an EPP of at least 23. This reinforces why rules of thumb (eg, 10 EPP) should be avoided. Researchers might additionally ensure the sample size gives precise estimates of key predictor effects; this is especially important when key categorical predictors have few events in some categories, as this may substantially increase the numbers required.

30 January 2019 in BMJ
Verified
Journal Article
Closed access
PDF file
RRRichard D Riley
Richard D Riley
KMKarel G M Moons
Karel G M Moons
KSKym I E Snell
Kym I E Snell
JEJoie Ensor
Joie Ensor
LHLotty Hooft
Lotty Hooft
TDThomas P. Debray
Thomas P. Debray
Prognostic factors are associated with the risk of future health outcomes in individuals with a particular health condition or some clinical start point (eg, a particular diagnosis). Research to identify genuine prognostic factors is important because these factors can help improve risk stratification, treatment, and lifestyle decisions, and the design of randomised trials. Although thousands of prognostic factor studies are published each year, often they are of variable quality and the findings are inconsistent. Systematic reviews and meta-analyses are therefore needed that summarise the evidence about the prognostic value of particular factors. In this article, the key steps involved in this review process are described.

5 January 2017 in BMJ
Verified
Journal Article
Closed access
PDF file
TDThomas P. Debray
Thomas P. Debray
JDJohanna A A G Damen
Johanna A A G Damen
KSKym I E Snell
Kym I E Snell
JEJoie Ensor
Joie Ensor
LHLotty Hooft
Lotty Hooft
KMKarel G M Moons
Karel G M Moons
Validation of prediction models is highly recommended and increasingly common in the literature. A systematic review of validation studies is therefore helpful, with meta-analysis needed to summarise the predictive performance of the model being validated across different settings and populations. This article provides guidance for researchers systematically reviewing and meta-analysing the existing evidence on a specific prediction model, discusses good practice when quantitatively summarising the predictive performance of the model across studies, and provides recommendations for interpreting meta-analysis estimates of model performance. We present key steps of the meta-analysis and illustrate each step in an example review, by summarising the discrimination and calibration performance of the EuroSCORE for predicting operative mortality in patients undergoing coronary artery bypass grafting. #### Summary points Systematic reviews and meta-analysis are an important—if not the most important—source of information for evidence based medicine.1 Traditionally, they aim to summarise the results of publications or reports of primary treatment studies and (more recently) of primary diagnostic test accuracy studies. Compared to therapeutic intervention and diagnostic test accuracy studies, there is limited guidance on the conduct of systematic reviews and meta-analysis of primary prognosis studies. A common aim of primary prognostic studies concerns the development of so-called prognostic prediction models or indices. These models estimate the individualised probability or risk that a certain condition will occur in the future by combining information from multiple prognostic factors from an individual. Unfortunately, there is often …

22 June 2016 in BMJ
Verified
Journal Article
Open access
PDF file
RRRichard D Riley
Richard D Riley
JEJoie Ensor
Joie Ensor
KSKym I E Snell
Kym I E Snell
TDThomas P. Debray
Thomas P. Debray
DADoug G Altman
Doug G Altman
GCGary S Collins
Gary S Collins
Access to big datasets from e-health records and individual participant data (IPD) meta-analysis is signalling a new advent of external validation studies for clinical prediction models. In this article, the authors illustrate novel opportunities for external validation in big, combined datasets, while drawing attention to methodological challenges and reporting issues.

16 October 2016 in Statistics in Medicine
Verified
Journal Article
Open access
PDF file
DBDanielle L. Burke
Danielle L. Burke
JEJoie Ensor
Joie Ensor
RRRichard D. Riley
Richard D. Riley
Meta-analysis using individual participant data (IPD) obtains and synthesises the raw, participant-level data from a set of relevant studies. The IPD approach is becoming an increasingly popular tool as an alternative to traditional aggregate data meta-analysis, especially as it avoids reliance on published results and provides an opportunity to investigate individual-level interactions, such as treatment-effect modifiers. There are two statistical approaches for conducting an IPD meta-analysis: one-stage and two-stage. The one-stage approach analyses the IPD from all studies simultaneously, for example, in a hierarchical regression model with random effects. The two-stage approach derives aggregate data (such as effect estimates) in each study separately and then combines these in a traditional meta-analysis model. There have been numerous comparisons of the one-stage and two-stage approaches via theoretical consideration, simulation and empirical examples, yet there remains confusion regarding when each approach should be adopted, and indeed why they may differ. In this tutorial paper, we outline the key statistical methods for one-stage and two-stage IPD meta-analyses, and provide 10 key reasons why they may produce different summary results. We explain that most differences arise because of different modelling assumptions, rather than the choice of one-stage or two-stage itself. We illustrate the concepts with recently published IPD meta-analyses, summarise key statistical software and provide recommendations for future IPD meta-analyses. © 2016 The Authors. Statistics in Medicine published by John Wiley & Sons Ltd.