Leo Anthony Celi

Dr. Leo Anthony Celi


Research Focus & Metrics

Academic Career Length

19Years (2008-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
16 April 2024 in BMJ
Verified
Journal Article
Open access
PDF file
GCGary S Collins
Gary S Collins
KMKarel G M Moons
Karel G M Moons
PDPaula Dhiman
Paula Dhiman
RRRichard D Riley
Richard D Riley
ABAndrew Beam
Andrew Beam
PLPatricia Logullo
Patricia Logullo
The TRIPOD (Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis) statement was published in 2015 to provide the minimum reporting recommendations for studies developing or evaluating the performance of a prediction model. Methodological advances in the field of prediction have since included the widespread use of artificial intelligence (AI) powered by machine learning methods to develop prediction models. An update to the TRIPOD statement is thus needed. TRIPOD+AI provides harmonised guidance for reporting prediction model studies, irrespective of whether regression modelling or machine learning methods have been used. The new checklist supersedes the TRIPOD 2015 checklist, which should no longer be used. This article describes the development of TRIPOD+AI and presents the expanded 27 item checklist with more detailed explanation of each reporting recommendation, and the TRIPOD+AI for Abstracts checklist. TRIPOD+AI aims to promote the complete, accurate, and transparent reporting of studies that develop a prediction model or evaluate its performance. Complete reporting will facilitate study appraisal, model evaluation, and model implementation.

3 January 2023 in Scientific Data
Verified
Journal Article
Open access
PDF file
AJAlistair E. W. Johnson
Alistair E. W. Johnson
LBLucas Bulgarelli
Lucas Bulgarelli
LSLu Shen
Lu Shen
AGAlvin Gayles
Alvin Gayles
ASAyad Shammout
Ayad Shammout
RMRoger G. Mark
Roger G. Mark
Digital data collection during routine clinical practice is now ubiquitous within hospitals. The data contains valuable information on the care of patients and their response to treatments, offering exciting opportunities for research. Typically, data are stored within archival systems that are not intended to support research. These systems are often inaccessible to researchers and structured for optimal storage, rather than interpretability and analysis. Here we present MIMIC-IV, a publicly available database sourced from the electronic health record of the Beth Israel Deaconess Medical Center. Information available includes patient measurements, orders, diagnoses, procedures, treatments, and deidentified free-text clinical notes. MIMIC-IV is intended to support a wide array of research studies and educational material, helping to reduce barriers to conducting clinical research.

22 October 2018 in Nature Medicine
Verified
Journal Article
Open access
PDF file
MKMatthieu Komorowski
Matthieu Komorowski
LCLeo Anthony Celi
Leo Anthony Celi
OBOmar Badawi
Omar Badawi
AGAnthony C. Gordon
Anthony C. Gordon
AFA. Aldo Faisal
A. Aldo Faisal
Sepsis is the third leading cause of death worldwide and the main cause of mortality in hospitals1,2,3, but the best treatment strategy remains uncertain. In particular, evidence suggests that current practices in the administration of intravenous fluids and vasopressors are suboptimal and likely induce harm in a proportion of patients1,4,5,6. To tackle this sequential decision-making problem, we developed a reinforcement learning agent, the Artificial Intelligence (AI) Clinician, which extracted implicit knowledge from an amount of patient data that exceeds by many-fold the life-time experience of human clinicians and learned optimal treatment by analyzing a myriad of (mostly suboptimal) treatment decisions. We demonstrate that the value of the AI Clinician’s selected treatment is on average reliably higher than human clinicians. In a large validation cohort independent of the training data, mortality was lowest in patients for whom clinicians’ actual doses matched the AI decisions. Our model provides individualized and clinically interpretable treatment decisions for sepsis that could improve patient outcomes.

24 March 2025 in BMJ
Verified
Journal Article
Open access
PDF file
KMKarel G M Moons
Karel G M Moons
JDJohanna A A Damen
Johanna A A Damen
TKTabea Kaul
Tabea Kaul
LHLotty Hooft
Lotty Hooft
CNConstanza Andaur Navarro
Constanza Andaur Navarro
MSMaarten van Smeden
Maarten van Smeden
The Prediction model Risk Of Bias ASsessment Tool (PROBAST) is used to assess the quality, risk of bias, and applicability of prediction models or algorithms and of prediction model/algorithm studies. Since PROBAST’s introduction in 2019, much progress has been made in the methodology for prediction modelling and in the use of artificial intelligence, including machine learning, techniques. An update to PROBAST-2019 is thus needed. This article describes the development of PROBAST+AI. PROBAST+AI consists of two distinctive parts: model development and model evaluation. For model development, PROBAST+AI users assess quality and applicability using 16 targeted signalling questions. For model evaluation, PROBAST+AI users assess the risk of bias and applicability using 18 targeted signalling questions. Both parts contain four domains: participants and data sources, predictors, outcome, and analysis. Applicability of the prediction model is rated for the participants and data sources, predictors, and outcome domains. PROBAST+AI may replace the original PROBAST tool and allows all key stakeholders (eg, model developers, AI companies, researchers, editors, reviewers, healthcare professionals, guideline developers, and policy organisations) to examine the quality, risk of bias, and applicability of any type of prediction model in the healthcare sector, irrespective of whether regression modelling or AI techniques are used.

8 January 2025 in Nature Medicine
Verified
Journal Article
Open access
PDF file
JGJack Gallifant
Jack Gallifant
MAMajid Afshar
Majid Afshar
SASaleem Ameen
Saleem Ameen
YAYindalon Aphinyanaphongs
Yindalon Aphinyanaphongs
SCShan Chen
Shan Chen
DBDanielle S. Bitterman
Danielle S. Bitterman
Large language models (LLMs) are rapidly being adopted in healthcare, necessitating standardized reporting guidelines. We present transparent reporting of a multivariable model for individual prognosis or diagnosis (TRIPOD)-LLM, an extension of the TRIPOD + artificial intelligence statement, addressing the unique challenges of LLMs in biomedical applications. TRIPOD-LLM provides a comprehensive checklist of 19 main items and 50 subitems, covering key aspects from title to discussion. The guidelines introduce a modular format accommodating various LLM research designs and tasks, with 14 main items and 32 subitems applicable across all categories. Developed through an expedited Delphi process and expert consensus, TRIPOD-LLM emphasizes transparency, human oversight and task-specific performance reporting. We also introduce an interactive website (https://tripod-llm.vercel.app/) facilitating easy guideline completion and PDF generation for submission. As a living document, TRIPOD-LLM will evolve with the field, aiming to enhance the quality, reproducibility and clinical applicability of LLM research in healthcare through comprehensive reporting.

1 September 2020 in The Lancet Digital Health
Verified
Journal Article
Open access
JFJoseph Futoma
Joseph Futoma
MSMorgan Simons
Morgan Simons
TPTrishan Panch
Trishan Panch
FDFinale Doshi-Velez
Finale Doshi-Velez
LCLeo Anthony Celi
Leo Anthony Celi
An emphasis on overly broad notions of generalisability as it pertains to applications of machine learning in health care can overlook situations in which machine learning might provide clinical utility. We believe that this narrow focus on generalisability should be replaced with wider considerations for the ultimate goal of building machine learning systems that are useful at the bedside.