Benjamin Atkins

Benjamin Atkins

Auto-generated profile, based on publicly available information

Benjamin Atkins

Imperial Clinical Analytics, Research and Evaluation (iCARE), NIHR Imperial Biomedical Research Centre, Imperial College Healthcare NHS Trust, London, England, United Kingdom

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
3 July 2026 in JMIR AI
Verified
Journal Article
Open access
CCCatalina Carenzo
Catalina Carenzo
KGKathleen Goldsmith
Kathleen Goldsmith
MAMaite Arribas
Maite Arribas
BABenjamin Atkins
Benjamin Atkins
IKIna Ko
Ina Ko
EMErik Mayer
Erik Mayer
Background: A discharge summary should be a clinical report that documents a patient’s hospital stay, including test results, diagnoses, management, and follow-up. Currently, discharge summaries are written by clinicians who manually locate pertinent information across the electronic health record, of which approximately 80% is free text. This process is time-consuming and may be suitable for automation using large language models. Objective: This study developed a template-based prompting system that can produce clinically acceptable discharge summaries, specifically the “clinical summary” and “plan and requested actions” sections, from routinely collected electronic patient records. Methods: This study used electronic health record data from Imperial College Healthcare National Health Service Trust, a network of 5 hospitals in northwest London. It was conducted within the Imperial Secure Data Environment under Data Access and Ethics Committee approval. In total, 52 inpatient encounters were selected by the clinical team to ensure diversity in clinical specialty, reason for admission, complexity, length of stay, and sociodemographic characteristics; 83% (n=43) of the cases were allocated to the development dataset, and 17% (n=9) comprised the test dataset. The system synthesized clinical notes related to an inpatient hospital encounter and used structured template prompts with OpenAI’s generative pretrained transformer-4 to generate a discharge summary. The prompt was co-designed across 3 iterations. Resident physicians completed an evaluation form to assess the clinical acceptability of the generated summaries, including the primary outcome (global confidence rating) and secondary outcomes (accuracy, completeness, readability, formatting, sociodemographic bias, and potential clinical harm). Sensitivity analyses assessed the effect of length of stay and admission type (emergency department vs other and surgical vs other) on the primary outcome. Results: A total of 52 patients (n=32, 62% female) were included, with a mean age of 44.8 (SD 27.1) years and an average length of stay of 15.2 (SD 21.1) days. In the test dataset, 89% (8/9) of generative pretrained transformer-4–generated summaries received a positive global confidence rating (“yes” or “yes, with minor changes”). Secondary outcomes were positive for the “clinical summary” section (8/9, 89% complete and 7/9, 78% accurate) and the “plan and requested actions” section (7/9, 78% complete and 7/9, 78% accurate). Readability, formatting, sociodemographic bias, and potential clinical harm also showed positive results in the test dataset. Sensitivity analyses showed no statistically significant variation in the primary outcome across length of stay or admission type (length of stay: P=.29; surgical admission: P=.99; emergency department admission: P=.15). Conclusions: Our results demonstrate the feasibility of the pipeline, but rigorous statistical evaluation in a larger, adequately powered sample is needed.

1 September 2021 in Advances in Medical Education and Practice
Verified
Journal Article
Open access
PDF file
JMJack McAlinden
Jack McAlinden
BABenjamin Atkins
Benjamin Atkins
CMCatrin Masson
Catrin Masson
Letter for the article Widening Participation in Medicine: The Impact of Medical Student-Led Conferences for Year 12 Pupils

13 May 2026 in SSRN Electronic Journal
Verified
Preprint
Open access
KGKathleen Goldsmith
Kathleen Goldsmith
MAMaite Arribas
Maite Arribas
FDFidan Damirova
Fidan Damirova
MMMazin Mukhaiber
Mazin Mukhaiber
GKGhavin Kuganesan
Ghavin Kuganesan
EMErik Mayer
Erik Mayer
Background: Hospital discharge summaries are essential for continuity of care, but fragmented electronic health record data can compromise their quality and safety. Large language models (LLMs) are increasingly proposed for clinical documentation tasks, despite limited evidence regarding their performance in healthcare settings. We evaluated the clinical acceptability of GPT-4o-mini-generated discharge summaries derived from electronic health records compared with routine clinician-written summaries. Methods: Retrospective non-inferiority study comparing LLM-generated with clinician-authored discharge summaries, using admission records from five London hospitals (Sept 1, 2022, to Sept 30, 2023). 1294 summaries (645 LLM-generated; 649 clinician-authored) were evaluated by 12 practising doctors. LLM-generated summaries were produced using GPT-4o-mini (2024-07-18) and a clinician co-designed prompt. The primary outcome was clinician willingness to sign the summary with no or minor edits; a 5-percentage-point non-inferiority margin was prespecified. Secondary outcomes assessed accuracy, completeness, tone, clarity, and potential harmfulness of missing or incorrect information on a 5-point Likert scale. Analysis used generalised linear mixed models adjusting for reviewer and case-level variability. Findings: The absolute difference in predicted probability of sign-off (LLM-generated minus clinician-authored) was 22.2 percentage points (95% CI 19.0-27.5) and non-inferiority was demonstrated. Compared with clinician-authored summaries, LLM-generated summaries received higher ratings for accuracy, completeness, tone, and clarity (adjusted risk differences for score ≥4 were 19.4–29.1 percentage points; all 95% CIs excluded zero). LLM-generated discharge summaries had a lower proportion of cases rated ≥3 for potential harm (17.2-19.4%) compared with clinician-authored summaries (37.5-38.5%). Interpretation: LLM-generated discharge summaries meet the current standard of care and represent a promising early use case for generative artificial intelligence (AI) in healthcare with close clinician oversight. Funding This research was funded by the NIHR Imperial Biomedical Research Centre (NIHR203323). The views expressed are those of the author(s) and not necessarily those of the NIHR or the Department of Health and Social Care.

2 December 2025 in JMIR Preprints
Verified
Preprint
Open access
CCCatalina Carenzo
Catalina Carenzo
KGKathleen Goldsmith
Kathleen Goldsmith
MAMaite Arribas
Maite Arribas
BABenjamin Atkins
Benjamin Atkins
IKIna Ko
Ina Ko
EMErik Mayer
Erik Mayer
BACKGROUND A discharge summary should be a clinical report that documents a patient’s hospital stay, including test results, diagnoses, management, and follow-up. Currently, discharge summaries are written by clinicians who manually locate pertinent information across the electronic health record, of which approximately 80% is free text. This process is time-consuming and may be suitable for automation using large language models. OBJECTIVE This study developed a template-based prompting system that can produce clinically acceptable discharge summaries, specifically the “clinical summary” and “plan and requested actions” sections, from routinely collected electronic patient records. METHODS This study used electronic health record data from Imperial College Healthcare National Health Service Trust, a network of 5 hospitals in northwest London. It was conducted within the Imperial Secure Data Environment under Data Access and Ethics Committee approval. In total, 52 inpatient encounters were selected by the clinical team to ensure diversity in clinical specialty, reason for admission, complexity, length of stay, and sociodemographic characteristics; 83% (n=43) of the cases were allocated to the development dataset, and 17% (n=9) comprised the test dataset. The system synthesized clinical notes related to an inpatient hospital encounter and used structured template prompts with OpenAI’s generative pretrained transformer-4 to generate a discharge summary. The prompt was co-designed across 3 iterations. Resident physicians completed an evaluation form to assess the clinical acceptability of the generated summaries, including the primary outcome (global confidence rating) and secondary outcomes (accuracy, completeness, readability, formatting, sociodemographic bias, and potential clinical harm). Sensitivity analyses assessed the effect of length of stay and admission type (emergency department vs other and surgical vs other) on the primary outcome. RESULTS A total of 52 patients (n=32, 62% female) were included, with a mean age of 44.8 (SD 27.1) years and an average length of stay of 15.2 (SD 21.1) days. In the test dataset, 89% (8/9) of generative pretrained transformer-4–generated summaries received a positive global confidence rating (“yes” or “yes, with minor changes”). Secondary outcomes were positive for the “clinical summary” section (8/9, 89% complete and 7/9, 78% accurate) and the “plan and requested actions” section (7/9, 78% complete and 7/9, 78% accurate). Readability, formatting, sociodemographic bias, and potential clinical harm also showed positive results in the test dataset. Sensitivity analyses showed no statistically significant variation in the primary outcome across length of stay or admission type (length of stay: P=.29; surgical admission: P=.99; emergency department admission: P=.15). CONCLUSIONS Our results demonstrate the feasibility of the pipeline, but rigorous statistical evaluation in a larger, adequately powered sample is needed.