Levi Burns

Mr. Levi Burns

orcid

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
19 January 2024 in International Medical Education
Verified
Journal Article
Open access
PDF file
LMLeo Morjaria
Leo Morjaria
LBLevi Burns
Levi Burns
KBKeyna Bracken
Keyna Bracken
Anthony J LevinsonAnthony J Levinson
Anthony J Levinson
QNQuang N. Ngo
Quang N. Ngo
MSMatthew Sibbald
Matthew Sibbald
Traditional approaches to marking short-answer questions face limitations in timeliness, scalability, inter-rater reliability, and faculty time costs. Harnessing generative artificial intelligence (AI) to address some of these shortcomings is attractive. This study aims to validate the use of ChatGPT for evaluating short-answer assessments in an undergraduate medical program. Ten questions from the pre-clerkship medical curriculum were randomly chosen, and for each, six previously marked student answers were collected. These sixty answers were evaluated by ChatGPT in July 2023 under four conditions: with both a rubric and standard, with only a standard, with only a rubric, and with neither. ChatGPT displayed good Spearman correlations with a single human assessor (r = 0.6–0.7, p < 0.001) across all conditions, with the absence of a standard or rubric yielding the best correlation. Scoring differences were common (65–80%), but score adjustments of more than one point were less frequent (20–38%). Notably, the absence of a rubric resulted in systematically higher scores (p < 0.001, partial η2 = 0.33). Our findings demonstrate that ChatGPT is a viable, though imperfect, assistant to human assessment, performing comparably to a single expert assessor. This study serves as a foundation for future research on AI-based assessment techniques with potential for further optimization and increased reliability.

17 September 2025 in Clinical and Translational Radiation Oncology
Verified
Journal Article
Open access
LBLevi Burns
Levi Burns
JTJillian Tsai
Jillian Tsai
PWPhilip Wong
Philip Wong
APAmy Parent
Amy Parent
YTYat Tsang
Yat Tsang
JLJelena Lukovic
Jelena Lukovic
• SFRT is a safe, feasible, and effective technique for re-irradiation. • Patients were re-treated with 66.7 Gy in 5 fractions to a high-dose vertex volume. • SFRT treatment plans were clinically acceptable in the re-irradiation setting. • Patients had improved symptoms with no severe radiation-related adverse events.

17 January 2024 in Current Problems in Diagnostic Radiology
Verified
Journal Article
Open access
LBLevi Burns
Levi Burns
SCScott Caterine
Scott Caterine
DWDanielle Walker
Danielle Walker
ZGZonia Ghumman
Zonia Ghumman
SLStefanie Y. Lee
Stefanie Y. Lee
Rationale and objectives: To measure change in radiology knowledge, confidence in radiology skills, and perceptions pertaining to radiology following a one-week boot camp elective for undergraduate medical students. Materials and methods: A five-day comprehensive radiology boot camp was developed including sessions on image interpretation, procedural skills, and appropriate image ordering. A multiple-choice quiz was administered before and after the elective, utilizing radiology questions from the validated AMSER STARS database. Additionally, a pre- and post-elective survey was administered assessing radiology career interest, confidence in radiology-based skills, and the potential ability of radiology-based skills to increase confidence in specialties other than radiology. Responses from the assessments were analysed using paired t-tests. Results: 15 students enrolled in the course and 14 completed all assessments. The average score on the quiz increased from 50.1% to 66.0% (p<0.001). On the post-elective survey, the average student confidence score increased by more than one point on a six-point Likert scale in each of radiographic interpretation (p=0.004), ultrasound interpretation (p=0.0002), CT/MRI interpretation (p=0.02), general radiology knowledge including procedural skills (p=0.0001), and appropriate image ordering (p=0.004). Average student satisfaction with the elective was 8.1 out of 10. Conclusion: A one-week radiology boot camp for pre-clerkship medical students improved radiology knowledge and confidence in radiology skills, showing potential for this format to meet the demand for increased radiology content in undergraduate training. Students indicated that confidence in radiology knowledge would increase confidence on non-radiology clerkship rotations, highlighting the importance of how a one-week radiology bootcamp can impact both future radiology and non-radiology clerkship experiences.

6 March 2026 in Applied Sciences
Verified
Journal Article
Open access
PDF file
LMLeo Morjaria
Leo Morjaria
LBLevi Burns
Levi Burns
BGBhavya Gandhi
Bhavya Gandhi
KBKeyna Bracken
Keyna Bracken
MFMuhammad S. Farooq
Muhammad S. Farooq
MSMatthew Sibbald
Matthew Sibbald
Background: Generative artificial intelligence (AI) tools including ChatGPT have the potential to augment the process of designing examinations and assessments for medical learners, leading to time and resource savings, and the ability to produce large volumes of practice problems tailored to learner-specific strengths and weaknesses. Methods: This study compares the quality of free-text assessment problems and answer keys generated by ChatGPT to those produced by faculty educators for a renal and hematology curriculum subunit. Five expert reviewers reviewed a collection of 21 free-text assessment problems, 9 from a collection of historical assessment problems used in an undergraduate medical program and 12 produced with ChatGPT. Reviewers assigned a score from 1 to 5, reflecting the overall quality. Results: The average quality of problems generated by ChatGPT was greater than that of human-generated problems (4.00 vs. 2.71, p < 0.001). Using ordinal mixed-effect modeling, human-generated problems had significantly lower odds of receiving higher ratings than ChatGPT-generated problems (β = −2.43, 95% confidence interval −3.34 to −1.51, p < 0.001). Conclusions: It is suggested that ChatGPT can assist expert faculty educators in producing assessment tools, with direct benefits to medical learners, although it cannot entirely replace this role in its current state.

7 July 2022 in Current Oncology
Verified
Journal Article
Open access
PDF file
CDCheryl Duzenli
Cheryl Duzenli
ECElisa Chan
Elisa Chan
TKTheodora Koulis
Theodora Koulis
SGSheri Grahame
Sheri Grahame
JSJoel Singer
Joel Singer
Robert Anton OlsonRobert Anton Olson
Robert Anton Olson
There has been an increasing interest in patient-reported outcome (PRO) measures in both the clinical and research settings to improve the quality of life among patients and to identify when clinical intervention may be needed. The primary purpose of this prospective study was to validate an acute breast skin toxicity PRO measure across a broad sample of patient body types undergoing radiation therapy. Between August 2018 and September 2019, 134 women undergoing adjuvant breast radiotherapy (RT) consented to completing serial PRO measures both during and post-RT treatment and to having their skin assessed by trained trial radiation therapists. There was high patient compliance, with 124 patients (92.5%) returning to the clinic post-RT for at least one staff skin assessment. Rates of moist desquamation (MD) in the infra-mammary fold (IMF) by PRO were compared with skin assessments completed by trial radiation therapists. There was high sensitivity (86.5%) and good specificity (79.4%) between PRO and staff-reported presence of MD in the IMF, and there was a moderate correlation between the peak severity of the MD reported by PRO and assessed by staff (rho = 0.61, p < 0.001). This prospective study validates a new PRO measure to monitor the presence of MD in the IMF among women receiving breast RT.