Anthony J Levinson

Prof. Dr. Anthony J Levinson

orcid

Research Focus & Metrics

Academic Career Length

19Years (2008-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
10 September 2008 in JAMA
Verified
Journal Article
Closed access
PDF file
DCDavid A. Cook
David A. Cook
Anthony J LevinsonAnthony J Levinson
Anthony J Levinson
SGSarah Garside
Sarah Garside
DDDenise M. Dupras
Denise M. Dupras
PEPatricia J. Erwin
Patricia J. Erwin
VMVictor M. Montori
Victor M. Montori
Review from JAMA — Internet-Based Learning in the Health Professions — A Meta-analysis

7 May 2018 in JMIR Aging
Verified
Journal Article
Open access
MDMaureen Dobbins
Maureen Dobbins
SWSusannah Watson
Susannah Watson
KRKristin Read
Kristin Read
KGKelly Graham
Kelly Graham
RNReza Yousefi Nooraie
Reza Yousefi Nooraie
Anthony J LevinsonAnthony J Levinson
Anthony J Levinson
Background: The internet is commonly used by older adults to obtain health information and this trend has markedly increased in the past decade. However, studies illustrate that much of the available online health information is not informed by good quality evidence, developed in a transparent way, or easy to use. Furthermore, studies highlight that the general public lacks the skills necessary to distinguish between online products that are credible and trustworthy and those that are not. A number of tools have been developed to assess the evidence, transparency, and usability of online health information; however, many have not been assessed for reliability or ease of use. Methods: An electronic database search was conducted between 2002 and 2012 to identify published papers describing tools that assessed the evidence, transparency, and usability of online health information. Papers were retained if the tool described was assessed for reliability, assessed the quality of evidence used to create online health information, and was quick and easy to use. When no one tool met expectations, a new instrument was developed and tested for reliability. Reliability between two raters was assessed using the intraclass correlation coefficient (ICC) for each item at two time points. SPSS Statistics 22 software was used for statistical analyses and a one-way random effects model was used to report the results. The overall ICC was assessed for the instrument as a whole in July 2015. The threshold for retaining items was ICC>0.60 (ie, “good” reliability). Results: All tools identified that evaluated online health information were either too complex, took a long time to complete, had poor reliability, or had not undergone reliability assessment. A new instrument was developed and assessed for reliability in April 2014. Three items had an ICC<0.60 (ie, “good” reliability). One of these items was removed (“minimal scrolling”) and two were retained but reworded for clarity. Four new items were added that assessed the level of research evidence that informed the online health information and the tool was retested in July 2015. The total ICC score showed excellent agreement with both single measures (ICC=0.988; CI 0.982–0.992) and average measures (ICC=0.994; CI 0.991–0.996). Conclusions: The results of this study suggest that this new tool is reliable for assessing the evidence, transparency, and usability of online health information that is relevant to optimal aging.

19 January 2024 in International Medical Education
Verified
Journal Article
Open access
PDF file
LMLeo Morjaria
Leo Morjaria
LBLevi Burns
Levi Burns
KBKeyna Bracken
Keyna Bracken
Anthony J LevinsonAnthony J Levinson
Anthony J Levinson
QNQuang N. Ngo
Quang N. Ngo
MSMatthew Sibbald
Matthew Sibbald
Traditional approaches to marking short-answer questions face limitations in timeliness, scalability, inter-rater reliability, and faculty time costs. Harnessing generative artificial intelligence (AI) to address some of these shortcomings is attractive. This study aims to validate the use of ChatGPT for evaluating short-answer assessments in an undergraduate medical program. Ten questions from the pre-clerkship medical curriculum were randomly chosen, and for each, six previously marked student answers were collected. These sixty answers were evaluated by ChatGPT in July 2023 under four conditions: with both a rubric and standard, with only a standard, with only a rubric, and with neither. ChatGPT displayed good Spearman correlations with a single human assessor (r = 0.6–0.7, p < 0.001) across all conditions, with the absence of a standard or rubric yielding the best correlation. Scoring differences were common (65–80%), but score adjustments of more than one point were less frequent (20–38%). Notably, the absence of a rubric resulted in systematically higher scores (p < 0.001, partial η2 = 0.33). Our findings demonstrate that ChatGPT is a viable, though imperfect, assistant to human assessment, performing comparably to a single expert assessor. This study serves as a foundation for future research on AI-based assessment techniques with potential for further optimization and increased reliability.

12 November 2018 in BMC Medical Education
Verified
Journal Article
Open access
PDF file
SWS. Wentzell
S. Wentzell
LML. Moran
L. Moran
JDJ. Dobranowski
J. Dobranowski
Anthony J LevinsonAnthony J Levinson
Anthony J Levinson
AHA. Hannigan
A. Hannigan
DMD. McGrath
D. McGrath
Radiology is an important aspect of medicine to which medical students often do not receive sufficient exposure. The aim of this project was to determine whether the integration of an innovative e-learning module on chest x-ray interpretation of the heart would enhance the radiological interpretive skills, and improve the confidence, of first year graduate entry medical students. All first-year graduate entry (all students had a prior university degree) medical students at the University of Limerick (n = 152) during academic year 2015–16 were invited to participate in this study. An assessment instrument was developed which consisted of 5 radiological cases to be interpreted over a designated and supervised 15-min time period. Students underwent a pre-, mid- and post-intervention assessment of their radiology interpretative skills. An online e-module was provided following the pre-test and additional practice cases were provided following the mid-intervention test. Assessment scores and confidence levels were compared pre-, mid- and post-intervention. The overall performance (out of a total score of 25) for the 87 students who completed all three assessments increased from 13.2 (SD 3.36) pre-intervention to 14.3 (SD 2.97) mid-intervention to 15.8 (SD 3.40) post-intervention. This change over time was statistically significant (p < 0.001) with a medium effect size (eta-squared = 0.35). Increases from pre- to post-intervention were observed in each of the five areas assessed, although performance remained poor in diagnosis post-intervention. Of the 118 students who provided feedback after the intervention, 102 (86.4%) stated that they would recommend the resource to a colleague to improve their interpretative skills. This study suggests that early exposure to e-learning radiology modules is beneficial in undergraduate medical school curricula. Further studies are encouraged to assess how long the improvement may last before attrition.

11 May 2016 in JMIR Human Factors
Verified
Journal Article
Open access
ABAngela M Barbara
Angela M Barbara
MDMaureen Dobbins
Maureen Dobbins
RHR. Brian Haynes
R. Brian Haynes
AIAlfonso Iorio
Alfonso Iorio
JLJohn N Lavis
John N Lavis
Anthony J LevinsonAnthony J Levinson
Anthony J Levinson
JMIR Human Factors - a leading peer-reviewed ehealth journal