Richard Fuller

Richard Fuller

Auto-generated profile, based on publicly available information

Richard Fuller

School of Medicine, University of Liverpool, Liverpool, UK

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
13 May 2020 in Medical Teacher
Verified
Journal Article
Closed access
JCJennifer Cleland
Jennifer Cleland
JMJudy McKimm
Judy McKimm
RFRichard Fuller
Richard Fuller
DTDavid C M Taylor
David C M Taylor
JJJanusz Janczukowicz
Janusz Janczukowicz
TGTrevor Gibbs
Trevor Gibbs
Health Professions’ Educators (HPEs) and their learners have to adapt their educational provision to rapidly changing and uncertain circumstances linked to the COVID-19 pandemic. This paper reports on an AMEE-hosted webinar: Adapting to the impact of COVID-19: Sharing stories, sharing practice. Attended by over 500 colleagues from five continents, this webinar focused on the impact of the virus across the continuum of education and training. Short formal presentations on teaching and learning, assessment, selection and postgraduate training generated wide-ranging questions via the Chatbox. A thematic analysis of the Chatbox thread indicated the most pressing concerns and challenges educators were experiencing in having to adapt programmes and learning across the continuum of medical education and training. The main areas of concern were: campus-based teaching and learning; clinical teaching; selection and assessment, and educator needs. While there is clearly no one simple solution to the unprecedented issues medical education and training face currently, there were two over-arching messages. First, this is a time for colleagues across the globe to help and support each other. Second, many local responses and innovations could have the potential to change the shape of medical education and training in the future.

4 August 2020 in Medical Teacher
Verified
Journal Article
Open access
PYPeter Yeates
Peter Yeates
AMAlice Moult
Alice Moult
JLJanet Lefroy
Janet Lefroy
JWJacqualyn Walsh-House
Jacqualyn Walsh-House
LCLorraine Clews
Lorraine Clews
RFRichard Fuller
Richard Fuller
Novel uses of video aim to enhance assessment in health-professionals education. Whilst these uses presume equivalence between video and live scoring, some research suggests that poorly understood ...

17 January 2022 in BMC Medical Education
Verified
Journal Article
Open access
PDF file
PYPeter Yeates
Peter Yeates
GMGareth McCray
Gareth McCray
AMAlice Moult
Alice Moult
NCNatalie Cope
Natalie Cope
RFRichard Fuller
Richard Fuller
RMRobert McKinley
Robert McKinley
Background: Ensuring equivalence of examiners’ judgements across different groups of examiners is a priority for large scale performance assessments in clinical education, both to enhance fairness and reassure the public. This study extends insight into an innovation called Video-based Examiner Score Comparison and Adjustment (VESCA) which uses video scoring to link otherwise unlinked groups of examiners. This linkage enables comparison of the influence of different examiner-groups within a common frame of reference and provision of adjusted “fair” scores to students. Whilst this innovation promises substantial benefit to quality assurance of distributed Objective Structured Clinical Exams (OSCEs), questions remain about how the resulting score adjustments might be influenced by the specific parameters used to operationalise VESCA. Research questions, How similar are estimates of students’ score adjustments when the model is run with either: fewer comparison videos per participating examiner?; reduced numbers of participating examiners? Methods: Using secondary analysis of recent research which used VESCA to compare scoring tendencies of different examiner groups, we made numerous copies of the original data then selectively deleted video scores to reduce the number of 1/ linking videos per examiner (4 versus several permutations of 3,2,or 1 videos) or 2/examiner participation rates (all participating examiners (76%) versus several permutations of 70%, 60% or 50% participation). After analysing all resulting datasets with Many Facet Rasch Modelling (MFRM) we calculated students’ score adjustments for each dataset and compared these with score adjustments in the original data using Spearman’s correlations. Results: Students’ score adjustments derived form 3 videos per examiner correlated highly with score adjustments derived from 4 linking videos (median Rho = 0.93,IQR0.90–0.95,p < 0.001), with 2 (median Rho 0.85,IQR0.81–0.87,p < 0.001) and 1 linking videos (median Rho = 0.52(IQR0.46–0.64,p < 0.001) producing progressively smaller correlations. Score adjustments were similar for 76% participating examiners and 70% (median Rho = 0.97,IQR0.95–0.98,p < 0.001), and 60% (median Rho = 0.95,IQR0.94–0.98,p < 0.001) participation, but were lower and more variable for 50% examiner participation (median Rho = 0.78,IQR0.65–0.83, some ns). Conclusions: Whilst VESCA showed some sensitivity to the examined parameters, modest reductions in examiner participation rates or video numbers produced highly similar results. Employing VESCA in distributed or national exams could enhance quality assurance or exam fairness.

26 October 2023 in BMC Medical Education
Verified
Journal Article
Open access
PDF file
PYPeter Yeates
Peter Yeates
AMAdriano Maluf
Adriano Maluf
NCNatalie Cope
Natalie Cope
GMGareth McCray
Gareth McCray
SMStuart McBain
Stuart McBain
RMRobert Bob McKinley
Robert Bob McKinley
Purpose: Ensuring equivalence of examiners’ judgements within distributed objective structured clinical exams (OSCEs) is key to both fairness and validity but is hampered by lack of cross-over in the performances which different groups of examiners observe. This study develops a novel method called Video-based Examiner Score Comparison and Adjustment (VESCA) using it to compare examiners scoring from different OSCE sites for the first time. Materials/ methods: Within a summative 16 station OSCE, volunteer students were videoed on each station and all examiners invited to score station-specific comparator videos in addition to usual student scoring. Linkage provided through the video-scores enabled use of Many Facet Rasch Modelling (MFRM) to compare 1/ examiner-cohort and 2/ site effects on students’ scores. Results: Examiner-cohorts varied by 6.9% in the overall score allocated to students of the same ability. Whilst only a tiny difference was apparent between sites, examiner-cohort variability was greater in one site than the other. Adjusting student scores produced a median change in rank position of 6 places (0.48 deciles), however 26.9% of students changed their rank position by at least 1 decile. By contrast, only 1 student’s pass/fail classification was altered by score adjustment. Conclusions: Whilst comparatively limited examiner participation rates may limit interpretation of score adjustment in this instance, this study demonstrates the feasibility of using VESCA for quality assurance purposes in large scale distributed OSCEs.

30 March 2022 in Academic Medicine
Verified
Journal Article
Closed access
PYPeter Mrcp Yeates
Peter Mrcp Yeates
RFRichard Ma Fuller
Richard Ma Fuller
RMRobert K. (Bob) MD McKinley
Robert K. (Bob) MD McKinley