Richard Hays

Richard Hays

Auto-generated profile, based on publicly available information

Richard Hays

College of Medicine and Dentistry, James Cook University, Townsville, Australia

Research Focus & Metrics

Academic Career Length

37Years (1990-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
23 February 2011 in Medical Teacher
Verified
Journal Article
Closed access
PDF file
JNJohn Norcini
John Norcini
BABrownell Anderson
Brownell Anderson
VBValdes Roberto Bollela
Valdes Roberto Bollela
VBVanessa Burch
Vanessa Burch
MCManuel João Costa
Manuel João Costa
TRTrudie Roberts
Trudie Roberts
In this article, we outline criteria for good assessment that include: (1) validity or coherence, (2) reproducibility or consistency, (3) equivalence, (4) feasibility, (5) educational effect, (6) catalytic effect, and (7) acceptability. Many of the criteria have been described before and we continue to support their importance here. However, we place particular emphasis on the catalytic effect of the assessment, which is whether the assessment provides results and feedback in a fashion that creates, enhances, and supports education. These criteria do not apply equally well to all situations. Consequently, we discuss how the purpose of the test (summative versus formative) and the perspectives of stakeholders (examinees, patients, teachers-educational institutions, healthcare system, and regulators) influence the importance of the criteria. Finally, we offer a series of practice points as well as next steps that should be taken with the criteria. Specifically, we recommend that the criteria be expanded or modified to take account of: (1) the perspectives of patients and the public, (2) the intimate relationship between assessment, feedback, and continued learning, (3) systems of assessment, and (4) accreditation systems.

9 October 2018 in Medical Teacher
Verified
Journal Article
Closed access
JNJohn Norcini
John Norcini
MAM. Brownell Anderson
M. Brownell Anderson
VBValdes Bollela
Valdes Bollela
VBVanessa Burch
Vanessa Burch
MCManuel João Costa
Manuel João Costa
DSDavid Swanson
David Swanson
Introduction: In 2010, the Ottawa Conference produced a set of consensus criteria for good assessment. These were well received and since then the working group monitored their use. As part of the 2010 report, it was recommended that consideration be given in the future to preparing similar criteria for systems of assessment. Recent developments in the field suggest that it would be timely to undertake that task and so the working group was reconvened, with changes in membership to reflect broad global representation.Methods: Consideration was given to whether the initially proposed criteria continued to be appropriate for single assessments and the group believed that they were. Consequently, we reiterate the criteria that apply to individual assessments and duplicate relevant portions of the 2010 report.Results and discussion: This paper also presents a new set of criteria that apply to systems of assessment and, recognizing the challenges of implementation, offers several issues for further consideration. Among these issues are the increasing diversity of candidates and programs, the importance of legal defensibility in high stakes assessments, globalization and the interest in portable recognition of medical training, and the interest among employers and patients in how medical education is delivered and how progression decisions are made.

6 April 2016 in Medical Teacher
Verified
Journal Article
Closed access
PDF file
EREliot L. Rees
Eliot L. Rees
AHAshley W. Hawarden
Ashley W. Hawarden
GDGordon Dent
Gordon Dent
RHRichard Hays
Richard Hays
JBJoanna Bates
Joanna Bates
AHAndrew B. Hassell
Andrew B. Hassell
Background: In the 11 years since its development at McMaster University Medical School, the multiple mini-interview (MMI) has become a popular selection tool. We aimed to systematically explore, analyze and synthesize the evidence regarding MMIs for selection to undergraduate health programs. Methods: The review protocol was peer-reviewed and prospectively registered with the Best Evidence Medical Education (BEME) collaboration. Thirteen databases were searched through 34 terms and their Boolean combinations. Seven key journals were hand-searched since 2004. The reference sections of all included studies were screened. Studies meeting the inclusion criteria were coded independently by two reviewers using a modified BEME coding sheet. Extracted data were synthesized through narrative synthesis. Results: A total of 4338 citations were identified and screened, resulting in 41 papers that met inclusion criteria. Thirty-two studies report data for selection to medicine, six for dentistry, three for veterinary medicine, one for pharmacy, one for nursing, one for rehabilitation, and one for health science. Five studies investigated selection to more than one profession. MMIs used for selection to undergraduate health programs appear to have reasonable feasibility, acceptability, validity, and reliability. Reliability is optimized by including 7–12 stations, each with one examiner. The evidence is stronger for face validity, with more research needed to explore content validity and predictive validity. In published studies, MMIs do not appear biased against applicants on the basis of age, gender, or socio-economic status. However, applicants of certain ethnic and social backgrounds did less well in a very small number of published studies. Performance on MMIs does not correlate strongly with other measures of noncognitive attributes, such as personality inventories and measures of emotional intelligence. Discussion: MMI does not automatically mean a more reliable selection process but it can do, if carefully designed. Effective MMIs require careful identification of the noncognitive attributes sought by the program and institution. Attention needs to be given to the number of stations, the blueprint and examiner training. Conclusion: More work is required on MMIs as they may disadvantage groups of certain ethnic or social backgrounds. There is a compelling argument for multi-institutional studies to investigate areas such as the relationship of MMI content to curriculum domains, graduate outcomes, and social missions; relationships of applicants’ performance on different MMIs; bias in selecting applicants of minority groups; and the long-term outcomes appropriate for studies of predictive validity.

5 October 2000 in Medical Education
Verified
Journal Article
Closed access
PDF file
LSLinda Snell
Linda Snell
STSusan Tallett
Susan Tallett
SHSteven Haist
Steven Haist
RHRichard Hays
Richard Hays
JNJohn Norcini
John Norcini
RRRichard Rowe
Richard Rowe

17 October 2002 in Medical Education
Verified
Journal Article
Closed access
PDF file
RHR B Hays
R B Hays
BJB C Jolly
B C Jolly
LCL J M Caldon
L J M Caldon
PMP McCrorie
P McCrorie
PMP A McAvoy
P A McAvoy
JRJ‐J Rethans
J‐J Rethans

18 November 2020 in Advances in Health Sciences Education
Verified
Journal Article
Closed access
PDF file
RHR. B. Hays
R. B. Hays
SRS. Ramani
S. Ramani
AHA. Hassell
A. Hassell