28 March 2012 in Medical Teacher
Background: The Multiple Mini-Interview (MMI) is a new interview process that Dundee Medical School has recently adopted to assess entrants into its undergraduate medicine course. This involves an ‘Objective Structured Clinical Examination’ like rotational approach in which candidates are assessed on specific attributes at a number of stations. Aims: To present methodological, questionnaire and psychometric data on the transitional process from traditional interviews to MMIs over a 3-year period and discuss the implications for those considering making this transition. Methods: To facilitate the transition, a four-station MMI was piloted in 2007. Success encouraged consideration of desirable attributes which were used to develop a full 10-station process which was implemented in 2009 with assessors being recruited from staff, students and simulated patients. A questionnaire was administered to all assessors and candidates who participated in the 2009 MMIs. Cronbach's alpha and Pearson's r and analysis of variances were used to determine the MMI's psychometric properties. Multi-faceted Rasch modelling (MFRM) was modelled to control for assessor leniency/stringency and the impact of using ‘fair scores’ determined. Analysis was conducted using SPSS 17 and FACETS 3.65.0. Results: The questionnaire confirmed that the process was acceptable to all parties. Cronbach's alpha reliability was satisfactory and consistent. Graduates/mature candidates outperformed UK school-leavers and overseas candidates. Using MFRM fair scores would change the selection outcome of 6.2% and 9.6% of candidates in 2009 and 2010, respectively. Students were less lenient, made more use of the full range of the rating scales and were just as reliable as staff. Conclusions: The strategy of generating institutional support through staged introduction proved effective. The MMI in Dundee was shown to be feasible and displayed sound psychometric properties. Student assessors appeared to perform at least as well as staff. Despite a considerable intellectual and logistical challenge MMIs were successfully introduced and deemed worthwhile.
31 August 2017 in BMJ Open
Objectives Differential attainment in school examinations is one of the barriers to increasing student diversity in medicine. However, studies on the predictive validity of prior academic achievement and educational performance at medical school are contradictory, possibly due to single-site studies or studies which focus only on early years’ performance. To address these gaps, we examined the relationship between sociodemographic factors, including school type and average educational performance throughout medical school across a large number of diverse medical programmes. Methods This retrospective study analysed data from students who graduated from 33 UK medical schools between 2012 and 2013. We included candidates’ demographics, pre-entry grades (adjusted Universities and Colleges Admissions Service tariff scores) preadmission test scores (UK Clinical Aptitude Test (UKCAT) and Graduate Medical School Admissions Test (GAMSAT)) and used the UK Foundation Programme’s educational performance measure (EPM) decile as an outcome measure. Logistic regression was used to assess the independent relationship between students’ background characteristics and EPM ranking. Results Students from independent schools had significantly higher mean UKCAT scores (2535.1, SD=209.6) than students from state-funded schools (2506.1, SD=224.0, p<0.001). Similarly, students from independent schools came into medical school with significantly higher mean GAMSAT scores (63.9, SD=6.9) than students from state-funded schools (60.8, SD=7.1, p<0.001). However, students from state-funded schools were almost twice as likely (OR=2.01, 95% CI 1.49 to 2.73) to finish in the highest rank of the EPM ranking than those who attended independent schools. Conclusions This is the first large-scale study to examine directly the relationship between school type and overall performance at medical school. Our findings provide modest supportive evidence that, when students from independent and state schools enter with similar pre-entry grades, once in medical school, students from state-funded schools are likely to outperform students from independent schools. This evidence contributes to discussions around contextualising medical admission.
19 May 2015 in Medical Education
27 March 2019 in BMJ Open
Objectives: Many countries are driving forward policies to widen the socioeconomic profile of medical students and to train more medical students for certain specialties. However, little is known about how socioeconomic origin relates to specialty choice. Nor is there a good understanding of the relationship between academic performance and specialty choice. To address these gaps, our aim was to identify the relationship between socioeconomic background, academic performance and accepted offers into specialty training.Design: Longitudinal, cohort study using data from the UK Medical Education Database (https://www.ukmed.ac.uk/).Participants: 6065 (60% females) UK doctors who accepted offers to a specialty training (residency) post after completing the 2-year generic foundation programme (UK Foundation Programme) between 2012 and 2014.Main outcome measures: Χ2tests were used to examine the relationships between sociodemographic characteristics, academic ability and the dependent variable, specialty choice. Multiple data imputation was used to address the issue of missing data. Multinomial regression was employed to test the independent variables in predicting the likelihood of choosing a given specialty.Results: Participants pursuing careers in more competitive specialties had significantly higher academic scores than colleagues pursuing less competitive ones. After controlling for the presence of multiple factors, trainees who came from families where no parent was educated to a degree level had statistically significant lower odds of choosing careers in medical specialties relative to general practice (OR=0.78, 95% CI, 0.67 to 0.92). Students who entered medical school as school leavers, compared with mature students, had odds 1.2 times higher (95% CI, 1.04 to 1.56) of choosing surgical specialties than general practice.Conclusions: The data indicate a direct association between trainees’ sociodemographic characteristics, academic ability and career choices. The findings can be used by medical school, training boards and workforce planners to inform recruitment and retention strategies.
11 June 2024 in Medical Education
8 May 2014 in Medical Education