7 July 2020 in Academic Medicine
Purpose: Teaching by way of asking questions is a time-honored practice that has taken on the negative connotation of “pimping” among medical students and has made some faculty hesitant to ask students questions during clerkship rotations. Yet, quantitative studies exploring student perspectives on this practice are limited. This study aimed to solicit student and faculty views and investigate faculty perceptions of students’ preferences. Method: Students who completed their internal medicine clerkship during the 2017–2018 academic year (n = 165) and were from the 2020 graduating class and their supervising faculty (n = 144) at the University of Michigan Medical School were asked to complete a Likert response survey in April 2019. The survey solicited perspectives on questions probing medical knowledge posed to students by faculty. Surveys were constructed using an iterative process, and data were analyzed using t tests and linear regressions. Results: A total of 140 (85%) students and 112 (78%) faculty participated. Of those, 125 (89%) students and 109 (97%) faculty agreed that probing questions are valuable for student education, but only 73 (65%) faculty perceived that students agreed with this statement ( P < .001). In addition, 115 (82%) students preferred to be asked too many questions than none at all. Fifty-five (39%) students agreed that they feel humiliated when they answer a question incorrectly. However, only 7 (5%) students agreed that faculty ask questions to humiliate them, and only 20 (14%) preferred that faculty stop asking questions if they answer a question incorrectly. Conclusions: Students valued probing questions more than faculty perceived, which argues against a withdrawal from the Socratic teaching method in the clinical arena. The students’ experience of humiliation when answering incorrectly requires further study and perhaps can be tempered by more explicit framing of the role of the questioning process.
17 March 2021 in Ophthalmic Genetics
Background: Several novel treatments of inherited retinal degenerations have undergone phase I/IIa clinical trials with limited sample size, yet investigators must still determine if toxicity or an efficacy signal occurred or if the change was due to test–retest variability (TRV) of the measurement tool. Materials and Methods: Synthetic datasets were used to compare three types of TRV estimators under different sample sizes, mean drift, skewness, and number of baseline measurements. Results: Mixed effects models underestimated the standard deviation of measurement error (SDEM); the unbiased change score estimator method (UBS) was more accurate. The fixed effect model had less bias and smaller standard deviation than UBS if >2 baseline measurements. The change score estimator had no bias; other estimators introduced bias for lower variability. With sample size <10, all estimators had high variance. With sample size ≥10, the differences between methods were often minimal. The pooled estimator model did not capture drift, whereas a fixed effect regression or mixed effects models accounted for drift while maintaining an accurate measure of variance. With small sample sizes, the bootstrap estimates of SDEM were severe underestimates, while the jackknife estimates were mildly low but much better. The jackknife was more accurate for the unbiased change score method than for the pooled estimator. Conclusions: The ideal phase I/IIa study has ≥20 subjects and uses UBS or its fixed effect model generalization if >2 baseline measurements. With non-ideal study parameters, investigators should at least quantify the error estimate present in their data analysis.