Background: Feedback processes are crucial for learning, guiding improvement, and enhancing performance. In workplace-based learning settings, diverse teaching and assessment activities are advocated to be designed and implemented, generating feedback that students use, with proper guidance, to close the gap between current and desired performance levels. Since productive feedback processes rely on observed information regarding a student's performance, it is imperative to establish structured feedback activities within undergraduate workplace-based learning settings. However, these settings are characterized by their unpredictable nature, which can either promote learning or present challenges in offering structured learning opportunities for students. This scoping review maps literature on how feedback processes are organised in undergraduate clinical workplace-based learning settings, providing insight into the design and use of feedback. Methods: A scoping review was conducted. Studies were identified from seven databases and ten relevant journals in medical education. The screening process was performed independently in duplicate with the support of the StArt program. Data were organized in a data chart and analyzed using thematic analysis. The feedback loop with a sociocultural perspective was used as a theoretical framework. Results: The search yielded 4,877 papers, and 61 were included in the review. Two themes were identified in the qualitative analysis: (1) The organization of the feedback processes in workplace-based learning settings, and (2) Sociocultural factors influencing the organization of feedback processes. The literature describes multiple teaching and assessment activities that generate feedback information. Most papers described experiences and perceptions of diverse teaching and assessment feedback activities. Few studies described how feedback processes improve performance. Sociocultural factors such as establishing a feedback culture, enabling stable and trustworthy relationships, and enhancing student feedback agency are crucial for productive feedback processes. Conclusions: This review identified concrete ideas regarding how feedback could be organized within the clinical workplace to promote feedback processes. The feedback encounter should be organized to allow follow-up of the feedback, i.e., working on required learning and performance goals at the next occasion. The educational programs should design feedback processes by appropriately planning subsequent tasks and activities. More insight is needed in designing a full-loop feedback process, in which specific attention is needed in effective feedforward practices.
26 August 2024 in IEEE Transactions on Learning Technologies
This article presents a controlled case study focused on implementing and using Generative Artificial Intelligence (AI), specifically Large Language Models (LLM) in physiotherapy education to assist instructors with formulating effective technology-mediated feedback for students. It outlines how these advanced technologies have been integrated into an existing feedback-oriented platform to guide instructors in providing feedback inputs and establish a reference framework for future innovations in practical skills training for health professions education. Specifically, the proposed solution uses LLM to automatically evaluate feedback inputs made by instructors based on pre-defined and literature-based quality criteria and generates actionable textual explanations for reformulation. In addition, if the instructor requires, the tool supports summary generation for large sets of text inputs to achieve better student reception and understanding. The case study describes how these features were integrated into the feedback-oriented platform, how their effectiveness was evaluated in a controlled setting with documented feedback inputs, and the results of its implementation with real users through cognitive walkthroughs. Initial results indicate that this innovative implementation holds great potential to enhance learning and performance in physiotherapy education and has the potential to expand to other health disciplines where the development of procedural skills is critical, offering a valuable tool to assess and improve feedback based on quality standards for effective feedback processes. The cognitive walkthroughs allowed us to determine participants' usability decisions in the face of these new features and to evaluate the perceived usefulness, how this would integrate into their workload, and their opinion regarding the potential for the future within this teaching strategy. The article concludes with a discussion of the implications of these findings for practice and future research directions in this developing field.
Background: During the COVID-19 pandemic, face-to-face teaching and learning of physiotherapy practical skills was limited. Asynchronous, remote training has been effective in development of clinical skills in some health professions. This study aimed to determine the effect of remote, asynchronous training and feedback on development of neurodynamic skills in physiotherapy students. Methods: Longitudinal repeated measurements study, across four training sessions. Participants engaged in a remote training program for development of upper limb neurodynamic techniques. In this sequential training, participants viewed the online tutorial, practiced independently, and uploaded a video of their performance for formative assessment and feedback from a trained instructor via a checklist and rubric. Results: Intra-subject analyses of 60 third-year physiotherapy students showed that the target standard of performance, with no further significant change in scores, was attained following session 2 for the checklist and session 3 for the rubric. This shows that two sessions are required to learn the procedures, and three sessions yield further improvements in performance quality. Conclusion: The remote, asynchronous training and feedback model proved to be an effective strategy for students’ development of neurodynamic testing skills and forms a viable alternative to in-person training. This study contributes to the future of acquiring physiotherapy clinical competencies when distance or hybrid practice is required.
Remote technology has been widely incorporated into health professions education. For procedural skills training, effective feedback and reflection processes are required. Consequently, supporting a self-regulated learning (SRL) approach with learning analytics dashboards (LADs) has proven beneficial in online environments. Despite the potential of LADs, understanding their design to enhance SRL and provide useful feedback remains a significant challenge. Focusing on LAD design, implementation, and evaluation, the study followed a mixed-methods two-phase design-based research approach. The study used a triangulation methodology of qualitative interviews and SRL and sensemaking questionnaires to comprehensively understand the LAD’s effectiveness and student SRL and feedback uptake strategies during remote procedural skills training. Initial findings revealed the value students placed on performance visualization and peer comparison despite some challenges in LAD design and usability. The study also identified the prominent adoption of SRL strategies such as help-seeking, elaboration, and strategic planning. Sensemaking results showed the value of personalized performance metrics and planning resources in the LAD and recommendations to improve reflection and feedback uptake. Subsequent findings suggested that SRL levels significantly predicted the levels of sensemaking. The students valued the LAD as a tool for supporting feedback uptake and strategic planning, demonstrating the potential for enhancing procedural skills learning.
Introduction Research activities have a positive impact on the performance of residents. However, information on research conducted by residents from developing countries is scarce. Our study sought to identify the barriers and facilitators for developing research in medical residency programs in a Latin-American faculty of medicine. Methods A mixed methodology study design was carried out. We used a grounded theory approach for the qualitative phase, collecting data through semi-structured interviews and focus groups with faculty and residents. For the quantitative phase, surveys were administered to residents and teachers. We used factor analysis and scree plot (validity), Cronbach's alpha, and Intraclass correlation coefficient (reliability) to evaluate the surveys' psychometric properties. Results Focus groups involving ten faculty members and 15 residents were conducted, and the following domains were identified: a) facilitators for resident participation, b) barriers, c) strategies for introducing research into the curriculum, d) arguments supporting research activities throughout medical residency, and e) profile of research-motivated residents. Both residents and faculty members identified a lack of protected time and adequate mentoring as the major barriers. A gender gap was found related to international publications (34% vs. 66% women/men); women perceived that research activities 'compete with other activities' (OR: 2.04, 95% CI 1.03 to 4.07). Conclusions Research is highly valued by both residents and faculty members at a Latin-American university with a strong academic output. Major barriers to promoting research in this context include lack of protected time and effective mentoring, and gender gaps. Strategies proposed to improve research within medical residency programs include: establishing an interdisciplinary mentoring program between residents and researchers, promoting elective rotations, and rewarding proposals that consider gender equity.
14 December 2022 in European Journal of Dental Education
IntroductionClinical reasoning is a core competence in health professions that impacts the ability to solve patients' health problems. Due to its relevance, it is necessary to identify difficulties arising from different sources that affect clinical reasoning development in students. The aim of this study was to explore a comprehensive approach to identify challenges for clinical reasoning development in undergraduate dental students and their potential solutions. MethodsMixed methods were used in four stages: (1) students and clinical teachers focus groups to identify challenges to clinical reasoning development; (2) literature review to explore potential solutions for these challenges; (3) Delphi technique for teacher consensus on pertinence and feasibility of solutions (1-5 scale); and (4) teachers' self-perception of their ability to implement the solutions. ResultsThree categories and seven subcategories of challenges were identified: (I) educational context factors influencing the clinical reasoning process; (II) teacher's role in clinical reasoning development; and (III) student factors influencing the clinical reasoning process. From 134 publications identified, 53 were selected for review, resulting in 10 potential solutions. Through two Delphi rounds, teachers rated the potential solutions very highly in terms of relevance (4.50-4.85) and feasibility (3.50-4.29). Finally, a prioritisation ranking of these solutions was generated using their scores for relevance, feasibility, and teachers' self-perception of their ability to implement them. ConclusionsThe present comprehensive approach identified challenges for clinical reasoning development in dental students and their potential solutions, perceived as relevant and feasible by teachers, requiring further research and follow-up actions to address them.