28 September 2023 in Computers in Human Behavior Reports
13 November 2024 in Medical Science Educator
TRTamina Rockwell-Kollmann
This review aims to provide a summary of all scientific publications on the use of large language models (LLMs) in medical education over the first year of their availability. A scoping literature review was conducted in accordance with the PRISMA recommendations for scoping reviews. Five scientific literature databases were searched using predefined search terms. The search yielded 1509 initial results, of which 145 studies were ultimately included. Most studies assessed LLMs’ capabilities in passing medical exams. Some studies discussed advantages, disadvantages, and potential use cases of LLMs. Very few studies conducted empirical research. Many published studies lack methodological rigor. We therefore propose a research agenda to improve the quality of studies on LLM.
2 April 2024 in Advances in Health Sciences Education
Serious games, as a learning resource, enhance their game character by embedding game design elements that are typically used in entertainment games. Serious games in its entirety have already proven their teaching effectiveness in different educational contexts including medical education. The embedded game design elements play an essential role for a game’s effectiveness and thus they should be selected based on evidence-based theories. For game design elements embedded in serious games used for the education of medical and healthcare professions, an overview of theories for the selection lacks. Additionally, it is still unclear whether and how single game design elements affect the learning effectiveness. Therefore, the main aim of this systematic review is threefold. Firstly, light will be shed on the single game design elements used in serious games in this area. Second, the game design elements’ underlying theories will be worked out, and third, the game design elements’ effectiveness on student learning outcome will be assessed. Two literature searches were conducted in November 2021 and May 2022 in six literature databases with keywords covering the fields of educational game design, serious game, and medical education. Out of 1006 initial records, 91 were included after applying predefined exclusion criteria. Data analysis revealed that the three most common game design elements were points, storyline, and feedback. Only four underlying theories were mentioned, and no study evaluated specific game design elements. Since game design elements should be based on theories to ensure meaningful evaluations, the conceptual GATE framework is introduced, which facilitates the selection of evidence-based game design elements for serious games.
27 February 2025 in Medical Science Educator
Objective: Virtual patients are already utilized in the teaching of medical history taking. Since its emergence, ChatGPT has been integrated into several areas of medical education. This study aimed to examine whether ChatGPT can be used to train empathic history taking while fostering students’ subjective autonomy. Methods: Third-year medical students took histories with ChatGPT 3.5 after entering a predefined prompt covering cardiological diseases. Afterwards, students answered a questionnaire regarding their experienced autonomy. All chats were analyzed using the Empathic Communication Coding System measuring ChatGPT’s given empathic opportunities as well as students’ responses. Results: Out of 659 interactions, 93 were identified as empathic. ChatGPT provided opportunities mostly through reporting emotional statements or challenges. Students sometimes missed reacting adequately to ChatGPT’s opportunities but more often responded by implicit recognition of patient perspective and reported a high level of experienced autonomy. Conclusions: The study yielded preliminary results that ChatGPT might be suitable as a tool mimicking a virtual patient while enabling an empathic history taking. To date, ChatGPT seems valid as a supplement to training with simulated patients. Medical faculty could consider integrating ChatGPT into teaching, such as through a flipped classroom approach, to guide students in its use as ChatGPT continues to gain attention.
27 September 2024 in BMC Medical Education
MLMatthias Carl Laupichler
Background: Serious games are risk-free environments training various medical competencies, such as clinical reasoning, without endangering patients’ safety. Furthermore, serious games provide a context for training situations with unpredictable outcomes. Training these competencies is particularly important for healthcare professionals in emergency medicine. Methods: Based on these considerations, we designed, implemented, and evaluated a serious game in form of an emergency department, containing the features of a virtual patient generator, a chatbot for medical history taking with self-formulated questions, artificially generated faces based on an artificial intelligence algorithm, and feedback for students. The development process was based on an already existing framework resulting in an iterative procedure between development and evaluation. The serious game was evaluated using the System Usability Scale and the User Experience Questionnaire. Results: The System Usability Scale provided a substantial result for the usability. In terms of the user experience, four scales yielded positive results, whereas two scales yielded neutral results. Conclusion: The evaluation of both usability and user experience yielded overall positive results, while simultaneously identifying potential areas for improvement. Further studies will address the implementation of additional game design elements, and testing student learning outcome.