Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet

The use of serious game tools in training of medical professions is steadily growing. However, there is a lack of reliable performance assessment methods to evaluate learner’s outcome. The aim of this study is to determine whether functional near infrared spectroscopy (fNIRS) can be used as an additional tool for assessing the learning outcome of virtual reality (VR) based learning modules. The hypothesis is that together with an improvement in learning outcome there would be a decrease in the participants’ cerebral oxygenation levels measured from the prefrontal cortex (PFC) region and an increase of participants’ serious gaming results. To test this hypothesis, the subjects were recruited and divided into four groups with different combinations of prior virtual reality experience and prior Basic Life Support (BLS) knowledge levels. A VR based serious gaming module for teaching BLS and 16-Channel fNIRS system were used to collect data from the participants. Results of the participants’ scores acquired from the serious gaming module were compared with fNIRS measures on the initial and final training sessions. Kruskal Wallis test was run to determine any significant statistical difference between the groups and Mann–Whitney U test was utilized to obtain pairwise comparisons. BLS training scores of the participants acquired from VR based serious game’s the learning management system and fNIRS measurements revealed decrease in use of resources from the PFC, but increase in behavioral performance. Importantly, brain-based measures can provide an additional quantitative metric for trainee’s expertise development and can assist the medical simulation instructors.

The aim of this study is to evaluate a simulation-based team performance course for medical students and compare its low- and high-fidelity components. This is a prospective crossover observational study. Groups participated in one low- and one high-fidelity session twice. Low-fidelity scenarios included management of an emergency case on a simulated-patient, whereas high-fidelity scenarios constituted of multiple-trauma cases where simulated-patients wore a hyper-realistic suit. Team performance was assessed objectively, using the TEAM™ tool, and subjectively using questionnaires. Questionnaires were also used to assess presence levels, stress levels and evaluate the course. Participants' team performance was higher in the low-fidelity intervention as assessed by the TEAM™ tool. An overall mean increase in self-assessed confidence towards non-technical skills attitudes was noted after the course, however there was no difference in self-assessed performance between the two interventions. Both reported mean stress and presence levels were higher for the high-fidelity module. Evaluation scores for all individual items of the questionnaire were ≥4.60 in both NTS modules. Students have assessed the high-fidelity module higher (4.88 out of 5, SD = 0.29) compared to low-fidelity module (4.74 out of 5, SD = 0.67). Both the low- and high-fidelity interventions demonstrated an improvement in team performance of the attending medical students. The high-fidelity intervention was more realistic, yet more stressful. Furthermore, it proved to be superior in harvesting leadership, teamwork and task management skills. Both modules were evaluated highly by the students, however, future research should address retention of the taught skills and adaptability of such interventions.

Background: Simulation-based Advanced Cardiac Life Support (ACLS) or Advanced Life Support (ALS) training for health care professionals is important worldwide for saving lives. Virtual reality (VR)–based serious gaming can be an alternative modality to be used as a part of simulation-based ALS training. Objective: The aim of this study is to investigate whether a VR-based ALS serious game module can replace classroom-based ALS lectures, the latter being part of existing conventional ALS training protocols in addition to skills training. Methods: Participants were students from Acibadem Mehmet Ali Aydinlar University’s Vocational School for Anesthesiology (N=29) randomly divided into 2 groups with 15 (conventional training group) and 14 (VR-based training group) participants each. Participants in the conventional training group had to complete the pretest consisting of multiple-choice questions at the beginning of the study. Afterward, they took part in an interactive classroom-based ALS lecture. The next step involved skills training with task trainers to teach them compression skills. Following this, the conventional training group was divided into Code Blue teams, each consisting of 5 participants for the simulation session. Two independent instructors evaluated video recordings in terms of technical and nontechnical skills. The score acquired from the manikin-based simulation session was considered the main performance indicator in this study to measure the learning outcome. A similar workflow was used for the VR-based training group, but this group was trained with the VR-based ALS serious game module instead of the theoretical lecture. The final stage of the study involved completing the posttest consisting of multiple-choice questions. A preference survey was conducted among the study participants. Mann-Whitney U and Wilcoxon signed-rank tests were used to analyze the 2 groups’ performances in this study. Results: The improvement in posttest results compared with pretest results was significant in the conventional training group (P=.002). Hands-on technical scores of the conventional training group were higher than those of the VR-based training group during manikin-based simulation, but total scores, including those for technical and crisis resource management skills, acquired from the manikin-based simulation session did not reveal any significant difference between the 2 groups. The results of the VR preference survey revealed that the majority of the participants prefer VR-based serious game–based training instead of classroom lectures. Conclusions: Although hands-on technical scores of the conventional training group during the manikin-based simulation session were higher than those of the VR-based training group, both groups’ total performance scores, including those for technical and crisis resource management skills, did not differ significantly. The preference survey reveals that the majority of the participants would prefer a VR-based ALS serious gaming module instead of lecture-based training. Further studies are required to reveal the learning outcome of VR-based ALS serious gaming. Trial Registration: ClinicalTrials.gov NCT05798910; https://clinicaltrials.gov/study/NCT05798910

Robot-assisted surgery systems are a recent breakthrough in minimally invasive surgeries, offering numerous benefits to both patients and surgeons including, but not limited to, greater visualization of the operation site, greater precision during operation and shorter hospitalization times. Training on robot-assisted surgery (RAS) systems begins with the use of high-fidelity simulators. Hence, the increasing demand of employing RAS systems has led to a rise in using RAS simulators to train medical doctors. The aim of this study was to investigate the brain activity changes elicited during the skill acquisition of resident surgeons by measuring hemodynamic changes from the prefrontal cortex area via a neuroimaging sensor, namely, functional near-infrared spectroscopy (fNIRS). Twenty-four participants, who are resident medical doctors affiliated with different surgery departments, underwent an RAS simulator training during this study and completed the sponge suturing tasks at three different difficulty levels in two consecutive sessions/blocks. The results reveal that cortical oxygenation changes in the prefrontal cortex were significantly lower during the second training session (Block 2) compared to the initial training session (Block 1) (p < 0.05).

Background: Serious games enrich simulation-based health care trainings and improve knowledge, skills, and self-confidence of learners while entertaining them. Objective: A platform which can combine performance data from a basic life support (BLS) serious game app and hands-on data based on the same scoring system is not available in the market. The aim of this study was to create such a platform and investigate whether performance evaluation of BLS trainings would be more objective compared to conventional Objective Structured Clinical Examination (OSCE) examinations if these evaluations were carried out with the platform which combines OSCE scoring criteria with sensor data retrieved from the simulator’s sensors. Methods: Participants were 25 volunteers (11 men [44.0%] and 14 [56.0] women) among Acıbadem Mehmet Ali Aydınlar University students without prior knowledge of the BLS protocol. A serious game module has been created for teaching learners the European Resuscitation Council Basic Life Support 2015 protocol. A second module called the hands-on module was designed for educators. This module includes a checklist used for BLS OSCE examinations and can retrieve sensor data such as compression depth, compression frequency, and ventilation volume from the manikin (CPR Lilly; 3B Scientific GmbH) via Bluetooth. Data retrieved from the sensors of the manikin enable educators to evaluate learners in a more objective way. Performance data retrieved from the serious gaming module have been combined with the results of the hands-on module. Data acquired from the hands-on module have also been compared with the results of conventional OSCE scores of the participants, which were obtained by watching the videos of the same trainings. Results: Participants were considered successful in the game if they scored 80/100 or above. Overall, participants scored 80 or above in an average of 1.4 (SD 0.65) trials. The average BLS serious game score was 88.3/100 (SD 5.17) and hands-on average score was 70.7/100 (SD 17.3), whereas the OSCE average score was 84.4/100 (SD 12.9). There was no statistically significant correlation between success on trials (score ≥80/100), serious game, hands-on training app, and OSCE scores (Spearman rho test, P>.05). The mean BLS serious game score of the participants was 88.3/100 (SD 5.17), whereas their mean hands-on training app score was 70.7/100 (SD 17.3) and OSCE score was 84.4/100 (SD 12.9). Conclusions: Although scoring criteria for OSCE and hands-on training app were identical, OSCE scores were 17% higher than hands-on training app scores. After analyzing the difference of scores between hands-on training app and OSCE, it has been revealed that these differences originate from scoring parameters such as compression depth, compression frequency, and ventilation volume. These data suggest that evaluation of BLS trainings would be more objective if these evaluations were carried out with the modality, which combines visual OSCE scoring criteria with sensor data retrieved from the simulator’s sensors. Trial Registration: ClinicalTrials.gov NCT04533893; https://clinicaltrials.gov/ct2/show/NCT04533893