Importance Globally, access to evidence-based psychological treatment is limited. Innovative self-help methods using smartphone applications and low-cost virtual reality have the potential to significantly improve the accessibility and scalability of psychological treatments. Objective To examine the effectiveness of ZeroPhobia, a fully self-guided app-based virtual reality cognitive behavior therapy (VR CBT) using low-cost (cardboard) virtual reality goggles compared with a wait-list control group and to determine its user friendliness. Design, Setting, and Participants In a single-blind randomized clinical trial, participants were enrolled between March 24 and September 28, 2017, and randomly assigned (1:1) by an independent researcher to either VR CBT app or a wait-list control group. A total of 193 individuals aged 18 to 65 years from the Dutch general population with acrophobia symptoms and access to an Android smartphone participated. The 6 animated modules of the VR-CBT app and gamified virtual reality environments were delivered over a 3-week period in participants’ natural environment. Assessments were completed at baseline, immediately after treatment, and at 3-month follow-up. Analysis began April 6, 2018, and was intention to treat. Intervention Self-guided app-based VR CBT. Main Outcomes and Measures The primary outcome measure was the Acrophobia Questionnaire. The hypothesis was formulated prior to data collection. Results In total, 193 participants (129 women [66.84%]; mean [SD] age, 41.33 [13.64] years) were randomly assigned to intervention (n = 96) or a wait-list control group (n = 97). An intent-to-treat analysis showed a significant reduction of acrophobia symptoms at posttest at 3 months for the VR-CBT app compared with the controls (b = –26.73 [95% CI, −32.12 to −21.34];P < .001;d = 1.14 [95% CI, 0.84 to 1.44]). The number needed to treat was 1.7. Sensitivity and robustness analysis confirmed these findings. Pretreatment attrition was 22 of 96 (23%) because of smartphone incompatibility. Of the 74 participants who started using the VR-CBT app, 57 (77%) completed the intervention fully. Conclusions and Relevance A low-cost fully self-guided app-based virtual reality cognitive behavioral therapy with rudimentary virtual reality goggles can produce large acrophobia symptom reductions. To our knowledge, this study is the first to show that virtual reality acrophobia treatment can be done at home without the intervention of a therapist. Trial Registration Trialregister.nl identifier:NTR6442
30 July 2022 in British Journal of Educational Technology
Participation in educational activities is an important prerequisite for academic success, yet often proves to be particularly challenging in digital settings. Therefore, this study set out to increase participation in an online proctored formative statistics exam by digital nudging. We exploited targeted nudges based on the Fogg Behaviour Model, highlighting the relevance of acknowledging differences in motivation and ability in allocating nudges to elicit target behaviour. First, we assessed whether pre‐existing levels of motivation and perceived ability to participate are effective in identifying different propensities of responsiveness to plain untailored nudges. Next, we evaluated whether tailoring nudges to students' motivation and perceived ability levels increases target behaviour by means of a randomized field experiment in which 579 first‐year university students received 6 consecutive emails over the course of three weeks to nudge behaviour regarding successful participation in the online exam. First, the results point out that motivation explains differences in engagement as indicated by student responsiveness and participation, whereas the perceived ability to participate does not. Second, the results from the randomized field experiment indicate that tailored nudging did not improve observed engagement. Implications for the potential of providing motivational information to improve participation in online educational activities are discussed, as are alternatives for capturing perceived ability more effectively. Practitioner notes: What is already known about this topic Participation in educational activities is an important prerequisite for academic success, yet often proves to be particularly challenging in digital settings. Students' internal barriers to online participation and persistence in higher education are lack of motivation and perceived ability. Nudging interventions tackle students' behavioural barriers, and are particularly effective when guided by a theory of behaviour change, and when targeting students who suffer most from those barriers. What this paper adds This study examines whether the Fogg Behaviour Model is suited to guide a nudging intervention with the aim to increase student engagement in online higher education. This study examines whether students with different levels of motivation and perceived ability vary in their online behaviour in response to nudges. This study experimentally evaluates whether targeted nudges—targeted at students' motivation and perceived ability—are more effective than plain (not‐targeted) nudges. Implications for practice and/or policy The results indicate the importance of motivation for performing nudged behaviours regarding successful participation in an online educational activity. The results do not provide evidence for the role of perceived digital ability, yet do show prior performance on a similar educational activity can effectively distinguish between students' responsiveness. Targeted nudges were not more effective than plain nudges, but the potential of other motivational nudges and how to increase perceived performance are discussed.
For decades, self-report instruments – which rely heavily on students’ perceptions and beliefs – have been the dominant way of measuring motivation and strategy use. An event-based measure based on online trace data arguably has the potential to remove analytical restrictions of self-report measures. The purpose of this study is therefore to triangulate constructs suggested in theory and measured using self-reported data with revealed online traces of learning behaviour. The results show that online trace data of learning behaviour are complementary to self-reports, as they explained a unique proportion of variance in student academic performance and reveal that self-reports explain more variance in online learning behaviour of prior weeks than variance in learning behaviour in succeeding weeks. Student motivation is, however, to a lesser extent captured with online trace data, likely because of its covert nature. In that respect, it is of importance to recognize the crucial role of self-reports in capturing student learning holistically. This manuscript is ‘frontline’ in the sense that event-based measurement methodologies using online trace data are relatively unexplored. The comparison with self-report data made in this manuscript sheds new light on the added value of innovative and traditional methods of measuring motivation and strategy use.
Early Warning Systems (EWS) in higher education accommodate student counsellors by identifying at‐risk students and allow them to intervene in a timely manner to prevent student dropout. This study evaluates an EWS that shares student‐specific risk information with student counsellors, which was implemented at a large Dutch university. A randomised field experiment was conducted to estimate the effect of EWS‐assisted counselling on first‐year student dropout and academic performance. The results show that the EWS accurately predicts at‐risk students. Yet, EWS‐assisted counselling did not reduce dropout, nor improved academic performance. Solving the underlying problem of poor academic performance might require additional actionable feedback and recommended counselling practices.
17 August 2018 in Journal of Computer Assisted Learning