Background: Electronic mental health interventions (eMental health or eMH) can be used to increase accessibility of mental health services for mood disorders, with indications of comparable clinical outcomes as face-to-face psychotherapy. However, the actual use of eMH in routine mental health care lags behind expectations. Identifying the factors that might promote or inhibit implementation of eMH in routine care may help to overcome this gap between effectiveness studies and routine care. Objective: This paper reports the results of a systematic review of the scientific literature identifying those determinants of practices relevant to implementing eMH for mood disorders in routine practice. Methods: A broad search strategy was developed with high sensitivity to four key terms: implementation, mental health care practice, mood disorder, and eMH. The reach, effectiveness, adoption, implementation, and maintenance (RE-AIM) framework was applied to guide the review and structure the results. Thematic analysis was applied to identify the most important determinants that facilitate or hinder implementation of eMH in routine practice. Results: A total of 13,147 articles were screened, of which 48 studies were included in the review. Most studies addressed aspects of the reach (n=33) of eMH, followed by intervention adoption (n=19), implementation of eMH (n=6), and maintenance (n=4) of eMH in routine care. More than half of the studies investigated the provision of mental health services through videoconferencing technologies (n=26), followed by Internet-based interventions (n=20). The majority (n=44) of the studies were of a descriptive nature. Across all RE-AIM domains, we identified 37 determinants clustered in six main themes: acceptance, appropriateness, engagement, resources, work processes, and leadership. The determinants of practices are expressed at different levels, including patients, mental health staff, organizations, and health care system level. Depending on the context, these determinants hinder or facilitate successful implementation of eMH. Conclusions: Of the 37 determinants, three were reported most frequently: (1) the acceptance of eMH concerning expectations and preferences of patients and professionals about receiving and providing eMH in routine care, (2) the appropriateness of eMH in addressing patients’ mental health disorders, and (3) the availability, reliability, and interoperability with other existing technologies such as the electronic health records are important factors for mental health care professionals to remain engaged in providing eMH to their patients in routine care. On the basis of the taxonomy of determinants of practices developed in this review, implementation-enhancing interventions can be designed and applied to achieve better implementation outcomes. Suggestions for future research and implementation practice are provided.

Background: The System Usability Scale (SUS) is used to measure usability of internet-based Cognitive Behavioural Therapy (iCBT). However, whether the SUS is a valid instrument to measure usability in this context is unclear. The aim of this study is to assess the factor structure of the SUS, measuring usability of iCBT for depression in a sample of professionals. In addition, the psychometric properties (reliability, convergent validity) of the SUS were tested. Methods: A sample of 242 professionals using iCBT for depression from 6 European countries completed the SUS. Confirmatory Factor Analysis (CFA) was conducted to test whether a one-factor, two-factor, tone-model or bi-direct model would fit the data best. Reliability was assessed using complementary statistical indices (e.g. omega). To assess convergent validity, the SUS total score was correlated with an adapted Client Satisfaction Questionnaire (CSQ-3). Results: CFA supported the one-factor, two-factor and tone-model, but the bi-factor model fitted the data best (Comparative Fit Index = 0.992, Tucker Lewis Index = 0.985, Root Mean Square Error of Approximation = 0.055, Standardized Root Mean Square Residual = 0.042 (respectively χ²_diff (9) = 69.82, p < 0.001; χ²_diff (8) ₌ 33.04, p < 0.001). Reliability of the SUS was good (ω = 0.91). The total SUS score correlated moderately with the CSQ-3 (CSQ1 r_s = .49, p < 0.001; CSQ2 r_s = .46, p < 0.001; CSQ3 r_s = .38, p < 0.001), indicating convergent validity. Conclusions: Although the SUS seems to have a multidimensional structure, the best model showed that the total sumscore of the SUS appears to be a valid and interpretable measure to assess the usability of internet-based interventions when used by professionals in mental healthcare.

Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet #Preprint #PeerReviewMe: Warning: This is a unreviewed preprint. Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn. Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period. Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author). Background: The implementation of eMental health interventions (eMH) in routine healthcare constitutes a major challenge, and reliable instruments to assess implementation processes are lacking. The Normalisation MeAsure Development project (NoMAD) developed a 20-item self-report questionnaire to overcome this gap. Based on the Normalisation Process Theory, this instrument focuses on four generative mechanisms involved in implementation processes: Coherence, Cognitive Participation, Collective Action, and Reflexive MONITORING. A psychometric assessment of the original English version of NoMAD indicates that the theoretical model represented the data acceptably. Objective: We translated the NoMAD questionnaire to Dutch and studied the factor structure in Dutch mental healthcare settings. Methods: Dutch healthcare professionals involved in eMH implementation were invited to complete the NoMAD questionnaire. Confirmatory Factor Analysis (CFA) was conducted to verify interpretability of scale scores for three models: (1) the theoretical four-factor structure, (2) a unidimensional model, and (3) a hierarchical model. Potential improvements were identified exploratively, and correlated scale scores with three control questions were used to assess convergent validity. Results: 313 healthcare professionals from mental healthcare settings completed the questionnaire (female: 77%; age: M = 46 ± 11). The internal consistency of the 20-item questionnaire was acceptable (.64 ≤ α ≤ .87). The theorised four-factor model and the hierarchical model fitted the data reasonably well in the CFA. The theorised four-factor model performed slightly better (CFI = .92, TLI = .90, RMSEA = .09, SRMR = .11, χ2diff = 25.21, p ≤ .05). Notwithstanding the significance, the difference is small and possibly not outweighing the practical relevance of a total score and sub-scale scores combined in one measurement model. One item was identified as weak (λCA.2 = .18). A moderate to strong convergent validity was found for two of the four sub-scales (.37 ≤ r ≤ .56, p ≤ .05). Conclusions: NoMAD’s theoretical factor structure was confirmed among mental healthcare professionals as meeting acceptable standards. The hierarchical model might prove useful in increasing the practical utility of the NoMAD questionnaire. The data suggests that NoMAD holds across service settings including Dutch mental healthcare. Future research should assess the questionnaire’s relative predictive value and responsiveness over time, and clarify the conceptual interpretability of the scale scores in implementation practices.

(1) Background: Blended cognitive behavioral therapy (bCBT; online and face-to-face sessions) seems a promising alternative alongside regular face-to-face CBT depression treatment in specialized mental health care organizations. Therapists are key in the uptake of bCBT. This study focuses on therapists’ perspectives on usability, satisfaction, and factors that promote or hinder the use of bCBT in routine practice; (2) Methods: Three focus groups (n = 8, n = 7, n = 6) and semi-structured in-depth interviews (n = 15) were held throughout the Netherlands. Beforehand, the participating therapists (n = 36) completed online questionnaires on usability and satisfaction. Interviews were analyzed by thematic analysis; (3) Results: Therapists found the usability sufficient and were generally satisfied with providing bCBT. The thematic analysis showed three main themes on promoting and hindering factors: (1) therapists’ needs regarding bCBT uptake, (2) therapists’ role in motivating patients for bCBT, and (3) therapists’ experiences with bCBT; (4) Conclusions: Overall, therapists were positive; bCBT can be offered by all CBT-trained therapists and future higher uptake is expected. Especially the pre-set structure of bCBT was found beneficial for both therapists and patients. Nevertheless, therapists did not experience promised time-savings—rather, the opposite. Besides, there are still teething problems and therapeutic shortcomings that need improvement in order to motivate therapists to use bCBT.

Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet

Internet-based Cognitive Behavioural Therapy (iCBT) for the treatment of depressive disorders is innovative and promising. Various studies have demonstrated large effect sizes up to 2.27, but implementation in routine practice lags behind. Mental health therapists play a significant role in the uptake of internet-based interventions. Therefore, it is interesting to study factors that influence the therapists in whether they apply internet-based therapy or not. This study, as part of the European implementation project MasterMind, aims to identity the factors that promote or hinder therapists in the use of iCBT in depression care. The uptake of iCBT by therapists in routine mental health care practice for the treatment of depression will be evaluated by a mixed method approach, to provide an understanding of the implementation factors (quantitative), and to ascertain the facilitating and hindering factors in the involvement of therapists in the implementation of iCBT (qualitative). The involvement of therapists in the implementation of iCBT is analysed following the RE-AIM framework on the five dimensions Reach, Efficacy/Effectiveness, Adoption, Implementation, and Maintenance. This enables us to evaluate the reach of therapists, the impact of iCBT on depression care, the extent to which therapists adopt iCBT, the extent to which iCBT is delivered as intended, and how iCBT can be maintained over time. The results will provide valuable insight into the role of therapists in the implementation of iCBT for depression in secondary mental health care settings. They will result in concrete recommendations for how therapists can be facilitated in implementing and up-scaling iCBT for depression.