The U.S. Department of Defense (DoD) aims to prevent suicide, harassment, sexual assault, and partner and child maltreatment by implementing evidence-based behavioral health interventions (EBIs). However, sustaining EBI implementation over time and with fidelity to result in meaningful impacts is a tremendous challenge. We interviewed 35 military leaders in positions to observe, and possibly hinder, the erosions of EBI implementations to learn what distinguishes EBIs that sustain in the military from those that fade away. Thematic analysis identified barriers and supports to EBI sustainment consistent with the Consolidated Framework for Implementation Research, reflecting the domains: outer setting, inner setting, individuals, and innovation. Participants described how factors at different levels of the social ecology interact with each other and emphasized how aspects of military culture (e.g., hierarchical structure, frequent moves, mission focus) can both support and challenge implementing and sustaining behavioral-health EBIs. EBI implementation in the military differs from most civilian settings in that service member participation in certain preventative programs is mandated. The results indicate how policy and practice can strengthen sustained EBI implementation to reduce harm and support service members.
Introduction: The Office of the Secretary of Defense and each of the services have made an unprecedented commitment to the prevention of sexual assault and related behavioral health phenomena. Indeed, the Department of Air Force has selected, in some cases tailored, and disseminated a wide array of evidence-based preventative programs, policies, and practices (EBPs) over the last few decades. However, many of these efforts seem to follow a predictable life course. EBPs are initially implemented with great enthusiasm, supported for a few years, then fall out of favor, and are replaced by a different effort. This research effort aims to build on the existing civilian implementation science research to (1) offer a military-specific model of sustained, high-quality implementation and (2) test this model in a series of interconnected studies. Materials and Methods: New York University’s Institutional Review Board approved the study protocols, and the Army’s Human Research Protection Office provided permission to collect data. We conducted interviews first with prevention leaders in the services and at the Office of the Secretary of Defense level regarding factors that they thought helped or hurt the sustainment of EBPs. We used these interviews to identify EBPs currently implemented in Department of Air Force and selected four EBPs out of the 25 identified for intensive study. We then interviewed implementers of those four EBPs regarding what they thought helped or hurt the sustainment of that EBP. We also gathered information about the 25 currently implemented EBPs themselves and gathered policy and guidance, as well as leadership communication about those EBPs and the target problems they focus on. We coded this information to allow us to test EBP parameters and policy and leader communication that predict sustained high-quality implementation. We conducted over 100 observations of the 4 EBPs we are studying intensively and have collected quantitative data from implementers and participants to help us test factors related to sustained high-quality implementation within each of those 4 EBPs and across the EBPs. Results: Several military-specific factors were nominated for inclusion in the military-specific model of implementation sustainment. The implementation of even highly standardized EBPs varies greatly. Implementers and participants are generally highly engaged, but implementers vary in the extent to which they understand the mechanisms of action for the EBP they are implementing. Conclusions: We recommend training implementers in the mechanisms of action in the EBPs they are expected to implement and including quality assurance as a component of prevention efforts in a manner more similar to how the military addresses aspects of the operational mission. By moving beyond counting classes and attendance, and specifying how to engage participants in the EBPs in the manner that produces the key outcomes, it is likely that EBPs will have more robust implementations that can be better sustained over time.
The need for standardized criteria in partner and child maltreatment response systems is critical for providing fair decisions, allocating family support, producing reliable research findings, and aiding prevention efforts, among other tasks. The primary goal of this study was to replicate Heyman and Slep's (see record 2009-23534-017) study-whether maltreatment incident determination committee decisions of local sites matched those of master reviewers. This study extended the prior work by testing if specific training techniques (i.e., social worker self-assessments, motivation-enhanced briefs, per-case feedback) increased the master reviewer-site concordance of the Field-Tested Assessment, Intervention-Planning, and Response (FAIR) system. Overall agreement between the master reviewers and the committees was 87%, indicating good agreement but falling just below the 91%-92% achieved in earlier FAIR dissemination studies. Sites were randomly assigned to one of eight training conditions using a multiphase optimization strategy design. The full factorial model was not statistically significant, indicating that the training techniques were not associated with committees' voting fidelity. The replicated agreement findings indicate that the FAIR system can be implemented successfully on a large scale and produce consistently good agreement on family maltreatment case decisions. Areas for future research are discussed (e.g., testing and usage of evidence-informed training techniques). (PsycInfo Database Record (c) 2025 APA, all rights reserved).