Virtual Integrated Multi-Site Patient Aligned Care Team (V-IMPACT) was a Veterans Health Administration (VHA) initiative created to increase access to primary care for Veterans through Clinical Video Telehealth (CVT) appointments. Between January and August 2019, we conducted 48 semi-structured qualitative interviews with Veterans who had a V-IMPACT appointment. Many participants shared feelings of skepticism before their first appointments but for some, their opinions changed. Veterans talked about how their opinion of video care changed for the better when it made care more convenient or timelier or met their health care needs. For some Veterans, their opinion about video care stayed the same or worsened because they had a poor relationship or rapport with their provider, did not feel like they received needed care, or did not feel like video care was useful. These findings offer an opportunity for telecare providers to better understand and support patients and to deliver effective care in the context of rapidly growing telehealth modalities.
Introduction: The United States Veterans Health Administration (VHA) Office of Rural Health funds Enterprise-Wide Initiatives (system-wide initiatives) to spread promising practices to rural Veterans. The Office requires that evaluations of Enterprise-Wide Initiatives use the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework. This presents a unique opportunity to understand the experience of using RE-AIM across a series of evaluations. The authors conducted a study to document the benefits and pitfalls of using RE-AIM, capture the variety of ways that the team captured the elements of RE-AIM, and develop recommendations for the future use of RE-AIM in evaluation.Materials and methods: The authors first conducted a document review to capture pre-existing information about how RE-AIM was used. They subsequently facilitated two focus groups to gather more detailed information from team members who had used RE-AIM. Finally, they used member-checking throughout the writing process to ensure accurate data representation and interpretation and to gather additional feedback.Results: Four themes emerged from the document review, focus groups, and member checking. RE-AIM: provides parameters and controls the evaluation scope, “buckets” are logical, plays well with other frameworks, and can foster collaboration or silo within a team. Challenges and attributes for each RE-AIM dimension were also described.Discussion: Overall, participants reported both strengths and challenges to using RE-AIM as an evaluation framework. The overarching theme around the challenges with RE-AIM dimensions was the importance of context. Many of these benefits and challenges of using RE-AIM may not be unique to RE-AIM and would likely occur when using any prescribed framework. The participants reported on the RE-AIM domains in a variety of ways in their evaluation reports and were not always able capture data as originally planned. Recommendations included: start with an evaluation framework (or frameworks) and revisit it throughout the evaluation, consider applying RE-AIM PRISM (Practical Robust Implementation Framework) to gain a broader perspective, and intentionally integrate quantitative and qualitative team members, regardless of the framework used.
24 February 2022 in American Journal of Evaluation
Site visits are common in evaluation plans but there is a dearth of guidance about how to conduct them. This paper revisits site visit standards published by Michael Patton in 2017 and proposes a framework for evaluative site visits. We retrospectively examined documents from a series of site visits for examples of Patton's standards. Through this process, we identified additional standards and organized them into four categories and fourteen standards that can guide evaluation site visits: team competencies and knowledge (interpersonal competence, cultural humility, evaluation competence, methodological competence, subject matter knowledge, site specific knowledge), planning and coordination (project design, resources, data management), engagement (team engagement, sponsor engagement, site engagement), and confounding factors (neutrality, credibility). In the paper, we provide definitions and examples from the case of meeting, and missing, the standards. We encourage others to apply the framework in their contexts and continue the discussion around evaluative site visits.
The Veterans Health Administration (VHA) has evolved its approach to chronic pain management, emphasizing the social context of pain and self-management strategies. This article describes the implementation of Vet-to-Vet, an interpersonal group that personifies this shift in VHA strategy by combining mutual help, mindfulness, and storytelling in weekly virtual meetings led by veterans experiencing chronic pain. An evaluation of the Rocky Mountain Regional Veterans Affairs Medical Center Vet-to-Vet group indicated high engagement, with many participants attending for ≥ 6 months. Qualitative findings highlight the program’s positive impact, particularly in fostering connections among veterans, facilitating mutual support, and empowering participants to better manage pain and become stronger advocates for their care. Participants reported improvements in accessing help, positive health outcomes, and addressing the psychological aspects of pain. Vet-to-Vet shows promise as an approach to chronic pain care that aligns with VHA whole health strategies. An ongoing evaluation will explore program effectiveness as it expands to additional sites, with the goal of embedding peer support and mutual help across various contexts.
6 August 2026 in Implementation Science Communications
Background: Veterans receiving care in Veterans Health Administration (VA) and non-VA settings often face fragmented care coordination, leading to adverse outcomes. Our study aimed to enhance Veteran care coordination through three evidence-based interventions. Relational Coordination (RC) theory emphasizes enhancing communication and relationships to strengthen team dynamics, which improves care quality. This study evaluated whether RC guided facilitation (relational facilitation) enhanced collaboration and coordinated care within and between teams during intervention implementation. Methods: From 2021 to 2025 trained facilitators supported intervention implementation across 15 VAs using relational facilitation. Key activities included team role identification, relational map development, RC Survey deployment, and RC-related SMART (specific, measurable, attainable, relevant, time-based) goal setting. Relational facilitation impact was assessed using mixed methods incorporating survey data and participant interviews. Results: Nine sites ( n = 138/1017 participants) completed pre/post surveys, with 8.3% average increase post-implementation for most sites ( n = 7/9). Participants reported relational facilitation strengthened team dynamics and improved care coordination. Conclusion: Relational facilitation enhanced teams’ collaboration and intervention implementation. Relational facilitation can improve collaboration and patient outcomes.
There has been limited attention to the role of research on evaluation (RoE) in PhD‐level evaluator education. Previous research suggests that evaluator education doctoral programs have multiple purposes to prepare practitioners and researchers, thus creating an unnamed tension where evaluation practice is the focus and RoE has not been integrated. Therefore, a gap exists in understanding how students learn RoE within existing programs. This collaborative autoethnography seeks to address this need from the perspective of PhD students actively engaged in learning RoE. This study examines the experiences of six mid‐career evaluators in PhD programs across five US universities. An ecological systems theory conceptual framework was used to understand micro (individual), meso (program), and macro (field) factors that influenced PhD student experiences. Findings revealed that authors’ practitioner background and positionality, faculty support and institutional culture, and connections within the evaluation field significantly shaped their knowledge of RoE and scholarly development. Constraints in formal RoE coursework, applied opportunities, and funding created barriers to achieving desired RoE‐related academic goals. Additionally, the study offers opportunities to enhance RoE preparation across individual, programmatic, and broader systems levels, including developing reflective practice skills, expanding cross‐institutional collaborations, and strengthening the relationship between evaluation practice and research. Findings and implications contribute to evaluation programs, faculty, and the broader evaluation community to improve RoE learning across the educational ecosystem.