To increase the likelihood of successful implementation of interventions and promote dissemination across real-world settings, it is essential to evaluate outcomes related to dimensions other than Effectiveness alone. Glasgow and colleagues' RE-AIM framework specifies four additional types of outcomes that are important to decision-makers: Reach, Adoption, Implementation (including cost), and Maintenance. To further strengthen RE-AIM, we propose integrating qualitative assessments in an expanded framework: RE-AIM Qualitative Evaluation for Systematic Translation (RE-AIM QuEST), a mixed methods framework. RE-AIM QuEST guides formative evaluation to identify real-time implementation barriers and explain how implementation context may influence translation to additional settings. RE-AIM QuEST was used to evaluate a pharmacist-led hypertension management intervention at 3 VA facilities in 2008-2009. We systematically reviewed each of the five RE-AIM dimensions and created open-ended companion questions to quantitative measures and identified qualitative and quantitative data sources, measures, and analyses. To illustrate use of the RE-AIM QuEST framework, we provide examples of real-time, coordinated use of quantitative process measures and qualitative methods to identify site-specific issues, and retrospective use of these data sources and analyses to understand variation across sites and explain outcomes. For example, in the Reach dimension, we conducted real-time measurement of enrollment across sites and used qualitative data to better understand and address barriers at a low-enrollment site. The RE-AIM QuEST framework may be a useful tool for improving interventions in real-time, for understanding retrospectively why an intervention did or did not work, and for enhancing its sustainability and translation to other settings.
Mobile health (m-health) tools are a promising strategy to facilitate the work of community health workers (CHWs) in low- and middle-income countries (LMICs). Despite their potential value, little is known about CHWs’ experiences working with m-health tools in their outreach activities with community members. To understand the benefits of and barriers to using m-health tools for CHWs, we conducted semi-structured interviews with 57 CHWs employed in six primary care centers in São Paulo, Brazil. All CHWs had experience using a cell phone application called Geohealth for collecting health and demographic data of community members. We assessed their experiences using Geohealth and recommendations for improvements. CHWs described key benefits of using Geohealth as helping them save time with bureaucratic paperwork, organizing the data that they needed to collect, and by replacing sheaves of paper, reducing the weight that they carried in the field. However, there were many technical and social barriers to the successful adoption of the m-health tool. Key among these were poor quality hardware, faulty software programs, and negative community member perceptions of the m-health program. The CHWs provided valuable input as to how Geohealth could be improved to fit their needs. m-health tools have the potential to facilitate the work of CHWs in LMICs. However, such tools must be designed and implemented thoughtfully. Technical barriers related to both hardware and software must be anticipated and addressed to maximize their efficiency and successful adoption. CHW input on the design of the tool should be sought to maximize its utility and minimize barriers to use.
The Preventing Maternal And Neonatal Deaths (PREMAND) project works to understand the social and cultural factors that may contribute to the deaths and near-misses (people who almost die but end up surviving) of mothers and babies in four districts in Northern Ghana. Examples of these factors include such thing as treating a sick baby at home with traditional medicine instead of going to a hospital or health center, or pregnant women needing permission from several people before they can go to a hospital to deliver. These social and cultural factors will be placed on a map to understand where patterns and clusters of deaths and near-misses are present in these four communities. The final phase of the project will include support and small grants for community members and local leaders to use these maps and this information to create their own solutions that address the specific needs of each community. Background While Ghana is a leader in some health indicators among West African nations, it still struggles with high maternal and neonatal morbidity and mortality rates, especially in the northern areas. The clinical causes of mortality and morbidity are relatively well understood in Ghana, but little is known about the impact of social and cultural factors on maternal and neonatal outcomes. Less still is understood about how such factors may vary by geographic location, and how such variability may inform locally-tailored solutions. Methods/Design Preventing Maternal And Neonatal Deaths (PREMAND) is a three-year, three-phase project that takes place in four districts in the Upper East, Upper West, and Northern Regions of Ghana. PREMAND will prospectively identify all maternal and neonatal deaths and ‘near-misses’, or those mothers and babies who survive a life threatening complication, in the project districts. Each event will be followed by either a social autopsy (in the case of deaths) or a sociocultural audit (in the case of near-misses). Geospatial technology will be used to visualize the variability in outcomes as well as the social, cultural, and clinical predictors of those outcomes. Data from PREMAND will be used to generate maps for local leaders, community members and Government of Ghana to identify priority areas for intervention. PREMAND is an effort of the Navrongo Health Research Centre and the University of Michigan Medical School. Discussion PREMAND uses an innovative, multifaceted approach to better understand and address neonatal and maternal morbidity and mortality in northern Ghana. It will provide unprecedented access to information on the social and cultural factors that contribute to deaths and near-misses in the project regions, and will allow such causal factors to be situated geographically. PREMAND will create the opportunity for local, regional, and national stakeholders to see how these events cluster, and place them relative to traditional healer compounds, health facilities, and other important geographic markers. Finally, PREMAND will enable local communities to generate their own solutions to maternal and neonatal morbidity and mortality, an effort that has great potential for long-term impact.
In a secondary analysis of a randomized controlled trial of diabetes reciprocal peer support, we examined characteristics of peers associated with improvements in their partner’s glycemic control. A total of 102 adults with diabetes were randomized to the reciprocal peer support arm (vs. a nurse care management arm). The primary outcome was change in A1c over six months. Intermediate outcomes were insulin initiation and peer engagement. A number of baseline characteristics of peers were hypothesized to influence outcomes for their peer, and concordant characteristics of peer dyads were hypothesized that would influence outcomes for both peer partners. Improvement in A1c was associated with having a peer older than oneself (P < .05) or with higher diabetes-related distress (P < .01). Participants with peers who reported poorer health at baseline had worse glycemic control at follow-up (P < .01). Hypothesized concordant characteristics were not associated with A1c improvements. Participants whose peers had a more controlled self-regulation style were more likely to initiate insulin (P < .05). The improved outcomes of peers whose partners were older and reported more diabetes distress at baseline supports the need for further research into the peer characteristics that lead to improved outcomes. This could allow for better matching and more effective partnerships.