Despite global efforts to increase health workforce capacity through training and guidelines, challenges remain in bridging the gap between knowledge and quality clinical practice and addressing health system deficiencies preventing health workers from providing high quality care. In many developing countries, supervision activities focus on data collection, auditing and report completion rather than catalyzing learning and supporting system quality improvement. To address this gap, mentorship and coaching interventions were implemented in projects in five African countries (Ghana, Mozambique, Rwanda, Tanzania, and Zambia) as components of health systems strengthening (HSS) strategies funded through the Doris Duke Charitable Foundation’s African Health Initiative. We report on lessons learned from a cross-country evaluation. The evaluation was designed based on a conceptual model derived from the project-specific interventions. Semi-structured interviews were administered to key informants to capture data in six categories: 1) mentorship and coaching goals, 2) selection and training of mentors and coaches, 3) integration with the existing systems, 4) monitoring and evaluation, 5) reported outcomes, and 6) challenges and successes. A review of project-published articles and technical reports from the individual projects supplemented interview information. Although there was heterogeneity in the approaches to mentorship and coaching and targeted areas of the country projects, all led to improvements in core health system areas, including quality of clinical care, data-driven decision making, leadership and accountability, and staff satisfaction. Adaptation of approaches to reflect local context encouraged their adoption and improved their effectiveness and sustainability. We found that incorporating mentorship and coaching activities into HSS strategies was associated with improvements in quality of care and health systems, and mentorship and coaching represents an important component of HSS activities designed to improve not just coverage, but even further effective coverage, in achieving Universal Health Care.

Early initiation of antenatal care (ANC) can reduce common maternal complications and maternal and perinatal mortality. Though Rwanda demonstrated a remarkable decline in maternal mortality and 98% of Rwandan women receive antenatal care from a skilled provider, only 38% of women have an ANC visit in their first three months of pregnancy. This study assessed factors associated with delayed ANC in Rwanda. This is a cross-sectional study using data collected during the 2010 Rwanda DHS from 6,325 women age 15–49 that had at least one birth in the last five years. Factors associated with delayed ANC were identified using a multivariable logistic regression model using manual backward stepwise regression. Analysis was conducted in Stata v12 applying survey commands to account for the complex sample design. Several factors were significantly associated with delayed ANC including having many children (4–6 children, OR = 1.42, 95% CI: 1.22, 1.65; or more than six children, OR = 1.57, 95% CI: 1.24, 1.99); feeling that distance to health facility is a problem (OR = 1.20, 95% CI: 1.04, 1.38); and unwanted pregnancy (OR = 1.41, 95% CI: 1.26, 1.58). The following were protective against delayed ANC: having an ANC at a private hospital or clinic (OR = 0.29, 95% CI: 0.15, 0.56); being married (OR = 0.85, 95% CI: 0.75, 0.96), and having public mutuelle health insurance (OR = 0.81, 95% CI: 0.71, 0.92) or another type of insurance (OR = 0.33, 95% CI: 0.23, 0.46). This analysis revealed potential barriers to ANC service utilization. Distance to health facility remains a major constraint which suggests a great need of infrastructure and decentralization of maternal ANC to health posts and dispensaries. Interventions such as universal health insurance coverage, family planning, and community maternal health system are underway and could be part of effective strategies to address delays in ANC.

Despite evidence supporting Integrated Management of Childhood Illness (IMCI) as a strategy to improve pediatric care in countries with high child mortality, its implementation faces challenges related to lack of or poor post-didactic training supervision and gaps in necessary supporting systems. These constraints lead to health care workers’ inability to consistently translate IMCI knowledge and skills into practice. A program providing mentoring and enhanced supervision at health centers (MESH), focusing on clinical and systems improvement was implemented in rural Rwanda as a strategy to address these issues, with the ultimate goal of improving the quality of pediatric care at rural health centers. We explored perceptions of MESH from the perspective of IMCI clinical mentors, mentees, and district clinical leadership.

Inadequate antenatal care (ANC) can lead to missed diagnosis of danger signs or delayed referral to emergency obstetrical care, contributing to maternal mortality. In developing countries, ANC quality is often limited by skill and knowledge gaps of the health workforce. In 2011, the Mentorship, Enhanced Supervision for Healthcare and Quality Improvement (MESH-QI) program was implemented to strengthen providers’ ANC performance at 21 rural health centers in Rwanda. We evaluated the effect of MESH-QI on the completeness of danger sign assessments. Completeness of danger sign assessments was measured by expert nurse mentors using standardized observation checklists. Checklists completed from October 2010 to May 2011 (n = 330) were used as baseline measurement and checklists completed between February and November 2012 (12–15 months after the start of MESH-QI implementation) were used for follow-up. We used a mixed-effects linear regression model to assess the effect of the MESH-QI intervention on the danger sign assessment score, controlling for potential confounders and the clustering of effect at the health center level. Complete assessment of all danger signs improved from 2.1% at baseline to 84.2% after MESH-QI (p < 0.001). Similar improvements were found for 20 of 23 other essential ANC screening items. After controlling for potential confounders, the improvement in danger sign assessment score was significant. However, the effect of the MESH-QI was different by intervention district and type of observed ANC visit. In Southern Kayonza District, the increase in the danger sign assessment score was 6.28 (95% CI: 5.59, 6.98) for non-first ANC visits and 5.39 (95% CI: 4.62, 6.15) for first ANC visits. In Kirehe District, the increase in danger sign assessment score was 4.20 (95% CI: 3.59, 4.80) for non-first ANC visits and 3.30 (95% CI: 2.80, 3.81) for first ANC visits. Assessment of critical danger signs improved under MESH-QI, even when controlling for nurse-mentees’ education level and previous training in focused ANC. MESH-QI offers an approach to enhance quality of care after traditional training and may be an approach to support newer providers who have not yet attended content-focused courses.

To address the know-do gap in the integration of mental health care into primary care in resource-limited settings, a multi-faceted implementation program initially designed to integrate HIV/AIDS care into primary care was adapted for severe mental disorders and epilepsy in Burera District, Rwanda. The Mentoring and Enhanced Supervision at Health Centers (MESH MH) program supported primary care-delivered mental health service delivery scale-up from 6 to 19 government-run health centers over two years. This quasi-experimental study assessed implementation reach, fidelity, and clinical outcomes at health centers supported by MESH MH during the scale up period. MESH MH consisted of four strategies to ensure the delivery of the priority care packages at health centers: training; supervision and mentorship; audit and feedback; and systems-based quality improvement (QI). Implementation reach (service use) across the 19 health centers supported by MESH MH during the two year scale-up period was described using routine service data. Implementation fidelity was measured at four select health centers by comparing total clinical supervisory visits and checklists to target goals, and by tracking clinical observation checklist item completion rates over a nine month period. A prospective before and after evaluation measured clinical outcomes in consecutive adults presenting to four select health centers over a nine month period. Primary outcome assessments at baseline, 2 and 6 months included symptoms and functioning, measured by the General Health Questionnaire (GHQ-12) and the World Health Organization Disability Assessment Scale (WHO-DAS Brief), respectively. Secondary outcome assessments included engagement in income generating work and caregiver burden using a quantitative scale adapted to context. A total of 2239 mental health service users completed 15,744 visits during the scale up period. MESH MH facilitated 70% and 76% of supervisory visit and clinical checklist utilization target goals, respectively. Checklist item completion rates significantly improved overall, and for three of five checklist item subgroups examined. 121 of 146 consecutive service users completed outcome measurements six months after entry into care. Scores improved significantly over six months on both the GHQ-12, with median score improving from 26 to 10 (mean within-person change 12.5 [95% CI: 10.9–14.0] p< 0.0001), and the WHO-DAS Brief, with median score improving from 26.5 to 7 (mean within-person change 16.9 [95% CI: 14.9–18.8] p< 0.0001). Over the same period, the percentage of surveyed service users reporting an inability to work decreased significantly (51% to 6% (p < 0.001)), and the proportion of households reporting that a caregiver had left income-generating work decreased significantly (41% to 4% (p < 0.001)). MESH MH was associated with high service use, improvements in mental health care delivery by primary care nurses, and significant improvements in clinical symptoms and functional disability of service users receiving care at health centers supported by the program. Multifaceted implementation programs such as MESH MH can reduce the evidence to practice gap for mental health care delivery by nonspecialists in resource-limited settings. The primary limitation of this study is the lack of a control condition, consistent with the implementation science approach of the study. ISRCTN #37231.