1 August 2003 in American Journal of Public Health
The gap between research and practice is well documented. We address one of the underlying reasons for this gap: the assumption that effectiveness research naturally and logically follows from successful efficacy research. These 2 research traditions have evolved different methods and values; consequently, there are inherent differences between the characteristics of a successful efficacy intervention versus those of an effectiveness one. Moderating factors that limit robustness across settings, populations, and intervention staff need to be addressed in efficacy studies, as well as in effectiveness trials. Greater attention needs to be paid to documenting intervention reach, adoption, implementation, and maintenance. Recommendations are offered to help close the gap between efficacy and effectiveness research and to guide evaluation and possible adoption of new programs.
1 April 2007 in Annual Review of Public Health
This review summarizes key factors that have interfered with translation of research to practice and what public health researchers can do to hasten such transfer, focusing on characteristics of interventions, target settings, and research designs. The need to address context and to utilize research, review, and reporting practices that address external validity issues—such as designs that focus on replication, and practical clinical and behavioral trials—are emphasized. Although there has been increased emphasis on social-ecological interventions that go beyond the individual level, interventions often address each component as if it were an independent intervention. Greater attention is needed to connectedness across program levels and components. Finally, examples are provided of evaluation models and current programs that can help accelerate translation of research to practice and policy.
1 May 2005 in Medical Care
There is a need for a brief, validated patient self-report instrument to assess the extent to which patients with chronic illness receive care that aligns with the Chronic Care Model—measuring care that is patient-centered, proactive, planned and includes collaborative goal setting; problem-solving and follow-up support. A total of 283 adults reporting one or more chronic illness from a large integrated health care delivery system were studied. Participants completed the 20-item Patient Assessment of Chronic Illness Care (PACIC) as well as measures of demographic factors, a patient activation scale, and subscales from a primary care assessment instrument so that we could evaluate measurement performance, construct, and concurrent validity of the PACIC. The PACIC consists of 5 scales and an overall summary score, each having good internal consistency for brief scales. As predicted, the PACIC was only slightly correlated with age and gender, and unrelated to education. Contrary to prediction, it was only slightly correlated (r = 0.13) with number of chronic conditions. The PACIC demonstrated moderate test-retest reliability (r = 0.58 during the course of 3 months) and was correlated moderately, as predicted (r = 0.32–0.60, median = 0.50, P < 0.001) to measures of primary care and patient activation. The PACIC appears to be a practical instrument that is reliable and has face, construct, and concurrent validity. The resulting questionnaire is in the public domain, and recommendations for its use in research and quality improvement are outlined.
15 May 2006 in Health Education Research
Current public health and medical evidence rely heavily on efficacy information to make decisions regarding intervention impact. This evidence base could be enhanced by research studies that evaluate and report multiple indicators of internal and external validity such as Reach, Effectiveness, Adoption, Implementation and Maintenance (RE-AIM) as well as their combined impact. However, indices that summarize the combined impact of, and complex interactions among, intervention outcome dimensions are not currently available. We propose and discuss a series of composite metrics that combine two or more RE-AIM dimensions, and can be used to estimate overall intervention impact. Although speculative and, at this point, there have been limited empirical data on these metrics, they extend current methods and are offered to yield more integrated composite outcomes relevant to public health. Such approaches offer potential to help identify interventions most likely to meaningfully impact population health.
1 February 2004 in Annals of Behavioral Medicine
Background: It is well documented that the results of most behavioral and health promotion studies have not been translated into practice.Purpose: In this article, reasons for this gap, focusing on study design characteristics as a central contributing barrier, are discussed.Methods: Four reviews of recent controlled studies in work sites, health care, school, and community settings are briefly discussed and summarized. Their implications for future research and for closing the gap between research and practice are then discussed.Results: These reviews come to consistent conclusions regarding key internal and external validity factors that have and have not been reported. It is very clear that moderating variables and generalization issues have not been included or reported in the majority of investigations, and that as a consequence little is known about the representatives or the robustness of results from current studies.Conclusions: To significantly improve the current state of affairs, substantial changes will be required on the part of researchers, funding agencies, and review and editorial boards. In conclusion, recommendations for each of these entities are provided.
1 December 2001 in The Milbank Quarterly