25 September 2019 in Review of Educational Research
This methodological guidance article discusses the elements of a high-quality meta-analysis that is conducted within the context of a systematic review. Meta-analysis, a set of statistical techniques for synthesizing the results of multiple studies, is used when the guiding research question focuses on a quantitative summary of study results. In this guidance article, we discuss the systematic review methods that support high-quality meta-analyses and outline best practice meta-analysis methods for describing the distribution of effect sizes in a set of eligible studies. We also provide suggestions for transparently reporting the methods and results of meta-analyses to influence practice and policy. Given the increasing use of meta-analysis for important policy decisions, the methods and results of meta-analysis should be both transparent and reproducible.
14 May 2019 in Research Synthesis Methods
Screening is one important aspect of conducting a high‐quality and comprehensive systematic review and meta‐analysis. Abstract screening allows the review team to conduct the tedious but vital first step to synthesize the extant literature: winnowing down the overwhelming amalgamation of citations discovered through research databases to the citations that should be “full‐text” screened and eventually included in the review. Although it is a critical process, few guidelines have been put forth since the publications of seminal systematic review textbooks. The purpose of this paper, therefore, is to provide a practical set of best practice guidelines to help future review teams and managers. Each of the 10 proposed guidelines is explained using real‐world examples or illustrations from applications. We also delineate recent experiences where a team of abstract screeners double‐screened 14 923 abstracts in 89 days.
9 July 2016 in Review of Educational Research
The incidence of violence in dating relationships has a significant impact on young people, including decreased mental and physical health. This review is the first to provide a quantitative synthesis of empirical evaluations of school-based programs implemented in middle and high schools that sought to prevent or reduce incidents of dating violence. After a systematic search and screening procedure, a meta-analysis of 23 studies was used to examine the effects of school-based programs. Results indicated school-based programs influence dating violence knowledge ([ ] 95% confidence interval [0.05, 0.39]) and attitudes ([ ] 95% confidence interval [0.10, 0.19]); however, to date, the results for dating violence perpetration and victimization indicate programs are not affecting these behaviors to a significant extent. The results of this review are encouraging, but they also highlight the need for modifications to dating violence prevention programs including the incorporation of skill-building components and a need to address the role of bystanders.
10 August 2015 in Research on Social Work Practice
KBKristen Esposito Brendel
Objective: School refusal is a psychosocial problem associated with adverse short- and long-term consequences for children and adolescents. The authors conducted a systematic review and meta-analysis to examine the effects of psychosocial treatments for children and adolescents with school refusal. Method: A comprehensive search process was used to find eligible randomized controlled trials and quasi-experimental studies assessing the effects of psychosocial treatments on anxiety or attendance outcomes. Data were quantitatively synthesized using meta-analytic methods. Results: Eight studies including 435 children and adolescents with school refusal were included in this review. Significant effects were found for attendance but not for anxiety. Conclusions: Evidence indicates that improvements in school attendance occur for children and adolescents with school refusal who receive psychosocial treatment. The lack of evidence of short-term effects on anxiety points to the need for long-term follow-up studies to determine whether increased attendance ultimately leads to reduced anxiety.
1 October 2017 in Journal of Clinical Epidemiology
Complex interventions are widely used in health systems, public health, education, and communities and are increasingly the subject of systematic reviews. Oversimplification and inconsistencies in reporting about complex interventions can limit the usability of review findings. Although guidance exists to ensure that reports of individual studies and systematic reviews adhere to accepted scientific standards, their design-specific focus leaves important reporting gaps relative to complex interventions in health care. This paper provides a stand-alone extension to the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) reporting tool for complex interventions-PRISMA-CI-to help authors, publishers, and readers understand and apply to systematic reviews of complex interventions. PRISMA-CI development followed the Enhancing the QUAlity and Transparency Of health Research Network guidance for extensions and focused on adding or modifying only essential items that are truly unique to complex interventions and are not covered by broader interpretation of current PRISMA guidance. PRISMA-CI provides an important structure and guidance for systematic reviews and meta-analyses for the highly prevalent and dynamic field of complex interventions.