Practitioners and evaluators face several constraints in conducting rigorous evaluations to determine program effect. Researchers have offered the retrospective pretest/posttest design as a remedy to curb response-shift bias and better estimate program effects. This article presents an example of how After School Matters (ASM) tested the use of retrospective pretest/posttest design for evaluating out-of-school time (OST) programs for high school youth participants. Differences between traditional pretest and retrospective pretest scores were statistically significant, but effect sizes were negligible, indicating that both pretests yielded similar results. Interviews with youth led to 3 key findings that have implications for ASM using retrospective pretests with youth: response-shift bias was more prominent in youth interviews than in quantitative findings, youth recommended reordering the questions so that the retrospective pretest appears first to increase comprehension, and acquiescence bias emerged in the interviews. This study demonstrates that the retrospective pretest/posttest design can be an alternative to the traditional pretest/posttest design for OST at ASM. These findings are important for ASM and other youth-serving organizations, which often have limited capacity to survey youth multiple times within 1 program session.
BACKGROUND: Individuals learn and develop across their lifespan in response to the people with whom they interact in settings, communities, cultures, and experiences. Collaborative research and policy efforts underscore the critical and reparative role of identity‐safe, culturally driven, and relationship‐rich environments—in classrooms, schools, and communities—for the healthy social, emotional, cognitive, and physical development of all learners. These themes align closely with the Whole School, Whole Community, Whole Child (WSCC) model.METHODS: Collaborative research and policy efforts, combined with the WSCC model make a strong case to elevate the unusual suspects, the settings and people outside of instructional classrooms who are key actors in creating the conditions and relationships that promote student health and well‐being.RESULTS: We describe promising cases of efforts aimed at bolstering adult capacity to foster student health and well‐being. We also discuss how these types of systemic efforts can move beyond system and program level actors to acknowledge the power of individual‐level implementation.CONCLUSIONS: It is time to recognize the systemic efforts, programmatic opportunities, and individual roles adults have in implementing an ideal WSCC model that is aligned with the collaborative research and policy efforts.
In this article, Deborah Moroney and Jill Young from the American Institutes for Research interview Rebecca Goldberg and Alex Hooker, senior program officers from the S. D. Bechtel, Jr. Foundation. Rebecca and Alex describe their experience as members of the youth development workforce and how that experience inspired them to support the youth development workforce on the grantmaking side, focusing on adult practice and youth character development. As the S. D. Bechtel, Jr. Foundation sunsets in 2020, Rebecca and Alex also share their hopes for the youth development workforce going forward.
Youth Development Principles and Practices in Out-of-school Time Settings (Witt & Caldwell, 2018) is a comprehensive resource for students and professionals who work with youth in out-of-school time programs. The book weaves youth development theory and practice together so current and future practitioners can understand how to plan for, design, and evaluate youth programs that enable young people to thrive. Practitioners who work with adolescents will find the topics discussed relevant and the examples practical.