26 December 2022 in American Journal of Evaluation
Evaluation capacity building (ECB) continues to attract the attention and interest of scholars and practitioners. Over the years, models, frameworks, strategies, and practices related to ECB have been developed and implemented. Although ECB is highly contextual, the evolution of knowledge in this area depends on learning from past efforts in a structured approach. The purpose of the present article is to integrate the ECB literature in evaluation journals. More specifically, the article aims to answer three questions: What types of articles and themes comprise the current literature on ECB? How are current practices of ECB described in the literature? And what is the current status of research on ECB? Informed by the findings of the review, the article concludes with suggestions for future ECB practice and scholarship.
19 May 2023 in Evaluation and Program Planning
Evaluation capacity building (ECB) continues to attract attention. Over the past two decades, a broad literature has emerged-covering the dimensions, contexts, and practices of ECB. This article presents findings from a bibliometric analysis of ECB articles published in six evaluation journals from 2000 to 2019. The findings shed light on the communities of scholars that contribute to the ECB knowledge base, the connections between these communities, and the themes they cover. Informed by the findings, future directions for ECB scholarship and how bibliometric analysis can supplement more established approaches to literature reviews are discussed.
20 January 2023 in Evaluation and Program Planning
1 January 2018 in Canadian Journal of Program Evaluation
Given the potential of the federal program evaluation function to inform decision-making at the highest levels of government, this project sought to investigate the nature and extent to which program evaluation findings are used as part of spending reviews and other reallocation exercises in selected government organizations. The multiple case study design used in this investigation included a qualitative content analysis of evaluation reports published between 2010 and 2013, as well as a series of key informant interviews conducted with evaluation staff and program managers. The findings show very little evidence of strategic evaluation utilization by organizational leaders. This is thought to be due to a few key factors: (a) the requirements of the 2009 Policy on Evaluation that was in effect at the time of the study; (b) the program-level focus of the evaluations; and (c) the public nature of the evaluation reports.
20 December 2022 in American Journal of Evaluation
Organizational evaluation policies describe how evaluation practices should be structured and implemented. As such, they provide key insights into organizational priorities and values regarding evaluation. However, the link between evaluation policies and how evaluation policies translate into concrete practices has seldom been explored until now. Our study examines the implementation of two Canadian federal government evaluation policies over a 10-year timespan, through the secondary analysis of reports produced on behalf of governmental evaluation functions. Our findings show that some policy elements have been fully implemented, but the way in which these have been implemented varies between organizations. Further, we observed that the level of control of various organizational members responsible for implementing policy elements, as well as time, can influence implementation of certain policy requirements. We conclude by proposing further directions for research to examine the policy-practice link.
1 June 2024 in Canadian Journal of Program Evaluation
Community-based organizations increasingly recognize the value of evaluative insights in informing decision-making and improving their services. However, these organizations often lack the capacity to conduct and use evaluations, and traditional evaluation capacity building (ECB) activities are not always adapted to their particular contexts. This practice note introduces an innovative evaluation training program for small grassroots community-based organizations. Employing a participatory curriculum development approach, the training program was tailored to meet the specific needs and realities of the community sector. The authors first outline the collaborative process used to involve community and academic stakeholders in the program’s development. They then present the resulting training plan, consisting of seven self-directed online learning modules with chosen activities to foster learning and knowledge transfer into practice. The potential implications for designing, researching, and evaluating similar initiatives are explored and discussed.