9 May 2024 in American Journal of Evaluation
In response to a call for more research on evaluator education, this paper explores the use of role-play as an in-class activity for students in a graduate course in evaluation. We describe the activity in detail and use the Structure of Observed Learning Outcomes taxonomy as a tool to describe the cognitive complexity of student responses in the activity. Using a collaborative autoethnographic approach, we found that the role-play activity provided the opportunity for students to exhibit knowledge of evaluation theories and for us to observe the complexity of their responses.
17 August 2025 in New Directions for Evaluation
There has been limited attention to the role of research on evaluation (RoE) in PhD‐level evaluator education. Previous research suggests that evaluator education doctoral programs have multiple purposes to prepare practitioners and researchers, thus creating an unnamed tension where evaluation practice is the focus and RoE has not been integrated. Therefore, a gap exists in understanding how students learn RoE within existing programs. This collaborative autoethnography seeks to address this need from the perspective of PhD students actively engaged in learning RoE. This study examines the experiences of six mid‐career evaluators in PhD programs across five US universities. An ecological systems theory conceptual framework was used to understand micro (individual), meso (program), and macro (field) factors that influenced PhD student experiences. Findings revealed that authors’ practitioner background and positionality, faculty support and institutional culture, and connections within the evaluation field significantly shaped their knowledge of RoE and scholarly development. Constraints in formal RoE coursework, applied opportunities, and funding created barriers to achieving desired RoE‐related academic goals. Additionally, the study offers opportunities to enhance RoE preparation across individual, programmatic, and broader systems levels, including developing reflective practice skills, expanding cross‐institutional collaborations, and strengthening the relationship between evaluation practice and research. Findings and implications contribute to evaluation programs, faculty, and the broader evaluation community to improve RoE learning across the educational ecosystem.