Although visual analysis is integral to evaluating intervention effects in single-case research, little is known about how researchers actually use this method. Previous research on visual analysis has focused on the decisions that researchers make but has not examined how researchers use visual analysis to make those decisions. In this qualitative study, we used a think-aloud protocol and asked 15 researchers to verbalize their analysis as they viewed published multiple baseline design graphs. We analyzed transcripts using Consensual Qualitative Research (CQR). Contrary to previous research on the reporting of visual analysis in published manuscripts, researchers frequently described level, trend, and variability. However, they discussed data sufficiency and covariation across tiers less often. Implications for future research include extending the think-aloud protocol to compare the analytic process across design types and expertise levels. Our findings may also contribute to the development or refinement of protocols for training visual analysis that are rooted in expert consensus.
As evaluation practices evolve to better reflect the needs, values, and experiences of diverse stakeholders, it is essential for evaluators to recognize the expertise that comes from lived experience. Historically, marginalized communities such as people with disabilities have often been left out of evaluation processes despite the ethical and practical imperative for their meaningful inclusion. To challenge a paradigm of exclusion in evaluation and encourage evaluators to center the voices of people with disabilities in their work, this paper details the core principles of disability-led evaluation and introduces the Continuum of Disability Engagement in Evaluation .
Using a modified participatory Delphi technique, researchers sought to build consensus on the high school supports and experiences that college students with intellectual and developmental disability (IDD) perceive as contributing to their current sense of belonging in postsecondary education. This Facilitating Inclusive Reflection and Empowerment-Delphi study took place in three distinct phases. The design was primarily qualitative, incorporating structured and semiquantitative elements (card sorting and ranking) to support consensus building. Phase One involved semistructured interviews, Phase Two used a card sort activity that generated quantitative data, and Phase Three employed a group insight mapping process to produce additional qualitative data. The research team specifically developed each phase for accessibility and inclusivity, centering the voices and expertise of 13 college students with IDD as the primary experts. Through iterative ranking and group discussion, participants emphasized the importance of teachers who fostered acceptance, friendships with peers with disabilities, and supportive school administrators. In the final phase, they further highlighted the value of teamwork experiences and conversations with teachers about college, underscoring how context and relationships shaped the impact of these supports. We discuss implications for practice and future research.