Although the general conceptual basis appeared far earlier, theory-driven evaluation came to prominence only a few decades ago with the appearance of Chen’s 1990 book Theory-Driven Evaluations. Since that time, the approach has attracted many supporters as well as detractors. In this paper, 45 cases of theory-driven evaluations, published over a twenty-year period, are systematically examined to ascertain how closely theory-driven evaluation practices comport with the key tenants of theory-driven evaluation as described and prescribed by prominent theoretical writers. Evidence derived from this review to repudiate or substantiate many of the claims put forth both by critics of and advocates for theory-driven forms of evaluation are presented and an agenda for future research on the approach is recommended.
15 June 2020 in Educational Technology Research and Development
Although investigations into evaluation theories, methods, and practices have been occurring since the late 1970s, research on evaluation (RoE) has seemingly increased in the past decade. In this review, 257 studies published in 14 evaluation-focused journals over a 10-year period (between 2005 and 2014) were identified as RoE and then classified according to Henry and Mark’s and Mark’s taxonomies of RoE. The majority of RoE published in evaluation-focused journals consists of descriptive studies and, to a lesser extent, comparative studies of evaluation practices. Few investigations, however, address questions pertaining to values or valuing in evaluation, ethics, or evaluation consequences. Gaps in and an agenda for future RoE are discussed.
4 April 2019 in The International Review of Research in Open and Distributed Learning
This study investigated online faculty familiarity, course design use, and professional development interest regarding universal design for learning (UDL) guidelines. The researchers surveyed all 2017 to 2018 online faculty at a large university in the southeastern United States. Findings included 71.6% of faculty reporting familiarity with at least one UDL guideline, with most respondents indicating familiarity with guidelines relating to perception, expression, and communication. Faculty reported the highest implementation of UDL guidelines was for those suggesting options for comprehension as well as expression and communication; the lowest implementation was for those suggesting options for physical action as well as language and support. Survey results also indicated high to moderate interest in learning more about all UDL guidelines, with emphasis on comprehension, persistence, and expression. This study suggests that faculty members desire UDL training and offers possibilities for planning and implementing such professional development in areas targeted to best meet the needs of online faculty.