This article presents a framework for practitioners in education and psychology to select accommodations based on student profiles and testing demands. A brief history of testing accommodations policy in the US and a definition of terms provide context for the discussion. A review of theory and empirical findings related to testing accommodations follow. The key assumption is that testing accommodations are used to obtain test scores from which valid inferences can be drawn. The article introduces a three-step process that involves identifying access skills, selecting accommodations, and considering their impact on target skills or knowledge. The reader is also introduced to tools that are commercially available to help with these decisions.
This study addresses the predictive validity of results from a screening system of academic enablers, with a sample of Australian elementary school students, when the criterion variable is end-of-year achievement. The investigation included (a) comparing the predictive validity of a brief criterion-referenced nomination system with more comprehensive behavior ratings, and (b) determining the optimal combination of scores to gather from this system for identifying academic difficulties. Students (n = 360) were rated using both the Performance Screening Guides (PSGs; Elliott & Gresham, 2007) and the Rating Scales (Gresham & Elliott, 2008) of the Social Skills Improvement System. The PSGs were highly sensitive (0.95) predictors of below minimum standard performance on the national test. The Rating Scales, including the brief academic competence scale in particular, added predictive value in most domains. The discussion addresses implications of these findings for school psychologists and other educators interested in the role of social behaviors as academic enablers and predictors of academic achievement.
Federal policy on alternate assessment based on modified academic achievement standards (AA-MAS) inspired this research. Specifically, an experimental study was conducted to determine whether tests composed of modified items would have the same level of reliability as tests composed of original items, and whether these modified items helped reduce the performance gap between AA-MAS eligible and ineligible students. Three groups of eighth-grade students (N = 755) defined by eligibility and disability status took original and modified versions of reading and mathematics tests. In a third condition, the students were provided limited reading support along with the modified items. Changes in reliability across groups and conditions for both the reading and mathematics tests were determined to be minimal. Mean item difficulties within the Rasch model were shown to decrease more for students who would be eligible for the AA-MAS than for non-eligible groups, revealing evidence of differential boost. Exploratory analyses indicated that shortening the question stem may be a highly effective modification, and that adding graphics to reading items may be a poor modification.
4 April 2020 in Journal of Psychoeducational Assessment
This investigation examined whether teacher practices, as measured by the Classroom Strategies Assessment System (CSAS), were associated with students’ proficiency and gain scores, as measured by the Measure of Academic Progress (MAP), in 13 high-poverty charter schools in New Jersey. Results from two-level hierarchical linear models, fitted to a sample of 2,188 Kindergarteners through eighth-grade students in 110 classrooms, revealed that instructional and behavior management strategies on the CSAS were associated with (a) MAP gains in mathematics but not in reading and (b) MAP Rasch Unit (RIT) (proficiency) scores in mathematics and reading. The relationship between CSAS scores and student achievement did not differ across grade levels. In general, students in classrooms with higher quality use of classroom strategies exhibited higher gains in mathematics and proficiency scores in mathematics and reading. Implications for research and educational practices are discussed.
1 September 2019 in Studies in Educational Evaluation