There have been many studies of the comparability of computer-administered and paper-administered tests. Not surprisingly (given the variety of measurement and statistical sampling issues that can affect any one study) the results of such studies have not always been consistent. Moreover, the quality of computer-based test administration systems has changed considerably over recent years, as has the computer-experience of students. This study synthesizes the results of 81 studies performed between 1997 and 2007. The estimated effect size across all studies was very small (–.01 weighted, .00 unweighted). Meta-analytic methods were used to ascertain whether grade (elementary, middle, or high school) or subject (English Language Arts, Mathematics, Reading, Science, or Social Studies) had an impact on comparability. Grade appeared to have no affect on comparability. Subject did appear to affect comparability, with computer administration appearing to provide a small advantage for English Language Arts and Social Studies test (effect sizes of .11 and .15, respectively), and paper administration appearing to provide a small advantage for Mathematics tests (effect size of −.06).
A context effect occurs when examinees' item re sponding behavior is affected by the location of an item within a test. Recent advances in testing practice, most notably adaptive testing and certain innovative equating schemes, require items to be more invariant across intended usages than earlier methods. In this paper, location effects are identified as a form of mul tidimensionality, and examples of testing situations where location effects are important are described. Then, the susceptibility to item location effects of 10 item types from the Graduate Record Examination General Test is investigated by comparing the item difficulty parameters of sets of items across intended usages. Results are replicated using a second form of the test. Two of the 10 item types, analysis of expla nations and logical diagrams, are clearly affected by item location in the population tested. One common item type, reading comprehension, appears to be af fected somewhat by item context in this population. It is strongly advised that these item types not be used in an adaptive testing program without first assessing their susceptibility to location effects within the popu lation (and subpopulations) of interest.
7 December 2012 in Journal of Learning Disabilities
Research suggests that self-determination skills are positively correlated with factors that have been shown to improve academic achievement, but the direct relationship among self-determination, self-concept, and academic achievement is not fully understood. This study offers an empirical explanation of how self-determination and self-concept affect academic achievement for adolescents with learning disabilities after taking into consideration the covariates of gender, income, and urbanicity. In a nationally representative sample (N = 560), the proposed model closely fit the data, with all proposed path coefficients being statistically significant. The results indicated that there were significant correlations among the three latent variables (i.e., self-determination, self-concept, and academic achievement), with self-determination being a potential predictor of academic achievement for students with learning disabilities.
The No Child Left Behind Act (2001) and the Individuals with Disabilities Education Improvement Act (2004) emphasize accountability to improve student academic achievement. Promoting self-determination has been proposed as a means to achieving this outcome. Elementary teachers in 30 states were surveyed to measure (a) their perceived importance of self-determination, (b) to what extent they teach it, and (c) the barriers that inhibit them from teaching it. Both general and special educators assigned considerable importance to self-determination instruction and reported at least occasionally providing such instruction. The authors found a lack of congruence between the value teachers place on promoting self-determination and the time they devote to teaching it. Limitations and implications are discussed, and suggestions for future research are offered.