The use of the nomination stage as the first step in the identification process is pervasive across the field of gifted education. In many cases, nominations are used to limit the number of students who will need to be evaluated using costly and time-consuming assessments for the purpose of gifted program identification and placement. This study evaluated the effect of the nomination stage on the overall efficacy of a gifted identification system. Results showed that in nearly all conditions, identification systems that require a nomination before testing result in a large proportion of gifted students being missed. Under commonly implemented conditions, the nomination stage can cause the false negative rate to easily exceed 60%. Changes to identification practices are urgently needed in order to ensure that larger numbers of gifted students receive appropriate educational placement and to maintain the integrity of gifted education services.
Best practice in gifted and talented identification procedures involves making decisions on the basis of multiple measures. However, very little research has investigated the impact of different methods of combining multiple measures. This article examines the consequences of the conjunctive (“and”), disjunctive/complementary (“or”), and compensatory (“mean”) models for combining scores from multiple assessments. It considers the impact of rule choice on the size of the student population, the ability heterogeneity of the identified students, and the psychometric performance of such systems. It also uses statistical simulation to examine the performance of the state of Georgia’s mandated and complex multiple-criteria assessment system.
Current practices in study design and data analysis have led to low reproducibility and replicability of findings in fields such as psychology, medicine, biology, and economics. Because gifted education research relies on the same underlying statistical and sociological paradigms, it is likely that it too suffers from these problems. This article discusses the origin of the poor replicability and introduces a set of open science practices that can increase the rigor and trustworthiness of gifted education’s scientific findings: preregistration, open data and open materials, registered reports, and preprints. Readers are directed to Internet resources for facilitating open science. To model these practices, a pre peer-review preprint of this article is available at https://psyarxiv.com/nhuv3/ .
1 February 2014 in Psychology of Aesthetics, Creativity, and the Arts
The editors of the Journal of Advanced Academics comment on Makel (2014). The replicability crisis in psychology is summarized in terms of three focal issues: the “file drawer” problem, lack of replication studies, and the null hypothesis significance testing paradigm. The authors argue that journal editors are uniquely positioned to address all three of these problems via the adoption of new policies for review and publication. (PsycINFO Database Record (c) 2017 APA, all rights reserved)
Card and Giuliano’s National Bureau of Economic Research (NBER) working paper on universal screening is discussed. This commentary provides a brief summary and critique of the article, proposes an explanation of the results in light of the author’s research on the role of nominations or screening tests in the gifted identification process, and discusses the methodological implications of this work for the field.