The implementation of polytomous item response theory (IRT) models such as the graded response model (GRM) and the generalized partial credit model (GPCM) to inform instrument design and validation has been increasing across social and educational contexts where rating scales are usually used. The performance of such models has not been fully investigated and compared across conditions with common survey-specific characteristics such as short test length, small sample size, and data missingness. The purpose of the current simulation study is to inform the literature and guide the implementation of GRM and GPCM under these conditions. For item parameter estimations, results suggest a sample size of at least 300 and/or an instrument length of at least five items for both models. The performance of GPCM is stable across instrument lengths while that of GRM improves notably as the instrument length increases. For person parameters, GRM reveals more accurate estimates when the proportion of missing data is small, whereas GPCM is favored in the presence of a large amount of missingness. Further, it is not recommended to compare GRM and GPCM based on test information. Relative model fit indices (AIC, BIC, LL) might not be powerful when the sample size is less than 300 and the length is less than 5. Synthesis of the patterns of the results, as well as recommendations for the implementation of polytomous IRT models, are presented and discussed.
There is increasing interest in the early roots and influencing factors of leadership potential from a life span development perspective. This conceptual and empirical work extends traditional approaches focusing on adults in organizational settings. From the perspective of early influences on leader development, the goal of this study was to examine the effects of overparenting on adolescent leader emergence, influencing mechanisms, and sex differences. Students (N = 1,255) from 55 classrooms in 13 junior high schools participated, with additional responses from their parents, peers, and teachers. The results indicated that overparenting is negatively related to adolescent leader emergence as indicated by parent ratings, teacher ratings, and peer nominations in addition to leader role occupancy. The negative effects of overparenting on leader emergence (perceived and actual) were serially mediated by self-esteem and leader self-efficacy. In addition, sex difference analysis revealed that male adolescents received more overparenting and showed less leader emergence (perceived and actual) than female adolescents. Female adolescents' self-esteem was more likely to be negatively related to overparenting, and female adolescents' leader emergence (perceived and actual) was more strongly related to their leader self-efficacy when compared with male adolescents. Implications for life span leader development theory, for youth and adult leadership development practices, and for parenting practices on future generations are discussed. (PsycINFO Database Record (c) 2019 APA, all rights reserved).
The presence of missing responses in assessment settings is inevitable and may yield biased parameter estimates in psychometric modeling if ignored or handled improperly. Many methods have been proposed to handle missing responses in assessment data that are often dichotomous or polytomous. Their applications remain nominal, however, partly due to that (1) there is no sufficient support in the literature for an optimal method; (2) many practitioners and researchers are not familiar with these methods; and (3) these methods are usually not employed by psychometric software and missing responses need to be handled separately. This article introduces and reviews the commonly used missing response handling methods in psychometrics, along with the literature that examines and compares the performance of these methods. Further, the use of the TestDataImputation package in R is introduced and illustrated with an example data set and a simulation study. Corresponding R codes are provided.
2 January 2023 in The Journal of Experimental Education
Applications of polytomous IRT models in applied fields (e.g., health, education, psychology) are abound. However, little is known about the impact of the number of categories and sample size requirements for precise parameter recovery. In a simulation study, we investigated the impact of the number of response categories and required sample size for successful parameter recovery and also examined model fit. Our results suggested that sample size requirements of approximately 250 or larger are typically sufficient for reasonable recovery of either person or item parameters (in particular discrimination). Further, we found that in many cases, the conditions of 10 items yielded more favorable results than those conditions when only 5 items were considered. With respect to the number of response categories, results were inconsistent, suggesting more complex recommendations in selecting the number of categories when developing scales. We discuss limitations of the current study, identify future directions, and provide recommendations for applied researchers who engage in scale development.
17 November 2023 in Journal of Psycholinguistic Research
Information about the psychometric properties of items can be highly useful in assessment development, for example, in item response theory (IRT) applications and computerized adaptive testing. Although literature on parameter recovery in unidimensional IRT abounds, less is known about parameter recovery in multidimensional IRT (MIRT), notably when tests exhibit complex structures or when latent traits are nonnormal. The current simulation study focuses on investigation of the effects of complex item structures and the shape of examinees’ latent trait distributions on item parameter recovery in compensatory MIRT models for dichotomous items. Outcome variables included bias and root mean square error. Results indicated that when latent traits were skewed, item parameter recovery was generally adversely impacted. In addition, the presence of complexity contributed to decreases in the precision of parameter recovery, particularly for discrimination parameters along one dimension when at least one latent trait was generated as skewed.