1 November 2021 in Journal of Counseling Psychology
We conducted an intensive longitudinal study of sexual minority adolescents to address gaps in the literature, limitations in retrospective reporting, and test tenets of the minority stress model. We examined the frequency of daily minority stressors and their within-person associations with negative and positive affect. We also tested the moderating effects of depressive symptomology on these associations. Sexual minority adolescents (N = 94; 35.1% were bisexual; 31.9% were gender minority; 45.2% were racial/ethnic minority), ages 12-18 years old (M = 16.1, SD = 1.5), were recruited from the community and completed a baseline questionnaire and then a 21-day daily dairy (82.5% response rate). Participants experienced at least one minority stressor, with an average of 16.96 minority stressors (SD = 18.7, Range: 0-83), over the 21-day monitoring period. Some minority stressors were more commonly experienced than others (e.g., vicarious minority stress) and most participants attributed their sexual orientation to these stressors. Participants also attributed other marginalized identities to these stressors (e.g., gender identity, race). Daily minority stressors were associated with greater negative affect but not positive affect. Participants had greater negative affect on days where sexual-orientation-specific minority stressors were endorsed compared to days where minority stressors were not reported. These associations were not moderated by depression symptomology. The results underscore that minority stressors are pervasive experiences of sexual minority adolescents' daily life and natural environment and they are associated with daily emotions. The findings have implications for the minority stress model and future research and interventions. (PsycInfo Database Record (c) 2021 APA, all rights reserved).
20 March 2019 in Psychometrika
In item response theory (IRT), it is often necessary to perform restricted recalibration (RR) of the model: A set of (focal) parameters is estimated holding a set of (nuisance) parameters fixed. Typical applications of RR include expanding an existing item bank, linking multiple test forms, and associating constructs measured by separately calibrated tests. In the current work, we provide full statistical theory for RR of IRT models under the framework of pseudo-maximum likelihood estimation. We describe the standard error calculation for the focal parameters, the assessment of overall goodness-of-fit (GOF) of the model, and the identification of misfitting items. We report a simulation study to evaluate the performance of these methods in the scenario of adding a new item to an existing test. Parameter recovery for the focal parameters as well as Type I error and power of the proposed tests are examined. An empirical example is also included, in which we validate the pediatric fatigue short-form scale in the Patient-Reported Outcome Measurement Information System (PROMIS), compute global and local GOF statistics, and update parameters for the misfitting items.
6 September 2017 in Psychometrika
In most item response theory applications, model parameters need to be first calibrated from sample data. Latent variable (LV) scores calculated using estimated parameters are thus subject to sampling error inherited from the calibration stage. In this article, we propose a resampling-based method, namely bootstrap calibration (BC), to reduce the impact of the carryover sampling error on the interval estimates of LV scores. BC modifies the quantile of the plug-in posterior, i.e., the posterior distribution of the LV evaluated at the estimated model parameters, to better match the corresponding quantile of the true posterior, i.e., the posterior distribution evaluated at the true model parameters, over repeated sampling of calibration data. Furthermore, to achieve better coverage of the fixed true LV score, we explore the use of BC in conjunction with Jeffreys’ prior. We investigate the finite-sample performance of BC via Monte Carlo simulations and apply it to two empirical data examples.
8 February 2024 in Psychological Methods
Observed scores (e.g., summed scores and estimated factor scores) are assumed to reflect underlying constructs and have many uses in psychological science. Constructs are often operationalized as latent variables (LVs), which are mathematically defined by their relations with manifest variables in an LV measurement model (e.g., common factor model). We examine the performance of several types of observed scores for the purposes of (a) estimating latent scores and classifying people and (b) recovering structural relations among LVs. To better reflect practice, our evaluation takes into account different sources of uncertainty (i.e., sampling error and model error). We review psychometric properties of observed scores based on the classical test theory applied to common factor models, report on a simulation study examining their performance, and provide two empirical examples to illustrate how different scores perform under different conditions of reliability, sample size, and model error. We conclude with general recommendations for using observed scores and discuss future research directions. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
15 January 2018 in Applied Psychological Measurement
Latent class models are powerful tools in psychological and educational measurement. These models classify individuals into subgroups based on a set of manifest variables, assisting decision making in a diagnostic system. In this article, based on information theory, the authors propose a mutual information reliability (MIR) coefficient that summaries the measurement quality of latent class models, where the latent variables being measured are categorical. The proposed coefficient is analogous to a version of reliability coefficient for item response theory models and meets the general concept of measurement reliability in the Standards for Educational and Psychological Testing. The proposed coefficient can also be viewed as an extension of the McFadden’s pseudo R-square coefficient, which evaluates the goodness-of-fit of logistic regression model, to latent class models. Thanks to several information-theoretic inequalities, the MIR coefficient is unitless, lies between 0 and 1, and receives good interpretation from a measurement point of view. The coefficient can be applied to both fixed and computerized adaptive testing designs. The performance of the MIR coefficient is demonstrated by simulated examples.