1 April 2009 in Annual Review of Clinical Psychology
In this review, we examine studies that use item response theory (IRT) to explore the psychometric properties of clinical measures. Next, we consider how IRT has been used in clinical research for: scale linking, computerized adaptive testing, and differential item functioning analysis. Finally, we consider the scale properties of IRT trait scores. We conclude that there are notable differences between cognitive and clinical measures that have relevance for IRT modeling. Future research should be directed toward a better understanding of the metric of the latent trait and the psychological processes that lead to individual differences in item response behaviors.
1 December 2008 in Psychometrika
Every set of alternate weights (i.e., nonleast squares weights) in a multiple regression analysis with three or more predictors is associated with an infinite class of weights. All members of a given class can be deemed fungible because they yield identical SSE (sum of squared errors) and R2 values. Equations for generating fungible weights are reviewed and an example is given that illustrates how fungible weights can be profitably used to evaluate parameter sensitivity in multiple regression.
28 July 2016 in Frontiers in Neuroscience
Recent advances in fMRI research highlight the use of multivariate methods for examining whole-brain connectivity. Complementary data-driven methods are needed for determining the subset of predictors related to individual differences. Although commonly used for this purpose, ordinary least squares (OLS) regression may not be ideal due to multi-collinearity and over-fitting issues. Penalized regression is a promising and underutilized alternative to OLS regression. In this paper, we propose a nonparametric bootstrap quantile (QNT) approach for variable selection with neuroimaging data. We use real and simulated data, as well as annotated R code, to demonstrate the benefits of our proposed method. Our results illustrate the practical potential of our proposed bootstrap QNT approach. Our real data example demonstrates how our method can be used to relate individual differences in neural network connectivity with an externalizing personality measure. Also, our simulation results reveal that the QNT method is effective under a variety of data conditions. Penalized regression yields more stable estimates and sparser models than OLS regression in situations with large numbers of highly correlated neural predictors. Our results demonstrate that penalized regression is a promising method for examining associations between neural predictors and clinically relevant traits or behaviors. These findings have important implications for the growing field of functional connectivity research, where multivariate methods produce numerous, highly correlated brain networks.
1 March 2010 in Psychometrika
A general theory on the use of correlation weights in linear prediction has yet to be proposed. In this paper we take initial steps in developing such a theory by describing the conditions under which correlation weights perform well in population regression models. Using OLS weights as a comparison, we define cases in which the two weighting systems yield maximally correlated composites and when they yield minimally similar weights. We then derive the least squares weights (for any set of predictors) that yield the largest drop in R2 (the coefficient of determination) when switching to correlation weights. Our findings suggest that two characteristics of a model/data combination are especially important in determining the effectiveness of correlation weights: (1) the condition number of the predictor correlation matrix, Rxx, and (2) the orientation of the correlation weights to the latent vectors of Rxx.
4 December 2017 in Psychometrika
The Schmid–Leiman (S–L; Psychometrika 22: 53–61, 1957) transformation is a popular method for conducting exploratory bifactor analysis that has been used in hundreds of studies of individual differences variables. To perform a two-level S–L transformation, it is generally believed that two separate factor analyses are required: a first-level analysis in which k obliquely rotated factors are extracted from an observed-variable correlation matrix, and a second-level analysis in which a general factor is extracted from the correlations of the first-level factors. In this article, I demonstrate that the S–L loadings matrix is necessarily rank deficient. I then show how this feature of the S–L transformation can be used to obtain a direct S–L solution from an unrotated first-level factor structure. Next, I reanalyze two examples from Mansolf and Reise (Multivar Behav Res 51: 698–717, 2016) to illustrate the utility of ‘best-fitting’ S–L rotations when gauging the ability of hierarchical factor models to recover known bifactor structures. Finally, I show how to compute direct bifactor solutions for non-hierarchical bifactor structures. An online supplement includes R code to reproduce all of the analyses that are reported in the article.
6 May 2015 in Clinical Oral Investigations