A goal of developmental research is to examine individual changes in constructs over time. The accuracy of the models answering such research questions hinges on the assumption of longitudinal measurement invariance: The repeatedly measured variables need to represent the same construct in the same metric over time. Measurement invariance can be studied through factor models examining the relations between the observed indicators and the latent constructs. In longitudinal research, ordered-categorical indicators such as self- or observer-report Likert scales are commonly used, and these measures often do not approximate continuous normal distributions. The present didactic article extends previous work on measurement invariance to the longitudinal case for ordered-categorical indicators. We address a number of problems that commonly arise in testing measurement invariance with longitudinal data, including model identification and interpretation, sparse data, missing data, and estimation issues. We also develop a procedure and associated R program for gauging the practical significance of the violations of invariance. We illustrate these issues with an empirical example using a subscale from the Mexican American Cultural Values scale. Finally, we provide comparisons of the current capabilities of 3 major latent variable programs (lavaan, Mplus, OpenMx) and computer scripts for addressing longitudinal measurement invariance. (PsycINFO Database Record
1 August 2008 in American Journal of Public Health
Public health researchers are addressing new research questions (e.g., effects of environmental tobacco smoke, Hurricane Katrina) for which the randomized controlled trial (RCT) may not be a feasible option. Drawing on the potential outcomes framework (Rubin Causal Model) and Campbellian perspectives, we consider alternative research designs that permit relatively strong causal inferences. In randomized encouragement designs, participants are randomly invited to participate in one of the treatment conditions, but are allowed to decide whether to receive treatment. In quantitative assignment designs, treatment is assigned on the basis of a quantitative measure (e.g., need, merit, risk). In observational studies, treatment assignment is unknown and presumed to be nonrandom. Major threats to the validity of each design and statistical strategies for mitigating those threats are presented.
Donald Campbell's approach to causal inference (D. T. Campbell, 1957; W. R. Shadish, T. D. Cook, & D. T. Campbell, 2002) is widely used in psychology and education, whereas Donald Rubin's causal model (P. W. Holland, 1986; D. B. Rubin, 1974, 2005) is widely used in economics, statistics, medicine, and public health. Campbell's approach focuses on the identification of threats to validity and the inclusion of design features that may prevent those threats from occurring or render them implausible. Rubin's approach focuses on the precise specification of both the possible outcomes for each participant and assumptions that are mathematically sufficient to estimate the causal effect. In this article, the authors compare the perspectives provided by the 2 approaches on randomized experiments, broken randomized experiments in which treatment nonadherence or attrition occurs, and observational studies in which participants are assigned to treatments on an unknown basis. The authors highlight dimensions on which the 2 approaches have different emphases, including the roles of constructs versus operations, threats to validity versus assumptions, methods of addressing threats to internal validity and violations of assumptions, direction versus magnitude of causal effects, role of measurement, and causal generalization. The authors conclude that investigators can benefit from drawing on the strengths of both approaches in designing research.
1 November 2012 in Multivariate Behavioral Research
A Monte Carlo simulation was conducted to investigate the robustness of 4 latent variable interaction modeling approaches (Constrained Product Indicator [CPI], Generalized Appended Product Indicator [GAPI], Unconstrained Product Indicator [UPI], and Latent Moderated Structural Equations [LMS]) under high degrees of nonnormality of the observed exogenous variables. Results showed that the CPI and LMS approaches yielded biased estimates of the interaction effect when the exogenous variables were highly nonnormal. When the violation of nonnormality was not severe (normal; symmetric with excess kurtosis < 1), the LMS approach yielded the most efficient estimates of the latent interaction effect with the highest statistical power. In highly nonnormal conditions, the GAPI and UPI approaches with maximum likelihood (ML) estimation yielded unbiased latent interaction effect estimates, with acceptable actual Type I error rates for both the Wald and likelihood ratio tests of interaction effect at N ≥ 500. An empirical example illustrated the use of the 4 approaches in testing a latent variable interaction between academic self-efficacy and positive family role models in the prediction of academic performance.
9 November 2017 in Journal of Educational Psychology
This 14 year prospective study investigated the effect of retention in grades 1–5 on high school completion (diploma, GED, or drop out). Participants were 734 (52.7% males) ethnically diverse, academically at-risk students recruited from Texas schools into the study when they were in first grade (mean age = 6.57). Propensity score weighting successfully equated the 256 retained students and the 478 students continuously promoted students on 65 covariates assessed in grade 1. At the end of 14 years, 477 had earned a diploma, 21 had obtained a GED, 110 had dropped out, and 126 were missing school completion status. Using multinomial logistic regression with high school graduation as the reference outcome, retention led to a significant increase in the likelihood of dropping out of high school (odds ratio = 2.61), above students’ propensity to be retained and additional covariates. The contrast between graduation and GED outcomes was not significant. A significant Retention X Ethnicity X Gender interaction was obtained: The negative effect of retention was strongest for African American and Hispanic girls. Even though grade retention in the elementary grades does not harm students in terms of their academic achievement or educational motivation at the transition to high school, retention increases the odds that a student will drop out of school before obtaining a high school diploma.