The Alabama Parenting Questionnaire-9 (APQ-9) is a widely used brief measure of parenting behaviors. However, the reliability coefficients of the three APQ-9 subscales vary substantially. A reliability generalization meta-analysis was conducted on the three APQ-9 subscales to (a) estimate mean internal consistency reliability values and (b) examine the sources of variance. A total of 113 coefficient alphas from 31,572 informants, across 32 studies were included in this meta-analysis. Results showed acceptable mean α values (.84 for positive parenting, .66 for inconsistent discipline, and .70 for poor supervision subscales). Moderator analyses results found that differences in coefficient αs of the three subscales were influenced by numerous variables including administration format, country, language version, population, the mean and standard deviation of scores, and sample size. Our findings support the utility of the parent-report APQ-9 as a useful measure of parenting behaviors. Future research direction is also discussed. (PsycInfo Database Record (c) 2021 APA, all rights reserved).
During an experimental session, participants adapt and change due to learning, fatigue, fluctuations in attention, or other physiological or environmental changes. This temporal variation affects measurement, potentially reducing statistical power. We introduce a restricted randomization algorithm, permuted-subblock randomization (PSR), that boosts power by balancing experimental conditions over the course of an experimental session. We used Monte Carlo simulations to explore the performance of PSR across four scenarios of time-dependent error: exponential decay (learning effect), Gaussian random walk, pink noise, and a mixture of the previous three. PSR boosted power by about 13% on average, with a range from 4% to 45% across a representative set of study designs, while simultaneously controlling the false positive rate when time-dependent variation was absent. An R package, explan, provides functions to implement PSR during experiment planning.
Although the Antisocial Process Screening Device (APSD) is one of the most widely used instruments for assessing psychopathic traits, the reliability estimates of the APSD show great heterogeneity across different studies. This investigation evaluated the reliability of the APSD using a reliability generalization meta-analytic technique across 158 studies (N = 75,749). The APSD demonstrated marginal to acceptable coefficient alphas ranging from 0.62 (for the Callous–Unemotional subscale) to 0.79 (for the total scale). Further moderation analysis revealed that the differences in administration formats significantly explained the variance of coefficient alphas for the APSD total and subscales, and the self-report version of the APSD manifested poorer coefficient alphas than other-report versions. The standard deviation of scale scores also partly accounted for the variance of the coefficient alphas. Overall, the APSD was found to be a reliable, practical measurement of psychopathic traits in youth, which can be widely applied in various study settings. Nevertheless, we recommend that parent- and teacher-report versions of the APSD as the preferred administering format of the measure when used for children and juveniles, while the self-report version of the APSD is recommended with caution when assessing youth psychopathy, unless multiple-assess methods are used.