1 January 2008 in American Psychologist
Classic parametric statistical significance tests, such as analysis of variance and least squares regression, are widely used by researchers in many disciplines, including psychology. For classic parametric tests to produce accurate results, the assumptions underlying them (e.g., normality and homoscedasticity) must be satisfied. These assumptions are rarely met when analyzing real data. The use of classic parametric methods with violated assumptions can result in the inaccurate computation of p values, effect sizes, and confidence intervals. This may lead to substantive errors in the interpretation of data. Many modern robust statistical methods alleviate the problems inherent in using parametric methods with violated assumptions, yet modern methods are rarely used by researchers. The authors examine why this is the case, arguing that most researchers are unaware of the serious limitations of classic methods and are unfamiliar with modern alternatives. A range of modern robust and rank-based significance tests suitable for analyzing a wide range of designs is introduced. Practical advice on conducting modern analyses using software such as SPSS, SAS, and R is provided. The authors conclude by discussing robust effect size indices.
17 January 2011 in Journal of Applied Social Psychology
1 June 2016 in Journal of Anxiety Disorders
26 November 2012 in Journal of Statistical Computation and Simulation
The most common strategy for comparing two independent groups is in terms of some measure of location intended to reflect the typical observation. However, it can be informative and important to compare the lower and upper quantiles as well, but when there are tied values, extant techniques suffer from practical concerns reviewed in the paper. For the special case where the goal is to compare the medians, a slight generalization of the percentile bootstrap method performs well in terms of controlling Type I errors when there are tied values [Wilcox RR. Comparing medians. Comput. Statist. Data Anal. 2006;51:1934–1943]. But our results indicate that when the goal is to compare the quartiles, or quantiles close to zero or one, this approach is highly unsatisfactory when the quantiles are estimated using a single order statistic or a weighted average of two order statistics. The main result in this paper is that when using the Harrell–Davis estimator, which uses all of the order statistics to estimate a quantile, control over the Type I error probability can be achieved in simulations, even when there are tied values, provided the sample sizes are not too small. It is demonstrated that this method can also have substantially higher power than the distribution free method derived by Doksum and Sievers [Plotting with confidence: graphical comparisons of two populations. Biometrika 1976;63:421–434]. Data from two studies are used to illustrate the practical advantages of the method studied here.
1 August 2018 in Journal of Consulting and Clinical Psychology
The present study aimed to examine whether Anorexia Nervosa (AN) illness severity or duration is associated with retention or treatment response in outpatient, enhanced cognitive-behavioral therapy (CBT-E). Patients with a confirmed AN diagnosis (N = 134) completed measures of eating disorder symptoms and quality of life, and had their BMI objectively measured before, during, and after treatment. We evaluated whether illness severity or duration predicted treatment outcomes, using longitudinal regression models. Greater levels of illness severity and duration were not associated with poorer treatment outcomes. Patients with more severe or long-standing AN illness did just as well in CBT-E as any other patient starting treatment. Therefore, classifying individuals as "severe and enduring" appears to lack clinical utility in CBT-E. Clinicians should continue to administer evidence-supported treatments such as CBT-E for patients with AN, regardless of duration or severity of AN illness. (PsycINFO Database Record
1 February 2015 in Behaviour Research and Therapy