Measuring treatment effects when an individual’s pretreatment performance is improving poses a challenge for single-case experimental designs. It may be difficult to determine whether improvement is due to the treatment or due to the preexisting baseline trend. Tau-U is a popular single-case effect size statistic that purports to control for baseline trend. However, despite its strengths, Tau-U has substantial limitations: Its values are inflated and not bound between −1 and +1, it cannot be visually graphed, and its relatively weak method of trend control leads to unacceptable levels of Type I error wherein ineffective treatments appear effective. An improved effect size statistic based on rank correlation and robust regression, Baseline Corrected Tau, is proposed and field-tested with both published and simulated single-case time series. A web-based calculator for Baseline Corrected Tau is also introduced for use by single-case investigators.
1 June 2020 in Journal of Psychotherapy Integration
Single-case experimental methods are used across a range of educational and psychological research. Single-case data are analyzed with a variety of methods, but no statistic has demonstrated clear superiority over other methods. The time-series nature of single-case designs requires special consideration for baseline trend and autocorrelation when estimating intervention effect size. However, standard correction methods are limited because they assume precise statistical estimation of trend and autocorrelation. Unlike standard correction methods, Monte Carlo simulation methods can address the poor precision of single-case effect size indices. This paper presents the rationale for a new simulation method, Interrupted Time-Series Simulation (ITSSIM). A small field test was also conducted, and ITSSIM performed similarly to sophisticated multilevel methods for single-case research. ITSSIM is accessible as a free software application that requires no prior knowledge of statistical computing or syntax. ITSSIM may be used to estimate the effect size of a single interrupted time-series (AB design), and multiple ITSSIM effect size estimates may be combined via meta-analysis. (PsycINFO Database Record (c) 2018 APA, all rights reserved).