In meta-analysis, the usual way of assessing whether a set of single studies is homogeneous is by means of the Q test. However, the Q test only informs meta-analysts about the presence versus the absence of heterogeneity, but it does not report on the extent of such heterogeneity. Recently, the I(2) index has been proposed to quantify the degree of heterogeneity in a meta-analysis. In this article, the performances of the Q test and the confidence interval around the I(2) index are compared by means of a Monte Carlo simulation. The results show the utility of the I(2) index as a complement to the Q test, although it has the same problems of power with a small number of studies.
It is very common to find meta-analyses in which some of the studies compare 2 groups on continuous dependent variables and others compare groups on dichotomized variables. Integrating all of them in a meta-analysis requires an effect-size index in the same metric that can be applied to both types of outcomes. In this article, the performance in terms of bias and sampling variance of 7 different effect-size indices for estimating the population standardized mean difference from a 2 x 2 table is examined by Monte Carlo simulation, assuming normal and nonnormal distributions. The results show good performance for 2 indices, one based on the probit transformation and the other based on the logistic distribution.
1 June 2018 in European Journal of Physical and Rehabilitation Medicine
The Modified Ashworth Scale is the most widely clinical scale used to measure the increase of muscle tone. Reliability is not an immutable property of a scale and can vary as a function of the variability and composition of the sample to which it is administered. The best method to examine how the reliability of a test scores varies is by conducting a systematic review and meta-analysis of the reliability coefficients obtained in different applications of the test with the data at hand. The objectives of this systematic revision are: what is the mean inter- and intra-rater reliability of the Modified Ashworth Scale's scores in upper and lower extremities? Which study characteristics affect the reliability of the scores in this scale? The PubMed, Embase and CINAHL databases were searched from 1987 to February 2015. Two reviewers independently selected empirical studies published in English or in Spanish that applied the Modified Ashworth Scale and reported any reliability coefficient with the data at hand in children, adolescents or adults with spasticity. Thirty-three studies reported any reliability estimate of Modified Ashworth Scale scores (N.=1065 participants). For lower extremities and inter-rater agreement, the mean intraclass correlation was ICC+=0.686 (95% CI: 0.563 and 0.780) and for kappa coefficients, κ+=0.360 (95% CI: 0.241 and 0.468); for intra-rater agreement: ICC+=0.644 (95% CI: 0.543 and 0.726) and κ+=0.488 (95% CI: 0.370 and 0.591). For upper extremities and inter-rater agreement: ICC+=0.781 (95% CI: 0.679 and 0.853) and κ+=0.625 (95% CI: 0.350 and 0.801); for intra-rater agreement: ICC+=0.748 (95% CI: 0.671 and 0.809) and κ+=0.593 (95% CI: 0.467 and 0.696). The type of design, the study focus, and the number of raters presented statistically significant relationships with ICC both for lower and upper extremities. Inter- and intra-rater agreement for Modified Ashworth Scale scores was satisfactory. Modified Ashworth Scale' scores exhibited better reliability when measuring upper extremities than lower. Several characteristics of the studies were statistically associated to inter-rater reliability of the scores for lower and upper extremities.