1 June 1994 in Computational Statistics & Data Analysis
1 May 2004 in British Journal of Mathematical and Statistical Psychology
1 May 1995 in Computational Statistics & Data Analysis
1 January 1991 in Communications in Statistics - Simulation and Computation
The 2 × 2 tables used to present the data in an experiment for comparing two proportions by means of two observations of two independent binomial distributions may appear simple but are not. The debate about the best method to use is unending, and has divided statisticians into practically irreconcilable groups. In this article, all the available non-asymptotic tests are reviewed (except the Bayesian methodology). The author states which is the optimal (for each group), referring to the tables and programs that exist for them, and contrast the arguments used by supporters of each of the options. They also sort the tangle of solutions into "families", based on the methodology used and/or prior assumptions, and point out the most frequent methodological mistakes committed when comparing the different families.
28 September 2012 in Statistics and Computing
1 October 2005 in Statistical Methods in Medical Research
When studying the degree of overall agreement between the nominal responses of two raters, it is customary to use the coefficient kappa. A more detailed analysis requires the evaluation of the degree of agreement category by category, and this is carried out in two different ways: using the value of kappa in the collapsed table for each category or using the agreement index for each category (proportion of agreements observed). Both indices have disadvantages: the former is sensitive to marginal totals; the latter is not chance corrected; and neither distinguishes the case where one of the two raters is a gold standard (an expert) from the case where neither rater is a gold standard. This article suggests five chance-corrected indices which are not sensitive to marginal totals and which differ depending on whether there is a standard rater. The article also justifies the reason for poor performance of kappa when the two marginal totals are unbalanced (especially if they are so in opposite directions) and the reason for its good performance when analysing the various 2 2 tables obtained by the collapse of a wider table.