The distances of discrete probability distributions are considered. Necessary and sufficient conditions for validity of the data processing theorem of information theory are established. These conditions are applied to the Burbea-Rao (1982) divergences and Bregman (1967) distances.
Problems of goodness-of-fit to a given distribution can usually be reduced to test uniformity. The uniform distribution appears due to natural random events or due to the application of methods for transforming samples from any other distribution to the samples with values uniformly distributed in the interval (0, 1). Thus, one can solve the problem of testing if a sample comes from a given distribution by testing whether its transformed sample is distributed according to the uniform distribution. For this reason, the methods of testing for goodness-of-fit to a uniform distribution have been widely investigated. In this paper, a comparative power analysis of a selected set of statistics is performed in order to give suggestions on which one to use for testing uniformity against the families of alternatives proposed by Stephens [Stephens, M.A., 1974, EDF statistics for goodness of fit and some comparisons. Journal of the American Statistical Association, 69, 730–737.]. Definition and some relevant features of the considered test statistics are given in section 1. Implemented numerical processes to calculate percentage points of every considered statistic are described in section 2. Finally, a Monte Carlo simulation experiment has been carried out to fulfill the mentioned target of this paper.
Read (1984) presented an asymptotic expansion for the distribution function of the power divergence statistics whose speed of convergence is dependent on the parameter of the family. Generalizes that result by considering the family of (h, φ)‐divergence measures. Considers two other closer approximations to the exact distribution. Compares these three approximations for the Renyi’s statistic in small samples.