Parallel statistical computing is an interesting and topical problem, driven by recent growth in the size of statistical data sets and the availability of network computing. This article reviews parallel statistical computing in regression analysis, nonparametric inference, and stochastic processes. In particular, we describe a range of methods including parallel multisplitting and the parallel QR method for least squares estimation in linear regression, parallel computing methods for nonlinear regression, the theoretical framework of the parallel bootstrap in nonparametric inference, preconditioner methods for Markov chains, and parallel Markov-chain Monte Carlo methods. We conclude that there is a need for further research in parallel statistical computing, and describe some of the important unsolved problems.
1 January 2015 in Journal of Computational and Applied Mathematics
Distributed interval estimation in linear regression may be computationally infeasible in the presence of big data that are normally stored in different computer servers or in cloud. The existing challenge represents the results from the distributed estimation may still contain redundant information about the population characteristics of the data. To tackle this computing challenge, we develop an optimization procedure to select the best subset from the collection of data subsets, based on which we perform interval estimation in the context of linear regression. The procedure is derived based on minimizing the length of the final interval estimator and maximizing the information remained in the selected data subset, thus is named as the LIC criterion. Theoretical performance of the LIC criterion is studied in this paper together with a simulation study and real data analysis.