7 July 2007 in Statistical Methods & Applications
1 June 2015 in Journal of Official Statistics
The timely, accurate monitoring of social indicators, such as poverty or inequality, on a finegrained spatial and temporal scale is a crucial tool for understanding social phenomena and policymaking, but poses a great challenge to official statistics. This article argues that an interdisciplinary approach, combining the body of statistical research in small area estimation with the body of research in social data mining based on Big Data, can provide novel means to tackle this problem successfully. Big Data derived from the digital crumbs that humans leave behind in their daily activities are in fact providing ever more accurate proxies of social life. Social data mining from these data, coupled with advanced model-based techniques for fine-grained estimates, have the potential to provide a novel microscope through which to view and understand social complexity. This article suggests three ways to use Big Data together with small area estimation techniques, and shows how Big Data has the potential to mirror aspects of well-being and other socioeconomic phenomena.
28 October 2008 in Computational Statistics
23 February 2009 in Journal of Nonparametric Statistics
Quantile regression investigates the conditional quantile functions of a response variable in terms of a set of covariates. M-quantile regression extends this idea by a ‘quantile-like’ generalisation of regression based on influence functions. In this work, we extend it to nonparametric regression, in the sense that the M-quantile regression functions do not have to be assumed to have a certain parametric form, but can be left undefined and estimated from the data. Penalised splines are employed to estimate them. This choice makes it easy to move to bivariate smoothing and semiparametric modelling. An algorithm based on iteratively reweighted penalised least squares to actually fit the model is proposed. Quantile crossing is addressed using an a posteriori adjustment to the function fits following He [1]. Simulation studies show the finite sample properties of the proposed estimation technique.
10 October 2007 in Statistical Methods & Applications