7 July 2007 in Statistical Methods & Applications
20 March 2013 in Journal of the Royal Statistical Society Series B: Statistical Methodology
1 May 2020 in Business Horizons
1 June 2015 in Journal of Official Statistics
The timely, accurate monitoring of social indicators, such as poverty or inequality, on a finegrained spatial and temporal scale is a crucial tool for understanding social phenomena and policymaking, but poses a great challenge to official statistics. This article argues that an interdisciplinary approach, combining the body of statistical research in small area estimation with the body of research in social data mining based on Big Data, can provide novel means to tackle this problem successfully. Big Data derived from the digital crumbs that humans leave behind in their daily activities are in fact providing ever more accurate proxies of social life. Social data mining from these data, coupled with advanced model-based techniques for fine-grained estimates, have the potential to provide a novel microscope through which to view and understand social complexity. This article suggests three ways to use Big Data together with small area estimation techniques, and shows how Big Data has the potential to mirror aspects of well-being and other socioeconomic phenomena.
10 August 2017 in Journal of the Royal Statistical Society Series A: Statistics in Society
Summary: Modern systems of official statistics require the accurate and timely estimation of sociodemographic indicators for disaggregated geographical regions. Traditional data collection methods such as censuses or household surveys impose great financial and organizational burdens on national statistical institutes. The rise of new information and communication technologies offers promising sources to mitigate these shortcomings. We propose a unified approach for national statistical institutes in developing countries based on small area estimation that allows for the estimation of sociodemographic indicators by using mobile phone data. In particular, the methodology is applied to mobile phone data from Senegal for deriving subnational estimates of the share of illiterates disaggregated by gender. The estimates are used to identify hotspots of illiterates with a need for additional infrastructure or policy adjustments. Although we focus on literacy as a particular sociodemographic indicator, the approach proposed is applicable to indicators from national statistics in general.