The timely, accurate monitoring of social indicators, such as poverty or inequality, on a finegrained spatial and temporal scale is a crucial tool for understanding social phenomena and policymaking, but poses a great challenge to official statistics. This article argues that an interdisciplinary approach, combining the body of statistical research in small area estimation with the body of research in social data mining based on Big Data, can provide novel means to tackle this problem successfully. Big Data derived from the digital crumbs that humans leave behind in their daily activities are in fact providing ever more accurate proxies of social life. Social data mining from these data, coupled with advanced model-based techniques for fine-grained estimates, have the potential to provide a novel microscope through which to view and understand social complexity. This article suggests three ways to use Big Data together with small area estimation techniques, and shows how Big Data has the potential to mirror aspects of well-being and other socioeconomic phenomena.
25 May 2010 in Australian & New Zealand Journal of Statistics
Food waste is a significant problem within public catering establishments in any normal situation. During spring 2020 the Covid-19 pandemic placed the public catering system under greater pressure, revealing weaknesses within the system and generation of food waste due to rapidly changing consumption patterns. In times of crisis, it is especially important to conserve resources and allocate existing resources to areas where they can be of most use, but this poses significant challenges. This study evaluated the potential of a forecasting model to predict guest attendance during the start and throughout the pandemic. This was done by collecting data on guest attendance in Swedish school and preschool catering establishments before and during the pandemic, and using a machine learning approach to predict future guest attendance based on historical data. Comparison of various learning methods revealed that random forest produced more accurate forecasts than a simple artificial neural network, with conditional mean absolute prediction error of 0.15 for the trained dataset. Economic savings were obtained by forecasting compared with a no-plan scenario, supporting selection of the random forest approach for effective forecasting of meal planning. Overall, the results obtained using forecasting models for meal planning in times of crisis confirmed their usefulness. Continuous use can improve estimates for the test period, due to the agile and flexible nature of these models. This is particularly important when guest attendance is unpredictable, so that production planning can be optimized to reduce food waste and contribute to a more sustainable and resilient food system.