Mobile phones are a pervasive platform for opportunistic sensing of behaviors and opinions. Three studies use location and communication sensors to model individual behaviors and symptoms, long-term health outcomes, and the diffusion of opinions in a community. These three analyses illustrate how mobile phones can unobtrusively monitor rich social interactions, because the underlying sensing technologies are now commonplace and readily available.
24 January 2011 in ACM Transactions on Intelligent Systems and Technology
In this work, we discover the daily location-driven routines that are contained in a massive real-life human dataset collected by mobile phones. Our goal is the discovery and analysis of human routines that characterize both individual and group behaviors in terms of location patterns. We develop an unsupervised methodology based on two differing probabilistic topic models and apply them to the daily life of 97 mobile phone users over a 16-month period to achieve these goals. Topic models are probabilistic generative models for documents that identify the latent structure that underlies a set of words. Routines dominating the entire group's activities, identified with a methodology based on the Latent Dirichlet Allocation topic model, include “going to work late”, “going home early”, “working nonstop” and “having no reception (phone off)” at different times over varying time-intervals. We also detect routines which are characteristic of users, with a methodology based on the Author-Topic model. With the routines discovered, and the two methods of characterizing days and users, we can then perform various tasks. We use the routines discovered to determine behavioral patterns of users and groups of users. For example, we can find individuals that display specific daily routines, such as “going to work early” or “turning off the mobile (or having no reception) in the evenings”. We are also able to characterize daily patterns by determining the topic structure of days in addition to determining whether certain routines occur dominantly on weekends or weekdays. Furthermore, the routines discovered can be used to rank users or find subgroups of users who display certain routines. We can also characterize users based on their entropy. We compare our method to one based on clustering using K-means. Finally, we analyze an individual's routines over time to determine regions with high variations, which may correspond to specific events.
There is relatively little work on the investigation of large-scale human data in terms of multimodality for human activity discovery. In this paper, we suggest that human interaction data, or human proximity, obtained by mobile phone Bluetooth sensor data, can be integrated with human location data, obtained by mobile cell tower connections, to mine meaningful details about human activities from large and noisy datasets. We propose a model, called bag of multimodal behavior, that integrates the modeling of variations of location over multiple time-scales, and the modeling of interaction types from proximity. Our representation is simple yet robust to characterize real-life human behavior sensed from mobile phones, which are devices capable of capturing large-scale data known to be noisy and incomplete. We use an unsupervised approach, based on probabilistic topic models, to discover latent human activities in terms of the joint interaction and location behaviors of 97 individuals over the course of approximately a 10-month period using data from MIT's Reality Mining project. Some of the human activities discovered with our multimodal data representation include “going out from 7 pm-midnight alone” and “working from 11 am-5 pm with 3-5 other people,” further finding that this activity dominantly occurs on specific days of the week. Our methodology also finds dominant work patterns occurring on other days of the week. We further demonstrate the feasibility of the topic modeling framework for human routine discovery by predicting missing multimodal phone data at specific times of the day.
Biomedical research often involves conducting experiments on model organisms in the anticipation that the biology learnt will transfer to humans. Previous comparative studies of mouse and human tissues were limited by the use of bulk-cell material. Here we show that transfer learning—the branch of machine learning that concerns passing information from one domain to another—can be used to efficiently map bone marrow biology between species, using data obtained from single-cell RNA sequencing. We first trained a multiclass logistic regression model to recognize different cell types in mouse bone marrow achieving equivalent performance to more complex artificial neural networks. Furthermore, it was able to identify individual human bone marrow cells with 83% overall accuracy. However, some human cell types were not easily identified, indicating important differences in biology. When re-training the mouse classifier using data from human, less than 10 human cells of a given type were needed to accurately learn its representation. In some cases, human cell identities could be inferred directly from the mouse classifier via zero-shot learning. These results show how simple machine learning models can be used to reconstruct complex biology from limited data, with broad implications for biomedical research.
Exposure and adoption of opinions in social networks are important questions in education, business, and government. We describe a novel application of pervasive computing based on using mobile phone sensors to measure and model the face-to-face interactions and subsequent opinion changes amongst undergraduates, during the 2008 US presidential election campaign. We find that self-reported political discussants have characteristic interaction patterns and can be predicted from sensor data. Mobile features can be used to estimate unique individual exposure to different opinions, and help discover surprising patterns of dynamic homophily related to external political events, such as election debates and election day. To our knowledge, this is the first time such dynamic homophily effects have been measured. Automatically estimated exposure explains individual opinions on election day. Finally, we report statistically significant differences in the daily activities of individuals that change political opinions versus those that do not, by modeling and discovering dominant activities using topic models. We find people who decrease their interest in politics are routinely exposed (face-to-face) to friends with little or no interest in politics.
About Me
{Katayoun Farrahi} received the Bachelor of Engineering Science degree from the University of Toronto, Canada, in 1998, the M.E.E. degree from the University of Victoria, Canada, in 2002, and the Ph.D. degree from the Swiss Federal Institute of Technology in Lausanne (EPFL) and Idiap, Switzerland in 2007. She is currently a lecturer in the ECS department at the University of Southampton working in the vision, learning, and control VLC Group. The focus of her research is on machine learning applied to large-scale mobile phone and wearable sensor datasets. Much of her research has focused on mobile phone data. She also works on mobile phone sensed data-driven applications, basically applications which can make use of human behavior knowledge extracted from mobile sensed data. One example is the simulation of epidemics from mobile phone sensed physical proximity data. Prior to joining Southampton, she was a research assistant at Idiap Research Institute.
{Katayoun Farrahi} received the Bachelor of Engineering Science degree from the University of Toronto, Canada, in 1998, the M.E.E. degree from the University of Victoria, Canada, in 2002, and the Ph.D. degree from the Swiss Federal Institute of Technology in Lausanne (EPFL) and Idiap, Switzerland in 2007. She is currently a lecturer in the ECS department at the University of Southampton working in the vision, learning, and control VLC Group. The focus of her research is on machine learning applied to large-scale mobile phone and wearable sensor datasets. Much of her research has focused on mobile phone data. She also works on mobile phone sensed data-driven applications, basically applications which can make use of human behavior knowledge extracted from mobile sensed data. One example is the simulation of epidemics from mobile phone sensed physical proximity data. Prior to joining Southampton, she was a research assistant at Idiap Research Institute.