7 June 2018 in IEEE Transactions on Mobile Computing
State-of-the-art systems in literature using wearables are not capable of distinguishing large number of fine-grained and/or complex human activities, which may appear similar but with vital differences in context. This paper has proposed a novel system, HuMAn, that recognizes and classifies complex at-home activities of human users with wearable sensing. HuMAn makes such classification feasible by leveraging selective multi-modal sensing from wearable, and enhances richness of sensed information for activity classification by further leveraging placement of wearables across multiple positions on human body. HuMAn system consists of the following components: (a) practical feature set extraction from specific multi-modal sensor suites; (b) novel two-level structured classification algorithm that improves accuracy by leveraging sensors in multiple body positions; and (c) refinement in classification of complex activities with minimal external infrastructure support. The system is evaluated with 10 users in real home environments. Experimental results demonstrate that HuMAn can detect total 21 complex at-home activities with high degree of accuracy. For same-user evaluations (data split from same user), the average activity classification accuracy for 10-fold cross-validation is as high as 95% over the 21 activities and for cross-user evaluations, the average classification accuracy for 10-fold cross-validation is 92% and leave-one-out cross-validation is 75%.
23 September 2018 in IEEE Journal of Biomedical and Health Informatics
Chronic obstructive pulmonary disease (COPD) and congestive heart failure (CHF) are leading chronic health concerns among the aging population today. They are both typically characterized by episodes of cough that share similarities. In this paper, we design TussisWatch, a smart-phone-based system to record and process cough episodes for early identification of COPD or CHF. In our technique, for each cough episode, we do the following: 1) filter noise; 2) use domain expertise to partition each cough episode into multiple segments, indicative of disease or otherwise; 3) identify a limited number of audio features for each cough segment; 4) remove inherent biases as a result of sample size differences; and 5) design a two-level classification scheme, based on the idea of Random Forests, to process a recorded cough segment. Our classifier, at the first-level, identifies whether or not a given cough segment indicates a disease. If yes, the second-level classifier identifies the cough segment as symptomatic of COPD or CHF. Testing with a cohort of 9 COPD, 9 CHF, and 18 CONTROLS subjects spread across both the genders, races, and ages, our system achieves good performance in terms of Sensitivity, Specificity, Accuracy, and Area under ROC curve. The proposed system has the potential to aid early access to healthcare, and may be also used to educate patients on self-care at home.
26 October 2018 in IEEE Transactions on Intelligent Transportation Systems
In this paper, we explore the feasibility of leveraging the accelerometer and gyroscope sensors in modern smartphones to detect instances of distracted driving activities (e.g., calling, texting, and reading while driving). To do so, we conducted an experiment with 16 subjects on a realistic driving simulator. As discussed later, the simulator is equipped with a realistic steering wheel, acceleration/braking pedals, and a wide screen to visualize background vehicular traffic. It is also programmed to simulate multiple environmental conditions like daytime, nighttime, fog, and rain/snow. The subjects were instructed to drive the simulator while performing a randomized sequence of activities that included texting, calling, and reading from a phone while they were driving, during which the accelerometer and gyroscope in the phone were logging sensory data. By extracting features from this sensory data, we then implemented a machine learning technique based on random forests to detect distracted driving. Our technique achieves very good precision, recall, and F -measure across all environmental conditions we tested. We believe that our contributions in this paper can have a significant impact on enhancing road safety.
7 April 2017 in IEEE Journal of Biomedical and Health Informatics
In a 2012 survey, in the United States alone, there were more than 35; 000 reported suicides with approximately 1; 800 of being psychiatric inpatients. Recent CDC (Centers for Disease Control and Prevention) reports indicate an upward trend in these numbers. In psychiatric facilities, staff perform intermittent or continuous observation of patients manually in order to prevent such tragedies, but studies show that they are insufficient, and also consume staff time and resources. In this paper, we present the Watch-Dog system, to address the problem of detecting self-harming activities when attempted by in-patients in clinical settings. Watch-Dog comprises of three key components - data sensed by tiny accelerometer sensors worn on wrists of subjects; an efficient algorithm to classify whether a user is active vs. dormant (i.e., performing a physical activity vs. not performing any activity); and a novel decision selection algorithm based on random forests and continuity indices for fine grained activity classification. With data acquired from 11 subjects performing a series of activities (both self-harming and otherwise), Watch-Dog achieves a classification accuracy of 98%, 94% and 70% for same-user 10-fold cross-validation, cross-user 10-fold cross-validation and cross-user leave-one-out evaluation respectively. We believe that the problem addressed in this paper is practical, important and timely. We also believe that our proposed system is practically deployable, and related discussions are provided in this paper.
19 August 2023 in Expert Systems with Applications
6 December 2023 in ACM Journal on Computing and Sustainable Societies
Towards providing personalized care, digital mental-wellness apps today ask questions to learn about subjects. However, not all subjects using these apps will have mood problems; thus, they do not need follow-up questions. In this study, we investigate an alternate mechanism to handle such non-sensitive posts (i.e., those not indicating mood problems) in college settings. To do so, we generate and use training data provided by a cohort of peer college students so that responses to non-sensitive posts are contextual, emotionally aware, and empathetic while also being terminal (not asking follow-up questions). Using data from a real mental-wellness app used by students, we identify that AI models trained with our peer-provided dataset generate desirable responses to non-sensitive posts, while models trained with state-of-the-art (Facebook’s) Empathetic Dataset yields responses that ask many follow-up questions, hence giving a perception of being intrusive. We believe that mental wellness apps today must not assume that any subject using these apps has mood problems. Perceptions of intrusiveness (i.e., apps asking many questions) must be a factor in design. We also believe that peer students can provide rich and reliable training datasets for college mental wellness apps, a topic that is not yet explored.