21 December 2022 in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Brain health attracts more recent attention as the population ages. Smartphone-based gait sensing and analysis can help identify the risks of brain diseases in daily life for prevention. Existing gait analysis approaches mainly hand-craft temporal gait features or developing CNN-based feature extractors, but they are either prone to lose some inconspicuous pathological information or are only dedicated to a single brain disease screening. We discover that the relationship between gait segments can be used as a principle and generic indicator to quantify multiple pathological patterns. In this paper, we propose NeuralGait, a pervasive smartphone-cloud system that passively captures and analyzes principle gait segments relationship for brain health assessment. On the smartphone end, inertial gait data are collected while putting the smartphone in the pants pocket. We then craft local temporal-frequent gait domain features and develop a self-attention-based gait segment relationship encoder. Afterward, the domain features and relation features are fed to a scalable RiskNet in the cloud for brain health assessment. We also design a pathological hot update protocol to efficiently add new brain diseases in the RiskNet. NeuralGait is practical as it provides brain health assessment with no burden in daily life. In the experiment, we recruit 988 healthy people and 417 patients with a single or combination of PD, TBI, and stroke, and evaluate the brain health assessment using a set of specifically designed metrics including global accuracy, exact accuracy, sensitivity, and false alarm rate. We also demonstrate the generalization (e.g., analysis of feature effectiveness and model efficiency) and inclusiveness of NeuralGait.
9 May 2019 in IEEE Internet of Things Journal
With the development of Internet of Things (IoT), indoor localization has been a research focus in recent years. For Inertial Measurement Unit (IMU) based indoor localization method, Zero Velocity Update (ZUPT) uses the known velocity at stationary epoch as a benchmark to calibrate the velocity drift. However, stationary epoch only takes up 24% of a whole gait cycle time, and the velocity drift at the remaining 76% time is usually estimated according to an assumption that velocity has a linear drift over time, which would introduce errors. In this paper, a two-step velocity calibration method was proposed based on human gait characteristics with Smart Insole: Known Velocity Update (KUPT) and Double-Foot Position Calibration (DFPC). KUPT could measure the velocity from heel-strike to toe-off based on the recorded real-time foot angle and the shoe dimensions, which increases the time period when the velocity could be measured from 24% to 62% of a whole gait cycle time. DFPC method could fuse the position information of both feet based on the symmetrical characteristic of human gait to further increase the reliability of the localization results. The statistical result of a 20 times 20 m walking experiment showed that KUPT method was more accurate and reliable than ZUPT method for both feet, and DFPC method could further improve the result of KUPT method. Another experiment about walking in an indoor environment for 91 m showed that the proposed KUPT+DFPC method had an error of about 0.78 m which is acceptable for most IoT applications.
22 December 2020 in IEEE Journal of Biomedical and Health Informatics
Falls are leading causes of nonfatal injuries in the workplace, which has a substantial injury and economic consequences. To help avoid fall injuries, asking safety managers to inspect working areas routinely is normally used. However, it is difficult for a limited number of safety managers to inspect instant fall hazards in time, especially in large workplaces. To address this problem, a novel fall hazard identification method was proposed in this paper, which makes it possible for all the workers in the workplace to report the potential hazards automatically. This method is based on the fact that people use different gaits to get across different floor surfaces. Through analyzing the gait patterns, potential fall hazards could be identified automatically. In this research, Smart Insole, an insole shaped wearable system for gait analysis, was applied to measure and analyze gait patterns for fall hazard identification. Since slips and trips are two main causes of falls in workplace, recognizing fall hazards that could lead to slips and trips was the focus of this study. Five effective gait features were extracted to train a Support Vector Machine (SVM) model for recognizing slip hazard, trip hazard, and safe floor surfaces. Experiment results showed that fall hazards could be recognized with high accuracy (98.1%).
20 April 2020 in IEEE Sensors Journal
With the development of technologies, an increasing number of wearable devices that are currently at the heart of the development of the Internet of Things are used around the world. The concerns about privacy, in particular healthcare wearable devices, are exacerbated as the requirement for selfhealth monitoring increases. In addition, many sources of data are geographically separated and might not be allowed to release due to patients or regulatory constraints. Accordingly, in this paper, a distributed hierarchical deep learning system is proposed. The proposed system applying a distributed hierarchical neural network over a cloud server and smartphones. The system enables multiple smartphones to train a shared consensus model collaboratively while keeping the private data locally to protect data privacy, and the system takes advantage of the abundant computational resources on the cloud server to lower the computational overhead on smartphones. The proposed system is demonstrated by a fall detection study which is the common healthcare issue among human beings. The patients’ data are collected from multiple wearable devices including the smartphone, the smartwatch, and the smart insoles. The experimental results show that the distributed hierarchical deep learning system can reproduce the accuracy, specificity, precision, and sensitivity of centralized machine learning while preserving privacy.
16 July 2021 in IEEE Internet of Things Journal
Smoking cessation is a significant challenge for many people addicted to cigarettes and tobacco. Mobile health-related research into smoking cessation is primarily focused on mobile phone data collection either using self-reporting or sensor monitoring techniques. In the past five years with the increased popularity of smartwatch devices, research has been conducted to predict smoking movements associated with smoking behaviors based on accelerometer data analyzed from the internal sensors in a user’s smartwatch. Previous smoking detection methods focused on classifying current user smoking behavior. For many users who are trying to quit smoking, this form of detection may be insufficient as the user has already relapsed. In this article, we present a smoking cessation system utilizing a smartwatch and finger sensor that is capable of detecting presmoking activities to discourage users from future smoking behavior. Presmoking activities include grabbing a pack of cigarettes or lighting a cigarette and these activities are often immediately succeeded by smoking. Therefore, through accurate detection of presmoking activities, we can alert the user before they have relapsed. Our smoking cessation system combines data from a smartwatch for gross accelerometer and gyroscope information and a wearable finger sensor for detailed finger bend-angle information. We compare the results of a smartwatch-only system with a combined smartwatch and finger sensor system to illustrate the accuracy of each system. The combined smartwatch and finger sensor system performed at an 80.6% accuracy for the classification of presmoking activities compared to 47.0% accuracy of the smartwatch-only system.
16 September 2019 in IEEE Transactions on Mobile Computing
With deep learning techniques, researchers can discover deep properties and features of events from quantitative mobile sensor data. However, many data sources are geographically separated and have strict privacy, security, and regulatory constraints. Upon releasing the privacy-sensitive data, these data sources generally no longer physically possess their data and cannot interfere with the way their personal data being used. Therefore, it is necessary to explore distributed data mining architecture which is able to conduct consensus learning based on needs. Accordingly, we propose a distributed deep learning optimized system which contains a cloud server and multiple smartphone devices with computation capabilities and each device is served as a personal mobile data hub for enabling mobile computing while preserving data privacy. The proposed system keeps the private data locally in smartphones, shares trained parameters and builds a global consensus model. The feasibility and usability of the proposed system are evaluated by three experiments and related discussion. The experimental results show that the proposed distributed deep learning system can reconstruct the behavior of centralized training. We also measure the cumulative network traffic in different scenarios and show that the partial parameter sharing strategy does not only preserve the performance of the trained model but also can reduce network traffic.