Smartphones are now nearly ubiquitous; their numerous built-in sensors enable continuous measurement of activities of daily living, making them especially well-suited for health research. Researchers have proposed various human activity recognition (HAR) systems aimed at translating measurements from smartphones into various types of physical activity. In this review, we summarized the existing approaches to smartphone-based HAR. For this purpose, we systematically searched Scopus, PubMed, and Web of Science for peer-reviewed articles published up to December 2020 on the use of smartphones for HAR. We extracted information on smartphone body location, sensors, and physical activity types studied and the data transformation techniques and classification schemes used for activity recognition. Consequently, we identified 108 articles and described the various approaches used for data acquisition, data preprocessing, feature extraction, and activity classification, identifying the most common practices, and their alternatives. We conclude that smartphones are well-suited for HAR research in the health sciences. For population-level impact, future studies should focus on improving the quality of collected data, address missing data, incorporate more diverse participants and activities, relax requirements about phone placement, provide more complete documentation on study participants, and share the source code of the implemented methods and algorithms.

Amyotrophic lateral sclerosis (ALS) therapeutic development has largely relied on staff-administered functional rating scales to determine treatment efficacy. We sought to determine if mobile applications (apps) and wearable devices can be used to quantify ALS disease progression through active (surveys) and passive (sensors) data collection. Forty ambulatory adults with ALS were followed for 6-months. The Beiwe app was used to administer the self-entry ALS functional rating scale-revised (ALSFRS-RSE) and the Rasch Overall ALS Disability Scale (ROADS) surveys every 2–4 weeks. Each participant used a wrist-worn activity monitor (ActiGraph Insight Watch) or an ankle-worn activity monitor (Modus StepWatch) continuously. Wearable device wear and app survey compliance were adequate. ALSFRS-R highly correlated with ALSFRS-RSE. Several wearable data daily physical activity measures demonstrated statistically significant change over time and associations with ALSFRS-RSE and ROADS. Active and passive digital data collection hold promise for novel ALS trial outcome measure development.

The ubiquity of personal digital devices offers unprecedented opportunities to study human behavior. Current state-of-the-art methods quantify physical activity using “activity counts,” a measure which overlooks specific types of physical activities. We propose a walking recognition method for sub-second tri-axial accelerometer data, in which activity classification is based on the inherent features of walking: intensity, periodicity, and duration. We validate our method against 20 publicly available, annotated datasets on walking activity data collected at various body locations (thigh, waist, chest, arm, wrist). We demonstrate that our method can estimate walking periods with high sensitivity and specificity: average sensitivity ranged between 0.92 and 0.97 across various body locations, and average specificity for common daily activities was typically above 0.95. We also assess the method’s algorithmic fairness to demographic and anthropometric variables and measurement contexts (body location, environment). Finally, we release our method as open-source software in Python and MATLAB.

Wearable accelerometers have recently become a standalone tool for the objective assessment of physical activity (PA). In free-living studies, accelerometers are placed by protocol on a pre-defined body location (e.g., non-dominant wrist). However, the protocol is not always followed, e.g., the sensor can be moved between wrists or reattached in a different orientation. Such protocol violations often result in PA miscalculation. We propose an approach, PLOE (“Placement, Location and Orientation Evaluation method”), to determine the sensor position using statistical features from the raw accelerometer measurements. We compare the estimated position with the study protocol and identify discrepancies. We apply PLOE to the measurements collected from 45 older adults who wore ActiGraph GT3X+ accelerometers on the left and right wrist for seven days. We found that 15.6% of participants who wore accelerometers violated the protocol for one or more days. The sensors were worn on the wrong hand during 6.9% of the days of simultaneous wearing of devices. During the periods of discrepancies, the daily PA was miscalculated by more than 20%. Our findings show that correct placement of the device has a significant effect on the PA estimates. These results demonstrate a need for the evaluation of sensor position.

Objective evaluation of people with amyotrophic lateral sclerosis (PALS) in free-living settings is challenging. The introduction of portable digital devices, such as wearables and smartphones, may improve quantifying disease progression and hasten therapeutic development. However, there is a need for tools to characterize upper limb movements in neurologic disease and disability. Twenty PALS wore a wearable accelerometer, ActiGraph Insight Watch, on their wrist for six months. They also used Beiwe, a smartphone application that collected self-entry ALS Functional Rating Scale-Revised (ALSFRS-RSE) survey responses every 1-4 weeks. We developed several measures that quantify count and duration of upper limb movements: flexion, extension, supination, and pronation. New measures were compared against ALSFRS-RSE total score (Q1-12), and individual responses to specific questions related to handwriting (Q4), cutting food (Q5), dressing and performing hygiene (Q6), and turning in bed and adjusting bed clothes (Q7). Additional analysis considered adjusting for total activity counts (TAC). At baseline, PALS with higher Q1-12 performed more upper limb movements, and these movements were faster compared to individuals with more advanced disease. Most upper limb movement metrics had statistically significant change over time, indicating declining function either by decreasing count metrics or by increasing duration metric. All count and duration metrics were significantly associated with Q1-12, flexion and extension counts were significantly associated with Q6 and Q7, supination and pronation counts were also associated with Q4. All duration metrics were associated with Q6 and Q7. All duration metrics retained their statistical significance after adjusting for TAC. Wearable accelerometer data can be used to generate digital biomarkers on upper limb movements and facilitate patient monitoring in free-living environments. The presented method offers interpretable monitoring of patients' functioning and versatile tracking of disease progression in the limb of interest. Mitsubishi-Tanabe Pharma Holdings America, Inc.

In the monitoring process of wind turbines the utmost attention should be given to gearboxes. This conclusion is derived from numerous summary papers. They reveal that, on the one hand, gearboxes are one of the most fault susceptible elements in the drive-train and, on the other, the most expensive to replace. Although state-of-the-art CMS can usually provide advanced signal processing tools for extraction of diagnostic information, there are still many installations, where the diagnosis is based simply on the averaged wideband features like root-mean-square (RMS) or peak-peak (PP). Furthermore, for machinery working in highly changing operational conditions, like wind turbines, those estimators are strongly fluctuating, and this fluctuation is not linearly correlated to operation parameters. Thus, the sudden increase of a particular feature does not necessarily have to indicate the development of fault. To overcome this obstacle, it is proposed to detect a fault development with Artificial Neural Network (ANN) and further observation of linear regression parameters calculated on the estimation error between healthy and unknown condition. The proposed reasoning is presented on the real life example of ring gear fault in wind turbine’s planetary gearbox.