Generally, people do various things while walking. For example, people frequently walk while looking at their smartphones. Sometimes we walk differently than usual; for example, when walking on ice or snow, we tend to waddle. Understanding walking patterns could provide users with contextual information tailored to the current situation. To formulate this as a machine-learning problem, we defined 18 different everyday walking styles. Noting that walking strategies significantly affect the spatiotemporal features of hand motions, e.g., the speed and intensity of the swinging arm, we propose a smartwatch-based wearable system that can recognize these predefined walking styles. We developed a wearable system, suitable for use with a commercial smartwatch, that can capture hand motions in the form of multivariate timeseries (MTS) signals. Then, we employed a set of machine learning algorithms, including feature-based and recent deep learning algorithms, to learn the MTS data in a supervised fashion. Experimental results demonstrated that, with recent deep learning algorithms, the proposed approach successfully recognized a variety of walking patterns, using the smartwatch measurements. We analyzed the results with recent attention-based recurrent neural networks to understand the relative contributions of the MTS signals in the classification process.

Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet #Preprint #PeerReviewMe: Warning: This is a unreviewed preprint. Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn. Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period. Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author). Gait quality is generally considered a critical health indicator, especially for older adults. Assessing gait quality in an unobtrusive manner is essential for the seamless monitoring of these populations. However, precise evaluation of gait often requires dedicated sensor systems, which may not be feasible or practical for monitoring in everyday life. Gait quality is generally considered a critical health indicator, especially for older adults. Assessing gait quality in an unobtrusive manner is essential for the seamless monitoring of these populations. However, precise evaluation of gait often requires dedicated sensor systems, which may not be feasible or practical for monitoring in everyday life. We first defined four typical gait patterns of older adults: gait with disturbances, gait without disturbances, gait with cane, and gait with walker. Thereafter, we formulated the classification task of these gait patterns as a supervised machine learning problem in which multivariate time series signals of inertial motions captured while walking were learned and tested using deep neural network architectures in a supervised learning fashion. To demonstrate the feasibility of the proposed approach, we recruited 38 older adult participants (age: 80.4 +- 6.5; 73.7 % women). We also examined the internal representations and computational attention vectors learned by deep neural networks tailored to learn gait features from complex time series gait-related data. The experimental results validated the feasibility of the proposed approach, revealing that 1) gait patterns of older adults were recognized using smartwatch measurements from both-hands with high accuracies (mean F_1-score of 97.4 %) and 2) either left- or right-hand measurement is sufficient for the proposed recognition task (mean F_1-score of 97.1 %). The proposed wearable recognition system demonstrated acceptable performance (i.e., both accuracy and F_m were higher than 0.95), in predicting the gait patterns of the older adult population.

Previous research on 3D skeleton-based human action recognition has frequently relied on a sequence-wise viewpoint normalization process, which adjusts the view directions of all segmented action sequences. This type of approach typically demonstrates robustness against variations in viewpoint found in short-term videos, a characteristic commonly encountered in public datasets. However, our preliminary investigation of complex action sequences, such as discussions or smoking, reveals its limitations in capturing the intricacies of such actions. To address these view-dependency issues, we propose a straightforward, yet effective, sequence-wise augmentation technique. This strategy enhances the robustness of action recognition models, particularly against changes in viewing direction that mainly occur within the horizontal plane (azimuth) by rotating human key points around either the z-axis or the spine vector, effectively creating variations in viewing directions. We scrutinize the robustness of this approach against real-world viewpoint variations through extensive empirical studies on multiple public datasets, including an additional set of custom action sequences. Despite the simplicity of our approach, our experimental results consistently yield improved action recognition accuracies. Compared to the sequence-wise viewpoint normalization method used with advanced deep learning models like Conv1D, LSTM, and Transformer, our approach showed a relative increase in accuracy of 34.42% for the z-axis and 10.86% for the spine vector.

BACKGROUND Gait quality is generally considered a critical health indicator, especially for older adults. Assessing gait quality in an unobtrusive manner is essential for the seamless monitoring of these populations. However, precise evaluation of gait often requires dedicated sensor systems, which may not be feasible or practical for monitoring in everyday life. OBJECTIVE Gait quality is generally considered a critical health indicator, especially for older adults. Assessing gait quality in an unobtrusive manner is essential for the seamless monitoring of these populations. However, precise evaluation of gait often requires dedicated sensor systems, which may not be feasible or practical for monitoring in everyday life. METHODS We first defined four typical gait patterns of older adults: gait with disturbances, gait without disturbances, gait with cane, and gait with walker. Thereafter, we formulated the classification task of these gait patterns as a supervised machine learning problem in which multivariate time series signals of inertial motions captured while walking were learned and tested using deep neural network architectures in a supervised learning fashion. To demonstrate the feasibility of the proposed approach, we recruited 38 older adult participants (age: 80.4 +- 6.5; 73.7 % women). We also examined the internal representations and computational attention vectors learned by deep neural networks tailored to learn gait features from complex time series gait-related data. RESULTS The experimental results validated the feasibility of the proposed approach, revealing that 1) gait patterns of older adults were recognized using smartwatch measurements from both-hands with high accuracies (mean F_1-score of 97.4 %) and 2) either left- or right-hand measurement is sufficient for the proposed recognition task (mean F_1-score of 97.1 %). CONCLUSIONS The proposed wearable recognition system demonstrated acceptable performance (i.e., both accuracy and F_m were higher than 0.95), in predicting the gait patterns of the older adult population.