Automatic recognition of activities of daily living (ADL) is an important component in understanding of energy balance, quality of life, and other areas of health and well-being. In our previous work, we had proposed an insole-based activity monitor-SmartStep, designed to be socially acceptable and comfortable. The goals of the current study were: first, validation of SmartStep in recognition of a broad set of ADL; second, comparison of the SmartStep to a wrist sensor and testing these in combination; third, evaluation of SmartStep's accuracy in measuring wear noncompliance and a novel activity class (driving); fourth, performing the validation in free living against a well-studied criterion measure (ActivPAL, PAL Technologies); and fifth, quantitative evaluation of the perceived comfort of SmartStep. The activity classification models were developed from a laboratory study consisting of 13 different activities under controlled conditions. Leave-one-out cross validation showed 89% accuracy for the combined SmartStep and wrist sensor, 81% for the SmartStep alone, and 69% for the wrist sensor alone. When household activities were grouped together as one class, SmartStep performed equally well compared to the combination of SmartStep and wrist-worn sensor (90% versus 94%), whereas the accuracy of the wrist sensor increased marginally (73% from 69%). SmartStep achieved 92% accuracy in recognition of nonwear and 82% in recognition of driving. Participants then were studied for a day under free-living conditions. The overall agreement with ActivPAL was 82.5% (compared to 97% for the laboratory study). The SmartStep scored the best on the perceived comfort reported at the end of the study. These results suggest that insole-based activity sensors may present a compelling alternative or companion to commonly used wrist devices
Footwear is an integral part of daily life. Embedding sensors and electronics in footwear for various different applications started more than two decades ago. This review article summarizes the developments in the field of footwear-based wearable sensors and systems. The electronics, sensing technologies, data transmission, and data processing methodologies of such wearable systems are all principally dependent on the target application. Hence, the article describes key application scenarios utilizing footwear-based systems with critical discussion on their merits. The reviewed application scenarios include gait monitoring, plantar pressure measurement, posture and activity classification, body weight and energy expenditure estimation, biofeedback, navigation, and fall risk applications. In addition, energy harvesting from the footwear is also considered for review. The article also attempts to shed light on some of the most recent developments in the field along with the future work required to advance the field.
22 December 2017 in IEEE Transactions on Neural Systems and Rehabilitation Engineering
Cerebral palsy (CP) is a group of non-progressive neuro-developmental conditions occurring in early childhood that causes movement disorders and physical disability. Measuring activity levels and gait patterns is an important aspect of CP rehabilitation programs. Traditionally, such programs utilize commercially available laboratory systems, which cannot to be utilized in community living. In this study, a novel, shoe based, wearable sensor system (Pediatric SmartShoe) was tested on 11 healthy children and 10 children with CP to validate its use for monitoring of physical activity and gait. Novel data processing techniques were developed to remove the effect of orthotics on the sensor signals. Machine learning models were developed to automatically classify the activities of daily living. The temporal gait parameters estimated from the SmartShoe data were compared against reference measurements on a GAITRite mat. A leave-one-out cross validation method indicated a 95.3% average accuracy of activity classification (for sitting, standing, walking) for children with CP and 96.2% for healthy children. Average relative errors in gait parameter estimation (gait cycle, stance, swing and step time, % single support time on both lower extremities, along with cadence) ranged from 0.2% to 6.4% (SD range = 1.4% to 9.9%). These results suggest that the pediatric SmartShoe can accurately measure physical activity and gait of children with CP, and can potentially be used for ambulatory monitoring.
19 May 2015 in IEEE Journal of Biomedical and Health Informatics
The use of wearable sensors coupled with the processing power of mobile phones may be an attractive way to provide real-time feedback about physical activity and energy expenditure (EE). Here, we describe the use of a shoe-based wearable sensor system (SmartShoe) with a mobile phone for real-time recognition of various postures/physical activities and the resulting EE. To deal with processing power and memory limitations of the phone, we compare the use of support vector machines (SVM), multinomial logistic discrimination (MLD), and multilayer perceptrons (MLP) for posture and activity classification followed by activity-branched EE estimation. The algorithms were validated using data from 15 subjects who performed up to 15 different activities of daily living during a 4-h stay in a room calorimeter. MLD and MLP demonstrated activity classification accuracy virtually identical to SVM (~ 95%) while reducing the running time and the memory requirements by a factor of >10 3 . Comparison of per-minute EE estimation using activity-branched models resulted in accurate EE prediction (RMSE = 0.78 kcal/min for SVM and MLD activity classification, 0.77 kcal/min for MLP versus RMSE of 0.75 kcal/min for manual annotation). These results suggest that low-power computational algorithms can be successfully used for real-time physical activity monitoring and EE estimation on a wearable platform.
Shoe-mounted wearable sensors can be used in applications, such as activity monitoring, gait analysis, post-stroke rehabilitation, body weight measurements and energy expenditure studies. Such wearable sensors typically require the modification or alteration of the shoe, which is not typically feasible for large populations without the direct involvement of shoe manufacturers. This article presents an insole-based wearable sensor (SmartStep) that has its electronics fully embedded into a generic insole, which is usable with a large variety of shoes and, thus, resolves the need for shoe modification. The SmartStep is an always-on electronic device that comprises a 3D accelerometer, a 3D gyroscope and resistive pressure sensors implemented around a CC2540 system-on-chip with an 8051 processor core, Bluetooth low energy (BLE) connectivity and flash memory buffer. The SmartStep is wirelessly interfaced to an Android smart phone application with data logging and visualization capabilities. This article focuses on low-power implementation methods and on the method developed for reliable data buffering, alleviating intermittent connectivity resulting from the user leaving the vicinity of the smart phone. The conducted tests illustrate the power consumption for several possible usage scenarios and the reliability of the data retention method. The trade-off between the power consumption and supported functionality is discussed, demonstrating that SmartStep can be worn for more than two days between battery recharges. The results of the mechanical reliability test on the SmartStep indicate that the pressure sensors in the SmartStep tolerated prolonged human wear. The SmartStep system collected more than 98.5% of the sensor data, in real usage scenarios, having intermittent connectivity with the smart phone.
In this work we developed and validated a method to capture the activities of daily living (ADL), transitions between ADL, and the associated Energy Expenditure (EE) using a novel insole based wearable system (SmartStep). A 15-participant study was conducted in a controlled laboratory environment while participants wore the SmartStep and performed various ADL. Machine learning models were developed using 4-branched and 8-branched steady-state activities to estimate the total energy expenditure (TEE) and physical activity energy expenditure (PAEE). Additional models accounting for transitions between activities were also developed. These models were validated in an independent study with 8-participants, performed in a whole room indirect calorimeter. In the controlled study, the 8-branched models had a lower root mean square error (RMSE, 0.58 vs. 0.67 kcal/min) and lower total error (−1.5% vs. 3%). In the validation study, the 8-branched models also had a lower RMSE (0.9 kcal/min vs. 1.2 kcal/min) and lower total error (−4.5% vs 11%). Accounting for activity transitions reduced the total error in the EE estimation to −1.3%. The results suggested that SmartStep can be used to accurately monitor the EE of the wearers in their daily living. The validation study results suggested that 8-branched models more accurately predict EE than 4-branched models and that accounting for activity transitions improves the estimation of EE in daily living.