Commonly used sensors like accelerometers, gyroscopes, surface electromyography sensors, etc., which provide a convenient and practical solution for human activity recognition (HAR), have gained extensive attention. However, which kind of sensor can provide adequate information in achieving a satisfactory performance, or whether the position of a single sensor would play a significant effect on the performance in HAR are sparsely studied. In this paper, a comparative study to fully investigate the performance of the aforementioned sensors for classifying four activities (walking, tooth brushing, face washing, drinking) is explored. Sensors are spatially distributed over the human body, and subjects are categorized into three groups (able-bodied people, stroke survivors, and the union of both). Performances of using accelerometer, gyroscope, sEMG, and their combination in each group are evaluated by adopting the Support Vector Machine classifier with the Leave-One-Subject-Out Cross-Validation technique, and the optimal sensor position for each kind of sensor is presented based on the accuracy. Experimental results show that using the accelerometer could obtain the best performance in each group. The highest accuracy of HAR involving stroke survivors was 95.84 ± 1.75% (mean ± standard error), achieved by the accelerometer attached to the extensor carpi ulnaris. Furthermore, taking the practical application of HAR into consideration, a novel approach to distinguish various activities of stroke survivors based on a pre-trained HAR model built on healthy subjects is proposed, the highest accuracy of which is 77.89 ± 4.81% (mean ± standard error) with the accelerometer attached to the extensor carpi ulnaris.
27 June 2022 in IEEE Transactions on Neural Systems and Rehabilitation Engineering
Assessment of physical performance is essential to predict the frailty level of older adults. The modified Physical Performance Test (mPPT) clinically assesses the performance of nine activities: standing balance, chair rising up & down, lifting a book, putting on and taking off a jacket, picking up a coin, turning 360°, walking, going upstairs, and going downstairs. The activity performing duration is the primary evaluation standard. In this study, wearable devices are leveraged to recognize and predict mPPT items’ duration automatically. This potentially allows frequent follow up of physical performance, and facilitates more appropriate interventions. Five devices, including accelerometers and gyroscopes, were attached to the waist, wrists and ankles of eight younger adults. The system was experimented within three aspects: machine learning models, sensor placement, and sampling frequencies, to which the non-causal six-stages temporal convolutional network using 6.25 Hz signals from the left wrist and right ankle obtained the optimal performance. The duration prediction error ranged from 0.63 ± 0.29 s (turning 360°) to 8.21 ± 16.41 s (walking). The results suggest the potential for the proposed system in the automatic recognition and segmentation of mPPT items. Future work includes improving the recognition performance of lifting a book and implementing the frailty score prediction.
This article provides a systematic review of studies on recognising bathroom activities in older adults using wearable sensors. Bathroom activities are an important part of Activities of Daily Living (ADL). The performance on ADL activities is used to predict the ability of older adults to live independently. This paper aims to provide an overview of the studied bathroom activities, the wearable sensors used, different applied methodologies and the tested activity recognition techniques. Six databases were screened up to March 2020, based on four categories of keywords: older adults, activity recognition, bathroom activities and wearable sensors. In total, 4262 unique papers were found, of which only seven met the inclusion criteria. This small number shows that few studies have been conducted in this field. Therefore, in addition, this critical review resulted in several recommendations for future studies. In particular, we recommend to (1) study complex bathroom activities, including multiple movements; (2) recruit participants, especially the target population; (3) conduct both lab and real-life experiments; (4) investigate the optimal number and positions of wearable sensors; (5) choose a suitable annotation method; (6) investigate deep learning models; (7) evaluate the generality of classifiers; and (8) investigate both detection and quality performance of an activity.
During COVID‐19, awareness of proper hand washing has increased significantly. It is critical that people learn the correct hand washing techniques and adopt good hand washing habits. Hence, this study proposes using wearable devices to detect hand washing activity among other daily living activities (ADLs) and classify steps proposed by the World Health Organization (WHO). Two experiments were conducted with 16 participants, aged from 20 to 31. The first experiment was hand washing following WHO regulation (ten participants), and the second experiment was performing eight ADLs (eight participants). All participants wore two wearable devices equipped with accelerometers and gyroscopes; one on each wrist. Four machine learning classifiers were compared in classifying hand washing steps in the leave‐one‐subject‐out (LOSO) mode. The SVM model with Gaussian kernel achieved the best performance in classifying 11 washing hands steps, with an average F1‐score of 0.8501. When detected among the other ADLs, hand washing following WHO regulation obtained the F1‐score of 0.9871. The study demonstrates that wearable devices are feasible to detect hand washing activity and the hand washing techniques as well. The classification results of getting the soap and rubbing thumbs are low, which will be the main focus in the future study.
6 March 2025 in IEEE Transactions on Instrumentation and Measurement
Accurate sleep staging for patients with sleep disorders requires the integration of multiple channels and various signal modalities. While Graph Convolutional Networks (GCNs) have significantly improved sleep staging accuracy by effectively processing complex data, current GCN-based methods often require a large number of signal channels and struggle to capture temporal correlations effectively. They are leading to a large limitation in the scope of graph network models in sleep staging. To address these challenges, we propose an attention based Spatial-Temporal Graph Network for sleep staging, named ASTGSleep. ASTGSleep effectively addresses the temporal continuity of sleep data and overcomes limitations related to the number of channels by integrating the Temporal Graph Construction and Feature Extraction Module (TGFEM). TGFEM captures dynamic temporal features through temporal graph construction, complementing spatial features and enhancing sensitivity to sleep stage transitions. Moreover, the Multi-Dimensional Fusion Module (MDFM) optimizes and fuses these spatio-temporal features using a graph attention network, further improving accuracy and robustness in sleep staging. Experimental results demonstrate that ASTGSleep achieves competitive accuracy on datasets with different numbers of channels, such as MASSSS3 with 26 channels (87.0%) and SleepEDF-20 with 3 channels (86.5%). Furthermore, its performance on sleep disorder datasets, including CAP (81.4%) and clinical CZ-RBD (82.7%), shows robust generalization and enhanced accuracy, making it a promising tool for automatic sleep staging in clinical diagnostics.
21 May 2024 in IEEE Journal of Biomedical and Health Informatics
Sleep staging plays a critical role in evaluating the quality of sleep. Currently, most studies are either suffering from dramatic performance drops when coping with varying input modalities or unable to handle heterogeneous signals. To handle heterogeneous signals and guarantee favorable sleep staging performance when a single modality is available, a pseudo-siamese neural network (PSN) to incorporate electroencephalography (EEG), electrooculography (EOG) characteristics is proposed (PSEENet). PSEENet consists of two parts, spatial mapping modules (SMMs) and a weight-shared classifier. SMMs are used to extract high-dimensional features. Meanwhile, joint linkages among multi-modalities are provided by quantifying the similarity of features. Finally, with the cooperation of heterogeneous characteristics, associations within various sleep stages can be established by the classifier. The evaluation of the model is validated on two public datasets, namely, Montreal Archive of Sleep Studies (MASS) and SleepEDFX, and one clinical dataset from Huashan Hospital of Fudan University (HSFU). Experimental results show that the model can handle heterogeneous signals, provide superior results under multimodal signals and show good performance with single modality. PSEENet obtains accuracy of 79.1%, 82.1% with EEG, EEG and EOG on Sleep-EDFX, and significantly improves the accuracy with EOG from 73.7% to 76% by introducing similarity information.