18 March 2024 in IEEE Journal of Biomedical and Health Informatics
The classification analysis of incomplete and imbalanced data is still a challenging task since these issues could negatively impact the training of classifiers, which were also found in our study on the physical fitness assessments of patients. And in fields such as healthcare, there are higher requirements for the accuracy of the generated imputation values. To train a high-performance classifier and pursue high accuracy, we attempted to resolve any potential negative impact by using a novel algorithmic approach based on the combination of multivariate imputation by chained equations and the ensemble learning method (MICEEN), which can solve the two problems simultaneously. We used multivariate imputation by chained equations to generate more accurate imputation values for the training set passed to ensemble learning to build a predictor. On the other hand, missing values were introduced into minority classes and used them to generate new samples belonging to the minority classes in order to balance the distribution of classes. On real-world datasets, we perform extensive experiments to assess our method and compare it to other state-of-the-art approaches. The advantages of the proposed method are demonstrated by experimental results for the benchmark datasets and self-collected datasets of physical fitness assessment of tumor patients with varying missing rates.
19 April 2022 in IEEE Journal of Biomedical and Health Informatics
The development of activity recognition based on multi-modal data makes it possible to reduce human intervention in the process of monitoring. This paper proposes an efficient and cost-effective multi-modal sensing framework for activity monitoring, it can automatically identify human activities based on multi-modal data, and provide help to patients with moderate disabilities. The multi-modal sensing framework for activity monitoring relies on parallel processing of videos and inertial data. A new supervised adaptive multi-modal fusion method (AMFM) is used to process multi-modal human activity data. Spatio-temporal graph convolution network with adaptive loss function (ALSTGCN) is proposed to extract skeleton sequence features, and long short-term memory fully convolutional network (LSTM-FCN) module with adaptive loss function is adapted to extract inertial data features. An adaptive learning method is proposed at the decision level to learn the contribution of the two modalities to the classification results. The effectiveness of the algorithm is demonstrated on two public multi-modal datasets (UTD-MHAD and C-MHAD) and a new multi-modal dataset H-MHAD collected from our laboratory. The results show that the performance of the AMFM approach on three datasets is better than the performance of the video or the inertial-based single-modality model. The class-balanced cross-entropy loss function further improves the model performance based on the H-MHAD dataset. The accuracy of action recognition is 91.18%, and the recall rate of falling activity is 100%. The results illustrate that using multiple heterogeneous sensors to realize automatic process monitoring is a feasible alternative to the manual response.
28 September 2022 in IEEE Sensors Journal
This study proposed a wearable inertial motion capture method for Parkinson’s lower limb motion reconstruction and analysis. To eliminate the error accumulation caused by sensor noise, the error state Kalman filter is used for attitude estimation. The inertial motion capture method proposed in this study is compared with OptiTrack system to verify the motion tracking effect. The accuracy of different phase detection methods is compared, and the highest recognition accuracy is 99.11% using long short-term memory method. In addition, this study collected subjects in healthy control, Parkinson’s disease and freezing of gait groups for comparative analysis. The experimental results revealed differences in motion characteristics and kinematics between Parkinson’s disease and healthy subjects. Thus, the quantitative analysis results can be used as an important reference for the clinical application of Parkinson’s disease.
13 April 2023 in IEEE Transactions on Cognitive and Developmental Systems
Tremor is one of the earliest signs of Parkinson’s disease (PD), which seriously disrupts patients’ daily lives. It is important to study upper limb tremors quantitatively to control PD progression. In this study, surface electromyography (sEMG) signals from wearable devices are used to recognize rest, posture, and kinetic tremor action from 6 upper-limb clinical actions and to quantify features of tremors. A multivariable time series classification model (MTSCM) based on fully convolutional networks and a long short-term memory network is proposed to recognize tremor actions. MTSCM achieves a high degree of accuracy both on the left-hand and right-hand data sets for tremor actions. An improved Hilbert-Huang transform (HHT) method is proposed to decompose the inertial signals of tremor actions to obtain tremor components. Using the improved HHT, tremor and motion components can be decomposed effectively. In addition, 53 features are extracted from inertial and sEMG signals, and a canonical correlation analysis is used to determine the correlation between features and MDS-UPDRS scores. Several of the relevant characteristics are related to MDS-UPDRS scores, notably the dominant frequency and amplitude of the tremor component are significantly correlated (p < 0.01) with tremor scores. Detecting upper-limb clinical tremors in PD patients using wearable sensors is feasible according to our findings.
1 June 2024 in Information Fusion