The clinical rehabilitation assessment methods for hemiplegic upper limb motor function are often subjective, time-consuming, and non-uniform. This study proposes an automatic rehabilitation assessment method for upper limb motor function based on posture and distributed force measurements. Azure Kinect combined with MediaPipe was used to detect upper limb and hand movements, and the array distributed flexible thin film pressure sensor was employed to measure the distributed force of hand. This allowed for the automated measurement of 30 items within the Fugl-Meyer scale. Feature information was extracted separately from the affected and healthy sides, the feature ratios or deviation were then fed into a single/multiple fuzzy logic assessment model to determine the assessment score of each item. Finally, the total score of the hemiplegic upper limb motor function assessment was derived. Experiments were performed to evaluate the motor function of the subjects’ upper extremities. Bland-Altman plots of physician and system scores showed good agreement. The results of the automated assessment system were highly correlated with the clinical Fugl-Meyer total score (r = 0.99, p < 0.001). The experimental results state that this system can automatically assess the motor function of the affected upper limb by measuring the posture and force distribution.
After regular rehabilitation training, paralysis sequelae can be significantly reduced in patients with limb movement disorders caused by stroke. Rehabilitation assessment is the basis for the formulation of rehabilitation training programs and the objective standard for evaluating the effectiveness of training. However, the quantitative rehabilitation assessment is still in the experimental stage and has not been put into clinical practice. In this work, we propose improved spatial-temporal graph convolutional networks based on precise posture measurement for upper limb rehabilitation assessment. Two Azure Kinect are used to enlarge the angle range of the visual field. The rigid body model of the upper limb with multiple degrees of freedom is established. And the inverse kinematics is optimized based on the hybrid particle swarm optimization algorithm. The self-attention mechanism map is calculated to analyze the role of each upper limb joint in rehabilitation assessment, to improve the spatial-temporal graph convolution neural network model. Long short-term memory is built to explore the sequence dependence in spatial-temporal feature vectors. An exercise protocol for detecting the distal reachable workspace and proximal self-care ability of the upper limb is designed, and a virtual environment is built. The experimental results indicate that the proposed posture measurement method can reduce position jumps caused by occlusion, improve measurement accuracy and stability, and increase Signal Noise Ratio. By comparing with other models, our rehabilitation assessment model achieved the lowest mean absolute deviation, root mean square error, and mean absolute percentage error. The proposed method can effectively quantitatively evaluate the upper limb motor function of stroke patients.
Current upper-limb rehabilitation robots primarily focus on training tasks involving free movements or static interactions with rigid objects. These paradigms lack simulation of complex object manipulation tasks encountered in daily life, thereby limiting the training of patients’ high-level sensorimotor integration capabilities. To address this gap, this study proposes an innovative robotic rehabilitation training system designed for functional occupational therapy. Specifically, the task of transporting a water cup was abstracted into a cup–ball system integrated with a robotic arm. The ball was modeled as a point mass, and kinematic and dynamic analyses of the system were conducted. A visual tracking method was employed to monitor the ball’s motion and calculate its slosh angle. Owing to the impaired fine motor control in stroke patients, a sloshing suppression control strategy integrating exponential filtering, feedforward force compensation, and impedance control was proposed to prevent the ball from spilling. Experiments validated the effectiveness of the proposed method. The results indicated that with full compensation, the oscillation rate of the ball was significantly reduced, and the smoothness of the hand force was markedly improved. This study presents an effective method for addressing dynamic uncertainty in rehabilitation robot training, thus significantly improving the functional relevance of the training.