The deep learning gesture recognition based on surface electromyography plays an increasingly important role in human-computer interaction. In order to ensure the high accuracy of deep learning in multistate muscle action recognition and ensure that the training model can be applied in the embedded chip with small storage space, this paper presents a feature model construction and optimization method based on multichannel sEMG amplification unit. The feature model is established by using multidimensional sequential sEMG images by combining convolutional neural network and long-term memory network to solve the problem of multistate sEMG signal recognition. The experimental results show that under the same network structure, the sEMG signal with fast Fourier transform and root mean square as feature data processing has a good recognition rate, and the recognition accuracy of complex gestures is 91.40%, with the size of 1 MB. The model can still control the artificial hand accurately when the model is small and the precision is high.

This article proposes coupled tendon-driven joint modules for anthropomorphic robots. Fully actuated 2-degree-of-freedom (DoF) and 3-DoF joint modules are classified and analyzed based on the motor-joint routing matrix that describes the tendon routing structure between the motors and the joints. Two-motor 2-DoF (2M2D) modules, which share the same form of motor-joint routing matrix, are classified into four types: externally actuated, internally coaxially actuated, internally separately actuated, and hybrid-actuated according to the location of the motors. Three-motor 3-DoF (3M3D) modules are classified into four forms based on the four possible forms of motor-joint routing matrix: fully routed motor-joint, 1-unrouted motor-joint, 2-unrouted motor-joint, and 3-unrouted motor-joint. The 2M2D and 3M3D coupled tendon-driven joint modules are analyzed and compared with respect to the relationship between the motor torque and the joint torque. A 7-DoF anthropomorphic robot arm was implemented with one 3M3D module for the shoulder joint and two 2M2D modules for the elbow and wrist joints, respectively, to demonstrate the utility of the proposed joint modules. The arm weighed 2.2 kg and was able to lift a 1.5-kg load with full outreach. The characteristics of the joint modules were evaluated in a current consumption experiment and a position accuracy experiment, and the performance of the robot arm was evaluated in a master–slave manipulation experiment involving dexterous movements.

Background. Spatial characteristics of sEMG signals are obtained by high-density matrix sEMG electrodes for further complex upper arm movement classification. Multiple electrode channels of the high-density sEMG acquisition device aggravate the burden of the microprocessor and deteriorate control system’s real-time performance at the same time. A shoulder motion recognition optimization method based on the maximizing mutual information from multiclass CSP selected spatial feature channels and wavelet packet features extraction is proposed in this study. Results. The relationship between the number of channels and recognition rate is obtained by the recognition optimization method. The original 64 electrodes channels are reduced to only 4-5 active signal channels with the accuracy over 92%. Conclusion. The shoulder motion recognition optimization method is combined with the spatial-domain and time-frequency-domain features. In addition, the spatial feature channel selection is independent of feature extraction and classification algorithm. Therefore, it is more convenient to use less channels to achieve the desired classification accuracy.

Background: Surface electromyography-based gesture recognition and prosthetic hand control using deep learning have become increasingly significant in the field of human-computer interaction. Objective: This study aims to enhance the control of prosthetic hands driven by complex gestures, addressing the challenge of low-resolution gesture differentiation caused by the coupling and superposition of surface electromyography signals in deep learning models. Method: We propose a deep learning-based framework for the recognition of complex surface electromyography signals, utilizing a multi-pathway approach to acquire raw surface electromyography signals, process them in the time-frequency domain, and extract features using multi-scale convolutional networks. The processed surface electromyography features are then analyzed in parallel to enhance accuracy. Results: This method effectively processes multiple signals concurrently and extracts diverse feature sets. By collecting data from six channels, it achieves an 88.56% recognition rate for 16 complex hand gestures, enabling control of 10 distinct prosthetic hand movements. Conclusion: By leveraging multi-dimensional continuous surface electromyography images, we have developed a feature model that resolves the issues of signal coupling and superposition in multi-channel surface electromyography data, allowing for precise control of prosthetic hand movements.

The multi-robot system (MRS) and relevant control strategy are a potential and effective approach to assist people with weak motion capability for various forms of assisted living. However, the rising transfer, a frequent and strenuous behavior, and its human-robot interaction (HRI) process with MRS, especially mental state, has never been researched, although it directly determines the user experience and security. In this paper, Functional Near-InfraRed Spectroscopy (fNIRS), a brain imaging technique to perform a continuous measure of the mental state, is introduced to monitor the user’s mental fatigue when implementing a behavior transfer in two difficulty levels assisted by multiple welfare-robots. Twenty-five subjects performed self-rising transfer and multiple welfare robots-assisted rising transfer. After removing physiological noises, six features of oxygenated and deoxygenated hemoglobin (HbO and HbR, respectively) features, which included the mean, slope, variance, peak, skewness, and kurtosis, were calculated. To maximize the distinction of fNIRS between self-rising transfer and assisted-rising transfer (multiple welfare robots assisted rising transfer), the optimal statistical feature combination for linear discriminant analysis (LDA) classification was proposed. In addition, the classification accuracy is regarded as a standard to quantify the difference of mental states between two contrasting behaviors. By fitting the index, we established the mental fatigue model that grows exponentially as the workload increases. Finally, the mental fatigue model is applied to guide the nursing mode of caregivers and the control strategy of the MRS. Our findings disclose that the combinations containing mean and peak values significantly yielded higher classification accuracies for both HbO and HbR than the entire other combinations did, across all the subjects. They effectively quantify mental fatigue to provide an evaluation with a theoretical foundation for enhancing the user experience and optimizing the control strategy of MRS.

As a kind of lower-limb motor assistance device, the intelligent walking aid robot plays an essential role in helping people with lower-limb diseases to carry out rehabilitation walking training. In order to enhance the safety performance of the lower-limb walking aid robot, this study proposes a deep vision-based abnormal lower-limb gait prediction model construction method for the problem of abnormal gait prediction of patients’ lower limbs. The point cloud depth vision technique is used to acquire lower-limb motion data, and a multi-posture angular prediction model is trained using long and short-term memory networks to build a model of the user’s lower-limb posture characteristics during normal walking as well as a real-time lower-limb motion prediction model. The experimental results indicate that the proposed lower-limb abnormal behavior prediction model is able to achieve a 97.4% prediction rate of abnormal lower-limb movements within 150 ms. Additionally, the model demonstrates strong generalization ability in practical applications. This paper proposes further ideas to enhance the safety performance of lower-limb rehabilitation robot use for patients with lower-limb disabilities.