This study aimed to develop an intuitive gait-related motor imagery (MI)-based hybrid brain-computer interface (BCI) controller for a lower-limb exoskeleton and investigate the feasibility of the controller under a practical scenario including stand-up, gait-forward, and sit-down. A filter bank common spatial pattern (FBCSP) and mutual information-based best individual feature (MIBIF) selection were used in the study to decode MI electroencephalogram (EEG) signals and extract a feature matrix as an input to the support vector machine (SVM) classifier. A successive eye-blink switch was sequentially combined with the EEG decoder in operating the lower-limb exoskeleton. Ten subjects demonstrated more than 80% accuracy in both offline (training) and online. All subjects successfully completed a gait task by wearing the lower-limb exoskeleton through the developed real-time BCI controller. The BCI controller achieved a time ratio of 1.45 compared with a manual smartwatch controller. The developed system can potentially be benefit people with neurological disorders who may have difficulties operating manual control.

Stroke is a leading cause of disability among elderly individuals, and gait impairment is a typical characteristic related to the stroke severity experienced by patients. The aim of this study is to propose a novel stroke severity classification method using symmetric gait features with recursive feature elimination with cross-validation (RFECV). An experiment was conducted on data acquired from thirteen chronic stroke patients and eighteen elderly participants. They walked on a treadmill at four different speeds based on their preferred speed. In this study, symmetric gait features representing the ratio between the left- and right-side values were used as inputs along with the general gait features that did not completely contain the patients’ gait characteristics. We used four different machine learning (ML) techniques to determine the optimal subset for differentiating between the elderly and stroke groups according to severity based on RFECV. To verify the performance of RFECV and the symmetric gait features, four different feature sets were used: 1) all forty-five general features, 2) all twenty-one symmetric features, 3) the optimal general feature subset obtained by using RFECV, and 4) the optimal symmetric feature subset obtained by using RFECV. It was confirmed that the classification performance increased when symmetric gait data and the RFECV technique were applied. The best classification result was obtained by RF-RFECV with an RF classifier derived from the symmetric features (accuracy: 96.01%). The findings of this study can help clinicians diagnose the stroke severity experienced by patients based on information obtained using ML technology.

In recent years, myoelectric interfaces using surface electromyogram (EMG) signals have been developed for assisting people with physical disabilities. Especially, in the myoelectric interfaces for robotic hands or arms, decoding the user’s upper-limb movement intentions is cardinal to properly control the prosthesis. However, because previous experiments were implemented with only healthy subjects, the possibility of classifying reaching-to-grasping based on the EMG signals from the residual limb without the below-elbow muscles was not investigated yet. Therefore, we aimed to investigate the possibility of classifying reaching-to-grasping tasks using the EMG from the upper arm and upper body without considering wrist muscles for prosthetic users. In our study, seven healthy subjects, one trans-radial amputee, and one wrist amputee were participated and performed 10 repeatable 12 reaching-to-grasping tasks based on the Southampton Hand Assessment Procedure (SHAP) with 12 different weighted (light and heavy) objects. The acquired EMG was processed using the principal component analysis (PCA) and convolutional neural network (CNN) to decode the tasks. The PCA–CNN method showed that the average accuracies of the healthy subjects were 69.4 ± 11.4%, using only the EMG signals by the upper arm and upper body. The result with the PCA–CNN method showed 8% significantly higher accuracies than the result with the widely used time domain and auto-regressive-support vector machine (TDAR–SVM) method as 61.6 ± 13.7%. However, in the cases of the amputees, the PCA–CNN showed slightly lower performance. In addition, in the aspects of assistant daily living, because grip force is also important when grasping an object after reaching, the possibility of classifying the two light and heavy objects in each reaching-to-grasping task was also investigated. Consequently, the PCA–CNN method showed higher accuracy at 70.1 ± 9.8%. Based on our results, the PCA–CNN method can help to improve the performance of classifying reaching-to-grasping tasks without wrist EMG signals. Our findings and decoding method can be implemented to further develop a practical human–machine interface using EMG signals.

Motor imagery (MI) brain–computer interfaces (BCIs) have been used for a wide variety of applications due to their intuitive matching between the user’s intentions and the performance of tasks. Applying dry electroencephalography (EEG) electrodes to MI BCI applications can resolve many constraints and achieve practicality. In this study, we propose a multi-domain convolutional neural networks (MD-CNN) model that learns subject-specific and electrode-dependent EEG features using a multi-domain structure to improve the classification accuracy of dry electrode MI BCIs. The proposed MD-CNN model is composed of learning layers for three domain representations (time, spatial, and phase). We first evaluated the proposed MD-CNN model using a public dataset to confirm 78.96% classification accuracy for multi-class classification (chance level accuracy: 30%). After that, 10 healthy subjects participated and performed three classes of MI tasks related to lower-limb movement (gait, sitting down, and resting) over two sessions (dry and wet electrodes). Consequently, the proposed MD-CNN model achieved the highest classification accuracy (dry: 58.44%; wet: 58.66%; chance level accuracy: 43.33%) with a three-class classifier and the lowest difference in accuracy between the two electrode types (0.22%, d = 0.0292) compared with the conventional classifiers (FBCSP, EEGNet, ShallowConvNet, and DeepConvNet) that used only a single domain. We expect that the proposed MD-CNN model could be applied for developing robust MI BCI systems with dry electrodes.

We investigated differences in knee kinetic variables (external knee adduction, flexion, internal rotation moments, and impulses) between patients with knee osteoarthritis (KOA) and healthy controls during stepping on a custom elliptical trainer; and searched knee kinetic variable candidates for real-time biofeedback and for complementing diagnosis/evaluation on the elliptical trainer based on the knee kinetic variables' associations with the knee injury and osteoarthritis outcome score (KOOS). Furthermore, we explored potential gait re-training strategies on the elliptical trainer by investigating the knee kinetic variables' associations with 3-D ankle angles. The knee kinetic variables and ankle angles were determined in real-time in a patient group of 10 patients with KOA and an age-and sex-matched control group of 10 healthy subjects. The mean peak external knee adduction moment of the patient group was 47% higher than that of the control group. The KOOS-Sports and Recreational Activities and KOOS-Pain scores were found to be significantly associated with the knee kinetic variables. All the ankle angles were associated with the knee kinetic variables. The findings support the use of the knee kinetic variables on the elliptical trainer to complement KOA diagnosis quantitatively and provide potential real-time KOA gait re-training strategies/guides.