Objective. Mobile Brain/Body Imaging (MoBI) frameworks allowed the research community to find evidence of cortical involvement at walking initiation and during locomotion. However, the decoding of gait patterns from brain signals remains an open challenge. The aim of this work is to propose and validate a deep learning model to decode gait phases from Electroenchephalography (EEG). Approach. A Long-Short Term Memory (LSTM) deep neural network has been trained to deal with time-dependent information within brain signals during locomotion. The EEG signals have been preprocessed by means of Artifacts Subspace Reconstruction (ASR) and Reliable Independent Component Analysis (RELICA) to ensure that classification performance was not affected by movement-related artifacts. Main results. The network was evaluated on the dataset of 11 healthy subjects walking on a treadmill. The proposed decoding approach shows a robust reconstruction (AUC > 90%) of gait patterns (i.e. swing and stance states) of both legs together, or of each leg independently. Significance. Our results support for the first time the use of a memory-based deep learning classifier to decode walking activity from non-invasive brain recordings. We suggest that this classifier, exploited in real time, can be a more effective input for devices restoring locomotion in impaired people.

In shared control teleoperation, the robot assists the user in accomplishing the desired task. Rather than simply executing the user’s command, the robot attempts to integrate it with information from the environment, such as obstacle and/or goal locations, and it modifies its behavior accordingly. In this article, we propose a real-time shared control teleoperation framework based on an artificial potential field approach improved by the dynamic generation of escape points around the obstacles. These escape points are virtual attractive points in the potential field that the robot can follow to overcome the obstacles more easily. The selection of which escape point to follow is done in real time by solving a soft-constrained problem optimizing the reaching of the most probable goal, estimated from the user’s action. Our proposal has been extensively compared with two state-of-the-art approaches in a static cluttered environment and a dynamic setup with randomly moving objects. Experimental results showed the efficacy of our method in terms of quantitative and qualitative metrics. For example, it significantly decreases the time to complete the tasks and the user’s intervention, and it helps reduce the failure rate. Moreover, we received positive feedback from the users that tested our proposal. Finally, the proposed framework is compatible with both mobile and manipulator robots.

Despite the advances in the field of brain computer interfaces (BCI), the use of the sole electroencephalography (EEG) signal to control walking rehabilitation devices is currently not viable in clinical settings, due to its unreliability. Hybrid interfaces (hHMIs) represent a very recent solution to enhance the performance of single-signal approaches. These are classification approaches that combine multiple human-machine interfaces, normally including at least one BCI with other biosignals, such as the electromyography (EMG). However, their use for the decoding of gait activity is still limited. In this work, we propose and evaluate a hybrid human-machine interface (hHMI) to decode walking phases of both legs from the Bayesian fusion of EEG and EMG signals. The proposed hHMI significantly outperforms its single-signal counterparts, by providing high and stable performance even when the reliability of the muscular activity is compromised temporarily (e.g., fatigue) or permanently (e.g., weakness). Indeed, the hybrid approach shows a smooth degradation of classification performance after temporary EMG alteration, with more than 75% of accuracy at 30% of EMG amplitude, with respect to the EMG classifier whose performance decreases below 60% of accuracy. Moreover, the fusion of EEG and EMG information helps keeping a stable recognition rate of each gait phase of more than 80% independently on the permanent level of EMG degradation. From our study and findings from the literature, we suggest that the use of hybrid interfaces may be the key to enhance the usability of technologies restoring or assisting the locomotion on a wider population of patients in clinical applications and outside the laboratory environment.

Background: Arm weight compensation with rehabilitation robots for stroke patients has been successfully used to increase the active range of motion and reduce the effects of pathological muscle synergies. However, the differences in structure, performance, and control algorithms among the existing robotic platforms make it hard to effectively assess and compare human arm weight relief. In this paper, we introduce criteria for ideal arm weight compensation, and furthermore, we propose and analyze three distinct arm weight compensation methods (Average, Full, Equilibrium) in the arm rehabilitation exoskeleton ’ARMin’. The effect of the best performing method was validated in chronic stroke subjects to increase the active range of motion in three dimensional space. Methods: All three methods are based on arm models that are generalizable for use in different robotic devices and allow individualized adaptation to the subject by model parameters. The first method Average uses anthropometric tables to determine subject-specific parameters. The parameters for the second method Full are estimated based on force sensor data in predefined resting poses. The third method Equilibrium estimates parameters by optimizing an equilibrium of force/torque equations in a predefined resting pose. The parameters for all three methods were first determined and optimized for temporal and spatial estimation sensitivity. Then, the three methods were compared in a randomized single-center study with respect to the remaining electromyography (EMG) activity of 31 healthy participants who performed five arm poses covering the full range of motion with the exoskeleton robot. The best method was chosen for feasibility tests with three stroke patients. In detail, the influence of arm weight compensation on the three dimensional workspace was assessed by measuring of the horizontal workspace at three different height levels in stroke patients. Results: All three arm weight compensation methods reduced the mean EMG activity of healthy subjects to at least 49% compared with the no compensation reference. The Equilibrium method outperformed the Average and the Full methods with a highly significant reduction in mean EMG activity by 19% and 28% respectively. However, upon direct comparison, each method has its own individual advantages such as in set-up time, cost, or required technology. The horizontal workspace assessment in poststroke patients with the Equilibrium method revealed potential workspace size-dependence of arm height, while weight compensation helped maximize the workspace as much as possible. Conclusion: Different arm weight compensation methods were developed according to initially defined criteria. The methods were then analyzed with respect to their sensitivity and required technology. In general, weight compensation performance improved with the level of technology, but increased cost and calibration efforts. This study reports a systematic way to analyze the efficacy of different weight compensation methods using EMG. Additionally, the feasibility of the best method, Equilibrium, was shown by testing with three stroke patients. In this test, a height dependence of the workspace size also seemed to be present, which further highlights the importance of patient-specific weight compensation, particularly for training at different arm heights. Trial registration: ClinicalTrials.gov,NCT02720341. Registered 25 March 2016

Neurorehabilitation with robotic devices requires a paradigm shift to enhance human-robot interaction. The coupling of robot assisted gait training (RAGT) with a brain-machine interface (BMI) represents an important step in this direction but requires better elucidation of the effect of RAGT on the user’s neural modulation. Here, we investigated how different exoskeleton walking modes modify brain and muscular activity during exoskeleton assisted gait. We recorded electroencephalographic (EEG) and electromyographic (EMG) activity from ten able-bodied volunteers walking with an exoskeleton with three modes of user assistance (i.e., transparent, adaptive and full assistance) and during free overground gait. Results identified that exoskeleton walking (irrespective of the exoskeleton mode) induces a stronger modulation of central mid-line mu (8–13 Hz) and low-beta (14–20 Hz) rhythms compared to free overground walking. These modifications are accompanied by a significant re-organization of the EMG patterns in exoskeleton walking. On the other hand, we observed no significant differences in neural activity during exoskeleton walking with the different assistance levels. We subsequently implemented four gait classifiers based on deep neural networks trained on the EEG data during the different walking conditions. Our hypothesis was that exoskeleton modes could impact the creation of a BMI-driven RAGT. We demonstrated that all classifiers achieved an average accuracy of 84.13 ± 3.49% in classifying swing and stance phases on their respective datasets. In addition, we demonstrated that the classifier trained on the transparent mode exoskeleton data can classify gait phases during adaptive and full modes with an accuracy of 78.3 ± 4.8%, while the classifier trained on free overground walking data fails to classify the gait during exoskeleton walking (accuracy of 59.4 ± 11.8%). These findings provide important insights into the effect of robotic training on neural activity and contribute to the advancement of BMI technology for improving robotic gait rehabilitation therapy.

Highly impaired stroke patients at early stages of recovery are unable to generate enough muscle force to lift the weight of their own arm. Accordingly, task-related training is strongly limited or even impossible. However, as soon as partial or full arm weight support is provided, patients are enabled to perform arm rehabilitation training again throughout an increased workspace. In the literature, the current solutions for providing arm weight support are mostly mechanical. These systems have components that restrict the freedom of movement or entail additional disturbances. A scalable weight compensation for upper and lower arm that is online adjustable as well as generalizable to any robotic system is necessary. In this paper, a model-based feedforward weight compensation of upper and lower arm fulfilling these requirements is introduced. The proposed method is tested with the upper extremity rehabilitation robot ARMin V, but can be applied in any other actuated exoskeleton system. Experimental results were verified using EMG measurements. These results revealed that the proposed weight compensation reduces the effort of the subjects to 26% on average and more importantly throughout the entire workspace of the robot.