Many power wheelchair control interfaces are not sufficient for individuals with severely limited upper limb mobility. The majority of controllers that do not rely on coordinated arm and hand movements provide users a limited vocabulary of commands and often do not take advantage of the user's residual motion. We developed a body-machine interface (BMI) that leverages the flexibility and customizability of redundant control by using high dimensional changes in shoulder kinematics to generate proportional control commands for a power wheelchair. In this study, three individuals with cervical spinal cord injuries were able to control a power wheelchair safely and accurately using only small shoulder movements. With the BMI, participants were able to achieve their desired trajectories and, after five sessions driving, were able to achieve smoothness that was similar to the smoothness with their current joystick. All participants were twice as slow using the BMI however improved with practice. Importantly, users were able to generalize training controlling a computer to driving a power wheelchair, and employed similar strategies when controlling both devices. Overall, this work suggests that the BMI can be an effective wheelchair control interface for individuals with high-level spinal cord injuries who have limited arm and hand control.

Objective.Several training programs have been developed in the past to restore motor functions after stroke. Their efficacy strongly relies on the possibility to assess individual levels of impairment and recovery rate. However, commonly used clinical scales rely mainly on subjective functional assessments and are not able to provide a complete description of patients’ neuro-biomechanical status. Therefore, current clinical tests should be integrated with specific physiological measurements, i.e. kinematic, muscular, and brain activities, to obtain a deep understanding of patients’ condition and of its evolution through time and rehabilitative intervention.Approach.We proposed a multivariate approach for motor control assessment that simultaneously measures kinematic, muscle and brain activity and combines the main physiological variables extracted from these signals using principal component analysis (PCA). We tested it in a group of six sub-acute stroke subjects evaluated extensively before and after a four-week training, using an upper-limb exoskeleton while performing a reaching task, along with brain and muscle measurements.Main results.After training, all subjects exhibited clinical improvements correlating with changes in kinematics, muscle synergies, and spinal maps. Movements were smoother and faster, while muscle synergies increased in numbers and became more similar to those of the healthy controls. These findings were coupled with changes in cortical oscillations depicted by EEG-topographies. When combining these physiological variables using PCA, we found that (i) patients’ kinematic and spinal maps parameters improved continuously during the four assessments; (ii) muscle coordination augmented mainly during treatment, and (iii) brain oscillations recovered mostly pre-treatment as a consequence of short-term subacute changes.Significance.Although these are preliminary results, the proposed approach has the potential of identifying significant biomarkers for patient stratification as well as for the design of more effective rehabilitation protocols.

A medical student learning to perform a laparoscopic procedure or a recently paralyzed user of a powered wheelchair must learn to operate machinery via interfaces that translate their actions into commands for an external device. Since the user’s actions are selected from a number of alternatives that would result in the same effect in the control space of the external device, learning to use such interfaces involves dealing with redundancy. Subjects need to learn an externally chosen many-to-one map that transforms their actions into device commands. Mathematically, we describe this type of learning as a deterministic dynamical process, whose state is the evolving forward and inverse internal models of the interface. The forward model predicts the outcomes of actions, while the inverse model generates actions designed to attain desired outcomes. Both the mathematical analysis of the proposed model of learning dynamics and the learning performance observed in a group of subjects demonstrate a first-order exponential convergence of the learning process toward a particular state that depends only on the initial state of the inverse and forward models and on the sequence of targets supplied to the users. Noise is not only present but necessary for the convergence of learning through the minimization of the difference between actual and predicted outcomes. Several studies have suggested that as we learn a new skill our brain forms representations, or “internal models”, of both the skill and the environment in which we operate. Theories of motor learning postulate that the brain builds forward models that predict the sensory consequences of motor commands, and inverse models that generate successful commands from movement goals. We test this hypothesis by taking advantage of an interface that relates the user’s actions to the position of a cursor on a computer monitor, thus allowing users to control an external device through body movements. We recorded the motions of the body and of the cursor, and used this data to estimate forward and inverse models. We followed the time evolution of these estimated models as interface users practiced and acquired a new skill. We found that the description of learning as a simple deterministic process driven by the presented sequence of targets is sufficient to capture the observed convergence to a single solution of the inverse model among an infinite variety of possibilities. This work is relevant to the study of fundamental learning mechanisms as well as to the design of intelligent interfaces for people with paralysis.

Spinal cord injury (SCI) survivors generally retain residual motor and sensory functions, which provide them with the means to control assistive devices. A body-machine interface (BoMI) establishes a mapping from these residual body movements to control commands for an external device. In this study, we designed a BoMI to smooth the way for operating computers, powered wheelchairs and other assistive technologies after cervical spinal cord injuries. The interface design included a comprehensive training paradigm with a range of diverse functional activities to enhance motor learning and retention. Two groups of SCI survivors and healthy control subjects participated in the study. The results indicate the effectiveness of the developed system as an alternative pathway for individuals with motor disabilities to control assistive devices while engaging in functional motor activity.

This study tested the use of a customized body-machine interface (BoMI) for enhancing functional capabilities in persons with cervical spinal cord injury (cSCI). The interface allows people with cSCI to operate external devices by reorganizing their residual movements. This was a proof-of-concept phase 0 interventional nonrandomized clinical trial. Eight cSCI participants wore a custom-made garment with motion sensors placed on the shoulders. Signals derived from the sensors controlled a computer cursor. A standard algorithm extracted the combinations of sensor signals that best captured each participant’s capacity for controlling a computer cursor. Participants practiced with the BoMI for 24 sessions over 12 weeks performing 3 tasks: reaching, typing, and game playing. Learning and performance were evaluated by the evolution of movement time, errors, smoothness, and performance metrics specific to each task. Through practice, participants were able to reduce the movement time and the distance from the target at the 1-second mark in the reaching task. They also made straighter and smoother movements while reaching to different targets. All participants became faster in the typing task and more skilled in game playing, as the pong hit rate increased significantly with practice. The results provide proof-of-concept for the customized BoMI as a means for people with absent or severely impaired hand movements to control assistive devices that otherwise would be manually operated.

Objective. Body-Machine Interfaces (BoMIs) establish a way to operate a variety of devices, allowing their users to extend the limits of their motor abilities by exploiting the redundancy of muscles and motions that remain available after spinal cord injury or stroke. Here, we considered the integration of two types of signals, motion signals derived from inertial measurement units (IMUs) and muscle activities recorded with electromyography (EMG), both contributing to the operation of the BoMI. Approach. A direct combination of IMU and EMG signals might result in inefficient control due to the differences in their nature. Accordingly, we used a nonlinear-regression-based approach to predict IMU from EMG signals, after which the predicted and actual IMU signals were combined into a hybrid control signal. The goal of this approach was to provide users with the possibility to switch seamlessly between movement and EMG control, using the BoMI as a tool for promoting the engagement of selected muscles. We tested the interface in three control modalities, EMG-only, IMU-only and hybrid, in a cohort of 15 unimpaired participants. Participants practiced reaching movements by guiding a computer cursor over a set of targets. Main results. We found that the proposed hybrid control led to comparable performance to IMU-based control and significantly outperformed the EMG-only control. Results also indicated that hybrid cursor control was predominantly influenced by EMG signals. Significance. We concluded that combining EMG with IMU signals could be an efficient way to target muscle activations while overcoming the limitations of an EMG-only control.