Four human subjects undergoing subdural electrocorticography for epilepsy surgery engaged in a range of finger and hand movements. We observed that the amplitudes of the low-pass filtered electrocorticogram (ECoG), also known as the local motor potential (LMP), over specific peri-Rolandic electrodes were correlated (p < 0.001) with the position of individual fingers as the subjects engaged in slow and deliberate grasping motions. A generalized linear model (GLM) of the LMP amplitudes from those electrodes yielded predictions for positions of the fingers that had a strong congruence with the actual finger positions (correlation coefficient, r; median = 0.51, maximum = 0.91), during displacements of up to 10 cm at the fingertips. For all the subjects, decoding filters trained on data from any given session were remarkably robust in their prediction performance across multiple sessions and days, and were invariant with respect to changes in wrist angle, elbow flexion and hand placement across these sessions (median r = 0.52, maximum r = 0.86). Furthermore, a reasonable prediction accuracy for grasp aperture was achievable with as few as three electrodes in all subjects (median r = 0.49; maximum r = 0.90). These results provide further evidence for the feasibility of robust and practical ECoG-based control of finger movements in upper extremity prosthetics.
In this paper, an ECoG-based system for controlling the MPL where patients were implanted with ECoG electrode grids for clinical seizure mapping and asked to perform various recorded finger or grasp movements.
8 November 2011 in IEEE Transactions on Neural Systems and Rehabilitation Engineering
The use of neural signals for prosthesis control is an emerging frontier of research to restore lost function to amputees and the paralyzed. Electrocorticography (ECoG) brain-machine interfaces (BMI) are an alternative to EEG and neural spiking and local field potential BMI approaches. Conventional ECoG BMIs rely on spectral analysis at specific electrode sites to extract signals for controlling prostheses. We compare traditional features with information about the connectivity of an ECoG electrode network. We use time-varying dynamic Bayesian networks (TV-DBN) to determine connectivity between ECoG channels in humans during a motor task. We show that, on average, TV-DBN connectivity decreases from baseline preceding movement and then becomes negative, indicating an alteration in the phase relationship between electrode pairs. In some subjects, this change occurs preceding and during movement, before changes in low or high frequency power. We tested TV-DBN output in a hand kinematic decoder and obtained an average correlation coefficient (r2) between actual and predicted joint angle of 0.40, and as high as 0.66 in one subject. This result compares favorably with spectral feature decoders, for which the average correlation coefficient was 0.13. This work introduces a new feature set based on connectivity and demonstrates its potential to improve ECoG BMI accuracy.
2 April 2019 in IEEE Transactions on Neural Systems and Rehabilitation Engineering
Although recent advances in neuroprostheses offer opportunities for improved and intuitive control of advanced motorized and sensorized robotic arms, practical complications associated with such hardware can impede the research necessary for clinical translation. These hurdles potentially can be reduced with virtual reality environments (VREs) with embedded physics engines using virtual models of physical robotic hands. These software suites offer several advantages over physical prototypes, including high repeatability, reduced human error, elimination of many secondary sensory cues, and others. There are limited demonstrations of closed-loop prostheses in a VRE, and it is unclear whether VRE performance translates to the physical world. Here we describe how two transradial amputees with neural and intramuscular implants identified objects and performed activities of daily living with closed-loop control of prostheses in a VRE. Our initial evidence further suggests that capabilities with virtual prostheses may be predictors of physical prosthesis performance, demonstrating the utility of VREs for neuroprosthetic research.
In patients with unilateral upper limb paralysis from strokes and other brain lesions, strategies for functional recovery may eventually include brain-machine interfaces (BMIs) using control signals from residual sensorimotor systems in the damaged hemisphere. When voluntary movements of the contralateral limb are not possible due to brain pathology, initial training of such a BMI may require use of the unaffected ipsilateral limb. We conducted an offline investigation of the feasibility of decoding ipsilateral upper limb movements from electrocorticographic (ECoG) recordings in three patients with different lesions of sensorimotor systems associated with upper limb control. We found that the first principal component (PC) of unconstrained, naturalistic reaching movements of the upper limb could be decoded from ipsilateral ECoG using a linear model. ECoG signal features yielding the best decoding accuracy were different across subjects. Performance saturated with very few input features. Decoding performances of 0.77, 0.73, and 0.66 (median Pearson's r between the predicted and actual first PC of movement using nine signal features) were achieved in the three subjects. The performance achieved here with small numbers of electrodes and computationally simple decoding algorithms suggests that it may be possible to control a BMI using ECoG recorded from damaged sensorimotor brain systems.
1 August 2016 in 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)
The needs of individuals with upper limb amputation and congenital limb difference are not being fully met by current prostheses, as evidenced by prosthesis rejection, non-wear, and user reports of pain and challenging activities. Emerging technologies such as dexterous sensorized robotic limbs, osseointegrated prostheses, implantable EMG electrodes, and electrical stimulation for sensory feedback have the potential to address unmet needs, but pose additional risks. We plan to assess upper limb prosthesis user needs and perspectives on these new benefits and risks using an extensive quantitative survey. In preparation for this survey, we report here on qualitative interviews with seven individuals with upper limb amputation or congenital limb difference. Unstructured text was mined using topic modeling and the results compared with identified themes. A more complete understanding of how novel technologies could address real user concerns will inform implementation of new technologies and regulatory decision-making.