31 January 2025 in IEEE Transactions on Medical Robotics and Bionics
Electroencephalography (EEG) based braincomputer interfaces (BCIs) offer a promising way for individuals with motor impairments to control prosthetic or rehabilitation devices. Accurately decoding movement intention (MI) is crucial for translating subjects’ motor execution plans into action. Common challenges in EEG-based BCIs include performance discrepancies, often requiring frequent recalibration of decoding algorithms. The objective of this study was enhancing BCI decoding performance of upper-limb MI identification by exploiting both machine and subjects learning and maintaining stable decoding algorithms. Significant performance improvements were observed across most subjects from the first to the last session of the experiment. Some subjects also demonstrated stable performance without requiring any model recalibration between sessions. All subjects achieved high efficacy in online decoding of movement intention, as reflected in improvement of the F1 score from 0.5810.26 in the first session, to 0.84±0.13 in the final session. We emphasize the critical importance of allowing users sufficient time to improve their performance in BCIs for upper-limb MI decoding. Unlike existing studies, we specifically evaluate the effect of stable decoding strategies in online and longitudinal BCI sessions, which are key to achieving more reliable and effective BCIs.
12 June 2024 in IEEE Transactions on Neural Systems and Rehabilitation Engineering
Hand neuroprostheses restore voluntary movement in people with paralysis through neuromodulation protocols. There are a variety of strategies to control hand neuroprostheses, which can be based on residual body movements or brain activity. There is no universally superior solution, rather the best approach may vary from patient to patient. Here, we propose a protocol based on an immersive virtual reality (VR) environment that simulates the use of a hand neuroprosthesis to allow patients to experience and familiarize themselves with various control schemes in clinically relevant tasks and choose the preferred one. We used our VR environment to compare two alternative control strategies over 5 days of training in four patients with C6 spinal cord injury: (a) control via the ipsilateral wrist, (b) control via the contralateral shoulder. We did not find a one-fits-all solution but rather a subject-specific preference that could not be predicted based only on a general clinical assessment. The main results were that the VR simulation allowed participants to experience the pros and cons of the proposed strategies and make an educated choice, and that there was a longitudinal improvement. This shows that our VR-based protocol is a useful tool for personalization and training of the control strategy of hand neuroprostheses, which could help to promote user comfort and thus acceptance.
1 August 2026 in Journal of Neural Engineering
Objective. Loss of hand function following spinal cord injury (SCI) severely impacts independence and quality of life. Restoring volitional hand control in individuals with SCI remains a critical challenge, addressed using different approaches, including physiotherapy, occupational therapy, and assistive technologies such as neuroprostheses and robotic systems. This study aimed to develop and evaluate an easy-to-setup and user-friendly electromyography (EMG) system for decoding attempted hand and finger movements in individuals with SCI. Approach. We implemented an EMG decoding system for hand opening/closing (2 classes) and single-finger flexion (3 classes) attempts, using a fast-donning 32-channel dry EMG sleeve integrated with a seamless deep learning-based decoding pipeline. Eight people with different classifications of SCI tested the system over two sessions while receiving real-time feedback through a virtual hand interface. Main results. The system achieved high online accuracy for hand open–close discrimination across all subjects (mean 92.5%), and an accuracy that was consistently above chance for single-finger flexion classification (mean 74.2%), with a greater error observed for more nuanced movements in participants with higher motor impairment. Performance plateaued quickly over time, indicating that user learning did not play a relevant role within the limited number of sessions performed. Significance. These findings demonstrate that our system allows good online decoding of different hand and finger movements in people with SCI. The approach supports pathways toward intuitive, digit-level control of neuroprostheses and robotic devices, with strong potential for clinical translation due to its quick setup and ease of use.
12 November 2026 in bioRxiv
Objective: Neural decoders for dexterous finger movements are limited by the accuracy with which ground truth movement is measured. In non-human primates (NHPs), hand kinematics are typically recorded with instrumentation that constrains movement dimensionality. We evaluated whether a markerless camera system could replace conventional methods for tracking movements in real time. Approach: We developed Freebie, a real-time markerless system for tracking NHP finger movements. Keypoints detected online were used in place of manipulandum bend sensor signals. Two NHPs performed tasks by flexing fingers to move a virtual hand into target zones. The virtual hand was directly controlled using bend sensors or Freebie-derived kinematics, or indirectly controlled through a Kalman filter (KF) decoding kinematics from forearm electromyographic (EMG) activity. We quantified Freebie’s accuracy relative to manual labels, agreement with bend sensor measurements, and latencies. We assessed online performance under Freebie control and compared EMG KFs trained using Freebie-derived labels with those trained using bend-sensor-derived labels. Main Results: We observed a median end-to-end latency of 15.8 ms at a 30 FPS camera acquisition rate, and 16.2 ms at 60 FPS. Freebie labels closely tracked bend sensor positions (median |r|=0.96). Median keypoint errors were 1.7 to 6.5 pixels, below the 20-pixel width of the smallest tracked finger. Direct Freebie control did not differ from bend sensor control on five of six online metrics; path efficiency was higher with Freebie. EMG KFs trained on Freebie-derived labels performed similarly to those trained on bend sensor labels online. When evaluated offline, models trained with Freebie had lower error. Significance: These findings indicate that bend sensors are not required to obtain finger labels for training a decoder: markerless keypoints alone provided effective labels. This is an important first step towards real-time tracking of more complex movements, beyond what could be easily measured with a manipulandum.