Sensory feedback provides critical interactive information for the effective use of hand prostheses. Non-invasive neural interfaces allow convenient access to the sensory system, but they communicate a limited amount of sensory information. This study examined a novel approach that leverages a direct and natural sensory afferent pathway, and enables an evoked tactile sensation (ETS) of multiple digits in the projected finger map (PFM) of participants with forearm amputation non-invasively. A bidirectional prosthetic interface was constructed by integrating the non-invasive ETS-based feedback system into a commercial prosthetic hand. The pressure information of five fingers was encoded linearly by the pulse width modulation range of the buzz sensation. We showed that simultaneous perception of multiple digits allowed participants with forearm amputation to identify object length and compliance by using information about contact patterns and force intensity. The ETS enhanced the grasp-and-transport performance of participants with and without prior experience of prosthetic use. The functional test of transport-and-identification further revealed improved execution in classifying object size and compliance using ETS-based feedback. Results demonstrated that the ETS is capable of communicating somatotopically compatible information to participants efficiently, and improves sensory discrimination and closed-loop prosthetic control. This non-invasive sensory interface may establish a viable way to restore sensory ability for prosthetic users who experience the phenomenon of PFM.
7 August 2024 in IEEE Transactions on Neural Systems and Rehabilitation Engineering
The ability of a novel biorealistic hand prosthesis for grasp force control reveals improved neural compatibility between the human-prosthetic interaction. The primary purpose here was to validate a virtual training platform for amputee subjects and evaluate the respective roles of visual and tactile information in fundamental force control tasks. We developed a digital twin of tendon-driven prosthetic hand in the MuJoCo environment. Biorealistic controllers emulated a pair of antagonistic muscles controlling the index finger of the virtual hand by surface electromyographic (sEMG) signals from amputees’ residual forearm muscles. Grasp force information was transmitted to amputees through evoked tactile sensation (ETS) feedback. Six forearm amputees participated in force tracking and holding tasks under different feedback conditions or using their intact hands. Test results showed that visual feedback played a predominant role than ETS feedback in force tracking and holding tasks. However, in the absence of visual feedback during the force holding task, ETS feedback significantly enhanced motor performance compared to feedforward control alone. Thus, ETS feedback still supplied reliable sensory information to facilitate amputee’s ability of stable grasp force control. The effects of tactile and visual feedback on force control were subject-specific when both types of feedback were provided simultaneously. Amputees were able to integrate visual and tactile information to the biorealistic controllers and achieve a good sensorimotor performance in grasp force regulation. The virtual platform may provide a training paradigm for amputees to adapt the biorealistic hand controller and ETS feedback optimally.
This study develops biomimetic strategies for slip prevention in prosthetic hand grasps. The biomimetic system is driven by a novel slip sensor, followed by slip perception and preventive control. Here, we show that biologically inspired sensorimotor pathways can be restored between the prosthetic hand and users. A Ruffini endings-like slip sensor is used to detect shear forces and identify slip events directly. The slip information and grip force are encoded into a bi-state sensory coding that evokes vibration and buzz tactile sensations in subjects with transcutaneous electrical nerve stimulation (TENS). Subjects perceive slip events under various conditions based on the vibration sensation and voluntarily adjust grip force to prevent further slipping. Additionally, short-latency compensation for grip force is also implemented using a neuromorphic reflex pathway. The reflex loop includes a sensory neuron and interneurons to adjust the activations of antagonistic muscles reciprocally. The slip prevention system is tested in five able-bodied subjects and two transradial amputees with and without reflex compensation. A psychophysical test for perception reveals that the slip can be detected effectively, with a success accuracy of 96.57%. A slip protection test indicates that reflex compensation yields faster grasp adjustments than voluntary action, with a median response time of 0.30 (0.08) s, a rise time of 0.26 (0.03) s, an execution time of 0.56 (0.07) s, and a slip distance of 0.39 (0.10) cm. Prosthetic grip force is highly correlated to that of an intact hand, with a correlation coefficient of 96.85% (2.73%). These results demonstrate that it is feasible to reconstruct slip biomimetic sensorimotor pathways that provide grasp stability for prosthetic users.
6 February 2025 in Neuromorphic Computing and Engineering
Current bionic hands lack the ability of fine force manipulation for grasping fragile objects due to missing human neuromuscular compliance in control. This incompatibility between prosthetic devices and the sensorimotor system has resulted in a high abandonment rate of hand prostheses. To tackle this challenge, we employed a neuromorphic modeling approach, biorealistic control, to regain human-like grasping ability. The biorealistic control restored muscle force regulation and stiffness adaptation using neuromorphic modeling of the neuromuscular reflex units, which was capable of real-time computing of model outputs. We evaluated the dexterity of the biorealistic control with a set of delicate grasp tasks that simulated varying challenging scenarios of grasping fragile objects in daily activities of life, including the box and block task, the glass box task, and the potato chip task. The performance of the biorealistic control was compared with that of proportional control. Results indicated that the biorealistic control with the compliance of the neuromuscular reflex units significantly outperformed the proportional control with more efficient grip forces, higher success rates, fewer break and drop rates. Post-task survey questionnaires revealed that the biorealistic control reduced subjective burdens of task difficulty and improved subjective confidence in control performance significantly. The outcome of the evaluation confirmed that the biorealistic control could achieve superior abilities in fine, accurate, and efficient grasp control for prosthetic users.
13 January 2025 in Neuromorphic Computing and Engineering
Current bionic hands lack the ability of fine force manipulation for grasping fragile objects due to missing human neuromuscular compliance in control. This incompatibility between prosthetic devices and the sensorimotor system has resulted in a high abandonment rate of hand prostheses. To tackle this challenge, we employed a neuromorphic modeling approach, biorealistic control, to regain human-like grasping ability. The biorealistic control restored muscle force regulation and stiffness adaptation using neuromorphic modeling of the neuromuscular reflex units, which was capable of real-time computing of model outputs. We evaluated the dexterity of the biorealistic control with a set of delicate grasp tasks that simulated varying challenging scenarios of grasping fragile objects in daily activities of life, including the Box and Block Task, the Glass Box Task, and the Potato Chip Task. The performance of the biorealistic control was compared with that of proportional control. Results indicated that the biorealistic control with the compliance of the neuromuscular reflex units significantly outperformed the proportional control with more efficient grip forces, higher success rates, fewer break and drop rates. Post-task survey questionnaires revealed that the biorealistic control reduced subjective burdens of task difficulty and improved subjective confidence in control performance significantly. The outcome of the evaluation confirmed that the biorealistic control could achieve superior abilities in fine, accurate, and efficient grasp control for prosthetic users.