In tactile sensing, decoding the journey from afferent tactile signals to efferent motor commands is a significant challenge primarily due to the difficulty in capturing population-level afferent nerve signals during active touch. This study integrates a finite element hand model with a neural dynamic model by using microneurography data to predict neural responses based on contact biomechanics and membrane transduction dynamics. This research focuses specifically on tactile sensation and its direct translation into motor actions. Evaluations of muscle synergy during in -vivo experiments revealed transduction functions linking tactile signals and muscle activation. These functions suggest similar sensorimotor strategies for grasping influenced by object size and weight. The decoded transduction mechanism was validated by restoring human-like sensorimotor performance on a tendon-driven biomimetic hand. This research advances our understanding of translating tactile sensation into motor actions, offering valuable insights into prosthetic design, robotics, and the development of next-generation prosthetics with neuromorphic tactile feedback.
Tactile sensors play a crucial role in the development of biologically inspired robotic prostheses, particularly in providing tactile feedback. However, existing sensing technology still falls short in terms of sensitivity under high pressure and adaptability to uneven working surfaces. Furthermore, the fabrication of tactile sensors often requires complex and expensive manufacturing processes, limiting their widespread application. Here we develop a conformal tactile sensor with improved sensing performance fabricated using an in-house 3D printing system. Our sensor detects shear stimuli through the integration of an auxetic structure and interlocking features. The design enables an extended sensing range (from 0.1 to 0.26 MPa) and provides sensitivity in both normal and shear directions, with values of 0.63 KPa−1and 0.92 N−1, respectively. Additionally, the sensor is capable of detecting temperature variations within the range of 40−90 °C. To showcase the feasibility of our approach, we have printed the tactile sensor directly onto the fingertip of an anthropomorphic robotic hand, the proximal femur head, and lumbar vertebra. The results demonstrate the potential for achieving sensorimotor control and temperature sensing in artificial upper limbs, and allowing the monitoring of bone-on-bone load.
15 September 2023 in Progress in Materials Science
Quantifying the effect of routing and topology of the inter-connected finger extensor mechanism on hand grasping performances is a long-standing research problem for the better clinical diagnosis, surgical planning and biomimetic hand development. However, it is technically demanding to measure the hand performance parameters such as the contact forces and contact area during hand manipulation. It is also difficult to replicate human hand performance through the physical hand model due to its sophisticated musculotendinous structure. In this study, an experimental validated subject-specific finite element (FE) human hand model was used for the first time to quantify the influence of different tendon topologies and material properties on hand grasping quality. It is found that the grasping quality is reduced by 15.94% and 8.54% if there are no extensor hood and lateral band respectively, and the former plays a more important role in transmitting forces and maintaining grasping qualities than the latter. Excluding extensor hood in the topology causes more reductions in hand contact pressure and contact area than omitting lateral band. 7.5% of the grasping quality is lost due to a softened tendon with half of its original Young’s Modulus. Hardened extensor tendon does increase the grasping quality, but the enhancing effect tends to level off once the tendon Young’s Modulus is increased by more than 50%. These results prove that the lateral band and extensor hood are critical components for maintaining grasping quality. The dexterity and grasping quality of robotic and prosthetic hands could be improved by integrating these two components. There is also no need to use very stiff tendon material as it won’t help to effectively enhance the grasping quality.
23 May 2022 in IEEE Transactions on Biomedical Engineering
First order cutaneous neurons allow object recognition, texture discrimination, and sensorimotor feedback. Their function is well-investigated under passive stimulation while their role during active touch or sensorimotor control is understudied. To understand how human perception and sensorimotor controlling strategy depend on cutaneous neural signals under active tactile exploration, the finite element (FE) hand and Izhikevich neural dynamic model were combined to predict the cutaneous neural dynamics and the resulting perception during a discrimination test. Using in-vivo microneurography generated single afferent recordings, 75% of the data was applied for the model optimization and another 25% was used for validation. By using this integrated numerical model, the predicted tactile neural signals of the single afferent fibers agreed well with the microneurography test results, achieving the out-of-sample values of 0.94 and 0.82 for slowly adapting type I (SAI) and fast adapting type I unit (FAI) respectively. Similar discriminating capability with the human subject was achieved based on this computational model. Comparable performance with the published numerical model on predicting the cutaneous neural response under passive stimuli was also presented, ensuring the potential applicability of this multi-level numerical model in studying the human tactile sensing mechanisms during active touch. The predicted population-level 1st order afferent neural signals under active touch suggest that different coding strategies might be applied to the afferent neural signals elicited from different cutaneous neurons simultaneously.
14 December 2022 in IEEE Transactions on Neural Systems and Rehabilitation Engineering
Human finger joints are conventionally simplified as rigid joints in robotic hand design and biomechanical hand modelling, due to their anatomic and morphologic complexity. However, our understanding of the effect of the finger joint configuration on the resulting hand performance is still primitive. In this study, we systematically investigate the grasping performance of the hands with the conventional rigid joints and the biomechanical flexible joints based on a computational human hand model. The measured muscle electromyography (EMG) and hand kinematic data during grasping are used as inputs for the grasping simulations. The results show that the rigid joint configuration currently used in most robotic hands leads to large reductions in hand contact force, contact pressure and contact area, compared to the flexible joint configuration. The grasping quality could be reduced up to 40% and 36% by the rigid joint configuration in terms of algebraic properties of grasping matrix and finger force limit respectively. Further investigation reveals that these reductions are caused by the weak rotational stiffness of the rigid joint configuration. This study implies that robotic/prosthetic hand performance could be improved by exploiting flexible finger joint design. Hand contact parameters and grasping performance may be underestimated by the rigid joint simplification in human hand modelling.