In recent years, human hand‐based robotic hands or dexterous hands have gained attention due to their enormous capabilities of handling soft materials compared to traditional grippers. Back in the earlier days, the development of a hand model close to that of a human was an impossible task but with the advancements made in technology, dexterous hands with three, four or five‐fingered robotic hands have been developed to mimic human hand nature. However, human‐like manipulation of dexterous hands to this date remains a challenge. Thus, this review focuses on (a) the history and motivation behind the development of dexterous hands, (b) a brief overview of the available multi‐fingered hands, and (c) learning‐based methods such as traditional and data‐driven learning methods for manipulating dexterous hands. Additionally, it discusses the challenges faced in terms of the manipulation of multi‐fingered or dexterous hands.
Robotic manipulation of objects with diverse shapes, sizes, and properties, especially deformable ones, remains a significant challenge in automation, necessitating human-like dexterity through the integration of perception, learning, and control. This study enhances a previous framework combining YOLOv8 for object detection and LSTM networks for adaptive grasping by introducing Gaussian Processes (GPs) for robust grasp predictions and Transformer models for efficient multi-modal sensory data integration. A Random Forest classifier also selects optimal grasp configurations based on object-specific features like geometry and stability. The proposed grasping framework achieved a 95.6% grasp success rate using Transformer-based force modulation, surpassing LSTM (91.3%) and GP (91.3%) models. Evaluation of a diverse dataset showed significant improvements in grasp force modulation, adaptability, and robustness for two- and three-finger grasps. However, limitations were observed in five-finger grasps for certain objects, and some classification failures occurred in the vision system. Overall, this combination of vision-based detection and advanced learning techniques offers a scalable solution for flexible robotic manipulation.
17 January 2024 in IEEE/ASME Transactions on Mechatronics
Grasp planning for irregularly shaped objects using multifingered robotic hands is challenging due to the high dimensionality of the search space and a lack of proper modeling methods for object geometry. To address these issues, we propose a grasp planning approach based on Gaussian process implicit surfaces (GPIS). To explore the object geometry and identify feasible contact positions and normals, our method introduces several moving points called attractors along with a dynamical system. The dynamical system constrains and guides the attractors with the partial differentials of the GPIS, which can be conveniently obtained through the linear expression of a GP. The hand motion is also guided by the dynamical system. In addition, an inverse kinematics method, which considers finger joint limits, is developed to simultaneously adjust the palm pose and finger joint angles for a feasible grasp. The performance of our method is demonstrated using various robotic hands and objects, and real robot experiments are conducted to validate the planned grasp's effectiveness in reality. Experimental evaluation demonstrates that the method works for different robotic hands and objects of varying shapes, with a higher likelihood of generating grasps with better quality.