The human hand is able to achieve an un-paralleled diversity of manipulation actions. One contributor to this capability is the structure of the human finger pad, where soft internal tissue is surrounded by a layer of more rigid skin. This permits conforming of the finger pad around object contours for firm grasping, while also permitting low-friction sliding over object surfaces with light touch. These varying modes of manipulation contribute to the common ability for in-hand-manipulation, where an object (such as a car key) may re-positioned relative to the palm. In this work we present a simple mechanical analogy to the human finger pad, via a robotic finger with both high and low friction surfaces. The low friction surface is suspended on elastic elements and recesses into a cavity when a sufficient normal force is applied (~1.2-2.5 N depending on contact location), exposing the high-friction surface. We implement one "variable friction" finger and one "constant friction" finger on a 2-DOF gripper with a simple torque controller. With this setup, we demonstrate how within-hand rolling and sliding of an object may be achieved without the need for tactile sensing, high-dexterity, dynamic finger/object modelling or complex control methods. The addition of an actuator to the finger design allows controlled switching between variable-friction and constant friction modes, enabling precise object translation and re-orientation within a grasp, via simple motion sequences. The rolling and sliding behaviors are characterized with experimentally verified geometric models.
18 November 2021 in IEEE Robotics and Automation Letters
This paper discusses recent research progress in robotic grasping and manipulation in the light of the latest Robotic Grasping and Manipulation Competitions (RGMCs). We first provide an overview of past benchmarks and competitions related to the robotics manipulation field. Then, we discuss the methodology behind designing the manipulation tasks in RGMCs. We provide a detailed analysis of key challenges for each task and identify the most difficult aspects based on the competing teams’ performance in recent years. We believe that such an analysis is insightful to determine the future research directions for the robotic manipulation domain.
18 November 2021 in IEEE Robotics and Automation Letters
In this paper, we propose a cloud-based benchmark for robotic grasping and manipulation, called the OCRTOC benchmark. The benchmark focuses on the object rearrangement problem, specifically table organization tasks. We provide a set of identical real robot setups and facilitate remote experiments of standardized table organization scenarios in varying difficulties. In this workflow, users upload their solutions to our remote server and their code is executed on the real robot setups and scored automatically. After each execution, the OCRTOC team resets the experimental setup manually. We also provide a simulation environment that researchers can use to develop and test their solutions. With the OCRTOC benchmark, we aim to lower the barrier of conducting reproducible research on robotic grasping and manipulation and accelerate progress in this field. Executing standardized scenarios on identical real robot setups allows us to quantify algorithm performances and achieve fair comparisons. Using this benchmark we held a competition in the 2020 International Conference on Intelligence Robots and Systems (IROS 2020). In total, 59 teams took part in this competition worldwide. We present the results and our observations of the 2020 competition, and discuss our adjustments and improvements for the upcoming OCRTOC 2021 competition. The homepage of the OCRTOC competition is www.ocrtoc.org , and the OCRTOC software package is available at https://github.com/OCRTOC/OCRTOC_software_package .
19 December 2019 in IEEE Robotics and Automation Letters
In this work, we propose a pick-and-place benchmark to assess the manipulation capabilities of a robotic system. The benchmark is based on the Box and Blocks Test (BBT), a task utilized for decades by the rehabilitation community to assess unilateral gross manual dexterity in humans. We propose three robot benchmarking protocols in this work that hold true to the spirit of the original clinical tests-the Modified-BBT, the Targeted-BBT, and the Standard-BBT. These protocols can be implemented by the greater robotics research community, as the physical BBT setup has been widely distributed with the Yale-CMU-Berkeley (YCB) Object and Model Set. Difficulty of the three protocols increase sequentially, adding a new performance component at each level, and therefore aiming to assess various aspects of the system separately. Clinical task-time norms are summarized for able-bodied human participants. We provide baselines for all three protocols with off-the-shelf planning and perception algorithms on a Barrett WAM and a Franka Emika Panda manipulator, and compare results with human performance.
10 March 2022 in IEEE Robotics and Automation Letters
Benchmarking of robotic manipulations is one of the open issues in robotic research. An important factor that has enabled progress in this area in the last decade is the existence of common object sets that have been shared among different research groups. However, the existing object sets are very limited when it comes to cloth-like objects that have unique particularities and challenges. This letter is a first step towards the design of a cloth object set to be distributed among research groups from the robotics cloth manipulation community. We present a set of household cloth objects and related tasks that serve to expose the challenges related to gathering such an object set and propose a roadmap to the design of common benchmarks in cloth manipulation tasks, with the intention to set the grounds for a future debate in the community that will be necessary to foster benchmarking for the manipulation of cloth-like objects. Some RGB-D and object scans are collected as examples for the relevant configurations and shared in http://www.iri.upc.edu/groups/perception/ClothObjectSet/ .
8 March 2018 in IEEE Transactions on Automation Science and Engineering
In this paper, a novel active vision strategy is proposed for optimizing the viewpoint of a robot's vision sensor for a given success criterion. The strategy is based on extremum seeking control (ESC), which introduces two main advantages: 1) Our approach is model free: It does not require an explicit objective function or any other task model to calculate the gradient direction for viewpoint optimization. This brings new possibilities for the use of active vision in unstructured environments, since a priori knowledge of the surroundings and the target objects is not required. 2) ESC conducts continuous optimization backed up with mechanisms to escape from local maxima. This enables an efficient execution of an active vision task. We demonstrate our approach with two applications in the object recognition and manipulation fields, where the model-free approach brings various benefits: for object recognition, our framework removes the dependence on offline training data for viewpoint optimization, and provides robustness of the system to occlusions and changing lighting conditions. In object manipulation, the model-free approach allows us to increase the success rate of a grasp synthesis algorithm without the need of an object model; the algorithm only uses continuous measurements of the objective value, i.e., the grasp quality. Our experiments show that continuous viewpoint optimization can efficiently increase the data quality for the underlying algorithm, while maintaining the robustness.