Proximity perception is a technology that has the potential to play an essential role in the future of robotics. It can fulfill the promise of safe, robust, and autonomous systems in industry and everyday life, alongside humans, as well as in remote locations in space and underwater. In this survey article, we cover the developments of this field from the early days up to the present, with a focus on human-centered robotics. In this domain, proximity sensors are typically deployed in two scenarios: first, on the exterior of manipulator arms to support safety and interaction functionality, and second, on the inside of grippers or hands to support grasping and exploration. Therefore, based on this observation, in the beginning of this article, we propose a categorization to organize the use cases of proximity sensors in human-centered robotics. Then, we devote effort to present the sensing technologies and different measuring principles that have been developed over the years, also providing a summary in form of a table. Following, we review the literature regarding the applications that have been proposed. Finally, we give an overview of the most important trends that will shape the future of this domain.
27 June 2018 in IEEE Robotics and Automation Letters
We developed a fingertip-size proximity sensor that detects the distance to and the tilt angle of the surface of an object with the peak-to-peak distance error less than 1/129th (<;31 μm) and the measuring time less than 1/10th (<;1 ms) those of existing sensors. In addition, we realized the task of catching a fragile object (paper balloon) with a high-speed robot hand equipped with the sensor. High-speed, high-precision sensing enables contact detection independently of the contact force. We describe a robust contact detection method that does not depend on the reflectance, the tilt angle, or the shape of target objects surface. In experiments, we confirmed that the sensor could measure a distance of 2.85-20 mm (resolution: 44 μm in <;3 mm) and a tilt angle of ±45° (error: 1.47°) for objects with reflectances of 18% and 90%. We demonstrated that the hand could catch the paper balloon when dropped from a height of about 20 cm without crushing it.
25 September 2019 in The International Journal of Robotics Research
We describe integrated control of a multiple-degree-of-freedom hand and arm using a simple reactive architecture based on high-speed proximity sensing. A proximity sensor installed on each fingertip of the hand detects the positions between the sensor and the surface of an object. By feeding back the sensor outputs, the reactive architecture simultaneously controls the position of the arm tip and the vector connecting the grasping position and the origin of the arm tip coordinates, the wrist posture, and the initial finger configurations before grasping. This architecture makes it possible to correct position errors. In addition, since the positions and postures are controlled without contact, there is no danger of damaging the object or the robot. To realize this integrated control using a simple reactive architecture, we designed a high-speed proximity sensor for the fingertips of the hand, and developed an integrated control system for the hand and the arm. We demonstrate high-speed position adjustment motion and grasping for static and moving objects in experiments.
7 January 2019 in IEEE Robotics and Automation Letters
In this paper, we propose a combination of sensing and control modules for catching soft objects (i.e., a marshmallow and paper balloon) at a high speed with small deformation. A paper balloon and marshmallow are deformed by a small force and they have individual differences in terms of softness. Therefore, model-based, small-deformation catching is difficult. To realize small-deformation catching, we used high-speed sensor-based (vision and proximity) control modules without a deformation model of the soft objects. A high-speed vision-based controller adjusts the positions of the fingertips of a robot to some extent. As the distance to the object decreased, the fingertip positions were accurately controlled by the high-speed, high-precision proximity-based control. Furthermore, the fingertips were stopped by a proximity-based contact detection before the object surface was deformed. Virtual damping control was effective in catching an object whose surface can be easily deformed by a small impact force or vibration of the fingertips, such as a paper balloon.
This article develops a flexible and robust robotic system for autonomously drawing on 3-D surfaces. The system takes 2-D drawing strokes and a 3-D target surface (mesh or point clouds) as input. It maps the 2-D strokes onto the 3-D surface and generates a robot motion to draw the mapped strokes using visual recognition, grasp pose reasoning, and motion planning. The system is flexible compared to conventional robotic drawing systems as we do not fix drawing tools to the end of a robot arm. Instead, a robot recognizes and picks up pens online and holds the pens to draw 3-D strokes. Meanwhile, the system has high robustness thanks to the following crafts: First, a high-quality mapping method is developed to minimize deformation in the strokes. Second, visual detection is used to reestimate the drawing tool’s pose before executing each drawing motion. Third, force control is employed to compensate for noisy visual detection and calibration and ensure a firm touch between the pen tip and the surface. Fourth, error detection and recovery are implemented to deal with slippage and other anomalies. The planning and executions are performed in a closed-loop manner until the strokes are successfully drawn. We evaluate the system and analyze the necessity of the various crafts using different real-world tasks. The results show that the proposed system is flexible and robust to generate robotic motion that picks up the pens and successfully draws 3-D strokes on given surfaces.
This article develops a mechanical screwing tool and its manipulation policies for two-finger parallel robotic grippers. The tool is based on a combined scissor-like element (SLE) and double-ratchet mechanism that converts the gripping motion of two-finger parallel grippers into a continuous rotation to realize tasks like fastening screws. The tool is entirely mechanical. There is no need for external cable connections. The manuscript includes two parts. For one thing, it shows the details of the tool design, optimizes the tool’s dimensions and effective stroke lengths, and studies the contacts and forces to achieve stable grasping and screwing. For another, it presents the related manipulation and control policies, including recognizing the tool, changing tool poses, and completing screw fastening tasks. The designed tool, together with the related manipulation and control policies, are analyzed and verified in several real-world applications. The results show that the tool has satisfying mechanical properties. Robots with parallel grippers can robustly and flexibly use the tool to fasten screws. The tool can also be used collaboratively with other tools to finish difficult tasks. In the future, similar tools are expected to replace special-purpose end-effectors or tool changers for more flexible robot integration.