14 March 2013 in The International Journal of Robotics Research
Transport of individual cells or chemical payloads on a subcellular scale is an enabling tool for the study of cellular communication, cell migration, and other localized phenomena. We present a magnetically actuated robotic system capable of fully automated manipulation of cells and microbeads. Our strategy uses autofluorescent robotic transporters and fluorescently labeled microbeads to aid tracking and control in optically obstructed environments. We demonstrate automated delivery of microbeads infused with chemicals to specified positions on neurons. This system is compatible with standard upright and inverted light microscopes and is capable of applying forces less than 1 pN for precision positioning tasks.
27 February 2019 in IEEE Robotics and Automation Letters
We autonomously pour from unknown symmetric containers found in a typical wet laboratory for the development of a robot-assisted, rapid experiment preparation system. The robot estimates the pouring container symmetric geometry, then leverages simulated pours as priors for a given fluid to pour precisely and quickly in a single attempt. The fluid is detected in the transparent receiving container by combining weight and vision. The change of volume in the receiver is a function of the geometry of the pouring container, the pouring angle, and rate. To determine the volumetric flow rate, the profile for maximum containable volume for a given angle is estimated along with the time delay of the fluid exiting the container. A trapezoidal trajectory generation algorithm prescribes the desired volumetric flow rate as a function of the estimation accuracy. A hybrid control strategy is then used to attenuate volumetric error. Three methods are compared for estimating the volume-angle profile, and it is shown that a combination of online system identification and leveraged model priors results in reliable performance. The major contributions of this work are a system capable of pouring quickly and precisely from varying symmetric containers in a single attempt with limited priors, and a novel fluid detection method. This system is implemented on the Rethink Robotics Sawyer and KUKA LBR iiwa manipulators.
6 November 2023 in IEEE Robotics and Automation Letters
Modeling multimodal human behavior has been a key barrier to increasing the level of interaction between human and robot, particularly for collaborative tasks. Our key insight is that an effective, learned robot policy used for human-robot collaborative tasks must be able to express a high degree of multimodality, predict actions in a temporally consistent manner, and recognize a wide range of frequencies of human actions in order to seamlessly integrate with a human in the control loop. We present Diffusion Co-policy, a method for planning sequences of actions that synergize well with humans during test time. The co-policy predicts joint human-robot action sequences via a Transformer-based diffusion model, which is trained on a dataset of collaborative human-human demonstrations, and directly executes the robot actions in a receding horizon control framework. We demonstrate in both simulation and real environments that the method outperforms other state-of-art learning methods on the task of human-robot table-carrying with a human in the loop. Moreover, we qualitatively highlight compelling robot behaviors that demonstrate evidence of true human-robot collaboration, including mutual adaptation, shared task understanding, leadership switching, and low levels of wasteful interaction forces arising from dissent.
23 January 2018 in IEEE Robotics and Automation Letters
This letter presents a new method for picking objects through quasistatic in-hand manipulation with end-effectors that have no degrees of freedom. Our stable manipulation/grasp planning is achieved with two contacts at fixed distance and the force of gravity, and is provably complete and correct. Practically, our robotic in-hand manipulation technique can facilitate low-cost manipulation and render simple end-effectors such as the parallel-jaw gripper more dexterous in picking, placing, and handing-off objects in case, for example, failing actuated grippers become frozen and it is impossible to exert sufficiently large internal forces. Our picking technique can also be applied to placing objects. Implementation and experimentation on a custom-made direct-drive manipulator and a conventional manipulator are presented. Many experiments were performed for both picking and placing and the results demonstrate usefulness of this method for manipulating a variety of common objects, with different geometries and surface conditions.