11 April 2016 in IEEE Transactions on Robotics
Robots are becoming safe and smart enough to work alongside people not only on manufacturing production lines, but also in spaces such as houses, museums, or hospitals. This can be significantly exploited in situations in which a human needs the help of another person to perform a task, because a robot may take the role of the helper. In this sense, a human and the robotic assistant may cooperatively carry out a variety of tasks, therefore requiring the robot to communicate with the person, understand his/her needs, and behave accordingly. To achieve this, we propose a framework for a user to teach a robot collaborative skills from demonstrations. We mainly focus on tasks involving physical contact with the user, in which not only position, but also force sensing and compliance become highly relevant. Specifically, we present an approach that combines probabilistic learning, dynamical systems, and stiffness estimation to encode the robot behavior along the task. Our method allows a robot to learn not only trajectory following skills, but also impedance behaviors. To show the functionality and flexibility of our approach, two different testbeds are used: a transportation task and a collaborative table assembly.
1 November 2018 in Robotics and Autonomous Systems
14 November 2018 in IEEE Transactions on Robotics
10 January 2017 in IEEE Robotics and Automation Letters
In this letter, we propose a novel method that enables the robot to autonomously devise an appropriate control strategy from human demonstrations without a prior knowledge of the demonstrated task. The method is primarily based on observing the patterns and consistency in the observed dataset. This is obtained through a demonstration setting that uses a motion capture system, a force sensor, and muscle activity measurements. The variables (position and force) in the collected dataset are then segmented and analysed for each axis of the observed task frame separately. While checking several conditions based on the consistency, value range, and magnitude of repeated observations, the appropriate controller (i.e., position or force) is delegated to each axis of the task frame. In the final stage, the method also checks for a correlation between variables and muscle activity patterns to determine the desired stiffness behaviour. The robot then uses the derived control strategies in autonomous operation through a hybrid force/impedance controller. To validate the proposed method, we performed experiments on real-life tasks involving physical interaction with the environment, where we considered surface wiping, material sawing, and drilling.
28 August 2023 in The International Journal of Robotics Research
In recent decades, advancements in motion learning have enabled robots to acquire new skills and adapt to unseen conditions in both structured and unstructured environments. In practice, motion learning methods capture relevant patterns and adjust them to new conditions such as dynamic obstacle avoidance or variable targets. In this paper, we investigate the robot motion learning paradigm from a Riemannian-manifold perspective. We argue that Riemannian manifolds may be learned via human demonstrations in which geodesics are natural motion skills. The geodesics are generated using a learned Riemannian metric produced by our novel variational autoencoder (VAE), which is intended to recover full-pose end-effector states and joint-space configurations. In addition, we propose a technique for facilitating on-the-fly end-effector/multiple-limb obstacle avoidance by reshaping the learned manifold using an obstacle-aware ambient metric. The motion generated using these geodesics may naturally result in multiple-solution tasks that have not been explicitly demonstrated previously. We extensively tested our approach in task-space and joint-space scenarios using a 7-DoF robotic manipulator. We demonstrate that our method is capable of learning and generating motion skills based on complicated motion patterns demonstrated by a human operator. Additionally, we assess several obstacle-avoidance strategies and generate trajectories in multiple-mode settings.
21 August 2025 in IEEE Transactions on Robotics
Diffusion-based visuomotor policies excel at learning complex robotic tasks by effectively combining visual data with high-dimensional, multi-modal action distributions. However, diffusion models often suffer from slow inference due to costly denoising processes or require complex sequential training arising from recent distilling approaches. This paper introduces Riemannian Flow Matching Policy (RFMP), a model that inherits the easy training and fast inference capabilities of flow matching (FM). Moreover, RFMP inherently incorporates geometric constraints commonly found in realistic robotic applications, as the robot state resides on a Riemannian manifold. To enhance the robustness of RFMP, we propose Stable RFMP (SRFMP), which leverages LaSalle's invariance principle to equip the dynamics of FM with stability to the support of a target Riemannian distribution. Rigorous evaluation on ten simulated and real-world tasks show that RFMP successfully learns and synthesizes complex sensorimotor policies on Euclidean and Riemannian spaces with efficient training and inference phases, outperforming Diffusion Policies and Consistency Policies.