Cooperative multiagent manipulation systems allow to extend on the manipulative limitations of individual agents, increasing the complexity of the manipulation tasks the ensemble can handle. Controlling such a system requires meticulous planning of subsequent subtasks, queried to the individual agents, in order to execute the master task successfully. Real-time (re)planning is essential to ensure the task can still be achieved when subtasks execution suffers from uncertainty or when the master task changes intermittently requiring real-time reconfiguration of the plan. In this article, we develop a supervisory control architecture tailored to the cooperation of two robotic manipulators equipped with standard pick-and-place facilities in the plane. We control the planar position and orientation of an object using two underactuated manipulators so that only the position of the object can be controlled directly. The desired orientation follows from the accumulation of alternating relative angles. A time-invariant policy function is trained using deep reinforcement learning, which can determine a finite sequence of pick-and-place maneuvers to manipulate the object to a desired configuration. Two policy architectures are compared. The first uses the kinematic model to determine the final step, whilst the second policy makes this decision itself. The more information is given to the policy, the easier it trains. In return, it becomes less adaptable and loses some of its generalizability.
26 April 2023 in Journal of Dynamic Systems, Measurement, and Control
In this work, we show that the differential kinematics of slider–pusher systems are differentially flat assuming quasi-static behavior and frictionless contact. Second, we demonstrate that the state trajectories are invariant to time-differential transformations of the path parametrizing coordinate. For one this property allows to impose arbitrary velocity profiles on the slider without impacting the geometry of the state trajectory. This property implies that certain path planning problems may be decomposed approximately into a strictly geometric path planning and an auxiliary throughput speed optimization problem. Building on these insights, we elaborate a numerical approach tailored to constrained time optimal collision free path planning and apply it to the slider–pusher system.
Cooperative multi-agent manipulation systems allow to extend on the manipulative limitations of individual agents, increasing the complexity of the manipulation tasks the ensemble can handle. Controlling such a system requires meticulous planning of subsequent subtasks, queried to the individual agents, in order to execute the master task successfully. Real-time planning is essential to ensure the task can still be achieved when subtasks execution suffers from uncertainty or when the master task changes intermittently requiring real-time reconfiguration of the plan. In this work we develop a supervisory control architecture tailored to the cooperation of two robotic manipulators equipped with standard pick-and-place facilities in the plane. We consider a toy task description where we control the planar position and orientation of an object. A time-invariant policy function is trained using deep reinforcement learning, which can determine a finite sequence pick-and-place maneuvers to manipulate the object into its desired configuration. A comparison is made between two strategies, with the distinction made based on different treatments of the final step. The more information is given to the policy the easier it trains. In return, it becomes less adaptable and loses some of its generalizability.
1 November 2026 in IEEE Transactions on Control Systems Technology