28 June 2023 in IEEE Transactions on Robotics
Modular robots can be rearranged into a new design, perhaps each day, to handle a wide variety of tasks by forming a customized robot for each new task. However, reconfiguring just the mechanism is not sufficient: each design also requires its own unique control policy. One could craft a policy from scratch for each new design, but such an approach is not scalable, especially given the large number of designs that can be generated from even a small set of modules. Instead, we create a modular policy framework where the policy structure is conditioned on the hardware arrangement, and use just one training process to create a policy that controls a wide variety of designs. Our approach leverages the fact that the kinematics of a modular robot can be represented as a design graph , with nodes as modules and edges as connections between them. Given a robot, its design graph is used to create a policy graph with the same structure, where each node contains a deep neural network, and modules of the same type share knowledge via shared parameters (e.g., all legs on a hexapod share the same network parameters). We developed a model-based reinforcement learning algorithm, interleaving model learning and trajectory optimization to train the policy. We show the modular policy generalizes to a large number of designs that were not seen during training without any additional learning. Finally, we demonstrate the policy controlling a variety of designs to locomote with both simulated and real robots.
24 March 2018 in The International Journal of Robotics Research
Highly articulated systems are capable of executing a variety of behaviors by coordinating their many internal degrees of freedom to help them move more effectively in complex terrains. However, this inherent variety poses significant challenges that have been the subject of a great deal of previous work: What are the most effective or most efficient methods for achieving the intrinsic coordination necessary to produce desired global objectives? This work takes these questions one step further, asking how different levels of coordination, which we quantify in terms of kinematic coupling, affect articulated locomotion in environments with different degrees of underlying structure. We introduce shape functions as the analytical basis for specifying kinematic coupling relationships that constrain the relative motion among the internal degrees of freedom for a given system during its nominal locomotion. Furthermore, we show how shape functions are used to derive shape-based controllers (SBCs) that manage the compliant interaction between articulated bodies and the environment while explicitly preserving the inter-joint coupling defined by shape functions. Initial experimental evidence provides a comparison of the benefits of different levels of coordination for two separate platforms in environments with different degrees of inherent structure. The experimental results show that decentralized implementations, where there is relatively little inter-joint coupling, perform well across a spectrum of different terrains but that there are potential benefits to higher degrees of coupling in structured terrains. We discuss how this observation has implications related to future planning and control approaches that actively “tune” their underlying structure by dynamically varying the assumed level of coupling as a function of task specification and local environmental conditions.
28 December 2018 in IEEE Robotics and Automation Letters
This paper addresses the challenge of determining the optimal design of a customizable robot for a given task. We present a motion planner that not only prescribes a path, but also synthesizes the robot design to follow that path. Our approach treats design variables as part of an inverse kinematics problem to jointly optimize manipulator design parameters and trajectory. We apply our method to two distinct problems where rapid prototyping and customization are desirable: an arm prototyped for a future Mars mission, and a wearable backpack-mounted arm. We then propose a novel method to minimize the number of joints in the mechanism while maintaining its ability to reach workspace task poses. We combine these methods into a framework in which we iteratively optimize and simplify task-specialized manipulator designs.
16 June 2022 in Bioinspiration & Biomimetics
Serially connected robots are promising candidates for performing tasks in confined spaces such as search and rescue in large-scale disasters. Such robots are typically limbless, and we hypothesize that the addition of limbs could improve mobility. However, a challenge in designing and controlling such devices lies in the coordination of high-dimensional redundant modules in a way that improves mobility. Here we develop a general framework to discover templates to control serially connected multi-legged robots. Specifically, we combine two approaches to build a general shape control scheme which can provide baseline patterns of self-deformation (‘gaits’) for effective locomotion in diverse robot morphologies. First, we take inspiration from a dimensionality reduction and a biological gait classification scheme to generate cyclic patterns of body deformation and foot lifting/lowering, which facilitate the generation of arbitrary substrate contact patterns. Second, we extend geometric mechanics, which was originally introduced to study swimming at low Reynolds numbers, to frictional environments, allowing the identification of optimal body–leg coordination in this common terradynamic regime. Our scheme allows the development of effective gaits on flat terrain with diverse numbers of limbs (4, 6, 16, and even 0 limbs) and backbone actuation. By properly coordinating body undulation and leg placement, our framework combines the advantages of both limbless robots (modularity and narrow profile) and legged robots (mobility). Our framework can provide general control schemes for rapid deployment of general multi-legged robots, paving the way toward machines that can traverse complex environments. In addition, we show that our framework can also offer insights into body–leg coordination in living systems, such as salamanders and centipedes, from a biomechanical perspective.