28 June 2023 in IEEE Transactions on Robotics
Modular robots can be rearranged into a new design, perhaps each day, to handle a wide variety of tasks by forming a customized robot for each new task. However, reconfiguring just the mechanism is not sufficient: each design also requires its own unique control policy. One could craft a policy from scratch for each new design, but such an approach is not scalable, especially given the large number of designs that can be generated from even a small set of modules. Instead, we create a modular policy framework where the policy structure is conditioned on the hardware arrangement, and use just one training process to create a policy that controls a wide variety of designs. Our approach leverages the fact that the kinematics of a modular robot can be represented as a design graph , with nodes as modules and edges as connections between them. Given a robot, its design graph is used to create a policy graph with the same structure, where each node contains a deep neural network, and modules of the same type share knowledge via shared parameters (e.g., all legs on a hexapod share the same network parameters). We developed a model-based reinforcement learning algorithm, interleaving model learning and trajectory optimization to train the policy. We show the modular policy generalizes to a large number of designs that were not seen during training without any additional learning. Finally, we demonstrate the policy controlling a variety of designs to locomote with both simulated and real robots.
24 March 2018 in The International Journal of Robotics Research
Highly articulated systems are capable of executing a variety of behaviors by coordinating their many internal degrees of freedom to help them move more effectively in complex terrains. However, this inherent variety poses significant challenges that have been the subject of a great deal of previous work: What are the most effective or most efficient methods for achieving the intrinsic coordination necessary to produce desired global objectives? This work takes these questions one step further, asking how different levels of coordination, which we quantify in terms of kinematic coupling, affect articulated locomotion in environments with different degrees of underlying structure. We introduce shape functions as the analytical basis for specifying kinematic coupling relationships that constrain the relative motion among the internal degrees of freedom for a given system during its nominal locomotion. Furthermore, we show how shape functions are used to derive shape-based controllers (SBCs) that manage the compliant interaction between articulated bodies and the environment while explicitly preserving the inter-joint coupling defined by shape functions. Initial experimental evidence provides a comparison of the benefits of different levels of coordination for two separate platforms in environments with different degrees of inherent structure. The experimental results show that decentralized implementations, where there is relatively little inter-joint coupling, perform well across a spectrum of different terrains but that there are potential benefits to higher degrees of coupling in structured terrains. We discuss how this observation has implications related to future planning and control approaches that actively “tune” their underlying structure by dynamically varying the assumed level of coupling as a function of task specification and local environmental conditions.
25 February 2021 in IEEE Robotics and Automation Letters
Snake robots composed of alternating single-axis pitch and yaw joints have many internal degrees of freedom, which make them capable of versatile three-dimensional locomotion. In motion planning process, snake robot motions are often designed kinematically by a chronological sequence of continuous backbone curves that capture desired macroscopic shapes of the robot. However, as the geometric arrangement of single-axis rotary joints creates constraints on the rotations in the robot, it is challenging for the robot to reconstruct an arbitrary 3D curve. When the robot configuration does not accurately achieve the desired shapes defined by these backbone curves, the robot can have unexpected contacts with the environment, such that the robot does not achieve the desired motion. In this work, we propose a method for snake robots to reconstruct desired backbone curves by posing an optimization problem that exploits the robot's geometric structure. We verified that our method enables fast and accurate curve-configuration conversions through its applications to commonly used 3D gaits. We also demonstrated via robot experiments that 1) our method results in smooth locomotion on the robot; 2) our method allows the robot to approach the numerically predicted locomotive performance of a sequence of continuous backbone curve.
17 June 2020 in IEEE Robotics and Automation Letters
This work proposes a method of footstep placement that controls system energy to enable a dynamically-safe walking behavior. Contrasting many other works that treat rough terrain as a series of disturbances that need to be mitigated with control, we provide some insight into how energy-targeted foot placement is enough to allow a passive system to transit over rough terrain. This work explores the underlying complexities of one of the simplest walking models, the inverted pendulum, which, in its various forms, is the skeleton behind all bipedal robots, from Asimo to Atlas. Troubling all of these humanoids is the foot placement problem, especially when the terrain is not flat. This work uses analysis of the system energy to divide the feasible stepping area into regions that would either enable dynamic walking or cause a fall. Second we subdivide the walking region into sectors that promote the accumulation or dissipation of energy, stimulating or inhibiting future steps. Third, we introduce a method of global energy management using a moving reference point over rough terrain. We present results on how these concepts can be used to prevent falls, accumulate energy to cross gaps, and even enable a passive system to walk uphill.
29 November 2024 in Journal of Terramechanics