20 November 2024 in IEEE Robotics & Automation Magazine
Deep reinforcement learning (DRL) has emerged as a promising solution to mastering explosive and versatile quadrupedal jumping skills. However, current DRL-based frameworks usually rely on pre-existing reference trajectories obtained by capturing animal motions or transferring experience from existing controllers. This work aims to prove that learning dynamic jumping is possible without relying on imitating a reference trajectory by leveraging a curriculum design. Starting from a vertical in-place jump, we generalize the learned policy to forward and diagonal jumps and, finally, we learn to jump across obstacles. Conditioned on the desired landing location, orientation, and obstacle dimensions, the proposed approach yields a wide range of omnidirectional jumping motions in real-world experiments. In particular, we achieve a 90 cm forward jump, exceeding all previous records for similar robots. Additionally, the robot can reliably execute continuous jumping on soft grassy grounds, which is especially remarkable as such conditions were not included in the training stage.
2 June 2022 in IEEE/ASME Transactions on Mechatronics
Robust locomotion is a challenging task for humanoid robots, especially when considering dynamic disturbances. This article proposes a disturbance observer-based cascaded model predictive control (MPC) approach for bipedal locomotion, with the capability of exploiting ankle, stepping, hip and height variation strategies. Specifically, based on the variable-height inverted pendulum model, a nonlinear MPC that is run at a low frequency is built for 3-D locomotion (i.e., with height variation) while accounting for the footstep modulation as well. Differing from previous works, the nonlinear MPC is formulated as a convex optimization problem by semidefinite relaxation. Subsequently, assuming a flywheel at the pelvis center, a linear MPC that is run at a high frequency is proposed to regulate angular momentum (e.g., through rotating the upper body), which is solved by convex quadratic programming. To run the cascaded MPC in a closed-loop manner, a high order sliding mode observer is designed to estimate system states and dynamic disturbances simultaneously. Simulation and hardware experiments demonstrate the walking robustness in real-world scenarios, including 3-D walking with varying speeds, walking across non-coplanar terrains and push recovery.
8 November 2023 in IEEE Robotics and Automation Letters
Quadrupeds deployed in real-world scenarios need to be robust to unmodelled dynamic effects. In this work, we aim to increase the robustness of quadrupedal periodic forward jumping (i.e., pronking) by unifying cutting-edge model-based trajectory optimization and iterative learning control. Using a reduced-order soft anchor model, the optimization-based motion planner generates the periodic reference trajectory. The controller then iteratively learns the feedforward control signal in a repetition process, without requiring an accurate full-body model. When enhanced by a continuous learning mechanism, the proposed controller can learn the control inputs without resetting the system at the end of each iteration. Simulations and experiments on a quadruped with parallel springs demonstrate that continuous jumping can be learned in a matter of minutes, with high robustness against various types of terrain.
10 June 2024 in IEEE Transactions on Robotics
Introducing parallel elasticity in the hardware design endows quadrupedal robots with the ability to perform explosive and efficient motions. However, for this kind of articulated soft quadruped, realizing dynamic jumping with robustness against system uncertainties remains a challenging problem. To achieve this, we propose an impact-aware jumping planning and control approach. Specifically, an offline kino-dynamic-type trajectory optimizer is first formulated to achieve compliant 3D jumping motions, using a novel actuated spring-loaded inverted pendulum (SLIP) model. Then, an optimization-based online landing strategy, including pre-impact leg motion modulation and post-impact landing recovery, is designed. The actuated SLIP model, with the capability of explicitly characterizing parallel elasticity, captures the jumping and landing dynamics, making the problem of motion generation/regulation more tractable. Finally, a hybrid torque control consisting of a feedback tracking loop and a feedforward compensation loop is employed for motion control. Experiments demonstrate the ability to accomplish robust 3D jumping motions with stable landing and recovery. Besides, our approach can be applied to quadrupedal robots with or without additional parallel compliance.
4 June 2024 in IEEE/ASME Transactions on Mechatronics
The usage of parallel elastic actuators (PEA) in legged robots could potentially enhance the joints and increase energy efficiency by providing extra torques. However, the current design that adopts tension springs or spiral springs usually requires additional working space for PEA add-ons and enlarges size and mass too much. Besides, they often tune the spring parameters especially the spring constant by hand, failing to achieve optimal performance when considering multiple objectives. To tackle these issues, this article designs a compact dual-slide PEA (DS-PEA) leg that adopts a compression spring structure. Through integrating with a dual-slide mechanism, the PEA elements are attached tightly to the transmission, resulting in a small-size and light-weighted design. Furthermore, we adopt a multiobjective optimization method, i.e., multi-Pareto fronts quantify, to automatically choose the proper spring constant. Simulation and hardware experiments demonstrate that peak torque, motor power, and cost of transport for motion tracking are all largely reduced, even when working at multiple trajectories. Extensive hopping experiments further validate the dynamic motion capability and the energy efficiency of the delicate design. The compact DS-PEA leg will be used in a quadruped robot shortly.
20 February 2023 in IEEE/ASME Transactions on Mechatronics
Bipedal locomotion has been widely studied in recent years, where passive safety (i.e., a biped rapidly brakes without falling) is deemed to be a pivotal problem. To realize safe 3-D walking, existing works resort to nonlinear optimization techniques based on simplified dynamics models, requiring hand-tuned reference trajectories. In this article, we propose to integrate safety constraints into constrained task-space imitation learning, endowing a humanoid robot with adaptive walking capability. Specifically, unlike previous work using nonlinear and coupled capturability dynamics, we first linearize the 3-D capture conditions using appropriate extreme values and then seamlessly incorporate them into constrained imitation learning. Furthermore, we propose novel heuristic rules to define control points, enabling adaptive locomotion learning. The resulting framework allows robots to learn locomotion skills from a few demonstrations efficiently and apply the learned skills to unseen 3-D scenarios while satisfying the constraints for passive safety. Unlike deep enforcement learning, our framework avoids the need of a large number of iterations or sim-to-real transfer. By virtue of the task-space adaptability, the proposed imitation learning framework can reuse collected demonstrations in a new robot platform. We validate our method by hardware experiments on Walker2 robot and simulations on COMAN robot.