Bipedal robots are gaining global recognition due to their potential applications and the rapid advancements in artificial intelligence, particularly through deep reinforcement learning (DRL). While DRL has significantly advanced bipedal locomotion, the development of a unified framework capable of handling a wide range of tasks remains an ongoing challenge. This survey systematically categorises, compares, and analyses existing DRL frameworks for bipedal locomotion, organising them into end-to-end and hierarchical control schemes. End-to-end frameworks are evaluated based on their learning approaches, whereas hierarchical frameworks are examined in terms of their layered structures that integrate learning-based and traditional model-based methods. We provide a detailed evaluation of the composition, strengths, limitations, and capabilities of each framework. Furthermore, this survey identifies key research gaps and proposes future directions aimed at creating a more integrated and efficient unified framework for bipedal locomotion, with broad applicability in real-world environments.
A novel control synthesis is proposed for humanoids to demonstrate unique foot-tilting behaviors that are comparable to humans in balance recovery. Our study of model-based behaviors explains the underlying mechanism and the significance of foot tilting well. Our main algorithms are composed of impedance control at the center of mass, virtual stoppers that prevent overtilting of the feet, and postural control for the torso. The proof of concept focuses on the sagittal scenario and the proposed control is effective to produce human-like balancing behaviors characterized by active foot tilting. The successful replication of this behavior on a real humanoid proves the feasibility of deliberately controlled underactuation. The experimental validation was rigorously performed, and the data from the submodules and the entire control were presented and analyzed.
31 July 2023 in IEEE Robotics and Automation Letters
Developing gaits inspired by animal locomotion for quadruped robots has become a prevalent approach in achieving dynamic locomotion. Analogous to animal gaits, they exhibit optimal effectiveness at specific velocities, necessitating the transitions between them for enhanced locomotion proficiency. Despite the significance of these transitions, methods for achieving them have received comparatively limited attention. For successful gait transitions, stability and suitable velocities are essential to maintain efficiency. In this study, a bio-inspired gait transition method has been devised, capitalising on the Froude number-a parameter characterising the velocity at which different-sized quadrupeds alter their gaits. By formulating a set of governing equations contingent on the Froude number, stable gait transitions can be generated. A series of simulations were conducted to determine the optimal Froude number ranges for various gaits and to validate the generality of this method by applying it to four distinct quadrupeds. To assess the performance of the gait transitions, a series of hardware experiments were executed, demonstrating a variety of gait transitions, comparing the proposed transition method with existing alternatives and testing its generality.