19 March 2021 in IEEE Robotics and Automation Letters
Human gait optimality has been investigated recently, with the development of detailed musculoskeletal models, through trajectory optimization approaches or deep reinforcement learning (DRL). Trajectory optimization studies are limited by the trajectory length and can only generate open-loop solutions. While existing DRL solutions provide closed-loop control policies without trajectory length limit, they either do not evaluate the naturalness of the behaviour, or directly impose experimental tracking data. In this letter, a DRL-based approach is proposed with a nature-inspired curriculum learning (CL) scheme and a neuromechanically-inspired reward function. This approach generates close-to-natural human walking without the aid of experimental data. Our CL scheme is realized by an evolving reward function, targeting simpler behaviours such as standing and stepping first, then gradually refining the gait. The emerged gait from the closed-loop stochastic policy demonstrated a strong correlation with human gait kinematics, with Pearson correlations of 0.95 and 0.83 at the hip and knee, respectively, and higher gait symmetry than two other DRL-based control policies without CL. Our approach was also found to have efficient convergence to walking-capable policy. This approach can facilitate the development of assistive robotic systems by providing a “human” controller, and could enable decentralized adaptation between the agent and the assistive robotic devices.
19 September 2022 in IEEE Transactions on Neural Systems and Rehabilitation Engineering
An ultra-robust accurate gait phase estimator is developed by training a time-delay neural network (D67) on data collected from the hip and knee joint angles of 14 participants during treadmill and overground walking. Collected data include normal gait at speeds ranging from 0.1m/s to 1.9m/s and conditions such as long stride, short stride, asymmetric walking, stop-start, and abrupt speed changes. Spatial analysis of our method indicates an average RMSE of 1.74±0.23% and 2.35±0.52% in gait phase estimation of test participants in the treadmill and overground walking, respectively. The temporal analysis reveals that D67 detects heel-strike events with an average MAE of 1.70±0.54% and 2.74±0.92% of step duration on test participants in the treadmill and overground walking, respectively. Both spatial and temporal performances are uniform across participants and gait conditions. Further analyses indicate the robustness of the D67 to smooth and abrupt speed changes, limping, variation of stride length, and sudden start or stop of walking. The performance of the D67 is also compared to the state-of-the-art techniques confirming the superior and comparable performance of the D67 to techniques without and with a ground contact sensor, respectively. The estimator is finally tested on a participant walking with an active exoskeleton, demonstrating the robustness of D67 in interaction with an exoskeleton without being trained on any data from the test subject with or without an exoskeleton.
23 June 2023 in IEEE Robotics and Automation Letters
This work investigates the optimal cost function composition for human gait at different walking speeds. Kinematic and kinetic data for walking at four walking speeds were collected from five individuals without any known disability. The data was then used to recover optimal cost functions in a predictive simulation environment with musculoskeletal models. Twenty inverse optimal control (IOC) problems were solved for cost function weight tuning using the previously developed and validated Adaptive Reference IOC (AR-IOC) algorithm. Given the walking speed range examined (0.6–1.5 m/s), the converged cost function weights suggest that the increase in walking speed attributes to a reduction of foot sliding penalty weight and weight increase for the center of mass (CoM) acceleration and stability as confirmed by several experiments. Furthermore, we did not observe any significant weight shift in effort reduction between the upper and the lower body with respect to walking speed. The obtained results from this study can be used in a toolbox for obtaining subject- and task-specific cost functions and assisting the development of personalized rehabilitation technologies.