19 March 2021 in IEEE Transactions on Systems, Man, and Cybernetics: Systems
This article investigates the tracking problem of an uncertain $n$ -link robot manipulator with guaranteed safety and performance. To tackle parametric uncertainties, the torque filtering-augmented concurrent learning (CL) method is introduced for online identification of the unknown system without requirements of joints acceleration. By using CL, the parameter convergence is guaranteed by exploiting the current and historical data simultaneously. This technique enjoys practicability compared with common methods that need to incorporate external noises to satisfy the persistence of excitation condition for the parameter convergence. Based on the estimated model, we design a barrier Lyapunov function (BLF)-based adaptive control law by the backstepping technique and Lyapunov analysis. By ensuring the boundness of the BLF, the system output and the tracking error are proved to lie in the safety set and performance set, respectively. Numerical simulation results and experiment tests validate the proposed strategy.
1 April 2022 in Mechatronics
2 February 2022 in IEEE Transactions on Control Systems Technology
This article proposes a new incremental model predictive control (IMPC) strategy, which allows for constrained control of a robot manipulator, while the resulting incremental model is derived without a concrete mathematical system model. First, to reduce dependence on the nominal model of robot manipulators, the continuous-time nonlinear system model is approximated by an incremental system using the time-delay estimation (TDE). Then, based on the incremental system, the tracking IMPC is designed in the framework of MPC without terminal ingredients. Thus, compared with existing MPC methods, the nominal mathematical model is not required. Moreover, we investigate reachable reference trajectories and confirm the local input-to-state stability (ISS) of IMPC, considering the bounded TDE error as the disturbance of the incremental system. For reachable reference trajectories, the local ISS of IMPC is analyzed using the continuity of the value function, and the cumulative error bound is not overconservative. Finally, several real-time experiments are conducted to verify the effectiveness of IMPC. Experimental results show that the system can achieve optimal control performance while guaranteeing that input and state constraints are not violated.
27 February 2024 in IEEE Transactions on Robotics
This paper presents a model predictive control (MPC) method for redundant robots controlling multiple hierarchical tasks formulated as multi-layer constrained optimal control problems (OCPs). The proposed method, named hierarchical incremental MPC (HIMPC), is robust to dynamic uncertainties, untethered from kinematic/algorithmic singularities, and capable of handling input and state constraints such as joint torque and position limits. To this end, we first derive robust incremental systems that approximate uncertain system dynamics without computing complex nonlinear functions or identifying model parameters. Then the constrained OCPs are cast as quadratic programming problems which result in linear MPC, where dynamically-consistent task priority is achieved by deploying equality constraints and optimal control is attained under input and state constraints. Moreover, hierarchical feasibility and recursive feasibility are theoretically proven. Since the computational complexity of HIMPC drastically decreases compared with nonlinear MPC-based methods, it is implemented under the sampling frequency of 1 kHz for physical experiments with redundant manipulator setups, where robustness (high tracking accuracy and enhanced dynamic consistency), admissibility of multiple constraints, and singularity-avoidance nature are demonstrated and compared with state-of-the-art task-prioritized controllers.
23 September 2024 in IEEE/ASME Transactions on Mechatronics
The learning inefficiency of reinforcement learning (RL) from scratch hinders its practical application toward continuous robotic tracking control, especially for high-dimensional robots. This article proposes a data-informed residual reinforcement learning (DR-RL)-based robotic tracking control scheme applicable to robots with high dimensionality. The proposed DR-RL methodology outperforms common RL methods regarding sample efficiency and scalability. Specifically, we first decouple the original robot into low-dimensional robotic subsystems; and further utilize one-step backward data to construct incremental subsystems that are equivalent model-free representations of the aforementioned decoupled robotic subsystems. The formulated incremental subsystems allow for parallel learning to relieve computation load and offer us mathematical descriptions of robotic movements for conducting theoretical analysis. Then, we apply DR-RL to learn the tracking control policy, a combination of incremental base policy and incremental residual policy, under a parallel learning architecture. The incremental residual policy uses the guidance from the incremental base policy as the learning initialization and further learns from interactions with environments to endow the tracking control policy with adaptability toward dynamically changing environments. Our proposed DR-RL-based tracking control scheme is developed with rigorous theoretical analysis of system stability and weight convergence. The effectiveness of our proposed method is validated numerically on a 7-DoF KUKA iiwa robot manipulator and experimentally on a 3-DoF robot manipulator that would fail for other counterpart RL methods.