This paper proposes a deep reinforcement learning (DRL) method that combines random network distillation (RND) and long short-term memory (LSTM) to address the tracking control problem, while leveraging the inherent symmetry in robotic arm movements to eliminate the need for learning or knowing the system’s dynamic model. In general, the complexity and strong coupling of robotic manipulators make trajectory tracking extremely challenging. Firstly, the prediction network and fixed network are jointly trained using the RND method. The difference in output values between the two networks acts as an internal reward for the robotic manipulator environment. This internal reward mechanism encourages the robotic arm agent to actively explore unpredictable and unknown environmental states, thereby consequently boosting the performance and efficiency of the tracking control for the robotic manipulator. Then, the Soft Actor-Critic (SAC) algorithm, the LSTM network, and the attention mechanism are integrated to resolve the instability problem during training and acquire a stable policy. The LSTM model effectively captures the symmetry and temporal changes in joint angles, while the attention mechanism dynamically prioritizes important features, thereby reducing the instability of the robotic manipulator during tracking tasks and enhancing feature extraction efficiency. The simulation outcomes demonstrate that the proposed method effectively performs the robot tracking task, confirming the efficacy and efficiency of the DRL algorithm.

In this paper, a deep reinforcement learning (DRL) approach based on generative adversarial imitation learning (GAIL) and long short-term memory (LSTM) is proposed to resolve tracking control problems for robotic manipulators with saturation constraints and random disturbances, without learning the dynamic and kinematic model of the manipulator. Specifically, it limits the torque and joint angle to a certain range. Firstly, in order to cope with the instability problem during training and obtain a stability policy, soft actor–critic (SAC) and LSTM are combined. The changing trends of joint position over time are more comprehensively captured and understood by employing an LSTM architecture designed for robotic manipulator systems, thereby reducing instability during the training of robotic manipulators for tracking control tasks. Secondly, the obtained policy by SAC-LSTM is used as expert data for GAIL to learn a better control policy. This SAC-LSTM-GAIL (SL-GAIL) algorithm does not need to spend time exploring unknown environments and directly learns the control strategy from stable expert data. Finally, it is demonstrated by the simulation results that the end effector of the robot tracking task is effectively accomplished by the proposed SL-GAIL algorithm, and more superior stability is exhibited in a test environment with interference compared with other algorithms.

In this study, tracking control and saturation nonlinearities problems of a flexible mobile vehicle-manipulator with disturbance uncertainty are investigated. Based on differential equations model, a novel iterative learning control (ILC) algorithm is designed, where two saturation functions and two hyperbolic tangent functions are developed to deal with actuator saturation constraint and an adaptive law is developed to reduce the impact of disturbance uncertainty. With the ILC algorithm, the target of tracking control and vibration attenuation of mobile manipulator can come true. Simulations are executed to verify the effectiveness of designed algorithm.

This paper investigates the stabilization and trajectory tracking problem of wheeled mobile robot with a ceiling-mounted camera in complex environment. First, an adaptive visual servoing controller is proposed based on the uncalibrated kinematic model due to the complex operation environment. Then, an adaptive controller is derived to provide a solution of uncertain dynamic control for a wheeled mobile robot subject to parametric uncertainties. Furthermore, the proposed controllers can be applied to a more general situation where the parallelism requirement between the image plane and operation plane is no more needed. The overparameterization of regressor matrices is avoided by exploring the structure of the camera-robot system, and thus, the computational complexity of the controller can be simplified. The Lyapunov method is employed to testify the stability of a closed-loop system. Finally, simulation results are presented to demonstrate the performance of the suggested control.

In order to solve the position tracking control, vibration restraint, and complex input-state constraints problems in the actual operation process of a type of flexible vehicle-based arm system with nonlinear input constraint, time-variant state constraint, uncertain parameters, and uncertain perturbations, an effective boundary control strategy based on backstepping technique, adaptive neural network, and observer technique is put forward in this paper. First, a novel continuous, smooth, and monotonic function is to describe actuator saturation nonlinearity, which can avoid chattering efficiently. Second, potential security issue caused by limited system space is considered and described as a non-linear time-variant state constraint issue, and barrier Lyapunov function (BLF) is used to make certain that time-variant constraint is satisfied. Applying backstepping technology, an adaptive neural network control strategy is constructed to deal with the system parameter uncertainty and saturation nonlinear errors, and perturbation observers are employed to deal with perturbations uncertainty. Finally, system stabilization based on Lyapunov’s method and simulations based on Matlab show the validity of constructed control strategy.

This paper involves a novel adaptive control approach of a flexible wing system with hysteresis nonlinearity. The usual control design strategies based on the ordinary differential equations (ODEs) are inapplicable due to the flexible wing system described in the partial differential equations (PDEs), and the design of the control algorithm becomes highly intricate. Firstly, the inverse dynamic model of hysteresis is introduced to compensate for the hysteresis nonlinearity. Considering the unknown external disturbances, an adaptive technique is utilized for compensation. Then, the direct Lyapunov approach is employed to prove the bounded stability of the system. Lastly, the effectiveness of the proposed approach is validated via simulation results.