In this paper, event-triggered reinforcement learning-based adaptive tracking control is developed for the continuous-time nonlinear system with unknown dynamics and external disturbances. The critic and action neural networks are designed to approximate an unknown long-term performance index and controller, respectively. The dead-zone event-triggered condition is developed to reduce communication and computational costs. Rigorous theoretical analysis is provided to show that the closed-loop system can be stabilized. The weight errors and the filtered tracking error are all uniformly ultimately bounded. Finally, to demonstrate the developed controller, the simulation results are provided using an autonomous underwater vehicle model.

In this work, pursuit-evasion (PE) games with marine surface vessels (MSVs) as pursuers are solved while considering velocity constraints and unknown dynamics simultaneously. Differentiable performance index functions are designed for PE games based on minimum and maximum approximation functions. Then, we can obtain the desired pursuit velocities for MSVs satisfying velocity constraints and evasion strategies by applying game theory. Neural networks (NNs) are established to approximate unknown dynamics, which is suitable to design NN-based control to ensure that all velocities of MSVs converge to their desired ones. Through rigorous Lyapunov analyses, it can be guaranteed that all convergence and weight errors are uniformly ultimately bounded. Simulation results and comparison with known dynamics are provided and analyzed, which show that the proposed NN-based PE game is effective for MSVs with velocity constraints and unknown dynamics.

In this article, a synchronous reinforcement-learning-based algorithm is developed for input-constrained partially unknown systems. The proposed control also alleviates the need for an initial stabilizing control. A first-order robust exact differentiator is employed to approximate unknown drift dynamics. Critic, actor, and disturbance neural networks (NNs) are established to approximate the value function, the control policy, and the disturbance policy, respectively. The Hamilton-Jacobi-Isaacs equation is solved by applying the value function approximation technique. The stability of the closed-loop system can be ensured. The state and weight errors of the three NNs are all uniformly ultimately bounded. Finally, the simulation results are provided to verify the effectiveness of the proposed method.

This article develops a self-triggered adaptive neural network (NN) tracking controller for a class of continuous-time nonlinear systems, that is, input constrained and with unknown drift and input dynamics. Since the drift and input dynamics are both unknown, an NN is built within a self-triggered update paradigm to approximate the unknown tracking control. The error derivative used in the weight update algorithm is derived using a robust exact differentiator technique. To address input constraints, an auxiliary compensator is designed for the unimplemented control effort. Through rigorous Lyapunov analyses, we can guarantee that all the tracking and weight errors are uniformly ultimately bounded. Finally, to show the effectiveness of the proposed control performance, simulation results of a two-link robot are provided and analyzed.