1 April 2020 in IEEE Transactions on Cybernetics
In this article, a novel distributed policy iteration algorithm is established for infinite horizon optimal control problems of continuous-time nonlinear systems. In each iteration of the developed distributed policy iteration algorithm, only one controller’s control law is updated and the other controllers’ control laws remain unchanged. The main contribution of the present algorithm is to improve the iterative control law one by one, instead of updating all the control laws in each iteration of the traditional policy iteration algorithms, which effectively releases the computational burden in each iteration. The properties of distributed policy iteration algorithm for continuous-time nonlinear systems are analyzed. The admissibility of the present methods has also been analyzed. Monotonicity, convergence, and optimality have been discussed, which show that the iterative value function is nonincreasingly convergent to the solution of the Hamilton–Jacobi–Bellman equation. Finally, numerical simulations are conducted to illustrate the effectiveness of the proposed method.
4 July 2023 in IEEE Transactions on Automation Science and Engineering
This paper presents a novel data-driven optimal output cluster synchronization control method for heterogeneous multi-agent systems with disturbances based on adaptive dynamic programming. Traditional cluster synchronization control methods require the information of system matrices, which limit the application scope in the reality. In order to solve this problem, a novel data-driven optimal control method is presented, where the input-state data is utilized without the information of system matrices of state equations, to realize the output cluster synchronization of multi-agent systems. The major contributions are displayed as follows: 1) a novel data-driven optimal output cluster synchronization control method is presented which requires the input-state data of multi-agent systems; 2) a novel distributed adaptive observer is designed which can avoid the effects of negative edge weights between the clusters; 3) the output cluster synchronization control problem is transformed into the output regulation problem, and adaptive dynamic programming method is presented which can realize the disturbance rejection. First, the output cluster synchronization control problem is formulated. Next, a novel optimal output cluster synchronization control method is presented based on distributed adaptive observer and adaptive dynamic programming. Numerical experiment shows the good performance of the presented method. Note to Practitioners —Most of the existing cluster synchronization control methods require the information of system matrices. However, it is hard to obtain the accurate system models in the reality, which limits the application scope of the existing methods. On the other hand, the disturbances in practice make the effective cluster synchronization control of multi-agent systems very challenging. Aiming at the above problems, this paper designs novel data-driven optimal control laws for heterogeneous multi-agent systems with disturbances to realize the output cluster synchronization. A novel distributed adaptive observer is designed to estimate the states and system matrices of leaders. Then, the adaptive dynamic programming method is presented to obtain the optimal control law of each agent based on the estimated information. Comparative experiment is provided to show the good performance of the presented method.
6 December 2022 in IEEE Transactions on Systems, Man, and Cybernetics: Systems
This article presents a novel data-based fault-tolerant control method for multicontroller linear systems via distributed policy iteration. The traditional fault-tolerant control methods based on policy iteration may cause a huge-computational burden under the situation of high-dimension control laws. In order to solve this problem, a novel distributed policy iteration method is presented, where only one iterative control law is updated in each iteration, to realize the fault-tolerant control of multicontroller linear systems. The main contributions can be highlighted as follows: 1) a novel data-based distributed policy iteration method is presented to reduce the computational burden; 2) the fault-tolerant control method is presented via designing fault compensators; and 3) the developed data-based method only requires the partial system information. First, the model-based fault-tolerant control via distributed policy iteration and fault compensation is provided. Based on the model-based method, a data-based fault-tolerant control method is presented. Finally, numerical experiments are given to show the performance of the presented method.
20 May 2022 in Frontiers of Information Technology & Electronic Engineering
This paper presents a novel optimal synchronization control method for multi-agent systems with input saturation. The multi-agent game theory is introduced
1 December 2021 in IEEE Transactions on Cybernetics
In this article, a novel linear parallel control method is developed for output regulation problems with disturbances. The traditional feedback regulators are passive regulation methods. In order to solve this problem, the parallel controllers are presented, where the time variation of the control is constructed instead of the control value itself, to stabilize the output of the system. The main contributions of the developed method include two aspects: 1) a novel parallel regulator structure is presented, which can provide greater flexibility comparing with traditional methods and 2) the necessary and sufficient conditions for the existence of parallel regulators are analyzed. First, the structure of the linear parallel regulators is provided. Next, considering the situations that the full system information is obtained and the information of error is obtained, respectively, the properties of the parallel regulators are analyzed, and the regulator designs for the two situations are provided. Finally, numerical examples are provided to verify the correctness of the present method.
18 March 2024 in IEEE Transactions on Cybernetics
In this article, the problem of inferring unknown isoperimetric constraints is considered given optimal state and control trajectories that solve the optimal control problem with isoperimetric constraints. By exploiting Pontryagin’s principle, the recovery equations for unknown isoperimetric constraints are established. Under verifiable dimensionality condition and matrix rank condition, the proposed method is guaranteed to infer the unknown isoperimetric constraints exactly. Furthermore, the proposed method is extended to multiple trajectory setting. Finally, the effectiveness of the proposed method is illustrated by two simulation examples with various settings.