21 December 2016 in IEEE Transactions on Circuits and Systems II: Express Briefs
This brief is concerned with the control problem for discrete-time networked control systems. It is assumed that state and control signals transmit through an unreliable communication channel, where packet dropout and input delay occur simultaneously. The main contributions are twofold. First, we obtain the optimal LQR controller, which is a linear function of the optimal state estimator, with the feedback gain based on a standard difference Riccati equation. It is noted that the state estimator and the controller can be calculated separately. Second, a necessary and sufficient condition for the mean-square stabilization is derived. It should be stressed that the eigenvalues of the system matrix and the packet dropout probability determine the stabilizing condition, which is uncorrelated with input delay.
19 November 2018 in IEEE Transactions on Automatic Control
This paper considers the consensusability of multi-agent systems with delay and packet dropout. By proposing a kind of predictor-like protocol, sufficient and necessary conditions are given for the mean-square consensusability in terms of system matrices, time delay, communication graph and the packet drop probability. Moreover, sufficient and necessary conditions are also obtained for the formationability of multi-agent systems.
26 February 2020 in IEEE Transactions on Control of Network Systems
This paper considers the optimal control and stabilization problems for networked control systems (NCSs) with asymmetric information. In this NCSs model, the remote controller can receive packet-dropout states of the plant, and the available information for the embedded controller are observations of states and packet-dropout states sent from the remote controller. The two controllers operate the plant simultaneously to make the quadratic performance minimized and stabilize the linear plant. For the finite-horizon case, since states of the plant cannot be obtained perfectly, we develop the optimal estimators for the embedded and remote controllers based on asymmetric information respectively. Then we give the necessary and sufficient condition for the optimal control based on the solution to the forward-backward stochastic difference equations (FBSDEs). For the infinite-horizon case, it is shown that the system is bounded in the mean-square sense if and only if there exist the solutions to the two coupled algebraic Riccati equations and the packet-dropout probability satisfies certain condition. Numerical examples on the unmanned underwater vehicle are presented to show the effec
12 March 2021 in IEEE Transactions on Cybernetics
In this article, we study the feedback Nash strategy of the model-free nonzero-sum difference game. The main contribution is to present the $Q$ -learning algorithm for the linear quadratic game without prior knowledge of the system model. It is noted that the studied game is in finite horizon which is novel to the learning algorithms in the literature which are mostly for the infinite-horizon Nash strategy. The key is to characterize the $Q$ -factors in terms of the arbitrary control input and state information. A numerical example is given to verify the effectiveness of the proposed algorithm.
27 February 2023 in IEEE Transactions on Automatic Control
This paper considers the decentralized LQG control problem for discrete-time decentralized system controlled by two players. In this scenario, player 1 shares a unit delayed observations and control inputs with the controller of player 2, whereas due to the limiting capacity, the controller of player 1 cannot obtain the observations and control inputs of player 2 which leads to the asymmetric one-step delay information. It should be emphasized that this structure makes the classical separation principle fail. Under the assumption of linear control strategies, we derive the optimal estimators based on asymmetric information. In virtue of the Pontryagin's maximum principle, the optimal explicit decentralized controllers are obtained by solving the forward and backward stochastic difference equations (FBSDEs). It is noted that the control gains are coupled with the estimation gains. Moreover, the estimation gains satisfy the forward Riccati equations and the control gains follow the backward Riccati equations which cannot be solved simultaneously. To this end, we present iterative solutions to the coupled forward and backward Riccati equations. Finally, a sufficient condition for the stabilization problem is given in terms of the coupled algebraic Riccati equations. Numerical examples are illustrated to show the effectiveness of the proposed algorithm.
11 May 2021 in IEEE Transactions on Circuits and Systems II: Express Briefs
This brief studies the consensus problem for heterogeneous multi-agent systems subject to time-varying communication delays, intermittent observations and system noises. An internal reference model for switching and directed communication topologies is constructed to generate a common signal for all agents. Different from existing literatures that design observer to estimate each agent’s state, the optimal estimator in this brief is derived based on the intermittent observations. A sufficient condition is given for the mean-square consensus of the closed loop control systems. A simulation example is provided to illustrate the effectiveness of the proposed algorithm.