The optimal control issue of fast sampling singularly perturbed systems is discussed throughout this paper. As a new attempt, without using complete system dynamics, the composite controller is designed by using controller of the different subsystems along with the usage of the subsystem decomposition technique by means of singular perturbation theory. Compared with the existing policy iteration and value iteration algorithms, there is not an enforced requirement for a stabilizing control strategy and the increase in convergence speed is achieved by the proposed hybrid iteration algorithm. For the purpose of considering that the fast and slow subsystems have different characteristics, two hybrid iteration algorithms that can be applied in different situations are developed. Meanwhile, the difference between the given composite controller and the optimal controller is analyzed in detail. Finally, the validity of the proposed controller design method is demonstrated by an example.
2 January 2023 in IEEE Transactions on Circuits and Systems II: Express Briefs
The design of a suboptimal controller for continuous-time Markov jump singularly perturbed systems with partially unknown dynamics is studied in this paper. With fast and slow decomposition technique, the original Markov jump singularly perturbed systems are decomposed into fast and slow subsystems as a new attempt. On this basis, an offline parallel Kleinman algorithm and an online parallel integral reinforcement learning algorithm are presented to cope with the different subsystems, respectively. Meanwhile, the controllers obtained by the above two algorithms are used to design the suboptimal controllers for original systems. Furthermore, the suboptimality of the proposed controllers is also discussed. Finally, an example of the electric circuit model is shown to illustrate the applicability of the proposed method.