26 September 2022 in IEEE Transactions on Automatic Control
This paper presents a new approach to the problem of globally asymptotical stability for nonlinear impulsive systems by utilizing self-triggered impulsive control (STIC), where impulse instants are determined by a well-designed self-triggered mechanism (STM) which is based on the comparison approach. Different from event-triggered impulsive control (ETIC) strategy in which the triggering conditions need to be continuously or periodically monitored to determine whether an impulse should be generated, our proposed STIC strategy does not require those monitoring because it can utilize the measurable information to predict the next impulse instant. Based on the proposed STIC strategy, some Lyapunov-based sufficient conditions for globally asymptotical stability are derived by adopting the comparison approach. Moreover, we prove that the Zeno behavior can be excluded from our results. Specifically, we apply the theoretical results to resolve the STIC problem for a class of nonlinear systems, where two different cases are fully considered, that is, state-based STIC and output-based STIC. For each case, the design method of STIC strategy is given in terms of linear matrix inequalities (LMIs). The effectiveness of the proposed methods is verified by two numerical examples and their simulations.
2 May 2025 in IEEE Transactions on Cybernetics
This article investigates the pursuit-evasion games for target capture in multiagent systems. To address this challenge, a novel data-driven optimal control policy is proposed, leveraging off-policy reinforcement learning and Nash-minmax strategies. First, a comprehensive framework for multiagent pursuit-evasion games is developed, modeled as a two-layer game structure. In this framework, interactions among agents within the same team are characterized as nonzero-sum games, while interactions between opposing teams are adversarial and treated as zero-sum games. Second, Nash-minmax strategies are introduced to solve the formulated multiagent pursuit-evasion games. These strategies effectively derive distributed Nash solutions for agents within the same team and adversarial worst-case policies for agents in opposing teams. Furthermore, to eliminate the reliance on prior knowledge of agent dynamics and initial stabilizing control gains, a data-driven optimal control policy is designed, ensuring the achievement of target capture. Finally, a numerical example is provided to demonstrate the effectiveness and practical applicability of the proposed approach.
29 October 2024 in IEEE Transactions on Control of Network Systems
This paper introduces a novel distributed control protocol to address the problem of output group formation tracking for heterogeneous multi-agent systems (MASs). In contrast to the existing group formation control protocols that rely on the system matrices, our approach leverages input-state data to design the optimal control gains in the framework of off-policy reinforcement learning (RL). Specifically, an event-triggered distributed consensus estimator is proposed to estimate the leaders' system matrices and the convex hulls spanned by the leaders while ensuring the exclusion of Zeno behavior. Based on the proposed estimator, we establish an approximate optimal distributed control protocol for each follower to achieve output group formation tracking, which can be solved by the designed data-driven policy iteration (PI) algorithm. Finally, a numerical example is provided to show the efficacy of the proposed control approach.
7 January 2025 in IEEE Transactions on Systems, Man, and Cybernetics: Systems
This article investigates the optimal group consensus problem (GCP) in multiagent systems (MASs). To address this problem, a novel distributed optimal control policy is designed in the framework of off-policy reinforcement learning (RL). First, a framework for multiagent differential graphical games is formulated. Second, a min-max strategy is then introduced to ensure the achievement of group consensus through a data-driven value iteration (VI) approach. Finally, the presented consensus control policy is extended to address the group formation tracking problem (GFTP) of nonholonomic mobile robots, with a numerical example to illustrate the efficacy of the proposed results. Compared with the existing literature, this article has the following contributions: 1) A group of agents are decomposed into multiple subgroups to accomplish different consensus objectives; 2) the prior knowledge of agents’ dynamics and initial stabilizing control gains can be eliminated; and 3) the performance index function (PIF) for each agent is designed to integrate not only its individual control policy but also that of its neighboring agents.
24 December 2024 in IEEE/CAA Journal of Automatica Sinica
Dear Editor, This letter is concerned with the problem of time-varying formation tracking for heterogeneous multi-agent systems (MASs) under directed switching networks. For this purpose, our first step is to present some sufficient conditions for the exponential stability of a particular category of switched systems. Then, we apply the theoretical results to design a distributed observer for reference leader under directed switching topologies. Based on the above designed observer, a novel event-triggered distributed control protocol is proposed for each follower to achieve the desired formation. Finally, we demonstrate the effectiveness of our proposed results through numerical simulations.
16 June 2025 in IEEE Control Systems Letters
This study investigates the robust stability of uncertain interval systems subject to impulsive effects, with comprehensive consideration given to uncertainties in both the system dynamics and the impulse time sequence. A novel interval matrices method is proposed, and techniques that decouple uncertainties in system dynamics are developed. These approaches establish dwell-time-based conditions to ensure the global asymptotic stability of interval systems, accommodating scenarios involving both stabilizing and destabilizing impulses. A numerical example is presented to illustrate the validity and effectiveness of the theoretical results.