This paper presents a model-free solution to the robust stabilization problem of discrete-time linear dynamical systems with bounded and mismatched uncertainty. An optimal controller design method is derived to solve the robust control problem, which results in solving an algebraic Riccati equation (ARE). It is shown that the optimal controller obtained by solving the ARE can robustly stabilize the uncertain system. To develop a model-free solution to the translated ARE, off-policy reinforcement learning (RL) is employed to solve the problem in hand without the requirement of system dynamics. In addition, the comparisons between on- and off-policy RL methods are presented regarding the robustness to probing noise and the dependence on system dynamics. Finally, a simulation example is carried out to validate the efficacy of the presented off-policy RL approach.
13 September 2022 in IEEE Transactions on Intelligent Transportation Systems
Realistic and diverse simulation scenarios with reactive and feasible agent behaviors can be used for validation and verification of self-driving system performance without relying on expensive and time-consuming real-world testing. Existing simulators rely on heuristic-based behavior models for background vehicles, which cannot capture the complex interactive behaviors in real-world scenarios. Meanwhile, existing learning-based methods are typical insufficient, yielding behaviors of traffic participants that frequently collide or drive off the road especially for a long horizon. To address this issue, we propose TrajGen, a two-stage trajectory generation framework, which can capture more realistic and diverse behaviors directly from human demonstration. In particular, TrajGen consists of the multi-modal trajectory prediction stage and the reinforcement learning based trajectory modification stage. In the first stage, we propose a novel auxiliary RouteLoss for the trajectory prediction model to generate multi-modal diverse trajectories in the drivable area. In the second stage, reinforcement learning is used to track the predicted trajectories while avoiding collisions, which can improve the reactivity and feasibility of generated trajectories. In addition, we develop a simulator I-Sim that can provide support for data-driven agent behavior simulation and train reinforcement learning models in parallel based on naturalistic driving data. The vehicle model in I-Sim can guarantee that the generated trajectories by TrajGen satisfy vehicle kinematic constraints. Finally, we give comprehensive metrics to evaluate generated trajectories for simulation scenarios, which shows that TrajGen outperforms either trajectory prediction or inverse reinforcement learning in terms of fidelity, reactivity, feasibility, and diversity.
8 September 2020 in IEEE Transactions on Fuzzy Systems
This article is concerned with the design of robust resilient control strategy for nonlinear systems under Denial-of-Service (DoS) attacks. First, Takagi–Sugeno fuzzy model is employed to approximate the nonlinear dynamics, and an improved sensor system is constructed by fuzzy observer and fuzzy predictor. By applying periodic event-triggered control strategy, the relationship between the estimated state and predicted state is obtained by event-triggering mechanism, which can reduce transmission attempts significantly in the sensor-to-controller channel. Second, caused by DoS attacks, the transmission attempts may be denied over the communication network. Under the proposed transmission policy with a bounded update period, input-to-state stability (ISS) of closed-loop systems can be guaranteed. Moreover, the maximum frequency and duration of DoS attacks are calculated. Finally, simulation results are provided to show the effectiveness of the proposed method.
30 July 2021 in International Journal of Robust and Nonlinear Control
This article focuses on developing a static output feedback (SOF) control scheme for Takagi–Sugeno fuzzy systems. The proposed SOF controller does not share the same premise membership functions with the model, which permits enhancing the flexibility in controller design and implementation. By contrast with the state feedback case, the SOF control generally results in nonconvex design conditions. To circumvent this problem, we develop a successive convex optimization algorithm, which is based on solving a sequence of more tractable convex optimization problems obtained by approximating the nonconvex constraints with some convex ones. As a heuristic algorithm, the validity of the developed successive convex optimization algorithm is highly affected by initial conditions, and, recognizing this, we put forward an iterative procedure for determining the feasible initial condition. Finally, two illustrative examples are presented to validate the efficiency of the proposed algorithms.
4 January 2023 in IEEE Transactions on Control of Network Systems
This paper investigates the problem of the fixed-time secure cooperative control for a class of nonlinear cyber-physical systems (CPSs) under denial-of-service (DoS) attacks. First of all, an event-based data transmission scheme is proposed to solve the fixed-time secure leader-following consensus in the occurrence of connective-preserved DoS attacks. Besides, a novel measurement error is developed to avoid Zeno behavior. However, the initial communication topology may inevitably be disconnected by malicious adversaries. To solve this difficulty, a new fixed-time secure observer is designed to estimate the leader information. Moreover, a self-triggered control strategy is proposed, which not only avoids the continuous communication but also restores the secure leader-following consensus subject to connective-preserved/broken DoS attacks. Then the characteristic of the allowable connective-preserved/broken DoS attacks can be obtained. Finally, simulation results show the effectiveness of the proposed method.