A data-driven distributed formation control algorithm is proposed for an unknown heterogeneous non-affine nonlinear discrete-time MIMO multi-agent system (MAS) with sensor fault. For the considered unknown MAS, the dynamic linearization technique in model-free adaptive control (MFAC) theory is used to transform the unknown MAS into an equivalent virtual dynamic linearization data model. Then using the virtual data model, the structure of the distributed model-free adaptive controller is constructed. For the incorrect signal measurements due to the sensor fault, the radial basis function neural network (RBFNN) is first trained for the MAS under the fault-free case, then using the outputs of the well-trained RBFNN and the actual outputs of MAS under sensor fault case, the estimation laws of the unknown fault and system parameters in the virtual data model are designed with only the measured input-output (I/O) data information. Finally, the boundedness of the formation error is analyzed by the contraction mapping method and mathematical induction method. The effectiveness of the proposed algorithm is illustrated by simulation examples.

In this article, a model-free adaptive control (MFAC) algorithm based on full form dynamic linearization (FFDL) data model is presented for a class of unknown multi-input multi-output (MIMO) nonaffine nonlinear discrete-time learning systems. A virtual equivalent data model in the input-output sense to the considered plant is established first by using the FFDL technology. Then, using the obtained data model, a data-driven MFAC algorithm is designed merely using the inputs and outputs data of the closed-loop learning system. The theoretical analysis of the monotonic convergence of the tracking error dynamics, the bounded-input bounded-output (BIBO) stability, and the internal stability of the closed-loop learning system is rigorously proved by the contraction mapping principle. The effectiveness of the proposed control algorithm is verified by a simulation and a quad-rotor aircraft experimental system.

To improve the upright balancing performance of the two-wheeled self-balancing car, this paper proposes an attitude estimation algorithm based on fuzzy Kalman filtering. Fuzzy logic is used to correct the inclination angle and angular velocity of the two-wheeled self-balancing car, thereby optimizing the state of the Kalman filter and ultimately improving the balancing performance of the car. This paper combines dual closed-loop PID control with the complementary filtering algorithm, Kalman filtering algorithm, and fuzzy Kalman filtering algorithm to conduct experiments on a physical two-wheeled self-balancing car. The experimental results validate the superiority of the fuzzy Kalman filtering algorithm proposed in this paper for improving the upright balancing performance of the two-wheeled self-balancing car.

Urban traffic management is highly complex, and inefficient control strategies often worsen congestion and increase energy consumption. This paper introduces a collaborative multi-agent reinforcement learning method tailored for sparse control scenarios, IKS-SAC (Improved Knowledge Sharing Soft Actor–Critic), which enhances coordination between traffic signals to optimize traffic flow. IKS-SAC incorporates a communication protocol for knowledge sharing among agents, enabling each agent to access and utilize traffic environment data collected by other agents, effectively addressing the challenge of data processing in asynchronous updates, thereby achieving a comprehensive understanding of the traffic environment within a sparse control framework. Validation of the synthetic data demonstrates that IKS-SAC exhibits superior adaptability and efficiency in managing traffic flow fluctuations and uncertainties, significantly outperforming existing reinforcement learning-based and traditional traffic control methods. The proposed method demonstrates significant advantages in reducing traffic congestion, lowering energy consumption, and mitigating environmental pollution.

In this paper, a distributed secure change control scheme for supply chain systems is presented under denial-of-service (DoS) attacks. To eliminate the effect of DoS attacks on supply chain systems, a secure change compensation is designed. A distributed policy iteration method is established to approximate the coupled Hamilton–Jacobi–Isaacs (HJI) equations. Based on the established reinforce–critic–actor (RCA) structure using reinforcement learning (RL), the reinforced signals, performance indicators, and disturbance input are proposed to update the traditional time-triggered mechanism, and the control input is proposed to update the dynamic event-triggered mechanism (DETM). Stability is guaranteed based on the Lyapunov method under secure change control. The simulation results for supply chain systems show the effectiveness of the secure change control scheme and verify the results.

This paper studies the containment control problem of heterogeneous multi-agent systems (MASs) with multiple leaders. The follower agent dynamics are assumed to be unknown and nonlinear. First, each follower is transformed into an incremental data description based on the dynamic linearization technique. Then, a distributed model-free adaptive containment control law is proposed such that all followers will be driven into the convex hull of the leaders. Furthermore, the algorithm is extended to the time-switching and dynamic leaders case. As a data-driven approach, the proposed controller design uses only the received input and output (I/O) data of these agents rather than agent mathematical models. Finally, to test the potential in real applications, three representative examples considering various environment factors, including external disturbances, are simulated to show the effectiveness and resilience of this method.