We propose an adaptive neural-network-based fault-tolerant control scheme for a flexible string considering the input constraint, actuator gain fault, and external disturbances. First, we utilize a radial basis function neural network to compensate for the actuator gain fault. In addition, an observer is used to handle composite disturbances, including unknown approximation errors and boundary disturbances. Then, an auxiliary system eliminates the effect of the input constraint. By integrating the composite disturbance observer and auxiliary system, adaptive fault-tolerant boundary control is achieved for an uncertain flexible string. Under rigorous Lyapunov stability analysis, the vibration scope of the flexible string is guaranteed to remain within a small compact set. Numerical simulations verify the high control performance of the proposed control scheme.

Limited computational resource is one of the features of the embedded system including unmanned marine surface vehicle (MSV). Under this practical constraint, we aim to develop a distributed formation control algorithm for a group of uncertain MSVs, whose computational burden is low. The uncertainty and disturbance estimator (UDE) is employed to compensate for the modeling uncertainties, the unknown environmental disturbances, and the unavailable derivative of the virtual control inputs, such that the formation errors converge asymptotically to zero. Meanwhile, the prescribed performance control technique is applied to ensure that the convergence rates of the formation errors are faster than predefined values. In addition, collision avoidance and connectivity preservation among the neighboring vehicles are guaranteed, while the obstacle avoidance is also ensured. As no parameter update law is required to calculate, the computational burden is reduced significantly. The effectiveness of the proposed UDE-based formation control algorithm is validated through comparative simulation.

This study focuses on an adaptive fault-tolerant boundary control (BC) for a flexible string (FS) in the presence of unknown external disturbances, dead zone, and actuator fault. To tackle these issues, by employing some transformations, a part of the unknown dead zone and external disturbance can be regarded as a composite disturbance. Subsequently, an adaptive fault-tolerant BC is developed by utilizing strict formula derivations to compensate for unknown composite disturbance, dead zone, and actuator fault in the FS system. Under the proposed control strategy, the closed-loop system proves to be uniformly ultimately bounded, and the vibration amplitude is guaranteed to converge ultimately to a small compact set by choosing suitable design parameters. Finally, a numerical simulation is performed to demonstrate the control performance of the proposed scheme.

Recently, with the development of the marine economy, marine risers have garnered increasing attention as they present facile and reliable methods for oil and gas transportation. However, these risers are susceptible to vibrations, which can lead to system performance degradation and fatigue damage. Therefore, effective vibration control strategies are required to address this issue. In this study, a novel adaptive fault-tolerant control (FTC) strategy is adopted to suppress the vibrations of a 3-D riser-vessel system against the effects of actuator failures, backlash-like hysteresis, and external disturbances. A barrier-based Lyapunov function is merged to eliminate the time-varying output constraints of the system. Adaptive FTC laws with projection mapping operators are designed to compensate for parameter uncertainties and consider input nonlinearities to improve system robustness. Finally, a rigorous Lyapunov analysis and numerical simulations are performed to verify the validity of the proposed controller and guarantee uniformly bounded stability of the system.

This study focuses on the novel reinforcement learning control strategy of a nonlinear two-degrees-of-freedom (2-DOF) helicopter system for tracking the desired trajectory while minimizing the tracking error. First, gradient descent algorithm is incorporated in the context of the reinforcement learning control scheme to obtain the adaptive laws. Subsequently, considering the uncertainties in the nonlinear system, radial basis function (RBF) neural networks (NNs) are exploited to approximate the unknown internal dynamics. In contrast to the previous studies, aiming at accelerating the convergence in reinforcement learning control, a barrier Lyapunov function is constructed to constrain the states to ensure that the tracking error rapidly converges to a neighborhood of zero. Under the proposed control strategy, the states of the closed-loop system are proven to be semi-globally uniformly ultimately bounded through rigorous Lyapunov analyses, and the state constraints are satisfied. Furthermore, the simulations and experiments conducted on a Quanser laboratory platform reveal that the proposed control functions are suitable and effective. Note to Practitioners —This paper is motivated by designing a reinforcement learning control strategy to enhance online learning capability and control performance of the controller for a nonlinear 2-DOF helicopter system. The control framework is divided into the design of the critic and actor NNs, responsible primarily for evaluating the control performance and approximating uncertainties in the system separately. Unlike the adaptive NN control, the actor NN weights are updated by combining information of states and inputs from the critic NN. In addition, aiming at accelerating the convergence, a barrier Lyapunov function is constructed to constrain the states to ensure that the tracking error rapidly converges to a neighborhood of zero. Finally, the proposed control strategy is validated in simulation and experiment on the Quanser laboratory platform.

With the rapid development of smart grids, the strategic behavior evolution in user-side electricity market transactions has become increasingly complex. To explore the dynamic evolution mechanisms in this area, this paper systematically reviews the application of evolutionary game theory in user-side electricity markets, focusing on its unique advantages in modeling multi-agent interactions and dynamic strategy optimization. While evolutionary game theory excels in explaining the formation of long-term stable strategies, it faces limitations when dealing with real-time dynamic changes and high-dimensional state spaces. Thus, this paper further investigates the integration of deep reinforcement learning, particularly the deep Q-learning network (DQN), with evolutionary game theory, aiming to enhance its adaptability in electricity market applications. The introduction of the DQN enables market participants to perform adaptive strategy optimization in rapidly changing environments, thereby more effectively responding to supply–demand fluctuations in electricity markets. Through simulations based on a multi-agent model, this study reveals the dynamic characteristics of strategy evolution under different market conditions, highlighting the changing interaction patterns among participants in complex market environments. In summary, this comprehensive review not only demonstrates the broad applicability of evolutionary game theory in user-side electricity markets but also extends its potential in real-time decision making through the integration of modern algorithms, providing new theoretical foundations and practical insights for future market optimization and policy formulation.