1 April 2015 in Aerospace Science and Technology
1 June 2021 in Applied Energy
7 July 2020 in IEEE Transactions on Systems, Man, and Cybernetics: Systems
This article addresses the tracking control problem for a class of nonlinear systems described by Euler-Lagrange equations with uncertain system parameters. The proposed control scheme is capable of guaranteeing prescribed performance from two aspects: 1) a special parameter estimator with prescribed-performance properties is embedded in the control scheme. The estimator not only ensures the exponential convergence of the estimation errors under relaxed excitation conditions but also can restrict all estimates to predetermined bounds during the whole estimation process and 2) the proposed controller can strictly guarantee the user-defined performance specifications on tracking errors, including convergence rate, maximum overshoot, and residual set. More importantly, it has the optimizing ability for the tradeoff between performance and control cost. A state transformation method is employed to transform the constrained optimal tracking control problem to an unconstrained stationary optimal problem. Then, a critic-only adaptive dynamic programming algorithm is designed to approximate the solution of the Hamilton-Jacobi-Bellman equation and the corresponding optimal control policy. Uniformly ultimately bounded stability is guaranteed via a Lyapunov-based stability analysis. Finally, numerical simulation results demonstrate the effectiveness of the proposed control scheme.
15 July 2020 in IEEE Transactions on Control Systems Technology
This article addresses the attitude reorientation problems of rigid bodies under multiple state constraints. A novel reinforcement learning (RL)-based approximate optimal control method is proposed to make the tradeoff between control cost and performance. The novelty lies in that it guarantees constraint handling abilities on attitude forbidden zones and angular velocity limits. To achieve this, barrier functions are employed to encode the constraint information into the cost function. Then, an RL-based learning strategy is developed to approximate the optimal cost function and control policy. A simplified critic-only neural network (NN) is employed to replace the conventional actor-critic structure once adequate data are collected online. This design guarantees the uniform boundedness of reorientation errors and NN weight estimation errors subject to the satisfaction of a finite excitation condition, which is a relaxation compared with the persistent excitation condition that is typically required for this class of problems. More importantly, all underlying state constraints are strictly obeyed during the online learning process. The effectiveness and advantages of the proposed controller are verified by both numerical simulations and experimental tests based on a comprehensive hardware-in-loop testbed.
27 March 2024 in IEEE Transactions on Control Systems Technology
This work proposes an innovative path-following control method, anchored in deep reinforcement learning (DRL), for unmanned underwater vehicles (UUVs). This approach is driven by several new designs, all of which aim to enhance learning efficiency and effectiveness and achieve high-performance UUV control. Specifically, a novel experience replay strategy is designed and integrated within the twin-delayed deep deterministic policy gradient algorithm (TD3). It distinguishes the significance of stored transitions by making a trade-off between rewards and temporal-difference (TD) errors, thus enabling the UUV agent to explore optimal control policies more efficiently. Another major challenge within this control problem arises from action oscillations associated with DRL policies. This issue leads to excessive system wear on actuators and makes real-time application difficult. To mitigate this challenge, a newly improved regularization method is proposed, which provides a moderate level of smoothness to the control policy. Furthermore, a dynamic reward function featuring adaptive constraints is designed to avoid unproductive exploration and expedite learning convergence speed further. Simulation results show that our method garners higher rewards in fewer training episodes compared with mainstream DRL-based control approaches (e.g., deep deterministic policy gradient (DDPG) and vanilla TD3) in UUV applications. Moreover, it can adapt to varying path configurations amid uncertainties and disturbances, all while ensuring high tracking accuracy. Simulation and experimental studies are conducted to verify the effectiveness.
7 June 2022 in Progress in Energy
Wind power plays a vital role in the global effort towards net zero. A recent figure shows that 93GW new wind capacity was installed worldwide in 2020, leading to a 53% year-on-year increase. The control system is the core of wind farm operations and has an essential influence on the farm’s power capture efficiency, economic profitability, and operation and maintenance cost. However, the inherent system complexities of wind farms and the aerodynamic interactions among wind turbines cause significant barriers to control system design. The wind industry has recognized that new technologies are needed to handle wind farm control tasks, especially for large-scale offshore wind farms. This paper provides a comprehensive review of the development and most recent advances in wind farm control technologies. It covers the introduction of fundamental aspects of wind farm control in terms of system modeling, main challenges and control objectives. Existing wind farm control methods for different purposes, including layout optimization, power generation maximization, fatigue load minimization and power reference tracking, are investigated. Moreover, a detailed discussion regarding the differences and similarities between model-based, model-free and data-driven wind farm approaches is presented. In addition, we highlight state-of-the-art wind farm control technologies based on reinforcement learning—a booming machine learning technique that has drawn worldwide attention. Future challenges and research avenues in wind farm control are also analyzed.