Fueled by recent advances in deep neural networks, reinforcement learning (RL) has been in the limelight because of many recent breakthroughs in artificial intelligence, including defeating humans in games (e.g., chess, Go, StarCraft), self-driving cars, smart-home automation, and service robots, among many others. Despite these remarkable achievements, many basic tasks can still elude a single RL agent. Examples abound, from multiplayer games, multirobots, cellular-antenna tilt control, traffic-control systems, and smart power grids to network management.
4 December 2018 in IEEE Transactions on Automatic Control
Recently, reinforcement learning (RL) is getting significant attentions due to its successful demonstrations outperforming humans in certain tasks. The goal of this paper is to study a new optimization formulation of the linear quadratic regulator (LQR) problem via the Lagrangian duality theories in order to lay theoretical foundations of potentially effective RL algorithms. The new optimization problem includes the Q-function parameters so that it can be directly used to develop Q-learning algorithms, known to be one of the most popular RL algorithms. We prove relations between saddle-points of the Lagrangian function and the optimal solutions of the Bellman equation. As an example of its applications, we propose a model-free primal-dual Q-learning algorithm to solve the LQR problem and demonstrate its validity through examples.
In this paper, a new linear matrix inequality-based model predictive control (MPC) problem is studied for discrete-time nonlinear systems described as Takagi-Sugeno fuzzy systems. A recent local stability approach is applied to improve the performance of the proposed MPC scheme. At each time k, an optimal state-feedback gain that minimizes an objective function is obtained by solving a semidefinite programming problem. The local stability analysis, the estimation of the domain of attraction, and feasibility of the proposed MPC are proved. Examples are given to demonstrate the advantages of the suggested MPC over existing approaches.
23 May 2015 in International Journal of Control, Automation, and Systems