6 March 2023 in IEEE Transactions on Automatic Control
We consider estimation and control in linear dynamical systems from the perspective of regret minimization. Unlike most prior work in this area, we focus on the problem of designing causal state estimators and causal controllers which compete against a clairvoyant noncausal policy, instead of the best policy selected in hindsight from some fixed parametric class. We show that regret-optimal filters and regret-optimal controllers can be derived in state-space form using operator-theoretic techniques from robust control. Our results can be viewed as extending traditional robust estimation and control, which focuses on minimizing worst-case cost, to minimizing worst-case regret. We propose regret-optimal analogs of Model-Predictive Control (MPC) and the Extended Kalman Filter (EKF) for systems with nonlinear dynamics and present numerical experiments which show that these algorithms can significantly outperform standard approaches to estimation and control.
2 November 2022 in IEEE Transactions on Automatic Control
We consider control from the perspective of competitive analysis. Unlike much prior work on learning-based control, which focuses on minimizing regret against the best controller selected in hindsight from some specific class, we focus on designing an online controller which competes against a clairvoyant offline optimal controller. A natural performance metric in this setting is competitive ratio, which is the ratio between the cost incurred by the online controller and the cost incurred by the offline optimal controller. Using operator-theoretic techniques from robust control, we derive a computationally efficient state-space description of the the controller with optimal competitive ratio in both finite-horizon and infinite-horizon settings. We extend competitive control to nonlinear systems using Model Predictive Control (MPC) and present numerical experiments which show that our competitive controller can significantly outperform standard $H_{2}$ and $H_{\infty }$ controllers in the MPC setting.
16 November 2009 in IET Systems Biology
Parameter estimation is the main bottleneck of metabolic pathway modelling. It may be addressed from the bottom up, using information on metabolites, enzymes and modulators, or from the top down, using metabolic time series data, which have become more prevalent in recent years. The authors propose here that it is useful to combine the two strategies and to complement time-series analysis with kinetic information. In particular, the authors investigate how the recent method of dynamic flux estimation (DFE) may be supplemented with other types of estimation. Using the glycolytic pathway in Lactococcus lactis as an illustration example, the authors demonstrate some strategies of such supplementation.