10 July 2019 in IEEE Transactions on Robotics
This paper presents an active learning strategy for robotic systems that takes into account task information, enables fast learning, and allows control to be readily synthesized by taking advantage of the Koopman operator representation. We first motivate the use of representing nonlinear systems as linear Koopman operator systems by illustrating the improved model-based control performance with an actuated Van der Pol system. Information-theoretic methods are then applied to the Koopman operator formulation of dynamical systems where we derive a controller for active learning of robot dynamics. The active learning controller is shown to increase the rate of information about the Koopman operator. In addition, our active learning controller can readily incorporate policies built on the Koopman dynamics, enabling the benefits of fast active learning and improved control. Results using a quadcopter illustrate single-execution active learning and stabilization capabilities during free fall. The results for active learning are extended for automating Koopman observables and we implement our method on real robotic systems.
27 May 2021 in IEEE Transactions on Robotics
This article presents a generalizable methodology for data-driven identification of nonlinear dynamics that bounds the model error in terms of the prediction horizon and the magnitude of the derivatives of the system states. Using higher order derivatives of general nonlinear dynamics that need not be known, we construct a Koopman-operator-based linear representation and utilize Taylor series accuracy analysis to derive an error bound. The resulting error formula is used to choose the order of derivatives in the basis functions and obtain a data-driven Koopman model using a closed-form expression that can be computed in real time. Using the inverted pendulum system, we illustrate the robustness of the error bounds given noisy measurements of unknown dynamics, where the derivatives are estimated numerically. When combined with control, the Koopman representation of the nonlinear system has marginally better performance than competing nonlinear modeling methods, such as SINDy and NARX. In addition, as a linear model, the Koopman approach lends itself readily to efficient control design tools, such as linear–quadratic regulator, whereas the other modeling approaches require nonlinear control methods. The efficacy of the approach is further demonstrated with simulation and experimental results on the control of a tail-actuated robotic fish. Experimental results show that the proposed data-driven control approach outperforms a tuned proportional–integral–derivative controller and that updating the data-driven model online significantly improves performance in the presence of unmodeled fluid disturbance. This article is complemented with a video available at https://youtu.be/9_wx0tdDta0 .
9 December 2015 in IEEE Transactions on Robotics
This paper presents an active search trajectory synthesis technique for autonomous mobile robots with nonlinear measurements and dynamics. The presented approach uses the ergodicity of a planned trajectory with respect to an expected information density map to close the loop during search. The ergodic control algorithm does not rely on discretization of the search or action spaces and is well posed for coverage with respect to the expected information density whether the information is diffuse or localized, thus trading off between exploration and exploitation in a single-objective function. As a demonstration, we use a robotic electrolocation platform to estimate location and size parameters describing static targets in an underwater environment. Our results demonstrate that the ergodic exploration of distributed information algorithm outperforms commonly used information-oriented controllers, particularly when distractions are present.
7 March 2017 in Proceedings of the National Academy of Sciences
Significance: Starting 385 million years ago, certain fish slowly evolved into legged animals living on land. We show that eyes tripled in size and shifted from the sides to the top of the head long before fish modified their fins into limbs for land. Before permanent life on land, these animals probably hunted like crocodiles, looking at prey from just above the water line, where the vastly higher transparency of air enabled long-distance vision and selected for larger eyes. The “buena vista” hypothesis that our study forwards is that seeing opportunities far away provided an informational zip line to the bounty of invertebrate prey on land, aiding selection for limbs—first for brief forays onto land and eventually, for life there.