1 January 2021 in Foundations of Data Science
This paper provides a unified perspective of iterative ensemble Kalman methods, a family of derivative-free algorithms for parameter reconstruction and other related tasks. We identify, compare and develop three subfamilies of ensemble methods that differ in the objective they seek to minimize and the derivative-based optimization scheme they approximate through the ensemble. Our work emphasizes two principles for the derivation and analysis of iterative ensemble Kalman methods: statistical linearization and continuum limits. Following these guiding principles, we introduce new iterative ensemble Kalman methods that show promising numerical performance in Bayesian inverse problems, data assimilation and machine learning tasks.
23 June 2022 in SIAM Journal on Mathematics of Data Science
Data assimilation is concerned with sequentially estimating a temporally evolving state. This task, which arises in a wide range of scientific and engineering applications, is particularly challeng...
27 October 2023 in Inverse Problems
This paper introduces a computational framework to reconstruct and forecast a partially observed state that evolves according to an unknown or expensive-to-simulate dynamical system. Our reduced-order autodifferentiable ensemble Kalman filters (ROAD-EnKFs) learn a latent low-dimensional surrogate model for the dynamics and a decoder that maps from the latent space to the state space. The learned dynamics and decoder are then used within an EnKF to reconstruct and forecast the state. Numerical experiments show that if the state dynamics exhibit a hidden low-dimensional structure, ROAD-EnKFs achieve higher accuracy at lower computational cost compared to existing methods. If such structure is not expressed in the latent state dynamics, ROAD-EnKFs achieve similar accuracy at lower cost, making them a promising approach for surrogate state reconstruction and forecasting.
1 January 2020 in Communications on Pure and Applied Analysis
We introduce hybrid fractals as a class of fractals constructed by gluing several fractal pieces in a specific manner and study energy forms and Laplacians on them. We consider in particular a hybrid based on the $ 3 $-level Sierpinski gasket, for which we construct explicitly an energy form with the property that it does not "capture" the $ 3 $-level Sierpinski gasket structure. This characteristic type of energy forms that "miss" parts of the structure of the underlying space is investigated in the more general framework of finitely ramified cell structures. The spectrum of the associated Laplacian and its asymptotic behavior in two different hybrids is analyzed theoretically and numerically. A website with further numerical data analysis is available at http://www.math.cornell.edu/~harry970804/.