Xiaoyong Ni

Xiaoyong Ni

Auto-generated profile, based on publicly available information

Xiaoyong Ni

ETH Zurich

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
11 March 2022 in IEEE Transactions on Signal Processing
Verified
Journal Article
Closed access
GRGuy Revach
Guy Revach
NSNir Shlezinger
Nir Shlezinger
XNXiaoyong Ni
Xiaoyong Ni
AEAdria Lopez Escoriza
Adria Lopez Escoriza
RSRuud J. G. van Sloun
Ruud J. G. van Sloun
YEYonina C. Eldar
Yonina C. Eldar
Real-time state estimation of dynamical systems is a fundamental task in signal processing and control. For systems that are well-represented by a fully known linear Gaussian state space (SS) model, the celebrated Kalman filter (KF) is a low complexity optimal solution. However, both linearity of the underlying SS model and accurate knowledge of it are often not encountered in practice. Here, we present KalmanNet, a real-time state estimator that learns from data to carry out Kalman filtering under non-linear dynamics with partial information. By incorporating the structural SS model with a dedicated recurrent neural network module in the flow of the KF, we retain data efficiency and interpretability of the classic algorithm while implicitly learning complex dynamics from data. We numerically demonstrate that KalmanNet overcomes nonlinearities and model mismatch, outperforming classic filtering methods operating with both mismatched and accurate domain knowledge.

17 November 2023 in IEEE Transactions on Signal Processing
Verified
Journal Article
Closed access
GRGuy Revach
Guy Revach
XNXiaoyong Ni
Xiaoyong Ni
NSNir Shlezinger
Nir Shlezinger
RSRuud J. G. van Sloun
Ruud J. G. van Sloun
YEYonina C. Eldar
Yonina C. Eldar
The smoothing task is core to many signal-processing applications. A widely popular smoother is the Rauch-Tung-Striebel (RTS) algorithm, which achieves minimal mean-squared error recovery with low complexity for linear Gaussian state-space (SS) models, yet is limited in systems that are only partially known, as well as nonlinear and non-Gaussian. In this work, we propose RTSNet, a highly efficient model-based and data-driven smoothing algorithm suitable for partially known SS models. RTSNet integrates dedicated trainable models into the flow of the classical RTS smoother, while iteratively refining its sequence estimate via deep unfolding methodology. As a result, RTSNet learns from data to reliably smooth when operating under model mismatch and nonlinearities while retaining the efficiency and interpretability of the traditional RTS smoothing algorithm. Our empirical study demonstrates that RTSNet overcomes nonlinearities and model mismatch, outperforming classic smoothers operating with both mismatched and accurate domain knowledge. Moreover, while RTSNet is based on compact neural networks, which leads to faster training and inference times, it demonstrates improved performance over previously proposed deep smoothers in nonlinear settings.

18 October 2021 in arXiv
Verified
Preprint
Open access
PDF file
GRGuy Revach
Guy Revach
NSNir Shlezinger
Nir Shlezinger
TLTimur Locher
Timur Locher
XNXiaoyong Ni
Xiaoyong Ni
RSRuud J. G. van Sloun
Ruud J. G. van Sloun
YEYonina C. Eldar
Yonina C. Eldar
In this paper we adapt KalmanNet, which is a recently pro-posed deep neural network (DNN)-aided system whose architecture follows the operation of the model-based Kalman filter (KF), to learn its mapping in an unsupervised manner, i.e., without requiring ground-truth states. The unsupervised adaptation is achieved by exploiting the hybrid model-based/data-driven architecture of KalmanNet, which internally predicts the next observation as the KF does. These internal features are then used to compute the loss rather than the state estimate at the output of the system. With the capability of unsupervised learning, one can use KalmanNet not only to track the hidden state, but also to adapt to variations in the state space (SS) model. We numerically demonstrate that when the noise statistics are unknown, unsupervised KalmanNet achieves a similar performance to KalmanNet with supervised learning. We also show that we can adapt a pre-trained KalmanNet to changing SS models without providing additional data thanks to the unsupervised capabilities.

3 October 2024 in bioRxiv
Verified
Preprint
Open access
PDF file
LCLuis Hernan Cubillos
Luis Hernan Cubillos
GRGuy Revach
Guy Revach
MMMatthew J. Mender
Matthew J. Mender
JCJoseph T. Costello
Joseph T. Costello
HTHisham Temmar
Hisham Temmar
CCCindy Chestek
Cindy Chestek
People with brain or spinal cord-related paralysis often need to rely on others for basic tasks, limiting their independence. A potential solution is brain-machine interfaces (BMIs), which could allow them to voluntarily control external devices (e.g., robotic arm) by decoding brain activity to movement commands. In the past decade, deep-learning decoders have achieved state-of-the-art results in most BMI applications, ranging from speech production to finger control. However, the ‘black-box’ nature of deep-learning decoders could lead to unexpected behaviors, resulting in major safety concerns in real-world physical control scenarios. In these applications, explainable but lower-performing decoders, such as the Kalman filter (KF), remain the norm. In this study, we designed a BMI decoder based on KalmanNet, an extension of the KF that augments its operation with recurrent neural networks to compute the Kalman gain. This results in a varying “trust” that shifts between inputs and dynamics. We used this algorithm to predict finger movements from the brain activity of two monkeys. We compared KalmanNet results offline (pre-recorded data, n = 13 days) and online (real-time predictions, n = 5 days) with a simple KF and two recent deep-learning algorithms with state-of-the-art results: tcFNN and LSTM. KalmanNet achieved comparable or better results than other deep learning models in offline and online modes, relying on the dynamical model for stopping while depending more on neural inputs for initiating movements. We further validated this mechanism by implementing a heteroscedastic KF that used the same strategy, and it also approached state-of-the-art performance while remaining in the explainable domain of standard KFs. However, we also see two downsides to KalmanNet. KalmanNet shares the limited generalization ability of existing deep-learning decoders, and its usage of the KF as an inductive bias limits its performance in the presence of unseen noise distributions. Despite this trade-off, our analysis successfully integrates traditional controls and modern deep-learning approaches to motivate high-performing yet still explainable BMI designs.