Xiao Li

Xiao Li

Auto-generated profile, based on publicly available information

Xiao Li

School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, China

Research Focus & Metrics

Academic Career Length

11Years (2016-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
21 March 2023 in IEEE Transactions on Robotics
Verified
Journal Article
Closed access
WXWei Xiao
Wei Xiao
TWTsun-Hsuan Wang
Tsun-Hsuan Wang
RHRamin Hasani
Ramin Hasani
MCMakram Chahine
Makram Chahine
AAAlexander Amini
Alexander Amini
DRDaniela Rus
Daniela Rus
Many safety-critical applications of neural networks, such as robotic control, require safety guarantees. This article introduces a method for ensuring the safety of learned models for control using differentiable control barrier functions (dCBFs). dCBFs are end-to-end trainable and guarantee safety. They improve over classical control barrier functions (CBFs), which are usually overly conservative. Our dCBF solution relaxes the CBF definitions by: 1) using environmental dependencies; 2) embedding them into differentiable quadratic programs. These novel safety layers are called a BarrierNet. They can be used in conjunction with any neural network-based controller. They are trained by gradient descent. With BarrierNet, the safety constraints of a neural controller become adaptable to changing environments. We evaluate BarrierNet on the following several problems: 1) robot traffic merging; 2) robot navigation in 2-D and 3-D spaces; 3) end-to-end vision-based autonomous driving in a sim-to-real environment and in physical experiments; 4) demonstrate their effectiveness compared to state-of-the-art approaches.

1 March 2021 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
XLXiao Li
Xiao Li
GRGuy Rosman
Guy Rosman
IGIgor Gilitschenski
Igor Gilitschenski
CVCristian-Ioan Vasile
Cristian-Ioan Vasile
JDJonathan A. DeCastro
Jonathan A. DeCastro
DRDaniela Rus
Daniela Rus
In this work, we propose a novel approach for integrating rules into traffic agent trajectory prediction. Consideration of rules is important for understanding how people behave-yet, it cannot be assumed that rules are always followed. To address this challenge, we evaluate different approaches of integrating rules as inductive biases into deep learning-based prediction models. We propose a framework based on generative adversarial networks that uses tools from formal methods, namely signal temporal logic and syntax trees. This allows us to leverage information on rule obedience as features in neural networks and improves prediction accuracy without biasing towards lawful behavior. We evaluate our method on a real-world driving dataset and show improvement in performance over off-the-shelf predictors.

25 November 2024 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
YCYuxuan Chen
Yuxuan Chen
YHYixin Han
Yixin Han
XLXiao Li
Xiao Li
With the rapid development of large language models (LLM), robots are starting to enjoy the benefits of new interaction methods that large language models bring. Because edge computing fulfills the needs for rapid response, privacy, and network autonomy, we believe it facilitates the extensive deployment of large models for robot navigation across various industries. To enable local deployment of language models on edge devices, we adopt some model boosting methods. In this paper, we propose FASTNav - a method for boosting lightweight LLMs, also known as small language models (SLMs), for robot navigation. The proposed method contains three modules: fine-tuning, teacher-student iteration, and language-based multi-point robot navigation. We train and evaluate models with FASTNav in both simulation and real robots, proving that we can deploy them with low cost, high accuracy and low response time. Compared to other model compression methods, FASTNav shows potential in the local deployment of language models and tends to be a promising solution for language-guided robot navigation on edge devices.

1 July 2026 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
YCYuxuan Chen
Yuxuan Chen
YHYixin Han
Yixin Han
YHYize Huang
Yize Huang
XLXiao Li
Xiao Li

16 December 2021 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
XLXiao Li
Xiao Li
GRGuy Rosman
Guy Rosman
IGIgor Gilitschenski
Igor Gilitschenski
BABrandon Araki
Brandon Araki
CVCristian-Ioan Vasile
Cristian-Ioan Vasile
DRDaniela Rus
Daniela Rus
Symbolic reasoning is a key component for enabling practical use of data-driven planners in autonomous driving. In that context, deterministic finite state automata (DFA) are often used to formalize the underlying high-level decision-making process. Manual design of an effective DFA can be tedious. In combination with deep learning pipelines, DFA can serve as an effective representation to learn and process complex behavioral patterns. The goal of this work is to leverage that potential. We propose the automaton generative network (AGN), a differentiable representation of DFAs. The resulting neural network module can be used standalone or as an embedded component within a larger architecture. In evaluations on deep learning based autonomous vehicle planning tasks, we demonstrate that incorporating AGN improves the explainability, sample efficiency, and generalizability of the model.

9 February 2026 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
ZZZhuoyi Zhang
Zhuoyi Zhang
YHYixin Han
Yixin Han
RLRenjun Li
Renjun Li
XLXiao Li
Xiao Li
Data-driven methods offer promising solutions for robotic manipulation in human-centric environments, but enabling robots to operate complex appliances from natural language remains a significant challenge. The ambiguity of human instructions and the visual diversity of real-world objects make it difficult to generate precise and reliable action sequences. In this letter, we propose a hierarchical multimodal Retrieval-Augmented Generation (RAG) framework that fuses visual perception with language understanding. Our framework uses a vision-based module to identify an appliance and its documentation from a snapshot, then leverages a task-oriented RAG pipeline to process user instructions, retrieve relevant manual sections, and generate executable action sequences. We train and validate this framework on a custom dataset of microwave oven operation tasks and demonstrate its effectiveness, robustness, and practical viability through extensive virtual and physical experiments on a robotic platform.