Jiaqi Chen

Jiaqi Chen

Auto-generated profile, based on publicly available information

Jiaqi Chen

Robotic Systems Laboratory, ETH Zürich, Zürich, Switzerland

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
6 September 2024 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
JCJiaqi Chen
Jiaqi Chen
JFJonas Frey
Jonas Frey
RZRuyi Zhou
Ruyi Zhou
TMTakahiro Miki
Takahiro Miki
GMGeorg Martius
Georg Martius
MHMarco Hutter
Marco Hutter
Identifying the physical properties of the surrounding environment is essential for robotic locomotion and navigation to deal with non-geometric hazards, such as slippery and deformable terrains. It would be of great benefit for robots to anticipate these extreme physical properties before contact; however, estimating environmental physical parameters from vision is still an open challenge. Animals can achieve this by using their prior experience and knowledge of what they have seen and how it felt. In this work, we propose a cross-modal self-supervised learning framework for vision-based environmental physical parameter estimation, which paves the way for future physical-property-aware locomotion and navigation. We bridge the gap between existing policies trained in simulation and identification of physical terrain parameters from vision. We propose to train a physical decoder in simulation to predict friction and stiffness from multi-modal input. The trained network allows the labeling of real-world images with physical parameters in a self-supervised manner to further train a visual network during deployment, which can densely predict the friction and stiffness from image data. We validate our physical decoder in simulation and the real world using a quadruped ANYmal robot, outperforming an existing baseline method. We show that our visual network can predict the physical properties in indoor and outdoor experiments while allowing fast adaptation to new environments.