Gang Yan

Gang Yan

Auto-generated profile, based on publicly available information

Gang Yan

Matsuo-Iwasawa Laboratory, Department of Technology Management for Innovation, The University of Tokyo, Tokyo, Japan

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
14 February 2022 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
GYGang Yan
Gang Yan
ASAlexander Schmitz
Alexander Schmitz
SFSatoshi Funabashi
Satoshi Funabashi
SSSophon Somlor
Sophon Somlor
TTTito Pradhono Tomo
Tito Pradhono Tomo
SSShigeki Sugano
Shigeki Sugano
Recently, tactile sensing has attracted increasing attention for robotic manipulation. Predicting the grasping stability before lifting objects and detecting the ongoing/onset of slip after lifting objects are two critical and widely studied tasks in robotic tactile manipulation. Previous methods focus on proposing novel neural networks (NN) architectures towards one of the above two tasks and did not consider that the two tasks are employed in two interconnected action-phases, i.e. grasping and lifting. Therefore, we firstly explore the possibility of constructing a multi-phase, multi-output framework to combine the stability prediction before lifting and the slip detection after lifting. Moreover, to improve the prediction/detection accuracy, we also proposed to explicitly ensemble different NN architectures using various methods, including attention mechanisms. Our experiments are done with 6 state-of-art NN architectures on two datasets including more than 3000 robotic grasps over 80 objects in total. Furthermore our proposals are tested in a real-time robot experiment with unseen objects. Our experimental results show that the proposed multi-phase, multi-output model exhibits more reliable and flexible performance than a single phase model. We also show that using the ensemble of different NN architectures is a viable and practical choice to boost the overall performance.

9 November 2023
Verified
Conference Paper
Closed access
GYGang Yan
Gang Yan
ZQZhida Qin
Zhida Qin
SFSatoshi Funabashi
Satoshi Funabashi
ASAlexander Schmitz
Alexander Schmitz
TTTito Pradhono Tomo
Tito Pradhono Tomo
SSShigeki Sugano
Shigeki Sugano
Predicting the grasp stability before lifting an object, to be detailed, whether a gripped object will move with respect to the gripper, gives more time to modify unstable grasps compared to after-lift slip detection. Recently, deep learning relying on visual and tactile information becomes increasingly popular. However, how to combine visual and tactile data effectively is still under research. In this paper, we propose to fuse visual and tactile data by introducing self attention (SA) mechanisms for predicting grasp stability. In our experiments, we use tactile sensors (uSkin) and camera sensor (Spresense). An image of the object, not collected immediately before or during grasping, is used, as it might be more readily available. Dataset collection is done by grasping and lifting 1050 times on 35 daily objects in total with various forces and grasping positions. As a result, the predicted accuracy improves over 9% compared to previous attention-based visual-tactile fusion research. Furthermore, our analysis reveals that the introduction of self-attention mechanisms enables more effective and widespread feature extraction for both visual and tactile data.

19 March 2026 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
GYGang Yan
Gang Yan
JGJiaxian Guo
Jiaxian Guo
KPKhrapchenkov Petr
Khrapchenkov Petr
ZZZhongchao Zhou
Zhongchao Zhou
YZYaonan Zhu
Yaonan Zhu
YMYutaka Matsuo
Yutaka Matsuo
Robotic tactile learning is a critical research area for enabling robots to perform complex manipulation tasks with human-like dexterity and adaptability. However, ensuring grasp stability remains one of the most fundamental yet challenging problems in tactile sensing. Existing approaches predominantly focus on classifying stability outcomes, lacking the ability to reason about failure modes or propose corrections. We address this gap by harnessing the inherent reasoning capabilities of Vision-Language Models (VLMs). To do so, we introduce a framework that integrates tactile modality via Quantized Low-Rank Adaptation (QLoRA), enabling parameter-efficient fine-tuning that empowers VLMs to both diagnose grasp instability and generate actionable, natural language corrections. To tackle tactile data scarcity, we develop an automated data collection and annotation pipeline leveraging state-of-the-art tactile sensor simulation, calibrated via a real-to-sim procedure to ensure robust transfer. Extensive experiments across 15 k simulated and 400 real-world trials demonstrate superior zero-shot sim-to-real generalization. In real-time physical evaluations, our approach achieves a 95% grasp success rate on unseen objects, significantly outperforming baselines.