Chao Tang

Chao Tang

Auto-generated profile, based on publicly available information

Chao Tang

National University of Singapore

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
27 September 2023 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
CTChao Tang
Chao Tang
DHDehao Huang
Dehao Huang
WGWenqi Ge
Wenqi Ge
WLWeiyu Liu
Weiyu Liu
HZHong Zhang
Hong Zhang
Task-oriented grasping (TOG) refers to the problem of predicting grasps on an object that enable subsequent manipulation tasks. To model the complex relationships between objects, tasks, and grasps, existing methods incorporate semantic knowledge as priors into TOG pipelines. However, the existing semantic knowledge is typically constructed based on closed-world concept sets, restraining the generalization to novel concepts out of the pre-defined sets. To address this issue, we propose GraspGPT, a large language model (LLM) based TOG framework that leverages the open-end semantic knowledge from an LLM to achieve zero-shot generalization to novel concepts. We conduct experiments on Language Augmented TaskGrasp (LA-TaskGrasp) dataset and demonstrate that GraspGPT outperforms existing TOG methods on different held-out settings when generalizing to novel concepts out of the training set. The effectiveness of GraspGPT is further validated in real-robot experiments. Our code, data, appendix, and video are publicly available at https://sites.google.com/view/graspgpt .

26 February 2021 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
RXRuinian Xu
Ruinian Xu
FCFu-Jen Chu
Fu-Jen Chu
CTChao Tang
Chao Tang
WLWeiyu Liu
Weiyu Liu
PVPatricio A. Vela
Patricio A. Vela
This letter investigates the addition of keypoint detections to a deep network affordance segmentation pipeline. The intent is to better interpret the functionality of object parts from a manipulation perspective. While affordance segmentation does provide label information about the potential use of object parts, it lacks predictions on the physical geometry that would support such use. The keypoints remedy the situation by providing structured predictions regarding position, direction, and extent. To support joint training of affordances and keypoints, a new dataset is created based on the UMD dataset. Called the UMD+GT affordance dataset, it emphasizes household objects and affordances. The dataset has a uniform representation for five keypoints that encodes information about where and how to manipulate the associated affordance. Visual processing benchmarking shows that the trained network, called AffKp, achieves the state-of-the-art performance on affordance segmentation and satisfactory result on keypoint detection. Manipulation experiments show more stable detection of the operating position for AffKp versus segmentation-only methods and the ability to infer object part pose and operating direction for task execution.

17 February 2025 in IEEE Transactions on Automation Science and Engineering
Verified
Journal Article
Closed access
CTChao Tang
Chao Tang
DHDehao Huang
Dehao Huang
WDWenlong Dong
Wenlong Dong
RXRuinian Xu
Ruinian Xu
HZHong Zhang
Hong Zhang
Task-oriented grasping (TOG), which refers to synthesizing grasps on an object that are configurationally compatible with the downstream manipulation task, is the first milestone towards tool manipulation. Analogous to the activation of two brain regions responsible for semantic and geometric reasoning during cognitive processes, modeling the intricate relationship between objects, tasks, and grasps necessitates rich semantic and geometric prior knowledge about these elements. Existing methods typically restrict the prior knowledge to a closed-set scope, limiting their generalization to novel objects and tasks out of the training set. To address such a limitation, we propose FoundationGrasp, a foundation model-based TOG framework that leverages the open-ended knowledge from foundation models to learn generalizable TOG skills. Extensive experiments are conducted on the contributed Language and Vision Augmented TaskGrasp (LaViA-TaskGrasp) dataset, demonstrating the superiority of FoundationGrasp over existing methods when generalizing to novel object instances, object classes, and tasks out of the training set. Furthermore, the effectiveness of FoundationGrasp is validated in real-robot grasping and manipulation experiments on a 7-DoF robotic arm. Our code, data, appendix, and video are publicly available at https://sites.google.com/view/foundationgrasp.

19 December 2025 in IEEE Transactions on Automation Science and Engineering
Verified
Journal Article
Closed access
Shan AnShan An
Shan An
ZMZiyu Meng
Ziyu Meng
CTChao Tang
Chao Tang
YZYuning Zhou
Yuning Zhou
TLTengyu Liu
Tengyu Liu
HZHong Zhang
Hong Zhang
Dexterous manipulation, which refers to the ability of a robotic hand or multi-fingered end-effector to skillfully control, reorient, and manipulate objects through precise, coordinated finger movements and adaptive force modulation, enables complex interactions similar to human hand dexterity. With recent advances in robotics and machine learning, there is a growing demand for these systems to operate in complex and unstructured environments. Traditional model-based approaches struggle to generalize across tasks and object variations due to the high dimensionality and complex contact dynamics of dexterous manipulation. Although model-free methods such as reinforcement learning (RL) show promise, they require extensive training, large-scale interaction data, and carefully designed rewards for stability and effectiveness. Imitation learning (IL) offers an alternative by allowing robots to acquire dexterous manipulation skills directly from expert demonstrations, capturing fine-grained coordination and contact dynamics while bypassing the need for explicit modeling and large-scale trial-and-error. This survey provides an overview of dexterous manipulation methods based on imitation learning, details recent advances, and addresses key challenges in the field. Additionally, it explores potential research directions to enhance IL-driven dexterous manipulation. Our goal is to offer researchers and practitioners a comprehensive introduction to this rapidly evolving domain.

18 August 2026 in The International Journal of Robotics Research
Verified
Journal Article
Closed access
YDYuhong Deng
Yuhong Deng
CTChao Tang
Chao Tang
CYCunjun Yu
Cunjun Yu
LLLinfeng Li
Linfeng Li
DHDavid Hsu
David Hsu
Clothes manipulation, such as folding or hanging, is a critical capability for home service robots. Despite recent advances, most existing methods remain limited to specific clothes types and tasks due to the complex, high-dimensional geometry of clothes. This paper presents CLothes mAnipulation with Semantic keyPoints (CLASP). CLASP aims at general-purpose clothes manipulation across diverse clothes types, such as T-shirts, shorts, skirts, long dresses, … and across different tasks, such as folding, flattening, hanging, …. The key idea of CLASP is semantic keypoints —for example, “left sleeve” and “right shoulder”—a sparse spatial-semantic representation, salient for both perception and action. Semantic keypoints of clothes can be reliably extracted from RGB-D images and provide an effective representation for a wide range of clothes manipulation policies. CLASP uses semantic keypoints as an intermediate representation to connect high-level task planning and low-level action execution. At the high level, it exploits a vision-language model (VLM) to predict task plans over the semantic keypoints. At the low level, it executes the plans with the help of a set of pre-built manipulation skills conditioned on the keypoints. Extensive simulation experiments show that CLASP outperforms state-of-the-art baseline methods on multiple tasks across diverse clothes types, demonstrating strong performance and generalization. Further experiments with a Franka dual-arm system on four distinct tasks—folding, flattening, hanging, and placing—confirm CLASP’s performance on real-life clothes manipulation.

14 October 2019 in arXiv
Verified
Preprint
Open access
PDF file
CTChao Tang
Chao Tang
WZWenkun Zhang
Wenkun Zhang
HLHaiting Li
Haiting Li
LLLei Li
Lei Li
ZLZiheng Li
Ziheng Li
BYBin Yan
Bin Yan
Purpose: The purpose is to design a novelty automatic diagnostic method for osteoporosis screening by using the potential capability of convolutional neural network (CNN) in feature representation and extraction, which can be incorporated into the procedure of routine CT diagnostic in physical examination thereby improving the osteoporosis diagnosis and reducing the patient burden. Methods: The proposed convolutional neural network-based method mainly comprises two functional modules to perform automatic detection of bone condition by analyzing the diagnostic CT image. The first functional module aims to locate and segment the ROI of diagnostic CT image, called Mark-Segmentation-Network (MS-Net). The second functional module is used to determine the category of bone condition by the features of ROI, called Bone-Conditions-Classification-Network (BCC-Net). The trained MS-Net can get the mark image of inputted original CT image, thereby obtain the segmentation image. The trained BCC-Net can obtain the probability value of normal bone mass, low bone mass, and osteoporosis by inputting the segmentation image. On the basis of network results, the radiologists can provide preliminary qualitative diagnosis results of bone condition. Results: The proposed MS-Net has an excellent segmentation precision on the shape preservation of different lumbar vertebra. The numerical indicators of segmentation results are greater than 0.998. The proposed BCC-Net was evaluated with 3,024 clinical images and achieved an accuracy of 76.65% and an area under the receiver operating characteristic curve of 0.9167. Conclusions: This study proposed a novel two-step method for automatic detection of bone conditions via diagnostic CT images and it has great potential in clinical applications for osteoporosis screening. The method can potentially reduce the manual burden to radiologists and diagnostic cost to patients.