Siyuan Huang

Siyuan Huang

Auto-generated profile, based on publicly available information

Siyuan Huang

Beijing Institute for General Artificial Intelligence (BIGAI)

Research Focus & Metrics

Academic Career Length

10Years (2017-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 March 2020 in Engineering
Verified
Journal Article
Open access
YZYixin Zhu
Yixin Zhu
TGTao Gao
Tao Gao
LFLifeng Fan
Lifeng Fan
SHSiyuan Huang
Siyuan Huang
MEMark Edmonds
Mark Edmonds
SZSong-Chun Zhu
Song-Chun Zhu

6 October 2018
Verified
Book Chapter
Closed access
PDF file
SHSiyuan Huang
Siyuan Huang
SQSiyuan Qi
Siyuan Qi
YZYixin Zhu
Yixin Zhu
YXYinxue Xiao
Yinxue Xiao
YXYuanlu Xu
Yuanlu Xu
SZSong-Chun Zhu
Song-Chun Zhu

22 October 2024
Verified
Book Chapter
Closed access
PDF file
BJBaoxiong Jia
Baoxiong Jia
YCYixin Chen
Yixin Chen
HYHuangyue Yu
Huangyue Yu
YWYan Wang
Yan Wang
XNXuesong Niu
Xuesong Niu
SHSiyuan Huang
Siyuan Huang

1 October 2023
Verified
Conference Paper
Open access
RGRan Gong
Ran Gong
JHJiangyong Huang
Jiangyong Huang
YZYizhou Zhao
Yizhou Zhao
HGHaoran Geng
Haoran Geng
XGXiaofeng Gao
Xiaofeng Gao
SHSiyuan Huang
Siyuan Huang
Understanding the continuous states of objects is essential for task learning and planning in the real world. However, most existing task learning benchmarks assume discrete (e.g., binary) object goal states, which poses challenges for the learning of complex tasks and transferring learned policy from simulated environments to the real world. Furthermore, state discretization limits a robot’s ability to follow human instructions based on the grounding of actions and states. To tackle these challenges, we present ARNOLD, a benchmark that evaluates language-grounded task learning with continuous states in realistic 3D scenes. ARNOLD is comprised of 8 language-conditioned tasks that involve understanding object states and learning policies for continuous goals. To promote language-instructed learning, we provide expert demonstrations with template-generated language descriptions. We assess task performance by utilizing the latest language-conditioned policy learning models. Our results indicate that current models for language-conditioned manipulations continue to experience significant challenges in novel goal-state generalizations, scene generalizations, and object generalizations. These findings highlight the need to develop new algorithms that address this gap and underscore the potential for further research in this area. Project website: https://arnold-benchmark.github.io.

6 March 2024 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
YLYuyang Li
Yuyang Li
BLBo Liu
Bo Liu
YGYiran Geng
Yiran Geng
PLPuhao Li
Puhao Li
YYYaodong Yang
Yaodong Yang
SHSiyuan Huang
Siyuan Huang
The intricate kinematics of the human hand enable simultaneous grasping and manipulation of multiple objects, essential for tasks such as object transfer and in-hand manipulation. Despite its significance, the domain of robotic multi-object grasping is relatively unexplored and presents notable challenges in kinematics, dynamics, and object configurations. This paper introduces MultiGrasp, a novel two-stage approach for multi-object grasping using a dexterous multi-fingered robotic hand on a tabletop. The process consists of (i) generating pre-grasp proposals and (ii) executing the grasp and lifting the objects. Our experimental focus is primarily on dual-object grasping, achieving a success rate of 44.13%, highlighting adaptability to new object configurations and tolerance for imprecise grasps. Additionally, the framework demonstrates the potential for grasping more than two objects at the cost of inference speed.

30 September 2024
Verified
Book Chapter
Closed access
PDF file
ZZZiyu Zhu
Ziyu Zhu
ZZZhuofan Zhang
Zhuofan Zhang
XMXiaojian Ma
Xiaojian Ma
XNXuesong Niu
Xuesong Niu
YCYixin Chen
Yixin Chen
QLQing Li
Qing Li