Chen Wang

Chen Wang

Auto-generated profile, based on publicly available information

Chen Wang

School of Engineering, Stanford University, Stanford, CA, USA

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
27 June 2022 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
CWChen Wang
Chen Wang
DXDanfei Xu
Danfei Xu
LFLi Fei-Fei
Li Fei-Fei
The ability to plan for multi-step manipulation tasks in unseen situations is crucial for future home robots. But collecting sufficient experience data for end-to-end learning is often infeasible in the real world, as deploying robots in many environments can be prohibitively expensive. On the other hand, large-scale scene understanding datasets contain diverse and rich semantic and geometric information. But how to leverage such information for manipulation remains an open problem. In this letter, we propose a learning-to-plan method that can generalize to new object instances by leveraging object-level representations extracted from a synthetic scene understanding dataset. We evaluate our method with a suite of challenging multi-step manipulation tasks inspired by household activities (Srivastava, et al. , 2022) and show that our model achieves measurably better success rate than state-of-the-art end-to-end approaches.

7 July 2023 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
JSJiankai Sun
Jiankai Sun
YXYan Xu
Yan Xu
MDMingyu Ding
Mingyu Ding
HYHongwei Yi
Hongwei Yi
CWChen Wang
Chen Wang
MSMac Schwager
Mac Schwager
Neural Radiance Fields (NeRFs) have become a widely-applied scene representation technique in recent years, showing advantages for robot navigation and manipulation tasks. To further advance the utility of NeRFs for robotics, we propose a transformer-based framework, NeRF-Loc , to extract 3D bounding boxes of objects in NeRF scenes. NeRF-Loc takes a pre-trained NeRF model and camera view as input and produces labeled, oriented 3D bounding boxes of objects as output. Using current NeRF training tools, a robot can train a NeRF environment model in real-time and, using our algorithm, identify 3D bounding boxes of objects of interest within the NeRF for downstream navigation or manipulation tasks. Concretely, we design a pair of paralleled transformer encoder branches, namely the coarse stream and the fine stream, to encode both the context and details of target objects. The encoded features are then fused together with attention layers to alleviate ambiguities for accurate object localization. We have compared our method with conventional RGB(-D) based methods that take rendered RGB images and depths from NeRFs as inputs. Our method is better than the baselines.