Shuran Song

Shuran Song

Auto-generated profile, based on publicly available information

Shuran Song

Columbia University

Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
16 November 2023 in Autonomous Robots
Verified
Journal Article
Closed access
PDF file
JWJimmy Wu
Jimmy Wu
RARika Antonova
Rika Antonova
AKAdam Kan
Adam Kan
MLMarion Lepert
Marion Lepert
AZAndy Zeng
Andy Zeng
TFThomas Funkhouser
Thomas Funkhouser

25 June 2020 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
SSShuran Song
Shuran Song
AZAndy Zeng
Andy Zeng
JLJohnny Lee
Johnny Lee
TFThomas Funkhouser
Thomas Funkhouser
Intelligent manipulation benefits from the capacity to flexibly control an end-effector with high degrees of freedom (DoF) and dynamically react to the environment. However, due to the challenges of collecting effective training data and learning efficiently, most grasping algorithms today are limited to top-down movements and open-loop execution. In this work, we propose a new low-cost hardware interface for collecting grasping demonstrations by people in diverse environments. This data makes it possible to train a robust end-to-end 6DoF closed-loop grasping model with reinforcement learning that transfers to real robots. A key aspect of our grasping model is that it uses “action-view” based rendering to simulate future states with respect to different possible actions. By evaluating these states using a learned value function (e.g., Q-function), our method is able to better select corresponding actions that maximize total rewards (i.e., grasping success). Our final grasping system is able to achieve reliable 6DoF closed-loop grasping of novel objects across various scene configurations, as well as in dynamic scenes with moving objects.

13 January 2022 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
ZXZhenjia Xu
Zhenjia Xu
ZHZhanpeng He
Zhanpeng He
SSShuran Song
Shuran Song
We introduce the Universal Manipulation Policy Network (UMPNet) – a single image-based policy network that infers closed-loop action sequences for manipulating articulated objects. To infer a wide range of action trajectories, the policy supports 6DoF action representation and varying trajectory length. To handle a diverse set of objects, the policy learns from objects with different articulation structures and generalizes to unseen objects or categories. The policy is trained with self-guided exploration without any human demonstrations, scripted policy, or pre-defined goal conditions. To support effective multi-step interaction, we introduce a novel Arrow-of-Time action attribute that indicates whether an action will change the object state back to the past or forward into the future. With the Arrow-of-Time inference at each interaction step, the learned policy is able to select actions that consistently lead towards or away from a given state, thereby, enabling both effective state exploration and goal-conditioned manipulation.

6 October 2018
Verified
Book Chapter
Closed access
PDF file
MGMichelle Guo
Michelle Guo
ECEdward Chou
Edward Chou
DHDe-An Huang
De-An Huang
SSShuran Song
Shuran Song
SYSerena Yeung
Serena Yeung
LFLi Fei-Fei
Li Fei-Fei

7 December 2019 in Advanced Robotics
Verified
Journal Article
Open access
MFM. Fujita
M. Fujita
YDY. Domae
Y. Domae
ANA. Noda
A. Noda
GRG. A. Garcia Ricardez
G. A. Garcia Ricardez
TNT. Nagatani
T. Nagatani
TOT. Ogasawara
T. Ogasawara
Bin picking is still a challenge in robotics, as patent in recent robot competitions. These competitions are an excellent platform for technology comparisons since some participants may use state-of-the-art technologies, while others may use conventional ones. Nevertheless, even though points are awarded or subtracted based on the performance in the frame of the competition rules, the final score does not directly reflect the suitability of the technology. Therefore, it is difficult to understand which technologies and their combination are optimal for various real-world problems. In this paper, we propose a set of performance metrics selected in terms of actual field use as a solution to clarify the important technologies in bin picking. Moreover, we use the selected metrics to compare our four original robot systems, which achieved the best performance in the Stow task of the Amazon Robotics Challenge 2017. Based on this comparison, we discuss which technologies are ideal for practical use in bin picking robots in the fields of factory and warehouse automation.

25 July 2022 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
JXJingxi Xu
Jingxi Xu
SSShuran Song
Shuran Song
MCMatei Ciocarlie
Matei Ciocarlie
Inspired by the human ability to perform complex manipulation in the complete absence of vision (like retrieving an object from a pocket), the robotic manipulation field is motivated to develop new methods for tactile-based object interaction. However, tactile sensing presents the challenge of being an active sensing modality: a touch sensor provides sparse, local data, and must be used in conjunction with effective exploration strategies in order to collect information. In this work, we focus on the process of guiding tactile exploration, and its interplay with task-related decision making. We propose TANDEM (TActile exploration aNd DEcision Making), an architecture to learn efficient exploration strategies in conjunction with decision making. Our approach is based on separate but co-trained modules for exploration and discrimination. We demonstrate this method on a tactile object recognition task, where a robot equipped with a touch sensor must explore and identify an object from a known set based on binary contact signals alone. TANDEM achieves higher accuracy with fewer actions than alternative methods and is also shown to be more robust to sensor noise.