Ryan Hoque

Ryan Hoque

Auto-generated profile, based on publicly available information

Ryan Hoque

AUTOLAB at the University of California Berkeley USA

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
26 July 2021 in Autonomous Robots
Verified
Journal Article
Closed access
PDF file
RHRyan Hoque
Ryan Hoque
DSDaniel Seita
Daniel Seita
ABAshwin Balakrishna
Ashwin Balakrishna
AGAditya Ganapathi
Aditya Ganapathi
ATAjay Kumar Tanwani
Ajay Kumar Tanwani
KGKen Goldberg
Ken Goldberg

16 November 2022 in arXiv
Verified
Preprint
Open access
PDF file
RHRyan Hoque
Ryan Hoque
LCLawrence Yunliang Chen
Lawrence Yunliang Chen
SSSatvik Sharma
Satvik Sharma
KDKarthik Dharmarajan
Karthik Dharmarajan
BTBrijen Thananjeyan
Brijen Thananjeyan
KGKen Goldberg
Ken Goldberg
Commercial and industrial deployments of robot fleets at Amazon, Nimble, Plus One, Waymo, and Zoox query remote human teleoperators when robots are at risk or unable to make task progress. With continual learning, interventions from the remote pool of humans can also be used to improve the robot fleet control policy over time. A central question is how to effectively allocate limited human attention. Prior work addresses this in the single-robot, single-human setting; we formalize the Interactive Fleet Learning (IFL) setting, in which multiple robots interactively query and learn from multiple human supervisors. We propose Return on Human Effort (ROHE) as a new metric and Fleet-DAgger, a family of IFL algorithms. We present an open-source IFL benchmark suite of GPU-accelerated Isaac Gym environments for standardized evaluation and development of IFL algorithms. We compare a novel Fleet-DAgger algorithm to 4 baselines with 100 robots in simulation. We also perform a physical block-pushing experiment with 4 ABB YuMi robot arms and 2 remote humans. Experiments suggest that the allocation of humans to robots significantly affects the performance of the fleet, and that the novel Fleet-DAgger algorithm can achieve up to 8.8x higher ROHE than baselines. See https://tinyurl.com/fleet-dagger for supplemental material.

20 July 2021 in arXiv
Verified
Preprint
Open access
PDF file
RHRyan Hoque
Ryan Hoque
DSDaniel Seita
Daniel Seita
ABAshwin Balakrishna
Ashwin Balakrishna
AGAditya Ganapathi
Aditya Ganapathi
ATAjay Kumar Tanwani
Ajay Kumar Tanwani
KGKen Goldberg
Ken Goldberg
Robotic fabric manipulation has applications in home robotics, textiles, senior care and surgery. Existing fabric manipulation techniques, however, are designed for specific tasks, making it difficult to generalize across different but related tasks. We build upon the Visual Foresight framework to learn fabric dynamics that can be efficiently reused to accomplish different sequential fabric manipulation tasks with a single goal-conditioned policy. We extend our earlier work on VisuoSpatial Foresight (VSF), which learns visual dynamics on domain randomized RGB images and depth maps simultaneously and completely in simulation. In this earlier work, we evaluated VSF on multi-step fabric smoothing and folding tasks against 5 baseline methods in simulation and on the da Vinci Research Kit (dVRK) surgical robot without any demonstrations at train or test time. A key finding was that depth sensing significantly improves performance: RGBD data yields an 80% improvement in fabric folding success rate in simulation over pure RGB data. In this work, we vary 4 components of VSF, including data generation, visual dynamics model, cost function, and optimization procedure. Results suggest that training visual dynamics models using longer, corner-based actions can improve the efficiency of fabric folding by 76% and enable a physical sequential fabric folding task that VSF could not previously perform with 90% reliability. Code, data, videos, and supplementary material are available at https://sites.google.com/view/fabric-vsf/.

18 February 2021 in arXiv
Verified
Preprint
Open access
PDF file
RHRyan Hoque
Ryan Hoque
DSDaniel Seita
Daniel Seita
ABAshwin Balakrishna
Ashwin Balakrishna
AGAditya Ganapathi
Aditya Ganapathi
ATAjay Kumar Tanwani
Ajay Kumar Tanwani
KGKen Goldberg
Ken Goldberg
Robotic fabric manipulation has applications in home robotics, textiles, senior care and surgery. Existing fabric manipulation techniques, however, are designed for specific tasks, making it difficult to generalize across different but related tasks. We extend the Visual Foresight framework to learn fabric dynamics that can be efficiently reused to accomplish different fabric manipulation tasks with a single goal-conditioned policy. We introduce VisuoSpatial Foresight (VSF), which builds on prior work by learning visual dynamics on domain randomized RGB images and depth maps simultaneously and completely in simulation. We experimentally evaluate VSF on multi-step fabric smoothing and folding tasks against 5 baseline methods in simulation and on the da Vinci Research Kit (dVRK) surgical robot without any demonstrations at train or test time. Furthermore, we find that leveraging depth significantly improves performance. RGBD data yields an 80% improvement in fabric folding success rate over pure RGB data. Code, data, videos, and supplementary material are available at https://sites.google.com/view/fabric-vsf/.

20 July 2021 in arXiv
Verified
Preprint
Open access
PDF file
RHRyan Hoque
Ryan Hoque
ABAshwin Balakrishna
Ashwin Balakrishna
CPCarl Putterman
Carl Putterman
MLMichael Luo
Michael Luo
DBDaniel S. Brown
Daniel S. Brown
KGKen Goldberg
Ken Goldberg
Corrective interventions while a robot is learning to automate a task provide an intuitive method for a human supervisor to assist the robot and convey information about desired behavior. However, these interventions can impose significant burden on a human supervisor, as each intervention interrupts other work the human is doing, incurs latency with each context switch between supervisor and autonomous control, and requires time to perform. We present LazyDAgger, which extends the interactive imitation learning (IL) algorithm SafeDAgger to reduce context switches between supervisor and autonomous control. We find that LazyDAgger improves the performance and robustness of the learned policy during both learning and execution while limiting burden on the supervisor. Simulation experiments suggest that LazyDAgger can reduce context switches by an average of 60% over SafeDAgger on 3 continuous control tasks while maintaining state-of-the-art policy performance. In physical fabric manipulation experiments with an ABB YuMi robot, LazyDAgger reduces context switches by 60% while achieving a 60% higher success rate than SafeDAgger at execution time.

21 April 2022 in arXiv
Verified
Preprint
Open access
PDF file
RHRyan Hoque
Ryan Hoque
KSKaushik Shivakumar
Kaushik Shivakumar
SAShrey Aeron
Shrey Aeron
GDGabriel Deza
Gabriel Deza
AGAditya Ganapathi
Aditya Ganapathi
KGKen Goldberg
Ken Goldberg
Autonomous fabric manipulation is a longstanding challenge in robotics, but evaluating progress is difficult due to the cost and diversity of robot hardware. Using Reach, a cloud robotics platform that enables low-latency remote execution of control policies on physical robots, we present the first systematic benchmarking of fabric manipulation algorithms on physical hardware. We develop 4 novel learning-based algorithms that model expert actions, keypoints, reward functions, and dynamic motions, and we compare these against 4 learning-free and inverse dynamics algorithms on the task of folding a crumpled T-shirt with a single robot arm. The entire lifecycle of data collection, model training, and policy evaluation is performed remotely without physical access to the robot workcell. Results suggest a new algorithm combining imitation learning with analytic methods achieves 84% of human-level performance on the folding task. See https://sites.google.com/berkeley.edu/cloudfolding for all data, code, models, and supplemental material.