Nikita Rudin

Nikita Rudin

Auto-generated profile, based on publicly available information

Nikita Rudin

Robotic Systems Lab, ETH Zurich, Zurich, Switzerland

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
25 April 2023 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
MMMayank Mittal
Mayank Mittal
CYCalvin Yu
Calvin Yu
QYQinxi Yu
Qinxi Yu
JLJingzhou Liu
Jingzhou Liu
NRNikita Rudin
Nikita Rudin
AGAnimesh Garg
Animesh Garg
We present Orbit , a unified and modular framework for robot learning powered by Nvidia Isaac Sim. It offers a modular design to easily and efficiently create robotic environments with photo-realistic scenes and high-fidelity rigid and deformable body simulation. With Orbit , we provide a suite of benchmark tasks of varying difficulty– from single-stage cabinet opening and cloth folding to multi-stage tasks such as room reorganization. To support working with diverse observations and action spaces, we include fixed-arm and mobile manipulators with different physically-based sensors and motion generators. Orbit allows training reinforcement learning policies and collecting large demonstration datasets from hand-crafted or expert solutions in a matter of minutes by leveraging GPU-based parallelization. In summary, we offer an open-sourced framework that readily comes with 16 robotic platforms, 4 sensor modalities, 10 motion generators, more than 20 benchmark tasks, and wrappers to 4 learning libraries. With this framework, we aim to support various research areas, including representation learning, reinforcement learning, imitation learning, and task and motion planning. We hope it helps establish interdisciplinary collaborations in these communities, and its modularity makes it easily extensible for more tasks and applications in the future. For videos, documentation, and code: https://isaac-orbit.github.io/ .

13 March 2024 in Science Robotics
Verified
Journal Article
Closed access
DHDavid Hoeller
David Hoeller
NRNikita Rudin
Nikita Rudin
DSDhionis Sako
Dhionis Sako
MHMarco Hutter
Marco Hutter
Performing agile navigation with four-legged robots is a challenging task because of the highly dynamic motions, contacts with various parts of the robot, and the limited field of view of the perception sensors. Here, we propose a fully learned approach to training such robots and conquer scenarios that are reminiscent of parkour challenges. The method involves training advanced locomotion skills for several types of obstacles, such as walking, jumping, climbing, and crouching, and then using a high-level policy to select and control those skills across the terrain. Thanks to our hierarchical formulation, the navigation policy is aware of the capabilities of each skill, and it will adapt its behavior depending on the scenario at hand. In addition, a perception module was trained to reconstruct obstacles from highly occluded and noisy sensory data and endows the pipeline with scene understanding. Compared with previous attempts, our method can plan a path for challenging scenarios without expert demonstration, offline computation, a priori knowledge of the environment, or taking contacts explicitly into account. Although these modules were trained from simulated data only, our real-world experiments demonstrate successful transfer on hardware, where the robot navigated and crossed consecutive challenging obstacles with speeds of up to 2 meters per second.

14 June 2021 in IEEE Transactions on Robotics
Verified
Journal Article
Closed access
NRNikita Rudin
Nikita Rudin
HKHendrik Kolvenbach
Hendrik Kolvenbach
VTVassilios Tsounis
Vassilios Tsounis
MHMarco Hutter
Marco Hutter
In this article, we show that learned policies can be applied to solve legged locomotion control tasks with extensive flight phases, such as those encountered in space exploration. Using an off-the-shelf deep reinforcement learning algorithm, we train a neural network to control a jumping quadruped robot while solely using its limbs for attitude control. We present tasks of increasing complexity leading to a combination of 3-D (re)orientation and landing locomotion behaviors of a quadruped robot traversing simulated low-gravity celestial bodies. We show that our approach easily generalizes across these tasks and successfully trains policies for each case. Using sim-to-real transfer, we deploy trained policies in the real world on the SpaceBok robot placed on an experimental testbed designed for 2-D microgravity experiments. The experimental results demonstrate that repetitive controlled jumping and landing with natural agility is possible.

20 June 2022 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
DHDavid Hoeller
David Hoeller
NRNikita Rudin
Nikita Rudin
CCChristopher Choy
Christopher Choy
AAAnimashree Anandkumar
Animashree Anandkumar
MHMarco Hutter
Marco Hutter
We propose a learning-based method to reconstruct the local terrain for locomotion with a mobile robot traversing urban environments. Using a stream of depth measurements from the onboard cameras and the robot’s trajectory, the algorithm estimates the topography in the robot’s vicinity. The raw measurements from these cameras are noisy and only provide partial and occluded observations that in many cases do not show the terrain the robot stands on. Therefore, we propose a 3D reconstruction model that faithfully reconstructs the scene, despite the noisy measurements and large amounts of missing data coming from the blind spots of the camera arrangement. The model consists of a 4D fully convolutional network on point clouds that learns the geometric priors to complete the scene from the context and an auto-regressive feedback to leverage spatio-temporal consistency and use evidence from the past. The network can be solely trained with synthetic data, and due to extensive augmentation, it is robust in the real world, as shown in the validation on a quadrupedal robot, ANYmal, traversing challenging settings. We run the pipeline on the robot’s onboard low-power computer using an efficient sparse tensor implementation and show that the proposed method outperforms classical map representations.

11 September 2023 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
GVGiorgio Valsecchi
Giorgio Valsecchi
NRNikita Rudin
Nikita Rudin
LNLennart Nachtigall
Lennart Nachtigall
KMKonrad Mayer
Konrad Mayer
FTFabian Tischhauser
Fabian Tischhauser
MHMarco Hutter
Marco Hutter
This letter introduces Barry, a dynamically balancing quadruped robot optimized for high payload capabilities and efficiency. It presents a new high-torque and low-inertia leg design, which includes custom-built high-efficiency actuators and transparent, sensorless transmissions. The robot's reinforcement learning-based controller is trained to fully leverage the new hardware capabilities to balance and steer the robot. The newly developed controller can manage the non-linearities introduced by the new leg design and handle unmodeled payloads up to 90 kg while operating at high efficiency. The approach's efficacy is demonstrated by a high payload-to-weight ratio verified with multiple tests, with a maximum ratio of 2 on flat terrain. Experiments also demonstrate Barry's power consumption and cost of transport, which converge to a value of 0.7 at 1.4 m/s, regardless of the payload mass.

19 August 2022 in arXiv
Verified
Preprint
Open access
PDF file
NRNikita Rudin
Nikita Rudin
DHDavid Hoeller
David Hoeller
PRPhilipp Reist
Philipp Reist
MHMarco Hutter
Marco Hutter
In this work, we present and study a training set-up that achieves fast policy generation for real-world robotic tasks by using massive parallelism on a single workstation GPU. We analyze and discuss the impact of different training algorithm components in the massively parallel regime on the final policy performance and training times. In addition, we present a novel game-inspired curriculum that is well suited for training with thousands of simulated robots in parallel. We evaluate the approach by training the quadrupedal robot ANYmal to walk on challenging terrain. The parallel approach allows training policies for flat terrain in under four minutes, and in twenty minutes for uneven terrain. This represents a speedup of multiple orders of magnitude compared to previous work. Finally, we transfer the policies to the real robot to validate the approach. We open-source our training code to help accelerate further research in the field of learned legged locomotion.