Yunlong Song

Yunlong Song

Auto-generated profile, based on publicly available information

Yunlong Song

Robotics and Perception Group, University of Zurich, Zurich, Switzerland

Research Focus & Metrics

Academic Career Length

14Years (2013-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
29 June 2022 in Science Robotics
Verified
Journal Article
Closed access
PFPhilipp Foehn
Philipp Foehn
EKElia Kaufmann
Elia Kaufmann
ARAngel Romero
Angel Romero
RPRobert Penicka
Robert Penicka
SSSihao Sun
Sihao Sun
DSDavide Scaramuzza
Davide Scaramuzza
Autonomous, agile quadrotor flight raises fundamental challenges for robotics research in terms of perception, planning, learning, and control. A versatile and standardized platform is needed to accelerate research and let practitioners focus on the core problems. To this end, we present Agilicious, a codesigned hardware and software framework tailored to autonomous, agile quadrotor flight. It is completely open source and open hardware and supports both model-based and neural network–based controllers. Also, it provides high thrust-to-weight and torque-to-inertia ratios for agility, onboard vision sensors, graphics processing unit (GPU)–accelerated compute hardware for real-time perception and neural network inference, a real-time flight controller, and a versatile software stack. In contrast to existing frameworks, Agilicious offers a unique combination of flexible software stack and high-performance hardware. We compare Agilicious with prior works and demonstrate it on different agile tasks, using both model-based and neural network–based controllers. Our demonstrators include trajectory tracking at up to 5 g and 70 kilometers per hour in a motion capture system, and vision-based acrobatic flight and obstacle avoidance in both structured and unstructured environments using solely onboard perception. Last, we demonstrate its use for hardware-in-the-loop simulation in virtual reality environments. Because of its versatility, we believe that Agilicious supports the next generation of scientific and industrial quadrotor research.

14 May 2024 in IEEE Transactions on Robotics
Verified
Journal Article
Open access
DHDrew Hanover
Drew Hanover
ALAntonio Loquercio
Antonio Loquercio
LBLeonard Bauersfeld
Leonard Bauersfeld
ARAngel Romero
Angel Romero
RPRobert Penicka
Robert Penicka
DSDavide Scaramuzza
Davide Scaramuzza
Over the last decade, the use of autonomous drone systems for surveying, search and rescue, or last-mile delivery has increased exponentially. With the rise of these applications comes the need for highly robust, safety-critical algorithms that can operate drones in complex and uncertain environments. Additionally, flying fast enables drones to cover more ground, increasing productivity and further strengthening their use case. One proxy for developing algorithms used in high-speed navigation is the task of autonomous drone racing, where researchers program drones to fly through a sequence of gates and avoid obstacles as quickly as possible using onboard sensors and limited computational power. Speeds and accelerations exceed over 80 kph and 4 g, respectively, raising significant challenges across perception, planning, control, and state estimation. To achieve maximum performance, systems require real-time algorithms that are robust to motion blur, high dynamic range, model uncertainties, aerodynamic disturbances, and often unpredictable opponents. This survey covers the progression of autonomous drone racing across model-based and learning-based approaches. We provide an overview of the field, its evolution over the years, and conclude with the biggest challenges and open questions to be faced in the future.

8 March 2021 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
FFFlorian Fuchs
Florian Fuchs
YSYunlong Song
Yunlong Song
EKElia Kaufmann
Elia Kaufmann
DSDavide Scaramuzza
Davide Scaramuzza
PDPeter Durr
Peter Durr
Autonomous car racing is a major challenge in robotics. It raises fundamental problems for classical approaches such as planning minimum-time trajectories under uncertain dynamics and controlling the car at the limits of its handling. Besides, the requirement of minimizing the lap time, which is a sparse objective, and the difficulty of collecting training data from human experts have also hindered researchers from directly applying learning-based approaches to solve the problem. In the present work, we propose a learning-based system for autonomous car racing by leveraging a high-fidelity physical car simulation, a course-progress proxy reward, and deep reinforcement learning. We deploy our system in Gran Turismo Sport, a world-leading car simulator known for its realistic physics simulation of different race cars and tracks, which is even used to recruit human race car drivers. Our trained policy achieves autonomous racing performance that goes beyond what had been achieved so far by the built-in AI, and at the same time, outperforms the fastest driver in a dataset of over 50,000 human players.

23 February 2022 in IEEE Transactions on Robotics
Verified
Journal Article
Closed access
YSYunlong Song
Yunlong Song
DSDavide Scaramuzza
Davide Scaramuzza
Policy search and model predictive control (MPC) are two different paradigms for robot control: policy search has the strength of automatically learning complex policies using experienced data, and MPC can offer optimal control performance using models and trajectory optimization. An open research question is how to leverage and combine the advantages of both approaches. In this article, we provide an answer by using policy search for automatically choosing high-level decision variables for MPC, which leads to a novel policy-search-for-model-predictive-control framework . Specifically, we formulate the MPC as a parameterized controller, where the hard-to-optimize decision variables are represented as high-level policies. Such a formulation allows optimizing policies in a self-supervised fashion. We validate this framework by focusing on a challenging problem in agile drone flight: flying a quadrotor through fast-moving gates. Experiments show that our controller achieves robust and real-time control performance in both simulation and the real world. The proposed framework offers a new perspective for merging learning and control.

13 June 2022 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
RPRobert Penicka
Robert Penicka
YSYunlong Song
Yunlong Song
EKElia Kaufmann
Elia Kaufmann
DSDavide Scaramuzza
Davide Scaramuzza
We tackle the problem of minimum-time flight for a quadrotor through a sequence of waypoints in the presence of obstacles while exploiting the full quadrotor dynamics. Early works relied on simplified dynamics or polynomial trajectory representations that did not exploit the full actuator potential of the quadrotor, and, thus, resulted in suboptimal solutions. Recent works can plan minimum-time trajectories; yet, the trajectories are executed with control methods that do not account for obstacles. Thus, a successful execution of such trajectories is prone to errors due to model mismatch and in-flight disturbances. To this end, we leverage deep reinforcement learning and classical topological path planning to train robust neural-network controllers for minimum-time quadrotor flight in cluttered environments. The resulting neural network controller demonstrates substantially better performance of up to 19% over state-of-the-art methods. More importantly, the learned policy solves the planning and control problem simultaneously online to account for disturbances, thus achieving much higher robustness. As such, the presented method achieves 100% success rate of flying minimum-time policies without collision, while traditional planning and control approaches achieve only 40%. The proposed method is validated in both simulation and the real world, with quadrotor speeds of up to $42 \,\mathrm{k}\mathrm{m}\mathrm{h}^{-1}$ and accelerations of 3.6 g.

16 June 2025 in Nature Machine Intelligence
Verified
Journal Article
Closed access
PDF file
YZYuang Zhang
Yuang Zhang
YHYu Hu
Yu Hu
YSYunlong Song
Yunlong Song
DZDanping Zou
Danping Zou
WLWeiyao Lin
Weiyao Lin