Enhancing the safety of passengers by venturing beyond the limits of a human driver is one of the main ideas behind autonomous vehicles. While drifting is mostly witnessed in motorsports as an advanced driving technique, it could provide many possibilities for improving traffic safety by avoiding accidents in extreme traffic situations. The purpose of the research presented in this article is to provide a machine learning-based solution to autonomous drifting as a proof of concept for vehicle control at the limits of handling. To achieve this, reinforcement learning (RL) agents were trained for the task in a MATLAB/Simulink-based simulation environment, using the state-of-the-art Soft Actor–Critic (SAC) algorithm. The trained agents were tested in reality at the ZalaZONE proving ground on a series production sports car with zero-shot transfer. Based on the test results, the simulation environment was improved through domain randomization, until the agent could perform the task both in simulation and in reality on a real test car.
Autonomous vehicle control has undergone remarkable developments in recent years, especially in maneuvering at the limits of traction. These developments promise improved maneuverability and safety, but they also highlight a constant challenge: translating control strategies developed in simulation into robust, real-world applications. The complexity of real-world environments, with their inherent uncertainties and rapid changes, poses significant obstacles for autonomous systems that need to dynamically adapt to unpredictable conditions, such as varying traction. The aim of this research is to investigate the effectiveness of robust adversarial reinforcement learning (RARL) for controlling circular drift maneuvers under dynamic road adhesion changes and uncertainties. The presented simulation results show that agents trained with RARL can enhance agents developed using only standard reinforcement learning techniques, where they were most critically vulnerable, such as sudden significant loss of traction during the drift initiation phase. This could present another step towards the application of more robust autonomous systems.