15 April 2024 in IEEE Transactions on Intelligent Transportation Systems
Interacting with human road users is one of the most challenging tasks for autonomous vehicles. For congruent driving behaviors, it is essential to recognize and comprehend sociality, encompassing both implicit social norms and individualized social preferences of human drivers. To understand and quantify the complex sociality in driving interactions, we propose a Virtual-Game-based Interaction Model (VGIM) that is parameterized by a social preference measurement, Interaction Preference Value (IPV). The IPV is designed to capture the driver’s relative inclination towards individual rewards over group rewards. A method for identifying IPV from observed driving trajectory is also developed, with which we assessed human drivers’ IPV using driving data recorded in a typical interactive driving scenario, the unprotected left turn. Our findings reveal that (1) human drivers exhibit particular social preference patterns while undertaking specific tasks, such as turning left or proceeding straight; (2) competitive actions could be strategically conducted by human drivers in order to coordinate with others. Finally, we discuss the potential of learning sociality-aware navigation from human demonstrations by incorporating a rule-based humanlike IPV expressing strategy into VGIM and optimization-based motion planners. Simulation experiments demonstrate that (1) IPV identification improves the motion prediction performance in interactive driving scenarios and (2) the dynamic IPV expressing strategy extracted from human driving data makes it possible to reproduce humanlike coordination patterns in the driving interaction.
13 November 2024 in IEEE Transactions on Artificial Intelligence
Decision-making stands as a pivotal component in the realm of autonomous vehicles (AVs), playing a crucial role in navigating the intricacies of autonomous driving. Amidst the evolving landscape of data-driven methodologies, enhancing decision-making performance in complex scenarios has emerged as a prominent research focus. Despite considerable advancements, current learning-based decision-making approaches exhibit potential for refinement, particularly in aspects of policy articulation and safety assurance. To address these challenges, we introduce DDM-Lag, a Diffusion Decision Model, augmented with Lagrangian-based safety enhancements. This work conceptualizes the sequential decision-making challenge inherent in autonomous driving as a problem of generative modeling, adopting diffusion models as the medium for assimilating patterns of decision-making. We introduce a hybrid policy update strategy for diffusion models, amalgamating the principles of behavior cloning and Q-learning, alongside the formulation of an Actor-Critic architecture for the facilitation of updates. To augment the model’s exploration process with a layer of safety, we incorporate additional safety constraints, employing a sophisticated policy optimization technique predicated on Lagrangian relaxation to refine the policy learning endeavor comprehensively. Empirical evaluation of our proposed decision-making methodology was conducted across a spectrum of driving tasks, distinguished by their varying degrees of complexity and environmental contexts. The comparative analysis with established baseline methodologies elucidates our model’s superior performance, particularly in dimensions of safety and holistic efficacy.
25 September 2024 in IEEE Transactions on Intelligent Transportation Systems
Autonomous vehicles (AV) are consistently criticized for their inadequacies in harmoniously interacting with human-driven vehicles (HV), primarily attributed to the lack of sociality, a key human trait that balances individual and group rewards. Understanding sociality is essential for smooth AV navigation but remains challenging. To address this, we propose a Game-Theoretic Inverse Reinforcement Learning (GT-IRL) approach to quantify individualized sociality in driving interaction. Our approach identifies the sociality-preference parameters of a pre-designed reward function that integrates the ego agent’s rewards and the group rewards shared by all the interacting agents. Instead of presuming an agent is propelled by the maximization of its own rewards, the game-theoretical mechanism is utilized within the IRL structure to capture the fact that human drivers take into account others’ interests. We validated our method using human driving data from an unprotected left-turn scenario. The results demonstrate that the proposed GT-IRL outperforms state-of-the-art methods in better reproducing the evolution of the left-turn interaction at both semantic and trajectory levels. Additionally, cross-dataset analysis reveals variations in sociality due to geographical differences (China vs. the U.S.) and the nature of the interacting entities (AV vs. HV or HV vs. HV).
1 August 2026 in IEEE Transactions on Intelligent Transportation Systems
14 August 2026 in Transportation Research Part C: Emerging Technologies