As autonomous driving technology scales up, complex urban intersections pose significant safety challenges. Current testing methods struggle to simulate these complex scenarios at a manageable cost, making simulation testing essential. For effective evaluation, establishing comprehensive and objective complexity metrics is crucial. However, existing complexity evaluation methods often depend on the performance of the primary vehicle and are based on local interaction relationships, which lack a global perspective and objectivity and have yet to be validated by autonomous driving systems. To address this issue, this paper proposes a multidimensional complexity assessment framework that introduces system-level indicators such as vehicle count, interaction density, disorder, and risk. This framework quantifies the complex interactions at intersections from a global perspective, independent of primary vehicle performance. Experimental results demonstrate that the complexity evaluation results are highly consistent with the performance of a high-level autonomous driving system (Apollo). The framework has been successfully applied to test scenario generation on the Apollo platform, achieving twice the scenario generation efficiency of traditional methods, thus showcasing substantial engineering value.
The development of autonomous driving technology has made simulation testing one of the most important tools for evaluating system performance. However, there is a lack of systematic methods for analyzing and assessing naturalistic driving trajectory datasets. Specifically, there is a lack of comprehensive analyses on data diversity and balance in machine learning-oriented research. This study presents a comprehensive assessment of existing highway scenario datasets in the context of traffic modeling in autonomous driving simulation tests. In order to clarify the level of traffic risk, we design a systematic risk index and propose an index describing the degree of data scatter based on the principle of Euclidean distance quantization. By comparing several datasets, including NGSIM, highD, INTERACTION, CitySim, and our self-collected Highway dataset, we find that the proposed metrics can effectively quantify the risk level of the dataset while helping to gain insight into the diversity and balance differences of the dataset.
23 August 2023 in IEEE Transactions on Intelligent Transportation Systems
Traffic modeling is vitally important to the simulation test of autonomous driving, as on-road testing is not only tedious, inefficient, costly, and often unsafe. The fidelity of the traffic model is thus the key to achieving effective and efficient simulation test results. However, high-fidelity traffic modeling remains a challenge due to the complexity of vehicle movement and the dynamic spatiotemporal interactions among vehicles. In this paper, we propose a novel system-based traffic modeling approach that considers traffic as a whole, or a collection of all vehicles’ movement and their interactions involved simultaneously. In addition, a long short-term memory (LSTM) encoding-decoding framework with a multi-head self-attention mechanism is proposed to capture the temporal dependency of vehicle motion and represent the vehicle-vehicle interaction. Furthermore, some traffic data are collected and used for model training purposes. A metric representing one of the traffic attributes, as the criterion for data screening, is proposed to describe the traffic complexity and disorder, or chaos. Experimental results demonstrate that the proposed model has achieved better performance compared with others from the literature.
Complexity is a crucial metric for evaluating urban intersection scenarios. However, existing complexity evaluations are often derived indirectly from the driving risk of autonomous vehicles, leading to subjective and incomplete evaluations. Therefore, this study undertakes a comprehensive evaluation of intersection scenarios from a systems perspective by quantifying the number of vehicles and the characteristics of vehicle interactions within the intersection.Specifically, we propose an objective framework for assessing complexity. In this framework, the number of vehicles serves as the foundation for assessment, while three interaction characteristics—interaction density, interaction disorder, and interaction risk—are modeled as scaling factors of complexity. In particular, by combining logistic and hyperbolic tangent functions, we accurately capture the nonlinear effects of vehicle numbers and interaction characteristics on complexity.The experimental results demonstrate that the evaluation outcomes of the proposed method are highly correlated with the risk and efficiency performance of autonomous vehicles at intersections, thereby validating the method. Additionally, this method is utilized to guide the generation of highly complex urban intersection scenarios, achieving double the generation efficiency compared to the random sampling method.