We demonstrate a working functional prototype of a cooperative perception system that maintains a real-time digital twin of the traffic environment, providing a more accurate and more reliable model than any of the participant subsystems—in this case, smart vehicles and infrastructure stations—would manage individually. The importance of such technology is that it can facilitate a spectrum of new derivative services, including cloud-assisted and cloud-controlled ADAS functions, dynamic map generation with analytics for traffic control and road infrastructure monitoring, a digital framework for operating vehicle testing grounds, logistics facilities, etc. In this paper, we constrain our discussion on the viability of the core concept and implement a system that provides a single service: the live visualization of our digital twin in a 3D simulation, which instantly and reliably matches the state of the real-world environment and showcases the advantages of real-time fusion of sensory data from various traffic participants. We envision this prototype system as part of a larger network of local information processing and integration nodes, i.e., the logically centralized digital twin is maintained in a physically distributed edge cloud.
A spectacular measurement campaign was carried out on a real-world motorway stretch of Hungary with the participation of international industrial and academic partners. The measurement resulted in vehicle based and infrastructure based sensor data that will be extremely useful for future automotive R&D activities due to the available ground truth for static and dynamic content. The aim of the measurement campaign was twofold. On the one hand, road geometry was mapped with high precision in order to build Ultra High Definition (UHD) map of the test road. On the other hand, the vehicles—equipped with differential Global Navigation Satellite Systems (GNSS) for ground truth localization—carried out special test scenarios while collecting detailed data using different sensors. All of the test runs were recorded by both vehicles and infrastructure. The paper also showcases application examples to demonstrate the viability of the collected data having access to the ground truth labeling. This data set may support a large variety of solutions, for the test and validation of different kinds of approaches and techniques. As a complementary task, the available 5G network was monitored and tested under different radio conditions to investigate the latency results for different measurement scenarios. A part of the measured data has been shared openly, such that interested automotive and academic parties may use it for their own purposes.
Vehicle dynamics models are widely used in many areas of the automotive industry. The usability of each model depends on how well it is able to mimic the behavior of the real vehicle. Each simulation model must go through a thorough investigation process first, which is called model validation. Although, vehicle dynamics simulation models and methodology for computational model validation are well established fields, a general framework for vehicle dynamics model validation is still lacking. This project aims to develop a comprehensive methodological framework for vehicle dynamics model validation. In this paper the aim is to present the high level layout of the proposed framework, introducing the main blocks and the tasks related, also addressing some critical issues regarding vehicle dynamics model validation such as validation metrics and vehicle parameter measurement and estimation. An important part of the proposed methodology is a sophisticated vehicle dynamics measurement system, which gives the opportunity to estimate a bunch of vehicle parameters during dynamic testing, which can be useful for several reasons, e.g. fine-tuning the parameters of the Pacejka Magic formula. As a case study some vehicle dynamics test based parameter estimations are shown to justify the raison d’être and investigate possible applications.
In recent years, verification and validation processes of automated driving systems have been increasingly moved to virtual simulation, as this allows for rapid prototyping and the use of a multitude of testing scenarios compared to on-road testing. However, in order to support future approval procedures for automated driving functions with virtual simulations, the models used for this purpose must be sufficiently accurate to be able to test the driving functions implemented in the complete vehicle model. In recent years, the modelling of environment sensor technology has gained particular interest, since it can be used to validate the object detection and fusion algorithms in Model-in-the-Loop testing. In this paper, a practical process is developed to enable a systematic evaluation for perception–sensor models on a low-level data basis. The validation framework includes, first, the execution of test drive runs on a closed highway; secondly, the re-simulation of these test drives in a precise digital twin; and thirdly, the comparison of measured and simulated perception sensor output with statistical metrics. To demonstrate the practical feasibility, a commercial radar-sensor model (the ray-tracing based RSI radar model from IPG) was validated using a real radar sensor (ARS-308 radar sensor from Continental). The simulation was set up in the simulation environment IPG CarMaker® 8.1.1, and the evaluation was then performed using the software package Mathworks MATLAB®. Real and virtual sensor output data on a low-level data basis were used, which thus enables the benchmark. We developed metrics for the evaluation, and these were quantified using statistical analysis.
In this paper, a model predictive control (MPC) approach for controlling automated vehicle steering during path tracking is presented. A (linear parameter-varying) LPV vehicle plant model including steering dynamics is proposed to determine the system evolution matrices. The steering dynamics are modeled in two different ways by using first-order lag and a second-order lag; the application of the first-order system resulted in a slightly more accurate path-following. Additionally, a cascade MPC structure is applied in which two MPCs are used; the second-order steering dynamics are separated from the path-following controller in a second MPC. Both steering system models and the cascade MPC are evaluated in simulation and on a test vehicle. The reference trajectory is calculated based on a fixed predefined path by transforming the necessary path segment to the vehicle ego coordinate system, thereby describing the reference for the path-following task in a novel way. The MPC method computes the optimal steering angle vector at each time step for following the path. The longitudinal dynamics is controlled separately by a PI controller. After simulation evaluation, experimental tests were conducted on a test vehicle on an asphalt surface. Both simulation and experimental results prove the effectiveness of the proposed reference definition method. The effect of the applied steering system models is evaluated. The inclusion of the steering dynamics in the prediction model resulted in a significant increase in controller performance. Finally, the computational requirements of the proposed control and modeling methods are also discussed.
In this paper, a linear time-varying model predictive controller (LTV-MPC) is proposed for automated vehicle path-following applications. In the field of path following, the application of nonlinear MPCs is becoming more common; however, the major disadvantage of this algorithm is the high computational cost. During this research, the authors propose two methods to reduce the nonlinear terms: one is a novel method to define the path-following problem by transforming the path according to the actual state of the vehicle, while the other one is the application of a successive linearization technique to generate the state–space representation of the vehicle used for state prediction by the MPC. Furthermore, the dynamic effect of the steering system is examined as well by modeling the steering dynamics with a first-order lag. Using the proposed method, the necessary segment of the predefined path is transformed, the linearized model of the vehicle is calculated, and the optimal steering control vector is calculated for a finite horizon at every timestep. The longitudinal dynamics of the vehicle are controlled separately from the lateral dynamics by a PI cruise controller. The performance of the controller is evaluated and the effect of the steering model is examined as well.