Intelligent vehicles and advanced driver assistance systems (ADAS) need to have proper awareness of the traffic context as well as the driver status since ADAS share the vehicle control authorities with the human driver. This study provides an overview of the ego-vehicle driver intention inference (DII), which mainly focus on the lane change intention on highways. First, a human intention mechanism is discussed in the beginning to gain an overall understanding of the driver intention. Next, the ego-vehicle driver intention is classified into different categories based on various criteria. A complete DII system can be separated into different modules, which consists of traffic context awareness, driver states monitoring, and the vehicle dynamic measurement module. The relationship between these modules and the corresponding impacts on the DII are analyzed. Then, the lane change intention inference (LCII) system is reviewed from the perspective of input signals, algorithms, and evaluation. Finally, future concerns and emerging trends in this area are highlighted.
17 January 2019 in IEEE Transactions on Intelligent Transportation Systems
A motion planning method for autonomous vehicles confronting emergency situations where collision is inevitable, generating a path to mitigate the crash as much as possible, is proposed in this paper. The Model predictive control (MPC) algorithm is adopted here for motion planning. If avoidance is impossible for the model predictive motion planning system, the potential crash severity, and artificial potential field are filled into the controller objective to achieve general obstacle avoidance and the lowest crash severity. Furthermore, the vehicle dynamic is also considered as an optimal control problem. Based on the analysis mentioned earlier, the model predictive controller can optimize the command following, obstacle avoidance, vehicle dynamics, road regulation, and mitigate the inevitable crash based on the predicted values. The proposed MPC algorithm has been proved by simulation to have the ability to avoid obstacles and mitigate the crash if collision is inevitable.
3 July 2019 in IEEE Transactions on Vehicular Technology
It is essential to develop proper energy management strategies (EMSs) with broad adaptability for hybrid electric vehicles (HEVs). This paper utilizes deep reinforcement learning (DRL) to develop EMSs for a series HEV (SHEV) due to DRL's advantages of requiring no future driving information in derivation and good generalization in solving energy management problem formulated as a Markov decision process (MDP). History cumulative trip information is also integrated for effective State of Charge (SoC) guidance in DRL-based EMSs. The proposed method is systematically introduced from offline training to online applications; its learning ability, optimality, and generalization are validated by comparisons with fuel economy benchmark optimized by dynamic programming (DP), and real-time EMSs based on model predictive control (MPC). Simulation results indicate that without priori knowledge of future trip, original DRL-based EMS achieves an average 3.5% gap from benchmark, superior to MPC-based EMS with accurate prediction; after further applying output frequency adjustment, a mean gap of 8.7%, which is comparable with MPC-based EMS with mean prediction error of 1m/s, is maintained with concurrently noteworthy improvement in reducing engine start times. Besides, its impressive computation speed of about 0.001s per simulation step proves its practical application potential, and this method is independent of powertrain topology such that it is applicative for any type of HEVs even when future driving information is unavailable.
5 July 2022 in IEEE Transactions on Intelligent Vehicles
Motion prediction is the fundamental input for decision-making in autonomous vehicles. The current motion prediction solutions are designed with a strong reliance on black box predictions based on neural networks (NNs), which is unacceptable for safety-critical applications. Motion prediction with high uncertainty can cause conflicting decisions and even catastrophic results. To address this issue, an uncertainty estimation approach based on the deep ensemble technique is proposed for motion prediction in this paper. Subsequently, the estimated uncertainty is considered in the decision-making module to improve driving safety. Firstly, a motion prediction model based on long short-term memory (LSTM) is built and the deep ensemble technique is utilized to obtain both epistemic and aleatoric uncertainty of the prediction model. Besides, an uncertainty-aware potential field is developed to process the prediction uncertainty. Furthermore, a decision-making framework is proposed based on the model predictive control algorithm that considers the uncertainty-aware potential field, road boundaries, and multiple constraints of vehicle dynamics. Finally, the public available NGSIM, HighD and INTERACTION datasets are used to evaluate the proposed motion prediction model. More importantly, two traffic scenarios are also extracted from NGSIM and INTERACTION datasets to verify the effectiveness of the proposed decision-making method and in particular, its real-time performance is shown by employing a hardware-in-the-loop (HiL) experiment bench.
24 April 2023 in IEEE Transactions on Vehicular Technology
Reinforcement learning (RL) methods are commonly regarded as effective solutions for designing intelligent driving policies. Nonetheless, even if the RL policy is converged after training, it is notoriously difficult to ensure safety. In particular, RL policy is susceptible to insecurity in the presence of long-tail or unseen traffic scenarios, i.e. , out-of-distribution test data. Therefore, the design of the RL-based decision-making method must account for this shift in distribution. This paper proposes a robust decision-making framework for autonomous driving on the highway to improve driving safety. First, a Deep Deterministic Policy Gradient (DDPG)-based RL policy that directly maps observations to actions is constructed. Subsequently, the model uncertainty of the DDPG policy is evaluated at runtime to quantify the policy's reliability and identify unseen scenarios. In addition, a complementary principle-based policy is developed using the intelligent driver model (IDM) and the model for minimizing overall braking induced by lane changes (MOBIL). It will take over the DDPG policy when encountering unseen scenarios to guarantee a lower-bound performance of the decision-making system. Finally, the proposed method is implemented on an embedded system, i.e. , NVIDIA Jetson AGX Xavier, and out-of-training distribution challenging cases are considered in the experiment, i.e. , observation with sensor noise, traffic density increasing significantly, objects falling from the front vehicle, and road construction causing temporal changes in road structure. Results indicate that the proposed framework outperforms state-of-the-art benchmarks. Additionally, the code is provided https://github.com/Kayne0401/Robust-Decision-Making-Framework .