8 March 2022 in IEEE Transactions on Intelligent Transportation Systems
Lane-merging scenarios pose highly challenging problems for autonomous vehicles due to conflicts of interest between the human-driven and cutting-in autonomous vehicles. Such conflicts become severe when traffic increases, and cut-in algorithms suffer from a steep trade-off between safety and cut-in performance. In this study, a reinforcement learning (RL)-based cut-in policy network nested within a finite state machine (FSM)—which is a high-level decision maker, is proposed to achieve high cut-in performance without sacrificing safety. This FSM-RL hybrid approach is proposed to obtain 1) a strategic and adjustable algorithm, 2) optimal safety and cut-in performance, and 3) robust and consistent performance. In the high-level decision making algorithm, the FSM provides a framework for four cut-in phases (ready for safe gap selection, gap approach, negotiation, and lane-change execution) and handles the transitions between these phases by calculating the collision risks associated with target vehicles. For the lane-change phase, a policy-based deep-RL approach with a soft actor–critic network is employed to get optimal cut-in performance. The results of simulations show that the proposed FSM-RL cut-in algorithm consistently achieves a high cut-in success rate without sacrificing safety. In particular, as the traffic increases, the cut-in success rate and safety are significantly improved over existing optimized rule-based cut-in algorithms and end-to-end RL algorithm.
22 December 2022 in IEEE Robotics and Automation Letters
Prior studies in the field of motion predictions for autonomous driving tend to focus on finding a trajectory that is close to the ground truth trajectory, which is highly biased toward straight maneuvers. Such problem formulations and imbalanced distribution of datasets, however, frequently lead to a loss of diversity and biased trajectory predictions. Therefore, they are unsuitable for real-world autonomous driving, where diverse and road-dependent multimodal trajectory predictions are critical for safety. To this end, this study proposes a novel trajectory prediction model that ensures map-adaptive diversity and accommodates geometric constraints. A two-stage trajectory prediction architecture with a novel trajectory candidate proposal module, Trajectory Prediction Attention (TPA) , which is trained with Lane Loss , encourages multiple trajectories to be diversely distributed in a map-aware manner. Furthermore, the diversity of multiple trajectory predictions cannot be properly evaluated by existing metrics, and thus a novel quantitative evaluation metric, termed the minimum lane final displacement error (minLaneFDE), is also proposed to evaluate the diversity as well as the accuracy of multiple trajectory predictions. Experiments conducted on the Argoverse dataset show that the proposed method simultaneously improves the diversity and accuracy of the predicted trajectories.
8 August 2019 in IEEE Transactions on Intelligent Transportation Systems
Predicting future motions of surrounding vehicles and driver's intentions are essential to avoid future potential risks. The predicting future motions, however, is very challenging because the future cannot be deterministically known a priori and there are infinitely many possible future trajectories. Prediction becomes far more challenging when trying to foresee distant future. This paper proposes a probabilistic motion prediction algorithm that can accurately compute the likelihood of multiple target lanes and trajectories of surrounding vehicles by using the artificial neural network; more specifically radial base function network (RBFN). The RBFN prediction algorithm estimates the likelihood of each lane being the driver's target lane in categorical distributions and the corresponding future trajectories in parallel. In order to demonstrate the effectiveness of the proposed prediction algorithm, it is applied for the predictive cruise control problem. Chance-constrained model predictive control (CCMPC) is utilized because the chance constraints in CCMPC can handle collision uncertainties associated with future uncertainties from the proposed prediction algorithm. The RBFN-based CCMPC simulation is conducted for several risky cut-in scenarios and compared with the state-of-the-art Interactive Multiple Model (IMM)-based prediction algorithm. The simulation results show that the RBFN-based CCMPC achieves higher collision avoidance success rate than that of the IMM-based CCMPC while using smaller actuator inputs and providing higher passenger comforts. Furthermore, the RBFN-based CCMPC showed high robustness to false braking during near lane-change (lane-keeping) scenarios.
1 October 2022 in Transaction of the Korean Society of Automotive Engineers
17 May 2023 in IEEE Transactions on Intelligent Transportation Systems
To make intelligent decisions in an autonomous vehicle, the system must predict the future reactions of surrounding vehicles for any given action plan of the ego vehicle. However, learning reactive trajectories is challenging due to scant action-reaction pair data. That is, building a dataset with multiple action-reaction pairs for an identical scene history is impossible in reality. Here, we propose a semi-supervised learning framework with auxiliary structures to handle this problem. The proposed training framework has two modules: Action Reconstructor and Identifier modules with corresponding loss functions referred to as the Reconstruction Loss and Association Loss . In addition to the conventional supervised approach pertaining to readily available data, the Action Reconstructor module is employed to learn the dependencies on the ego vehicle in an unsupervised manner. Furthermore, reaction trajectory data corresponding to the augmented future trajectories of the ego vehicle are not available, meaning that the model must be trained in an unsupervised manner as well. The main idea of the proposed unsupervised learning method is to find the identity feature vector from both history and future trajectories and associate these features for each vehicle. This idea is realized by introducing the Identifier network and the Association Loss , which are used only during the training process. Interestingly, experimental results show that plausible reaction can be predicted for the augmented future trajectory of the ego vehicle, which indicates that the network can generalize the interactive behavior of vehicles from a partially labelled dataset.