In recent years, research concerning autonomous driving has gained momentum to enhance road safety and traffic efficiency. Relevant concepts are being applied to the fields of perception, planning, and control of automated vehicles to leverage the advantages offered by the vehicle-to-everything (V2X) communication technology. This paper presents a V2X communication-aided autonomous driving system for vehicles. It is comprised of three subsystems: beyond line-of-sight (BLOS) perception, extended planning, and control. Specifically, the BLOS perception subsystem facilitates unlimited LOS environmental perception through data fusion between local perception using on-board sensors and communication perception via V2X. In the extended planning subsystem, various algorithms are presented regarding the route, velocity, and behavior planning to reflect real-time traffic information obtained utilizing V2X communication. To verify the results, the proposed system was integrated into a full-scale vehicle that participated in the 2019 Hyundai Autonomous Vehicle Competition held in K-city with the V2X infrastructure. Using the proposed system, the authors demonstrated successful completion of all assigned real-life-based missions, including emergency braking caused by a jaywalker, detouring around a construction site ahead, complying with traffic signals, collision avoidance, and yielding the ego-lane for an emergency vehicle. The findings of this study demonstrated the possibility of several potential applications of V2X communication with regard to autonomous driving systems.
16 February 2021 in IEEE Robotics and Automation Letters
Autonomous driving in an urban environment with surrounding agents remains challenging. One of the key challenges is to accurately predict the traversability map that probabilistically represents future trajectories considering multiple contexts: inertial, environmental, and social. To address this, various approaches have been proposed; however, they mainly focus on considering the individual context. In addition, most studies utilize expensive prior information (such as HD maps) of the driving environment, which is not a scalable approach. In this study, we extend a deep inverse reinforcement learning-based approach that can predict the traversability map while incorporating multiple contexts for autonomous driving in a dynamic environment. Instead of using expensive prior information of the driving scene, we propose a novel deep neural network to extract contextual cues from sensing data and effectively incorporate them in the output, i.e., the reward map. Based on the reward map, our method predicts the ego-centric traversability map that represents the probability distribution of the plausible and socially acceptable future trajectories. The proposed method is qualitatively and quantitatively evaluated in real-world traffic scenarios with various baselines. The experimental results show that our method improves the prediction accuracy compared to other baseline methods and can predict future trajectories similar to those followed by a human driver.
Autonomous driving in an urban environment is one of the most actively studied topics. To date, many studies on autonomous driving can be classified into two main approaches: 1.local perception-based approach 2.global path tracking-based approach. However, each approach has its own limitations for fully autonomous driving. In the case of perception-based approach, it is impossible to autonomously drive to the global destination because it only runs locally within the sensor range. On the other hand, the path tracking-based approach relies heavily on accurate navigation. For accurate navigation, there are many studies using expensive equipment or extremely precise and detailed maps, but they have not been resolved yet, and they are also not practical. In this paper, we address the problem of autonomous driving in an urban environment through the proposed hybrid control architecture. Proposed control architecture is designed to be complementary of local perception-based and global path tracking-based approaches. Especially, end-to-end deep learning based autonomous driving, which mimics human driving, is applied as a local perceptionbased approach. In addition, path tracking-based autonomous driving is performed in an environment where directional information to the destination is required, such as intersections. At the same time, our hybrid control architecture effectively compensates for the navigation error using ICP matching between the perception-based driven trajectory and the global path to the destination without any highly detailed prior map or expensive equipment. The performance of the proposed architecture on a full-scale autonomous vehicle is verified through experiments in the urban environment.
End-to-end autonomous driving approach, which directly maps raw input images to vehicle control commands using a deep neural network, is gaining considerable attention from both academia and industry. Researchers have conducted studies on this subject over the past few years. However, they have focused on designing network architecture, and evaluated performance only with root mean square error (RMSE), which did not account for the temporal dynamics of autonomous driving. In this paper, we propose a time-to-line crossing (TLC) enhanced end-to-end driving framework. The proposed framework is original to the industry in three ways. First, for the fine-labeled training dataset for end-to-end autonomous driving, the TLC based label correction algorithm is applied to reduce the inaccuracies of driver action, which is used as a ground truth. Second, we designed a novel deep neural network model based on bi-directional convolutional long short-term memory (bi-CLSTM) which can sufficiently encode the spatial and temporal features in the input image sequence. Third, in addition to the RMSE evaluation metric, we validated the performance of the end-to-end driving model using TLC, the advanced driving support system (ADAS), and a driver performance indicator. We integrated the proposed framework with existing end-to-end driving models on a full-scale autonomous vehicle in the experimental portion of our study. The results show that the proposed framework is valid and that our network model outperforms the existing models in terms of both RMSE and TLC.