Traffic light recognition is an indispensable elemental technology for automated driving in urban areas. In this study, we propose an algorithm that recognizes traffic lights and arrow lights by image processing using the digital map and precise vehicle pose which is estimated by a localization module. The use of a digital map allows the determination of a region-of-interest in an image to reduce the computational cost and false detection. In addition, this study develops an algorithm to recognize arrow lights using relative positions of traffic lights, and the arrow light is used as prior spatial information. This allows for the recognition of distant arrow lights that are difficult for humans to see clearly. Experiments were conducted to evaluate the recognition performance of the proposed method and to verify if it matches the performance required for automated driving. Quantitative evaluations indicate that the proposed method achieved 91.8% and 56.7% of the average f-value for traffic lights and arrow lights, respectively. It was confirmed that the arrow-light detection could recognize small arrow objects even if their size was smaller than 10 pixels. The verification experiments indicate that the performance of the proposed method meets the necessary requirements for smooth acceleration or deceleration at intersections in automated driving.
Localization is an important technology for autonomous driving. Map-matching using road surface pattern features gives accurate position estimation and has been used in autonomous driving tests on public roads. To provide highly safe autonomous driving, localization technology that is not affected by the environment is required. In particular, in snowy environments, the features of the road surface pattern may not be used for matching because the road surface is hidden. In such cases, it is necessary to construct a robust system by rejecting the matching results or making up for them with other sensors. On the other hand, millimeter-wave radar-based localization methods are not as accurate as LiDAR-based methods due to their ranging accuracy, but it has successfully achieved autonomous driving in snowy environments. Therefore, this paper proposes a localization method that combines LiDAR and millimeter-wave radar. We constructed a system that emphasizes LiDAR-based matching results during normal conditions when the road surface pattern is visible and emphasizes radar matching results when the road surface is not visible due to snow cover or other factors. This method achieves an accuracy that allows autonomous driving to continue regardless of normal or snowy conditions and more robust position estimation.
This paper demonstrates the weakness of GNSS/INS-RTK (GIR) systems in mapping challenging environments because of obstruction and deflection of satellite signals. Thus, it emphasizes that the strategy of mapping companies to commercially provide maps using expensive GIR systems does not always work robustly. This limits the scalability of autonomous vehicle deployment in many road structures and modern cities. Accordingly, different critical environments in Tokyo have been analyzed and investigated to demonstrate the effects of the road structure complexity on the GIR map quality with highlighting the relevant reasons. Therefore, this paper is intended to be a reference to prove that the data of GIR systems cannot always be considered as ground truth and the integration of SLAM technologies into the mapping modules is very necessary to enable the levels four and five of autonomous driving.
The automated driving is an emerging technology in which a car performs recognition, decision making, and control. The decision-making system consists of route planning and trajectory planning. The route planning optimizes the shortest path to the destination like an automotive navigation system. According to static and dynamic obstacles around the vehicle, the trajectory planning generates lateral and longitudinal profiles for vehicle maneuver to drive the given path. This study is focused on the trajectory planning for vehicle maneuver in urban traffic scenes. This paper proposes a trajectory generation method that extends the existing method to generate more natural behavior with small acceleration and deceleration. This paper introduces an intermediate behavior to gradually switch from the velocity keeping to the distance keeping. The proposed method can generate smooth trajectory with small acceleration/deceleration. Numerical experiments show that the vehicle generates smooth behaviors according to surrounding vehicles.
This Automated driving is an emerging technology in which a car performs recognition, decision making, and control. Recognizing surrounding vehicles is a key technology in order to generate a trajectory of ego vehicle. This paper is focused on detecting a turn signal information as one of the driver's intention for surrounding vehicles. Such information helps to predict their behavior in advance especially about lane change and turn left-or-right on intersection. Using their intension, the automated vehicle is able to generate the safety trajectory before they begin to change their behavior. The proposed method recognizes the turn signal for target vehicle based on mono-camera. It detects lighting state using Convolutional Neural Network, and then calculates a flashing frequency using Fast Fourier Transform.