3 June 2022 in IEEE Access
Advanced Driver Assistance Systems (ADAS) are a collection of intelligent solutions integrated into next-generation vehicles to assist in safe driving. When building ADAS systems, the main goals are that they are stable, flexible, easy to maintain, and allow for error tracing. If a driving assistance algorithm is designed to be implemented on one machine or in one model, there is a potential disadvantage that if one component fails, then the entire system would stop. We work on modularizing the ADAS system to be flexible to accommodate any changes or improvements based on up-to-date requirements. Using advanced current edge (or network) devices, we propose a Detection-based Driving Assistance algorithm, which can collaborate or integrate with an existing system in a vehicle. The core of any process is to ensure that the system has a predictable level of functionality and that any misbehavior can be easily traced to the root cause. The proposed system shows fast, real-time performance on edge devices with limited computing power.
13 April 2023 in IEEE Transactions on Intelligent Transportation Systems
Traffic flow estimation is an essential task in modern intelligent transportation systems. Many types of information, including vehicle type, vehicle totals, and movement direction, are vital for mitigating transportation-related tasks and effective traffic control strategies. With the development of embedded devices, systems can process captured video at the edge instead of transferring data to centralized processing servers. This paper proposes a real-time and edge-based traffic flow estimation system. The proposed system follows a detect-and-track mechanism where lightweight deep learning models perform vehicle detection. A novel scenario-based tracking and counting technique is developed to provide multi-class, multi-movement vehicle counting. The method uses predefined regions to assign the movement for each vehicle initially detected. It then performs spatial-temporal trajectory matching between the vehicle trajectory and the movement path throughout the whole video. Extensive experiments have shown that the proposed method achieves high effectiveness with multiple camera types and viewpoints.
17 May 2024 in IEEE Access
While computer vision and computing technology advances have facilitated advanced driver assistance applications, systems with multi-task design remain highly demanding to operate at high speed on resource-constrained devices. Our study addresses this challenge by proposing a real-time driver assistance solution specifically developed for a single Jetson AGX Xavier embedded device. It simultaneously performs lane detection, traffic object detection and recognition, and rule-based scene analysis. To achieve high throughput (up to 43 frames per second) without reliance on additional hardware or cloud server, the system exploits Jetson device’s specialized AI accelerator and employs various optimization techniques: multithreaded programming, the TensorRT framework, and post-training quantization. The modular design integrates state-of-the-art task-specific methods and ensures adaptation to diverse traffic scenarios across countries as well as future hardware and solutions. Experimental results using a Korean dashcam traffic dataset validated the system’s effectiveness and practicality.
25 February 2021 in IEEE Transactions on Industrial Electronics
Rectification is a standard process in every system that requires multi-views. Existing algorithms largely work on similar field of view (FoV) cases where the two views are mostly identical. Dissimilarities between different FoVs can generate unexpected errors during the optimization process, resulting in a large amount of rectification errors and unwanted geometric distortion. In this study, we present a full pipeline to rectify uncalibrated images captured by cameras that have dissimilar FoVs under the constraints of geometric distortion. The proposed method contains two main parts: Field of View Neutralization, and Rectification with Adaptive Geometric Constraints. The Field of View Neutralization module estimates the transformation matrix to compensate for the imbalance between different views. In addition, this module improves the overall quality of correspondences by removing misleading feature matching pairs. Finally, by applying an adaptive optimization process with the geometric constraints involved, our method addresses the overdistortion issue while maintaining small rectification errors. Extensive experiments are conducted to demonstrate the robust performance of the proposed method. Besides the existing datasets, we provide our dissimilar FoVs dataset with multiple baselines to examine the performance. Our method outperforms the existing algorithms in terms of both rectification errors and geometric distortion rates.