For sustainable operation and maintenance of urban railway infrastructure, intelligent visual inspection of the railway infrastructure attracts increasing attention to avoid unreliable, manual observation by humans at night, while trains do not operate. Although various automatic approaches were proposed using image processing and computer vision techniques, most of them are focused only on railway tracks. In this paper, we present a novel railway inspection system using facility detection based on deep convolutional neural network and computer vision-based image comparison approach. The proposed system aims to automatically detect wears and cracks by comparing a pair of corresponding image sets acquired at different times. We installed line scan camera on the roof of the train. Unlike an area-based camera, the line scan camera quickly acquires images with a wide field of view. The proposed system consists of three main modules: (i) image reconstruction for registration of facility positions, (ii) facility detection using an improved single shot detector, and (iii) deformed region detection using image processing and computer vision techniques. In experiments, we demonstrate that the proposed system accurately finds facilities and detects their potential defects. For that reason, the proposed system can provide various advantages such as cost reduction for maintenance and accident prevention.
Acquisition of stabilized video is an important issue for various type of digital cameras. This paper presents an adaptive camera path estimation method using robust feature detection to remove shaky artifacts in a video. The proposed algorithm consists of three steps: (i) robust feature detection using particle keypoints between adjacent frames; (ii) camera path estimation and smoothing; and (iii) rendering to reconstruct a stabilized video. As a result, the proposed algorithm can estimate the optimal homography by redefining important feature points in the flat region using particle keypoints. In addition, stabilized frames with less holes can be generated from the optimal, adaptive camera path that minimizes a temporal total variation (TV). The proposed video stabilization method is suitable for enhancing the visual quality for various portable cameras and can be applied to robot vision, driving assistant systems, and visual surveillance systems.
14 May 2020 in IEEE Transactions on Intelligent Transportation Systems
Advanced driver-assistance systems need a camera calibration algorithm for various vision applications including surround-view monitoring (SVM) and lane departure warning (LDW). Although cameras mounted on a vehicle are calibrated in the manufacturing process, their orientation angles are subject to tilting because of continuing vibration and external impact. To solve the problem, this paper presents an online calibration algorithm for camera orientation estimation using motion vectors and three-dimensional geometry. The proposed algorithm consists of three steps: i) driving direction estimation by calculating an intersection of motion vectors, ii) camera orientation estimation based on 3-line random sample consensus (RANSAC) using the estimated intersection, and iii) final orientation decision using extended Kalman filter from the result of each frame. Experimental results demonstrate that the proposed algorithm stably estimates camera orientation angles from motion vectors and lines under the parallelism and orthogonality assumptions.
31 December 2018 in IEIE Transactions on Smart Processing & Computing