Advances in deep learning recognition have led to accurate object detection with 2D images. However, these 2D perception methods are insufficient for complete 3D world information. Concurrently, advanced 3D shape estimation approaches focus on the shape itself, without considering metric scale. These methods cannot determine the accurate location and orientation of objects. To tackle this problem, we propose a framework that jointly estimates a metric scale shape and pose from a single RGB image. Our framework has two branches: the Metric Scale Object Shape branch (MSOS) and the Normalized Object Coordinate Space branch (NOCS). The MSOS branch estimates the metric scale shape observed in the camera coordinates. The NOCS branch predicts the normalized object coordinate space (NOCS) map and performs similarity transformation with the rendered depth map from a predicted metric scale mesh to obtain 6D pose and size. Additionally, we introduce the Normalized Object Center Estimation (NOCE) to estimate the geometrically aligned distance from the camera to the object center. We validated our method on both synthetic and real-world datasets to evaluate category-level object pose and shape.
26 July 2019 in IEEE Transactions on Intelligent Transportation Systems
In this paper, a method to generate the downward image of current vehicle location using a commercial around view monitor (AVM) is proposed. The proposed system consists of three stages, namely feature tracking, obstacle filtering, and downward view generation. In the feature tracking stage, the Shi-Tomasi corner detection is used and feature tracking is performed with a Kanade-Lucas-Tomasi (KLT) tracker to determine the transformation between AVM images. In the obstacle filtering stage, features on obstacles are filtered by using the difference in a tracking distance between features detected on the ground and features detected on the obstacle. This is performed by using a histogram based on the tracking distance of features. Finally, in the downward view generation stage, transformation between the current AVM image and the previous AVM image is obtained by using the tracked feature pair refined via the aforementioned steps. Specifically, the random sample consensus (RANSAC) method is used to obtain transformations from which the influence of outliers is removed. The downward image of the current vehicle is generated by the obtained transformation and is synthesized to the existing AVM image. The results indicate that the proposed system synthesizes the existing AVM image and the generated downward image of a vehicle in a seamless way by determining the exact pair of matching points between current and the previous AVM images. We believe the proposed system can be utilized in efficient wireless charging system and safe driving system.