Visual tracking of multiple objects is an essential component for a perception system in autonomous driving vehicles. One of the favorable approaches is the tracking-by-detection paradigm, which links current detection hypotheses to previously estimated object trajectories (also known as tracks) by searching appearance or motion similarities between them. As this search operation is usually based on a very limited spatial or temporal locality, the association can fail in cases of motion noise or long-term occlusion. In this paper, we propose a novel tracking method that solves this problem by putting together information from both enlarged structural and temporal domain. For efficiency without loss of optimality, this approach is decomposed in to three stages, with each dealing with only one constrained association task, and thus, it follows the alternating optimization fashion. In our approach, detections are first assembled into small tracklets based on meta-measurements of object affinity. The association task for tracklets-to-tracks is solved by structural information based on a motion pattern between them. Here, we propose new rules to decouple the processing time from the tracklet length. Furthermore, constraints from temporal domain are introduced to recover objects, which are long-time disappearing due to failed detection or long-term occlusion. By putting together the heterogeneous domain information, our approach exhibits an improved state-of-the-art performance on standard benchmarks. With relatively little processing time, an online and real-time tracking is also permitted in our approach.
Despite the fact that in recent years, vision-based tracking approaches have made significant progress, the task of tracking vehicles at night still remains challenging. Visual information is strongly deteriorated or at least degraded due to poor illumination conditions. This reduces the perceptive ability of vision systems significantly and can even lead to target loss, resulting in false estimation and/or false prediction of object behavior. In this paper, we propose a novel online-learning method to track vehicles at night. Our method is based on the kernelized correlation filter and assembles different feature channels to kernelized experts. By estimating their reliabilities, we force the appearance model to focus on the most discriminative visual features to accomplish the classification. In addition, a temporal optimization step in conjunction with a memory model is used to remove outliers and keep the most reliable samples to train the tracker models. Experiments over various daytime and weather conditions show that our approach outperforms existing trackers at night and in case of bad weather while offering state-of-the-art performance in more favorable situations. As our tracker has only little computational cost, it is appropriate for use cases with real-time requirements like in automotive or industrial applications.
24 September 2018 in IEEE Intelligent Transportation Systems Magazine
Vision-based object tracking approach has been drawing increased attention from both the academia and the industry in recent years. One of its most successful applications is the monitoring system, which can be installed on infrastructures or on mobile platforms (e.g., vehicles) to track pedestrians or bicyclists in a pre-defined region and further to prevent probable accidents. Despite tremendous progress achieved, the task of visual tracking is still challenging, especially in dealing with severe occlusions, where the tracker may fail due to the abrupt change of object appearance. Such case is common not only in traffic scenarios but also in other tracking tasks. Aiming to tackle this problem, in this paper, we propose a new tracking approach by adopting part based trackers, which are built in the form of correlation filter. In this approach, the occluded object parts are identified by leveraging the knowledge derived from image features and filter responses. With the help of a masking process, visible object areas are acquired in a pixel-wise precision and utilized to build part filters. As both the number and size of part filters are adapted to the current object appearance, the influence of occlusions can be significantly suppressed. Experimental results on traffic sequences demonstrate that our tracker performs robust against occlusion, especially in cases, where long term and severe occlusions appear. A further experiment on the standard benchmark proves that our approach outperforms state-of-the-art methods in tracking various object classes under varied circumstances. Furthermore, the proposed tracker is sophisticatedly designed and is feasible for real time applications.