1 March 1999 in Neural Networks
29 August 2013 in IEEE Transactions on Circuits and Systems for Video Technology
In this paper, we focus on the improvements of appearance representation for multihuman tracking. Many previous methods extracted low-level appearance features, such as color histogram and texture, even combined with spatial information for each frame. These methods ignore the temporal distribution of features. The features of each frame may not be stable due to illumination, human pose variation, and image noise. In order to improve it, we propose a novel appearance representation called the spatial-temporal appearance model based on the statistical distribution of Gaussian mixture model (GMM). It represents the appearance of a tracklet as a whole with dynamic spatial and temporal information. The spatial information is the dynamic subregions. The temporal information is the dynamic duration time of each subregion. Each subregion is modeled as the weighted Gaussian distribution of GMM. The online expectation-maximization (online EM) algorithm is used to estimate the parameters of GMM. Then, we propose a tracklet association method using Bayesian prediction and Jensen-Shannon divergence. The Bayesian prediction is used to predict the locations of targets. The Jensen-Shannon divergence is used to compute the distance of spatial-temporal appearance distribution between two tracklets. Finally, we test our approach on four challenging datasets (TRECVID, CAVIAR, ETH, and EPFL Terrace) and achieve good results.
1 May 2019 in Journal of Physics: Conference Series
With the rapid increase of cars, the research of license plate recognition in intelligent traffic algorithm has attracted much attention. In this paper, pointing at the shortcomings of the existing recognition algorithm, we adopt a license plate recognition method based on BP neural network with a median filtering. The method consists of a median filtering algorithm for denoising and a BP neural network for training and testing. First the character library is processed by median filtering to remove the influence of noise. Then, utilizing the strong learning ability of BP, the character library is passed into the network for classification. Compared with the traditional algorithm, our method not only speeds up the recognition efficiency, but also obtains more robust results. Therefore, the proposed approach can provide a technical support for the practical application of license plate recognizing.
11 July 2024 in ACM Transactions on Multimedia Computing, Communications, and Applications
Video captioning is a multimodal task on both CV and NLP, whose goal is to automatically obtain the description of video content with natural language statements. Although there are amounts of video data, their annotations with description sentences are very limited. In this paper, we define the semi-supervised video captioning (SSVC) problem in order to improve performance with limited annotations by leveraging the semantic knowledge from both well-annotated samples and no-annotated samples. To address the problem, we introduce a LCA-boosted model (LCABM) for boosting SSVC, where it is first to explore a learnable candidates adjuster to adjust the caption candidates and then treat these adjusted captions as pesudo labels to train the SSVC model with no-annotated samples in reverse. In particular, the model learning is considered as a bi-level optimization problem and solved by an EM-like multi-stage training algorithm. The experiments show the effectiveness of our proposed LCABM, whose performance is comparable and even better than those state-of-the-art fully-supervised methods even with less annotations.