Although there are well established object detection methods based on static images, their application to video data on a frame by frame basis faces two shortcomings: (i) lack of computational efficiency due to redundancy across image frames or by not using a temporal and spatial correlation of features across image frames, and (ii) lack of robustness to real-world conditions such as motion blur and occlusion. Since the introduction of the ImageNet Large Scale Visual Recognition Challenge (ILSVRC) in 2015, a growing number of methods have appeared in the literature on video object detection, many of which have utilized deep learning models. The aim of this paper is to provide a review of these papers on video object detection. An overview of the existing datasets for video object detection together with commonly used evaluation metrics is first presented. Video object detection methods are then categorized and a description of each of them is stated. Two comparison tables are provided to see their differences in terms of both accuracy and computational efficiency. Finally, some future trends in video object detection to address the challenges involved are noted.
The Unscented Kalman filter (UKF) may suffer from performance degradation and even divergence while mismatch between the noise distribution assumed as a priori by users and the actual ones in a real nonlinear system. To resolve this problem, this paper proposes a robust adaptive UKF (RAUKF) to improve the accuracy and robustness of state estimation with uncertain noise covariance. More specifically, at each timestep, a standard UKF will be implemented first to obtain the state estimations using the new acquired measurement data. Then an online fault-detection mechanism is adopted to judge if it is necessary to update current noise covariance. If necessary, innovation-based method and residual-based method are used to calculate the estimations of current noise covariance of process and measurement, respectively. By utilizing a weighting factor, the filter will combine the last noise covariance matrices with the estimations as the new noise covariance matrices. Finally, the state estimations will be corrected according to the new noise covariance matrices and previous state estimations. Compared with the standard UKF and other adaptive UKF algorithms, RAUKF converges faster to the actual noise covariance and thus achieves a better performance in terms of robustness, accuracy, and computation for nonlinear estimation with uncertain noise covariance, which is demonstrated by the simulation results.
Energy efficiency is a key performance metric for ultra-dense wireless sensor networks. In this letter, an unsupervised learning approach for topology control is proposed to prolong the lifetime of ultra-dense wireless sensor networks by balancing energy consumption. By encoding sensors as genes according to the network clusters, the proposed genetic-based algorithm learns an optimum chromosome to construct a close-to-optimum network topology using unsupervised learning in probability. Moreover, it schedules some of the cluster members to sleep to conserve the node energy using geographically adaptive fidelity. Simulation results demonstrate the superior performance of the proposed algorithm by improving energy efficiency in comparison with state-of-the-art algorithms at an acceptable computational complexity.
This paper addresses real-time moving object detection with high accuracy in high-resolution video frames. A previously developed framework for moving object detection is modified to enable real-time processing of high-resolution images. First, a computationally efficient method is employed, which detects moving regions on a resized image while maintaining moving regions on the original image with mapping coordinates. Second, a light backbone deep neural network in place of a more complex one is utilized. Third, the focal loss function is employed to alleviate the imbalance between positive and negative samples. The results of the extensive experimentations conducted indicate that the modified framework developed in this paper achieves a processing rate of 21 frames per second with 86.15% accuracy on the dataset SimitMovingDataset, which contains high-resolution images of the size 1920 × 1080.
Different from conventional wireless sensor networks (WSNs), ultra-reliable and low-latency WSNs (uRLLWSNs), being an important application of 5G networks, must meet more stringent performance requirements. In this paper, we propose a novel algorithm to improve uRLLWSNs performance by applying machine learning techniques and genetic algorithms. Using the K-means clustering algorithm to construct a 2-tier network topology, the proposed algorithm designs the fetal dataset, denoted by the population, and develops a clustering method of energy conversion to prevent overloaded cluster heads. A multi-objective optimization model is formulated to simultaneously satisfy multiple optimization objectives including the longest network lifetime and the highest network connectivity and reliability. Under this model, the principal component analysis algorithm is adopted to eliminate the various optimization objectives’ dependencies and rank their importance levels. Considering the NP-hardness of wireless network scheduling, the genetic algorithm is used to identify the optimal chromosome for designing a near-optimal clustering network topology. Moreover, we prove the convergence of the proposed algorithm both locally and globally. Simulation results are presented to demonstrate the viability of the proposed algorithm compared to state-of-the-art algorithms at an acceptable computational complexity.
In large field of view for open country, the real-time detection and identification of moving objects with high accuracy is a very challenging work due to the excessive amount of data. This paper proposes a novel framework that consists of a coarse-grained detection as well as a fine-grained detection. To solve the problem of noise-induced object fracture during the coarse-grained detection process, we present a low-complexity connected region detection algorithm to extract moving regions. Furthermore, in the finegrained detection, Deep Convolution Neural Networks are leveraged to detect more precise coordinates and identify the category of objects. To the best of our knowledge, this is the first work that proposes a coarse-tofine grained framework to detect moving objects on high-resolution scenes. Experimental results show that the proposed framework can robustly work on the high resolution video frames (1920*1080p) with complex situations more fastly and accurately over existing methods.