Although there are well established object detection methods based on static images, their application to video data on a frame by frame basis faces two shortcomings: (i) lack of computational efficiency due to redundancy across image frames or by not using a temporal and spatial correlation of features across image frames, and (ii) lack of robustness to real-world conditions such as motion blur and occlusion. Since the introduction of the ImageNet Large Scale Visual Recognition Challenge (ILSVRC) in 2015, a growing number of methods have appeared in the literature on video object detection, many of which have utilized deep learning models. The aim of this paper is to provide a review of these papers on video object detection. An overview of the existing datasets for video object detection together with commonly used evaluation metrics is first presented. Video object detection methods are then categorized and a description of each of them is stated. Two comparison tables are provided to see their differences in terms of both accuracy and computational efficiency. Finally, some future trends in video object detection to address the challenges involved are noted.

The Unscented Kalman filter (UKF) may suffer from performance degradation and even divergence while mismatch between the noise distribution assumed as a priori by users and the actual ones in a real nonlinear system. To resolve this problem, this paper proposes a robust adaptive UKF (RAUKF) to improve the accuracy and robustness of state estimation with uncertain noise covariance. More specifically, at each timestep, a standard UKF will be implemented first to obtain the state estimations using the new acquired measurement data. Then an online fault-detection mechanism is adopted to judge if it is necessary to update current noise covariance. If necessary, innovation-based method and residual-based method are used to calculate the estimations of current noise covariance of process and measurement, respectively. By utilizing a weighting factor, the filter will combine the last noise covariance matrices with the estimations as the new noise covariance matrices. Finally, the state estimations will be corrected according to the new noise covariance matrices and previous state estimations. Compared with the standard UKF and other adaptive UKF algorithms, RAUKF converges faster to the actual noise covariance and thus achieves a better performance in terms of robustness, accuracy, and computation for nonlinear estimation with uncertain noise covariance, which is demonstrated by the simulation results.

The aim of an automatic video-based facial expression recognition system is to detect and classify human facial expressions from image sequence. An integrated automatic system often involves two components: 1) peak expression frame detection and 2) expression feature extraction. In comparison with the image-based expression recognition system, the video-based recognition system often performs online detection, which prefers low-dimensional feature representation for cost-effectiveness. Moreover, effective feature extraction is needed for classification. Many recent recognition systems often incorporate rich additional subjective information and thus become less efficient for real-time application. In our facial expression recognition system, first, we propose the double local binary pattern (DLBP) to detect the peak expression frame from the video. The proposed DLBP method has a much lower-dimensional size and can successfully reduce detection time. Besides, to handle the illumination variations in LBP, logarithm-laplace (LL) domain is further proposed to get a more robust facial feature for detection. Finally, the Taylor expansion theorem is employed in our system for the first time to extract facial expression feature. We propose the Taylor feature pattern (TFP) based on the LBP and Taylor expansion to obtain an effective facial feature from the Taylor feature map. Experimental results on the JAFFE and Cohn-Kanade data sets show that the proposed TFP method outperforms some state-of-the-art LBP-based feature extraction methods for facial expression feature extraction and can be suited for real-time applications.

Energy efficiency is a key performance metric for ultra-dense wireless sensor networks. In this letter, an unsupervised learning approach for topology control is proposed to prolong the lifetime of ultra-dense wireless sensor networks by balancing energy consumption. By encoding sensors as genes according to the network clusters, the proposed genetic-based algorithm learns an optimum chromosome to construct a close-to-optimum network topology using unsupervised learning in probability. Moreover, it schedules some of the cluster members to sleep to conserve the node energy using geographically adaptive fidelity. Simulation results demonstrate the superior performance of the proposed algorithm by improving energy efficiency in comparison with state-of-the-art algorithms at an acceptable computational complexity.

This paper addresses real-time moving object detection with high accuracy in high-resolution video frames. A previously developed framework for moving object detection is modified to enable real-time processing of high-resolution images. First, a computationally efficient method is employed, which detects moving regions on a resized image while maintaining moving regions on the original image with mapping coordinates. Second, a light backbone deep neural network in place of a more complex one is utilized. Third, the focal loss function is employed to alleviate the imbalance between positive and negative samples. The results of the extensive experimentations conducted indicate that the modified framework developed in this paper achieves a processing rate of 21 frames per second with 86.15% accuracy on the dataset SimitMovingDataset, which contains high-resolution images of the size 1920 × 1080.

Different from conventional wireless sensor networks (WSNs), ultra-reliable and low-latency WSNs (uRLLWSNs), being an important application of 5G networks, must meet more stringent performance requirements. In this paper, we propose a novel algorithm to improve uRLLWSNs performance by applying machine learning techniques and genetic algorithms. Using the K-means clustering algorithm to construct a 2-tier network topology, the proposed algorithm designs the fetal dataset, denoted by the population, and develops a clustering method of energy conversion to prevent overloaded cluster heads. A multi-objective optimization model is formulated to simultaneously satisfy multiple optimization objectives including the longest network lifetime and the highest network connectivity and reliability. Under this model, the principal component analysis algorithm is adopted to eliminate the various optimization objectives’ dependencies and rank their importance levels. Considering the NP-hardness of wireless network scheduling, the genetic algorithm is used to identify the optimal chromosome for designing a near-optimal clustering network topology. Moreover, we prove the convergence of the proposed algorithm both locally and globally. Simulation results are presented to demonstrate the viability of the proposed algorithm compared to state-of-the-art algorithms at an acceptable computational complexity.