Modeling the spatiotemporal relationship (STR) of traffic data is important yet challenging for existing graph networks. These methods usually capture features separately in temporal and spatial dimensions or represent the spatiotemporal data by adopting multiple local spatial-temporal graphs. The first kind of method mentioned above is difficult to capture potential temporal-spatial relationships, while the other is limited for long-term feature extraction due to its local receptive field. To handle these issues, the Synchronous Spatio-Temporal grAph Transformer (S²TAT) network is proposed for efficiently modeling the traffic data. The contributions of our method include the following: 1) the nonlocal STR can be synchronously modeled by our integrated attention mechanism and graph convolution in the proposed S²TAT block; 2) the timewise graph convolution and multihead mechanism designed can handle the heterogeneity of data; and 3) we introduce a novel attention-based strategy in the output module, being able to capture more valuable historical information to overcome the shortcoming of conventional average aggregation. Extensive experiments are conducted on PeMS datasets that demonstrate the efficacy of the S²TAT by achieving a top-one accuracy but less computational cost by comparing with the state of the art.
29 October 2018 in IEEE Transactions on Information Forensics and Security
Security surveillance is critical to social harmony and people’s peaceful life. It has a great impact on strengthening social stability and life safeguarding. Detecting anomaly timely, effectively and efficiently in video surveillance remains challenging. This paper proposes a new approach, called S2-VAE, for anomaly detection from video data. The S2-VAE consists of two proposed neural networks: a Stacked Fully Connected Variational AutoEncoder (SF - VAE) and a Skip Convolutional VAE (SC-VAE). The SF -VAE is a shallow generative network to obtain a model like Gaussian mixture to fit the distribution of the actual data. The SC-VAE, as a key component of S2- VAE, is a deep generative network to take advantages of CNN, VAE and skip connections. Both SF -VAE and SC-VAE are efficient and effective generative networks and they can achieve better performance for detecting both local abnormal events and global abnormal events. The proposed S2-VAE is evaluated using four public datasets. The experimental results show that the S2-VAE outperforms the state-of-the-art algorithms. The code is available publicly at https://github.com/tianwangbuaa/.
7 April 2014 in IEEE Transactions on Information Forensics and Security
The aim of this paper is to detect abnormal events in video streams, a challenging but important subject in video surveillance. We propose a novel algorithm to address this problem. The algorithm is based on an image descriptor and a nonlinear classification method. We introduce a histogram of optical flow orientation as a descriptor encoding the moving information of each video frame. The nonlinear one-class support vector machine classification algorithm, following a learning period characterizing the normal behavior of training frames, detects abnormal events in the current frame. Further, a fast version of the detection algorithm is designed by fusing the optical flow computation with a background subtraction step. We finally apply the method to detect abnormal events on several benchmark data sets, and show promising results.