This paper presents an approach for detecting anomalous events in videos with crowds. The main goal is to recognize patterns that might lead to an anomalous event. An anomalous event might be characterized by the deviation from the normal or usual, but not necessarily in an undesirable manner, e.g., an anomalous event might just be different from normal but not a suspicious event from the surveillance point of view. One of the main challenges of detecting such events is the difficulty to create models due to their unpredictability and their dependency on the context of the scene. Based on these challenges, we present a model that uses general concepts, such as orientation, velocity, and entropy to capture anomalies. Using such a type of information, we can define models for different cases and environments. Assuming images captured from a single static camera, we propose a novel spatiotemporal feature descriptor, called histograms of optical flow orientation and magnitude and entropy, based on optical flow information. To determine the normality or abnormality of an event, the proposed model is composed of training and test steps. In the training, we learn the normal patterns. Then, during test, events are described and if they differ significantly from the normal patterns learned, they are considered as anomalous. The experimental results demonstrate that our model can handle different situations and is able to recognize anomalous events with success. We use the well-known UCSD and Subway data sets and introduce a new data set, namely, Badminton.
Modeling human behavior and activity patterns for recognition or detection of anomalous events has attracted significant research interest in recent years, particularly among the video surveillance community. An anomalous event might be characterized as an event that deviates from the normal or usual, but not necessarily in an undesirable manner, e.g., An anomalous event might just be different from normal but not a suspicious event from the surveillance stand point. One of the main challenges of detecting such events is the difficulty to create models due to their unpredictability. Therefore, most works model the expected patterns on the scene, instead, based on video sequences where anomalous events do not occur. Assuming images captured from a single camera, we propose a novel spatiotemporal feature descriptor, called Histograms of Optical Flow Orientation and Magnitude (HOFM), based on optical flow information to describe the normal patterns on the scene, so that we can employ a simple nearest neighbor search to identify whether a given unknown pattern should be classified as an anomalous event. Our descriptor captures spatiotemporal information from cuboids (regions with spatial and temporal support) and encodes both magnitude and orientation of the optical flow separately into histograms, differently from previous works, which are based only on the orientation. The experimental evaluation demonstrates that our approach is able to detect anomalous events with success, achieving better results than the descriptor based only on optical flow orientation and outperforming several state-of-the-art methods on one scenario (Peds2) of the well-known UCSD anomaly data set, and achieving comparable results in the other scenario (Peds1).
In most surveillance traffic systems the background image is used for segmenting the moving objects. In this paper, we propose a method for progressive and constant renewal of the background image of a video sequence. Our method is divided in three parts: frame difference to get an actual information of the video sequence, reward and penalty function that modifies a temporal histogram, and the background generation uses the information found in the histogram. The principal characteristic of the method is the constant regeneration of the histogram using neighborhood information of intensity levels, penalizing the occurrence of foreign objects and rewarding the values of static objects. For that, the histogram values are modified regionally and its variation correspond to a normal distribution. The principal advantages of our proposed method lies in the progressive increment of the background pixel intensity occurrences, the fast reaction to changes between foreground and background segments and the simplicity of the method that can be used in real time applications. At the end of this paper, experimental results demonstrated the feasibility of the proposed technique in different weather conditions and traffic situations.
To cope with the challenges that low light conditions produce in images, photographers tend to use the light provided by the camera flash to get better illumination. Nevertheless, harsh shadows and non-uniform illumination can arise from using a camera flash, especially in low light conditions. Previous studies have focused on normalizing the lighting on flash images; however, to the best of our knowledge, no prior studies have examined the sideways shadows removal, reconstruction of overexposed areas, and the generation of synthetic ambient shadows or natural tone of scene objects. To provide more natural illumination on flash images and ensure high-frequency details, we propose a generative adversarial network in a guided conditional mode. We show that this approach not only generates natural illumination but also attenuates harsh shadows, simultaneously generating synthetic ambient shadows. Our approach achieves promising results on a custom FAID dataset, outperforming our baseline studies. We also analyze the components of our proposal and how they affect the overall performance and discuss the opportunities for future work.