The ability of real-time detection and recognition of abnormal behavior in video monitoring system is a key problem in intelligent monitoring system. This paper proposes a network framework based on multi-level residual network to detect and recognize abnormal human behavior from video. The framework of multi-level residual network includes human body detection module and posture recognition module. Based on the former, this paper proposes the detection residual network (d-Res) to adopt multi-scale target detection strategy to ensure the detection speed and detection effect of human body. The latter is used to extract spatial features of abnormal behaviors, and the recognition residual network (r-Res) based on transfer learning is used to extract deep features of images, so as to classify abnormal behaviors efficiently. Experiments are carried out on UTI dataset to evaluate the performance of the proposed algorithm. The results show that the proposed method is effective in detecting and recognizing abnormal behaviors in real-world scenes.
12 January 2024 in Information Technology And Control
Temporal reasoning is crucial for action recognition tasks. The previous works use 3D CNNs to jointly capture spatiotemporal information, but it causes a lot of computational costs as well. To improve the above problems, we propose a general channel split spatiotemporal network (CSST-Net) to achieve effective spatiotemporal feature representation learning. The CSST module consists of the grouped spatiotemporal modeling (GSTM) module and the parameter-free feature fusion (PFFF) module. The GSTM module decomposes features into spatial and temporal parts along the channel dimension in parallel, which focuses on spatial and temporal clues respectively. Meanwhile, we utilize the combination of group-wise convolution and point-wise convolution to reduce the number of parameters in the temporal branch, thus alleviating the overfitting of 3D CNNs. Furthermore, for the problem of spatiotemporal feature fusion, the PFFF module performs the recalibration and fusion of spatial and temporal features by a soft attention mechanism, without introducing extra parameters, thus ensuring the correct network information flow effectively. Finally, extensive experiments on three benchmark databases (Sth-Sth V1, Sth-Sth V2, and Jester) indicate that the proposed CSST-Net can achieve competitive performance compared to existing methods, and significantly reduces the number of parameters and FLOPs of 3D CNNs baseline.