The rising demand for surveillance systems naturally necessitates more efficient and noise robust moving object detection (MOD) systems from the captured video streams. Inspired by the challenges in MOD which are yet to be addressed properly, this paper proposes a new MOD scheme using l1/2 regularization in the tensor framework. It takes advantage of the special features of tensor singular value decomposition (t-SVD) along with regularizations using l1/2-norm with half thresholding operation and tensor total variation (TTV) to develop a noise robust MOD system with improved detection accuracy. While t-SVD exploits the spatio-temporal correlation of the video background, l1/2 regularization provides noise robustness besides removing the sparser but discontinuous dynamic elements in the spatio-temporal direction. Moreover, TTV enhances the spatio-temporal continuity and fills up the gaps due to the lingering objects and thereby extracting the foreground precisely. The proposed three-way optimization method is designed to address both static and dynamic background cases of MOD separately with the intention to reduce the misclassifications due to moving/cluttered background. The brilliance of this method is confirmed by the impressive visual quality of the background/foreground separation, noise robustness, reduced computational complexity, and rapid response. The quantitative evaluation discloses the predominance of the proposed method with respect to the state-of-the-art techniques.
30 June 2020 in IEEE Transactions on Image Processing
The spatially distributed digital cameras in Wireless Multimedia Sensor Networks (WMSN) are provided with miniature batteries resulting in power constraints. These cameras acquire compressive measurements of video at a rate significantly below the Nyquist rate and transmit them wirelessly in the network. Thus, the encoding side (transmitter) is made less complex at the expense of increased complexity at the more resourceful decoder (receiver). Well grounded on this relevant practical scenario, a unified system is proposed that integrates detection of moving objects into the Compressive Sensing (CS) recovery framework and thereby realizing simultaneous data recovery and object detection in a single optimization problem which guarantees fast response. In this work, a new tensor RPCA approach is proposed to accomplish this requirement. For background separation, low rank approximation is done on the highly correlated background components. A Laplace function based surrogate for tensor tubal rank is formulated to provide adaptive thresholding for the singular value tubes of the background tensor. Moreover, the spatio-temporal continuity of the foreground is explored using 3D-Piecewise Smoothness Constraints combinations based Anisotropic Total Variation (3DPSCATV) regularization. Additionally, l1 regularization has been adopted to describe the sparsity of moving objects. The proposed model is solved using Alternative Direction Method of Multipliers (ADMM) scheme. The quantitative and qualitative results validate the superior performance of the proposed method against the compared approaches.
Since automated cleaning systems are less common in extreme surveillance environments, the accumulations of combustion fuels, dust, dirt, spider webs etc. affect the visibility and clarity of the captured video data to different degrees resulting in incomplete (missing) video sequences. Grounded on this significant practical scenario, this work proposes a scheme to concurrently complete the missing entries and detect moving objects with efficient background separation by formulating a single convex optimization problem developed and implemented in the tensor framework. The work is implemented as a unified scheme for concurrent video completion and Moving Object Detection (MOD) using twist Spatio-Temporal (SPA-TEM) Total Variation (TV) to enhance the detection performance of the foreground while fitting the Tensor Nuclear Norm (TNN) minimization for efficient background separation with half thresholding applied on the tensor singular values. Moreover, the sparse variations which are part of the dynamic background are addressed using $l_{1/2}$ regularization. The formulated minimization problem is solved using Augmented Lagrangian Method (ALM) with Alternating direction strategy. The work also has computational benefits and the excellence of this method is revealed in the quantified performance evaluation against the compared approaches.