This letter proposes a novel multiple extended target (ET) joint tracking and classification (JTC) algorithm based on Gaussian processes (GPs) and labeled multi-Bernoulli (LMB) filter, called the ET-JTC-GP-LMB filter, which aims to track and classify simultaneously multiple ETs with the goal of improving estimation performance. Firstly, we construct the relationship between GP-based extension state and prior class information (PCI), and design a new class probability update method. Then, we integrate these two works into the GP-based ET LMB filtering framework, propose the ET-JTC-GP-LMB filter, and provide its gamma-Gaussian-Gaussian mixture implementation to form a closed recursion. Finally, we present an evaluation metric called class recognition rate (CRR) to evaluate classification performance. The simulation results demonstrate the superior performance of the proposed filter.
Multi-target tracking (MTT) of multi-active and multi-passive sensor (MAMPS) systems in dense group clutter environments is facing significant challenges in measurement fusion. Due to the difference in measurement information characteristics in MAMPS fusion, it is difficult to effectively correlate and fuse different types of sensors’ measurements, leading to difficulty in taking full advantage of various types of sensors to improve target tracking accuracy. To this end, we present a novel MAMPS fusion algorithm, which is based on centralized measurement association fusion (MAF) and distributed deep neural network (DNN) track fusion, named the MAMPS-MAF-DNN algorithm. Firstly, to reduce the impact of the dense group clutter, a clutter pre-processing algorithm is elaborated, which combines the advantages of the CFDP (cluster by finding density peaks) and double threshold screening algorithms. Then, for the single-active and multi-passive sensor (SAMPS) system, a centralized MAF algorithm based on angle information is developed, called the SAMPS-MAF algorithm. Finally, the SAMPS-MAF algorithm is extended to the MAMPS system within the DNN framework, and the complete MAMPS-MAF-DNN algorithm is proposed. Experimental results indicate that, compared to the existing MAF and covariance intersection (CI) fusion algorithms, the proposed MAMPS-MAF-DNN algorithm can fully combine the advantages of multi-active and multi-passive sensors, efficiently reduce the computational complexity, and obviously improve the tracking accuracy.
24 July 2024 in IEEE Transactions on Circuits and Systems for Video Technology
Video object detection remains a challenging task due to appearance degradation in certain frames. Existing studies usually aggregate temporal information from multiple frames to enhance the object’s appearance representation. Although significant detection performance has been achieved, there are still two shortcomings: (1) The spatial context information within each frame is not fully exploited, which can provide additional decision support when objects are corrupted; (2) In the feature alignment phase, traditional methods tend to employ one-to-one or one-to-global temporal alignment strategies, overlooking the local temporal correlation of objects. To address the above issues, we propose a Joint Spatial and Temporal Feature Enhancement Network (JSTFE-Net) for video object detection, which can jointly utilize spatial-temporal information. First, we present a novel local-global context enhancement module to effectively encode intra-frame spatial context information. This module can enhance the learning of both local details and global semantic information of objects, thereby facilitating accurate object perception within the spatial domain. Second, we develop a deformable temporal sampling module, which adaptively samples correlated temporal information according to the motion information between frames. In addition, to improve the aggregation of temporal-correlated sampled features from multiple frames, we devise an attention-based temporal aggregation block, which dynamically fuses these feature points based on their temporal similarity with the corresponding object feature point. Note that our JSTFE-Net can be effortlessly plugged into image object detectors and state-of-the-art video object detectors. Extensive experiments on the ImageNet VID dataset show that the proposed JSTFE-Net can consistently and significantly improve performance, demonstrating its effectiveness in video object detection.
Effective implementation of the fast labeled multi-Bernoulli (FLMB) filter is addressed for target tracking with interval measurements. Firstly, a sequential Monte Carlo (SMC) implementation of the FLMB filter, SMC-FLMB filter, is derived based on generalized likelihood function weighting. Then, a box particle (BP) implementation of the FLMB filter, BP-FLMB filter, is developed, with a computational complexity reduction of the SMC-FLMB filter. Finally, an improved version of the BP-FLMB filter, improved BP-FLMB (IBP-FLMB) filter, is proposed, improving its estimation accuracy and real-time performance under the conditions of low detection probability and high clutter. Simulation results show that the BP-FLMB filter has a great improvement of the real-time performance than the SMC-FLMB filter, with similar tracking performance. Compared with the BP-FLMB filter, the IBP-FLMB filter has better estimation performance and real-time performance under the conditions of low detection probability and high clutter.