RGBT tracking can be accomplished by constructing Bayesian estimators that incorporate fusion prior distributions for the visible (RGB) and thermal (T) modalities. Such estimators enable the computation of a posterior distribution for the variables of interest to locate the target. Incorporating rich prior information can improve the performance of predictors. However, current RGBT trackers face limited fusion prior data. To mitigate this issue, we propose a novel tracker, BD $^{2}$ Track, which employs a diffusion model. Firstly, this paper introduces a dumbbell diffusion model, and employ convolution networks and the dumbbell model to derive the fusion feature prior information from various index frames in the same tracking video sequence. Secondly, we propose a plug-and-play channel augmented joint learning strategy to derive the images prior distribution. This strategy not only homogeneously generates modality-relevant prior information but also increases the distance between positive and negative samples within the modality, while reducing the distance between modalities during fusion. Results demonstrate promising performance in the GTOT, RGBT234, LasHeR, and VTUAV-ST datasets, surpassing other state-of-the-art trackers.
3 October 2023 in Neural Computing and Applications
Ship detection achieves great significance in remote sensing of synthetic aperture radar (SAR) and many efforts have been done in recent years. However, distinguishing ship targets precisely from the interference of multiplicative non-Gaussian coherent speckle is still a challenging task due to the discreteness, variability, and nonlinearity of ship scattering features. A detection framework based on hierarchical sampling representation is introduced to alleviate the phenomenon in this article. First, ships in SAR images exhibit multiplicative non-Gaussian coherent speckle, which introduces nonlinear characteristics under the imaging mechanism of SAR. Therefore, a statistical feature learning module is proposed with learnable design to describe the nonlinear representations and expand the feature space. Second, our method designs a convex-hull representation to fit the irregular contours of ships represented by strong scattering points. Third, in order to supervise and optimize the regression of convex-hull representation, a sparse low-rank reassignment module is employed to evaluate the positive samples with SAR mechanism and reassign ones of high quality, which produces better results. Furthermore, experimental results on three authoritative SAR-oriented datasets for ship detection application present the comprehensive performance of our method.