Transformer-based architecture network has shown excellent performance in the coarse-grained image classification. However, it remains a challenge for the fine-grained image classification task, which needs more significant regional information. As one of the attention mechanisms, transformer pays attention to the most significant region while neglecting other sub-significant regions. To use more regional information, in this letter, we propose a complemental attention multi-feature fusion network (CAMF), which extracts multiple attention features to obtain more effective features. In CAMF, we propose two novel modules: (i) a complemental attention module (CAM) that extracts the most salient attention feature and the complemental attention feature. (ii) a multi-feature fusion module (MFM) that uses different branches to extract multiple regional discriminative features. Furthermore, a new feature similarity loss is proposed to measure the diversity of inter-class features. Experiments were conducted on four public fine-grained classification datasets. Our CAMF achieves 91.2%, 92.8%, 93.3%, 95.3% on CUB-200-2011, Stanford Dogs, FGVC-Aircraft, and Stanford Cars. The ablation study verified that CAM and MFM can focus on more local discriminative regions and improve fine-grained classification performance.
Visual object tracking is a challenging task due to object appearance changes caused by shape deformation, heavy occlusion, background clutters, illumination variation, and camera motion. In this letter, we propose a novel robust algorithm which decomposes the task of tracking into translation and scale estimation. We estimate the translation by using five correlation filters with hierarchical convolutional features which produced multilevel correlation response maps to collaboratively infer the target location. We also calculate the scale variation by another correlation filter with histogram of oriented gradient features at the same time. Extensive experimental results on a large-scale 50 challenging benchmark dataset show that the proposed algorithm achieved outstanding performance against state-of-the-art methods.
20 February 2025 in Engineering Applications of Artificial Intelligence
Background subtraction is a classic video processing task pervading in numerous visual applications such as video surveillance and traffic monitoring. Given the diversity and variability of real application scenes, an ideal background subtraction model should be robust to various scenarios. Even though deep-learning approaches have demonstrated unprecedented improvements, they often fail to generalize to unseen scenarios, thereby less suitable for extensive deployment. In this work, we propose to tackle cross-scene background subtraction via a two-phase framework that includes meta-knowledge learning and domain adaptation. Specifically, as we observe that meta-knowledge (i.e., scene-independent common knowledge) is the cornerstone for generalizing to unseen scenes, we draw on traditional frame differencing algorithms and design a deep difference network (DDN) to encode meta-knowledge especially temporal change knowledge from various cross-scene data (source domain) without intermittent foreground motion pattern. In addition, we explore a self-training domain adaptation strategy based on iterative evolution. With iteratively updated pseudo-labels, the DDN is continuously fine-tuned and evolves progressively toward unseen scenes (target domain) in an unsupervised fashion. Our framework could be easily deployed on unseen scenes without relying on their annotations. As evidenced by our experiments on the CDnet2014 dataset, it brings a significant improvement to background subtraction. Our method has a favorable processing speed (70 fps) and outperforms the best unsupervised algorithm and top supervised algorithm designed for unseen scenes by 9% and 3%, respectively.
5 August 2020 in Multimedia Tools and Applications
Vehicle safety is increasingly becoming a concern. Whether the driver is wearing a seatbelt and whether the vehicle is speeding out or not become important indicators of the vehicle safety. However, manually searching, detecting, recording and other work will spend a lot of manpower and time inefficiently. This paper proposes a cascade Adaboost classifier based seatbelt detection system to detect the vehicle windows, to complete Canny edge detection on gradient map of vehicle window images, and to perform the probabilistic Hough transform to extract the straight-lines of seatbelts. The system achieves the goal of seatbelt detection intelligently.