10 June 2022 in IEEE Transactions on Intelligent Transportation Systems
Context prediction plays a crucial role in implementing autonomous driving applications. As one of important context-prediction tasks, crowd-and-vehicle counting is critical for achieving real-time traffic and crowd analysis, consequently facilitating decision-making processes for autonomous vehicles. However, the completion of crowd-and-vehicle counting also faces challenges, such as large-scale variations, imbalanced data distribution, and insufficient local patterns. To tackle these challenges, we put forth a novel frequency feature pyramid network (FFPNet) in this paper. Our proposed FFPNet extracts the multi-scale information by frequency feature pyramid module, which can tackle the issue of large-scale variations. Meanwhile, the frequency feature pyramid module uses different frequency branches to obtain different scale information. We also adopt the attention mechanism to strength the extraction of different scale information. Moreover, we devise a novel loss function, namely global-local consistency loss, to address the existing problems of imbalanced data distribution and insufficient local patterns. Furthermore, we conduct extensive experiments on six datasets to evaluate our proposed FFPNet. It is worth mentioning that we also construct a novel crowd-and-vehicle dataset (CROVEH), which is the only dataset that contains both crowd-and-vehicle annotations. The experimental results show that FFPNet achieves the best performance on different backbones, e.g., 52.69 mean absolute error (MAE) on P2PNet with FFP module. The codes are available at: https://github.com/MUST-AI-Lab/FFPNet .
1 January 2025 in IET Biometrics
Unified face attack detection (UAD), which simultaneously addresses physical presentation attacks (PAs) and digital forgery attacks (DAs) with a vision‐language model, remains challenging due to the difficulty of effectively separating live and fake cues. The challenges mainly arise from two aspects: (1) text prompts are insufficiently aligned with visual features across layers, and (2) patch tokens containing live and fake cues often overlap, leading to ambiguous attribution and small decision margins. To address these problems, we propose a novel Layer‐wise Cue Alignment framework (LCA) that leverages textual features to extract both layer‐wise and global cues from patch tokens, and we further introduce a new training strategy to improve the separation of live and fake cues. Specifically, the layer‐wise prompts are obtained by the cue matching block (CMB), which matches textual features with patch embeddings at each transformer layer, and the layer‐level cues are injected into the visual features of each layer and further aggregated by the cue fusion block (CFB) to form comprehensive prompts that enhance the overall visual representation. Moreover, we design a complementary supervision mechanism (CSM) that suppresses forgery cues in live faces while enforcing mutual exclusivity between live and fake cues in attack samples to improve the reliability of cue separation. Extensive experiments on multiple benchmarks demonstrate that our framework achieves state‐of‐the‐art performance on most protocols of the datasets.
6 January 2026 in Neurocomputing