26 February 2024 in IEEE Transactions on Multimedia
Recognizing novel sub-categories with scarce samples is an essential and challenging research topic in computer vision. Existing literature addresses this challenge by employing local-based representation approaches, which may not sufficiently facilitate meaningful object-specific semantic understanding, leading to a reliance on apparent background correlations. Moreover, they primarily rely on high-dimensional local descriptors to construct complex embedding space, potentially limiting the generalization. To address the above challenges, this article proposes a novel model, Robust Saliency-aware Distillation (RSaD), for few-shot fine-grained visual recognition. RSaD introduces additional saliency-aware supervision via saliency detection to guide the model toward focusing on the intrinsic discriminative regions. Specifically, RSaD utilizes the saliency detection model to emphasize the critical regions of each sub-category, providing additional object-specific information for fine-grained prediction. RSaD transfers such information with two symmetric branches in a mutual learning paradigm. Furthermore, RSaD exploits inter-regional relationships to enhance the informativeness of the representation and subsequently summarize the highlighted details into contextual embeddings to facilitate the effective transfer, enabling quick generalization to novel sub-categories. The proposed approach is empirically evaluated on three widely used benchmarks, demonstrating its superior performance.
30 March 2026 in IEEE Transactions on Computational Social Systems
Multimodal cross-subject emotion recognition has gained increasing attention due to the complementary nature of physiological and behavioral signals, such as electroencephalography (EEG) and eye movements (EM). However, modality heterogeneity and subject variability remain major obstacles, especially in few-shot scenarios. Existing approaches often combine increasingly complex architectures with unsupervised domain adaptation to address these issues, but they typically require large amounts of unlabeled target data and struggle to generalize when samples are scarce. To overcome these limitations, this article proposes a unified multimodal representation learning (UMRL) framework with prototype calibration under the few-shot paradigm. Specifically, the UMRL strategy is designed from an optimization perspective rather than architectural complexity to learn a compact and discriminative joint representation. It encourages compact representations by jointly minimizing cross-modal inconsistency and penalizing modality dominance, ensuring that complementary cues are effectively integrated in a unified embedding space. Nevertheless, emotional prototypes constructed from a few labeled samples of novel subjects are often unstable and sensitive to subject-dependent variability. To further alleviate this issue, this article introduces an emotional prototype calibration mechanism that aligns novel emotional prototypes with semantic priors learned from seen subjects to suppress noise and improve cross-subject generalization. Extensive experiments on multiple multimodal emotion recognition benchmarks with EEG and EM demonstrate that the proposed framework achieves state-of-the-art performance and delivers consistent robustness under few-shot conditions.