9 February 2026 in ACM Transactions on Multimedia Computing, Communications, and Applications
Sarcasm in social media, frequently conveyed through the interplay of text and images, presents significant challenges for sentiment analysis and intention mining. Existing multi-modal sarcasm detection approaches have been shown to excessively depend on superficial cues within the textual modality, exhibiting limited capability to accurately discern sarcasm through subtle text–image interactions. To address this limitation, a novel framework, InterCLIP-MEP, is proposed. This framework integrates Interactive CLIP (InterCLIP), which employs an efficient training strategy to derive enriched cross-modal representations by embedding inter-modal information directly into each encoder, while using approximately 20.6 \(\times\) fewer trainable parameters compared with existing state-of-the-art (SOTA) methods. Furthermore, a Memory-Enhanced Predictor (MEP) is introduced, featuring a dynamic dual-channel memory mechanism that captures and retains valuable knowledge from test samples during inference, serving as a nonparametric classifier to enhance sarcasm detection robustness. Extensive experiments on MMSD, MMSD2.0, and DocMSU show that InterCLIP-MEP achieves SOTA performance, specifically improving accuracy by 1.08% and F1-score by 1.51% on MMSD2.0. Under distributional shift evaluation, it attains 73.96% accuracy, exceeding its memory-free variant by nearly 10% and the previous SOTA by over 15%, demonstrating superior stability and adaptability. The implementation of InterCLIP-MEP is publicly available at https://github.com/CoderChen01/InterCLIP-MEP .
18 June 2026 in ACM Transactions on Multimedia Computing, Communications, and Applications
Multimodal sarcasm detection identifies ironic intent by jointly analyzing text and images. It has attracted increasing attention due to its importance in understanding user-generated content on social media. However, multimodal observations are often incomplete due to data loss during transmission or collection, leading to unreliable predictions in real-world multimodal sarcasm detection scenarios. To address incomplete observations, we further propose a Reliability-Aware Dynamic Fusion (RADF) module, which predicts the reliability of the textual, visual, and interactive views from their representations, converts these reliability scores into dynamic fusion weights via a temperature-scaled softmax to control the sharpness of the weight distribution, and refines the fused features through feature-wise scaling. In this way, degraded views are suppressed while more informative views are emphasized under incomplete observations. Extensive experiments on public datasets validate the effectiveness of our approach, which consistently outperforms existing baselines.
11 March 2025 in Expert Systems with Applications