Junbin Xiao

Junbin Xiao

Auto-generated profile, based on publicly available information

Junbin Xiao

National University of Singapore, Singapore, Singapore

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
26 June 2023 in Proceedings of the AAAI Conference on Artificial Intelligence
Verified
Journal Article
Open access
PDF file
PQPeng Qi
Peng Qi
YBYuyan Bu
Yuyan Bu
JCJuan Cao
Juan Cao
Wei JiWei Ji
Wei Ji
RSRuihao Shui
Ruihao Shui
TCTat-Seng Chua
Tat-Seng Chua
Short video platforms have become an important channel for news sharing, but also a new breeding ground for fake news. To mitigate this problem, research of fake news video detection has recently received a lot of attention. Existing works face two roadblocks: the scarcity of comprehensive and largescale datasets and insufficient utilization of multimodal information. Therefore, in this paper, we construct the largest Chinese short video dataset about fake news named FakeSV, which includes news content, user comments, and publisher profiles simultaneously. To understand the characteristics of fake news videos, we conduct exploratory analysis of FakeSV from different perspectives. Moreover, we provide a new multimodal detection model named SV-FEND, which exploits the cross-modal correlations to select the most informative features and utilizes the social context information for detection. Extensive experiments evaluate the superiority of the proposed method and provide detailed comparisons of different methods and modalities for future works. Our dataset and codes are available in https://github.com/ICTMCG/FakeSV.

29 October 2022
Verified
Book Chapter
Closed access
PDF file
JXJunbin Xiao
Junbin Xiao
PZPan Zhou
Pan Zhou
TCTat-Seng Chua
Tat-Seng Chua
SYShuicheng Yan
Shuicheng Yan

4 July 2023 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
JXJunbin Xiao
Junbin Xiao
PZPan Zhou
Pan Zhou
AYAngela Yao
Angela Yao
YLYicong Li
Yicong Li
RHRichang Hong
Richang Hong
TCTat-Seng Chua
Tat-Seng Chua
We propose to perform video question answering (VideoQA) in a Co ntrastive manner via a V ideo G raph T ransformer model (CoVGT). CoVGT's uniqueness and superiority are three-fold: 1) It proposes a dynamic graph transformer module which encodes video by explicitly capturing the visual objects, their relations and dynamics, for complex spatio-temporal reasoning. 2) It designs separate video and text transformers for contrastive learning between the video and text to perform QA, instead of multi-modal transformer for answer classification. Fine-grained video-text communication is done by additional cross-modal interaction modules. 3) It is optimized by the joint fully- and self-supervised contrastive objectives between the correct and incorrect answers, as well as the relevant and irrelevant questions respectively. With superior video encoding and QA solution, we show that CoVGT can achieve much better performances than previous arts on video reasoning tasks. Its performances even surpass those models that are pretrained with millions of external data. We further show that CoVGT can also benefit from cross-modal pretraining, yet with orders of magnitude smaller data. The results demonstrate the effectiveness and superiority of CoVGT, and additionally reveal its potential for more data-efficient pretraining.

18 February 2025 in International Journal of Computer Vision
Verified
Journal Article
Closed access
PDF file
JXJunbin Xiao
Junbin Xiao
NHNanxin Huang
Nanxin Huang
HQHangyu Qin
Hangyu Qin
DLDongyang Li
Dongyang Li
YLYicong Li
Yicong Li
AYAngela Yao
Angela Yao

9 August 2023 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
YLYicong Li
Yicong Li
XWXiang Wang
Xiang Wang
JXJunbin Xiao
Junbin Xiao
Wei JiWei Ji
Wei Ji
TCTat-Seng Chua
Tat-Seng Chua
Video Question Answering (VideoQA) is the task of answering questions about a video. At its core is the understanding of the alignments between video scenes and question semantics to yield the answer. In leading VideoQA models, the typical learning objective, empirical risk minimization (ERM), tends to over-exploit the spurious correlations between question-irrelevant scenes and answers, instead of inspecting the causal effect of question-critical scenes, which undermines the prediction with unreliable reasoning. In this work, we take a causal look at VideoQA and propose a modal-agnostic learning framework, named Invariant Grounding for VideoQA (IGV), to ground the question-critical scene, whose causal relations with answers are invariant across different interventions on the complement. With IGV, leading VideoQA models are forced to shield the answering from the negative influence of spurious correlations, which significantly improves their reasoning ability. To unleash the potential of this framework, we further provide a Transformer-Empowered Invariant Grounding for VideoQA (TIGV), a substantial instantiation of IGV framework that naturally integrates the idea of invariant grounding into a transformer-style backbone. Experiments on four benchmark datasets validate our design in terms of accuracy, visual explainability, and generalization ability over the leading baselines. Our code is available at https://github.com/yl3800/TIGV.

30 April 2023
Verified
Conference Paper
Open access
FZFengbin Zhu
Fengbin Zhu
MLMoxin Li
Moxin Li
JXJunbin Xiao
Junbin Xiao
Fuli FengFuli Feng
Fuli Feng
CWChao Wang
Chao Wang
TCTat Seng Chua
Tat Seng Chua
Towards the intelligent understanding of table-text data in the finance domain, previous research explores numerical reasoning over table-text content with Question Answering (QA) tasks. A general framework is to extract supporting evidence from the table and text and then perform numerical reasoning over extracted evidence for inferring the answer. However, existing models are vulnerable to missing supporting evidence, which limits their performance. In this work, we propose a novel Semantic-Oriented Hierarchical Graph (SoarGraph) that models the semantic relationships and dependencies among the different elements (e.g., question, table cells, text paragraphs, quantities, and dates) using hierarchical graphs to facilitate supporting evidence extraction and enhance numerical reasoning capability. We conduct our experiments on two popular benchmarks, FinQA and TAT-QA datasets, and the results show that our SoarGraph significantly outperforms all strong baselines, demonstrating remarkable effectiveness.