Rui Wang

Rui Wang

Auto-generated profile, based on publicly available information

Rui Wang

Key Laboratory of Aerospace Information Security and Trusted Computing, Ministry of Education, School of Cyber Science and Engineering, Wuhan University, Wuhan, China

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
25 July 2024 in IEEE Signal Processing Letters
Verified
Journal Article
Closed access
RWRui Wang
Rui Wang
DYDengpan Ye
Dengpan Ye
LTLong Tang
Long Tang
YZYunming Zhang
Yunming Zhang
JDJiacheng Deng
Jiacheng Deng
With the continuous improvements of deepfake methods, forgery messages have transitioned from single-modality to multi-modal fusion, posing new challenges for existing forgery detection algorithms. In this paper, we propose AVT$^{2}$-DWF , the A udio- V isual dual T ransformers grounded in D ynamic W eight F usion, which aims to amplify both intra- and cross-modal forgery cues, thereby enhancing detection capabilities. AVT $^{2}$ -DWF adopts a dual-stage approach to capture both spatial characteristics and temporal dynamics of facial expressions. This is achieved through a face transformer with an $n$ -frame-wise tokenization strategy encoder and an audio transformer encoder. Subsequently, it uses multi-modal conversion with dynamic weight fusion to address the challenge of heterogeneous information fusion between audio and visual modalities. Experiments on DeepfakeTIMIT, FakeAVCeleb, and DFDC datasets indicate that AVT $^{2}$ -DWF achieves state-of-the-art performance intra- and cross-dataset Deepfake detection. Code is available at https://github.com/raining-dev/AVT2-DWF .