Kartavya Manojbhai Bhatt

Kartavya Manojbhai Bhatt

Auto-generated profile, based on publicly available information

Kartavya Manojbhai Bhatt

Rochester Institute of Technology, Rochester, NY, USA

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 June 2020 in IEEE Journal of Selected Topics in Signal Processing
Verified
Journal Article
Closed access
ACAkash Chintha
Akash Chintha
BTBao Thai
Bao Thai
SSSaniat Javid Sohrawardi
Saniat Javid Sohrawardi
KBKartavya Manojbhai Bhatt
Kartavya Manojbhai Bhatt
AHAndrea Hickerson
Andrea Hickerson
RPRaymond Ptucha
Raymond Ptucha
Deepfakes, or artificially generated audiovisual renderings, can be used to defame a public figure or influence public opinion. With the recent discovery of generative adversarial networks, an attacker using a normal desktop computer fitted with an off-the-shelf graphics processing unit can make renditions realistic enough to easily fool a human observer. Detecting deepfakes is thus becoming important for reporters, social media platforms, and the general public. In this work, we introduce simple, yet surprisingly efficient digital forensic methods for audio spoof and visual deepfake detection. Our methods combine convolutional latent representations with bidirectional recurrent structures and entropy-based cost functions. The latent representations for both audio and video are carefully chosen to extract semantically rich information from the recordings. By feeding these into a recurrent framework, we can detect both spatial and temporal signatures of deepfake renditions. The entropy-based cost functions work well in isolation as well as in context with traditional cost functions. We demonstrate our methods on the FaceForensics++ and Celeb-DF video datasets and the ASVSpoof 2019 Logical Access audio datasets, achieving new benchmarks in all categories. We also perform extensive studies to demonstrate generalization to new domains and gain further insight into the effectiveness of the new architectures.

28 September 2020
Verified
Conference Paper
Closed access
ACAkash Chintha
Akash Chintha
ARAishwarya Rao
Aishwarya Rao
SSSaniat Sohrawardi
Saniat Sohrawardi
KBKartavya Bhatt
Kartavya Bhatt
MWMatthew Wright
Matthew Wright
RPRaymond Ptucha
Raymond Ptucha
Deepfakes can be used maliciously to sway public opinion, defame an individual, or commit fraud. Hence, it is vital for journalists and social media platforms, as well as the general public, to be able to detect deepfakes. Existing deepfake detection methods, while highly accurate on datasets they have been trained on, falter in open-world scenarios due to different deepfake generations algorithms, video formats, and compression levels. In this paper, we seek to address this by building on the XceptionNet-based deepfake detection technique that utilizes convolutional latent representations with recurrent structures. In particular, we explore how to leverage a combination of visual frames, edge maps, and dense optical flow maps together as inputs to this architecture. We evaluate these techniques using the FaceForensics++ and DFDC-mini datasets. We also perform extensive studies to evaluate the robustness of our network against adversarial post-processing as well as the generalization capabilities to out-of-domain datasets and manipulation strategies. Our methods, which we call XceptionNet*, achieve 100% accuracy on the popular Face-Forensics-s+ dataset and set new benchmark standards on the difficult DFDC-mini dataset. The XceptionNet* models are shown to exhibit superior performance on cross-domain testing and demonstrate surprising resilience to adversarial manipulations.