Raymond Ptucha

Raymond Ptucha

Auto-generated profile, based on publicly available information

Raymond Ptucha

Computer Engineering, Rochester Institute of Technology, 6925 Rochester, New York, United States

Research Focus & Metrics

Academic Career Length

14Years (2013-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 June 2020 in IEEE Journal of Selected Topics in Signal Processing
Verified
Journal Article
Closed access
ACAkash Chintha
Akash Chintha
BTBao Thai
Bao Thai
SSSaniat Javid Sohrawardi
Saniat Javid Sohrawardi
KBKartavya Manojbhai Bhatt
Kartavya Manojbhai Bhatt
AHAndrea Hickerson
Andrea Hickerson
RPRaymond Ptucha
Raymond Ptucha
Deepfakes, or artificially generated audiovisual renderings, can be used to defame a public figure or influence public opinion. With the recent discovery of generative adversarial networks, an attacker using a normal desktop computer fitted with an off-the-shelf graphics processing unit can make renditions realistic enough to easily fool a human observer. Detecting deepfakes is thus becoming important for reporters, social media platforms, and the general public. In this work, we introduce simple, yet surprisingly efficient digital forensic methods for audio spoof and visual deepfake detection. Our methods combine convolutional latent representations with bidirectional recurrent structures and entropy-based cost functions. The latent representations for both audio and video are carefully chosen to extract semantically rich information from the recordings. By feeding these into a recurrent framework, we can detect both spatial and temporal signatures of deepfake renditions. The entropy-based cost functions work well in isolation as well as in context with traditional cost functions. We demonstrate our methods on the FaceForensics++ and Celeb-DF video datasets and the ASVSpoof 2019 Logical Access audio datasets, achieving new benchmarks in all categories. We also perform extensive studies to demonstrate generalization to new domains and gain further insight into the effectiveness of the new architectures.

30 November 2020 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Verified
Journal Article
Open access
MSManish Sharma
Manish Sharma
MDMayur Dhanaraj
Mayur Dhanaraj
SKSrivallabha Karnam
Srivallabha Karnam
DCDimitris G. Chachlakis
Dimitris G. Chachlakis
RPRaymond Ptucha
Raymond Ptucha
ESEli Saber
Eli Saber
Deep-learning object detection methods that are designed for computer vision applications tend to under-perform when applied to remote sensing data. This is because, contrary to computer vision, in remote sensing training data are harder to collect and targets can be very small, occupying only a few pixels in the entire image, and exhibit arbitrary perspective transformations. Detection performance can improve by fusing data from multiple remote sensing modalities, including RGB, IR, hyper-spectral, multi-spectral, synthetic aperture radar, and LiDAR, to name a few. In this work, we propose YOLOrs: a new convolutional neural network, specifically designed for realtime object detection in multimodal remote sensing imagery. YOLOrs can detect objects at multiple scales, with smaller receptive fields to account for small targets, as well as predict target orientations. In addition, YOLOrs introduces a novel midlevel fusion architecture that renders it applicable to multimodal aerial imagery. Our experimental studies compare YOLOrs with contemporary alternatives and corroborate its merits.

28 September 2020
Verified
Conference Paper
Closed access
ACAkash Chintha
Akash Chintha
ARAishwarya Rao
Aishwarya Rao
SSSaniat Sohrawardi
Saniat Sohrawardi
KBKartavya Bhatt
Kartavya Bhatt
MWMatthew Wright
Matthew Wright
RPRaymond Ptucha
Raymond Ptucha
Deepfakes can be used maliciously to sway public opinion, defame an individual, or commit fraud. Hence, it is vital for journalists and social media platforms, as well as the general public, to be able to detect deepfakes. Existing deepfake detection methods, while highly accurate on datasets they have been trained on, falter in open-world scenarios due to different deepfake generations algorithms, video formats, and compression levels. In this paper, we seek to address this by building on the XceptionNet-based deepfake detection technique that utilizes convolutional latent representations with recurrent structures. In particular, we explore how to leverage a combination of visual frames, edge maps, and dense optical flow maps together as inputs to this architecture. We evaluate these techniques using the FaceForensics++ and DFDC-mini datasets. We also perform extensive studies to evaluate the robustness of our network against adversarial post-processing as well as the generalization capabilities to out-of-domain datasets and manipulation strategies. Our methods, which we call XceptionNet*, achieve 100% accuracy on the popular Face-Forensics-s+ dataset and set new benchmark standards on the difficult DFDC-mini dataset. The XceptionNet* models are shown to exhibit superior performance on cross-domain testing and demonstrate surprising resilience to adversarial manipulations.

1 May 2013 in Image and Vision Computing
Verified
Journal Article
Closed access
RPRaymond Ptucha
Raymond Ptucha
ASAndreas Savakis
Andreas Savakis

19 November 2020 in Journal of Medical Internet Research
Verified
Journal Article
Open access
CHChristopher Homan
Christopher Homan
JSJ Nicolas Schrading
J Nicolas Schrading
RPRaymond W Ptucha
Raymond W Ptucha
CCCatherine Cerulli
Catherine Cerulli
CACecilia Ovesdotter Alm
Cecilia Ovesdotter Alm
Background: Social media is a rich, virtually untapped source of data on the dynamics of intimate partner violence, one that is both global in scale and intimate in detail. Objective: The aim of this study is to use machine learning and other computational methods to analyze social media data for the reasons victims give for staying in or leaving abusive relationships. Methods: Human annotation, part-of-speech tagging, and machine learning predictive models, including support vector machines, were used on a Twitter data set of 8767 #WhylStayed and #WhylLeft tweets each. Results: Our methods explored whether we can analyze micronarratives that include details about victims, abusers, and other stakeholders, the actions that constitute abuse, and how the stakeholders respond. Conclusions: Our findings are consistent across various machine learning methods, which correspond to observations in the clinical literature, and affirm the relevance of natural language processing and machine learning for exploring issues of societal importance in social media.

5 January 2019 in Pattern Analysis and Applications
Verified
Journal Article
Closed access
PDF file
SSShagan Sah
Shagan Sah
TNThang Nguyen
Thang Nguyen
RPRay Ptucha
Ray Ptucha