The rise of AI-generated synthetic media, or deepfakes, has introduced unprecedented opportunities and challenges across various fields, including entertainment, cybersecurity, and digital communication. Using advanced frameworks such as Generative Adversarial Networks (GANs) and Diffusion Models (DMs), deepfakes are capable of producing highly realistic yet fabricated content, while these advancements enable creative and innovative applications, they also pose severe ethical, social, and security risks due to their potential misuse. The proliferation of deepfakes has triggered phenomena like “Impostor Bias”, a growing skepticism toward the authenticity of multimedia content, further complicating trust in digital interactions. This paper is mainly based on the description of a research project called FF4ALL (FF4ALL-Detection of Deep Fake Media and Life-Long Media Authentication) for the detection and authentication of deepfakes, focusing on areas such as forensic attribution, passive and active authentication, and detection in real-world scenarios. By exploring both the strengths and limitations of current methodologies, we highlight critical research gaps and propose directions for future advancements to ensure media integrity and trustworthiness in an era increasingly dominated by synthetic media.
20 January 2017 in IEEE Transactions on Information Forensics and Security
Morphological operators are widely used in binary image processing for several purposes, such as removing noise, detecting contours or particular structures, and regularizing shapes. In particular, morphological filters are largely adopted in scanned documents to correct the artifacts caused by acquisition and binarization, as well as other processing. In this paper, we propose a novel approach for forensics detection of morphological filtering on binary images. The proposed technique exploits some mathematical properties of the two basic morphologic operators, erosion and dilation, to define an algorithm able not only to detect the application of the filter, but also to estimate the shape of the relevant structuring element. Experimental tests demonstrate that the technique is effective and robust to the most common operations performed on binary image documents.
11 July 2017 in IEEE Transactions on Information Forensics and Security
Intrinsic statistical properties of natural uncompressed images are used in image forensics for detecting the traces of previous processing operations. In this paper, we propose novel forensic detectors of JPEG compression traces in images stored in uncompressed formats, based on a theoretical analysis of Benford-Fourier coefficients computed on the 8 × 8 block-Discrete Cosine Transform (DCT) domain. In fact, the distribution of such coefficients is derived theoretically both under the hypotheses of no compression and previous compression with a certain quality factor, allowing for the computation of the respective likelihood functions. Then, two classification tests based on different statistics are proposed, both relying on a discriminative threshold that can be determined without the need of any training phase. The statistical analysis is based on the only assumptions of generalized Gaussian distribution of DCT coefficients and independence among DCT frequencies, thus resulting in robust detectors applying to any uncompressed image. In fact, experiments on different datasets show that the proposed models are suitable for the images of different sizes and source cameras, thus overcoming dataset-dependence issues that typically affect the state-of-art techniques.
Mathematical morphology provides a large set of powerful non-linear image operators, widely used for feature extraction, noise removal or image enhancement. Although morphological filters might be used to remove artifacts produced by image manipulations, both on binary and graylevel documents, little effort has been spent towards their forensic identification. In this paper we propose a non-trivial extension of a deterministic approach originally detecting erosion and dilation of binary images. The proposed approach operates on grayscale images and is robust to image compression and other typical attacks. When the image is attacked the method looses its deterministic nature and uses a properly trained SVM classifier, using the original detector as a feature extractor. Extensive tests demonstrate that the proposed method guarantees very high accuracy in filtering detection, providing 100% accuracy in discriminating the presence and the type of morphological filter in raw images of three different datasets. The achieved accuracy is also good after JPEG compression, equal or above 76.8% on all datasets for quality factors above 80. The proposed approach is also able to determine the adopted structuring element for moderate compression factors. Finally, it is robust against noise addition and it can distinguish morphological filter from other filters.
The detection of manipulated videos represents a highly relevant problem in multimedia forensics, which has been widely investigated in the last years. However, a common trait of published studies is the fact that the forensic analysis is typically applied on data prior to their potential dissemination over the web. This work addresses the challenging scenario where manipulated videos are first shared through social media platforms and then are subject to the forensic analysis. In this context, a large scale performance evaluation has been carried out involving general purpose deep networks and state-of-the-art manipulated data, and studying different effects. Results confirm that a performance drop is observed in every case when unseen shared data are tested by networks trained on non-shared data; however, fine-tuning operations can mitigate this problem. Also, we show that the output of differently trained networks can carry useful forensic information for the identification of the specific technique used for visual manipulation, both for shared and non-shared data.
The concept of “event” emerged in recent years as a key feature to efficiently index and retrieve media. Several approaches have been proposed to analyze the relationship between events and media, enable event discovery, and perform event-based media tagging, indexing, and retrieval. Despite the outstanding work done in this area, a major problem that remains open is how to infer the link between visual concepts and events. In particular, the possibility of understanding which perceptual elements allow a human recognizing the event depicted by an image would open new directions in event media discovery. In this paper we introduce the concept of event saliency to define the above event-revealing perceptual elements, and we propose an original method to detect it by exploiting crowd knowledge through gamification. We propose an adversarial game with a hidden purpose, where users are engaged in competitive roles: masking photos to prevent competitors recognizing the related event, and discovering events in photos masked by other players. Rules and incentives are defined to minimize cheating and force players to focus on details that really matter. A suitable algorithm composes the masks created by different players on the same media, thus producing a saliency map that, different from the traditional concept of saliency, does not focus on perceptual prominence but rather on event-related semantics of media. A thorough validation on public datasets is presented, and initial experiments to apply event saliency in detection tasks are proposed . Furthermore, an event-saliency dataset is disclosed to allow further research.