CoChat

Media Forensics and DeepFakes: An Overview

Open access
Verdoliva, Luisa · 2020 · IEEE Journal of Selected Topics in Signal Processing

The DOI matches its Crossref record; 289 of the 289 references it cites were found in a registry or an index.

Abstract

With the rapid progress in recent years, techniques that generate and manipulate multimedia content can now provide a very advanced level of realism. The boundary between real and synthetic media has become very thin. On the one hand, this opens the door to a series of exciting applications in different fields such as creative arts, advertising, film production, and video games. On the other hand, it poses enormous security threats. Software packages freely available on the web allow any individual, without special skills, to create very realistic fake images and videos. These can be used to manipulate public opinion during elections, commit fraud, discredit or blackmail people. Therefore, there is an urgent need for automated tools capable of detecting false multimedia content and avoiding the spread of dangerous false information. This review paper aims to present an analysis of the methods for visual media integrity verification, that is, the detection of manipulated images and videos. Special emphasis will be placed on the emerging phenomenon of deepfakes, fake media created through deep learning tools, and on modern data-driven forensic methods to fight them. The analysis will help highlight the limits of current forensic tools, the most relevant issues, the upcoming challenges, and suggest future directions for research.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/jstsp.2020.3002101

Cites

289 of 289 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

7 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Items 201–289 of 289

Research works printed but not linked: 7

  1. chung, 0, Proc Brit Mach Vision Conf, 1
  2. [36] T.-C. Wang, M.-Y. Liu, J.-Y. Zhu, G. Liu, A. Tao, J. Kautz, and B. Catanzaro, 'Video-to-video synthesis,' in Conference on Neural Information Processing Systems , 2018. -
  3. [59] J. Ho, O. Au, J. Zhou, and Y. Guo, 'Inter-channel demosaicing traces for digital image forensics,' in IEEE International Conference on Multimedia and Expo , 2010. -
  4. [133] M. Barni, Q.-T. Phan, and B. Tondi, 'Copy Move SourceTarget Disambiguation through Multi-Branch CNNs,' arXiv preprint arXiv:1912.12640v1 , 2019. - · arXiv
  5. [241] I. Goodfellow, J. Shlens, and C. Szegedy, 'Intriguing properties of neural networks,' in Explaining and harnessing adversarial examples , 2015. -
  6. [17] D. G¨ uera, S. Baireddy, P. Bestagini, S. Tubaro, and E. Delp, 'We need no pixels: Video manipulation detection using stream descriptors,' in ICML Workshops , 2019. -
  7. [105] S. Chakraborty and M. Kirchner, 'PRNU-based forgery detection with discriminative random fields,' in International Symposium on Electronic Imaging: Media Watermarking, Security, and Forensics , 2017. -

Cited by

See all 1,003

Metadata

Authors
Verdoliva, L.
Affiliations
University of Naples Federico II (IT)
Corresponding author
Verdoliva, Luisa
Venue
IEEE Journal of Selected Topics in Signal Processing
Published
2020-08
Volume
14
Issue
5
Pages
910-932
ISSN
  • 1932-4553 (ISSN-L)
  • 1941-0484
OpenAlex
W3002581072
Cited by
979
References
278
Citations by year
2026: 263 · 2025: 190 · 2024: 165 · 2023: 121 · 2022: 121 · 2021: 86 · 2020: 33
FWCI
35.09
Type
journal article
Language
en
Open access
Locations
  • IEEE Journal of Selected Topics in Signal Processing (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
  • IEEE RESOURCE CENTERS
Funders
Defense Advanced Research Projects Agency (FA8750-16-2-0204)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
  • Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Steganography and Watermarking Techniques
Keywords
multimedia forensics, deepfakes, fake image detection, fake video detection, deep learning, misinformation, synthetic media

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.