CoChat
Sign Up
PreprintCited by 184Digital Media Forensic DetectionGenerative Adversarial Networks and Image SynthesisMisinformation and Its Impacts

Unmasking DeepFakes with simple Features

Open access
Durall, Ricard, Keuper, Margret, Pfreundt, Franz-Josef, Keuper, Janis·2019·arXiv
DOI 10.48550/arxiv.1911.00686arXiv 1911.00686
Open this paper in CoChat — free accountOpen PDF

Abstract

Deep generative models have recently achieved impressive results for many real-world applications, successfully generating high-resolution and diverse samples from complex datasets. Due to this improvement, fake digital contents have proliferated growing concern and spreading distrust in image content, leading to an urgent need for automated ways to detect these AI-generated fake images. Despite the fact that many face editing algorithms seem to produce realistic human faces, upon closer examination, they do exhibit artifacts in certain domains which are often hidden to the naked eye. In this work, we present a simple way to detect such fake face images - so-called DeepFakes. Our method is based on a classical frequency domain analysis followed by basic classifier. Compared to previous systems, which need to be fed with large amounts of labeled data, our approach showed very good results using only a few annotated training samples and even achieved good accuracies in fully unsupervised scenarios. For the evaluation on high resolution face images, we combined several public datasets of real and fake faces into a new benchmark: Faces-HQ. Given such high-resolution images, our approach reaches a perfect classification accuracy of 100% when it is trained on as little as 20 annotated samples. In a second experiment, in the evaluation of the medium-resolution images of the CelebA dataset, our method achieves 100% accuracy supervised and 96% in an unsupervised setting. Finally, evaluating a low-resolution video sequences of the FaceForensics++ dataset, our method achieves 91% accuracy detecting manipulated videos. Source Code: https://github.com/cc-hpc-itwm/DeepFakeDetection

Integrity signals

Registry

DataCite · 10.48550/arxiv.1911.00686

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Faces-HQ includes 40,000 high-resolution images, half real and half deepfake, collected from CelebA-HQ, Flickr-Faces-HQ, 100K-Faces, and thispersondoesnotexist.com.

    “Faces-HQ (Durall et al., 2019): This dataset includes 40,000 high-resolution images, half real and half deepfake. The images were collected from four sources: the CelebA-HQ dataset,30 the Flickr-Faces-HQ dataset (see text footnote 28), the 100K-Faces dataset31 (not available any longer, see the description of generated.photos datasets), and thispersondoesnotexist.com.”

    From Deepfake: definitions, performance metrics and standards, datasets, and a meta-review (2024) · cites this paper as Durall et al., 2019

  • The generated.photos datasets are commercial datasets with up to nearly 2.7 million synthetic face images generated by StyleGAN, with a free edition of 10,000 128x128 images for academic research.

    “generated.photos datasets23: This is a number of commercial datasets provided by Generated Media, Inc., with up to nearly 2.7 million synthetic face images generated by StyleGAN. A free edition with 10,000 128x128 synthetic images is made available for academic research.”

    From Deepfake: definitions, performance metrics and standards, datasets, and a meta-review (2024) · cites this paper as [23]

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Durall, R., Keuper, M., Pfreundt, F.-J., & Keuper, J.
ORCID
Venue
arXiv
Publisher
arXiv
Published
2019
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.1911.00686
arXiv
1911.00686
OpenAlex
W2987809008
Cited by
184
References
4
Citations by year
2026: 2 · 2025: 10 · 2024: 40 · 2023: 36 · 2022: 37 · 2021: 44 · 2020: 14 · 2019: 1
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • Fraunhofer-Publica (Fraunhofer-Gesellschaft) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
  • Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
Keywords
deepfake detection, AI-generated image detection, frequency domain analysis, low-resource learning, unsupervised learning, high-resolution face images, FaceForensics++

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review