PreprintCited by 428Digital Media Forensic DetectionFace recognition and analysisGenerative Adversarial Networks and Image Synthesis

The Deepfake Detection Challenge (DFDC) Preview Dataset

Open access
Dolhansky, Brian, Howes, Russ, Pflaum, Ben, Baram, Nicole, Ferrer, Cristian Canton·2019·arXiv

Abstract

In this paper, we introduce a preview of the Deepfakes Detection Challenge (DFDC) dataset consisting of 5K videos featuring two facial modification algorithms. A data collection campaign has been carried out where participating actors have entered into an agreement to the use and manipulation of their likenesses in our creation of the dataset. Diversity in several axes (gender, skin-tone, age, etc.) has been considered and actors recorded videos with arbitrary backgrounds thus bringing visual variability. Finally, a set of specific metrics to evaluate the performance have been defined and two existing models for detecting deepfakes have been tested to provide a reference performance baseline. The DFDC dataset preview can be downloaded at: deepfakedetectionchallenge.ai

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1910.08854

Cites

6 of 6 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The DFDC dataset does not indicate whether the visual component or speech is manipulated in the video.

    “It does not indicate whether the visual component or speech is manipulated in the video.”

    From Attention-based Multimodal learning framework for Generalized Audio-Visual Deepfake Detection (2023) · cites this paper as [9]

    The Introduction (p. 1) says the dataset’s labels describe whether videos were generated using facial manipulation techniques. Dataset Construction (p. 3) also says its metadata lists swapped and target identities for each video. Thus, the paper does indicate visual face manipulation, contrary to the claim; it does not discuss speech-manipulation labels. (LLM, conf=0.83)

    Checked by a reasoning model — may be wrong.

    Experimental — accuracy not yet measured
  • DFDC-preview is the initial version of the DFDC dataset, containing 1131 real videos and 4119 manipulated videos.

    “DFDC-preview is the initial version of the DFDC dataset containing 1131 real videos and 4119 manipulated videos and is available on Kaggle.”

    From Attention-based Multimodal learning framework for Generalized Audio-Visual Deepfake Detection (2023) · cites this paper as [9]

    Dataset Construction (p. 2) calls the preview the first version of the DFDC dataset. But Table 1 (p. 3) gives 5,214 total videos, whereas the claimed 1,131 real and 4,119 manipulated videos sum to 5,250. The paper does not give those claimed category counts. (LLM, conf=0.87)

    Checked by a reasoning model — may be wrong.

    Experimental — accuracy not yet measured
  • DFDC is a multimodal deepfake dataset comprising nearly 120,000 videos, of which 100,000 are labeled as fake and the remaining as real.

    “DFDC [52] (DeepFake Detection Challenge) is a multimodal deepfake dataset comprising nearly 120,000 videos, of which 100,000 are labeled as fake and the remaining as real.”

    From Deepfake Media Forensics: Status and Future Challenges (2025) · cites this paper as [52]

    The Introduction (p. 1) identifies DFDC as a video dataset with labels distinguishing manipulated from original footage. But this paper describes a preview dataset: Table 1 in Dataset Construction (p. 3) lists 5,214 videos. Our copy does not substantiate the claimed nearly 120,000 videos, the 100,000-fake split, or the multimodal characterization. (LLM, conf=0.88)

    Experimental — accuracy not yet measured
  • DFDC has a 3:1 ratio of fake to real videos, while CelebDF has nearly 5 times more fake videos.

    “For instance, DFDC [37] has a 3:1 ratio of fake to real videos, while CelebDF [38] has nearly 5 times more fake videos.”

    From Deepfake detection across image, video, and audio: a comprehensive survey with empirical evaluation of generalization and robustness (2026) · cites this paper as [37]

    Table 1 (Dataset Construction, p. 3) gives the DFDC Preview Dataset’s tampered-to-original ratio as 1:0.28, or about 3.6:1, rather than 3:1. It also describes the preview dataset, not necessarily the full DFDC dataset. The Celeb-DF clause has a separate citation and is not judged here. (LLM, conf=0.87)

    Experimental — accuracy not yet measured
  • There is a lack of multimodal deepfake datasets in the literature, while monomodal ones are widely available.

    “This poses an additional challenge since there is a lack of multimodal deepfake datasets proposed in the literature, while monomodal ones are widely available.”

    From A Robust Approach to Multimodal Deepfake Detection (2023) · cites this paper as [42]

    The Introduction (p. 1) lists several published datasets for detecting manipulated facial footage, supporting the point that visual deepfake datasets are available. It does not compare monomodal and multimodal datasets or state that multimodal datasets are scarce; searches for those terms and for audio–visual datasets found no such discussion. (LLM, conf=0.75)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Dolhansky, B., Howes, R., Pflaum, B., Baram, N., & Ferrer, C. C.
Venue
arXiv
Publisher
arXiv
Published
2019
ISSN
2331-8422 (ISSN-L)
OpenAlex
W2980459401
Cited by
413
References
6
Citations by year
2026: 6 · 2025: 31 · 2024: 94 · 2023: 79 · 2022: 60 · 2021: 85 · 2020: 55 · 2019: 3
Type
posted content
Language
en
Open access
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
Keywords
deepfake detection, DFDC, face manipulation, synthetic video, video forensics, evaluation metrics

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review