Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.

Fully Unsupervised Deepfake Video Detection Via Enhanced Contrastive Learning

Qiao, Tong, Xie, Shichuang, Chen, Yanli, Retraint, Florent, Luo, Xiangyang · 2024 · IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract

Nowadays, Deepfake videos are widely spread over the Internet, which severely impairs the public trustworthiness and social security. Although more and more reliable detectors have recently sprung up for resisting against that new-emerging tampering technique, some challengeable issues still need to be addressed, such that most of Deepfake video detectors under the framework of the supervised mechanism require a large scale of samples with accurate labels for training. When the amount of the training samples with the true labels are not enough or the training data are maliciously poisoned by adversaries, the supervised classifier is probably not reliable for detection. To tackle that tough issue, it is proposed to design a fully unsupervised Deepfake detector. In particular, in the whole procedure of training or testing, we have no idea of any information about the true labels of samples. First, we novelly design a pseudo-label generator for labeling the training samples, where the traditional hand-crafted features are used to characterize both types of samples. Second, the training samples with the pseudo-labels are fed into the proposed enhanced contrastive learner, in which the discriminative features are further extracted and continually refined by iteration on the guidance of the contrastive loss. Last, relying on the inter-frame correlation, we complete the final binary classification between real and fake videos. A large scale of experimental results empirically verify the effectiveness of our proposed unsupervised Deepfake detector on the benchmark datasets including FF++, Celeb-DF, DFD, DFDC, and UADFV. Furthermore, our proposed well-performed detector is superior to the current unsupervised method, and comparable to the baseline supervised methods. More importantly, when facing the problem of the labeled data poisoned by malicious adversaries or insufficient data for training, our proposed unsupervised Deepfake detector performs its powerful superiority.

Overview

Integrity signals

Registry

Crossref · 10.1109/tpami.2024.3356814

Cites

57 of 57 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 57 references

Research works printed but not linked: 4

  1. Neyaz, 2020, Security, privacy and steganographic analysis of faceapp and TikTok, Int. J. Comput. Sci. Secur., 14
  2. Agarwal, Protecting world leaders against Deepfakes, 38
  3. 10.5555/3524938.3525087 · doi:10.5555/3524938.3525087
  4. Dufour, 2019, Contributing data to Deepfake detection research, Google AI Blog, 1

Cited by

See all 57

Metadata

Authors
Qiao, T., Xie, S., Chen, Y., Retraint, F., & Luo, X.
Affiliations
  • Hangzhou Dianzi University (CN)
  • Université de Technologie de Troyes (FR)
  • State Key Laboratory of Mathematical Engineering and Advanced Computing, Zhengzhou Science and Technology Institute, Zhengzhou, China
Venue
IEEE Transactions on Pattern Analysis and Machine Intelligence
Published
2024-07
Volume
46
Issue
7
Pages
4654-4668
ISSN
  • 0162-8828 (ISSN-L)
  • 2160-9292
  • 1939-3539
OpenAlex
W4391092975
Cited by
48
References
57
Citations by year
2026: 22 · 2025: 19 · 2024: 7
FWCI
6.75
Type
journal article
Language
en
Open access
closed
Locations
  • IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
  • PubMed (publishedVersion)
  • HAL (submittedVersion)
Funders
  • Zhejiang Provincial Natural Science Foundation of China (LZ23F020006, LTGG24F020008)
  • National Natural Science Foundation of China (U23A20305, 62172435)
  • National Key Research and Development Program of China (2022YFB3102900.e)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
  • Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
Keywords
deepfake detection, unsupervised learning, contrastive learning, pseudo-labeling, inter-frame correlation, video forgery detection

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Fully Unsupervised Deepfake Video Detection Via Enhanced Contrastive Learning. https://app.cochat.ai/papers/10.1109/tpami.2024.3356814
The paper
Qiao, T., Xie, S., Chen, Y., Retraint, F., & Luo, X. (2024). Fully Unsupervised Deepfake Video Detection Via Enhanced Contrastive Learning. IEEE Transactions on Pattern Analysis and Machine Intelligence. https://doi.org/10.1109/tpami.2024.3356814

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.