CoChat

Deepfakes Generation and Detection: A Short Survey

Open access
Akhtar, Zahid · 2023 · Journal of Imaging

The DOI matches its Crossref record; 165 of the 165 references it cites were found in a registry or an index.

Abstract

Advancements in deep learning techniques and the availability of free, large databases have made it possible, even for non-technical people, to either manipulate or generate realistic facial samples for both benign and malicious purposes. DeepFakes refer to face multimedia content, which has been digitally altered or synthetically created using deep neural networks. The paper first outlines the readily available face editing apps and the vulnerability (or performance degradation) of face recognition systems under various face manipulations. Next, this survey presents an overview of the techniques and works that have been carried out in recent years for deepfake and face manipulations. Especially, four kinds of deepfake or face manipulations are reviewed, i.e., identity swap, face reenactment, attribute manipulation, and entire face synthesis. For each category, deepfake or face manipulation generation methods as well as those manipulation detection methods are detailed. Despite significant progress based on traditional and advanced computer vision, artificial intelligence, and physics, there is still a huge arms race surging up between attackers/offenders/adversaries (i.e., DeepFake generation methods) and defenders (i.e., DeepFake detection methods). Thus, open challenges and potential research directions are also discussed. This paper is expected to aid the readers in comprehending deepfake generation and detection mechanisms, together with open issues and future directions.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/jimaging9010018

Cites

165 of 165 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Examples of different face manipulations: original samples (first row) and manipulated samples (second row).
Figure 1 Examples of different face manipulations: original samples (first row) and manipulated samples (second row).CC BY · PubMed Central
Figure 2 Real and fake examples of each deepfake/face manipulation group. The fake sample in “Entire face synthesis” group is obtained from the method in [81].
Figure 2 Real and fake examples of each deepfake/face manipulation group. The fake sample in “Entire face synthesis” group is obtained from the method in [81].CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 18

  1. Li, L., Bao, J., Yang, H., Chen, D., and Wen, F. (2019). Faceshifter: Towards high fidelity and occlusion aware face swapping. arXiv.
  2. Koopman, M., Rodriguez, A., and Geradts, Z. (2018, January 29–31). Detection of deepfake video manipulation. Proceedings of the 20th Irish Machine Vision and Image Processing Conference (IMVIP), Coleraine, UK.
  3. Tariq, S., Lee, S., and Woo, S. (2020). A Convolutional LSTM based Residual Network for Deepfake Video Detection. arXiv.
  4. Nirkin, Y., Wolf, L., Keller, Y., and Hassner, T. (2020). DeepFake detection based on the discrepancy between the face and its context. arXiv.
  5. Aneja, S., and Nießner, M. (2020). Generalized Zero and Few-Shot Transfer for Facial Forgery Detection. arXiv.
  6. Liu, S., Lian, Z., Gu, S., and Xiao, L. (2022). Block shuffling learning for Deepfake Detection. arXiv.
  7. Cao, M., Huang, H., Wang, H., Wang, X., Shen, L., Wang, S., Bao, L., Li, L., and Luo, J. (2020). Task-agnostic Temporally Consistent Facial Video Editing. arXiv.
  8. Cozzolino, D., Thies, J., Rossler, A., Riess, C., Niener, M., and Verdoliva, L. (2018). Forensictransfer: Weakly-supervised domain adaptation for forgery detection. arXiv.
  9. Lu, J., Sunkavalli, K., Carr, N., Hadap, S., and Forsyth, D. (2016). A visual representation for editing face images. arXiv.
  10. Kim, D., Kim, D., and Kim, K. (2021). Facial Manipulation Detection Based on the Color Distribution Analysis in Edge Region. arXiv.
  11. Berthelot, D., Schumm, T., and Metz, L. (2017). Began: Boundary equilibrium generative adversarial networks. arXiv.
  12. Kingma, D., and Dhariwal, P. (2018). Glow: Generative flow with invertible 1 × 1 convolutions. arXiv.
  13. Choi, H., Park, C., and Lee, K. (2020). From inference to generation: End-to-end fully self-supervised generation of human face from speech. arXiv.
  14. Curtó, J., Zarza, I., De La Torre, F., King, I., and Lyu, M. (2017). High-resolution deep convolutional generative adversarial networks. arXiv.
  15. Prajapati, P., and Pollett, C. (2022). MRI-GAN: A Generalized Approach to Detect DeepFakes using Perceptual Image Assessment. arXiv.
  16. Karras, T., Aila, T., Laine, S., and Lehtinen, J. (2017). Progressive growing of gans for improved quality, stability, and variation. arXiv.
  17. Bounareli, S., Argyriou, V., and Tzimiropoulos, G. (2022). Finding Directions in GAN’s Latent Space for Neural Face Reenactment. arXiv.
  18. Lample, G., Zeghidour, N., Usunier, N., Bordes, A., Denoyer, L., and Ranzato, M. (2017). Fader networks: Manipulating images by sliding attributes. arXiv.

Cited by

See all 107

Metadata

Authors
Akhtar, Z.
Affiliations
State University of New York (US)
Corresponding author
Akhtar, Zahid
Venue
Journal of Imaging
Publisher
MDPI AG
Published
2023-01-13
Volume
9
Issue
1
Pages
18
ISSN
2313-433X (ISSN-L)
OpenAlex
W4315865725
Cited by
106
References
152
Citations by year
2026: 26 · 2025: 27 · 2024: 41 · 2023: 12
FWCI
2.75
Type
journal article
Language
en
Open access
Locations
  • Journal of Imaging (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
Keywords
deepfakes, deepfake detection, face manipulation, face reenactment, face synthesis, synthetic face generation, adversarial defense

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.