The DOI matches its Crossref record; 345 of the 345 references it cites were found in a registry or an index; 73 of the 188 sources its claims cite were checked for support.
Countering Malicious DeepFakes: Survey, Battleground, and Horizon
Open accessAbstract
The creation or manipulation of facial appearance through deep generative approaches, known as DeepFake, have achieved significant progress and promoted a wide range of benign and malicious applications, e.g., visual effect assistance in movie and misinformation generation by faking famous persons. The evil side of this new technique poses another popular study, i.e., DeepFake detection aiming to identify the fake faces from the real ones. With the rapid development of the DeepFake-related studies in the community, both sides (i.e., DeepFake generation and detection) have formed the relationship of battleground, pushing the improvements of each other and inspiring new directions, e.g., the evasion of DeepFake detection. Nevertheless, the overview of such battleground and the new direction is unclear and neglected by recent surveys due to the rapid increase of related publications, limiting the in-depth understanding of the tendency and future works. To fill this gap, in this paper, we provide a comprehensive overview and detailed analysis of the research work on the topic of DeepFake generation, DeepFake detection as well as evasion of DeepFake detection, with more than 318 research papers carefully surveyed. We present the taxonomy of various DeepFake generation methods and the categorization of various DeepFake detection methods, and more importantly, we showcase the battleground between the two parties with detailed interactions between the adversaries (DeepFake generation) and the defenders (DeepFake detection). The battleground allows fresh perspective into the latest landscape of the DeepFake research and can provide valuable analysis towards the research challenges and opportunities as well as research trends and future directions. We also elaborately design interactive diagrams (http://www.xujuefei.com/dfsurvey) to allow researchers to explore their own interests on popular DeepFake generators or detectors.
Overview
CoChat Summary
TL;DR
This survey reviews more than 318 papers on DeepFake generation, detection, and evasion, framing generation and detection as an adversarial “battleground.” It provides taxonomies, technical-evolution analyses, dataset summaries, and future research directions for countering malicious DeepFakes.
Key findings
- The survey collected 318 papers; about 78% appeared in the last two years, and it tabulates 83 DeepFake generation methods and 117 DeepFake detection methods.
- DeepFake generation is organized into four categories: entire face synthesis, attribute manipulation, identity swap, and expression swap; identity swap ranks highest in detector popularity, while expression swap is least attempted.
- Detection methods are grouped into spatial-based, frequency-based, and biological-signal-based approaches; evasion methods are grouped into adversarial attacks, frequency-domain trace removal, and filtering/generative reconstruction.
- In challenges, DFDC had 2,114 teams; 60% of submissions had log loss ≤ 0.69, and all top-5 solutions were image-based, with three using EfficientNet. DeeperForensics Challenge 2020 had 115 registered participants and 25 valid submissions; two of the top-3 used EfficientNet and all used augmentation.
Methods
- This is a survey/analysis paper, not an experimental study. Papers were collected from a GitHub repository, keyword matching on Google Scholar, DBLP, and arXiv, plus manual browsing of recent top-tier conferences and workshops.
- The analysis includes taxonomies of generation and detection methods, technical-evolution diagrams, Sankey and chord diagrams for method interactions, Elo ratings for generation methods, and detailed tables of real/fake datasets and detection performance.
Limitations
- The paper states it focuses solely on facial DeepFakes; social and ethical aspects are briefly touched but are not the focus of the survey.
- The paper notes an inherent shortcoming of Elo rating: a generation method that appears once but beats high-score competitors can rise sharply, while a method not detected for a long time keeps an unchanged score that may not reflect its true difficulty.
- The text makes evident that DeepFake detection generally lags behind generation, and many detectors lack robustness, generalization, or explainability; the provided text is also truncated, omitting part of the detection and battleground discussion.
Model-written summary of a shortened version of the paper’s full text (it is longer than we read). Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
62 Valid · 31 Not valid · 108 Not checked · 138 Own results and interpretations
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“Although effective, IcGAN can be time-consuming when it aims to perform the manipulation of multiple facial attributes since each attribute is addressed via an independent deep model.”
What the sources say
- Disputedcites Perarnau et al. 2016 sourceExperimental — accuracy not yet measured
The paper describes two independent encoders—one for the latent representation z and one for the attribute information y—not a separate deep model for each facial attribute (Section 4.1, p. 3; Section 6, p. 8). It demonstrates edits across 18 CelebA attributes by modifying y (Section 5.4, p. 7). The copy does not assess whether editing multiple attributes is time-consuming, but it contradicts the claimed reason. (LLM, conf=0.86)
Checked by a reasoning model — may be wrong.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Disputed
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The CramerGANperformssignificantly better than the WGAN.”
What the sources say
- Partly supportedcites Bellemare et al. 2017 sourceExperimental — accuracy not yet measured
Section 5.1 (p. 7) reports that Cramér GAN produced more stable learning and more diverse samples than WGAN-GP; the experiments on p. 8 give examples of both advantages. The claim overgeneralizes this comparison to WGAN and says “significantly better” without specifying the outcomes or conditions the paper evaluated. (LLM, conf=0.86)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“according to the surveys (Verdoliva 2020; Nguyen et al. 2019d; Tolosana et al. 2020; Lyu 2020), GANs are the mainstream baseline technique.”
What the sources say
- Partly supportedcites Verdoliva 2020 sourceExperimental — accuracy not yet measured
Section II, “Fake Content Generation” (p. 3), describes GANs as a successful approach to synthesizing complete media assets, especially photorealistic faces. It also names autoencoders; the copy does not establish that GANs are the mainstream or baseline technique for entire-face synthesis. (LLM, conf=0.79)
- Not matchedcites Nguyen et al. 2019d
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Supportedcites Tolosana et al. 2020 source
The survey’s “Types of Facial Manipulations” section says entire face synthesis is usually performed through GANs. Its “Manipulation Techniques and Public Databases” section also says the four relevant public databases all use ProGAN or StyleGAN, supporting the characterization of GANs as the mainstream technique for this task. (LLM, conf=0.91)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Karras et al. (2017) propose to grow both the generator and discriminator progressively and implement the PGGAN, which significantly improves the generation size to at least 1024 × 1024.”
What the sources say
- Supportedcites Karras et al. 2017 source
Section 2 (p. 2) describes progressively growing both the generator and discriminator and shows generated images at 1024 × 1024. Section 6.3 (p. 8) says the approach handles high output resolutions robustly and reports 1024 × 1024 images produced by the network. (LLM, conf=0.91)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“In previous works, the absence of paired examples is always the limitation in image transformation tasks. CycleGAN has artfully solved this problem.”
What the sources say
- Supportedcites Zhu et al. 2017 source
The Results section identifies CycleGAN as the authors’ method and says it is applied where paired data does not exist. Section 5.1 reports that it learns image-to-image mappings without paired supervision, supporting the attributed claim. (LLM, conf=0.90)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
90 more claims · 9 with their cited sources checked
Create a free account to see all 339 claims and to verify the 3 references still open.
- Probably not a substantial claim. 191
- It may state two separate claims as one. 101
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing surveys [4], [16] relevant to deepfakes predominantly emphasize deepfake generation or general synthetic media detection, whereas our survey is exclusively tailored to the detection of facial deepfakes.”
From Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challenges (2024) · cites this paper as [16]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Earlier surveys [16], [17], [18], [19] predominantly address research published up to 2023, missing significant advancements in recent years.”
From Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challenges (2024) · cites this paper as [16]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“While previous surveys [4], [16], [17] limit their discussions primarily to visual manipulations, we systematically explore recent developments in detecting multi-modal forgeries that simultaneously involve audio, visual, and textual modalities.”
From Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challenges (2024) · cites this paper as [16]
The cited source says what the claim attributes to it.
In the citing paper
“FF++ [57] is one of the most popular datasets [22], but it contains limited types of deepfake data.”
From DEEPFAKER: A Unified Evaluation Platform for Facial Deepfake and Detection Models (2024) · cites this paper as [22]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 3.7 Fake Dataset
“The DFDC is a publicly-available face swap video dataset, with 128,514 videos, over 100,000 total clips sourced from 3426 actors.”
§ 3.9 Summary of DeepFake Generation Methods
“| DFDC (Dolhansky et al. 2020) | 128,154 | - | - | 23,954 | 104,500 |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 3.6 Real Dataset
“MegaFace(Kemelmacher-Shlizermanetal.2016)includes more than 690K different individuals with one million photos.”
§ 3.9 Summary of DeepFake Generation Methods
“| MegaFace (Kemelmacher-Shlizerman et al. 2016) | 690,572 | 4,700,000 | 6.81 |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 2.3 Paper Collection Results
“One fourth of the papers are published in top conferences”
§ 2.3 Paper Collection Results
“Half of the papers are published in top conferences.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 2.1 Survey Scope
“CVPR, which accounts for about half the published top papers.”
§ 2.3 Paper Collection Results
“CVPR, which accounts for about two-thirds the published top papers.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“The DeepFake-TIMIT dataset (Korshunov and Marcel 2018) consists of 620 DeepFake videos of 32 subjects. In DeepFake-TIMIT, each subject has 20 DeepFake videos.”
Reported 620 · recomputed 640
3 more findings
Create a free account to see every finding of this check.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 5×
“FDFtNet (Jeon et al., 2020b) provides a reusable fine-tuning network to improve the capabilities of existing CNN models ( e.g ., SqueezeNet, ShallowNetV3, ResNetV2, and Xception) in detecting fake images effectively.”
MethodInfluentialImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · cited 7×
“On one hand, there will be convergence of many dataset sources into a few very large-scale standardized evaluation datasets for the DeepFake community, similar to the scales of the ImageNet dataset or the COCO object detection dataset (Lin et al., 2014).”
BackgroundMethodInfluentialAn Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460 · cited 1×
“On one hand, there will be convergence of many dataset sources into a few very large-scale standardized evaluation datasets for the DeepFake community, similar to the scales of the ImageNet dataset or the COCO object detection dataset (Lin et al., 2014).”
MethodUnpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Xception: Deep Learning with Depthwise Separable Convolutions
Chollet, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.195 · Cited by 20,380 · cited 5×
“W a n g ' 21 2017) with significant accuracy reduction on the public datasets (Wang et al., 2020e; Frank et al., 2020).”
BackgroundMethodInfluentialAuto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
Tan, M., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1905.11946 · Cited by 17,072 · cited 3×
“Three of the five methods used EfficientNet (Tan and Le, 2019) as the backbone model.”
MethodLearning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293 · cited 2×
“Examples of vision and language foundational models include Florence (Yuan et al., 2021), CLIP (Radford et al., 2021), ALIGN (Jia et al., 2021), Wu Dao (Beijing Academy of Artificial Intelligence, 2021), etc .”
MethodAdvances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,281
Advances in Neural Information Processing Systems 29
Teymur, O., Zygalakis, K., & Calderhead, B. (2016) · Cited by 13,887
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235
A Style-Based Generator Architecture for Generative Adversarial Networks
Karras, T., Laine, S., & Aila, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00453 · Cited by 11,714 · cited 9×
“(Liu et al., 2015) 10,000 200,000 20 VGGFace2 (Cao et al., 2018) 9,131 3,310,000 362.50 FFHQ (Karras et al., 2019) unknown 70,000 unknown VGGFace (Parkhi et al., 2015) 2,622 2,600,000 991.61 Ms-Celeb-1M (Guo et al., 2016) 100,000 10,000,000 100 MegaFace (Kemelmacher-Shlizerman et al., 2016) 690,572 4,700,000 6.81 LSUN…”
BackgroundMethodInfluentialExplaining and Harnessing Adversarial Examples
Goodfellow, I. J., Shlens, J., & Szegedy, C. (2014) · arXiv · doi:10.48550/arxiv.1412.6572 · Cited by 10,381 · cited 3×
“Goodfellow et al. (2014a) propose the generative adversarial network (GAN) and the trained generator is able to produce meaningful examples, e.g ., handwritten numbers and human faces.”
BackgroundMethodConditional Generative Adversarial Nets
Mirza, M., & Osindero, S. (2014) · arXiv · doi:10.48550/arxiv.1411.1784 · Cited by 8,863 · cited 2×
“Based on an extension of the idea of conditional GAN (cGAN) (Mirza and Osindero, 2014), they have evaluated encoders to map a real image into a latent space and a conditional representation, which allows the reconstruction and modifi-cation of arbitrary attributes of real human face images.”
BackgroundTowards Evaluating the Robustness of Neural Networks
Carlini, N., & Wagner, D. (2017) · 2017 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2017.49 · Cited by 8,859 · cited 2×
“Similarly, Gandhi and Jain (2020) use the fast gradient sign method (Goodfellow et al., 2014b) and C&W attacks (Carlini and Wagner, 2017) to fool DeepFake detectors.”
BackgroundMethodDeep Learning Face Attributes in the Wild
Liu, Z., Luo, P., Wang, X., & Tang, X. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.425 · Cited by 7,747 · cited 8×
“CelebA contains ten thousand identities, each of which has twenty images, a total of 200,000 images.”
InfluentialImproved training of Wasserstein GANs
Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., & Courville, A. (2017) · arXiv · doi:10.48550/arxiv.1704.00028 · Cited by 6,800
Analyzing and Improving the Image Quality of StyleGAN
Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., & Aila, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00813 · Cited by 6,332 · cited 2×
“StyleGAN2 (Karras et al., 2020) has exposed several typical artifacts of StyleGAN and has proposed changes in both model architecture and training methods”
BackgroundAnalyzing and Improving the Image Quality of StyleGAN
Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., & Aila, T. (2019) · arXiv · doi:10.48550/arxiv.1912.04958 · Cited by 6,332
Parkhi, O. M., Vedaldi, A., & Zisserman, A. (2015) · Procedings of the British Machine Vision Conference 2015 · doi:10.5244/c.29.41 · Cited by 5,479 · cited 5×
“(Liu et al., 2015) 10,000 200,000 20 VGGFace2 (Cao et al., 2018) 9,131 3,310,000 362.50 FFHQ (Karras et al., 2019) unknown 70,000 unknown VGGFace (Parkhi et al., 2015) 2,622 2,600,000 991.61 Ms-Celeb-1M (Guo et al., 2016) 100,000 10,000,000 100 MegaFace (Kemelmacher-Shlizerman et al., 2016) 690,572 4,700,000 6.81 LSUN…”
BackgroundMethodInfluentialProgressive Growing of GANs for Improved Quality, Stability, and Variation
Karras, T., Aila, T., Laine, S., & Lehtinen, J. (2017) · arXiv · doi:10.48550/arxiv.1710.10196 · Cited by 4,727 · cited 11×
“, 2017) and StyleGAN (Karras et al., 2017) are used for face image synthesis.”
BackgroundMethodInfluentialGenerative Adversarial Networks
Goodfellow, I. J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1406.2661 · Cited by 4,477
StarGAN: Unified Generative Adversarial Networks for Multi-domain Image-to-Image Translation
Choi, Y., Choi, M., Kim, M., Ha, J.-W., Kim, S., & Choo, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00916 · Cited by 4,163 · cited 9×
“To allow flexible GANs and avoid high time consumption, Choi et al. (2018) propose the StarGAN and design a network that enables to manipulate faces along with different properties with a single generator.”
BackgroundMethodInfluentialLarge Scale GAN Training for High Fidelity Natural Image Synthesis
Brock, A., Donahue, J., & Simonyan, K. (2018) · arXiv · doi:10.48550/arxiv.1809.11096 · Cited by 3,717 · cited 1×
“BigGAN (Brock et al., 2018) has attempted to generate high-resolution diverse images from datasets such as ImageNet (Deng et al., 2009).”
MethodTransformers in Vision: A Survey
Khan, S., Naseer, M., Hayat, M., Zamir, S. W., Khan, F. S., & Shah, M. (2022) · ACM Computing Surveys · doi:10.1145/3505244 · Cited by 3,595
Transformers in Vision: A Survey
Khan, S., Naseer, M., Hayat, M., Zamir, S. W., Khan, F. S., & Shah, M. (2021) · arXiv · doi:10.48550/arxiv.2101.01169 · Cited by 3,594
Spectral Normalization for Generative Adversarial Networks
Miyato, T., Kataoka, T., Koyama, M., & Yoshida, Y. (2018) · arXiv · doi:10.48550/arxiv.1802.05957 · Cited by 3,438
FaceForensics++: Learning to Detect Manipulated Facial Images
Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Niessner, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00009 · Cited by 3,314
VGGFace2: A Dataset for Recognising Faces across Pose and Age
Cao, Q., Shen, L., Xie, W., Parkhi, O. M., & Zisserman, A. (2018) · 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018) · doi:10.1109/fg.2018.00020 · Cited by 3,032 · cited 3×
“(Liu et al., 2015) 10,000 200,000 20 VGGFace2 (Cao et al., 2018) 9,131 3,310,000 362.50 FFHQ (Karras et al., 2019) unknown 70,000 unknown VGGFace (Parkhi et al., 2015) 2,622 2,600,000 991.61 Ms-Celeb-1M (Guo et al., 2016) 100,000 10,000,000 100 MegaFace (Kemelmacher-Shlizerman et al., 2016) 690,572…”
BackgroundInfluentialSemantic Image Synthesis With Spatially-Adaptive Normalization
Park, T., Liu, M.-Y., Wang, T.-C., & Zhu, J.-Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00244 · Cited by 2,974 · cited 1×
“…style transfer (Chen et al., 2018c), (Yao et al., 2019), image inpainting (Yu et al., 2018), (Yu et al., 2018), rendering (Chen and Koltun, 2017), (Park et al., 2019), (Liu et al., 2021a), super resolution (Dai et al., 2019), (Guo et al., 2020b), (Liu et al., 2020a), (Mei et al., 2020), fusion…”
ImageNet: A large-scale hierarchical image database
Deng, J. H., Dong, W. F., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206848 · Cited by 2,714
On the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676
Self-citationGenerative Image Inpainting with Contextual Attention
Yu, J., Lin, Z., Yang, J., Shen, X., Lu, X., & Huang, T. S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00577 · Cited by 2,527 · cited 3×
“, 2018), (Yu et al., 2018), rendering (Chen and Koltun, 2017), (Park et al.”
MethodTaming Transformers for High-Resolution Image Synthesis
Esser, P., Rombach, R., & Ommer, B. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01268 · Cited by 2,514 · cited 1×
“They, together with other latest generative approaches such as vector quantized variational autoencoder (VQ-VAE) (Razavi et al., 2019), VQ-GAN + autoregressive transformer (Esser et al., 2021), etc ., will definitely supplement and enhance the DeepFake generation techniques.”
BackgroundTaming Transformers for High-Resolution Image Synthesis
Esser, P., Rombach, R., & Ommer, B. (2020) · arXiv · doi:10.48550/arxiv.2012.09841 · Cited by 2,514
Arjovsky, M., Chintala, S., & Bottou, L. (2017) · arXiv · doi:10.48550/arxiv.1701.07875 · Cited by 2,225
Globally and locally consistent image completion
Iizuka, S., Simo-Serra, E., & Ishikawa, H. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073659 · Cited by 2,203
MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition
Guo, Y., Zhang, L., Hu, Y., He, X., & Gao, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46487-9_6 · Cited by 2,122 · cited 3×
“…2018) 9,131 3,310,000 362.50 FFHQ (Karras et al., 2019) unknown 70,000 unknown VGGFace (Parkhi et al., 2015) 2,622 2,600,000 991.61 Ms-Celeb-1M (Guo et al., 2016) 100,000 10,000,000 100 MegaFace (Kemelmacher-Shlizerman et al., 2016) 690,572 4,700,000 6.81 LSUN (Yu et al., 2015) 30 1000,000…”
BackgroundInfluentialNeural ordinary differential equations
Chen, R. T. Q., Rubanova, Y., Bettencourt, J., & Duvenaud, D. (2018) · arXiv · doi:10.48550/arxiv.1806.07366 · Cited by 2,097
Second-Order Attention Network for Single Image Super-Resolution
Dai, T., Cai, J., Zhang, Y., Xia, S.-T., & Zhang, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01132 · Cited by 2,010 · cited 7×
“, 2021a), super resolution (Dai et al., 2019), (Guo et al.”
MethodInfluentialScaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision
Jia, C., Yang, Y., Xia, Y., Chen, Y.-T., Parekh, Z., Pham, H., Le, Q. V., Sung, Y., Li, Z., & Duerig, T. (2021) · arXiv · doi:10.48550/arxiv.2102.05918 · Cited by 1,977 · cited 2×
“Examples of vision and language foundational models include Florence (Yuan et al., 2021), CLIP (Radford et al., 2021), ALIGN (Jia et al., 2021), Wu Dao (Beijing Academy of Artificial Intelligence, 2021), etc .”
MethodFree-Form Image Inpainting With Gated Convolution
Yu, J., Lin, Z., Yang, J., Shen, X., Lu, X., & Huang, T. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00457 · Cited by 1,928 · cited 2×
“Yu et al. (2019b) first introduce the GAN fingerprints for classifying the images as real or synthesized with GANs.”
BackgroundMethodLempitsky, V., Vedaldi, A., & Ulyanov, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00984 · Cited by 1,916
MesoNet: a Compact Facial Video Forgery Detection Network
Afchar, D., Nozick, V., Yamagishi, J., & Echizen, I. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630761 · Cited by 1,872 · cited 2×
“…et al., 2019b), multiple instance learning (Li et al., 2020d), few-shot learning (Mansourifar and Shi, 2020), enhanced MesoNet (Kawa and Syga, 2020; Afchar et al., 2018), a combination with CNN and RNN (Güera and Delp, 2018; Mas Montserrat et al., 2020), DNN with contrastive loss (Hsu et al.,…”
BackgroundMethodCeleb-DF: A Large-Scale Challenging Dataset for DeepFake Forensics
Li, Y., Yang, X., Sun, P., Qi, H., & Lyu, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00327 · Cited by 1,846 · cited 4×
“As expected, systemically organized DeepFake datasets such as Face-Forensics++ (Rossler et al., 2019), Celeb-DF (Li et al., 2020e), DFDC (Dolhansky et al., 2020) as well as open-sourced high-fidelity face generation methods such as PGGAN (Karras et al., 2017), StarGAN (Choi et al., 2018), StyleGAN (Karras et al., 2019)…”
BackgroundMethodInfluentialConditional Image Generation with PixelCNN Decoders
van den Oord, A., Kalchbrenner, N., Vinyals, O., Espeholt, L., Graves, A., & Kavukcuoglu, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.05328 · Cited by 1,833
Face2Face: Real-Time Face Capture and Reenactment of RGB Videos
Thies, J., Zollhofer, M., Stamminger, M., Theobalt, C., & Niessner, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.262 · Cited by 1,747
StarGAN v2: Diverse Image Synthesis for Multiple Domains
Choi, Y., Uh, Y., Yoo, J., & Ha, J.-W. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00821 · Cited by 1,663 · cited 2×
“As an improvement, StarGAN2 (Choi et al., 2020) simultaneously satis-fies two properties in image-to-image translation: diversity of generated images as well as scalability over multiple domains.”
BackgroundLearning Face Representation from Scratch
Yi, D., Lei, Z., Liao, S., & Li, S. Z. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.7923 · Cited by 1,521 · cited 2×
“CASIA-WebFace (Yi et al., 2014) has proposed a semiautomatic way to collect a lot of face images from the Internet.”
BackgroundProceedings of the Web Conference 2021
(2021) · doi:10.1145/3442381 · Cited by 1,488
(2008) · doi:10.1007/978-0-387-71041-9 · Cited by 1,406
Chen, C., Chen, Q., Xu, J., & Koltun, V. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00347 · Cited by 1,376 · cited 2×
“Fernandes et al. (2019) use neural ordinary differential equation (Neural-ODE) (Chen et al., 2018b) trained on the original videos to predict the heart rate of testing videos.”
MethodDeferred neural rendering: image synthesis using neural textures
Thies, J., Zollhöfer, M., & Nießner, M. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3323035 · Cited by 1,356
Deepfake Video Detection Using Recurrent Neural Networks
Guera, D., & Delp, E. J. (2018) · 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2018.8639163 · Cited by 1,285 · cited 4×
“, 2018), a combination with CNN and RNN (Güera and Delp, 2018; Mas Montserrat et al., 2020),”
BackgroundInfluentialVariational Inference with Normalizing Flows
Rezende, D. J., & Mohamed, S. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.05770 · Cited by 1,253
LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loop
Yu, F., Seff, A., Zhang, Y., Song, S., Funkhouser, T., & Xiao, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.03365 · Cited by 1,245
Deepfakes and beyond: A Survey of face manipulation and fake detection
Tolosana, R., Vera-Rodriguez, R., Fierrez, J., Morales, A., & Ortega-Garcia, J. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.06.014 · Cited by 1,237 · cited 6×
“Tolosana et al. (2020) explore the role of different facial regions in contributing to the DeepFake detection.”
BackgroundMethodInfluentialFace X-Ray for More General Face Forgery Detection
Li, L., Bao, J., Zhang, T., Yang, H., Chen, D., Wen, F., & Guo, B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00505 · Cited by 1,211 · cited 11×
“As expected, systemically organized DeepFake datasets such as Face-Forensics++ (Rossler et al., 2019), Celeb-DF (Li et al., 2020e), DFDC (Dolhansky et al., 2020) as well as open-sourced high-fidelity face generation methods such as PGGAN (Karras et al., 2017), StarGAN (Choi et al., 2018), StyleGAN (Karras et al., 2019)…”
BackgroundMethodInfluentialCNN-Generated Images Are Surprisingly Easy to Spot… for Now
Wang, S.-Y., Wang, O., Zhang, R., Owens, A., & Efros, A. A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00872 · Cited by 1,210 · cited 7×
“W a n g ' 21 2017) with significant accuracy reduction on the public datasets (Wang et al., 2020e; Frank et al., 2020).”
BackgroundMethodInfluentialExposing Deep Fakes Using Inconsistent Head Poses
Yang, X., Li, Y., & Lyu, S. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683164 · Cited by 1,196 · cited 4×
“Formulating fake forensics as a segmentation task to localize the manipulated region in synthesized faces is another interesting idea in fighting against DeepFakes (Li et al., 2019a; Chen and Yang, 2020).”
BackgroundMethodInfluentialIn Ictu Oculi: Exposing AI Created Fake Videos by Detecting Eye Blinking
Li, Y., Chang, M.-C., & Lyu, S. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630787 · Cited by 1,089 · cited 3×
“The UADFV dataset (Li et al., 2018b) consists of 98 videos, with 49 real videos from YouTube and 49 synthesized videos, which are made using the FakeAPP (FaceApp, 2021).”
BackgroundMethodThinking in Frequency: Face Forgery Detection by Mining Frequency-Aware Clues
Qian, Y., Yin, G., Sheng, L., Chen, Z., & Shao, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58610-2_6 · Cited by 1,058 · cited 9×
“For the entire face synthesis, we think the improvements of training sta-Countering bility, resolution, and controllable facial attributes are the major technical characteristics that have been evolved throughout the years, and we highlight seminal works DCGAN, WGAN, PG-GAN, StyleGAN in the top left panel of Figure 5,…”
BackgroundMethodInfluentialSynthesizing Obama: learning lip sync from audio
Suwajanakorn, S., Seitz, S. M., & Kemelmacher-Shlizerman, I. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073640 · Cited by 1,057 · cited 5×
“A2V (Suwajanakorn et al., 2017) has used a recurrent neural network to train a model that can map from raw audio features of Obama’s weekly address footage to mouth shapes.”
BackgroundMethodInfluentialMulti-attentional Deepfake Detection
Zhao, H., Wei, T., Zhou, W., Zhang, W., Chen, D., & Yu, N. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00222 · Cited by 1,019 · cited 2×
“, 2018), multi-attentional network (Zhao et al., 2021).”
Background(2020) · International Conference on Machine Learning · Cited by 1,012
Media Forensics and DeepFakes: An Overview
Verdoliva, L. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.3002101 · Cited by 979 · cited 3×
“However, according to the surveys (Verdoliva, 2020; Nguyen et al., 2019d; Tolosana et al., 2020; Lyu, 2020), GANs are the mainstream baseline technique.”
BackgroundMethodCapsule-forensics: Using Capsule Networks to Detect Forged Images and Videos
Nguyen, H. H., Yamagishi, J., & Echizen, I. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8682602 · Cited by 951 · cited 5×
“In addition, there are also a few relatable DeepFake surveys first published in late 2019 and early 2020 (Nguyen et al., 2019d; Tolosana et al., 2020; Lyu, 2020).”
BackgroundMethodInfluentialThe MegaFace Benchmark: 1 Million Faces for Recognition at Scale
Kemelmacher-Shlizerman, I., Seitz, S. M., Miller, D., & Brossard, E. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.527 · Cited by 912 · cited 5×
“They have established MegaFace challenge which evaluates how face recognition algorithms perform under the perturbation of a very large number of “distractors” ( i.e ., individuals that are not in the probe set).”
BackgroundInfluentialPhotographic Image Synthesis with Cascaded Refinement Networks
Chen, Q., & Koltun, V. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.168 · Cited by 887 · cited 1×
“The methods such as style transfer (Chen et al., 2018c), (Yao et al., 2019), image inpainting (Yu et al., 2018), (Yu et al., 2018), rendering (Chen and Koltun, 2017), (Park et al., 2019), (Liu et al., 2021a), super resolution (Dai et al., 2019), (Guo et al., 2020b), (Liu et al., 2020a), (Mei et…”
MethodThe Creation and Detection of Deepfakes: A Survey
Mirsky, Y., & Lee, W. (2022) · ACM Computing Surveys · doi:10.1145/3425780 · Cited by 863
The Creation and Detection of Deepfakes: A Survey
Mirsky, Y., & Lee, W. (2020) · arXiv · doi:10.48550/arxiv.2004.11138 · Cited by 863
AttGAN: Facial attribute editing by only changing what you want
He, Z., Zuo, W., Kan, M., Shan, S., & Chen, X. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2916751 · Cited by 833 · cited 11×
“StarGAN (Choi et al., 2018) AttGAN (He et al., 2019b) Apply an attribute classification constraint to the generated image.”
BackgroundMethodInfluentialGlow: Generative Flow with Invertible 1x1 Convolutions
Kingma, D. P., & Dhariwal, P. (2018) · arXiv · Cited by 825
Exploiting Visual Artifacts to Expose Deepfakes and Face Manipulations
Matern, F., Riess, C., & Stamminger, M. (2019) · 2019 IEEE Winter Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw.2019.00020 · Cited by 824 · cited 1×
“Visual artifacts such as eyes, teeth, facial contours will be an important clue for exposing DeepFakes (Matern et al., 2019).”
BackgroundExposing DeepFake Videos By Detecting Face Warping Artifacts
Li, Y., & Lyu, S. (2018) · arXiv · doi:10.48550/arxiv.1811.00656 · Cited by 785 · cited 2×
“Early works study the irregular eye blinking (Li et al., 2018b), the mismatch facial landmarks (Yang et al., 2019a,b), and the fixed size of synthesized faces (Li and Lyu, 2019), etc .”
BackgroundLearning Rich Features for Image Manipulation Detection
Zhou, P., Han, X., Morariu, V. I., & Davis, L. S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00116 · Cited by 778 · cited 2×
“…multi-scale retinex space (Chen et al., 2019a), two-stream Faster R-CNN with features from the RGB image and noise features by using steganalysis (Zhou et al., 2018), two-stream neural network with GoogLeNet for observing artifacts and a patch-based triplet network for capturing local noise…”
MethodOn the Detection of Digital Face Manipulation
Dang, H., Liu, F., Stehouwer, J., Liu, X., & Jain, A. K. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00582 · Cited by 764 · cited 3×
“Diverse Fake Face Dataset (DFFD) (Dang et al., 2020) has collected a large-scale dataset that contains numerous types of facial forgeries.”
BackgroundMethodInfluentialDrop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks With Octave Convolution
Chen, Y., Fan, H., Xu, B., Yan, Z., Kalantidis, Y., Rohrbach, M., Shuicheng, Y., & Feng, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00353 · Cited by 736 · cited 2×
“Octave convolution (OctConv) (Chen et al., 2019b) is leveraged for capturing the frequency domain to learn the intrinsic feature from CDI and SI to determine fake faces.”
BackgroundMethodUlyanov, D., Vedaldi, A., & Lempitsky, V. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-020-01303-4 · Cited by 719
FSGAN: Subject Agnostic Face Swapping and Reenactment
Nirkin, Y., Keller, Y., & Hassner, T. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00728 · Cited by 706 · cited 1×
“Face swapping GAN (FSGAN) (Nirkin et al., 2019) is a subject agnostic method that doesn’t rely on the training of pairs of faces.”
MethodTwo-Stream Neural Networks for Tampered Face Detection
Zhou, P., Han, X., Morariu, V. I., & Davis, L. S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.229 · Cited by 700 · cited 2×
“…et al., 2018), two-stream neural network with GoogLeNet for observing artifacts and a patch-based triplet network for capturing local noise residual (Zhou et al., 2017), multistream deep learning network for capturing the artifacts by using Face2Face reenactment (Kumar et al., 2020), incorporating…”
MethodBEGAN: Boundary Equilibrium Generative Adversarial Networks
Berthelot, D., Schumm, T., & Metz, L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.10717 · Cited by 654
Wu, Y., AbdAlmageed, W., & Natarajan, P. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00977 · Cited by 647 · cited 2×
“ManTra-Net (Wu et al., 2019) proposes an end-to-end fully convolutional network for addressing various types of image forgery, such as splicing, copy-move, removal, enhancement, and even unknown types.”
BackgroundAn Introduction to Variational Autoencoders
Kingma, D. P., & Welling, M. (2019) · doi:10.1561/9781680836233 · Cited by 643
GANimation: Anatomically-Aware Facial Animation from a Single Image
Pumarola, A., Agudo, A., Martinez, A. M., Sanfeliu, A., & Moreno-Noguer, F. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01249-6_50 · Cited by 621 · cited 1×
“To address this limitation, GAN animation (GANimation) (Pumarola et al., 2018) has introduced a novel GAN conditioning method based on action units (AU) annotations.”
MethodResidual Feature Aggregation Network for Image Super-Resolution
Liu, J., Zhang, W., Tang, Y., Tang, J., & Wu, G. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00243 · Cited by 619 · cited 2×
“Gram-Net (Liu et al., 2020b) OC-FakeDect (Khalid and Woo, 2020) proposes training on real faces with a one-class variational autoencoder (VAE) to Table 7: Summary of existing DeepFake detection methods.”
BackgroundHigh-Resolution Representations for Labeling Pixels and Regions
Sun, K., Zhao, Y. S., Jiang, B., Cheng, T., Xiao, B., Liu, D., Mu, Y., Wang, X., Liu, W., & Wang, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.04514 · Cited by 614
Generalizing Face Forgery Detection with High-frequency Features
Luo, Y., Zhang, Y., Yan, J., & Liu, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01605 · Cited by 609
Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domain
Liu, H., Li, X., Zhou, W., Chen, Y., He, Y., Xue, H., Zhang, W., & Yu, N. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00083 · Cited by 600 · cited 1×
“To improve the transferability of face forgery detection method across unseen synthetic techniques, Liu et al. (2021b) combine spatial image and phase spectrum to capture the up-sampling artifacts in existing GANs for aiding detection.”
MethodDeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detection
Jiang, L., Li, R., Wu, W., Qian, C., & Loy, C. C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00296 · Cited by 599 · cited 4×
“0 (Jiang et al., 2020b) has represented the largest face forgery detection dataset by far, with 60,000 videos constituted by a total of 17.6 million frames.”
BackgroundInfluentialDetecting and Simulating Artifacts in GAN Fake Images
Zhang, X., Karaman, S., & Chang, S.-F. (2019) · 2019 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs47025.2019.9035107 · Cited by 567 · cited 4×
“Figure 7 visualizes the spectra maps of real and fake face (Zhang et al., 2019), respectively.”
BackgroundInfluentialInvertible Conditional GANs for image editing
Perarnau, G., van de Weijer, J., Raducanu, B., & Álvarez, J. M. (2016) · arXiv · doi:10.48550/arxiv.1611.06355 · Cited by 563
Multi-task Learning for Detecting and Segmenting Manipulated Facial Images and Videos
Nguyen, H. H., Fang, F., Yamagishi, J., & Echizen, I. (2019) · 2019 IEEE 10th International Conference on Biometrics Theory, Applications and Systems (BTAS) · doi:10.1109/btas46853.2019.9185974 · Cited by 549 · cited 5×
“In addition, there are also a few relatable DeepFake surveys first published in late 2019 and early 2020 (Nguyen et al., 2019d; Tolosana et al., 2020; Lyu, 2020).”
BackgroundMethodInfluentialLips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detection
Haliassos, A., Vougioukas, K., Petridis, S., & Pantic, M. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00500 · Cited by 537
Brown, T. B., Mané, D., Roy, A., Abadi, M., & Gilmer, J. (2017) · arXiv · doi:10.48550/arxiv.1712.09665 · Cited by 509
Learning Pyramid-Context Encoder Network for High-Quality Image Inpainting
Zeng, Y., Fu, J., Chao, H., & Guo, B. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00158 · Cited by 500
FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signals
Ciftci, U. A., Demir, I., & Yin, L. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3009287 · Cited by 499 · cited 3×
“FakeCatcher (Ciftci et al., 2020a) has collected over 140 online videos, up to 30GB. Unlike most of the fake datasets, it includes “in the wild” videos, independent of the generative model, resolution, compression, content, and context. iFakeFaceDB (Neves et al., 2020) is a fake image dataset for…”
BackgroundMethodDeepFakes: a New Threat to Face Recognition? Assessment and Detection
Korshunov, P., & Marcel, S. (2018) · arXiv · doi:10.48550/arxiv.1812.08685 · Cited by 497 · cited 5×
“However, Korshunov and Marcel (2018) investigate several baselines for evaluating existing studies in DeepFake detection including lip-sync inconsistency detection.”
BackgroundMethodInfluentialTwo-Branch Recurrent Network for Isolating Deepfakes in Videos
Masi, I., Killekar, A., Mascarenhas, R. M., Gurudatt, S. P., & AbdAlmageed, W. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58571-6_39 · Cited by 471 · cited 1×
“Masi et al. (2020) propose a two-branch network for amplifying the artifacts in the synthesized faces by combing clues from the color domain and frequency domain.”
BackgroundDeep Learning for Deepfakes Creation and Detection: A Survey
Nguyen, T. T., Nguyen, Q. V. H., Nguyen, D. T., Nguyen, D. T., Huynh-The, T., Nahavandi, S., Nguyen, T. T., Pham, Q.-V., & Nguyen, C. M. (2019) · arXiv · doi:10.48550/arxiv.1909.11573 · Cited by 464
WildDeepfake: A Challenging Real-World Dataset for Deepfake Detection
Zi, B., Chang, M., Chen, J., Ma, X., & Jiang, Y.-G. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413769 · Cited by 448 · cited 1×
“To provide a more realistic DeepFake dataset, Zi et al. (2020) collect their dataset WildDeepfake, which contains 7,314 face sequences extracted from 707 DeepFake videos collected completely from the internet.”
MethodOne-Shot Free-View Neural Talking-Head Synthesis for Video Conferencing
Wang, T.-C., Mallya, A., & Liu, M.-Y. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00991 · Cited by 444 · cited 7×
“W a n g ' 21 2017) with significant accuracy reduction on the public datasets (Wang et al., 2020e; Frank et al., 2020).”
BackgroundMethodInfluentialRecurrent convolutional strategies for face manipulation detection in videos
Sabir, E., Cheng, J., Jaiswal, A., AbdAlmageed, W., Masi, I., & Natarajan, P. (2019) · arXiv · doi:10.48550/arxiv.1905.00582 · Cited by 443 · cited 2×
“A recurrent convolutional network is exploited to capture the temporal discrepancies in fake videos (Sabir et al., 2019). de Lima et al. (2020) have employed the temporal information by leveraging various typical CNNs for DeepFake detection.”
BackgroundMethodAttributing Fake Images to GANs: Learning and Analyzing GAN Fingerprints
Yu, N., Davis, L., & Fritz, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00765 · Cited by 437 · cited 2×
“Yu et al. (2019b) first introduce the GAN fingerprints for classifying the images as real or synthesized with GANs.”
BackgroundMethodThe deepfake detection challenge (dfdc) dataset
Dolhansky, B., Bitton, J., Pflaum, B., Lu, J., Howes, R., Wang, M., & Ferrer, C. C. (2020) · arXiv · doi:10.48550/arxiv.2006.07397 · Cited by 427
Deepfake Video Detection through Optical Flow Based CNN
Amerini, I., Galteri, L., Caldelli, R., & Del Bimbo, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00152 · Cited by 424 · cited 1×
“…CNN (Dang et al., 2019; Marra et al., 2020; Coz-zolino et al., 2018), CNN with local features (Tarasiou and Zafeiriou, 2020), CNN with optical flow (Amerini et al., 2019), ensembled CNNs (Bonettini et al., 2021b; Tariq et al., 2018), light-weight CNN (Sambhu and Canavan, 2020), 3D CNNs…”
Method(2019) · Cited by 415
Image Super-Resolution With Cross-Scale Non-Local Attention and Exhaustive Self-Exemplars Mining
Mei, Y., Fan, Y., Zhou, Y., Huang, L., Huang, T. S., & Shi, H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00573 · Cited by 413 · cited 1×
“…(Chen and Koltun, 2017), (Park et al., 2019), (Liu et al., 2021a), super resolution (Dai et al., 2019), (Guo et al., 2020b), (Liu et al., 2020a), (Mei et al., 2020), fusion (Lin et al., 2019), de-identification (Sun et al., 2018), (Li and Lin, 2019), (Maximov et al., 2020), etc . share some of…”
The Deepfake Detection Challenge (DFDC) Preview Dataset
Dolhansky, B., Howes, R., Pflaum, B., Baram, N., & Ferrer, C. C. (2019) · arXiv · doi:10.48550/arxiv.1910.08854 · Cited by 413 · cited 3×
“DFDC Preview (Dolhansky et al., 2019) 5,214 - - 1,131 4,113”
MethodDeepFaceLab: Integrated, flexible and extensible face-swapping frameworkPreprint
Perov, I., Gao, D., Chervoniy, N., Liu, K., Marangonda, S., Umé, C., Dpfks, Facenheim, C. S., Rp, L., Jiang, J., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.05535 · Cited by 410
Global Texture Enhancement for Fake Face Detection in the Wild
Liu, Z., Qi, X., & Torr, P. H. S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00808 · Cited by 401 · cited 2×
“Gram-Net (Liu et al., 2020b) OC-FakeDect (Khalid and Woo, 2020) proposes training on real faces with a one-class variational autoencoder (VAE) to Table 7: Summary of existing DeepFake detection methods.”
BackgroundDetection of GAN-Generated Fake Images over Social Networks
Marra, F., Gragnaniello, D., Cozzolino, D., & Verdoliva, L. (2018) · 2018 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr.2018.00084 · Cited by 399
STGAN: A Unified Selective Transfer Network for Arbitrary Image Attribute Editing
Liu, M., Ding, Y., Xia, M., Liu, X., Ding, E., Zuo, W., & Wen, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00379 · Cited by 394 · cited 8×
“Considering that the specific editing task is only related to the changed attributes instead of all target attributes, as an improvement of AttGAN, STGAN (Liu et al., 2019) has selectively taken the difference between target and source attribute vectors as the input of the model.”
MethodInfluentialTest-Time Training with Self-Supervision for Generalization under Distribution Shifts
Sun, Y., Wang, X., Liu, Z., Miller, J., Efros, A. A., & Hardt, M. (2019) · arXiv · doi:10.48550/arxiv.1909.13231 · Cited by 393
Leveraging Frequency Analysis for Deep Fake Image Recognition
Frank, J., Eisenhofer, T., Schönherr, L., Fischer, A., Kolossa, D., & Holz, T. (2020) · arXiv · doi:10.48550/arxiv.2003.08685 · Cited by 390 · cited 4×
“W a n g ' 21 2017) with significant accuracy reduction on the public datasets (Wang et al., 2020e; Frank et al., 2020).”
BackgroundInfluentialFlorence: A New Foundation Model for Computer Vision
Yuan, L., Chen, D., Chen, Y.-L., Codella, N., Dai, X., Gao, J., Hu, H., Huang, X., Li, B., Li, C., et al. (2021) · arXiv · doi:10.48550/arxiv.2111.11432 · Cited by 389
Coherent Semantic Attention for Image Inpainting
Liu, H., Jiang, B., Xiao, Y., & Yang, C. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00427 · Cited by 383 · cited 8×
“Considering that the specific editing task is only related to the changed attributes instead of all target attributes, as an improvement of AttGAN, STGAN (Liu et al., 2019) has selectively taken the difference between target and source attribute vectors as the input of the model.”
MethodInfluentialLearning Self-Consistency for Deepfake Detection
Zhao, T., Xu, X., Xu, M., Ding, H., Xiong, Y., & Xia, W. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01475 · Cited by 383
TediGAN: Text-Guided Diverse Face Image Generation and Manipulation
Xia, W., Yang, Y., Xue, J.-H., & Wu, B. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00229 · Cited by 376 · cited 3×
“Recently, Xia et al. (2021) propose a new design to use text as input instead of an attribute vector to change the facial properties of real images.”
BackgroundMethodDeepFake Detection by Analyzing Convolutional Traces
Guarnera, L., Giudice, O., & Battiato, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00341 · Cited by 374 · cited 3×
“Ac-tually, leveraging the frequency domain to distinguish real and fake faces is widely applied in recent studies (Durall et al., 2019; Bonettini et al., 2021a; Guarnera et al., 2020c).”
MethodPose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representation
Zhou, H., Sun, Y., Wu, W., Loy, C. C., Wang, X., & Liu, Z. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00416 · Cited by 370 · cited 2×
“To solve this problem, PC-AVS introduces extra pose source video to compensate only for head motions and successfully disentangle the representations of talking human faces into the spaces of speech content, head pose, and identity respectively.”
Do GANs leave artificial fingerprints?
Marra, F., Gragnaniello, D., Verdoliva, L., & Poggi, G. (2019) · 2019 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr.2019.00103 · Cited by 361 · cited 2×
“Other studies (Marra et al., 2019a) also leverage the GAN fingerprints for discriminating GAN-synthesized fake faces.”
BackgroundResultWhat Makes Fake Images Detectable? Understanding Properties that Generalize
Chai, L., Bau, D., Lim, S.-N., & Isola, P. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58574-7_7 · Cited by 357 · cited 3×
“Chai et al. (2020) investigate that local patches have redundant artifacts which could be used for differentiating fake faces.”
BackgroundMethodInfluentialLi, J., Xie, H., Li, J., Wang, Z., & Zhang, Y. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00639 · Cited by 357 · cited 3×
“FaceInpainter (Li et al., 2021a) proposes a controllable face inpainting network under heterogeneous domains ( i.e ., oil painting, 3D cartoons, pencil drawing, exaggerated drawing, etc .).”
BackgroundClosed-Loop Matters: Dual Regression Networks for Single Image Super-Resolution
Guo, Y., Chen, J., Wang, J., Chen, Q., Cao, J., Deng, Z., Xu, Y., & Tan, M. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00545 · Cited by 352 · cited 3×
“ARENnet (Guo et al., 2020c) aims at highlighting the tampered artifacts by suppressing the image content to build a practical DeepFake detector.”
BackgroundSC-FEGAN: Face Editing Generative Adversarial Network With User’s Sketch and Color
Jo, Y., & Park, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00183 · Cited by 346 · cited 2×
“SC-FEGAN (Jo and Park, 2019) has presented a novel image editing system that generates images with the free-form masks, sketches, and color provided by the users.”
BackgroundCombating Deepfake Videos Using Blockchain and Smart Contracts
Hasan, H. R., & Salah, K. (2019) · IEEE Access · doi:10.1109/access.2019.2905689 · Cited by 339 · cited 1×
“Hasan and Salah (2019) also leverage blockchain to trace and track the source of multimedia which provides insight for combating DeepFake videos.”
BackgroundFaceForensics: A Large-scale Video Dataset for Forgery Detection in Human Faces
Rössler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Nießner, M. (2018) · arXiv · doi:10.48550/arxiv.1803.09179 · Cited by 339
Detecting GAN generated Fake Images using Co-occurrence Matrices
Nataraj, L., Mohammed, T. M., Manjunath, B. S., Chandrasekaran, S., Flenner, A., Bappy, J. H., & Roy-Chowdhury, A. K. (2019) · Electronic Imaging · doi:10.2352/issn.2470-1173.2019.5.mwsf-532 · Cited by 331
MFC Datasets: Large-Scale Benchmark Datasets for Media Forensic Challenge Evaluation
Guan, H., Kozak, M., Robertson, E., Lee, Y., Yates, A. N., Delgado, A., Zhou, D., Kheyrkhah, T., Smith, J., & Fiscus, J. (2019) · 2019 IEEE Winter Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw.2019.00018 · Cited by 329 · cited 2×
“MFC (Guan et al., 2019) data contains several major parts:”
Emotions Don't Lie: An Audio-Visual Deepfake Detection Method using Affective Cues
Mittal, T., Bhattacharya, U., Chandra, R., Bera, A., & Manocha, D. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413570 · Cited by 319 · cited 1×
“Then, some studies are working on how to measure the similarity between visual and audio (Mittal et al., 2020; Chugh et al., 2020) and further explore strong visual-audio inconsistency signals for DeepFake detection (Agarwal et al., 2020b).”
BackgroundIntroVAE: Introspective Variational Autoencoders for Photographic Image SynthesisPreprint
Huang, H., li, Z., He, R., Sun, Z., & Tan, T. N. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.06358 · Cited by 318
DeepFake Detection Based on Discrepancies Between Faces and Their Context
Nirkin, Y., Wolf, L., Keller, Y., & Hassner, T. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3093446 · Cited by 312
Neural Face Editing with Intrinsic Image Disentangling
Shu, Z., Yumer, E., Hadap, S., Sunkavalli, K., Shechtman, E., & Samaras, D. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.578 · Cited by 307
Deep fake image detection based on pairwise learning
Hsu, C.-C., Zhuang, Y.-X., & Lee, C.-Y. (2020) · Applied Sciences · doi:10.3390/app10010370 · Cited by 304 · cited 1×
“…(Kumar et al., 2020), incorporating CNN with image segmentation (Yu et al., 2019a), capsule networks (Nguyen et al., 2019b,c), pairwise learning (Hsu et al., 2020), metric learning (Kumar et al., 2020), incremental learning (Marra et al., 2019b), multiple instance learning (Li et al., 2020d),…”
MethodAdvancing High Fidelity Identity Swapping for Forgery Detection
Li, L., Bao, J., Yang, H., Chen, D., & Wen, F. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00512 · Cited by 288 · cited 11×
“As expected, systemically organized DeepFake datasets such as Face-Forensics++ (Rossler et al., 2019), Celeb-DF (Li et al., 2020e), DFDC (Dolhansky et al., 2020) as well as open-sourced high-fidelity face generation methods such as PGGAN (Karras et al., 2017), StarGAN (Choi et al., 2018), StyleGAN (Karras et al., 2019)…”
BackgroundMethodInfluentialRepresentative Forgery Mining for Fake Face Detection
Wang, C., & Deng, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01468 · Cited by 288 · cited 2×
“On the same line of thought, there has been an increase in a digital avatar or virtual assistance by means of DeepFake technology (Pinscreen, 2021) to be used for e.g ., video conferencing scenarios (Wang et al., 2021).”
BackgroundMethodHybrid Deep Learning for Face Verification
Sun, Y., Wang, X., & Tang, X. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.188 · Cited by 285 · cited 2×
“selected from a famous face dataset: CelebFaces (Sun et al., 2013).”
BackgroundDeepRhythm: Exposing DeepFakes with Attentional Visual Heartbeat Rhythms
Qi, H., Guo, Q., Juefei-Xu, F., Xie, X., Ma, L., Feng, W., Liu, Y., & Zhao, J. (2020) · arXiv · doi:10.48550/arxiv.2006.07634 · Cited by 280
Self-citationTransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Up
Jiang, Y., Chang, S., & Wang, Z. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.07074 · Cited by 254 · cited 4×
“In recent years, there have been two famous DeepFake challenge: DeepFake Detection Challenge (DFDC) (Dolhansky et al., 2020) and DeeperForensics Challenge 2020 (Jiang et al., 2021a).”
BackgroundInfluentialFakeSpotter: A Simple yet Robust Baseline for Spotting AI-Synthesized Fake Faces
Wang, R., Juefei-Xu, F., Ma, L., Xie, X., Huang, Y., Wang, J., & Liu, Y. (2020) · Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/476 · Cited by 250 · cited 7×
“W a n g ' 21 2017) with significant accuracy reduction on the public datasets (Wang et al., 2020e; Frank et al., 2020).”
BackgroundMethodInfluentialSelf-citationMSG-GAN: Multi-Scale Gradients for Generative Adversarial Networks
Karnewar, A., & Wang, O. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00782 · Cited by 248
Face2Face: real-time face capture and reenactment of RGB videos
Thies, J., Zollhöfer, M., Stamminger, M., Theobalt, C., & Nießner, M. (2018) · Communications of the ACM · doi:10.1145/3292039 · Cited by 244
Detecting Deep-Fake Videos from Appearance and Behavior
Agarwal, S., Farid, H., El-Gaaly, T., & Lim, S.-N. (2020) · 2020 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs49906.2020.9360904 · Cited by 242 · cited 3×
“Researchers leveraged this clue for detecting lip-sync DeepFakes (Agarwal et al., 2020b).”
BackgroundIdentification of deep network generated images using disparities in color components
Li, H., Li, B., Tan, S., & Huang, J. (2020) · Signal Processing · doi:10.1016/j.sigpro.2020.107616 · Cited by 241 · cited 11×
“As expected, systemically organized DeepFake datasets such as Face-Forensics++ (Rossler et al., 2019), Celeb-DF (Li et al., 2020e), DFDC (Dolhansky et al., 2020) as well as open-sourced high-fidelity face generation methods such as PGGAN (Karras et al., 2017), StarGAN (Choi et al., 2018), StyleGAN (Karras et al., 2019)…”
BackgroundMethodInfluentialDeepfake Detection: Current Challenges and Next Steps
Lyu, S. (2020) · 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW) · doi:10.1109/icmew46912.2020.9105991 · Cited by 234 · cited 2×
“In addition, there are also a few relatable DeepFake surveys first published in late 2019 and early 2020 (Nguyen et al., 2019d; Tolosana et al., 2020; Lyu, 2020).”
BackgroundDetecting Deep-Fake Videos from Phoneme-Viseme Mismatches
Agarwal, S., Farid, H., Fried, O., & Agrawala, M. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00338 · Cited by 234 · cited 3×
“Researchers leveraged this clue for detecting lip-sync DeepFakes (Agarwal et al., 2020b).”
BackgroundSharp Multiple Instance Learning for DeepFake Video Detection
Li, X., Lang, Y., Chen, Y., Mao, X., He, Y., Wang, S., Xue, H., & Lu, Q. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3414034 · Cited by 234 · cited 12×
“As expected, systemically organized DeepFake datasets such as Face-Forensics++ (Rossler et al., 2019), Celeb-DF (Li et al., 2020e), DFDC (Dolhansky et al., 2020) as well as open-sourced high-fidelity face generation methods such as PGGAN (Karras et al., 2017), StarGAN (Choi et al., 2018), StyleGAN (Karras et al., 2019)…”
BackgroundMethodInfluentialNot made for each other- Audio-Visual Dissonance-based Deepfake Detection and Localization
Chugh, K., Gupta, P., Dhall, A., & Subramanian, R. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413700 · Cited by 225 · cited 3×
“Then, some studies are working on how to measure the similarity between visual and audio (Mittal et al., 2020; Chugh et al., 2020) and further explore strong visual-audio inconsistency signals for DeepFake detection (Agarwal et al., 2020b).”
BackgroundUse of a Capsule Network to Detect Fake Images and VideosPreprint
Nguyen, H. H., Yamagishi, J., & Echizen, I. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.12467 · Cited by 224 · cited 5×
“In addition, there are also a few relatable DeepFake surveys first published in late 2019 and early 2020 (Nguyen et al., 2019d; Tolosana et al., 2020; Lyu, 2020).”
BackgroundMethodInfluentialThe Cramer Distance as a Solution to Biased Wasserstein Gradients
Bellemare, M. G., Danihelka, I., Dabney, W., Mohamed, S., Lakshminarayanan, B., Hoyer, S., & Munos, R. (2017) · arXiv · doi:10.48550/arxiv.1705.10743 · Cited by 223 · cited 3×
“To improve it, CramerGAN (Bellemare et al., 2017) has combined the best of the Wasserstein and Kullback-Leibler divergences to propose the Cramér distance.”
MethodCIAGAN: Conditional Identity Anonymization Generative Adversarial Networks
Maximov, M., Elezi, I., & Leal-Taixe, L. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00549 · Cited by 222 · cited 1×
“…(Liu et al., 2021a), super resolution (Dai et al., 2019), (Guo et al., 2020b), (Liu et al., 2020a), (Mei et al., 2020), fusion (Lin et al., 2019), de-identification (Sun et al., 2018), (Li and Lin, 2019), (Maximov et al., 2020), etc . share some of the technical similarities of DeepFake generation.”
BackgroundForensicTransfer: Weakly-supervised Domain Adaptation for Forgery Detection
Cozzolino, D., Thies, J., Rössler, A., Riess, C., Nießner, M., & Verdoliva, L. (2018) · arXiv · doi:10.48550/arxiv.1812.02510 · Cited by 221 · cited 23×
“P represents the method simply employs peer works for comparison, T indicates the method simply adopts some simple CNN models for comparison, B denotes the method leverages both peer works and conventional CNN models for comparison.”
MethodInfluentialID-Reveal: Identity-aware DeepFake Video Detection
Cozzolino, D., Rossler, A., Thies, J., Niesner, M., & Verdoliva, L. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01483 · Cited by 221
Detecting GAN-Generated Imagery Using Saturation Cues
McCloskey, S., & Albright, M. (2019) · 2019 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2019.8803661 · Cited by 220 · cited 2×
“In particular, McCloskey and Albright (2019) measure the frequency of saturated and under-exposed pixels to discriminate real and fake faces.”
BackgroundDeepRhythm: Exposing DeepFakes with Attentional Visual Heartbeat Rhythms
Qi, H., Guo, Q., Juefei-Xu, F., Xie, X., Ma, L., Feng, W., Liu, Y., & Zhao, J. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413707 · Cited by 220 · cited 4×
“…difference between real and fake from the biological signal domain, especially the colorful motion-magnified spatial-temporal (MMST) maps between them (Qi et al., 2020). for computing the similarity between visual and audio, the other loss function is devised for calculating the effect cues, like…”
BackgroundInfluentialSelf-citationDeepfake Detection using Spatiotemporal Convolutional NetworksPreprint
de Lima, O., Franklin, S., Basu, S., Karwoski, B., & George, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.14749 · Cited by 215
ExprGAN: Facial Expression Editing With Controllable Expression Intensity
Ding, H., Sricharan, K., & Chellappa, R. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12277 · Cited by 207 · cited 1×
“The expression generative adversarial network (ExprGAN) (Ding et al., 2017) has added an expression controller module that can learn an expressive and compact expression code to the encoder-decoder network.”
BackgroundAdversarial Perturbations Fool Deepfake Detectors
Gandhi, A., & Jain, S. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207034 · Cited by 206 · cited 1×
“Similarly, Gandhi and Jain (2020) use the fast gradient sign method (Goodfellow et al., 2014b) and C&W attacks (Carlini and Wagner, 2017) to fool DeepFake detectors.”
MethodAttention-Based Two-Stream Convolutional Networks for Face Spoofing Detection
Chen, H., Hu, G., Lei, Z., Chen, Y., Robertson, N. M., & Li, S. Z. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2922241 · Cited by 202 · cited 2×
“Octave convolution (OctConv) (Chen et al., 2019b) is leveraged for capturing the frequency domain to learn the intrinsic feature from CDI and SI to determine fake faces.”
BackgroundMethodAuthentication theory and hypothesis testing
Maurer, U. M. (2000) · IEEE Transactions on Information Theory · doi:10.1109/18.850674 · Cited by 200 · cited 1×
“Maurer (2000) approaches the DeepFake detection as a hypothesis testing problem and presents a generalizable statistical framework based on the information-theoretic study of authentication.”
BackgroundExposing GAN-Generated Faces Using Inconsistent Corneal Specular Highlights
Hu, S., Li, Y., & Lyu, S. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414582 · Cited by 200 · cited 1×
“The inconsistent corneal specular highlight between two eyes is another clue for exposing the GAN-synthesized faces (Hu et al., 2020).”
BackgroundOC-FakeDect: Classifying Deepfakes Using One-class Variational Autoencoder
Khalid, H., & Woo, S. S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00336 · Cited by 197 · cited 2×
“Gram-Net (Liu et al., 2020b) OC-FakeDect (Khalid and Woo, 2020) proposes training on real faces with a one-class variational autoencoder (VAE) to Table 7: Summary of existing DeepFake detection methods.”
BackgroundStyleGAN2 Distillation for Feed-Forward Image Manipulation
Viazovetskyi, Y., Ivashkin, V., & Kashin, E. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58542-6_11 · Cited by 195
Information Bottleneck Disentanglement for Identity Swapping
Gao, G., Huang, H., Fu, C., Li, Z., & He, R. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00341 · Cited by 193 · cited 9×
“To solve this problem, Gao et al. (2021d) propose high-fidelity arbitrary face editing (HifaFace) to maintain rich details of undesired attribute areas.”
BackgroundMethodInfluentialAttention-Aware Multi-Stroke Style Transfer
Yao, Y., Ren, J., Xie, X., Liu, W., Liu, Y.-J., & Wang, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00156 · Cited by 190 · cited 2×
“(Yao et al., 2019) has developed an attention-aware multistroke style transfer model.”
MethodSelf-citationOn the Generalization of GAN Image Forensics
Xuan, X., Peng, B., Wang, W., & Dong, J. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-31456-9_15 · Cited by 184 · cited 2×
“In order to focus on the intrinsic forensics clues, image preprocessing by using smoothing filtering or noise is employed for destroying the low-level unstable artifacts in GAN-synthesized images (Xuan et al., 2019).”
BackgroundUnmasking DeepFakes with simple Features
Durall, R., Keuper, M., Pfreundt, F.-J., & Keuper, J. (2019) · arXiv · doi:10.48550/arxiv.1911.00686 · Cited by 184 · cited 2×
“Ac-tually, leveraging the frequency domain to distinguish real and fake faces is widely applied in recent studies (Durall et al., 2019; Bonettini et al., 2021a; Guarnera et al., 2020c).”
ResultFACIAL: Synthesizing Dynamic Talking Face with Implicit Attribute Learning
Zhang, C., Zhao, Y., Huang, Y., Zeng, M., Ni, S., Budagavi, M., & Guo, X. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00384 · Cited by 183 · cited 2×
“To model these implicit relationships, face implicit attribute learning generative adversarial network (FACIAL-GAN) (Zhang et al., 2021a) integrates the phonetics-aware, context-aware, and identity-aware information to synthesize the 3D face animation with realistic motions of lips, head poses, and eye blinks.”
BackgroundSelf-citationDeepfakes Detection with Automatic Face Weighting
Montserrat, D. M., Hao, H., Yarlagadda, S. K., Baireddy, S., Shao, R., Horvath, J., Bartusiak, E., Yang, J., Guera, D., Zhu, F., et al. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00342 · Cited by 181 · cited 1×
“…al., 2020d), few-shot learning (Mansourifar and Shi, 2020), enhanced MesoNet (Kawa and Syga, 2020; Afchar et al., 2018), a combination with CNN and RNN (Güera and Delp, 2018; Mas Montserrat et al., 2020), DNN with contrastive loss (Hsu et al., 2018), multi-attentional network (Zhao et al., 2021).”
BackgroundFake Faces Identification via Convolutional Neural Network
Mo, H., Chen, B., & Luo, W. (2018) · Proceedings of the 6th ACM Workshop on Information Hiding and Multimedia Security · doi:10.1145/3206004.3206009 · Cited by 175
One Shot Face Swapping on Megapixels
Zhu, Y., Li, Q., Wang, J., Xu, C., & Sun, Z. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00480 · Cited by 175 · cited 5×
“Megapixel level face swapping (MegaFS) (Zhu et al., 2021b) has proposed the first one-shot ultra-high-resolution face swap-ping method.”
BackgroundMethodInfluentialDetecting Both Machine and Human Created Fake Face Images In the Wild
Tariq, S., Lee, S., Kim, H., Shin, Y., & Woo, S. S. (2018) · Proceedings of the 2nd International Workshop on Multimedia Privacy and Security · doi:10.1145/3267357.3267367 · Cited by 174 · cited 1×
“…2018), CNN with local features (Tarasiou and Zafeiriou, 2020), CNN with optical flow (Amerini et al., 2019), ensembled CNNs (Bonettini et al., 2021b; Tariq et al., 2018), light-weight CNN (Sambhu and Canavan, 2020), 3D CNNs (Ganiyusufoglu et al., 2020), a two-stream CNN using RGB space and…”
MethodMask-Guided Portrait Editing With Conditional GANs
Gu, S., Bao, J., Yang, H., Chen, D., Wen, F., & Yuan, L. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00355 · Cited by 172 · cited 2×
“Mask-guided portraiting editing (MaskPE) (Gu et al., 2019) proposes a unique way to manipulate face attributes.”
BackgroundTowards Robust Detection of Adversarial ExamplesPreprint
Pang, T., Du, C., Dong, Y., & Zhu, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.00633 · Cited by 171
Evading Deepfake-Image Detectors with White- and Black-Box Attacks
Carlini, N., & Farid, H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00337 · Cited by 170 · cited 3×
“For example, Carlini and Farid (2020) add imperceptible adversarial perturbations to the fake/real faces and show that even the state-of-the-art DeepFake detectors are vulnerable to both white-box and black-box attacks (Carlini and Wagner, 2017; Brown et c C .”
BackgroundGated-GAN: Adversarial Gated Networks for Multi-Collection Style Transfer
Chen, X., Xu, C., Yang, X., Song, L., & Tao, D. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2869695 · Cited by 169 · cited 2×
“Fernandes et al. (2019) use neural ordinary differential equation (Neural-ODE) (Chen et al., 2018b) trained on the original videos to predict the heart rate of testing videos.”
MethodIn Ictu Oculi: Exposing AI Generated Fake Face Videos by Detecting Eye Blinking
Li, Y., Chang, M., & Lyu, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.02877 · Cited by 169
Multi-class Generative Adversarial Networks with the L2 Loss Function.Preprint
Mao, X., Li, Q., Xie, H., Lau, R. Y. K., & Wang, Z. (2016) · arXiv (Cornell University) · Cited by 168
AnonymousNet: Natural Face De-Identification With Measurable Privacy
Li, T., & Lin, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00013 · Cited by 166 · cited 1×
“…(Liu et al., 2021a), super resolution (Dai et al., 2019), (Guo et al., 2020b), (Liu et al., 2020a), (Mei et al., 2020), fusion (Lin et al., 2019), de-identification (Sun et al., 2018), (Li and Lin, 2019), (Maximov et al., 2020), etc . share some of the technical similarities of DeepFake generation.”
BackgroundFake face detection via adaptive manipulation traces extraction network
Guo, Z., Yang, G., Chen, J., & Sun, X. (2021) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2021.103170 · Cited by 165 · cited 1×
“For example, Guo et al. (2020a) realize an adversarial blur attack that can generate realistic-blurred images and mislead the state-of-the-art deep neural networks (Guo et al., 2021).”
BackgroundPredicting Heart Rate Variations of Deepfake Videos using Neural ODE
Fernandes, S. L., Raj, S., Ortiz, E., Vintila, I., Salter, M., Urosevic, G., & Jha, S. K. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00213 · Cited by 164 · cited 1×
“Fernandes et al. (2019) use neural ordinary differential equation (Neural-ODE) (Chen et al., 2018b) trained on the original videos to predict the heart rate of testing videos.”
MethodStyleGAN2 Distillation for Feed-forward Image ManipulationPreprint
Viazovetskyi, Y., Ivashkin, V., & Kashin, E. (2020) · European Conference on Computer Vision · doi:10.48550/arxiv.2003.03581 · Cited by 164
ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysis
He, Y., Gan, B., Chen, S., Zhou, Y., Yin, G., Song, L., Sheng, L., Shao, J., & Liu, Z. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00434 · Cited by 161 · cited 3×
“, 2020) 7,314 - 3,805 3,509 ForgeryNet (He et al., 2021) 3,117,309 1,438,201 1,457,861 99,630 121,617”
BackgroundInfluentialÇiftçi, U. A., Demir, İ., & Yin, L. (2020) · IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/ijcb48548.2020.9304909 · Cited by 160 · cited 3×
“FakeCatcher (Ciftci et al., 2020a) has collected over 140 online videos, up to 30GB. Unlike most of the fake datasets, it includes “in the wild” videos, independent of the generative model, resolution, compression, content, and context. iFakeFaceDB (Neves et al., 2020) is a fake image dataset for…”
BackgroundMethodBińkowski, M., Sutherland, D. J., Arbel, M., & Gretton, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.01401 · Cited by 160
Generative Adversarial Network with Spatial Attention for Face Attribute Editing
Zhang, G., Kan, M., Shan, S., & Chen, X. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01231-1_26 · Cited by 159 · cited 2×
“To solve this problem, spatial attention GAN (SaGAN) (Zhang et al., 2018) propose a module to only change the attribute-specific region and keep the other area unchanged.”
BackgroundMarioNETte: Few-Shot Face Reenactment Preserving Identity of Unseen Targets
Ha, S., Kersner, M., Kim, B., Seo, S., & Kim, D. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6721 · Cited by 157 · cited 1×
“To solve this problem, Mari-oNETte (Ha et al., 2020) has proposed a few-shot face reen-actment framework that preserves the information of target identity even in situations where the facial characteristics of the source identity are far from the target.”
BackgroundAuto-Exposure Fusion for Single-Image Shadow Removal
Fu, L., Zhou, C., Guo, Q., et al. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01043 · Cited by 157 · cited 1×
“Thus, Zhou et al. (2021b) build a large dataset FFIW 10 K , which comprises 10,000 high-quality fake videos and real videos, with an average of three human faces in each frame.”
BackgroundSelf-citationA Full-Image Full-Resolution End-to-End-Trainable CNN Framework for Image Forgery Detection
Marra, F., Gragnaniello, D., Verdoliva, L., & Poggi, G. (2020) · IEEE Access · doi:10.1109/access.2020.3009877 · Cited by 156 · cited 24×
“P represents the method simply employs peer works for comparison, T indicates the method simply adopts some simple CNN models for comparison, B denotes the method leverages both peer works and conventional CNN models for comparison.”
BackgroundMethodInfluentialHistoGAN: Controlling Colors of GAN-Generated and Real Images via Color Histograms
Afifi, M., Brubaker, M. A., & Brown, M. S. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00785 · Cited by 156 · cited 1×
“HistoGAN (Afifi et al., 2021) chooses a special angle to manipulate images.”
BackgroundZhou, T., Wang, W., Liang, Z., & Shen, J. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00572 · Cited by 156 · cited 3×
“To solve this problem, PC-AVS introduces extra pose source video to compensate only for head motions and successfully disentangle the representations of talking human faces into the spaces of speech content, head pose, and identity respectively.”
BackgroundImage-To-Image Translation via Group-Wise Deep Whitening-And-Coloring Transformation
Cho, W., Choi, S., Park, D. K., Shin, I., & Choo, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01089 · Cited by 154 · cited 2×
“, 2020) GDWCT (Cho et al., 2019) Glow (Kingma and Dhariwal, 2018) SC-FEGAN (Jo and Park, 2019) SAN (Dai et al.”
Automated face swapping and its detection
Zhang, Y., Zheng, L., & Thing, V. L. L. (2017) · 2017 IEEE 2nd International Conference on Signal and Image Processing (ICSIP) · doi:10.1109/siprocess.2017.8124497 · Cited by 154 · cited 1×
“Zhang et al. (2017) detect the key points in facial images and applied a descriptor to represent them for capturing the local information, then a linear classifier is applied for effective detection.”
MethodIncremental learning for the detection and classification of GAN-generated images
Marra, F., Saltori, C., Boato, G., & Verdoliva, L. (2019) · 2019 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs47025.2019.9035099 · Cited by 154 · cited 2×
“Other studies (Marra et al., 2019a) also leverage the GAN fingerprints for discriminating GAN-synthesized fake faces.”
BackgroundResultLeast Squares Generative Adversarial NetworksPreprint
Mao, X., Li, Q., Xie, H., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.04076 · Cited by 154
Exposing GAN-synthesized Faces Using Landmark Locations
Yang, X., Li, Y., Qi, H., & Lyu, S. (2019) · ACM Workshop on Information Hiding and Multimedia Security (IH&MMSec) · doi:10.1145/3335203.3335724 · Cited by 152 · cited 3×
“Early works study the irregular eye blinking (Li et al., 2018b), the mismatch facial landmarks (Yang et al., 2019a,b), and the fixed size of synthesized faces (Li and Lyu, 2019), etc .”
BackgroundMethodFighting Deepfake by Exposing the Convolutional Traces on Images
Guarnera, L., Giudice, O., & Battiato, S. (2020) · IEEE Access · doi:10.1109/access.2020.3023037 · Cited by 149 · cited 3×
“Ac-tually, leveraging the frequency domain to distinguish real and fake faces is widely applied in recent studies (Durall et al., 2019; Bonettini et al., 2021a; Guarnera et al., 2020c).”
BackgroundMethodLearning to Detect Fake Face Images in the Wild
Hsu, C.-C., Lee, C.-Y., & Zhuang, Y.-X. (2018) · 2018 International Symposium on Computer, Consumer and Control (IS3C) · doi:10.1109/is3c.2018.00104 · Cited by 148 · cited 3×
“Finally, a dual-spatial-temporal attentional network is designed for detecting fake video based on the output of MMSTR. DeepFakesON-Phys (Hernandez-Ortega et al., 2020) also leverages heart rate for DeepFake detection by using remote photoplethysmography (rPPG) to illustrate the presence of blood flow by observing the…”
BackgroundMethod
Research works printed but not linked: 7
- Chen, Z., & Yang, H. (2021). Attentive semantic exploring for manipulated face detection. ICASSP 2021–2021 IEEE international conference on acoustics (pp. 1985–1989). IEEE: Speech and Signal Processing (ICASSP). · DOI
- Friesen, E., & Ekman, P. (1978). Facial action coding system: A technique for the measurement of facial movement. Palo Alto, 3(2), 5.
- Huang, Y., Juefei-Xu, F., Guo, Q., Ma, L., Xie, X., Miao, W., Liu, Y., & Pu, G. (2021a). Dodging DeepFake detection via implicit spatial-domain notch filtering. arXiv preprint arXiv:2009.09213 · arXiv
- Koopman, M., Rodriguez, A. M., & Geradts, Z. (2018). Detection of deepfake video manipulation. In Conference: IMVIP.
- Nhu, T., Na, I., & Kim, S. (2018). Forensics face detection from gans using convolutional neural network. In Proceeding of 2018 international symposium on information technology convergence (ISITC 2018).
- Van Oord, A., Kalchbrenner, N., & Kavukcuoglu, K. (2016). Pixel recurrent neural networks. In: International Conference on Machine Learning, PMLR, pp 1747–1756
- Zhai, L., Juefei-Xu, F., Guo, Q., Xie, X., Ma, L., Feng, W., Qin, S., & Liu, Y. (2022). Adversarial rain attack and defensive deraining for dnn perception. arXiv preprint arXiv:2009.09205 · arXiv
Cited by
Deepfake video detection: challenges and opportunities
Kaur, A., Noori Hoshyar, A., Saikrishna, V., Firmin, S., & Xia, F. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10810-6 · Cited by 214
UVCGAN: UNet Vision Transformer cycle-consistent GAN for unpaired image-to-image translation
Torbunov, D., Huang, Y., Yu, H., Huang, J., Yoo, S., Lin, M., Viren, B., & Ren, Y. (2023) · 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv56688.2023.00077 · Cited by 189
“Thankfully, there are countermeasures and detection tools [39] developed to counter such misuse.”
BackgroundSelf-citationMasked Relation Learning for DeepFake Detection
Yang, Z., Liang, J., Xu, Y., Zhang, X., & He, R. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3249566 · Cited by 185
“terfeit faces of images or videos [3], [4], [5], [6].”
BackgroundDeepfakes: current and future trends
Gambín, Á. F., Yazidi, A., Vasilakos, A., Haugerud, H., & Djenouri, Y. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-023-10679-x · Cited by 145
Das, S., Seferbekov, S., Datta, A., Islam, M. S., & Amin, M. R. (2021) · 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw54120.2021.00421 · Cited by 107
“A survey of multiple DeepFake detection architectures and their performance comparison has been presented in [20].”
Metadata
- Authors
- Juefei-Xu, F., Wang, R., Huang, Y., Guo, Q., Ma, L., & Liu, Y.
- Affiliations
- Alibaba Group (United States) (US)
- Wuhan University (CN)
- East China Normal University (CN)
- Tianjin University (CN)
- University of Alberta (CA)
- Zhejiang Sci-Tech University (CN)
- Corresponding author
- Wang, Run
- Guo, Qing
- Venue
- International Journal of Computer Vision
- Published
- 2022-05-04
- Volume
- 130
- Issue
- 7
- Pages
- 1678-1734
- ISSN
- 0920-5691 (ISSN-L)
- 1573-1405
- PMC
- PMC9066404
- OpenAlex
- W3135485589
- Cited by
- 191
- References
- 325
- Citations by year
- 2026: 23 · 2025: 53 · 2024: 53 · 2023: 43 · 2022: 11
- FWCI
- 13.09
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- International Journal of Computer Vision (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- DR-NTU (Nanyang Technological University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Research Foundation Singapore (NRF2018NCR-NCR005-0001, NRF2018NCR-NSOE003-0001)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Keywords
- deepfakes, deepfake detection, deepfake generation, adversarial interaction, misinformation, face manipulation, generative adversarial networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-28, under version 3 of the claim definition (prompt extract-v3).
A second model labelled each claim on 2026-09-28 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.