CoChat
Sign Up
PreprintCited by 865Digital Media Forensic DetectionGenerative Adversarial Networks and Image SynthesisMisinformation and Its Impacts

The Creation and Detection of Deepfakes: A Survey

Open access
Mirsky, Yisroel, Lee, Wenke·2020·arXiv
DOI 10.48550/arxiv.2004.11138arXiv 2004.11138
Open this paper in CoChat — free accountOpen PDF

Abstract

Generative deep learning algorithms have progressed to a point where it is difficult to tell the difference between what is real and what is fake. In 2018, it was discovered how easy it is to use this technology for unethical and malicious applications, such as the spread of misinformation, impersonation of political leaders, and the defamation of innocent individuals. Since then, these `deepfakes' have advanced significantly. In this paper, we explore the creation and detection of deepfakes and provide an in-depth view of how these architectures work. The purpose of this survey is to provide the reader with a deeper understanding of (1) how deepfakes are created and detected, (2) the current trends and advancements in this domain, (3) the shortcomings of the current defense solutions, and (4) the areas which require further research and attention.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2004.11138

Cites

81 of 81 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Deepfakes possess a diverse range of beneficial applications beyond malicious intent, including visual effects, entertainment, education, gaming, virtual reality, photography, and reanimation.

    “Deepfakes possess a diverse range of applications beyond malicious intent. They are employed in various industries, including visual e ff ects, entertainment, and education. For instance, deepfakes can be used to create realistic special e ff ects in movies, personalise digital avatars, or generate synthetic voices for individuals who have lost theirs (Forbes Magazine, July 22, 2019). Additionally”

    From Generative AI and deepfakes: a human rights approach to tackling harmful content (2024) · cites this paper as Mirsky and Lee 2020, 1

    The Introduction (p. 1) describes positive uses in education, historical-figure reanimation, and entertainment. Section 2.1 (p. 3) adds movie and video-game production and photograph improvement, supporting most of the listed applications. The passages do not establish virtual reality as an application. (LLM, conf=0.86)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 98

  1. [2][2] Kfir Aberman, Mingyi Shi, Jing Liao, D Liscbinski, Baoquan Chen, and Daniel Cohen-Or. 2019. Deep Video-Based Performance Cloning. In Computer Graphics Forum . Wiley Online Library. -
  2. [6][6] Shruti Agarwal, Hany Farid, Yuming Gu, Mingming He, Koki Nagano, and Hao Li. 2019. Protecting World Leaders Against Deep Fakes. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops . 38-45. -
  3. [7][7] Sakshi Agarwal and Lav R Varshney. 2019. Limits of Deepfake Detection: A Robust Estimation Viewpoint. arXiv:1905.03493 (2019). - · arXiv
  4. [12][12] Arije Antinori. 2019. Terrorism and DeepFake: from Hybrid Warfare to Post-Truth Warfare in a Hybrid World. In ECIAIR 2019 European Conference on the Impact of Artificial Intelligence and Robotics . Academic Conferences and publishing limited, 23. -
  5. [13][13] Hadar Averbuch-Elor, Daniel Cohen-Or, Johannes Kopf, and Michael F. Cohen. 2017. Bringing Portraits to Life. ACMTransactions on Graphics (Proceeding of SIGGRAPH Asia 2017) 36, 6 (2017), 196. -
  6. [19][19] Volker Blanz, Curzio Basso, Tomaso Poggio, and Thomas Vetter. 2003. Reanimating faces in images and video. In Computer graphics forum , Vol. 22. Wiley Online Library, 641-650. -
  7. [20][20] Volker Blanz, Kristina Scherbaum, Thomas Vetter, and Hans-Peter Seidel. 2004. Exchanging faces in images. In Computer Graphics Forum , Vol. 23. Wiley Online Library, 669-676. -
  8. [25][25] Caroline Chan, Shiry Ginosar, Tinghui Zhou, and Alexei A Efros. 2019. Everybody dance now. In Proceedings of the IEEE International Conference on Computer Vision . 5933-5942. -
  9. [30][30] Umur Aybars Ciftci and Ilke Demir. 2019. FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signals. arXiv preprint arXiv:1901.02212 (2019). - · arXiv
  10. [31][31] Umur Aybars Ciftci, Ilke Demir, and Lijun Yin. 2020. How Do the Hearts of Deep Fakes Beat? Deep Fake Source Detection via Interpreting Residuals with Biological Signals. arXiv preprint arXiv:2008.11363 (2020). - · arXiv
  11. [33][33] Davide Cozzolino, Justus Thies, Andreas Rossler, Christian Riess, Matthias Niessner, and Luisa Verdoliva. 2018. Forensictransfer: Weakly-supervised domain adaptation for forgery detection. arXiv preprint arXiv:1812.02510 (2018). - · arXiv
  12. [36][36] Oscar de Lima, Sean Franklin, Shreshtha Basu, Blake Karwoski, and Annet George. 2020. Deepfake Detection using Spatiotemporal Convolutional Networks. arXiv preprint arXiv:2006.14749 (2020). - · arXiv
  13. [38][38] Xinyi Ding, Zohreh Raziei, Eric C Larson, Eli V Olinick, Paul Krueger, and Michael Hahsler. 2019. Swapped Face Detection using Deep Learning and Subjective Assessment. arXiv preprint arXiv:1909.04217 (2019). - · arXiv
  14. [40][40] Brian Dolhansky, Russ Howes, Ben Pflaum, Nicole Baram, and Cristian Canton Ferrer. 2019. The Deepfake Detection Challenge (DFDC) Preview Dataset. arXiv preprint arXiv:1910.08854 (2019). - · arXiv
  15. [41][41] Mengnan Du, Shiva Pentyala, Yuening Li, and Xia Hu. 2019. Towards Generalizable Forgery Detection with Locality-aware AutoEncoder. arXiv preprint arXiv:1909.05999 (2019). - · arXiv
  16. [42][42] Ricard Durall, Margret Keuper, Franz-Josef Pfreundt, and Janis Keuper. 2019. Unmasking DeepFakes with simple Features. arXiv preprint arXiv:1911.00686 (2019). - · arXiv
  17. [44][44] Chi-Ying Chen et al. 2019. A Trusting News Ecosystem Against Fake News from Humanity and Technology Perspectives. In 2019 19th International Conference on Computational Science and Its Applications (ICCSA) . IEEE, 132-137. -
  18. [46][46] Liqian Ma et al. 2018. Disentangled person image generation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . 99-108. -
  19. [47][47] Pavel Korshunov et al. 2019. Tampered Speaker Inconsistency Detection with Phonetically Aware Audio-visual Features. In International Conference on Machine Learning . -
  20. [48][48] Shengju Qian et al. 2019. Make a Face: Towards Arbitrary High Fidelity Face Manipulation. In Proceedings of the IEEE International Conference on Computer Vision . -
  21. [50][50] Tiziano Fagni, Fabrizio Falchi, Margherita Gambini, Antonio Martella, and Maurizio Tesconi. 2020. TweepFake: about Detecting Deepfake Tweets. arXiv preprint arXiv:2008.00036 (2020). - · arXiv
  22. [52][52] Tharindu Fernando, Clinton Fookes, Simon Denman, and Sridha Sridharan. 2019. Exploiting Human Social Cognition for the Detection of Fake and Fraudulent Faces via Memory Networks. arXiv preprint arXiv:1911.07844 (2019). - · arXiv
  23. [53][53] Chelsea Finn, Pieter Abbeel, and Sergey Levine. 2017. Model-agnostic meta-learning for fast adaptation of deep networks. In Proceedings of the 34th International Conference on Machine Learning-Volume 70 . JMLR. org, 1126-1135. -
  24. [55][55] Ohad Fried, Ayush Tewari, Michael Zollhofer, Adam Finkelstein, Eli Shechtman, Dan B Goldman, Kyle Genova, Zeyu Jin, Christian Theobalt, and Maneesh Agrawala. 2019. Text-based Editing of Talking-head Video. arXiv preprint arXiv:1906.01524 (2019). - · arXiv
  25. [54][54] Paula Fraga-Lamas and Tiago M Fernandez-Carames. 2019. Leveraging Distributed Ledger Technologies and Blockchain to Combat Fake News. arXiv preprint arXiv:1904.05386 (2019). - · arXiv
  26. [56][56] Chaoyou Fu, Yibo Hu, Xiang Wu, Guoli Wang, Qian Zhang, and Ran He. 2019. High Fidelity Face Manipulation with Extreme Pose and Expression. arXiv preprint arXiv:1903.12003 (2019). - · arXiv
  27. [59][59] LeonAGatys,AlexanderSEcker,andMatthiasBethge.2015. Aneuralalgorithmofartisticstyle. arXiv preprint arXiv:1508.06576 (2015). - · arXiv
  28. [61][61] Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative adversarial nets. In Advances in neural information processing systems . 2672-2680. -
  29. [63][63] David Guera and Edward J Delp. 2018. Deepfake video detection using recurrent neural networks. In IEEE Conference on Advanced Video and Signal Based Surveillance (AVSS) . IEEE, 1-6. 30. Talking Facial Animation Synthesis.. In AAAI . 10861-10868. -
  30. [64][64] Zhiqing Guo, Gaobo Yang, Jiyou Chen, and Xingming Sun. 2020. Fake Face Detection via Adaptive Residuals Extraction Network. arXiv preprint arXiv:2005.04945 (2020). - · arXiv
  31. [66][66] Holly Kathleen Hall. 2018. Deepfake Videos: When Seeing Isn't Believing. Cath. UJL & Tech 27 (2018), 51. -
  32. [72][72] Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, and Alexei A Efros. 2017. Image-to-image translation with conditional adversarial networks. In Proceedings of the IEEE conference on computer vision and pattern recognition . 1125-1134. -
  33. [74][74] Amir Jamaludin, Joon Son Chung, and Andrew Zisserman. 2019. You said that?: Synthesising talking faces from audio. International Journal of Computer Vision (2019), 1-13. -
  34. [73][73] Seyed Ali Jalalifar, Hosein Hasani, and Hamid Aghajan. 2018. Speech-driven facial reenactment using conditional generative adversarial networks. arXiv preprint arXiv:1803.07461 (2018). - · arXiv
  35. [75][75] Ye Jia, Yu Zhang, Ron Weiss, Quan Wang, Jonathan Shen, Fei Ren, Patrick Nguyen, Ruoming Pang, Ignacio Lopez Moreno, Yonghui Wu,etal. 2018. Transfer learning from speaker verification to multispeaker text-to-speech synthesis. In Advances in neural information processing systems . 4480-4490. -
  36. [78][78] Tero Karras, Samuli Laine, Miika Aittala, Janne Hellsten, Jaakko Lehtinen, and Timo Aila. 2019. Analyzing and improving the image quality of stylegan. arXiv preprint arXiv:1912.04958 (2019). - · arXiv
  37. [79][79] Triantafyllos Kefalas, Konstantinos Vougioukas, Yannis Panagakis, Stavros Petridis, Jean Kossaifi, and Maja Pantic. 2019. Speech-driven facial animation using polynomial fusion of features. arXiv preprint arXiv:1912.05833 (2019). - · arXiv
  38. [81][81] Hasam Khalid and Simon S Woo. 2020. OC-FakeDect: Classifying Deepfakes Using One-Class Variational Autoencoder. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops . 656-657. -
  39. [86][86] Pavel Korshunov and Sebastien Marcel. 2018. Deepfakes: a new threat to face recognition? assessment and detection. arXiv preprint arXiv:1812.08685 (2018). - · arXiv
  40. [85][85] Marissa Koopman, Andrea Macarulla Rodriguez, and Zeno Geradts. 2018. Detection of Deepfake Video Manipulation. In Conference: IMVIP . -
  41. [89][89] Rithesh Kumar, Jose Sotelo, Kundan Kumar, Alexandre de Brebisson, and Yoshua Bengio. 2017. Obamanet: Photo-realistic lip-sync from text. arXiv preprint arXiv:1801.01442 (2017). - · arXiv
  42. [92][92] Jia Li, Tong Shen, Wei Zhang, Hui Ren, Dan Zeng, and Tao Mei. 2019. Zooming into Face Forensics: A Pixel-level Analysis. arXiv preprint arXiv:1912.05790 (2019). - · arXiv
  43. [91][91] Jessica Lee, Deva Ramanan, and Rohit Girdhar. 2019. MetaPix: Few-Shot Video Retargeting. arXiv preprint arXiv:1910.04742 (2019). - · arXiv
  44. [93][93] Lingzhi Li, Jianmin Bao, Hao Yang, Dong Chen, and Fang Wen. 2019. FaceShifter: Towards High Fidelity And Occlusion Aware Face Swapping. arXiv preprint arXiv:1912.13457 (2019). - · arXiv
  45. [94][94] Lingzhi Li, Jianmin Bao, Ting Zhang, Hao Yang, Dong Chen, Fang Wen, and Baining Guo. 2019. Face X-ray for More General Face Forgery Detection. arXiv preprint arXiv:1912.13458 (2019). - · arXiv
  46. [99][99] Yuezun Li and Siwei Lyu. 2019. Exposing DeepFake Videos By Detecting Face Warping Artifacts. In IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) . -
  47. [101][101] Yuezun Li, Xin Yang, Pu Sun, Honggang Qi, and Siwei Lyu. 2019. Celeb-DF: A New Dataset for DeepFake Forensics. arXiv preprint:1909.12962 (2019). - · arXiv
  48. [100][100] Yuheng Li, Krishna Kumar Singh, Utkarsh Ojha, and Yong Jae Lee. 2019. MixNMatch: Multifactor Disentanglement and Encodingfor Conditional Image Generation. arXiv preprint arXiv:1911.11758 (2019). - · arXiv
  49. [102][102] Yuezun Li, Xin Yang, Baoyuan Wu, and Siwei Lyu. 2019. Hiding Faces in Plain Sight: Disrupting AI Face Synthesis with Adversarial Perturbations. arXiv preprint arXiv:1906.09288 (2019). - · arXiv
  50. [105][105] Zhaoxiang Liu, Huan Hu, Zipeng Wang, Kai Wang, Jinqiang Bai, and Shiguo Lian. 2019. Video synthesis of human upper body with realistic face. arXiv preprint arXiv:1908.06607 (2019). - · arXiv
  51. [108][108] Iacopo Masi, Aditya Killekar, Royston Marian Mascarenhas, Shenoy Pratik Gurudatt, and Wael AbdAlmageed. 2020. Two-branch Recurrent Network for Isolating Deepfakes in Videos. arXiv preprint arXiv:2008.03412 (2020). - · arXiv
  52. [110][110] Trisha Mittal, Uttaran Bhattacharya, Rohan Chandra, Aniket Bera, and Dinesh Manocha. 2020. Emotions Don't Lie: A Deepfake Detection Method using Audio-Visual Affective Cues. arXiv preprint arXiv:2003.06711 (2020). - · arXiv
  53. [109][109] Yisroel Mirsky, Tom Mahler, Ilan Shelef, and Yuval Elovici. 2019. CT-GAN: Malicious Tampering of 3D Medical Imagery using Deep Learning. In USENIX Security Symposium 2019 . -
  54. [113][113] Koki Nagano, Jaewoo Seo, Jun Xing, Lingyu Wei, Zimo Li, Shunsuke Saito, Aviral Agarwal, Jens Fursund, Hao Li, Richard Roberts, et al. 2018. paGAN: real-time avatars using dynamic textures. ACMTrans. Graph. 37, 6 (2018), 258-1. -
  55. [112][112] Joel Ruben Antony Moniz, Christopher Beckham, Simon Rajotte, Sina Honari, and Chris Pal. 2018. Unsupervised depth estimation, 3d face rotation and replacement. In Advances in Neural Information Processing Systems . 9736-9746. -
  56. [114][114] Ryota Natsume, Tatsuya Yatagawa, and Shigeo Morishima. 2018. FSNet: An Identity-Aware Generative Model for Image-Based Face Swapping. In Asian Conference on Computer Vision . Springer, 117-132. -
  57. [116][116] Paarth Neekhara, Shehzeen Hussain, Malhar Jere, Farinaz Koushanfar, and Julian McAuley. 2020. Adversarial Deepfakes: Evaluating Vulnerability of Deepfake Detectors to Adversarial Examples. arXiv preprint arXiv:2002.12749 (2020). - · arXiv
  58. [115][115] Ryota Natsume, Tatsuya Yatagawa, and Shigeo Morishima. 2018. RSGAN: face swapping and editing using face and hair representation in latent spaces. arXiv preprint arXiv:1804.03447 (2018). - · arXiv
  59. [118][118] Huy H Nguyen, Fuming Fang, Junichi Yamagishi, and Isao Echizen. 2019. Multi-task Learning For Detecting and Segmenting Manipulated Facial Images and Videos. arXiv preprint arXiv:1906.06876 (2019). - · arXiv
  60. [123][123] Yuval Nirkin, Lior Wolf, Yosi Keller, and Tal Hassner. 2020. DeepFake Detection Based on the Discrepancy Between the Face and its Context. arXiv preprint arXiv:2008.12262 (2020). - · arXiv
  61. [125][125] NaimaOtberdout,MohamedDaoudi,AnisKacem,LahoucineBallihi,andStefanoBerretti.2019. DynamicFacialExpressionGeneration on Hilbert Hypersphere with Conditional Wasserstein Generative Adversarial Nets. arXiv preprint arXiv:1907.10087 (2019). - · arXiv
  62. [126][126] Nicolas Papernot, Patrick McDaniel, and Ian Goodfellow. 2016. Transferability in machine learning: from phenomena to black-box attacks using adversarial samples. arXiv preprint arXiv:1605.07277 (2016). - · arXiv
  63. [128][128] Albert Pumarola, Antonio Agudo, Aleix M Martinez, Alberto Sanfeliu, and Francesc Moreno-Noguer. 2019. GANimation: One-shot anatomically consistent facial animation. International Journal of Computer Vision (2019), 1-16. -
  64. [127][127] Hai X Pham, Yuting Wang, and Vladimir Pavlovic. 2018. Generative adversarial talking head: Bringing portraits to life with a weakly supervised neural network. arXiv preprint arXiv:1803.07716 (2018). - · arXiv
  65. [129][129] Md Shohel Rana and Andrew H Sung. 2020. DeepfakeStack: A Deep Ensemble-based Learning Technique for Deepfake Detection. In 2020 7th IEEE International Conference on Cyber Security and Cloud Computing (CSCloud)/2020 6th IEEE International Conference on Edge Computing and Scalable Cloud (EdgeCom) . IEEE, 70-75. -
  66. [131][131] Andreas Rossler, Davide Cozzolino, Luisa Verdoliva, Christian Riess, Justus Thies, and Matthias Niessner. 2019. Faceforensics++: Learning to detect manipulated facial images. arXiv preprint:1901.08971 (2019). - · arXiv
  67. [130][130] Andreas Rossler, Davide Cozzolino, Luisa Verdoliva, Christian Riess, Justus Thies, and Matthias Niessner. 2018. Faceforensics: A large-scale video dataset for forgery detection in human faces. arXiv preprint arXiv:1803.09179 (2018). - · arXiv
  68. [132][132] Ekraam Sabir, Jiaxin Cheng, Ayush Jaiswal, Wael AbdAlmageed, Iacopo Masi, and Prem Natarajan. 2019. Recurrent-Convolution Approach to DeepFake Detection-State-Of-Art Results on FaceForensics++. arXiv preprint arXiv:1905.00582 (2019). - · arXiv
  69. [133][133] Tim Salimans, Ian Goodfellow, Wojciech Zaremba, Vicki Cheung, Alec Radford, and Xi Chen. 2016. Improved techniques for training gans. In Advances in neural information processing systems . 2234-2242. -
  70. [135][135] Enrique Sanchez and Michel Valstar. 2018. Triple consistency loss for pairing distributions in GAN-based face synthesis. arXiv preprint arXiv:1811.03492 (2018). - · arXiv
  71. [136][136] Marco Schreyer, Timur Sattarov, Bernd Reimer, and Damian Borth. 2019. Adversarial Learning of Deepfakes in Accounting. arXiv preprint arXiv:1910.03810 (2019). - · arXiv
  72. [138][138] Shawn Shan, Emily Wenger, Jiayun Zhang, Huiying Li, Haitao Zheng, and Ben Y Zhao. 2020. Fawkes: Protecting Privacy against Unauthorized Deep Learning Models. In 29th f USENIX g Security Symposium ( f USENIX g Security 20) . 1589-1604. -
  73. [142][142] Yujun Shen, Bolei Zhou, Ping Luo, and Xiaoou Tang. 2018. FaceFeat-GAN: a Two-Stage Approach for Identity-Preserving Face Synthesis. arXiv preprint arXiv:1812.01288 (2018). - · arXiv
  74. [145][145] Aliaksandr Siarohin, St´ ephane Lathuili` ere, Sergey Tulyakov, Elisa Ricci, and Nicu Sebe. 2019. First Order Motion Model for Image Animation. In Advances in Neural Information Processing Systems 32 . Curran Associates, Inc., 7135-7145. http://papers.nips.cc/paper/8935-first-order-motion-model-for-image-animation.pdf -
  75. [147][147] Yang Song, Jingwen Zhu, Xiaolong Wang, and Hairong Qi. 2018. Talking face generation by conditional recurrent adversarial network. arXiv preprint arXiv:1804.04786 (2018). - · arXiv
  76. [149][149] Joel Stehouwer, Hao Dang, Feng Liu, Xiaoming Liu, and Anil Jain. 2019. On the Detection of Digital Face Manipulation. arXiv preprint arXiv:1910.01717 (2019). - · arXiv
  77. [154][154] Justus Thies, Mohamed Elgharib, Ayush Tewari, Christian Theobalt, and Matthias Niessner. 2019. Neural Voice Puppetry: Audio-driven Facial Reenactment. arXiv preprint arXiv:1912.05566 (2019). - · arXiv
  78. [153][153] Shahroz Tariq, Sangyup Lee, Hoyoung Kim, Youjin Shin, and Simon S Woo. 2018. Detecting both machine and human created fake face images in the wild. In Proceedings of the 2nd International Workshop on Multimedia Privacy and Security . ACM, 81-87. -
  79. [155][155] Justus Thies, Michael Zollhofer, and Matthias Niessner. 2019. Deferred Neural Rendering: Image Synthesis using Neural Textures. arXiv preprint arXiv:1904.12356 (2019). - · arXiv
  80. [157][157] Justus Thies, Michael Zollhofer, Marc Stamminger, Christian Theobalt, and Matthias Niessner. 2016. Face2face: Real-time face capture and reenactment of rgb videos. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . 2387-2395. -
  81. [158][158] Justus Thies, Michael Zollhofer, Christian Theobalt, Marc Stamminger, and Matthias Niessner. 2018. Headon: Real-time reenactment of human portrait videos. ACMTransactions on Graphics (TOG) 37, 4 (2018), 164. -
  82. [160][160] Soumya Tripathy, Juho Kannala, and Esa Rahtu. 2019. ICface: Interpretable and Controllable Face Reenactment Using GANs. arXiv preprint arXiv:1904.01909 (2019). - · arXiv
  83. [161][161] Xiaoguang Tu, Hengsheng Zhang, Mei Xie, Yao Luo, Yuefei Zhang, and Zheng Ma. 2019. Deep Transfer Across Domains for Face Anti-spoofing. arXiv preprint arXiv:1901.05633 (2019). - · arXiv
  84. [164][164] Konstantinos Vougioukas, Stavros Petridis, and Maja Pantic. 2019. End-to-End Speech-Driven Realistic Facial Animation with Temporal GANs. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops . 37-40. -
  85. [166][166] Run Wang, Lei Ma, Felix Juefei-Xu, Xiaofei Xie, Jian Wang, and Yang Liu. 2019. Fakespotter: A simple baseline for spotting ai-synthesized fake faces. arXiv preprint arXiv:1909.06122 (2019). - · arXiv
  86. [165][165] Konstantinos Vougioukas, Stavros Petridis, and Maja Pantic. 2019. Realistic Speech-Driven Facial Animation with GANs. arXiv preprint arXiv:1906.06337 (2019). - · arXiv
  87. [167][167] Sheng-Yu Wang, Oliver Wang, Richard Zhang, Andrew Owens, and Alexei A Efros. 2020. CNN-generated images are surprisingly easy to spot… for now. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , Vol. 7. -
  88. [169][169] Ting-ChunWang,Ming-YuLiu,Jun-YanZhu, GuilinLiu, AndrewTao, Jan Kautz, and Bryan Catanzaro. 2018. Video-to-Video Synthesis. In Advances in Neural Information Processing Systems (NeurIPS) . -
  89. [168][168] Ting-Chun Wang, Ming-Yu Liu, Andrew Tao, Guilin Liu, Jan Kautz, and Bryan Catanzaro. 2019. Few-shot Video-to-Video Synthesis. In Advances in Neural Information Processing Systems (NeurIPS) . -
  90. [176][176] Runze Xu, Zhiming Zhou, Weinan Zhang, and Yong Yu. 2017. Face transfer with generative adversarial network. arXiv preprint:1710.06090 (2017). - · arXiv
  91. [183][183] Egor Zakharov, Aliaksandra Shysheya, Egor Burkov, and Victor Lempitsky. 2019. Few-Shot Adversarial Learning of Realistic Neural Talking Head Models. arXiv preprint arXiv:1905.08233 (2019). - · arXiv
  92. [182][182] Polina Zablotskaia, Aliaksandr Siarohin, Bo Zhao, and Leonid Sigal. 2019. DwNet: Dense warp-based network for pose-guided human video generation. arXiv preprint arXiv:1910.09139 (2019). - · arXiv
  93. [184][184] Rowan Zellers, Ari Holtzman, Hannah Rashkin, Yonatan Bisk, Ali Farhadi, Franziska Roesner, and Yejin Choi. 2019. Defending Against Neural Fake News. In Advances in Neural Information Processing Systems 32 . Curran Associates, Inc., 9054-9065. http://papers.nips.cc/paper/9106-defending-against-neural-fake-news.pdf -
  94. [186][186] Yunxuan Zhang, Siwei Zhang, Yue He, Cheng Li, Chen Change Loy, and Ziwei Liu. 2019. One-shot Face Reenactment. arXiv preprint arXiv:1908.03251 (2019). - · arXiv
  95. [185][185] Jiangning Zhang, Xianfang Zeng, Yusu Pan, Yong Liu, Yu Ding, and Changjie Fan. 2019. FaceSwapNet: Landmark Guided Many-to-Many Face Reenactment. arXiv preprint arXiv:1905.11805 (2019). - · arXiv
  96. [187][187] Ying Zhang, Lilei Zheng, and Vrizlynn LL Thing. 2017. Automated face swapping and its detection. In 2017 IEEE 2nd International Conference on Signal and Image Processing (ICSIP) . IEEE, 15-19. -
  97. [192][192] Jun-Yan Zhu, Taesung Park, Phillip Isola, and Alexei A Efros. 2017. Unpaired image-to-image translation using cycle-consistent adversarial networks. In Proceedings of the IEEE international conference on computer vision . 2223-2232. -
  98. [191][191] Yipin Zhou, Zhaowen Wang, Chen Fang, Trung Bui, and Tamara L Berg. 2019. Dance Dance Generation: Motion Transfer for Internet Videos. arXiv preprint arXiv:1904.00129 (2019). - · arXiv

Cited by

Sorted by citations

Related

Authors
Mirsky, Y., & Lee, W.
Affiliations
Georgia Institute of Technology (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2020
Volume
54
Issue
1
Pages
1-41
ISSN
0360-0300 (ISSN-L)
DOI
10.48550/arxiv.2004.11138
arXiv
2004.11138
OpenAlex
W3019200173
Cited by
863
References
81
Citations by year
2026: 202 · 2025: 213 · 2024: 163 · 2023: 131 · 2022: 90 · 2021: 53 · 2020: 11
FWCI
39.29
Type
journal article
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • ACM Computing Surveys (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
  • Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
Keywords
deepfakes, deepfake detection, deepfake generation, generative adversarial networks, misinformation, impersonation, defamation, synthetic media

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review