CoChat

Navigating the Soundscape of Deception: A Comprehensive Survey on Audio Deepfake Generation, Detection, and Future Horizons

Open access
Wani, Taiba Majid, Qadri, Syed Asif Ahmad, Wani, Farooq Ahmad, Amerini, Irene · 2024 · Foundations and Trends® in Privacy and Security

The DOI matches its Crossref record; 162 of the 162 references it cites were found in a registry or an index.

Abstract

The rise of audio deepfakes presents a significant security threat that undermines trust in digital communications and media. These synthetic audio technologies can convincingly mimic a person’s voice, enabling malicious activities like impersonation, fraud, and misinformation. Addressing this growing threat requires robust detection systems to ensure the authenticity of digital content. In this survey, we provide a comprehensive analysis of the state-of-the-art techniques in audio deepfake generation and detection. We examine various methods used to generate audio deepfakes, including Text-to-Speech (TTS) and Voice Conversion (VC) technologies, and discuss their capabilities in producing highly realistic synthetic audio. On the detection front, we explore a wide range of approaches, encompassing traditional machine learning and deep learning models for feature extraction and classification. The importance of publicly available datasets for training and evaluating these models is emphasized, showcasing their role in advancing detection capabilities. Additionally, the integration of audio and video deepfake detection systems is discussed, providing a comprehensive defense against sophisticated attacks. This survey critically assesses existing methods and datasets, highlighting challenges like the high realism of deepfakes, limited data diversity, and the need for models that generalize well. It aims to guide future research in enhancing detection and safeguarding digital media integrity.

Overview

Integrity signals

Registry

Crossref · 10.1561/3300000048

Cites

162 of 162 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Research works printed but not linked: 138

  1. Adiga, 2013, Gammatone wavelet cepstral coefficients for robust speech recognition, 2013 IEEE International Conference of IEEE Region 10 (TENCON 2013), 1
  2. AlBadawy, 2019, Detecting AI-Synthesized Speech Using Bispectral Analysis, CVPR workshops, 104
  3. Almutairi, 2022, A review of modern audio deepfake detection methods: challenges and future directions, Al- gorithms, 15, 155
  4. Alzantot, 2019, Deep resid- ual neural networks for audio spoofing detection, arXiv preprint arXiv:1907.00501 · arXiv
  5. Aravind, 2020, Audio spoofing verification using deep convolutional neural networks by transfer learning, arXiv preprint arXiv:2008.03464 · arXiv
  6. Arık, 2017, Deep voice: Real-time neural text-to-speech, International conference on machine learning, 195
  7. Attorresi, 2022, Combining automatic speaker verification and prosody analysis for synthetic speech detection, arXiv preprint arXiv:2210.17222 · arXiv
  8. Ballesteros, 2020, A dataset of histograms of original and fake voice recordings (H-Voice), Data in brief, 29
  9. Barrault, 2023, SeamlessM4T-Massively Multilingual & Multimodal Ma- chine Translation, arXiv preprint arXiv:2308.11596 · arXiv
  10. Barrington, 2024, DeepSpeak Dataset v1. 0, arXiv preprint arXiv:2408.05366 · arXiv
  11. Bartusiak, 2022, Frequency domain-based detection of generated audio, arXiv preprint arXiv:2205.01806 · arXiv
  12. Bhat, 2017, Cortana-intelligent personal digital assistant: A review, International Journal of Ad- vanced Research in Computer Science, 8, 55
  13. Bhatia, 2022, Detection of AI Synthesized Hindi Speech, arXiv preprint arXiv:2203.03706 · arXiv
  14. Bińkowski, 2019, High fidelity speech synthesis with adversarial networks, arXiv preprint arXiv:1909.11646 · arXiv
  15. Blue, 2022, Who Are You (I Really Wanna Know)? Detecting Audio {DeepFakes} Through Vocal Tract Recon- struction, 31st USENIX Security Symposium (USENIX Security 22), 2691
  16. Capes, 2017, Siri on-device deep learning-guided unit selection text-to-speech system, Interspeech, 4011
  17. Casanova, 2022, Yourtts: Towards zero-shot multi-speaker tts and zero-shot voice conversion for everyone, International Conference on Machine Learning, 2709
  18. Channing, 2024, Toward Robust Real-World Audio Deepfake Detection: Closing the Explainability Gap, arXiv preprint arXiv:2410.07436 · arXiv
  19. Chen, 2021, Adaspeech: Adaptive text to speech for custom voice, arXiv preprint arXiv:2103.00993 · arXiv
  20. Chen, 2024, VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers, arXiv preprint arXiv:2406.05370 · arXiv
  21. Chesney, 2018, Deep fakes: A looming crisis for national security, democracy and privacy, The Lawfare Blog
  22. Christensen, 2022, Multi-pitch estimation
  23. Conner, 2015, Photo tampering throughout history, Four and Six. Accessed, 9
  24. De, 2012, Synthetic Speech Discrimination using Pitch Pattern Statistics Derived from Image Analysis, Interspeech, 370
  25. Delgado, 2018, ASVspoof 2017 Version 2.0: meta- data analysis and baseline enhancements, Odyssey 2018-The Speaker and Language Recognition Workshop
  26. Dhar, 2023, GLGAN-VC: A guided loss-based generative adversarial network for many-to-many voice conversion, IEEE Transactions on Neural Networks and Learning Systems
  27. Dixit, 2023, Review of audio deepfake detection techniques: Issues and prospects, Expert Systems, e13322
  28. Doan, 2023, BTS-E: Au- dio Deepfake Detection Using Breathing-Talking-Silence Encoder, ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 1
  29. Donahue, 2018, Adversarial audio synthesis, arXiv preprint arXiv:1802.04208 · arXiv
  30. Elias, 2021, Parallel Tacotron 2: A non-autoregressive neural TTS model with differentiable duration modeling, arXiv preprint arXiv:2103.14574 · arXiv
  31. Forbes., 2019, A Voice Deepfake Was Used To Scam A CEO Out Of $243,000.
  32. Frank, 2021, Wavefake: A data set to facilitate audio deepfake detection, arXiv preprint arXiv:2111.02813 · arXiv
  33. Gamage, 2021, The Emergence of Deepfakes and its Societal Implications: A Systematic Review, TTO, 28
  34. Ge, 2021, Raw differentiable architecture search for speech deepfake and spoofing detection, arXiv preprint arXiv:2107.12212 · arXiv
  35. Gibiansky, 2017, Deep voice 2: Multi-speaker neural text-to-speech, Advances in neural information processing systems, 30
  36. Goodfellow, 2014, Generative adversarial nets, Advances in neural information processing systems, 27
  37. Guo, 2019, Exploiting syntactic features in a parsed tree to improve end-to-end TTS, arXiv preprint arXiv:1904.04764 · arXiv
  38. Han, 2024, Uncovering Human Traits in Determining Real and Spoofed Audio: Insights from Blind and Sighted Individuals, Proceedings of the CHI Conference on Human Factors in Computing Systems, 1
  39. Heidari, 2024, Deep- fake detection using deep learning methods: A systematic and com- prehensive review, Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 14, e1520
  40. Hsu, 2017, Voice conversion from unaligned corpora using variational autoen- coding wasserstein generative adversarial networks, arXiv preprint arXiv:1704.00849 · arXiv
  41. Huang, 2021, Audio replay spoofing attack detection using deep learning feature and long-short-term memory recurrent neural network, AIIPCC 2021; The Second International Con- ference on Artificial Intelligence, Information Processing and Cloud Computing, 1
  42. Huang, 2019, Voice transformer network: Sequence-to-sequence voice conversion using transformer with text-to-speech pretraining, arXiv preprint arXiv:1912.06813 · arXiv
  43. Iqbal, 2022, Deepfake Audio Detection Via Feature Engineering And Machine Learning, CIKM Workshops
  44. Jang, 2020, Universal melgan: A robust neural vocoder for high-fidelity waveform generation in multiple domains, arXiv preprint arXiv:2011.09631 · arXiv
  45. Jiang, 2020, Self- Supervised Spoofing Audio Detection Scheme, INTERSPEECH, 4223
  46. Jung, 2024, WWW: Where, Which and Whatever Enhancing Interpretability in Multimodal Deepfake Detection, arXiv preprint arXiv:2408.02954 · arXiv
  47. Kameoka, 2021, Fasts2s-vc: Streaming non-autoregressive sequence-to-sequence voice conversion, arXiv preprint arXiv:2104.06900 · arXiv
  48. Katamneni, 2023, MIS-AVioDD: Modality invariant and specific representation for audio-visual deepfake de- tection, arXiv preprint arXiv:2310.02234 · arXiv
  49. Kenyon, 2020, Clarifying the Probable Cause Standard in the Internet Age for Crimes Involving Child Pornography, Cath. UL Rev., 69, 633
  50. Khan, 2022, Voice Spoofing Countermeasures: Taxonomy, State-of-the-art, experimen- tal analysis of generalizability, open challenges, and the way forward, arXiv preprint arXiv:2210.00417 · arXiv
  51. Khochare, 2021, A deep learning framework for audio deepfake detection, Arabian Journal for Science and Engineering, 1
  52. Kim, 2021, Conditional variational autoen- coder with adversarial learning for end-to-end text-to-speech, International Conference on Machine Learning, 5530
  53. Kingma, 2018, Glow: Generative flow with invertible 1x1 convolutions, Advances in neural information pro-cessing systems, 31
  54. Klein, 2024, Source tracing of audio deepfake systems, arXiv preprint arXiv:2407.08016 · arXiv
  55. Kong, 2020, Hifi-gan: Generative adversarial networks for efficient and high fidelity speech synthesis, Advances in Neural Information Processing Systems, 33, 17022
  56. Korshunov, 2018, Deepfakes: a new threat to face recognition?, arXiv preprint arXiv:1812.08685 · arXiv
  57. Korshunov, 2016, Overview of BTAS 2016 speaker anti- spoofing competition, 2016 IEEE 8th international conference on biometrics theory, applications and systems (BTAS), 1
  58. Kumar, 2019, Melgan: Generative adversarial networks for conditional waveform synthesis, Advances in neural information processing systems, 32
  59. Kumar, 2017, Obamanet: Photo-realistic lip-sync from text, arXiv preprint arXiv:1801.01442 · arXiv
  60. Kumari, 2024, Neural Network Pruning Techniques for Efficient Model Compression, International Journal of Intelligent Systems and Applications in Engineering, 12, 565
  61. Kwon, 2021, Kodf: A large-scale korean deepfake detection dataset, Proceedings of the IEEE/CVF International Conference on Computer Vision, 10744
  62. Lai, 2019, ASSERT: Anti-spoofing with squeeze-excitation and residual networks, arXiv preprint arXiv:1904.01120 · arXiv
  63. Łajszczak, 2024, BASE TTS: Lessons from building a billion-parameter text-to- speech model on 100K hours of data, arXiv preprint arXiv:2402.08093 · arXiv
  64. Lei, 2020, Siamese Convolutional Neural Network Using Gaussian Probability Feature for Spoofing Speech Detection, INTERSPEECH, 1116
  65. Levine, 2020, Dollars, Deception, and Deepfakes: An Analysis of Deepfakes and Synthetic Media Fraud, PhD thesis
  66. Liu, 2021, Self-supervised learning: Generative or contrastive, IEEE transactions on knowledge and data engineering, 35, 857
  67. Liu, 2023, Asvspoof 2021: Towards spoofed and deepfake speech detection in the wild, IEEE/ACM Transactions on Audio, Speech, and Language Processing
  68. Liu, 2023, Diffvoice: Text-to-speech with latent diffusion, ICASSP 2023-2023 IEEE International Confer- ence on Acoustics, Speech and Signal Processing (ICASSP), 1
  69. Ma, 2022, FAD: A Chinese dataset for fake audio detection, arXiv preprint arXiv:2207.12308 · arXiv
  70. Ma, 2023, A Lightweight and Efficient Model for Audio Anti-Spoofing, Proceedings of the 5th ACM International Conference on Multimedia in Asia, 1
  71. Macharyas, 2015, The malicious and forensic uses of Adobe software, PhD thesis
  72. Martın-Donas, 2024, Exploring Self-supervised Embeddings and Syn- thetic Data Augmentation for Robust Audio Deepfake Detection, Proc. Interspeech, 2024
  73. Mateo, 2023, A Deep Dive into Artificial Intelligence and Its Integration into Cybersecurity, PhD thesis
  74. Mischie, 2018, Implementation of google assistant on rasberry pi, 2018 International Symposium on Electronics and Telecommunications (ISETC), 1
  75. Muppalla, 2023, Integrating audio-visual fea- tures for multimodal deepfake detection, arXiv preprint arXiv:2310. 03827
  76. Nercessian, 2020, Zero-Shot Singing Voice Conversion, ISMIR, 70
  77. Oord, 2018, ., Par- allel wavenet: Fast high-fidelity speech synthesis
  78. Oord, 2016, Wavenet: A generative model for raw audio, arXiv preprint arXiv:1609.03499 · arXiv
  79. Ouyang, 2021, Capsule net- work based end-to-end system for detection of replay attacks, 2021 12th International Symposium on Chinese Spoken Language Processing (ISCSLP), 1
  80. Pan, 2022, Speaker recognition-assisted robust audio deepfake detection., INTERSPEECH, 4202
  81. Park, 2020, Cotatron: Transcription- guided speech encoder for any-to-many voice conversion without parallel data, arXiv preprint arXiv:2005.03295 · arXiv
  82. Pascu, 2024, Easy, Interpretable, Effective: openSMILE for voice deepfake detection, arXiv preprint arXiv:2408.15775 · arXiv
  83. Patel, 2015, Combining evidences from mel cepstral, cochlear filter cepstral and instantaneous frequency features for detection of natural vs. spoofed speech, Sixteenth annual conference of the international speech communication association
  84. Phukan, 2024, Heterogeneity over Homogeneity: Investigating Multilingual Speech Pre-Trained Models for Detecting Audio Deepfake, arXiv preprint arXiv:2404.00809 · arXiv
  85. Pianese, 2022, Deepfake audio detection by speaker verification, 2022 IEEE International Workshop on Information Forensics and Security (WIFS), 1
  86. Ping, 2017, Deep voice 3: Scaling text- to-speech with convolutional sequence learning, arXiv preprint arXiv:1710.07654 · arXiv
  87. Qais, 2022, Deep- fake Audio Detection with Neural Networks Using Audio Features, 2022 International Conference on Intelligent Controller and Computing for Smart Power (ICICCSP), 1
  88. Raza, 2023, Multimodaltrace: Deepfake detection using audiovisual representation learning, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 993
  89. Reimao, 2019, For: A dataset for synthetic speech detection, 2019 International Conference on Speech Technology and Human-Computer Dialogue (SpeD), 1
  90. Rekimoto, 2023, WESPER: Zero-shot and realtime whisper to normal voice conversion for whisper-based speech interactions, Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, 1
  91. Ren, 2020, Fastspeech 2: Fast and high-quality end-to-end text to speech, arXiv preprint arXiv:2006.04558 · arXiv
  92. Ren, 2019, Fastspeech: Fast, robust and controllable text to speech, Advances in neural information processing systems, 32
  93. Sachdeva, 2021, Cyberbullying Detection on Social Media Using Deep Learning Models, PhD thesis
  94. Sailor, 2017, Unsupervised Filterbank Learning Using Convolutional Restricted Boltzmann Machine for Environmental Sound Classification., InterSpeech
  95. Saxena, 2023, Multiple Aspects of Artificial Intelligence
  96. Shan, 2020, A Cross-Verification Approach for Protecting World Leaders from Fake and Tampered Audio, arXiv preprint arXiv:2010.12173 · arXiv
  97. Shen, 2020, Non-attentive tacotron: Robust and controllable neural tts synthesis including unsupervised duration modeling, arXiv preprint arXiv:2010.04301 · arXiv
  98. Shi, 2020, Aishell-3: A multi- speaker mandarin tts corpus and the baselines, arXiv preprint arXiv:2010.11567 · arXiv
  99. Sisman, 2018, Wavelet Analysis of Speaker Dependent and Independent Prosody for Voice Conversion., Interspeech
  100. Sotelo, 2017, ., Char2wav: End-to-end speech synthesis
  101. Stupp, 2019, Fraudsters used AI to mimic CEO’s voice in unusual cybercrime case, The Wall Street Journal, 30
  102. Suratkar, 2020, Employing transfer-learning based CNN architectures to enhance the generalizability of deepfake detection, 2020 11th in- ternational conference on computing, communication and networking technologies (ICCCNT), 1
  103. Swetha, 2021, AI Based Assistance for Visually Im- paired People Using TTS (Text To Speech), International Journal of Innovative Research in Science and Technology, 1, 8
  104. Tak, 2022, ., arXiv preprint arXiv:2202.12233 · arXiv
  105. Taylor, 2009, ., Text-to-speech synthesis
  106. TechCrunch., 2016, AdobesProjectVoCo
  107. Todisco, 2016, A New Feature for Automatic Speaker Verification Anti-Spoofing: Constant Q Cepstral Coefficients., Odyssey, 2016, 283
  108. Vaswani, 2018, Tensor2tensor for neural machine translation, arXiv preprint arXiv:1803.07416 · arXiv
  109. Villalba, 2015, Spoofing detection with DNN and one-class SVM for the ASVspoof 2015 challenge, Sixteenth annual conference of the international speech communication association
  110. Wang, 2023, Detection of Cross-Dataset Fake Audio Based on Prosodic and Pronunciation Features, arXiv preprint arXiv:2305.13700 · arXiv
  111. Wang, 2023, Neural codec language models are zero- shot text to speech synthesizers, arXiv preprint arXiv:2301.02111 · arXiv
  112. Wang, 2021, Investigating self-supervised front ends for speech spoofing countermeasures, arXiv preprint arXiv:2111.07725 · arXiv
  113. Wang, 2023, Robust audio anti-spoofing countermeasure with joint training of front-end and back-end models, Proc. INTERSPEECH, 2023, 4004
  114. Wang, 2017, Tacotron: Towards end-to-end speech synthesis, arXiv preprint arXiv:1703.10135 · arXiv
  115. Wang, 2020, Densely connected convolutional network for audio spoofing detection, 2020 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), 1352
  116. Wani, 2023, Deepfakes Audio Detection Lever- aging Audio Spectrogram and Convolutional Neural Networks, International Conference on Image Analysis and Processing, 156
  117. Wani, 2024, ABC-CapsNet: Attention based Cascaded Capsule Network for Audio Deepfake De- tection, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2464
  118. Wijethunga, 2020, Deepfake audio detection: a deep learning based solution for group conversations, 2020 2nd Inter- national Conference on Advancements in Computing (ICAC), 192
  119. Wong, 2023, Privacy Legisla- tion as Business Risks: How GDPR and CCPA are Represented in Technology Companies’ Investment Risk Disclosures, Proceedings of the ACM on Human-Computer Interaction, 7, 1
  120. Wu, 2022, Adaspeech 4: Adaptive text to speech in zero-shot scenarios, arXiv preprint arXiv:2204.00436 · arXiv
  121. Wu, 2020, Light convolutional neural network with feature genuinization for detection of synthetic speech attacks, arXiv preprint arXiv:2009.09637 · arXiv
  122. Wu, 2015, ASVspoof 2015: the first automatic speaker verification spoofing and countermeasures challenge, Sixteenth annual conference of the international speech communication associ-ation
  123. Xiao, 2015, Spoof- ing speech detection using high dimensional magnitude and phase features: the NTU approach for ASVspoof 2015 challenge., In- terspeech
  124. Xie, 2023, Domain Generalization Via Aggregation and Separation for Audio Deepfake Detection, IEEE Transactions on Information Forensics and Security
  125. Xie, 2023, Learning A Self- Supervised Domain-Invariant Feature Representation for General- ized Audio Deepfake Detection, Proc. INTERSPEECH, 2808
  126. Xue, 2023, Foundationtts: Text-to-speech for asr customization with generative language model, arXiv preprint arXiv:2303.02939 · arXiv
  127. Yamagishi, 2021, ASVspoof 2021: accelerating progress in spoofed and deepfake speech detection, arXiv preprint arXiv:2109.00537 · arXiv
  128. Yan, 2023, Deep Dive into Deepfakes—Safeguarding Our Digital Identity, Brooklyn Journal of International Law, 48, 767
  129. Yan, 2021, Adaspeech 3: Adaptive text to speech for spontaneous style, arXiv preprint arXiv:2107.02530 · arXiv
  130. Yang, 2018, Feature with Complementarity of Statistics and Principal Information for Spoofing Detection., INTERSPEECH
  131. Yang, 2020, VocGAN: A high- fidelity real-time vocoder with a hierarchically-nested adversarial network, arXiv preprint arXiv:2007.15256 · arXiv
  132. Yi, 2021, Half-truth: A partially fake audio detection dataset, arXiv preprint arXiv:2104.03617 · arXiv
  133. Yu, 2023, Pvass- mdd: predictive visual-audio alignment self-supervision for multi- modal deepfake detection, IEEE Transactions on Circuits and Systems for Video Technology
  134. Yu, 2022, Deep learning for face anti-spoofing: A survey, IEEE transactions on pattern analysis and machine intelligence, 45, 5609
  135. Zhang, 2023, Do you remember?, International Conference on Machine Learning, 41819
  136. Zhang, 2024, Joint Audio-Visual Attention with Contrastive Learning for More General Deepfake Detection, ACM Transactions on Multimedia Computing, Communications and Applications, 20, 1
  137. Zhang, 2020, Gazev: Gan-based zero-shot voice conversion over non-parallel speech corpus, arXiv preprint arXiv:2010.12788 · arXiv
  138. Zhou, 2021, Joint audio-visual deepfake detec- tion, Proceedings of the IEEE/CVF International Conference on Computer Vision, 14800

Cited by

See all 16

Metadata

Authors
Wani, T. M., Qadri, S. A. A., Wani, F. A., & Amerini, I.
Affiliations
  • Sapienza University of Rome (IT)
  • National Tsing Hua University (TW)
Venue
Foundations and Trends® in Privacy and Security
Publisher
Emerald
Published
2024-11-27
Volume
6
Issue
3-4
Pages
153-345
ISSN
  • 2474-1558 (ISSN-L)
  • 2474-1566
OpenAlex
W4404765990
Cited by
16
References
155
Citations by year
2026: 6 · 2025: 10
FWCI
2.36
Type
journal article
Language
en
Open access
Locations
Foundations and Trends® in Privacy and Security (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
  • Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
Keywords
deepfake audio, deepfake detection, speech synthesis, voice conversion, text-to-speech, misinformation, deepfake datasets, media integrity

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.