Navigating the Soundscape of Deception: A Comprehensive Survey on Audio Deepfake Generation, Detection, and Future Horizons
Open accessThe DOI matches its Crossref record; 162 of the 162 references it cites were found in a registry or an index.
Abstract
The rise of audio deepfakes presents a significant security threat that undermines trust in digital communications and media. These synthetic audio technologies can convincingly mimic a person’s voice, enabling malicious activities like impersonation, fraud, and misinformation. Addressing this growing threat requires robust detection systems to ensure the authenticity of digital content. In this survey, we provide a comprehensive analysis of the state-of-the-art techniques in audio deepfake generation and detection. We examine various methods used to generate audio deepfakes, including Text-to-Speech (TTS) and Voice Conversion (VC) technologies, and discuss their capabilities in producing highly realistic synthetic audio. On the detection front, we explore a wide range of approaches, encompassing traditional machine learning and deep learning models for feature extraction and classification. The importance of publicly available datasets for training and evaluating these models is emphasized, showcasing their role in advancing detection capabilities. Additionally, the integration of audio and video deepfake detection systems is discussed, providing a comprehensive defense against sophisticated attacks. This survey critically assesses existing methods and datasets, highlighting challenges like the high realism of deepfakes, limited data diversity, and the need for models that generalize well. It aims to guide future research in enhancing detection and safeguarding digital media integrity.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“While detection methods have evolved in accuracy and robustness, their lack of interpretability and explainability limits their broader adoption in high-stakes applications such as forensic analysis, media authentication, and legal proceedings [63].”
From Deepfake Media Forensics: Status and Future Challenges (2025) · cites this paper as [63]
In the citing paper
“These methods mitigate catastrophic forgetting through the use of a memory buffer that stores past samples, which are revisited periodically during training on new tasks [63].”
From Deepfake Media Forensics: Status and Future Challenges (2025) · cites this paper as [63]
Citations
Cites
Dwivedi, Y. K., Hughes, L., Ismagilova, E., Aarts, G., Coombs, C., Crick, T., Duan, Y., Dwivedi, R., Edwards, J., Eirug, A., et al. (2021) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2019.08.002 · Cited by 4,611
Natural TTS Synthesis by Conditioning Wavenet on MEL Spectrogram Predictions
Shen, J., Pang, R., Weiss, R. J., Schuster, M., Jaitly, N., Yang, Z., Chen, Z., Zhang, Y., Wang, Y., Skerrv-Ryan, R., et al. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8461368 · Cited by 2,791
Unit selection in a concatenative speech synthesis system using a large speech database
Hunt, A. J., & Black, A. W. (2002) · 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings · doi:10.1109/icassp.1996.541110 · Cited by 1,190
“Waveglow: a flow-based generative network for speech synthesis,”
Prenger, R., Valle, R., & Catanzaro, B. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683143 · Cited by 1,004
Media Forensics and DeepFakes: An Overview
Verdoliva, L. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.3002101 · Cited by 979
The Creation and Detection of Deepfakes: A Survey
Mirsky, Y., & Lee, W. (2022) · ACM Computing Surveys · doi:10.1145/3425780 · Cited by 863
The Creation and Detection of Deepfakes: A Survey
Mirsky, Y., & Lee, W. (2020) · arXiv · doi:10.48550/arxiv.2004.11138 · Cited by 863
Yamamoto, R., Song, E., & Kim, J.-M. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9053795 · Cited by 827
An Introduction to Text-to-Speech Synthesis
Dutoit, T. (1997) · Text, Speech and Language Technology · doi:10.1007/978-94-011-5730-8 · Cited by 632
Spoofing and countermeasures for speaker verification: A survey
Wu, Z., Evans, N., Kinnunen, T., Yamagishi, J., Alegre, F., & Li, H. (2015) · Speech Communication · doi:10.1016/j.specom.2014.10.005 · Cited by 601
Masood, M., Nawaz, M., Malik, K. M., Javed, A., Irtaza, A., & Malik, H. (2023) · Applied Intelligence · doi:10.1007/s10489-022-03766-z · Cited by 543
The ASVspoof 2017 challenge: assessing the limits of replay spoofing attack detection
Kinnunen, T., Sahidullah, M., Delgado, H., Todisco, M., Evans, N., Yamagishi, J., & Lee, K. A. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-1111 · Cited by 535
ASVspoof 2019: A large-scale public database of synthesized, converted and replayed speech
Wang, X., Yamagishi, J., Todisco, M., Delgado, H., Nautsch, A., Evans, N., Sahidullah, M., Vestman, V., Kinnunen, T., Lee, K. A., et al. (2020) · Computer Speech & Language · doi:10.1016/j.csl.2020.101114 · Cited by 505
Kietzmann, J., Lee, L. W., McCarthy, I. P., & Kietzmann, T. C. (2020) · Business Horizons · doi:10.1016/j.bushor.2019.11.006 · Cited by 504
Trends in audio signal feature extraction methods
Sharma, G., Umapathy, K., & Krishnan, S. (2020) · Applied Acoustics · doi:10.1016/j.apacoust.2019.107020 · Cited by 479
Deep learning for deepfakes creation and detection: A survey
Nguyen, T. T., Nguyen, Q. V. H., Nguyen, D. T., Nguyen, D. T., Huynh-The, T., Nahavandi, S., Nguyen, T. T., Pham, Q.-V., & Nguyen, C. M. (2022) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2022.103525 · Cited by 464
Deep Learning for Deepfakes Creation and Detection: A Survey
Nguyen, T. T., Nguyen, Q. V. H., Nguyen, D. T., Nguyen, D. T., Huynh-The, T., Nahavandi, S., Nguyen, T. T., Pham, Q.-V., & Nguyen, C. M. (2019) · arXiv · doi:10.48550/arxiv.1909.11573 · Cited by 464
Constant Q Cepstral Coefficients: A Spoofing Countermeasure for Automatic Speaker Verification
Todisco, M., Delgado, H., & Evans, N. (2017) · Computer Speech & Language · doi:10.1016/j.csl.2017.01.001 · Cited by 424
A comparison of features for synthetic speech detection
Sahidullah, M., Kinnunen, T., & Hanilçi, C. (2015) · Interspeech 2015 · doi:10.21437/interspeech.2015-472 · Cited by 382
“StarGAN-VC: non-parallel many-to-many voice conversion using star generative adversarial networks,”
Kameoka, H., Kaneko, T., Tanaka, K., & Hojo, N. (2018) · 2018 IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2018.8639535 · Cited by 371
CycleGAN-VC: Non-parallel Voice Conversion Using Cycle-Consistent Adversarial Networks
Kaneko, T., & Kameoka, H. (2018) · 2018 26th European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco.2018.8553236 · Cited by 358
An Overview of Voice Conversion and Its Challenges: From Statistical Modeling to Deep Learning
Sisman, B., Yamagishi, J., King, S., & Li, H. (2021) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2020.3038524 · Cited by 357
Emotions Don't Lie: An Audio-Visual Deepfake Detection Method using Affective Cues
Mittal, T., Bhattacharya, U., Chandra, R., Bera, A., & Manocha, D. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413570 · Cited by 319
Multi-Region Probabilistic Histograms for Robust and Scalable Identity Inference
Sanderson, C., & Lovell, B. C. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-01793-3_21 · Cited by 301
Merlin: An Open Source Neural Network Speech Synthesis System
Wu, Z., Watts, O., & King, S. (2016) · 9th ISCA Workshop on Speech Synthesis Workshop (SSW 9) · doi:10.21437/ssw.2016-33 · Cited by 299
CycleGAN-VC2: improved CycleGAN-based non-parallel voice conversion.
Kaneko, T., Kameoka, H., Tanaka, K., & Hojo, N. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8682897 · Cited by 272
An overview of voice conversion systems
Mohammadi, S. H., & Kain, A. (2017) · Speech Communication · doi:10.1016/j.specom.2017.01.008 · Cited by 264
Deepfake Audio Detection via MFCC features using Machine Learning
Hamza, A., Javed, A. R. R., Iqbal, F., Kryvinska, N., Almadhor, A. S., Jalil, Z., & Borghol, R. (2022) · IEEE Access · doi:10.1109/access.2022.3231480 · Cited by 264
The rising trend of Metaverse in education: challenges, opportunities, and ethical considerations
Kaddoura, S., & Al Husseiny, F. (2023) · PeerJ Computer Science · doi:10.7717/peerj-cs.1252 · Cited by 251
Artificial intelligence in digital media: the era of deepfakes
Karnouskos, S. (2020) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2020.3001312 · Cited by 239
Parametric Statistical Modeling by Minimum Integrated Square Error
Scott, D. W. (2001) · Technometrics · doi:10.1198/004017001316975880 · Cited by 228
Recurrent convolutional structures for audio spoof and video deepfake detection
Chintha, A., Thai, B., Sohrawardi, S. J., Bhatt, K., Hickerson, A., Wright, M., & Ptucha, R. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.2999185 · Cited by 226
NLP techniques for automating responses to customer queries: a systematic review
Olujimi, P. A., & Ade-Ibijola, A. (2023) · Discover Artificial Intelligence · doi:10.1007/s44163-023-00065-5 · Cited by 220
The Social Impact of Deepfakes
Hancock, J. T., & Bailenson, J. N. (2021) · Cyberpsychology, Behavior, and Social Networking · doi:10.1089/cyber.2021.29208.jth · Cited by 214
A review on social spam detection: Challenges, open issues, and future directions
Rao, S., Verma, A. K., & Bhatia, T. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115742 · Cited by 213
Maddocks, S. (2020) · Porn Studies · doi:10.1080/23268743.2020.1757499 · Cited by 203
Generalization of Audio Deepfake Detection
Chen, T., Kumar, A., Nagarsheth, P., Sivaraman, G., & Khoury, E. (2020) · The Speaker and Language Recognition Workshop (Odyssey 2020) · doi:10.21437/odyssey.2020-19 · Cited by 200
Speaker identification features extraction methods: A systematic review
Tirumala, S. S., Shahamiri, S. R., Garhwal, A. S., & Wang, R. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.08.015 · Cited by 194
Multi-Band Melgan: Faster Waveform Generation For High-Quality Text-To-Speech
Yang, G., Yang, S., Liu, K., Fang, P., Chen, W., & Xie, L. (2021) · 2021 IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt48900.2021.9383551 · Cited by 192
Spread of misinformation on social media: What contributes to it and how to combat it
Chen, S., Xiao, L., & Kumar, A. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107643 · Cited by 187
Ilyas, H., Javed, A., & Malik, K. M. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.110124 · Cited by 186
Replay and Synthetic Speech Detection with Res2Net Architecture
Li, X., Li, N., Weng, C., Liu, X., Su, D., Yu, D., & Meng, H. (2021) · ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp39728.2021.9413828 · Cited by 186
Valle, R., Li, J., Prenger, R., & Catanzaro, B. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054556 · Cited by 177
Machine learning-based social media bot detection: a comprehensive literature review
Aljabri, M., Zagrouba, R., Shaahid, A., Alnasser, F., Saleh, A., & Alomari, D. M. (2023) · Social Network Analysis and Mining · doi:10.1007/s13278-022-01020-5 · Cited by 171
Social media platforms and social enterprise: Bibliometric analysis and systematic review
Ali, I., Balta, M. E., & Παπαδόπουλος, Θ. (2022) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2022.102510 · Cited by 170
Gmail Smart Compose: Real-Time Assisted Writing
Chen, M. X., Lee, B. N., Bansal, G., Cao, Y., Zhang, S., Lu, J., Tsay, J., Wang, Y., Dai, A. M., Chen, Z., et al. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330723 · Cited by 169
ADD 2022: the first Audio Deep Synthesis Detection Challenge
Yi, J., Fu, R., Tao, J., Nie, S., Ma, H., Wang, C., Wang, T., Tian, Z., Bai, Y., Fan, C., et al. (2022) · ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp43922.2022.9746939 · Cited by 165
A Survey on the Detection and Impacts of Deepfakes in Visual, Audio, and Textual Formats
Mubarak, R., Alsboui, T., Alshaikh, O., Inuwa-Dutse, I., Khan, S., & Parkinson, S. (2023) · IEEE Access · doi:10.1109/access.2023.3344653 · Cited by 132
DeepSonar: Towards Effective and Robust Detection of AI-Synthesized Fake Voices
Wang, R., Juefei-Xu, F., Huang, Y., Guo, Q., Xie, X., Ma, L., & Liu, Y. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413716 · Cited by 131
Pawelec, M. (2022) · Digital Society · doi:10.1007/s44206-022-00010-6 · Cited by 131
Synthetic speech detection using temporal modulation feature
Wu, Z., Xiao, X., Chng, E. S., & Li, H. (2013) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2013.6639067 · Cited by 122
Parallel Tacotron: Non-Autoregressive and Controllable TTS
Elias, I., Zen, H., Shen, J., Zhang, Y., Ye, J., Weiss, R. J., & Wu, Y. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414718 · Cited by 122
Khanjani, Z., Watson, G., & Janeja, V. P. (2023) · Frontiers in Big Data · doi:10.3389/fdata.2022.1001063 · Cited by 121
Kinnunen, T., Sahidullah, M., Falcone, M., Costantini, L., Hautamäki, R. G., Thomsen, D. A. L., Sarkar, A. K., Tan, Z., Delgado, H., Todisco, M., et al. (2017) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2017.7953187 · Cited by 120
Wu, Z., Leon, P. L. D., Demiroğlu, C., Khodabakhsh, A., King, S., Ling, Z.-H., Saito, D., Stewart, B., Toda, T., Wester, M., et al. (2016) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2016.2526653 · Cited by 117
Yu, H. T., Tan, Z., Ma, Z., Martin, R., & Guo, J. H. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2771947 · Cited by 116
A literature review and perspectives in deepfakes: generation, detection, and applications
Dagar, D., & Vishwakarma, D. K. (2022) · International Journal of Multimedia Information Retrieval · doi:10.1007/s13735-022-00241-w · Cited by 113
ATTS2S-VC: Sequence-to-sequence Voice Conversion with Attention and Context Preservation Mechanisms
Tanaka, K., Kameoka, H., Kaneko, T., & Hojo, N. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8683282 · Cited by 112
Deep learning for deepfakes creation and detection: a survey
Nguyen, T. T., Nguyen, Q. V. H., Nguyen, D. T., Nguyen, D. T., Huynh-The, T., Nahavandi, S., Nguyen, T. T., Pham, Q.-V., & Nguyen, C. M. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4030341 · Cited by 112
Audio-deepfake detection: Adversarial attacks and countermeasures
Rabhi, M., Bakiras, S., & Pietro, R. D. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.123941 · Cited by 106
The Vicomtech Audio Deepfake Detection System Based on Wav2vec2 for the 2022 ADD Challenge
Martin-Donas, J. M., & Alvarez, A. (2022) · ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp43922.2022.9747768 · Cited by 100
Mel spectrogram-based audio forgery detection using CNN
Üstübıoğlu, A., Üstübioğlu, B., & Ulutaş, G. (2022) · Signal Image and Video Processing · doi:10.1007/s11760-022-02436-4 · Cited by 100
Impact of Deepfake Technology on Social Media: Detection, Misinformation and Societal Implications
AL-KHAZRAJI, S. H., SALEH, H. H., KHALID, A. I., & MISHKHAL, I. A. (2023) · The Eurasia Proceedings of Science Technology Engineering and Mathematics · doi:10.55549/epstem.1371792 · Cited by 98
A Robust Approach to Multimodal Deepfake Detection
Salvi, D., Liu, H., Mandelli, S., Bestagini, P., Zhou, W., Zhang, W., & Tubaro, S. (2023) · Journal of Imaging · doi:10.3390/jimaging9060122 · Cited by 96
STC anti-spoofing systems for the ASVspoof 2015 challenge
Novoselov, S., Kozlov, A., Lavrentyeva, G., Simonchik, K., & Shchemelinin, V. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7472724 · Cited by 90
Transfer Learning From Speech Synthesis to Voice Conversion With Non-Parallel Training Data
Zhang, M., Zhou, Y., Li, Z., & Li, H. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3066047 · Cited by 90
The Ethical Implications of Generative Audio Models: A Systematic Literature Review
Barnett, J. (2023) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3600211.3604686 · Cited by 89
Analyzing Fairness in Deepfake Detection With Massively Annotated Databases
Xu, Y., Terhörst, P., Pedersen, M., & Raja, K. B. (2024) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2024.3365421 · Cited by 89
Fake Audio Detection Based On Unsupervised Pretraining Models
Lv, Z., Zhang, S., Tang, K., & Hu, P. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747605 · Cited by 87
Overview of Voice Conversion Methods Based on Deep Learning
Walczyna, T., & Piotrowski, Z. (2023) · Applied Sciences · doi:10.3390/app13053100 · Cited by 86
Spectral Features for Synthetic Speech Detection
Paul, D., Pal, M., & Saha, G. (2017) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2017.2684705 · Cited by 85
A Capsule Network Based Approach for Detection of Audio Spoofing Attacks
Luo, A., Li, E., Liu, Y., Kang, X., & Wang, Z. J. (2021) · ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp39728.2021.9414670 · Cited by 84
Toward Robust Audio Spoofing Detection: A Detailed Comparison of Traditional and Learned Features
Balamurali, B. T., Lin, K. W. E., Lui, S., Chen, J., & Herremans, D. (2019) · IEEE Access · doi:10.1109/access.2019.2923806 · Cited by 83
Detecting Deepfake Voice Using Explainable Deep Learning Techniques
Lim, S.-Y., Chae, D.-K., & Lee, S.-C. (2022) · Applied Sciences · doi:10.3390/app12083926 · Cited by 82
Synthetic speech detection through short-term and long-term prediction traces
Borrelli, C., Bestagini, P., Antonacci, F., Sarti, A., & Tubaro, S. (2021) · EURASIP Journal on Information Security · doi:10.1186/s13635-021-00116-3 · Cited by 80
Choi, H.-Y., Lee, S.-H., & Lee, S. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29740 · Cited by 80
Deepfakes as a threat to a speaker and facial recognition: An overview of tools and attack vectors
Firc, A., Malinka, K., & Hanáček, P. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e15090 · Cited by 78
Long Range Acoustic and Deep Features Perspective on ASVspoof 2019
Das, R. K., Yang, J., & Li, H. (2019) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru46091.2019.9003845 · Cited by 75
LEGAL CHALLENGES OF ARTIFICIAL INTELLIGENCE AND ROBOTICS: A COMPREHENSIVE REVIEW
Akpuokwe, C. U., Adeniyi, A. O., Bakare, S. S., & Eneh, N. E. (2024) · Computer Science & IT Research Journal · doi:10.51594/csitrj.v5i3.860 · Cited by 73
The Kestrel TTS text normalization system
EBDEN, P., & Sproat, R. (2014) · Natural Language Engineering · doi:10.1017/s1351324914000175 · Cited by 71
Bogach, N., Boitсova, E., Chernonog, S., Lamtev, A., Lesnichaya, M., Lezhenin, I., Novopashenny, A., Svechnikov, R., Tsikach, D., Vasiliev, K., et al. (2021) · Electronics · doi:10.3390/electronics10030235 · Cited by 69
Deepfake Speech Detection Through Emotion Recognition: A Semantic Approach
Conti, E., Salvi, D., Borrelli, C., Hosler, B., Bestagini, P., Antonacci, F., Sarti, A., Stamm, M. C., & Tubaro, S. (2022) · ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp43922.2022.9747186 · Cited by 69
DNN Filter Bank Cepstral Coefficients for Spoofing Detection
Yu, H., Tan, Z.-H., Zhang, Y., Ma, Z., & Guo, J. (2017) · IEEE Access · doi:10.1109/access.2017.2687041 · Cited by 67
Masuyama, Y., Yatabe, K., Koizumi, Y., Oikawa, Y., & Harada, N. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8682744 · Cited by 67
Fake Speech Detection Using Residual Network with Transformer Encoder
Zhang, Z., Yi, X., & Zhao, X. (2021) · Proceedings of the 2021 ACM Workshop on Information Hiding and Multimedia Security · doi:10.1145/3437880.3460408 · Cited by 66
Adaspeech 2: Adaptive Text to Speech with Untranscribed Data
Yan, Y., Tan, X., Li, B., Qin, T., Zhao, S., Shen, Y., & Liu, T. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414872 · Cited by 65
TIMIT-TTS: A Text-to-Speech Dataset for Multimodal Synthetic Media Detection
Salvi, D., Hosler, B., Bestagini, P., Stamm, M. C., & Tubaro, S. (2023) · IEEE Access · doi:10.1109/access.2023.3276480 · Cited by 65
Assessing the Scope of Generalized Countermeasures for Anti-Spoofing
Das, R. K., Yang, J., & Li, H. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053086 · Cited by 62
Voice Spoofing Countermeasure for Logical Access Attacks Detection
Arif, T., Javed, A., Alhameed, M. H., Jeribi, F., & Tahir, A. (2021) · IEEE Access · doi:10.1109/access.2021.3133134 · Cited by 62
VISinger: Variational Inference with Adversarial Learning for End-to-End Singing Voice Synthesis
Zhang, Y., Cong, J., Xue, H., Xie, L., Zhu, P., & Bi, M. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747664 · Cited by 61
A Secure Deepfake Mitigation Framework: Architecture, Issues, Challenges, and Societal Impact
Wazid, M., Mishra, A. K., Mohd, N., & Das, A. K. (2024) · Cyber Security and Applications · doi:10.1016/j.csa.2024.100040 · Cited by 61
Ali, Z., Elamvazuthi, I., Alsulaiman, M., & Muhammad, G. (2016) · Journal of Voice · doi:10.1016/j.jvoice.2015.08.010 · Cited by 59
Synthetic speech detection using fundamental frequency variation and spectral features
Pal, M., Paul, D., & Saha, G. (2017) · Computer Speech & Language · doi:10.1016/j.csl.2017.10.001 · Cited by 59
Learning Efficient Representations for Fake Speech Detection
Subramani, N., & Rao, D. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6044 · Cited by 59
Identification of Fake Stereo Audio Using SVM and CNN
Liu, T., Yan, D., Wang, R., Yan, N., & Chen, G. (2021) · Information · doi:10.3390/info12070263 · Cited by 59
Spoofing detection from a feature representation perspective
Tian, X., Wu, Z., Xiao, X., Chng, E. S., & Li, H. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7472051 · Cited by 56
NVC-Net: End-To-End Adversarial Voice Conversion
Nguyen, B., & Cardinaux, F. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747020 · Cited by 56
Detecting Fake Audio of Arabic Speakers Using Self-Supervised Deep Learning
Almutairi, Z. M., & ElGibreen, H. (2023) · IEEE Access · doi:10.1109/access.2023.3286864 · Cited by 56
Liew, T. W., Tan, S.-M., Pang, W. M., Khan, M. T. I., & Kew, S. N. (2022) · Education and Information Technologies · doi:10.1007/s10639-022-11255-6 · Cited by 55
Session-based cyberbullying detection in social media: A survey
Yi, P., & Zubiaga, A. (2023) · Online Social Networks and Media · doi:10.1016/j.osnem.2023.100250 · Cited by 55
Long-term high frequency features for synthetic speech detection
Yang, J., & Das, R. K. (2019) · Digital Signal Processing · doi:10.1016/j.dsp.2019.102622 · Cited by 53
SpecRNet: Towards Faster and More Accessible Audio DeepFake Detection
Kawa, P., Plata, M., & Syga, P. (2022) · IEEE International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) · doi:10.1109/trustcom56396.2022.00111 · Cited by 52
Detection of Cross-Dataset Fake Audio Based on Prosodic and Pronunciation Features
Wang, C., Yi, J., Tao, J., Zhang, C. Y., Zhang, S., & Chen, X. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-1254 · Cited by 51
Detection of AI-Synthesized Speech Using Cepstral & Bispectral Statistics
Singh, A. K., & Singh, P. (2021) · IEEE International Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr51284.2021.00076 · Cited by 50
STREAMVC: Real-Time Low-Latency Voice Conversion
Yang, Y., Kartynnik, Y., Li, Y., Tang, J., Li, X., Sung, G., & Grundmann, M. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446863 · Cited by 50
Replay detection using CQT-based modified group delay feature and ResNeWt network in ASVspoof 2019
Cheng, X., Xu, M., & Zheng, T. F. (2019) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc47483.2019.9023158 · Cited by 49
Extraction of Octave Spectra Information for Spoofing Attack Detection
Yang, J., Das, R. K., & Zhou, N. (2019) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2019.2946897 · Cited by 48
Conversational End-to-End TTS for Voice Agents
Guo, H., Zhang, S., Soong, F. K., He, L., & Xie, L. (2021) · 2021 IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt48900.2021.9383460 · Cited by 47
Providing detection strategies to improve human detection of deepfakes: An experimental study
Somoray, K., & Miller, D. J. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2023.107917 · Cited by 47
Johnson, D. G., & Diakopoulos, N. (2021) · Communications of the ACM · doi:10.1145/3447255 · Cited by 45
Machine Learning-Based Opinion Spam Detection: A Systematic Literature Review
Qazi, A., Hasan, N., Mao, R., Abo, M. E. M., Dey, S. K., & Hardaker, G. (2024) · IEEE Access · doi:10.1109/access.2024.3399264 · Cited by 45
Exposing Vulnerabilities of Deepfake Detection Systems with Robust Attacks
Hussain, S., Neekhara, P., Dolhansky, B., Bitton, J., Ferrer, C. C., McAuley, J., & Koushanfar, F. (2021) · Digital Threats Research and Practice · doi:10.1145/3464307 · Cited by 40
Xue, J., Fan, C., Lv, Z., Tao, J., Yi, J., Zheng, C., Wen, Z., Yuan, M., & Shao, S. (2022) · Proceedings of the 1st International Workshop on Deepfake Detection for Audio Multimedia · doi:10.1145/3552466.3556526 · Cited by 40
Continual Learning for Fake Audio Detection
Ma, H., Yi, J., Tao, J., Bai, Y., Tian, Z., & Wang, C. (2021) · Interspeech 2021 · doi:10.21437/interspeech.2021-794 · Cited by 39
Audio Deepfake Detection System with Neural Stitching for ADD 2022
Yan, R., Cheng, W. M., Zhou, S., Guo, T., Zou, W., & Li, X. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746820 · Cited by 38
Adversarial learning techniques for security and privacy preservation: A comprehensive review
Hathaliya, J. J., Tanwar, S., & Sharma, P. (2022) · Security and Privacy · doi:10.1002/spy2.209 · Cited by 38
Voice spoofing detection corpus for single and multi-order audio replays
Baumann, R., Malik, K. M., Javed, A., Ball, A., Kujawa, B., & Malik, H. (2021) · Computer Speech & Language · doi:10.1016/j.csl.2020.101132 · Cited by 36
Pitch strength and Stevens’s power law
Shofner, W. P., & Selas, G. (2002) · Perception & Psychophysics · doi:10.3758/bf03194716 · Cited by 35
A Comparative Study on Physical and Perceptual Features for Deepfake Audio Detection
Li, M., Ahmadiadli, Y., & Zhang, X.-P. (2022) · Proceedings of the 1st International Workshop on Deepfake Detection for Audio Multimedia · doi:10.1145/3552466.3556523 · Cited by 35
A Machine Learning Model to Detect Fake Voice
Rodríguez-Ortega, Y., Ballesteros, D. M., & Renza, D. (2020) · Communications in computer and information science · doi:10.1007/978-3-030-61702-8_1 · Cited by 34
Deep Learning for Multimedia Forensics
Amerini, I., Anagnostopoulos, A., Maiano, L., & Celsi, L. R. (2021) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000096 · Cited by 34
Self-citationVoice Deepfake Detection Using the Self-Supervised Pre-Training Model HuBERT
Li, L., Lu, T., Ma, X., Yuan, M., & Wan, D. (2023) · Applied Sciences · doi:10.3390/app13148488 · Cited by 33
A Review of Spam Detection in Social Media
Yurtseven, I., Bağrıyanık, S., & Ayvaz, S. (2021) · International Conference on Computer Science and Engineering (UBMK) · doi:10.1109/ubmk52708.2021.9558993 · Cited by 33
Emergence of deepfakes and video tampering detection approaches: A survey
Kingra, S., Aggarwal, N., & Kaur, N. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-022-13100-x · Cited by 33
Sinha, S., Dey, S., & Saha, G. (2023) · Computer Speech & Language · doi:10.1016/j.csl.2023.101599 · Cited by 33
Liu, R., Zhang, J., & Gao, G. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102257 · Cited by 32
What to remember: Self-adaptive continual learning for audio deepfake detection
Zhang, X., Yi, J., Wang, C., Zhang, C. Y., Zeng, S., & Tao, J. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29929 · Cited by 32
Perot, E., & Mostert, F. (2019) · Journal of Intellectual Property Law & Practice · doi:10.1093/jiplp/jpz164 · Cited by 31
Multi-Scale Permutation Entropy for Audio Deepfake Detection
Wang, C., He, J., Yi, J., Tao, J., Zhang, C. Y., & Zhang, X. (2024) · ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp48485.2024.10448095 · Cited by 31
Ar-DAD: Arabic diversified audio dataset
Lataifeh, M., & Elnagar, A. (2020) · Data in Brief · doi:10.1016/j.dib.2020.106503 · Cited by 30
Bhatt, S., Jain, A., & Dev, A. (2021) · Wireless Personal Communications · doi:10.1007/s11277-021-08181-0 · Cited by 30
Detecting Audio Deepfakes: Integrating CNN and BiLSTM with Multi-Feature Concatenation
Wani, T. M., Qadri, S. A. A., Comminiello, D., & Amerini, I. (2024) · ACM Workshop on Information Hiding and Multimedia Security (IH&MMSec) · doi:10.1145/3658664.3659647 · Cited by 30
Self-citationPatel, T. B., & Patil, H. A. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7472650 · Cited by 29
Air traffic control communication (ATCC) speech corpora and their use for ASR and TTS development
Šmídl, L., Švec, J., Tihelka, D., Matoušek, J., Romportl, J., & Ircing, P. (2019) · Language Resources and Evaluation · doi:10.1007/s10579-019-09449-5 · Cited by 29
Clustering time series under the Fréchet distance
Driemel, A., Krivošija, A., & Sohler, C. (2015) · ACM-SIAM Symposium on Discrete Algorithms (SODA) · doi:10.1137/1.9781611974331.ch55 · Cited by 29
Styletts-VC: One-Shot Voice Conversion by Knowledge Transfer From Style-Based TTS Models
Li, Y. A., Han, C., & Mesgarani, N. (2023) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt54892.2023.10022498 · Cited by 29
Current Usage Areas of Deepfake Applications with Artificial Intelligence Technology
Kılıç, B., & Kahraman, M. E. (2023) · International E-Journal of Advances in Social Sciences · doi:10.59534/jcss.1358318 · Cited by 29
Voice spoofing detection for multiclass attack classification using deep learning
Boyd, J., Fahim, M., & Olukoya, O. (2023) · Machine Learning with Applications · doi:10.1016/j.mlwa.2023.100503 · Cited by 29
Fake Speech Recognition Using Deep Learning
Camacho, S., Ballesteros, D. M., & Renza, D. (2021) · Communications in computer and information science · doi:10.1007/978-3-030-86702-7_4 · Cited by 28
Securing Voice-Driven Interfaces Against Fake (Cloned) Audio Attacks
Malik, H. (2019) · 2019 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr.2019.00104 · Cited by 27
Modeling Prosodic Phrasing With Multi-Task Learning in Tacotron-Based TTS
Liu, R., Şişman, B., Bao, F., Gao, G., & Li, H. (2020) · IEEE Signal Processing Letters · doi:10.1109/lsp.2020.3016564 · Cited by 26
Song, K., Zhang, Y., Lei, Y., Cong, J., Li, H., Xie, L., He, G., & Bai, J. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095105 · Cited by 25
CrowdGraph: Weakly supervised Crowd Counting via Pure Graph Neural Network
Zhang, C., Zhang, Y., Li, B., Piao, X., & Yin, B. (2023) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3638774 · Cited by 25
The biometric vox system for the ASVspoof 2021 challenge
Cáceres, J., Font, R., Grau, T., & Molina, J. (2021) · 2021 Edition of the Automatic Speaker Verification and Spoofing Countermeasures Challenge · doi:10.21437/asvspoof.2021-11 · Cited by 25
Audio Anti-Spoofing Based on Audio Feature Fusion
Zhang, J., Tu, G., Liu, S., & Cai, Z. (2023) · Algorithms · doi:10.3390/a16070317 · Cited by 23
Alam, J., & Kenny, P. J. (2017) · European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco.2017.8081177 · Cited by 22
Development of Technologies for the Detection of (Cyber)Bullying Actions: The BullyBuster Project
Orrù, G., Galli, A., Gattulli, V., Gravina, M., Micheletto, M., Marrone, S., Nocerino, W., Procaccino, A., Terrone, G., Curtotti, D., et al. (2023) · Information · doi:10.3390/info14080430 · Cited by 21
Manipulation detection of key populations under information measurement
Xiao, S., Zhang, Z., Yang, J., Wen, J., & Li, Y. (2023) · Information Sciences · doi:10.1016/j.ins.2023.03.006 · Cited by 20
ADD 2023: the Second Audio Deepfake Detection Challenge
Yi, J., Tao, J., Fu, R., Yan, X., Wang, C., Wang, T., Zhang, C. Y., Zhang, X., Zhao, Y., Ren, Y., et al. (2023) · arXiv · doi:10.48550/arxiv.2305.13774 · Cited by 20
Analysis of the current state of deepfake techniques-creation and detection methods
Abu-Ein, A. A.-K. H., Al-Hazaimeh, O. M., Dawood, A. M., & Swidan, A. I. (2022) · Indonesian Journal of Electrical Engineering and Computer Science · doi:10.11591/ijeecs.v28.i3.pp1659-1667 · Cited by 19
GAN Discriminator based Audio Deepfake Detection
Doan, T.-P., Hong, K., & Jung, S. (2023) · doi:10.1145/3595353.3595883 · Cited by 11
Recalibrated Bandpass Filtering On Temporal Waveform For Audio Spoof Detection
Ren, Y., Liu, W., Liu, D., & Wang, L. (2021) · 2021 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip42928.2021.9506427 · Cited by 9
NeuralVC: Any-to-Any Voice Conversion Using Neural Networks Decoder for Real-Time Voice Conversion
Cao, D., Zhang, Z., & Zhang, J. (2024) · IEEE Signal Processing Letters · doi:10.1109/lsp.2024.3439469 · Cited by 9
Updating the Authentication of Digital Evidence in the International Criminal Court
da Silva, R. B. (2021) · International Criminal Law Review · doi:10.1163/15718123-bja10083 · Cited by 8
From GANs to Deepfakes: Getting the Characteristics Right
Kalpokas, I., & Kalpokienė, J. (2022) · SpringerBriefs in political science · doi:10.1007/978-3-030-93802-4_4 · Cited by 8
Detecting synthetic speech using long term magnitude and phase information
Tian, X., Du, S., Xiao, X., Xu, H., Chng, E. S., & Li, H. (2015) · IEEE China Summit and International Conference on Signal and Information Processing (ChinaSIP) · doi:10.1109/chinasip.2015.7230476 · Cited by 7
Oncological Applications of Deep Learning Generative Adversarial Networks
Phillips, H., Soffer, S., & Klang, E. (2022) · JAMA Oncology · doi:10.1001/jamaoncol.2021.8202 · Cited by 7
Exploring Green AI for Audio Deepfake Detection
Saha, S., Sahidullah, M., & Das, S. (2024) · arXiv · doi:10.48550/arxiv.2403.14290 · Cited by 7
Anti-spoofing Methods for Automatic Speaker Verification System
Lavrentyeva, G., Novoselov, S., & Simonchik, K. (2017) · Communications in computer and information science · doi:10.1007/978-3-319-52920-2_17 · Cited by 5
Kumar, S. R., & Bharathi, B. (2022) · Circuits Systems and Signal Processing · doi:10.1007/s00034-022-01957-0 · Cited by 5
Non-Cepstral Uncertainty Vector for Replay Spoofed Speech Detection
Patil, H. A., Acharya, R., Patil, A. T., & Gupta, P. (2022) · European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco55093.2022.9909946 · Cited by 4
IVCGAN:An Improved GAN for Voice Conversion
Zhao, W. Z., Wang, W., Chai, J., & Huang, J. (2021) · IEEE Information Technology, Networking, Electronic and Automation Control Conference (ITNEC) · doi:10.1109/itnec52019.2021.9587053 · Cited by 2
Research works printed but not linked: 138
- Adiga, 2013, Gammatone wavelet cepstral coefficients for robust speech recognition, 2013 IEEE International Conference of IEEE Region 10 (TENCON 2013), 1
- AlBadawy, 2019, Detecting AI-Synthesized Speech Using Bispectral Analysis, CVPR workshops, 104
- Almutairi, 2022, A review of modern audio deepfake detection methods: challenges and future directions, Al- gorithms, 15, 155
- Alzantot, 2019, Deep resid- ual neural networks for audio spoofing detection, arXiv preprint arXiv:1907.00501 · arXiv
- Aravind, 2020, Audio spoofing verification using deep convolutional neural networks by transfer learning, arXiv preprint arXiv:2008.03464 · arXiv
- Arık, 2017, Deep voice: Real-time neural text-to-speech, International conference on machine learning, 195
- Attorresi, 2022, Combining automatic speaker verification and prosody analysis for synthetic speech detection, arXiv preprint arXiv:2210.17222 · arXiv
- Ballesteros, 2020, A dataset of histograms of original and fake voice recordings (H-Voice), Data in brief, 29
- Barrault, 2023, SeamlessM4T-Massively Multilingual & Multimodal Ma- chine Translation, arXiv preprint arXiv:2308.11596 · arXiv
- Barrington, 2024, DeepSpeak Dataset v1. 0, arXiv preprint arXiv:2408.05366 · arXiv
- Bartusiak, 2022, Frequency domain-based detection of generated audio, arXiv preprint arXiv:2205.01806 · arXiv
- Bhat, 2017, Cortana-intelligent personal digital assistant: A review, International Journal of Ad- vanced Research in Computer Science, 8, 55
- Bhatia, 2022, Detection of AI Synthesized Hindi Speech, arXiv preprint arXiv:2203.03706 · arXiv
- Bińkowski, 2019, High fidelity speech synthesis with adversarial networks, arXiv preprint arXiv:1909.11646 · arXiv
- Blue, 2022, Who Are You (I Really Wanna Know)? Detecting Audio {DeepFakes} Through Vocal Tract Recon- struction, 31st USENIX Security Symposium (USENIX Security 22), 2691
- Capes, 2017, Siri on-device deep learning-guided unit selection text-to-speech system, Interspeech, 4011
- Casanova, 2022, Yourtts: Towards zero-shot multi-speaker tts and zero-shot voice conversion for everyone, International Conference on Machine Learning, 2709
- Channing, 2024, Toward Robust Real-World Audio Deepfake Detection: Closing the Explainability Gap, arXiv preprint arXiv:2410.07436 · arXiv
- Chen, 2021, Adaspeech: Adaptive text to speech for custom voice, arXiv preprint arXiv:2103.00993 · arXiv
- Chen, 2024, VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers, arXiv preprint arXiv:2406.05370 · arXiv
- Chesney, 2018, Deep fakes: A looming crisis for national security, democracy and privacy, The Lawfare Blog
- Christensen, 2022, Multi-pitch estimation
- Conner, 2015, Photo tampering throughout history, Four and Six. Accessed, 9
- De, 2012, Synthetic Speech Discrimination using Pitch Pattern Statistics Derived from Image Analysis, Interspeech, 370
- Delgado, 2018, ASVspoof 2017 Version 2.0: meta- data analysis and baseline enhancements, Odyssey 2018-The Speaker and Language Recognition Workshop
- Dhar, 2023, GLGAN-VC: A guided loss-based generative adversarial network for many-to-many voice conversion, IEEE Transactions on Neural Networks and Learning Systems
- Dixit, 2023, Review of audio deepfake detection techniques: Issues and prospects, Expert Systems, e13322
- Doan, 2023, BTS-E: Au- dio Deepfake Detection Using Breathing-Talking-Silence Encoder, ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 1
- Donahue, 2018, Adversarial audio synthesis, arXiv preprint arXiv:1802.04208 · arXiv
- Elias, 2021, Parallel Tacotron 2: A non-autoregressive neural TTS model with differentiable duration modeling, arXiv preprint arXiv:2103.14574 · arXiv
- Forbes., 2019, A Voice Deepfake Was Used To Scam A CEO Out Of $243,000.
- Frank, 2021, Wavefake: A data set to facilitate audio deepfake detection, arXiv preprint arXiv:2111.02813 · arXiv
- Gamage, 2021, The Emergence of Deepfakes and its Societal Implications: A Systematic Review, TTO, 28
- Ge, 2021, Raw differentiable architecture search for speech deepfake and spoofing detection, arXiv preprint arXiv:2107.12212 · arXiv
- Gibiansky, 2017, Deep voice 2: Multi-speaker neural text-to-speech, Advances in neural information processing systems, 30
- Goodfellow, 2014, Generative adversarial nets, Advances in neural information processing systems, 27
- Guo, 2019, Exploiting syntactic features in a parsed tree to improve end-to-end TTS, arXiv preprint arXiv:1904.04764 · arXiv
- Han, 2024, Uncovering Human Traits in Determining Real and Spoofed Audio: Insights from Blind and Sighted Individuals, Proceedings of the CHI Conference on Human Factors in Computing Systems, 1
- Heidari, 2024, Deep- fake detection using deep learning methods: A systematic and com- prehensive review, Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 14, e1520
- Hsu, 2017, Voice conversion from unaligned corpora using variational autoen- coding wasserstein generative adversarial networks, arXiv preprint arXiv:1704.00849 · arXiv
- Huang, 2021, Audio replay spoofing attack detection using deep learning feature and long-short-term memory recurrent neural network, AIIPCC 2021; The Second International Con- ference on Artificial Intelligence, Information Processing and Cloud Computing, 1
- Huang, 2019, Voice transformer network: Sequence-to-sequence voice conversion using transformer with text-to-speech pretraining, arXiv preprint arXiv:1912.06813 · arXiv
- Iqbal, 2022, Deepfake Audio Detection Via Feature Engineering And Machine Learning, CIKM Workshops
- Jang, 2020, Universal melgan: A robust neural vocoder for high-fidelity waveform generation in multiple domains, arXiv preprint arXiv:2011.09631 · arXiv
- Jiang, 2020, Self- Supervised Spoofing Audio Detection Scheme, INTERSPEECH, 4223
- Jung, 2024, WWW: Where, Which and Whatever Enhancing Interpretability in Multimodal Deepfake Detection, arXiv preprint arXiv:2408.02954 · arXiv
- Kameoka, 2021, Fasts2s-vc: Streaming non-autoregressive sequence-to-sequence voice conversion, arXiv preprint arXiv:2104.06900 · arXiv
- Katamneni, 2023, MIS-AVioDD: Modality invariant and specific representation for audio-visual deepfake de- tection, arXiv preprint arXiv:2310.02234 · arXiv
- Kenyon, 2020, Clarifying the Probable Cause Standard in the Internet Age for Crimes Involving Child Pornography, Cath. UL Rev., 69, 633
- Khan, 2022, Voice Spoofing Countermeasures: Taxonomy, State-of-the-art, experimen- tal analysis of generalizability, open challenges, and the way forward, arXiv preprint arXiv:2210.00417 · arXiv
- Khochare, 2021, A deep learning framework for audio deepfake detection, Arabian Journal for Science and Engineering, 1
- Kim, 2021, Conditional variational autoen- coder with adversarial learning for end-to-end text-to-speech, International Conference on Machine Learning, 5530
- Kingma, 2018, Glow: Generative flow with invertible 1x1 convolutions, Advances in neural information pro-cessing systems, 31
- Klein, 2024, Source tracing of audio deepfake systems, arXiv preprint arXiv:2407.08016 · arXiv
- Kong, 2020, Hifi-gan: Generative adversarial networks for efficient and high fidelity speech synthesis, Advances in Neural Information Processing Systems, 33, 17022
- Korshunov, 2018, Deepfakes: a new threat to face recognition?, arXiv preprint arXiv:1812.08685 · arXiv
- Korshunov, 2016, Overview of BTAS 2016 speaker anti- spoofing competition, 2016 IEEE 8th international conference on biometrics theory, applications and systems (BTAS), 1
- Kumar, 2019, Melgan: Generative adversarial networks for conditional waveform synthesis, Advances in neural information processing systems, 32
- Kumar, 2017, Obamanet: Photo-realistic lip-sync from text, arXiv preprint arXiv:1801.01442 · arXiv
- Kumari, 2024, Neural Network Pruning Techniques for Efficient Model Compression, International Journal of Intelligent Systems and Applications in Engineering, 12, 565
- Kwon, 2021, Kodf: A large-scale korean deepfake detection dataset, Proceedings of the IEEE/CVF International Conference on Computer Vision, 10744
- Lai, 2019, ASSERT: Anti-spoofing with squeeze-excitation and residual networks, arXiv preprint arXiv:1904.01120 · arXiv
- Łajszczak, 2024, BASE TTS: Lessons from building a billion-parameter text-to- speech model on 100K hours of data, arXiv preprint arXiv:2402.08093 · arXiv
- Lei, 2020, Siamese Convolutional Neural Network Using Gaussian Probability Feature for Spoofing Speech Detection, INTERSPEECH, 1116
- Levine, 2020, Dollars, Deception, and Deepfakes: An Analysis of Deepfakes and Synthetic Media Fraud, PhD thesis
- Liu, 2021, Self-supervised learning: Generative or contrastive, IEEE transactions on knowledge and data engineering, 35, 857
- Liu, 2023, Asvspoof 2021: Towards spoofed and deepfake speech detection in the wild, IEEE/ACM Transactions on Audio, Speech, and Language Processing
- Liu, 2023, Diffvoice: Text-to-speech with latent diffusion, ICASSP 2023-2023 IEEE International Confer- ence on Acoustics, Speech and Signal Processing (ICASSP), 1
- Ma, 2022, FAD: A Chinese dataset for fake audio detection, arXiv preprint arXiv:2207.12308 · arXiv
- Ma, 2023, A Lightweight and Efficient Model for Audio Anti-Spoofing, Proceedings of the 5th ACM International Conference on Multimedia in Asia, 1
- Macharyas, 2015, The malicious and forensic uses of Adobe software, PhD thesis
- Martın-Donas, 2024, Exploring Self-supervised Embeddings and Syn- thetic Data Augmentation for Robust Audio Deepfake Detection, Proc. Interspeech, 2024
- Mateo, 2023, A Deep Dive into Artificial Intelligence and Its Integration into Cybersecurity, PhD thesis
- Mischie, 2018, Implementation of google assistant on rasberry pi, 2018 International Symposium on Electronics and Telecommunications (ISETC), 1
- Muppalla, 2023, Integrating audio-visual fea- tures for multimodal deepfake detection, arXiv preprint arXiv:2310. 03827
- Nercessian, 2020, Zero-Shot Singing Voice Conversion, ISMIR, 70
- Oord, 2018, ., Par- allel wavenet: Fast high-fidelity speech synthesis
- Oord, 2016, Wavenet: A generative model for raw audio, arXiv preprint arXiv:1609.03499 · arXiv
- Ouyang, 2021, Capsule net- work based end-to-end system for detection of replay attacks, 2021 12th International Symposium on Chinese Spoken Language Processing (ISCSLP), 1
- Pan, 2022, Speaker recognition-assisted robust audio deepfake detection., INTERSPEECH, 4202
- Park, 2020, Cotatron: Transcription- guided speech encoder for any-to-many voice conversion without parallel data, arXiv preprint arXiv:2005.03295 · arXiv
- Pascu, 2024, Easy, Interpretable, Effective: openSMILE for voice deepfake detection, arXiv preprint arXiv:2408.15775 · arXiv
- Patel, 2015, Combining evidences from mel cepstral, cochlear filter cepstral and instantaneous frequency features for detection of natural vs. spoofed speech, Sixteenth annual conference of the international speech communication association
- Phukan, 2024, Heterogeneity over Homogeneity: Investigating Multilingual Speech Pre-Trained Models for Detecting Audio Deepfake, arXiv preprint arXiv:2404.00809 · arXiv
- Pianese, 2022, Deepfake audio detection by speaker verification, 2022 IEEE International Workshop on Information Forensics and Security (WIFS), 1
- Ping, 2017, Deep voice 3: Scaling text- to-speech with convolutional sequence learning, arXiv preprint arXiv:1710.07654 · arXiv
- Qais, 2022, Deep- fake Audio Detection with Neural Networks Using Audio Features, 2022 International Conference on Intelligent Controller and Computing for Smart Power (ICICCSP), 1
- Raza, 2023, Multimodaltrace: Deepfake detection using audiovisual representation learning, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 993
- Reimao, 2019, For: A dataset for synthetic speech detection, 2019 International Conference on Speech Technology and Human-Computer Dialogue (SpeD), 1
- Rekimoto, 2023, WESPER: Zero-shot and realtime whisper to normal voice conversion for whisper-based speech interactions, Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, 1
- Ren, 2020, Fastspeech 2: Fast and high-quality end-to-end text to speech, arXiv preprint arXiv:2006.04558 · arXiv
- Ren, 2019, Fastspeech: Fast, robust and controllable text to speech, Advances in neural information processing systems, 32
- Sachdeva, 2021, Cyberbullying Detection on Social Media Using Deep Learning Models, PhD thesis
- Sailor, 2017, Unsupervised Filterbank Learning Using Convolutional Restricted Boltzmann Machine for Environmental Sound Classification., InterSpeech
- Saxena, 2023, Multiple Aspects of Artificial Intelligence
- Shan, 2020, A Cross-Verification Approach for Protecting World Leaders from Fake and Tampered Audio, arXiv preprint arXiv:2010.12173 · arXiv
- Shen, 2020, Non-attentive tacotron: Robust and controllable neural tts synthesis including unsupervised duration modeling, arXiv preprint arXiv:2010.04301 · arXiv
- Shi, 2020, Aishell-3: A multi- speaker mandarin tts corpus and the baselines, arXiv preprint arXiv:2010.11567 · arXiv
- Sisman, 2018, Wavelet Analysis of Speaker Dependent and Independent Prosody for Voice Conversion., Interspeech
- Sotelo, 2017, ., Char2wav: End-to-end speech synthesis
- Stupp, 2019, Fraudsters used AI to mimic CEO’s voice in unusual cybercrime case, The Wall Street Journal, 30
- Suratkar, 2020, Employing transfer-learning based CNN architectures to enhance the generalizability of deepfake detection, 2020 11th in- ternational conference on computing, communication and networking technologies (ICCCNT), 1
- Swetha, 2021, AI Based Assistance for Visually Im- paired People Using TTS (Text To Speech), International Journal of Innovative Research in Science and Technology, 1, 8
- Tak, 2022, ., arXiv preprint arXiv:2202.12233 · arXiv
- Taylor, 2009, ., Text-to-speech synthesis
- TechCrunch., 2016, AdobesProjectVoCo
- Todisco, 2016, A New Feature for Automatic Speaker Verification Anti-Spoofing: Constant Q Cepstral Coefficients., Odyssey, 2016, 283
- Vaswani, 2018, Tensor2tensor for neural machine translation, arXiv preprint arXiv:1803.07416 · arXiv
- Villalba, 2015, Spoofing detection with DNN and one-class SVM for the ASVspoof 2015 challenge, Sixteenth annual conference of the international speech communication association
- Wang, 2023, Detection of Cross-Dataset Fake Audio Based on Prosodic and Pronunciation Features, arXiv preprint arXiv:2305.13700 · arXiv
- Wang, 2023, Neural codec language models are zero- shot text to speech synthesizers, arXiv preprint arXiv:2301.02111 · arXiv
- Wang, 2021, Investigating self-supervised front ends for speech spoofing countermeasures, arXiv preprint arXiv:2111.07725 · arXiv
- Wang, 2023, Robust audio anti-spoofing countermeasure with joint training of front-end and back-end models, Proc. INTERSPEECH, 2023, 4004
- Wang, 2017, Tacotron: Towards end-to-end speech synthesis, arXiv preprint arXiv:1703.10135 · arXiv
- Wang, 2020, Densely connected convolutional network for audio spoofing detection, 2020 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), 1352
- Wani, 2023, Deepfakes Audio Detection Lever- aging Audio Spectrogram and Convolutional Neural Networks, International Conference on Image Analysis and Processing, 156
- Wani, 2024, ABC-CapsNet: Attention based Cascaded Capsule Network for Audio Deepfake De- tection, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2464
- Wijethunga, 2020, Deepfake audio detection: a deep learning based solution for group conversations, 2020 2nd Inter- national Conference on Advancements in Computing (ICAC), 192
- Wong, 2023, Privacy Legisla- tion as Business Risks: How GDPR and CCPA are Represented in Technology Companies’ Investment Risk Disclosures, Proceedings of the ACM on Human-Computer Interaction, 7, 1
- Wu, 2022, Adaspeech 4: Adaptive text to speech in zero-shot scenarios, arXiv preprint arXiv:2204.00436 · arXiv
- Wu, 2020, Light convolutional neural network with feature genuinization for detection of synthetic speech attacks, arXiv preprint arXiv:2009.09637 · arXiv
- Wu, 2015, ASVspoof 2015: the first automatic speaker verification spoofing and countermeasures challenge, Sixteenth annual conference of the international speech communication associ-ation
- Xiao, 2015, Spoof- ing speech detection using high dimensional magnitude and phase features: the NTU approach for ASVspoof 2015 challenge., In- terspeech
- Xie, 2023, Domain Generalization Via Aggregation and Separation for Audio Deepfake Detection, IEEE Transactions on Information Forensics and Security
- Xie, 2023, Learning A Self- Supervised Domain-Invariant Feature Representation for General- ized Audio Deepfake Detection, Proc. INTERSPEECH, 2808
- Xue, 2023, Foundationtts: Text-to-speech for asr customization with generative language model, arXiv preprint arXiv:2303.02939 · arXiv
- Yamagishi, 2021, ASVspoof 2021: accelerating progress in spoofed and deepfake speech detection, arXiv preprint arXiv:2109.00537 · arXiv
- Yan, 2023, Deep Dive into Deepfakes—Safeguarding Our Digital Identity, Brooklyn Journal of International Law, 48, 767
- Yan, 2021, Adaspeech 3: Adaptive text to speech for spontaneous style, arXiv preprint arXiv:2107.02530 · arXiv
- Yang, 2018, Feature with Complementarity of Statistics and Principal Information for Spoofing Detection., INTERSPEECH
- Yang, 2020, VocGAN: A high- fidelity real-time vocoder with a hierarchically-nested adversarial network, arXiv preprint arXiv:2007.15256 · arXiv
- Yi, 2021, Half-truth: A partially fake audio detection dataset, arXiv preprint arXiv:2104.03617 · arXiv
- Yu, 2023, Pvass- mdd: predictive visual-audio alignment self-supervision for multi- modal deepfake detection, IEEE Transactions on Circuits and Systems for Video Technology
- Yu, 2022, Deep learning for face anti-spoofing: A survey, IEEE transactions on pattern analysis and machine intelligence, 45, 5609
- Zhang, 2023, Do you remember?, International Conference on Machine Learning, 41819
- Zhang, 2024, Joint Audio-Visual Attention with Contrastive Learning for More General Deepfake Detection, ACM Transactions on Multimedia Computing, Communications and Applications, 20, 1
- Zhang, 2020, Gazev: Gan-based zero-shot voice conversion over non-parallel speech corpus, arXiv preprint arXiv:2010.12788 · arXiv
- Zhou, 2021, Joint audio-visual deepfake detec- tion, Proceedings of the IEEE/CVF International Conference on Computer Vision, 14800
Cited by
Deepfake Media Forensics: Status and Future Challenges
Amerini, I., Barni, M., Battiato, S., Bestagini, P., Boato, G., Bruni, V., Caldelli, R., De Natale, F., De Nicola, R., Guarnera, L., et al. (2025) · Journal of Imaging · doi:10.3390/jimaging11030073 · Cited by 113
Self-citationDeepfake Audio Detection in Low-Resource Languages: A Case Study of Urdu
Owais, M., Jadoon, K. K., Sandhu, A. I., Ali, Z., Mahmood, Z., Yahya, M., & Wahid, A. (2026) · IEEE Access · doi:10.1109/access.2026.3654621 · Cited by 8
“…voices can The associate editor coordinating the review of this manuscript and approving it for publication was Alba Amato . convincingly imitate real speakers, creating vulnerabilities in financial fraud, identity verification, political misinformation, and social engineering attacks [5], [6].”
Defending Speaker Verification Against Deepfake: A Multi-Step Approach
Doan, T.-P., Dinh-Xuan, H., Kim, I., Lee, W., Han, S., & Jung, S. (2025) · ACM Workshop on Deepfake, Deception, and Disinformation Security (3D-Sec) · doi:10.1145/3733813.3764373 · Cited by 5
Learning to Fuse: A Gated Multi-Stream Framework for Generalized Audio Deepfake Detection
Wani, T. M., & Amerini, I. (2025) · doi:10.1145/3746265.3759657 · Cited by 3
Self-citationMulti-Scale Self-Supervised Learning for Efficient Audio Deepfake Detection
Wani, T. M., & Amerini, I. (2025) · IEEE Signal Processing Letters · doi:10.1109/lsp.2025.3634032 · Cited by 2
Self-citation
Metadata
- Authors
- Wani, T. M., Qadri, S. A. A., Wani, F. A., & Amerini, I.
- Affiliations
- Sapienza University of Rome (IT)
- National Tsing Hua University (TW)
- Venue
- Foundations and Trends® in Privacy and Security
- Publisher
- Emerald
- Published
- 2024-11-27
- Volume
- 6
- Issue
- 3-4
- Pages
- 153-345
- ISSN
- 2474-1558 (ISSN-L)
- 2474-1566
- OpenAlex
- W4404765990
- Cited by
- 16
- References
- 155
- Citations by year
- 2026: 6 · 2025: 10
- FWCI
- 2.36
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- Foundations and Trends® in Privacy and Security (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Keywords
- deepfake audio, deepfake detection, speech synthesis, voice conversion, text-to-speech, misinformation, deepfake datasets, media integrity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.