CoChat
Sign Up
PreprintCited by 40Speech Recognition and SynthesisDigital Media Forensic DetectionMusic and Audio Processing

Audio Deepfake Detection: A Survey

Open access
Yi, Jiangyan, Wang, Chenglong, Tao, Jianhua, Zhang, Xiaohui, Zhang, Chu Yuan, Zhao, Yan·2023·arXiv
DOI 10.48550/arxiv.2308.14970arXiv 2308.14970
Open this paper in CoChat — free accountOpen PDF

Abstract

Audio deepfake detection is an emerging active topic. A growing number of literatures have aimed to study deepfake detection algorithms and achieved effective performance, the problem of which is far from being solved. Although there are some review literatures, there has been no comprehensive survey that provides researchers with a systematic overview of these developments with a unified evaluation. Accordingly, in this survey paper, we first highlight the key differences across various types of deepfake audio, then outline and analyse competitions, datasets, features, classifications, and evaluation of state-of-the-art approaches. For each aspect, the basic techniques, advanced developments and major challenges are discussed. In addition, we perform a unified comparison of representative features and classifiers on ASVspoof 2021, ADD 2023 and In-the-Wild datasets for audio deepfake detection, respectively. The survey shows that future research should address the lack of large scale datasets in the wild, poor generalization of existing detection methods to unknown fake attacks, as well as interpretability of detection results.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2308.14970

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Current survey papers primarily focus on reviewing detection methods based on their accuracy performance within the same dataset (within-domain evaluation), which achieves high accuracy often exceeding 95%.

    “Current survey papers [5-9, 15, 15, 16] primarily focus on reviewing detection methods based on their accuracy performance within the same dataset (within-domain evaluation), which achieves high accuracy (often exceeding 95%).”

    From Deepfake detection across image, video, and audio: a comprehensive survey with empirical evaluation of generalization and robustness (2026) · cites this paper as [8]

    Section 7.1 (Table 5; page unavailable) reports some competition systems with EER below 5%, and Section 7.2 says detection systems perform worse out of domain than in domain. But the paper reports EER rather than accuracy and does not establish that within-domain accuracy often exceeds 95%. Its Introduction describes earlier surveys as covering ASV spoofing, countermeasures, datasets and metrics—not as primarily reviewing within-domain accuracy. (LLM, conf=0.85)

    Experimental — accuracy not yet measured

  • Existing surveys of passive deepfake detection examine specific modalities in isolation.

    “While there are several surveys of passive DF detection that examine specific modalities in isolation [5-9], the field requires a holistic analysis that transcends these single approaches.”

    From Deepfake detection across image, video, and audio: a comprehensive survey with empirical evaluation of generalization and robustness (2026) · cites this paper as [8]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 167

  1. T. Wang, R. Fu, J. Yi, J. Tao, and S. Wang, "Prosody and voice factorization for few-shot speaker adaptation in the challenge m2voc 2021," in Proc. of ICASSP), 2021.
  2. Z. Yi, W.-C. Huang, X. Tian, J. Yamagishi, R. K. Das, T. Kinnunen, Z.-H. Ling, and T. Toda, "Voice Conversion Challenge 2020: Intra- lingual semi-parallel and cross-lingual voice conversion," in Proc. Joint Workshop for the Blizzard Challenge and Voice Conversion Challenge 2020, 2020, pp. 80-98.
  3. T. Chen, A. Kumar, P. Nagarsheth, G. Sivaraman, and E. Khoury, "Generalization of audio deepfake detection," in Proc. of Odyssey: The Speaker and Language Recognition Workshop, 2020.
  4. R. Wang, F. Juefei-Xu, Y. Huang, Q. Guo, and et al., "Deepsonar: Towards effective and robust detection of ai-synthesized fake voices," in Proc. of ACM MM, 2020.
  5. Z. Wu, R. K. Das1, J. Yang, and H. Li, "Light convolutional neural network with feature genuinization for detection of synthetic speech attacks," in Proc. of INTERSPEECH, 2020.
  6. Z. Wu, N. Evans, T. Kinnunen, J. Yamagishi, F. Alegre, and H. Li, "Spoofing and countermeasures for speaker verification: A survey," Speech Communication, vol. 66, pp. 130-153, 2015.
  7. M. R. Kamble, H. B. Sailor, H. A. Patil, and H. Li, "Advances in anti-spoofing: from the perspective of asvspoof challenges," Published online by Cambridge University Press, pp. 1-18, 2020.
  8. C. B. Tan, M. Hijazi, N. Khamis, P. Nohuddin, Z. Zainol, F. Co- enen, and A. Gani, "A survey on presentation attack detection for automatic speaker verification systems: State-of-the-art, tax- onomy, issues and future direction," Multimedia Tools and Appli- cations, pp. 32 725-32 762, 2021.
  9. A. Mittal and M. Dua, "Automatic speaker verification systems and spoof detection techniques: review and analysis," Interna- tional Journal of Speech Technology, vol. 25, pp. 105-134, 2021.
  10. Z. Almutairi and H. Elgibreen, "A review of modern audio deepfake detection methods: Challenges and future directions," Algorithms, 2022.
  11. A. J. Hunt and A. W. Black, "Unit selection in a concatenative speech synthesis system using a large speech database," in IEEE International Conference on Acoustics, 1996.
  12. Y. Stylianou, "Applying the harmonic plus noise model in con- catenative speech synthesis," Speech & Audio Processing IEEE Transactions on, vol. 9, no. 1, pp. 21-29, 2001.
  13. H. Zen, A. W. Senior, and M. Schuster, "Statistical parametric speech synthesis using deep neural networks," 2013 IEEE Inter- national Conference on Acoustics, Speech and Signal Processing, pp. 7962-7966, 2013.
  14. J. Kim, J. Kong, and J. Son, "Conditional variational autoen- coder with adversarial learning for end-to-end text-to-speech," in ICML, 2021.
  15. R. Huang, M. W. Y. Lam, J. Wang, D. Su, D. Yu, Y. Ren, and Z. Zhao, "Fastdiff: A fast conditional diffusion model for high- quality speech synthesis," in International Joint Conference on Artificial Intelligence, 2022.
  16. B. Sisman, J. Yamagishi, S. King, and H. Li, "An overview of voice conversion and its challenges: From statistical modeling to deep learning," IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 29, pp. 132-157, 2020.
  17. H.-S. Choi, J. Lee, W. Kim, J. Lee, H. Heo, and K. Lee, "Neu- ral analysis and synthesis: Reconstructing speech from self- supervised representations," Advances in Neural Information Pro- cessing Systems, vol. 34, pp. 16 251-16 265, 2021.
  18. E. Godoy, O. Rosec, and T. Chonavel, "Voice conversion using dynamic frequency warping with amplitude scaling, for parallel or nonparallel corpora," IEEE Transactions on Audio, Speech, and Language Processing, vol. 20, no. 4, pp. 1313-1323, 2011.
  19. Z. Jin, A. Finkelstein, S. DiVerdi, J. Lu, and G. J. Mysore, "Cute: A concatenative method for voice conversion using exemplar-based unit selection," in 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2016, pp. 5660-5664.
  20. A. v. d. Oord, S. Dieleman, H. Zen, K. Simonyan, O. Vinyals, A. Graves, N. Kalchbrenner, A. Senior, and K. Kavukcuoglu, "Wavenet: A generative model for raw audio," arXiv preprint arXiv:1609.03499, 2016. · arXiv
  21. J. Kong, J. Kim, and J. Bae, "Hifi-gan: Generative adversarial net- works for efficient and high fidelity speech synthesis," Advances in Neural Information Processing Systems, vol. 33, pp. 17 022-17 033, 2020.
  22. S. Dahmani, V. Colotte, V. Girard, and S. Ouni, "Conditional variational auto-encoder for text-driven expressive audiovisual speech synthesis," in INTERSPEECH 2019-20th Annual Conference of the International Speech Communication Association, 2019.
  23. Y. L. Zhao, J. Yi, J. Tao, C. Wang, C. Y. Zhang, T. Wang, and Y. Dong, "Emofake: An initial dataset for emotion fake audio detection," ArXiv, vol. abs/2211.05363, 2022. · arXiv
  24. K. Zhou, B. Sisman, R. Liu, and H. Li, "Emotional voice conver- sion: Theory, databases and esd," Speech Commun., vol. 137, pp. 1-18, 2021.
  25. J. Yi, C. Wang, J. Tao, Z. Tian, C. Fan, H. Ma, and R. Fu, "Scenefake: An initial dataset and benchmarks for scene fake audio detection," ArXiv, vol. abs/2211.06073, 2022. · arXiv
  26. J. Yi, Y. Bai, J. Tao, H. Ma, Z. Tian, C. Wang, T. Wang, and R. Fu, "Half-truth: A partially fake audio detection dataset," in Proc. of INTERSPEECH, 2021.
  27. Z. Wu, T. Kinnunen, N. Evans, J. Yamagishi, C. Hanilc¸i, and et al., "Asvspoof 2015: the first automatic speaker verification spoofing and countermeasures challenge," in Proc. of INTERSPEECH, 2015.
  28. T. Kinnunen, M. Sahidullah, H. Delgado, N. E. M. Todisco, and et al., "The asvspoof 2017 challenge: Assessing the limits of replay spoofing attack detection," in Proc. of INTERSPEECH, 2017.
  29. M. Todisco, X. Wang, V. Vestman, M. Sahidullah, and K. Lee, "Asvspoof 2019: Future horizons in spoofed and fake audio detection," in Proc. of INTERSPEECH, 2019.
  30. J. Yamagishi, X. Wang, M. Todisco, M. Sahidullah, J. Patino, A. Nautsch, X. Liu, K. A. Lee, T. Kinnunen, and N. Evans, "Asvspoof 2021: accelerating progress in spoofed and deepfake speech detection," in The ASVspoof 2021 Workshop, 2021.
  31. J. Yi, R. Fu, J. Tao, S. Nie, H. Ma, C. Wang, T. Wang, Z. Tian, Y. Bai, C. Fan, S. Liang, S. Wang, S. Zhang, X. Yan, L. Xu, Z. Wen, and H. Li, "Add 2022: the first audio deep synthesis detection challenge," in 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2022.
  32. P. L. D. Leon, M. Pucher, and J. Yamagishi, "Evaluation of the vulnerability of speaker verification to synthetic speech," in Proc. of Odyssey: The Speaker and Language Recognition Workshop, 2010.
  33. F. Alegre, A. Amehraye, and N. Evans, "A one-class classification approach to generalised speaker verification spoofing counter- measures using local binary patterns," in Proc. of Int. Conf. on Biometrics: Theory, Applications and Systems (BTAS), 2013.
  34. Z. Kons and H. Aronowitz, "Voice transformation-based spoof- ing of text dependent speaker verification systems," in Annual Conference of the International Speech Communication Association (Interspeech), 2013.
  35. Z. Wu, A. Larcher, K. A. Lee, and et al., "Vulnerability evaluation of speaker verification under voice conversion spoofing: the effect of text constraints," in Annual Conference of the International Speech Communication Association (Interspeech), 2013.
  36. Z. Wu, A. Khodabakhsh, C. Demiroglu, and et al., "Sas : A speaker verification spoofing database containing diverse at- tacks," in IEEE International Conference on Acoustics, Speech and Signal, 2015.
  37. T. Kinnunen, M. Sahidullah, H. Delgado, N. E. M. Todisco, and et al., "The asvspoof 2017 challenge: Assessing the limits of replay spoofing attack detection," in Annual Conference of the International Speech Communication Association (Interspeech), 2017.
  38. X. Wang, J. Yamagishi1, M. Todisco1c, and et al., "Asvspoof 2019: A large-scale public database of synthesized, converted and replayed speech," Journal of Computer Speech and Language, vol. 64, 2020.
  39. G. Lavrentyeva1, S. Novoselov1, M. Volkova, and et al., "Phone- spoof: A new dataset for spoofing attack detection in telephone channel," in IEEE International Conference on Acoustics, Speech and Signal, 2019.
  40. L. Zhang, X. Wang, E. Cooper, J. Yamagishi, and N. Evans, "An initial investigation for detecting partially spoofed audio," in Annual Conference of the International Speech Communication Association (Interspeech), 2021.
  41. R. Reimao and V. Tzerpos, "For: A dataset for synthetic speech detection," in 2019 International Conference on Speech Technology and Human-Computer Dialogue (SpeD), 2019, pp. 1-10.
  42. J. C. Frank and L. Sch önherr, "Wavefake: A data set to facilitate audio deepfake detection," ArXiv, vol. abs/2111.02813, 2021. · arXiv
  43. Z. Zhang, Y. Gu, X. Yi, and X. Zhao, "Fmfcc-a: A challenging mandarin dataset for synthetic speech detection," in International Workshop on Digital Watermarking, 2021.
  44. N. M üller, P. Czempin, F. Dieckmann, A. Froghyar, and K. Bttinger, "Does audio deepfake detection generalize?" in arxiv.org/abs/2203.16263v3, 2022. · arXiv
  45. M. Sahidullah, T. Kinnunen, and C. Hanilc ¸i, "A comparison of features for synthetic speech detection," in Proc. of INTER- SPEECH, 2015.
  46. R. K. Das, J. Yang, and H. Li, "Long range acoustic and deep features perspective on asvspoof 2019," 2019 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), pp. 1018- 1025, 2019.
  47. X. Wang and J. Yamagishi, "Investigating self-supervised front ends for speech spoofing countermeasures," in The Speaker and Language Recognition Workshop, 2021.
  48. N. Zeghidour, O. Teboul, F. Quitry, and M. Tagliasacchi, "Leaf: A learnable frontend for audio classification," in ICLR, 2021.
  49. X. Xiao, X. Tian, S. Du, H. Xu, and H. Li, "Spoofing speech detection using high dimensional magnitude and phase features: the ntu approach for asvspoof 2015 challenge." in Interspeech, 2015.
  50. X. Tian, Z. Wu, X. Xiong, E. S. Chng, and H. Li, "Spoofing de- tection from a feature representation perspective," in 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2016.
  51. M. Todisco, H. Delgado, K.-A. Lee, M. Sahidullah, N. W. D. Evans, T. H. Kinnunen, and J. Yamagishi, "Integrated presenta- tion attack detection and automatic speaker verification: Com- mon features and gaussian back-end fusion," in Interspeech, 2018.
  52. L. Chen, W. Guo, and L. Dai, "Speaker verification against synthetic speech," 2010 7th International Symposium on Chinese Spoken Language Processing, pp. 309-312, 2010.
  53. S. Novoselov, A. Kozlov, G. Lavrentyeva, K. Simonchik, and V. Shchemelinin, "Stc anti-spoofing systems for the asvspoof 2015 challenge," in 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2016.
  54. S. Chakroborty, A. Roy, and G. Saha, "Improved closed set text-independent speaker identification by combining mfcc with evidence from flipped filter banks," World Academy of Science, Engineering and Technology, International Journal of Electrical, Com- puter, Energetic, Electronic and Communication Engineering, vol. 2, pp. 2554-2561, 2008.
  55. J. Yang, K. D. Rohan, and H. Li, "Significance of subband features for synthetic speech detection," IEEE transactions on information forensics and security, vol. 15, pp. 2160-2170, 2020.
  56. Z. Wu, X. Xiong, E. S. Chng, and H. Li, "Synthetic speech detec- tion using temporal modulation feature," in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2013.
  57. Z. Wu, P. L. De Leon, C. Demiroglu, A. Khodabakhsh, S. King, Z.-H. Ling, D. Saito, B. Stewart, T. Toda, M. Wester, and J. Yam- agishi, "Anti-spoofing for text-independent speaker verification: An initial database, comparison of countermeasures, and human performance," IEEE/ACM Transactions on Audio, Speech, and Lan- guage Processing, vol. 24, no. 4, pp. 768-783, 2016.
  58. E. S. C. Zhizheng Wu and H. Li, "Detecting converted speech and natural speech for anti-spoofing attack in speaker recognition," in Interspeech, 2012.
  59. J. Sanchez, I. Saratxaga, I. Hernaez, E. Navas, D. Erro, and T. Raitio, "Toward a universal synthetic speech spoofing detec- tion using phase information," IEEE Transactions on Information Forensics & Security, vol. 10, no. 4, pp. 810-820, 2015.
  60. T. Ojala, M. Pietikäinen, and T. Mäenpää, "Multiresolution gray- scale and rotation invariant texture classification with local bi- nary patterns," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, pp. 971-987, 2002.
  61. G. Zhao and M. Pietikäinen, "Dynamic texture recognition using local binary patterns with an application to facial expressions," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 29, pp. 915-928, 2007.
  62. F. Alegre, R. Vipperla, A. Amehraye, and N. W. D. Evans, "A new speaker verification spoofing countermeasure based on local binary patterns," in Interspeech, 2013.
  63. F. Alegre, A. Amehraye, and N. W. D. Evans, "A one-class classification approach to generalised speaker verification spoof- ing countermeasures using local binary patterns," 2013 IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS), pp. 1-8, 2013.
  64. X. Cheng, M. Xu, and T. F. Zheng, "Replay detection using cqt- based modified group delay feature and resnewt network in asvspoof 2019," in 2019 Asia-Pacific Signal and Information Pro- cessing Association Annual Summit and Conference (APSIPA ASC), 2019.
  65. M. Todisco, H. Delgado, and N. Evans, "A new feature for automatic speaker verification antispoofing: Constant q cepstral coefficients," in Processings of Odyssey 2016, 2016.
  66. G. Lavrentyeva, S. Novoselov, E. Malykh, A. Kozlov, and V. Shchemelinin, "Audio replay attack detection with deep learn- ing frameworks," in Interspeech 2017, 2017.
  67. H. Tak, J. Patino, A. Nautsch, N. Evans, and M. Todisco, "An explainability study of the constant q cepstral coefficient spoofing countermeasure for automatic speaker verification," in Odyssey 2020 The Speaker and Language Recognition Workshop, 2020.
  68. B. Chettri, D. Stoller, V. Morfi, M. Ramírez, and B. L. Sturm, "Ensemble models for spoofing detection in automatic speaker verification," in Interspeech, 2019.
  69. G. Lavrentyeva, S. Novoselov, A. Tseren, M. Volkova, A. Gor- lanov, and A. Kozlov, "Stc antispoofing systems for the asvspoof2019 challenge," in Interspeech, 2019.
  70. R. K. Das, J. Yang, and H. Li, "Assessing the scope of generalized countermeasures for anti-spoofing," in IEEE International Con- ference on Acoustics, Speech, and Signal Processing (ICASSP) 2020, 2020.
  71. J. Yang and R. K. Das, "Long-term high frequency features for synthetic speech detection," Digital Signal Processing, vol. 97, p. 102622, 2019.
  72. T. B. Patel and H. Patil, "Combining evidences from mel cepstral, cochlear filter cepstral and instantaneous frequency features for detection of natural vs. spoofed speech," in Conference of Interna- tional Speech Communication Association, 2015.
  73. T. K. A and H. L. B, "An overview of text-independent speaker recognition: From features to supervectors," Speech Communica- tion, vol. 52, no. 1, pp. 12-40, 2010.
  74. P. Leon, B. Stewart, and J. Yamagishi, "Synthetic speech dis- crimination using pitch pattern statistics derived from image analysis," in Interspeech, 2012.
  75. M. Pal, D. Paul, and G. Saha, "Synthetic speech detection using fundamental frequency variation and spectral features," Com- puter Speech & Language, vol. 48, pp. 31-50, 2018.
  76. J. Xue, C. Fan, Z. Lv, J. Tao, J. Yi, C. Zheng, Z. Wen, M. Yuan, and S. Shao, "Audio deepfake detection based on a combination of F0 information and real plus imaginary spectrogram features," in DDAM@MM 2022: Proceedings of the 1st International Workshop on Deepfake Detection for Audio Multimedia, Lisboa, Portugal, 14 October 2022. ACM, 2022, pp. 19-26.
  77. C. Wang, J. Yi, J. Tao, C. Zhang, S. Zhang, and X. Chen, "Detection of cross-dataset fake audio based on prosodic and pronunciation features," in Interspeech, 2023.
  78. W.-N. Hsu, B. Bolte, Y.-H. H. Tsai, K. Lakhotia, R. Salakhutdinov, and A. Mohamed, "Hubert: Self-supervised speech representa- tion learning by masked prediction of hidden units," IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 29, pp. 3451-3460, 2021.
  79. Y. Hong, Z. H. Tan, Z. Ma, and J. Guo, "Dnn filter bank cepstral coefficients for spoofing detection," IEEE Access, vol. 5, no. 99, pp. 4779-4787, 2017.
  80. H. B. Sailor, D. M. Agrawal, and H. A. Patil, "Unsupervised filter- bank learning using convolutional restricted boltzmann machine for environmental sound classification," in Interspeech, 2017.
  81. K. W. Cheuk, H. Anderson, K. Agres, and D. Herremans, "nnau- dio: An on-the-fly gpu audio to spectrogram conversion toolbox using 1d convolutional neural networks," IEEE Access, vol. PP, no. 99, pp. 1-1, 2020.
  82. T. N. Sainath, B. Kingsbury, A. rahman Mohamed, and B. Ram- abhadran, "Learning filter banks within a deep neural network framework," 2013 IEEE Workshop on Automatic Speech Recognition and Understanding, pp. 297-302, 2013.
  83. Q. Fu, Z. Teng, J. White, M. G. Powell, and D. C. Schmidt, "Fas- taudio: A learnable audio front-end for spoof speech detection," ICASSP 2022 -2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 3693-3697, 2021.
  84. T. Zhang and J. Wu, "Discriminative frequency filter banks learn- ing with neural networks," EURASIP Journal on Audio, Speech, and Music Processing, vol. 2019, pp. 1-16, 2019.
  85. N. Zeghidour, N. Usunier, I. Kokkinos, T. Schatz, G. Synnaeve, and E. Dupoux, "Learning filterbanks from raw speech for phone recognition," 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 5509-5513, 2018.
  86. J. Andén and S. Mallat, "Deep scattering spectrum," IEEE Trans- actions on Signal Processing, vol. 62, pp. 4114-4128, 2013.
  87. M. Ravanelli and Y. Bengio, "Speaker recognition from raw waveform with sincnet," 2018 IEEE Spoken Language Technology Workshop (SLT), pp. 1021-1028, 2018.
  88. P.-G. Noé, T. Parcollet, and M. Morchid, "Cgcnn: Complex gabor convolutional neural network on raw speech," ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 7724-7728, 2020.
  89. H. Tak, J. Patino, M. Todisco, A. Nautsch, N. W. D. Evans, and A. Larcher, "End-to-end anti-spoofing with rawnet2," ICASSP 2021 -2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 6369-6373, 2021.
  90. A. Tomilov, A. F. Svishchev, M. Volkova, A. Chirkovskiy, A. S. Kondratev, and G. Lavrentyeva, "Stc antispoofing systems for the asvspoof2021 challenge," 2021 Edition of the Automatic Speaker Verification and Spoofing Countermeasures Challenge, 2021.
  91. N. Chen, Y. Qian, H. Dinkel, B. Chen, and K. Yu, "Robust deep feature for spoofing detection -the sjtu system for asvspoof 2015 challenge," in Interspeech, 2015.
  92. Y. Qian, N. Chen, and K. Yu, "Deep features for automatic spoofing detection," Speech Commun., vol. 85, pp. 43-52, 2016.
  93. A. G. Alanís, A. M. Peinado, J. A. González, and A. M. G ómez, "A light convolutional gru-rnn deep feature extractor for asv spoofing detection," in Interspeech, 2019.
  94. T.-P. Doan, L. Nguyen-Vu, S. Jung, and K. Hong, "Bts-e: Au- dio deepfake detection using breathing-talking-silence encoder," ICASSP 2023 -2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2023.
  95. E. Conti, D. Salvi, C. Borrelli, B. Hosler, P. Bestagini, F. Antonacci, A. Sarti, M. C. Stamm, and S. Tubaro, "Deepfake speech detection through emotion recognition: A semantic approach," in IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2022, Virtual and Singapore, 23-27 May 2022. IEEE, 2022, pp. 8962-8966.
  96. J.-Y. Pan, S. Nie, H. Zhang, S. He, K. Zhang, S. Liang, X. Zhang, and J. Tao, "Speaker recognition-assisted robust audio deepfake detection," in INTERSPEECH, 2022.
  97. X. Wang and J. Yamagishi, "Investigating self-supervised front ends for speech spoofing countermeasures," in The Speaker and Language Recognition Workshop, 2021.
  98. S. Schneider, A. Baevski, R. Collobert, and M. Auli, "wav2vec: Unsupervised pre-training for speech recognition," in Interspeech, 2019.
  99. A. Baevski, H. Zhou, A. rahman Mohamed, and M. Auli, "wav2vec 2.0: A framework for self-supervised learning of speech representations," ArXiv, vol. abs/2006.11477, 2020. · arXiv
  100. A. Babu, C. Wang, A. Tjandra, K. Lakhotia, Q. Xu, N. Goyal, K. Singh, P. von Platen, Y. Saraf, J. M. Pino, A. Baevski, A. Con- neau, and M. Auli, "Xls-r: Self-supervised cross-lingual speech representation learning at scale," in Interspeech, 2021.
  101. Y. Xie, Z. Zhang, and Y. Yang, "Siamese network with wav2vec feature for spoofing speech detection," in Interspeech, 2021.
  102. H. Tak, M. Todisco, X. Wang, J. weon Jung, J. Yamagishi, and N. W. D. Evans, "Automatic speaker verification spoofing and deepfake detection using wav2vec 2.0 and data augmentation," ArXiv, vol. abs/2202.12233, 2022. · arXiv
  103. J. M. Mart'in-Donas and A. Álvarez, "The vicomtech audio deepfake detection system based on wav2vec2 for the 2022 add challenge," 2022, pp. 9241-9245.
  104. Z. Lv, S. Zhang, K. Tang, and P. Hu, "Fake audio detection based on unsupervised pretraining models," 2022, pp. 9231-9235.
  105. F. Alegre, R. Vipperla, and N. W. D. Evans, "Spoofing counter- measures for the protection of automatic speaker recognition systems against attacks with artificial signals," in Interspeech, 2012.
  106. J. A. V. L ópez, A. Miguel, A. Ortega, and E. L. SOLANO, "Spoofing detection with dnn and one-class svm for the asvspoof 2015 challenge," in Interspeech, 2015.
  107. T. B. Amin, J. S. German, and P. Marziliano, "Detecting voice disguise from speech variability: Analysis of three glottal and vocal tract measures," Journal of the Acoustical Society of America, vol. 134, pp. 4068-4068, 2013.
  108. A. Sizov, E. el Khoury, T. H. Kinnunen, Z. Wu, and S. Marcel, "Joint speaker verification and antispoofing in the $i$ -vector space," IEEE Transactions on Information Forensics and Security, vol. 10, pp. 821-832, 2015.
  109. Z. Ji, Z.-Y. Li, P. Li, M. An, S. Gao, D. Wu, and F. Zhao, "Ensemble learning for countermeasure of audio replay spoofing attack in asvspoof2017," in Interspeech, 2017.
  110. M. Todisco, H. Delgado, and N. Evans, "Constant q cepstral coefficients: A spoofing countermeasure for automatic speaker verification," Computer Speech and Language, vol. 45, pp. 516-535, 2017.
  111. R. Hemavathi and R. Kumaraswamy, "Voice conversion spoofing detection by exploring artifacts estimates," Multimedia Tools and Applications, vol. 80, pp. 23 561 -23 580, 2021.
  112. M. Todisco, X. Wang, V. Vestman, M. Sahidullah, and K. A. Lee, "Asvspoof 2019: Future horizons in spoofed and fake audio detection," in Annual Conference of the International Speech Commu- nication Association (Interspeech), 2019.
  113. H. Zeinali, T. Stafylakis, G. Athanasopoulou, J. Rohdin, and I. G. et al., "Detecting spoofing attacks using vgg and sincnet: But- omilia submission to asvspoof 2019 challenge," in Interspeech, 2019.
  114. M. F. Alzantot, Z. Wang, and M. B. Srivastava, "Deep residual neural networks for audio spoofing detection," in Interspeech, 2019.
  115. T. Chen, E. el Khoury, K. Phatak, and G. Sivaraman, "Pindrop labs' submission to the asvspoof 2021 challenge," 2021 Edition of the Automatic Speaker Verification and Spoofing Countermeasures Challenge, 2021.
  116. P. Parasu, J. Epps, K. Sriskandaraja, and G. Suthokumar, "In- vestigating light-resnet architecture for spoofing detection under mismatched conditions," in Interspeech, 2020.
  117. C.-I. Lai, A. Abad, K. Richmond, J. Yamagishi, N. Dehak, and S. King, "Attentive filtering networks for audio replay attack detection," ICASSP 2019 -2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 6316-6320, 2018.
  118. X. Li, N. Li, C. Weng, X. Liu, D. Su, D. Yu, and H. M. Meng, "Re- play and synthetic speech detection with res2net architecture," ICASSP 2021 -2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 6354-6358, 2021.
  119. J. Kim and S. M. Ban, "Phase-aware spoof speech detection based on res2net with phase network," ICASSP 2023 -2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2023.
  120. J. Hu, L. Shen, S. Albanie, G. Sun, and E. Wu, "Squeeze-and- excitation networks," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 42, pp. 2011-2023, 2017.
  121. Y. Zhang, W. Wang, and P. Zhang, "The effect of silence and dual- band fusion in anti-spoofing system," in Interspeech, 2021.
  122. H. Tak, J. weon Jung, J. Patino, M. Todisco, and N. W. D. Evans, "Graph attention networks for anti-spoofing," in Interspeech, 2021.
  123. W. Ge, M. Panariello, J. Patino, M. Todisco, and N. W. D. Evans, "Partially-connected differentiable architecture search for deep- fake and spoofing detection," in Interspeech, 2021.
  124. A. Chintha, B. Thai, S. J. Sohrawardi, K. Bhatt, A. Hickerson, M. K. Wright, and R. W. Ptucha, "Recurrent convolutional struc- tures for audio spoof and video deepfake detection," IEEE Journal of Selected Topics in Signal Processing, vol. 14, pp. 1024-1037, 2020.
  125. J. H. L. Hansen and Z. Wang, "Audio anti-spoofing using sim- ple attention module and joint optimization based on additive angular margin loss and meta-learning," Interspeech, 2022.
  126. C. Wang, J. Yi, J. Tao, C. Zhang, S. Zhang, R. Fu, and X. Chen, "To-rawnet: Improving rawnet with tcn and orthogonal regular- ization for fake audio detection," in Interspeech, 2023.
  127. H. Tak, J. weon Jung, J. Patino, M. R. Kamble, M. Todisco, and N. W. D. Evans, "End-to-end spectro-temporal graph attention networks for speaker verification anti-spoofing and speech deep- fake detection," ArXiv, vol. abs/2107.12710, 2021. · arXiv
  128. J. weon Jung, H.-S. Heo, H. Tak, H. jin Shim, J. S. Chung, B.-J. Lee, H. jin Yu, and N. W. D. Evans, "Aasist: Audio anti-spoofing using integrated spectro-temporal graph attention networks," ICASSP 2022 -2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 6367-6371, 2022.
  129. W. Ge, J. Patino, M. Todisco, and N. W. D. Evans, "Raw dif- ferentiable architecture search for speech deepfake and spoofing detection," 2021 Edition of the Automatic Speaker Verification and Spoofing Countermeasures Challenge, 2021.
  130. X. Liu, M. Liu, L. Wang, K.-A. Lee, H. Zhang, and J. Dang, "Leveraging positional-related local-global dependency for syn- thetic speech detection," ICASSP 2023 -2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2023.
  131. Y. Rodríguez-Ortega, L. DoraMaríaBallesteros, and D. Renza, "A machine learning model to detect fake voice," in International Conference on Applied Informatics, 2020.
  132. A. K. Singh and P. Singh, "Detection of ai-synthesized speech using cepstral & bispectral statistics," 2021 IEEE 4th Interna- tional Conference on Multimedia Information Processing and Retrieval (MIPR), pp. 412-417, 2021.
  133. S. Prince, P. Li, Y. Fu, U. Mohammed, and J. H. Elder, "Prob- abilistic models for inference about identity," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 34, pp. 144-157, 2012.
  134. R. Rahmeni, A. B. Aicha, and Y. B. Ayed, "Speech spoofing detection using svm and elm technique with acoustic features," 2020 5th International Conference on Advanced Technologies for Signal and Image Processing (ATSIP), pp. 1-4, 2020.
  135. C.-C. Chang and C.-J. Lin, "Libsvm: A library for support vector machines," ACM Trans. Intell. Syst. Technol., vol. 2, pp. 27:1-27:27, 2011.
  136. D. A. Reynolds and R. C. Rose, "Robust text-independent speaker identification using gaussian mixture speaker models," IEEE Trans. Speech Audio Process., vol. 3, pp. 72-83, 1995.
  137. C. Hanilc ¸i, T. H. Kinnunen, M. Sahidullah, and A. Sizov, "Classi- fiers for synthetic speech detection: a comparison," in Interspeech, 2015.
  138. Z. Wu, C. E. Siong, and H. Li, "Detecting converted speech and natural speech for anti-spoofing attack in speaker recognition," in Interspeech, 2012.
  139. A. Godoy, F. O. Sim ões, J. A. Stuchi, M. de Assis Angeloni, M. Uliani, and R. P. V. Violato, "Using deep learning for detecting spoofing attacks on speech signals," ArXiv, vol. abs/1508.01746, 2015. · arXiv
  140. X. Wu, R. He, Z. Sun, and T. Tan, "A light cnn for deep face representation with noisy labels," IEEE Transactions on Information Forensics and Security, vol. 13, no. 11, pp. 2884-2896, 2018.
  141. K. He, X. Zhang, S. Ren, and J. Sun, "Deep residual learning for image recognition," 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770-778, 2015.
  142. R. Yan, C. Wen, S. Zhou, T. Guo, W. Zou, and X. Li, "Audio deepfake detection system with neural stitching for add 2022," ICASSP 2022 -2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 9226-9230, 2022.
  143. I.-Y. Kwak, S. Kwag, J. Lee, J. H. Huh, C.-H. Lee, Y. B. Jeon, J.- H. Hwang, and J. W. Yoon, "Resmax: Detecting voice spoofing attacks with residual network and max feature map," 2020 25th International Conference on Pattern Recognition (ICPR), pp. 4837- 4844, 2021.
  144. H. Wu, H.-C. Kuo, N. Zheng, K.-H. Hung, H. yi Lee, Y. Tsao, H.-M. Wang, and H. M. Meng, "Partially fake audio detection by self-attention-based fake span discovery," ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 9236-9240, 2022.
  145. J. Xue, C. Fan, J. Yi, C. Wang, Z. Wen, D. Zhang, and Z. Lv, "Learn- ing from yourself: A self-distillation method for fake speech detection," ICASSP 2023 -2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2023.
  146. F. Scarselli, M. Gori, A. C. Tsoi, M. Hagenbuchner, and G. Mon- fardini, "The graph neural network model," IEEE Transactions on Neural Networks, vol. 20, pp. 61-80, 2009.
  147. F. Chen, S. Deng, T. Zheng, Y. He, and J. Han, "Graph-based spectro-temporal dependency modeling for anti-spoofing," ICASSP 2023 -2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2023.
  148. H. Liu, K. Simonyan, and Y. Yang, "Darts: Differentiable architec- ture search," in ICML, 2019.
  149. C. Wang, J. Yi, J. Tao, H. Sun, X. Chen, Z. Tian, H. Ma, C. Fan, and R. Fu, "Fully automated end-to-end fake audio detection," Proceedings of the 1st International Workshop on Deepfake Detection for Audio Multimedia, 2022.
  150. Z. Cai, W. Wang, and M. Li, "Waveform boundary detection for partially spoofed audio," ArXiv, vol. abs/2211.00226, 2022. · arXiv
  151. X. Wang and J. Yamagishi, "A comparative study on recent neural spoofing countermeasures for synthetic speech detection," in Interspeech, 2021.
  152. H. Muckenhirn, M. Magimai.-Doss, and S. Marcel, "End-to-end convolutional neural network-based voice presentation attack detection," 2017 IEEE International Joint Conference on Biometrics (IJCB), pp. 335-341, 2017.
  153. H. Dinkel, N. Chen, Y. Qian, and K. Yu, "End-to-end spoofing detection with raw waveform cldnns," 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 4860-4864, 2017.
  154. G. Hua, A. Teoh, and H. Zhang, "Towards end-to-end synthetic speech detection," IEEE Signal Processing Letters, vol. 28, pp. 1265- 1269, 2021.
  155. J. W. Jung, S. B. Kim, H. J. Shim, J. H. Kim, and H. J. Yu, "Improved rawnet with filter-wise rescaling for text-independent speaker verification using raw waveforms," in Proc. of INTER- SPEECH, 2020.
  156. Y. Ma, Z. Ren, and S. Xu, "Rw-resnet: A novel speech anti- spoofing model using raw waveform," Interspeech, 2021.
  157. A. Nautsch, X. Wang, N. W. D. Evans, T. H. Kinnunen, V. Vest- man, M. Todisco, H. Delgado, M. Sahidullah, J. Yamagishi, and K.-A. Lee, "Asvspoof 2019: Spoofing countermeasures for the detection of synthesized, converted and replayed speech," IEEE Transactions on Biometrics, Behavior, and Identity Science, vol. 3, pp. 252-265, 2021.
  158. X. Liu, X. Wang, M. Sahidullah, J. Patino, H. Delgado, T. H. Kinnunen, M. Todisco, J. Yamagishi, N. W. D. Evans, A. Nautsch, and K.-A. Lee, "Asvspoof 2021: Towards spoofed and deepfake speech detection in the wild," IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 31, pp. 2507-2522, 2022.
  159. H. Tak, M. R. Kamble, J. Patino, M. Todisco, and N. W. D. Evans, "Rawboost: A raw data boosting and augmentation method applied to automatic speaker verification anti-spoofing," ICASSP 2022 -2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 6382-6386, 2022.
  160. P. Korshunov and S. Marcel, "Cross-database evaluation of audio-based spoofing detection systems," in Interspeech, 2016.
  161. N. M. M üller, P. Czempin, F. Dieckmann, A. Froghyar, and K. B öttinger, "Does audio deepfake detection generalize?" in Interspeech, 2022.
  162. T. Chen, A. Kumar, P. Nagarsheth, G. Sivaraman, and E. el Khoury, "Generalization of audio deepfake detection," in The Speaker and Language Recognition Workshop, 2020.
  163. Y. Zhang, F. Jiang, and Z. Duan, "One-class learning towards synthetic voice spoofing detection," IEEE Signal Processing Letters, vol. 28, pp. 937-941, 2020.
  164. S. Ding, Y. Zhang, and Z. Duan, "Samo: Speaker attractor multi- center one-class learning for voice anti-spoofing," ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2023.
  165. H. Ma, J. Yi, J. Tao, Y. Bai, Z. Tian, and C. Wang, "Continual learning for fake audio detection," in Proc. of INTERSPEECH, 2021.
  166. X. Zhang, J. Yi, J. Tao, C. Wang, and C. Zhang, "Do you remember? overcoming catastrophic forgetting for fake audio detection," in Proceedings of the 40-th International Conference on Machine Learning (ICML), 2023.
  167. K. Kasi and S. A. Zahorian, "Yet another algorithm for pitch tracking," in 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2002, pp. I-361-I-364.

Cited by

Sorted by citations

Authors
Yi, J., Wang, C., Tao, J., Zhang, X., Zhang, C. Y., & Zhao, Y.
ORCID
Venue
arXiv
Publisher
arXiv
Published
2023
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2308.14970
arXiv
2308.14970
OpenAlex
W4386302282
Cited by
40
References
0
Citations by year
2026: 5 · 2025: 13 · 2024: 21 · 2023: 1
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
  • Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
Keywords
audio deepfake detection, deepfake audio, anti-spoofing, ASVspoof 2021, interpretability

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review