CoChat
Sign Up
PreprintCited by 2Speech Recognition and SynthesisDigital Media Forensic DetectionSpeech and Audio Processing

The DOI matches its DataCite record; 1 of the 1 references it cites were found in a registry or an index.

VoiceWukong: Benchmarking Deepfake Voice Detection

Open access
Yan, Ziwei, Zhao, Yanjie, Wang, Haoyu·2024·arXiv
DOI 10.48550/arxiv.2409.06348arXiv 2409.06348
Open this paper in CoChat — free accountOpen PDF

Abstract

With the rapid advancement of technologies like text-to-speech (TTS) and voice conversion (VC), detecting deepfake voices has become increasingly crucial. However, both academia and industry lack a comprehensive and intuitive benchmark for evaluating detectors. Existing datasets are limited in language diversity and lack many manipulations encountered in real-world production environments. To fill this gap, we propose VoiceWukong, a benchmark designed to evaluate the performance of deepfake voice detectors. To build the dataset, we first collected deepfake voices generated by 19 advanced and widely recognized commercial tools and 15 open-source tools. We then created 38 data variants covering six types of manipulations, constructing the evaluation dataset for deepfake voice detection. VoiceWukong thus includes 265,200 English and 148,200 Chinese deepfake voice samples. Using VoiceWukong, we evaluated 12 state-of-the-art detectors. AASIST2 achieved the best equal error rate (EER) of 13.50%, while all others exceeded 20%. Our findings reveal that these detectors face significant challenges in real-world applications, with dramatically declining performance. In addition, we conducted a user study with more than 300 participants. The results are compared with the performance of the 12 detectors and a multimodel large language model (MLLM), i.e., Qwen2-Audio, where different detectors and humans exhibit varying identification capabilities for deepfake voices at different deception levels, while the LALM demonstrates no detection ability at all. Furthermore, we provide a leaderboard for deepfake voice detection, publicly available at {https://voicewukong.github.io}.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2409.06348

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 1 references

Research works printed but not linked: 63

  1. Zhongjie Ba, Qing Wen, Peng Cheng, Yuwei Wang, Feng Lin, Li Lu, and Zhenguang Liu. Transferring au- dio deepfake detection capability across languages. In Proceedings of the ACM Web Conference 2023, WWW '23, page 2033-2044, New York, NY, USA, 2023. Asso- ciation for Computing Machinery.
  2. Hui Bu, Jiayu Du, Xingyu Na, Bengu Wu, and Hao Zheng. Aishell-1: An open-source mandarin speech corpus and a speech recognition baseline. In 2017 20th conference of the oriental chapter of the international coordinating committee on speech databases and speech I/O systems and assessment (O-COCOSDA), pages 1-5. IEEE, 2017.
  3. Lian-Wu Chen, Wu Guo, and Li-Rong Dai. Speaker verification against synthetic speech. In 2010 7th In- ternational Symposium on Chinese Spoken Language Processing, pages 309-312. IEEE, 2010.
  4. Yujie Chen, Jiangyan Yi, Jun Xue, Chenglong Wang, Xiaohui Zhang, Shunbo Dong, Siding Zeng, Jianhua Tao, Lv Zhao, and Cunhang Fan. Rawbmamba: End-to- end bidirectional state space model for audio deepfake detection. arXiv preprint arXiv:2406.06086, 2024. · arXiv
  5. Xingliang Cheng, Mingxing Xu, and Thomas Fang Zheng. Replay detection using cqt-based modified group delay feature and resnewt network in asvspoof 2019. In 2019 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), pages 540-545. IEEE, 2019.
  6. Ha-Yeong Choi, Sang-Hoon Lee, and Seong-Whan Lee. Dddm-vc: Decoupled denoising diffusion models with disentangled representation and prior mixup for verified robust voice conversion. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 38, pages 17862-17870, 2024.
  7. Yunfei Chu, Jin Xu, Qian Yang, Haojie Wei, Xipin Wei, Zhifang Guo, Yichong Leng, Yuanjun Lv, Jinzheng He, Junyang Lin, et al. Qwen2-audio technical report. arXiv preprint arXiv:2407.10759, 2024. · arXiv
  8. Emanuele Conti, Davide Salvi, Clara Borrelli, Brian Hosler, Paolo Bestagini, Fabio Antonacci, Augusto Sarti, Matthew C Stamm, and Stefano Tubaro. Deepfake speech detection through emotion recognition: a seman- tic approach. In ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 8962-8966. IEEE, 2022.
  9. Phillip L De Leon, Bryan Stewart, and Junichi Yamag- ishi. Synthetic speech discrimination using pitch pattern statistics derived from image analysis. In Proc. Inter- speech: Portland, Oregon, USE. 2012.
  10. Jingyi Deng, Chenhao Lin, Pengbin Hu, Chao Shen, Qian Wang, Qi Li, and Qiming Li. Towards benchmark- ing and evaluating deepfake detection. IEEE Trans- actions on Dependable and Secure Computing, pages 1-16, 2024.
  11. Siwen Ding, You Zhang, and Zhiyao Duan. Samo: Speaker attractor multi-center one-class learning for voice anti-spoofing. In ICASSP 2023-2023 IEEE In- ternational Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 1-5. IEEE, 2023.
  12. Thien-Phuc Doan, Long Nguyen-Vu, Souhwan Jung, and Kihun Hong. Bts-e: Audio deepfake detection using breathing-talking-silence encoder. In ICASSP 2023-2023 IEEE International Conference on Acous- tics, Speech and Signal Processing (ICASSP), pages 1-5. IEEE, 2023.
  13. Jonathan Driedger and Meinard Müller. A review of time-scale modification of music signals. Applied Sci- ences, 6(2):57, 2016.
  14. Joel Frank and Lea Schönherr. Wavefake: A data set to facilitate audio deepfake detection. arXiv preprint arXiv:2111.02813, 2021. · arXiv
  15. Yihui Fu, Luyao Cheng, Shubo Lv, Yukai Jv, Yuxi- ang Kong, Zhuo Chen, Yanxin Hu, Lei Xie, Jian Wu, Hui Bu, et al. Aishell-4: An open source dataset for speech enhancement, separation, recognition and speaker diarization in conference scenario. arXiv preprint arXiv:2104.03603, 2021. · arXiv
  16. Shang-Hua Gao, Ming-Ming Cheng, Kai Zhao, Xin-Yu Zhang, Ming-Hsuan Yang, and Philip Torr. Res2net: A new multi-scale backbone architecture. IEEE trans- actions on pattern analysis and machine intelligence, 43(2):652-662, 2019.
  17. Wanying Ge, Michele Panariello, Jose Patino, Massimil- iano Todisco, and Nicholas Evans. Partially-connected differentiable architecture search for deepfake and spoof- ing detection. arXiv preprint arXiv:2104.03123, 2021. · arXiv
  18. Wanying Ge, Jose Patino, Massimiliano Todisco, and Nicholas Evans. Raw differentiable architecture search for speech deepfake and spoofing detection. arXiv preprint arXiv:2107.12212, 2021. · arXiv
  19. Houjian Guo, Chaoran Liu, Carlos Toshinori Ishi, and Hiroshi Ishiguro. Quickvc: Any-to-many voice conver- sion using inverse short-time fourier transform for faster conversion. arXiv preprint arXiv:2302.08296, 2023. · arXiv
  20. Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 770-778, 2016.
  21. Xinyi Hou, Yanjie Zhao, Yue Liu, Zhou Yang, Kailong Wang, Li Li, Xiapu Luo, David Lo, John Grundy, and Haoyu Wang. Large language models for software engi- neering: A systematic literature review. arXiv preprint arXiv:2308.10620, 2023. · arXiv
  22. Guang Hua, Andrew Beng Jin Teoh, and Haijian Zhang. Towards end-to-end synthetic speech detection. IEEE Signal Processing Letters, 28:1265-1269, 2021.
  23. Jee-weon Jung, Hee-Soo Heo, Hemlata Tak, Hye-jin Shim, Joon Son Chung, Bong-Jin Lee, Ha-Jin Yu, and Nicholas Evans. Aasist: Audio anti-spoofing using in- tegrated spectro-temporal graph attention networks. In ICASSP 2022 -2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 6367-6371, 2022.
  24. Jee-weon Jung, Seung-bin Kim, Hye-jin Shim, Ju-ho Kim, and Ha-Jin Yu. Improved rawnet with feature map scaling for text-independent speaker verification using raw waveforms. Proc. Interspeech, pages 3583-3587, 2020.
  25. Jee-weon Jung, Hemlata Tak, Hye-jin Shim, Hee-Soo Heo, Bong-Jin Lee, Soo-Whan Chung, Ha-Jin Yu, Nicholas Evans, and Tomi Kinnunen. Sasv 2022: The first spoofing-aware speaker verification challenge. arXiv preprint arXiv:2203.14732, 2022. · arXiv
  26. Zahra Khanjani, Gabrielle Watson, and Vandana P Janeja. How deep are the fakes? focusing on audio deepfake: A survey. arXiv preprint arXiv:2111.14203, 2021. · arXiv
  27. Juntae Kim and Sung Min Ban. Phase-aware spoof speech detection based on res2net with phase network. In ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 1-5. IEEE, 2023.
  28. Chuqiao Li, Zhiwu Huang, Danda Pani Paudel, Yabin Wang, Mohamad Shahbazi, Xiaopeng Hong, and Luc Van Gool. A continual deepfake detection benchmark: Dataset, methods, and essentials. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), pages 1339-1349, January 2023.
  29. Hanxiao Liu, Karen Simonyan, and Yiming Yang. Darts: Differentiable architecture search. arXiv preprint arXiv:1806.09055, 2018. · arXiv
  30. Lucian Lupşa-Tȃtaru. Novel technique of customizing the audio fade-out shape. Applied Computer Science, 14(3), 2018.
  31. Lucian Lupşa-Tȃtaru. Implementing the fade-in audio effect for real-time computing. Applied Computer Sci- ence, 15(2), 2019.
  32. Juan M Martín-Doñas and Aitor Álvarez. The vicomtech audio deepfake detection system based on wav2vec2 for the 2022 add challenge. In ICASSP 2022-2022 IEEE In- ternational Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 9241-9245. IEEE, 2022.
  33. Victoria Mingote, Antonio Miguel, Dayana Ribas, Al- fonso Ortega Giménez, and Eduardo Lleida. Optimiza- tion of false acceptance/rejection rates and decision threshold for end-to-end text-dependent speaker veri- fication systems. In INTERSPEECH, pages 2903-2907, 2019.
  34. Nicolas M Müller, Pavel Czempin, Franziska Dieck- mann, Adam Froghyar, and Konstantin Böttinger. Does audio deepfake detection generalize? arXiv preprint arXiv:2203.16263, 2022. · arXiv
  35. Jiahui Pan, Shuai Nie, Hui Zhang, Shulin He, Kanghao Zhang, Shan Liang, Xueliang Zhang, and Jianhua Tao. Speaker recognition-assisted robust audio deepfake de- tection. In Interspeech, pages 4202-4206, 2022.
  36. Yogesh Patel, Sudeep Tanwar, Rajesh Gupta, Pron- aya Bhattacharya, Innocent Ewean Davidson, Royi Nyameko, Srinivas Aluvala, and Vrince Vimal. Deep- fake generation and detection: Case study and chal- lenges. IEEE Access, 2023.
  37. Karol J Piczak. Esc: Dataset for environmental sound classification. In Proceedings of the 23rd ACM inter- national conference on Multimedia, pages 1015-1018, 2015.
  38. Zengyi Qin, Wenliang Zhao, Xumin Yu, and Xin Sun. Openvoice: Versatile instant voice cloning. arXiv preprint arXiv:2312.01479, 2023. · arXiv
  39. Ricardo Reimao and Vassilios Tzerpos. For: A dataset for synthetic speech detection. In 2019 Interna- tional Conference on Speech Technology and Human- Computer Dialogue (SpeD), pages 1-10. IEEE, 2019.
  40. Yao Shi, Hui Bu, Xin Xu, Shaoji Zhang, and Ming Li. Aishell-3: A multi-speaker mandarin tts corpus and the baselines. arXiv preprint arXiv:2010.11567, 2020. · arXiv
  41. Ryosuke Sonobe, Shinnosuke Takamichi, and Hiroshi Saruwatari. Jsut corpus: free large-scale japanese speech corpus for end-to-end speech synthesis. arXiv preprint arXiv:1711.00354, 2017. · arXiv
  42. Chengzhe Sun, Shan Jia, Shuwei Hou, and Siwei Lyu. Ai-synthesized voice detection using neural vocoder artifacts. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 904- 912, 2023.
  43. Hemlata Tak, Jee-weon Jung, Jose Patino, Madhu Kam- ble, Massimiliano Todisco, and Nicholas Evans. End- to-end spectro-temporal graph attention networks for speaker verification anti-spoofing and speech deepfake detection. arXiv preprint arXiv:2107.12710, 2021. · arXiv
  44. Hemlata Tak, Madhu Kamble, Jose Patino, Massimil- iano Todisco, and Nicholas Evans. Rawboost: A raw data boosting and augmentation method applied to au- tomatic speaker verification anti-spoofing. In ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 6382- 6386. IEEE, 2022.
  45. Hemlata Tak, Jose Patino, Massimiliano Todisco, An- dreas Nautsch, Nicholas Evans, and Anthony Larcher. End-to-end anti-spoofing with rawnet2. In ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 6369- 6373. IEEE, 2021.
  46. Hemlata Tak, Massimiliano Todisco, Xin Wang, Jee- weon Jung, Junichi Yamagishi, and Nicholas Evans. Au- tomatic speaker verification spoofing and deepfake de- tection using wav2vec 2.0 and data augmentation. arXiv preprint arXiv:2202.12233, 2022. · arXiv
  47. Xiaohai Tian, Zhizheng Wu, Xiong Xiao, Eng Siong Chng, and Haizhou Li. Spoofing detection from a fea- ture representation perspective. In 2016 IEEE Interna- tional conference on acoustics, speech and signal pro- cessing (ICASSP), pages 2119-2123. IEEE, 2016.
  48. Massimiliano Todisco, Xin Wang, Ville Vestman, Md Sahidullah, Héctor Delgado, Andreas Nautsch, Ju- nichi Yamagishi, Nicholas Evans, Tomi Kinnunen, and Kong Aik Lee. Asvspoof 2019: Future horizons in spoofed and fake audio detection. arXiv preprint arXiv:1904.05441, 2019. · arXiv
  49. Anton Tomilov, Aleksei Svishchev, Marina Volkova, Artem Chirkovskiy, Alexander Kondratev, and Galina Lavrentyeva. Stc antispoofing systems for the asvspoof2021 challenge. In Proc. ASVspoof 2021 Work- shop, pages 61-67, 2021.
  50. Jesús Villalba and Eduardo Lleida. Speaker verification performance degradation against spoofing and tamper- ing attacks. In FALA workshop, pages 131-134, 2010.
  51. Qian Wang, Xiu Lin, Man Zhou, Yanjiao Chen, Cong Wang, Qi Li, and Xiangyang Luo. Voicepop: A pop noise based anti-spoofing system for voice authentica- tion on smartphones. In IEEE INFOCOM 2019-IEEE Conference on Computer Communications, pages 2062- 2070. IEEE, 2019.
  52. Run Wang, Felix Juefei-Xu, Yihao Huang, Qing Guo, Xiaofei Xie, Lei Ma, and Yang Liu. Deepsonar: Towards effective and robust detection of ai-synthesized fake voices. In Proceedings of the 28th ACM International Conference on Multimedia, MM '20, page 1207-1216, New York, NY, USA, 2020. Association for Computing Machinery.
  53. Xin Wang and Junich Yamagishi. A comparative study on recent neural spoofing countermeasures for synthetic speech detection. arXiv preprint arXiv:2103.11326, 2021. · arXiv
  54. Zhenyu Wang and John HL Hansen. Audio anti- spoofing using a simple attention module and joint op- timization based on additive angular margin loss and meta-learning. arXiv preprint arXiv:2211.09898, 2022. · arXiv
  55. Thomas Wilmering, David Moffat, Alessia Milo, and Mark B Sandler. A history of audio effects. Applied Sciences, 10(3):791, 2020.
  56. Haolin Wu, Jing Chen, Ruiying Du, Cong Wu, Kun He, Xingcan Shang, Hao Ren, and Guowen Xu. Clad: Robust audio deepfake detection against manipula- tion attacks with contrastive learning. arXiv preprint arXiv:2404.15854, 2024. · arXiv
  57. Junichi Yamagishi, Xin Wang, Massimiliano Todisco, Md Sahidullah, Jose Patino, Andreas Nautsch, Xuechen Liu, Kong Aik Lee, Tomi Kinnunen, Nicholas Evans, et al. Asvspoof 2021: accelerating progress in spoofed and deepfake speech detection. In ASVspoof 2021 Workshop-Automatic Speaker Verification and Spoofing Coutermeasures Challenge, 2021.
  58. Jiangyan Yi, Ruibo Fu, Jianhua Tao, Shuai Nie, Haoxin Ma, Chenglong Wang, Tao Wang, Zhengkun Tian, Ye Bai, Cunhang Fan, et al. Add 2022: the first au- dio deep synthesis detection challenge. In ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 9216- 9220. IEEE, 2022.
  59. Jiangyan Yi, Jianhua Tao, Ruibo Fu, Xinrui Yan, Cheng- long Wang, Tao Wang, Chu Yuan Zhang, Xiaohui Zhang, Yan Zhao, Yong Ren, et al. Add 2023: the second audio deepfake detection challenge. arXiv preprint arXiv:2305.13774, 2023. · arXiv
  60. Jiangyan Yi, Chenglong Wang, Jianhua Tao, Xiaohui Zhang, Chu Yuan Zhang, and Yan Zhao. Audio deepfake detection: A survey. arXiv preprint arXiv:2308.14970, 2023. · arXiv
  61. XiaoHui Zhang, Jiangyan Yi, Chenglong Wang, Chu Yuan Zhang, Siding Zeng, and Jianhua Tao. What to remember: Self-adaptive continual learning for au- dio deepfake detection. Proceedings of the AAAI Con- ference on Artificial Intelligence, 38(17):19569-19577, Mar. 2024.
  62. You Zhang, Fei Jiang, and Zhiyao Duan. One-class learning towards synthetic voice spoofing detection. IEEE Signal Processing Letters, 28:937-941, 2021.
  63. Ziqiang Zhang, Long Zhou, Chengyi Wang, Sanyuan Chen, Yu Wu, Shujie Liu, Zhuo Chen, Yanqing Liu, Huaming Wang, Jinyu Li, et al. Speak foreign lan- guages with your own voice: Cross-lingual neural codec language modeling. arXiv preprint arXiv:2303.03926, 2023. · arXiv

Cited by

Sorted by citations

Metadata

Authors
Yan, Z., Zhao, Y., & Wang, H.
Affiliations
Huazhong University of Science and Technology (CN)
Venue
arXiv
Publisher
arXiv
Published
2024
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2409.06348
arXiv
2409.06348
OpenAlex
W4403623444
Cited by
1
References
1
Citations by year
2025: 1
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
  • Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
Keywords
benchmark dataset, voice manipulation, text-to-speech, voice conversion, user study, multimodal large language models

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review