Towards Robust Audio Deepfake Detection: A Evolving Benchmark for Continual Learning
Open accessAbstract
The rise of advanced large language models such as GPT-4, GPT-4o, and the Claude family has made fake audio detection increasingly challenging. Traditional fine-tuning methods struggle to keep pace with the evolving landscape of synthetic speech, necessitating continual learning approaches that can adapt to new audio while retaining the ability to detect older types. Continual learning, which acts as an effective tool for detecting newly emerged deepfake audio while maintaining performance on older types, lacks a well-constructed and user-friendly evaluation framework. To address this gap, we introduce EVDA, a benchmark for evaluating continual learning methods in deepfake audio detection. EVDA includes classic datasets from the Anti-Spoofing Voice series, Chinese fake audio detection series, and newly generated deepfake audio from models like GPT-4 and GPT-4o. It supports various continual learning techniques, such as Elastic Weight Consolidation (EWC), Learning without Forgetting (LwF), and recent methods like Regularized Adaptive Weight Modification (RAWM) and Radian Weight Modification (RWM). Additionally, EVDA facilitates the development of robust algorithms by providing an open interface for integrating new continual learning methods
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The results show that replay-based and architectural methods consistently outperform baseline approaches in maintaining low EER and adapting to new tasks, demonstrating the benchmark's utility for advancing robust and adaptive audio deepfake detection.
“The results show that replay-based and architectural methods consistently outperform baseline approaches in maintaining low EER and adapting to new tasks, demonstrating the benchmark’s utility for advancing robust and adaptive audio deepfake detection.”
From Deepfake Media Forensics: Status and Future Challenges (2025) · cites this paper as [73]
Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Experimental — accuracy not yet measuredThe EVDA benchmark is designed to evaluate various continual learning methods for audio deepfake detection across diverse datasets and conditions.
“The authors of [73] introduced the EVDA benchmark, designed to evaluate various continual learning methods for audio deepfake detection across diverse datasets and conditions.”
From Deepfake Media Forensics: Status and Future Challenges (2025) · cites this paper as [73]
The EVDA benchmark is designed specifically to evaluate continual learning methods for audio deepfake detection.
“Furthermore, Zhang et al. [163] proposed the EVolving synthetic and Deepfake Audio detection (EVDA) benchmark, designed specifically to evaluate continual learning methods for audio deepfake detection.”
From Audio Deepfake Detection: What Has Been Achieved and What Lies Ahead (2025) · cites this paper as [163]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
The citation lists haven’t been fetched yet
Research works printed but not linked: 22
- James Kirkpatrick, Razvan Pascanu, Neil Rabinowitz, Joel Veness, Guillaume Desjardins, Andrei A Rusu, Kieran Milan, John Quan, Tiago Ramalho, Agnieszka Grabska-Barwinska, et al. Overcoming catastrophic forgetting in neural networks. Proceedings of the national academy of sciences, 114(13):3521-3526, 2017.
- Zhizhong Li and Derek Hoiem. Learning without forgetting. IEEE transactions on pattern analysis and machine intelligence, 40(12):2935-2947, 2017.
- Xuechen Liu, Xin Wang, Md Sahidullah, Jose Patino, Héctor Delgado, Tomi Kinnunen, Massimiliano Todisco, Junichi Yamagishi, Nicholas Evans, Andreas Nautsch, and Kong Aik Lee. Asvspoof 2021: Towards spoofed and deepfake speech detection in the wild. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 31:2507-2522, 2023. doi: 10.1109/TASLP.2023.3285283. · DOI · Paper page
- Haoxin Ma, Jiangyan Yi, Jianhua Tao, Ye Bai, Zhengkun Tian, and Chenglong Wang. Continual learning for fake audio detection. arXiv preprint arXiv:2104.07286, 2021. · arXiv
- Davide Maltoni and Vincenzo Lomonaco. Continuous learning in single-incremental-task sce- narios. Neural Networks, 116:56-73, 2019. doi: 10.1016/J.NEUNET.2019.03.010. URL https://doi.org/10.1016/j.neunet.2019.03.010. · DOI · Paper page
- Nicolas M Müller, Pavel Czempin, Franziska Dieckmann, Adam Froghyar, and Konstantin Böttinger. Does audio deepfake detection generalize? arXiv preprint arXiv:2203.16263, 2022. · arXiv
- OpenAI. GPT-4 technical report. CoRR, abs/2303.08774, 2023. doi: 10.48550/ARXIV.2303.08774. URL https://doi.org/10.48550/arXiv.2303.08774. · DOI · Paper page
- Ameya Prabhu, Philip H. S. Torr, and Puneet K. Dokania. Gdumb: A simple approach that ques- tions our progress in continual learning. In Andrea Vedaldi, Horst Bischof, Thomas Brox, and Jan-Michael Frahm (eds.), Computer Vision -ECCV 2020 -16th European Conference, Glas- gow, UK, August 23-28, 2020, Proceedings, Part II, volume 12347 of Lecture Notes in Com- puter Science, pp. 524-540. Springer, 2020. doi: 10.1007/978-3-030-58536-5\ 31. URL https://doi.org/10.1007/978-3-030-58536-5_31. · DOI
- Sylvestre-Alvise Rebuffi, Alexander Kolesnikov, Georg Sperl, and Christoph H. Lampert. icarl: Incremental classifier and representation learning. In 2017 IEEE Conference on Computer Vision and Pattern Recog- nition, CVPR 2017, Honolulu, HI, USA, July 21-26, 2017, pp. 5533-5542. IEEE Computer Society, 2017. doi: 10.1109/CVPR.2017.587. URL https://doi.org/10.1109/CVPR.2017.587. · DOI · Paper page
- Ricardo Reimao and Vassilios Tzerpos. For: A dataset for synthetic speech detection. In Corneliu Burileanu and Horia-Nicolai Teodorescu (eds.), 2019 International Conference on Speech Technology and Human- Computer Dialogue, SpeD 2019, Timisoara, Romania, October 10-12, 2019, pp. 1-10. IEEE, 2019. doi: 10.1109/SPED.2019.8906599. URL https://doi.org/10.1109/SPED.2019.8906599. · DOI · Paper page
- David Rolnick, Arun Ahuja, Jonathan Schwarz, Timothy P. Lillicrap, and Gregory Wayne. Experi- ence replay for continual learning. In Hanna M. Wallach, Hugo Larochelle, Alina Beygelzimer, Florence d'Alché-Buc, Emily B. Fox, and Roman Garnett (eds.), Advances in Neural Infor- mation Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, December 8-14, 2019, Vancouver, BC, Canada, pp. 348-358, 2019. URL https://proceedings.neurips.cc/paper/2019/hash/fa7cdfad1a5aaf8370ebeda47a1ff1c3-Abstra
- Claude Elwood Shannon. A mathematical theory of communication. The Bell system technical journal, 27 (3):379-423, 1948.
- Massimiliano Todisco, Xin Wang, Ville Vestman, Md Sahidullah, Héctor Delgado, Andreas Nautsch, Junichi Yamagishi, Nicholas Evans, Tomi Kinnunen, and Kong Aik Lee. Asvspoof 2019: Future horizons in spoofed and fake audio detection. arXiv preprint arXiv:1904.05441, 2019. · arXiv
- Zhizheng Wu, Tomi Kinnunen, Nicholas Evans, Junichi Yamagishi, Cemal Hanilc ¸i, Md Sahidullah, and Aleksandr Sizov. Asvspoof 2015: the first automatic speaker verification spoofing and countermeasures challenge. In Sixteenth annual conference of the international speech communication association, 2015.
- Jiangyan Yi, Ye Bai, Jianhua Tao, Haoxin Ma, Zhengkun Tian, Chenglong Wang, Tao Wang, and Ruibo Fu. Half-truth: A partially fake audio detection dataset. In Hynek Hermansky, Honza Cernocký, Lukás Burget, Lori Lamel, Odette Scharenborg, and Petr Motlícek (eds.), Interspeech 2021, 22nd An- nual Conference of the International Speech Communication Association, Brno, Czechia, 30 August -3 September 2021, pp. 1654-1658. ISCA, 2021. doi: 10.21437/INTERSPEECH.2021-930. URL https://doi.org/10.21437/Interspeech.2021-930. · DOI
- Jiangyan Yi, Ruibo Fu, Jianhua Tao, Shuai Nie, Haoxin Ma, Chenglong Wang, Tao Wang, Zhengkun Tian, Ye Bai, Cunhang Fan, et al. Add 2022: the first audio deep synthesis detection challenge. In ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 9216-9220. IEEE, 2022.
- Jiangyan Yi, Jianhua Tao, Ruibo Fu, Xinrui Yan, Chenglong Wang, Tao Wang, Chu Yuan Zhang, Xiaohui Zhang, Yan Zhao, Yong Ren, Le Xu, Junzuo Zhou, Hao Gu, Zhengqi Wen, Shan Liang, Zheng Lian, Shuai Nie, and Haizhou Li. ADD 2023: the second audio deepfake detection challenge. In Jianhua Tao, Haizhou Li, Jiangyan Yi, and Cunhang Fan (eds.), Proceedings of the Workshop on Deepfake Audio Detection and Analysis co-located with 32th International Joint Conference on Artificial Intelligence (IJCAI 2023), Macao, China, August 19, 2023, volume 3597 of CEUR Workshop Proceedings, pp. 125-130. CEUR- WS.org, 2023. URL https://ceur-ws.org/Vol-3597/paper21.pdf.
- Guanxiong Zeng, Yang Chen, Bo Cui, and Shan Yu. Continual learning of context-dependent processing in neural networks. Nature Machine Intelligence, 1(8):364-372, 2019.
- Friedemann Zenke, Ben Poole, and Surya Ganguli. Continual learning through synaptic intelli- gence. In Doina Precup and Yee Whye Teh (eds.), Proceedings of the 34th International Con- ference on Machine Learning, ICML 2017, Sydney, NSW, Australia, 6-11 August 2017, vol- ume 70 of Proceedings of Machine Learning Research, pp. 3987-3995. PMLR, 2017. URL http://proceedings.mlr.press/v70/zenke17a.html.
- Xiaohui Zhang, Jiangyan Yi, Jianhua Tao, Chenglong Wang, and Chu Yuan Zhang. Do you re- member? overcoming catastrophic forgetting for fake audio detection. In Andreas Krause, Emma Brunskill, Kyunghyun Cho, Barbara Engelhardt, Sivan Sabato, and Jonathan Scarlett (eds.), Inter- national Conference on Machine Learning, ICML 2023, 23-29 July 2023, Honolulu, Hawaii, USA, volume 202 of Proceedings of Machine Learning Research, pp. 41819-41831. PMLR, 2023. URL https://proceedings.mlr.press/v202/zhang23au.html.
- Xiaohui Zhang, Jiangyan Yi, Chenglong Wang, Chu Yuan Zhang, Siding Zeng, and Jianhua Tao. What to remember: Self-adaptive continual learning for audio deepfake detection. In Michael J. Wooldridge, Jennifer G. Dy, and Sriraam Natarajan (eds.), Thirty-Eighth AAAI Conference on Artificial Intelligence, AAAI 2024, Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence, IAAI 2024, Four- teenth Symposium on Educational Advances in Artificial Intelligence, EAAI 2014, February 20-27, 2024, Vancouver, Canada, pp. 19569-19577. AAAI Press, 2024. doi: 10.1609/AAAI.V38I17.29929. URL https://doi.org/10.1609/aaai.v38i17.29929. · DOI · Paper page
- Zhenyu Zhang, Yewei Gu, Xiaowei Yi, and Xianfeng Zhao. FMFCC-A: A challenging mandarin dataset for synthetic speech detection. In Xianfeng Zhao, Alessandro Piva, and Pedro Comesaña Alfaro (eds.), Digital Forensics and Watermarking -20th International Workshop, IWDW 2021, Beijing, China, November 20-22, 2021, Revised Selected Papers, volume 13180 of Lecture Notes in Computer Science, pp. 117-131. Springer, 2021. doi: 10.1007/978-3-030-95398-0\ 9. URL https://doi.org/10.1007/978-3-030-95398-0_9. · DOI · Paper page
- Authors
- Zhang, X., Yi, J., & Tao, J.
- Affiliations
- Chinese Academy of Sciences (CN)
- Tsinghua University (CN)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2024
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2405.08596
- OpenAlex
- W4396986544
- Cited by
- 0
- References
- 0
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Keywords
- audio deepfake detection, continual learning, benchmark, synthetic speech, large language models, GPT-4, GPT-4o, elastic weight consolidation, learning without forgetting, catastrophic forgetting
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
