CoChat
Sign Up
Cited by 20Speech Recognition and SynthesisBiometric Identification and SecuritySpeech and Audio Processing

The DOI matches its Crossref record.

One-class learning with adaptive centroid shift for audio deepfake detection

Open access
Kim, Hyun Myung, Jang, Kangwook, Kim, Hoirin·2024·Interspeech 2024
DOI 10.21437/interspeech.2024-177
Open this paper in CoChat — free accountOpen PDF

Abstract

As speech synthesis systems continue to make remarkable advances in recent years, the importance of robust deepfake detection systems that perform well in unseen systems has grown.In this paper, we propose a novel adaptive centroid shift (ACS) method that updates the centroid representation by continually shifting as the weighted average of bonafide representations.Our approach uses only bonafide samples to define their centroid, which can yield a specialized centroid for one-class learning.Integrating our ACS with one-class learning gathers bonafide representations into a single cluster, forming wellseparated embeddings robust to unseen spoofing attacks.Our proposed method achieves an equal error rate (EER) of 2.19% on the ASVspoof 2021 deepfake dataset, outperforming all existing systems.Furthermore, the t-SNE visualization illustrates that our method effectively maps the bonafide embeddings into a single cluster and successfully disentangles the bonafide and spoof classes.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.21437/interspeech.2024-177

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Still being checked.

Research works printed but not linked: 34

  1. Y. Ren, C. Hu, X. Tan, T. Qin, S. Zhao, Z. Zhao, and T.-Y. Liu, "Fastspeech 2: Fast and high-quality end-to-end text to speech," in International Conference on Learning Representations, 2020.
  2. K. Qian, Y. Zhang, S. Chang, X. Yang, and M. Hasegawa- Johnson, "Autovc: Zero-shot voice style transfer with only au- toencoder loss," in International Conference on Machine Learn- ing. PMLR, 2019.
  3. C. Stupp, "Fraudsters used ai to mimic ceo's voice in unusual cy- bercrime case," The Wall Street Journal, vol. 30, no. 08, 2019.
  4. X. Liu, X. Wang, M. Sahidullah, J. Patino, H. Delgado, T. Kin- nunen, M. Todisco, J. Yamagishi, N. Evans, A. Nautsch et al., "Asvspoof 2021: Towards spoofed and deepfake speech detection in the wild," IEEE/ACM Transactions on Audio, Speech, and Lan- guage Processing, 2023.
  5. N. Müller, P. Czempin, F. Diekmann, A. Froghyar, and K. Böttinger, "Does Audio Deepfake Detection Generalize?" in Proc. Interspeech, 2022.
  6. W. Cai, D. Cai, W. Liu, G. Li, and M. Li, "Countermeasures for Automatic Speaker Verification Replay Spoofing Attack : On Data Augmentation, Feature Representation, Classification and Fusion," in Proc. Interspeech, 2017.
  7. H. Tak, M. Kamble, J. Patino, M. Todisco, and N. Evans, "Raw- boost: A raw data boosting and augmentation method applied to automatic speaker verification anti-spoofing," in Proc. ICASSP, 2022.
  8. X. Wang and J. Yamagishi, "Investigating Self-Supervised Front Ends for Speech Spoofing Countermeasures," in Proc. The Speaker and Language Recognition Workshop (Odyssey 2022), 2022.
  9. Y. Eom, Y. Lee, J. S. Um, and H. Kim, "Anti-spoofing using trans- fer learning with variational information bottleneck," in Proc. In- terspeech, 2022.
  10. V. Panayotov, G. Chen, D. Povey, and S. Khudanpur, "Lib- rispeech: an asr corpus based on public domain audio books," in Proc. ICASSP, 2015.
  11. H. Ling, L. Huang, J. Huang, B. Zhang, and P. Li, "Attention- based convolutional neural network for asv spoofing detection." in Proc. Interspeech, 2021.
  12. H. Tak, J.-w. Jung, J. Patino, M. Kamble, M. Todisco, and N. Evans, "End-to-end spectro-temporal graph attention networks for speaker verification anti-spoofing and speech deepfake detec- tion," in Proc. ASVspoof workshop, 2021.
  13. Y. Zhang, F. Jiang, and Z. Duan, "One-class learning towards syn- thetic voice spoofing detection," IEEE Signal Processing Letters, 2021.
  14. X. Yan, J. Yi, J. Tao, C. Wang, H. Ma, T. Wang, S. Wang, and R. Fu, "An initial investigation for detecting vocoder fingerprints of fake audio," in Proceedings of the 1st International Workshop on Deepfake Detection for Audio Multimedia, 2022.
  15. F. Alegre, A. Amehraye, and N. Evans, "A one-class classifica- tion approach to generalised speaker verification spoofing coun- termeasures using local binary patterns," in 2013 IEEE Sixth In- ternational Conference on Biometrics: Theory, Applications and Systems (BTAS), 2013.
  16. C. Wang, M. Rivière, A. Lee et al., "Voxpopuli: A large-scale multilingual speech corpus for representation learning, semi- supervised learning and interpretation," in ACL 2021-59th Annual Meeting of the Association for Computational Linguistics, 2021.
  17. V. Pratap, Q. Xu, A. Sriram, G. Synnaeve, and R. Collobert, "MLS: A Large-Scale Multilingual Dataset for Speech Research," in Proc. Interspeech, 2020.
  18. L. Van der Maaten and G. Hinton, "Visualizing data using t-sne." Journal of machine learning research, vol. 9, no. 11, 2008.
  19. A. Babu, C. Wang, A. Tjandra, K. Lakhotia, Q. Xu, N. Goyal, K. Singh, P. von Platen, Y. Saraf, J. Pino et al., "Xls-r: Self- supervised cross-lingual speech representation learning at scale," in Proc. Interspeech, 2022.
  20. A. Baevski, Y. Zhou, A. Mohamed, and M. Auli, "wav2vec 2.0: A framework for self-supervised learning of speech representa- tions," Advances in neural information processing systems, 2020.
  21. K. Okabe, T. Koshinaka, and K. Shinoda, "Attentive statistics pooling for deep speaker embedding," in Proc. Interspeech, 2018.
  22. Y. Zhang, Z. Li, J. Lu, H. Hua, W. Wang, and P. Zhang, "The im- pact of silence on speech anti-spoofing," IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2023.
  23. Y. Zhang, W. Wang, and P. Zhang, "The Effect of Silence and Dual-Band Fusion in Anti-Spoofing System," in Proc. Inter- speech, 2021.
  24. X. Liu, M. Liu, L. Wang, K. A. Lee, H. Zhang, and J. Dang, "Leveraging positional-related local-global dependency for syn- thetic speech detection," in Proc. ICASSP, 2023.
  25. J. Yamagishi, X. Wang, M. Todisco, M. Sahidullah, J. Patino, A. Nautsch, X. Liu, K. A. Lee, T. Kinnunen, N. Evans et al., "Asvspoof 2021: accelerating progress in spoofed and deepfake speech detection," in ASVspoof 2021 Workshop, 2021.
  26. T. Kinnunen, K. A. Lee, H. Delgado, N. Evans, M. Todisco, M. Sahidullah, J. Yamagishi, and D. A. Reynolds, "t-dcf: a de- tection cost function for the tandem assessment of spoofing coun- termeasures and automatic speaker verification," arXiv preprint arXiv:1804.09618, 2018. · arXiv
  27. H. Tak, M. Todisco, X. Wang, J.-w. Jung, J. Yamagishi, and N. Evans, "Automatic speaker verification spoofing and deep- fake detection using wav2vec 2.0 and data augmentation," in The Speaker and Language Recognition Workshop, 2022.
  28. M. Ott, S. Edunov, A. Baevski, A. Fan, S. Gross, N. Ng, D. Grang- ier, and M. Auli, "fairseq: A fast, extensible toolkit for sequence modeling," in Proceedings of NAACL-HLT 2019: Demonstra- tions, 2019.
  29. P. Izmailov, D. Podoprikhin, T. Garipov, D. Vetrov, and A. G. Wilson, "Averaging weights leads to wider optima and better gen- eralization," in 34th Conference on Uncertainty in Artificial Intel- ligence, 2018.
  30. Y. Guo, H. Huang, X. Chen, H. Zhao, and Y. Wang, "Audio deep- fake detection with self-supervised wavlm and multi-fusion atten- tive classifier," in Proc. ICASSP, 2024.
  31. J. Lu, Y. Zhang, W. Wang, Z. Shang, and P. Zhang, "One-class knowledge distillation for spoofing speech detection," in Proc. ICASSP, 2024.
  32. J.-w. Jung, H.-S. Heo, H. Tak, H.-j. Shim, J. S. Chung, B.-J. Lee, H.-J. Yu, and N. Evans, "Aasist: Audio anti-spoofing using integrated spectro-temporal graph attention networks," in Proc. ICASSP, 2022.
  33. B. Huang, S. Cui, J. Huang, and X. Kang, "Discriminative fre- quency information learning for end-to-end speech anti-spoofing," IEEE Signal Processing Letters, vol. 30, 2023.
  34. A. Tomilov, A. Svishchev, M. Volkova, A. Chirkovskiy, A. Kon- dratev, and G. Lavrentyeva, "Stc antispoofing systems for the asvspoof2021 challenge," in Proc. ASVspoof 2021 Workshop, 2021.

Cited by

Sorted by citations

See all 20

Related

Metadata

Authors
Kim, H. M., Jang, K., & Kim, H.
Affiliations
Korea Advanced Institute of Science and Technology (KR)
ORCID
Kim, Hyun Myung
Venue
Interspeech 2024
Publisher
ISCA
Published
2024-09-01
Pages
4853-4857
ISSN
2308-457X (ISSN-L)
DOI
10.21437/interspeech.2024-177
OpenAlex
W4402112426
Cited by
17
References
0
Citations by year
2026: 9 · 2025: 7 · 2024: 1
FWCI
5.02
Type
conference paper
Language
en
Open access
Licence
public-domain
Locations
  • Interspeech (USB) (publishedVersion, public-domain)
  • arXiv (Cornell University) (submittedVersion, public-domain)
  • arXiv (Cornell University)
Funders
  • Ministry of Science and ICT, South Korea (2022-0-00653)
  • Institute for Information and Communications Technology Promotion (2022-)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
  • Physical Sciences › Computer Science › Signal Processing › Biometric Identification and Security
  • Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
Keywords
audio deepfake detection, one-class learning, anti-spoofing, speech synthesis, ASVspoof 2021

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review