Investigating Self-Supervised Front Ends for Speech Spoofing Countermeasures
Open accessThe DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
Self-supervised speech model is a rapid progressing research topic, and many pre-trained models have been released and used in various down stream tasks.For speech anti-spoofing, most countermeasures (CMs) use signal processing algorithms to extract acoustic features for classification.In this study, we use pre-trained self-supervised speech models as the front end of spoofing CMs.We investigated different back end architectures to be combined with the self-supervised front end, the effectiveness of fine-tuning the front end, and the performance of using different pre-trained self-supervised models.Our findings showed that, when a good pre-trained front end was fine-tuned with either a shallow or a deep neural network-based back end on the ASVspoof 2019 logical access (LA) training set, the resulting CM not only achieved a low EER score on the 2019 LA test set but also significantly outperformed the baseline on the ASVspoof 2015, 2021 LA, and 2021 deepfake test sets.A sub-band analysis further demonstrated that the CM mainly used the information in a specific frequency band to discriminate the bona fide and spoofed trials across the test sets.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“While the use of SSL brings substantial improvements in performance, the use of models pre-trained on external data is not compliant with the ASVspoof training protocol.”
From ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wild (2023) · cites this paper as [43]
In the citing paper
“Preliminary works showed that SSL models such as wav2vec2 [9] were able to outperform supervised deep learning classifiers when used as feature extractors [10] or fine-tuned for the downstream task [11, 12].”
From Exploring Self-supervised Embeddings and Synthetic Data Augmentation for Robust Audio Deepfake Detection (2024) · cites this paper as [11]
In the citing paper
“While LFB demonstrated strong performance in ResNet-based models, it was not the optimal choice for LCNN-based architectures.”
From Audio Deepfake Detection: What Has Been Achieved and What Lies Ahead (2025) · cites this paper as [98]
In the citing paper
“a significant body of research [64,96,97,98,99] has demonstrated that the performance of detection models largely depends on the choice of input features.”
From Audio Deepfake Detection: What Has Been Achieved and What Lies Ahead (2025) · cites this paper as [98]
In the citing paper
“As shown above, large SSL models have shown very good performance over the deepfake detection task.”
From WavLM model ensemble for audio deepfake detection (2024) · cites this paper as [1]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.01703 · Cited by 31,473
“Librispeech: an ASR corpus based on public domain audio books,”
Panayotov, V., Chen, G., Povey, D., & Khudanpur, S. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178964 · Cited by 6,072
Davis, S., & Mermelstein, P. (1980) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1980.1163420 · Cited by 5,465
HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units
Hsu, W.-N., Bolte, B., Tsai, Y.-H. H., Lakhotia, K., Salakhutdinov, R., & Mohamed, A. (2021) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2021.3122291 · Cited by 2,983
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations
Baevski, A., Zhou, H., Mohamed, A., & Auli, M. (2020) · arXiv · doi:10.48550/arxiv.2006.11477 · Cited by 2,369
fairseq: A Fast, Extensible Toolkit for Sequence Modeling
Ott, M., Edunov, S., Baevski, A., Fan, A., Gross, S., Ng, N., Grangier, D., & Auli, M. (2019) · Proceedings of the 2019 Conference of the North · doi:10.18653/v1/n19-4009 · Cited by 2,344
SWITCHBOARD: telephone speech corpus for research and development
Godfrey, J. J., Holliman, E. C., & McDaniel, J. (1992) · [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1992.225858 · Cited by 2,134 · cited 1×
“W2V-Large2 Wav2vec (w2v large) CommonVoice, Switchboard [27], LibriLight [28], Fisher [29] 317 m 1024”
Common Voice: A Massively-Multilingual Speech Corpus
Ardila, R., Branson, M., Davis, K., Henretty, M., Kohler, M., Meyer, J., Morais, R., Saunders, L., Tyers, F. M., & Weber, G. (2019) · arXiv · doi:10.48550/arxiv.1912.06670 · Cited by 905
Speaker Recognition from Raw Waveform with SincNet
Ravanelli, M., & Bengio, Y. (2018) · 2018 IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2018.8639585 · Cited by 896
ASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detection
Todisco, M., Wang, X., Vestman, V., Sahidullah, M., Delgado, H., Nautsch, A., Yamagishi, J., Evans, N., Kinnunen, T., & Lee, K. A. (2019) · arXiv · doi:10.48550/arxiv.1904.05441 · Cited by 688
Self-citationASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detection
Todisco, M., Wang, X., Vestman, V., Sahidullah, M., Delgado, H., Nautsch, A., Yamagishi, J., Evans, N., Kinnunen, T. H., & Lee, K. A. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-2249 · Cited by 687
Self-citationSUPERB: Speech Processing Universal PERformance Benchmark
Yang, S.-W., Chi, P.-H., Chuang, Y.-S., Lai, C.-I. J., Lakhotia, K., Lin, Y. Y., Liu, A. T., Shi, J., Chang, X., Lin, G.-T., et al. (2021) · Interspeech 2021 · doi:10.21437/interspeech.2021-1775 · Cited by 681
ASVspoof 2015: the first automatic speaker verification spoofing and countermeasures challenge
Wu, Z., Kinnunen, T., Evans, N., Yamagishi, J., Hanilçi, C., Sahidullah, M., & Sizov, A. (2015) · Interspeech 2015 · doi:10.21437/interspeech.2015-462 · Cited by 484
Self-citationThe Fisher Corpus: a Resource for the Next Generations of Speech-to-Text
Cieri, C., Miller, D. A. B., & Walker, K. P. (2004) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/5q862povzthr · Cited by 464
Libri-Light: A Benchmark for ASR with Limited or No Supervision
Kahn, J., Riviere, M., Zheng, W., Kharitonov, E., Xu, Q., Mazare, P. E., Karadayi, J., Liptchinsky, V., Collobert, R., Fuegen, C., et al. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9052942 · Cited by 458
Constant Q Cepstral Coefficients: A Spoofing Countermeasure for Automatic Speaker Verification
Todisco, M., Delgado, H., & Evans, N. (2017) · Computer Speech & Language · doi:10.1016/j.csl.2017.01.001 · Cited by 424
End-to-End anti-spoofing with RawNet2
Tak, H., Patino, J., Todisco, M., Nautsch, A., Evans, N., & Larcher, A. (2021) · ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp39728.2021.9414234 · Cited by 402
A comparison of features for synthetic speech detection
Sahidullah, M., Kinnunen, T., & Hanilçi, C. (2015) · Interspeech 2015 · doi:10.21437/interspeech.2015-472 · Cited by 382
ASVspoof 2021: accelerating progress in spoofed and deepfake speech detection
Yamagishi, J., Wang, X., Todisco, M., Sahidullah, M., Patino, J., Nautsch, A., Liu, X., Lee, K. A., Kinnunen, T., Evans, N., et al. (2021) · 2021 Edition of the Automatic Speaker Verification and Spoofing Countermeasures Challenge · doi:10.21437/asvspoof.2021-8 · Cited by 380
Self-citationDAVIS, S. B., & MERMELSTEIN, P. (1990) · Readings in Speech Recognition · doi:10.1016/b978-0-08-051584-7.50010-3 · Cited by 341
Layer-Wise Analysis of a Self-Supervised Speech Representation Model
Pasad, A., Chou, J.-C., & Livescu, K. (2021) · 2021 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU) · doi:10.1109/asru51503.2021.9688093 · Cited by 262
Spoofing and countermeasures for automatic speaker verification
Evans, N., Kinnunen, T., & Yamagishi, J. (2013) · Interspeech 2013 · doi:10.21437/interspeech.2013-288 · Cited by 160
Self-citationA Comparative Study on Recent Neural Spoofing Countermeasures for Synthetic Speech Detection
Wang, X., & Yamagishi, J. (2021) · Interspeech 2021 · doi:10.21437/interspeech.2021-702 · Cited by 137
Self-citationAdvances in anti-spoofing: from the perspective of ASVspoof challenges
Kamble, M. R., Sailor, H. B., Patil, H. A., & Li, H. (2020) · APSIPA Transactions on Signal and Information Processing · doi:10.1017/atsip.2019.21 · Cited by 102
DNN Filter Bank Cepstral Coefficients for Spoofing Detection
Yu, H., Tan, Z.-H., Zhang, Y., Ma, Z., & Guo, J. (2017) · IEEE Access · doi:10.1109/access.2017.2687041 · Cited by 67
Long Range Acoustic and Deep Features Perspective on ASVspoof 2019
Das, R. K., Yang, J., & Li, H. (2019) · 2019 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU) · doi:10.1109/asru46091.2019.9003845 · Cited by 65
FastAudio: A Learnable Audio Front-End For Spoof Speech Detection
Fu, Q., Teng, Z., White, J., Powell, M., & Schmidt, D. C. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746722 · Cited by 63
Kumar, Y., Shah, J., Shah, R. R., & Chen, C. (2021) · Preprints.org · doi:10.20944/preprints202101.0081.v1 · Cited by 46
Assessing the Scope of Generalized Countermeasures for Anti-Spoofing
Das, R. K., Yang, J., & Li, H. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9053086 · Cited by 45
Siamese Network with wav2vec Feature for Spoofing Speech Detection
Xie, Y., Zhang, Z., & Yang, Y. (2021) · Interspeech 2021 · doi:10.21437/interspeech.2021-847 · Cited by 41
Generalization of spoofing countermeasures: A case study with ASVspoof 2015 and BTAS 2016 corpora
Paul, D., Sahidullah, M., & Saha, G. (2017) · 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2017.7952516 · Cited by 38
Tak, H., Patino, J., Nautsch, A., Evans, N., & Todisco, M. (2020) · The Speaker and Language Recognition Workshop (Odyssey 2020) · doi:10.21437/odyssey.2020-47 · Cited by 31
Self-Supervised Spoofing Audio Detection Scheme
Jiang, Z. K., Zhu, H.-L., Peng, L., Ding, W., & Ren, Y. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-1760 · Cited by 26
FastAudio: A Learnable Audio Front-End for Spoof Speech DetectionPreprint
Fu, Q., Teng, Z., White, J., Powell, M., & Schmidt, D. C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.02774 · Cited by 6
A Comparative Study on Recent Neural Spoofing Countermeasures for Synthetic Speech Detection
Wang, X., & Yamagishi, J. (2021) · arXiv · doi:10.48550/arxiv.2103.11326 · Cited by 4
Self-citation(2020) · neural information processing systems
Cited by
ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wild
Liu, X., Wang, X., Sahidullah, M., Patino, J., Delgado, H., Kinnunen, T., Todisco, M., Yamagishi, J., Evans, N., Nautsch, A., et al. (2023) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2023.3285283 · Cited by 312
Self-citationTak, H., Todisco, M., Wang, X., Jung, J.-W., Yamagishi, J., & Evans, N. (2022) · The Speaker and Language Recognition Workshop (Odyssey 2022) · doi:10.21437/odyssey.2022-16 · Cited by 237
Self-citationA Survey on Speech Deepfake Detection
Li, M., Ahmadiadli, Y., & Zhang, X.-P. (2025) · ACM Computing Surveys · doi:10.1145/3714458 · Cited by 101
Zhang, L., Wang, X., Cooper, E., Evans, N., & Yamagishi, J. (2023) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2022.3233236 · Cited by 100
Self-citationThe Vicomtech Audio Deepfake Detection System Based on Wav2vec2 for the 2022 ADD Challenge
Martin-Donas, J. M., & Alvarez, A. (2022) · ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp43922.2022.9747768 · Cited by 100
Metadata
- Authors
- Wang, X., & Yamagishi, J.
- Affiliations
- National Institute of Informatics (JP)
- Venue
- The Speaker and Language Recognition Workshop (Odyssey 2022)
- Publisher
- ISCA
- Published
- 2022-06-28
- Pages
- 100-106
- OpenAlex
- W3212117663
- Cited by
- 138
- References
- 39
- Citations by year
- 2026: 27 · 2025: 45 · 2024: 32 · 2023: 23 · 2022: 11
- FWCI
- 15.35
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- cc-by-nc-nd
- Locations
- The Speaker and Language Recognition Workshop (Odyssey) (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by-nc-nd)
- arXiv (Cornell University)
- Funders
- Japan Society for the Promotion of Science (21H04906)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Biometric Identification and Security
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Keywords
- self-supervised speech models, pre-trained speech models, fine-tuning, ASVspoof 2019, subband decomposition, spoofed speech
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.