Deep Residual Neural Networks for Audio Spoofing Detection
Open accessThe DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
The state-of-art models for speech synthesis and voice conversion are capable of generating synthetic speech that is perceptually indistinguishable from bonafide human speech. These methods represent a threat to the automatic speaker verification (ASV) systems. Additionally, replay attacks where the attacker uses a speaker to replay a previously recorded genuine human speech are also possible. We present our solution for the ASVSpoof2019 competition, which aims to develop countermeasure systems that distinguish between spoofing attacks and genuine speeches. Our model is inspired by the success of residual convolutional networks in many classification tasks. We build three variants of a residual convolutional neural network that accept different feature representations (MFCC, Log-magnitude STFT, and CQCC) of input. We compare the performance achieved by our model variants and the competition baseline models. In the logical access scenario, the fusion of our models has zero t-DCF cost and zero equal error rate (EER), as evaluated on the development set. On the evaluation set, our model fusion improves the t-DCF and EER by 25% compared to the baseline algorithms. Against physical access replay attacks, our model fusion improves the baseline algorithms t-DCF and EER scores by 71% and 75% on the evaluation set, respectively.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
(2014) · Cited by 33,419
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
(2017) · Cited by 11,625
WaveNet: a generative model for raw audio
Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911
Speaker Verification Using Adapted Gaussian Mixture Models
Reynolds, D. A., Quatieri, T. F., & Dunn, R. B. (2000) · Digital Signal Processing · doi:10.1006/dspr.1999.0361 · Cited by 4,268
Wide & Deep Learning for Recommender Systems
Cheng, H.-T., Koc, L., Harmsen, J., Shaked, T., Chandra, T., Aradhye, H., Anderson, G., Corrado, G., Chai, W., Ispir, M., et al. (2016) · Proceedings of the 1st Workshop on Deep Learning for Recommender Systems · doi:10.1145/2988450.2988454 · Cited by 3,535
librosa: Audio and Music Signal Analysis in Python
McFee, B., Raffel, C., Liang, D., Ellis, D., McVicar, M., Battenberg, E., & Nieto, O. (2015) · Proceedings of the Python in Science Conference · doi:10.25080/majora-7b98e3ed-003 · Cited by 3,033
Robust text-independent speaker identification using Gaussian mixture speaker models
Reynolds, D. A., & Rose, R. C. (1995) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.365379 · Cited by 2,860
Convolutional Neural Networks for Speech Recognition
Abdel-Hamid, O., Mohamed, A.-R., Jiang, H., Deng, L., Penn, G., & Yu, D. (2014) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2014.2339736 · Cited by 2,262
Deep Speech 2: End-to-End Speech Recognition in English and Mandarin
Amodei, D., Anubhai, R., Battenberg, E., Case, C. T., Casper, J., Catanzaro, B., Chen, J., Chrzanowski, M., Coates, A., Diamos, G., et al. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.02595 · Cited by 2,110
Self-citationCardiologist-Level Arrhythmia Detection with Convolutional Neural Networks
Rajpurkar, P., Hannun, A., Haghpanahi, M., Bourn, C., & Ng, A. Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.01836 · Cited by 595
ASVspoof 2015: the first automatic speaker verification spoofing and countermeasures challenge
Wu, Z., Kinnunen, T., Evans, N., Yamagishi, J., Hanilçi, C., Sahidullah, M., & Sizov, A. (2015) · Interspeech 2015 · doi:10.21437/interspeech.2015-462 · Cited by 484
Constant Q Cepstral Coefficients: A Spoofing Countermeasure for Automatic Speaker Verification
Todisco, M., Delgado, H., & Evans, N. (2017) · Computer Speech & Language · doi:10.1016/j.csl.2017.01.001 · Cited by 424
The Voice Conversion Challenge 2018: Promoting Development of Parallel and Nonparallel Methods
Lorenzo-Trueba, J., Yamagishi, J., Toda, T., Saito, D., Villavicencio, F., Kinnunen, T., & Ling, Z. (2018) · The Speaker and Language Recognition Workshop (Odyssey 2018) · doi:10.21437/odyssey.2018-28 · Cited by 305
Merlin: An Open Source Neural Network Speech Synthesis System
Wu, Z., Watts, O., & King, S. (2016) · 9th ISCA Workshop on Speech Synthesis Workshop (SSW 9) · doi:10.21437/ssw.2016-33 · Cited by 299
Audio replay attack detection with deep learning frameworks
Lavrentyeva, G., Novoselov, S., Malykh, E., Kozlov, A., Kudashev, O., & Shchemelinin, V. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-360 · Cited by 292
Kinnunen, T., Lee, K. A., Delgado, H., Evans, N., Todisco, M., Sahidullah, M., Yamagishi, J., & Reynolds, D. A. (2018) · The Speaker and Language Recognition Workshop (Odyssey 2018) · doi:10.21437/odyssey.2018-44 · Cited by 198
ResNet and Model Fusion for Automatic Spoofing Detection
Chen, Z., Xie, Z., Zhang, W., & Xu, X. (2017) · Interspeech (USB) · doi:10.21437/interspeech.2017-1085 · Cited by 171
Spoofing and countermeasures for automatic speaker verification
Evans, N., Kinnunen, T., & Yamagishi, J. (2013) · Interspeech 2013 · doi:10.21437/interspeech.2013-288 · Cited by 160
Relative phase information for detecting human speech and spoofed speech
Wang, L., Yoshida, Y., Kawakami, Y., & Nakagawa, S. (2015) · Interspeech 2015 · doi:10.21437/interspeech.2015-473 · Cited by 77
Spoofing detection with DNN and one-class SVM for the ASVspoof 2015 challenge
Villalba, J., Miguel, A., Ortega, A., & Lleida, E. (2015) · Interspeech 2015 · doi:10.21437/interspeech.2015-468 · Cited by 72
The Voice Conversion Challenge 2018: Promoting Development of Parallel and Nonparallel MethodsPreprint
Lorenzo-Trueba, J., Yamagishi, J., Toda, T., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.04262 · Cited by 66
Cited by
Does Audio Deepfake Detection Generalize?
Müller, N., Czempin, P., Diekmann, F., Froghyar, A., & Böttinger, K. (2022) · Interspeech 2022 · doi:10.21437/interspeech.2022-108 · Cited by 258
Recurrent convolutional structures for audio spoof and video deepfake detection
Chintha, A., Thai, B., Sohrawardi, S. J., Bhatt, K., Hickerson, A., Wright, M., & Ptucha, R. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.2999185 · Cited by 226
Joint Audio-Visual Deepfake Detection
Zhou, Y., & Lim, S.-N. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01453 · Cited by 217
A Review of Modern Audio Deepfake Detection Methods: Challenges and Future Directions
Almutairi, Z., & Elgibreen, H. (2022) · Algorithms · doi:10.3390/a15050155 · Cited by 187
Replay and Synthetic Speech Detection with Res2Net Architecture
Li, X., Li, N., Weng, C., Liu, X., Su, D., Yu, D., & Meng, H. (2021) · ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp39728.2021.9413828 · Cited by 186
Metadata
- Authors
- Alzantot, M., Wang, Z., & Srivastava, M. B.
- Affiliations
- University of California, Los Angeles (US)
- Venue
- Interspeech 2019
- Publisher
- ISCA
- Published
- 2019-09-15
- Pages
- 1078-1082
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W2955459848
- Cited by
- 215
- References
- 28
- Citations by year
- 2026: 22 · 2025: 37 · 2024: 38 · 2023: 41 · 2022: 32 · 2021: 31 · 2020: 13 · 2019: 1
- FWCI
- 7.36
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Interspeech (USB) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Biometric Identification and Security
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Keywords
- speaker verification, deep residual convolutional neural network, replay attacks, ASVspoof 2019, spoofing countermeasures, Mel-frequency cepstral coefficients, model fusion, equal error rate
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.