Deep Residual Neural Networks for Audio Spoofing Detection
Open accessThe DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
The state-of-art models for speech synthesis and voice conversion are capable of generating synthetic speech that is perceptually indistinguishable from bonafide human speech. These methods represent a threat to the automatic speaker verification (ASV) systems. Additionally, replay attacks where the attacker uses a speaker to replay a previously recorded genuine human speech are also possible. We present our solution for the ASVSpoof2019 competition, which aims to develop countermeasure systems that distinguish between spoofing attacks and genuine speeches. Our model is inspired by the success of residual convolutional networks in many classification tasks. We build three variants of a residual convolutional neural network that accept different feature representations (MFCC, Log-magnitude STFT, and CQCC) of input. We compare the performance achieved by our model variants and the competition baseline models. In the logical access scenario, the fusion of our models has zero t-DCF cost and zero equal error rate (EER), as evaluated on the development set. On the evaluation set, our model fusion improves the t-DCF and EER by 25% compared to the baseline algorithms. Against physical access replay attacks, our model fusion improves the baseline algorithms t-DCF and EER scores by 71% and 75% on the evaluation set, respectively.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
(2014) · Cited by 33,419
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
(2017) · Cited by 11,625
WaveNet: a generative model for raw audio
Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911
Cited by
Does Audio Deepfake Detection Generalize?
Müller, N., Czempin, P., Diekmann, F., Froghyar, A., & Böttinger, K. (2022) · Interspeech 2022 · doi:10.21437/interspeech.2022-108 · Cited by 258
Recurrent convolutional structures for audio spoof and video deepfake detection
Chintha, A., Thai, B., Sohrawardi, S. J., Bhatt, K., Hickerson, A., Wright, M., & Ptucha, R. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.2999185 · Cited by 226
Joint Audio-Visual Deepfake Detection
Zhou, Y., & Lim, S.-N. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01453 · Cited by 217
A Review of Modern Audio Deepfake Detection Methods: Challenges and Future Directions
Almutairi, Z., & Elgibreen, H. (2022) · Algorithms · doi:10.3390/a15050155 · Cited by 187
Replay and Synthetic Speech Detection with Res2Net Architecture
Li, X., Li, N., Weng, C., Liu, X., Su, D., Yu, D., & Meng, H. (2021) · ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp39728.2021.9413828 · Cited by 186
Deepfake generation and detection: Case study and challenges
Patel, Y., Tanwar, S., Gupta, R., Bhattacharya, P., Davidson, I. E., Nyameko, R., Aluvala, S., & Vimal, V. (2023) · IEEE Access · doi:10.1109/access.2023.3342107 · Cited by 186
A Survey on the Detection and Impacts of Deepfakes in Visual, Audio, and Textual Formats
Mubarak, R., Alsboui, T., Alshaikh, O., Inuwa-Dutse, I., Khan, S., & Parkinson, S. (2023) · IEEE Access · doi:10.1109/access.2023.3344653 · Cited by 132
Khanjani, Z., Watson, G., & Janeja, V. P. (2023) · Frontiers in Big Data · doi:10.3389/fdata.2022.1001063 · Cited by 121
A Survey on Speech Deepfake Detection
Li, M., Ahmadiadli, Y., & Zhang, X.-P. (2025) · ACM Computing Surveys · doi:10.1145/3714458 · Cited by 101
A Comprehensive Review of DeepFake Detection Using Advanced Machine Learning and Fusion Methods
Gupta, G., Raja, K., Gupta, M., Jan, T., Whiteside, S. T., & Prasad, M. (2023) · Electronics · doi:10.3390/electronics13010095 · Cited by 99
A Capsule Network Based Approach for Detection of Audio Spoofing Attacks
Luo, A., Li, E., Liu, Y., Kang, X., & Wang, Z. J. (2021) · ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp39728.2021.9414670 · Cited by 84
Self-citationGraph Attention Networks for Anti-Spoofing
Tak, H., Jung, J.-W., Patino, J., Todisco, M., & Evans, N. (2021) · Interspeech 2021 · doi:10.21437/interspeech.2021-993 · Cited by 79
Speech is Silver, Silence is Golden: What do ASVspoof-trained Models Really Learn?
Müller, N., Dieckmann, F., Czempin, P., Canals, R., Böttinger, K., & Williams, J. (2021) · 2021 Edition of the Automatic Speaker Verification and Spoofing Countermeasures Challenge · doi:10.21437/asvspoof.2021-9 · Cited by 69
Human Perception of Audio Deepfakes
Müller, N. M., Pizzi, K., & Williams, J. (2022) · Proceedings of the 1st International Workshop on Deepfake Detection for Audio Multimedia · doi:10.1145/3552466.3556531 · Cited by 68
Fake Speech Detection Using Residual Network with Transformer Encoder
Zhang, Z., Yi, X., & Zhao, X. (2021) · Proceedings of the 2021 ACM Workshop on Information Hiding and Multimedia Security · doi:10.1145/3437880.3460408 · Cited by 66
Combining Automatic Speaker Verification and Prosody Analysis for Synthetic Speech Detection
Attorresi, L., Salvi, D., Borrelli, C., Bestagini, P., & Tubaro, S. (2023) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-37742-6_21 · Cited by 30
Borodin, K., Kudryavtsev, V., Korzh, D., Efimenko, A., Mkrtchian, G., Gorodnichev, M., & Rogov, O. Y. (2024) · The Automatic Speaker Verification Spoofing Countermeasures Workshop (ASVspoof 2024) · doi:10.21437/asvspoof.2024-8 · Cited by 26
Mel-Spectrogram Image-Based End-to-End Audio Deepfake Detection Under Channel-Mismatched Conditions
Fathan, A., Alam, J., & Kang, W. H. (2022) · 2022 IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme52920.2022.9859621 · Cited by 29
FMFCC-A: A Challenging Mandarin Dataset for Synthetic Speech Detection
Zhang, Z., Gu, Y., Yi, X., & Zhao, X. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-95398-0_9 · Cited by 24
Deepfake audio detection with spectral features and ResNeXt-based architecture
Tahaoglu, G., Baracchi, D., Shullani, D., Iuliani, M., & Piva, A. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113726 · Cited by 24
Li, J., Wang, H., He, P., Abdullahi, S. M., & Li, B. (2022) · Digital Signal Processing · doi:10.1016/j.dsp.2021.103256 · Cited by 20
Complex-valued neural networks for voice anti-spoofing
Müller, N. M., Sperl, P., & Böttinger, K. (2023) · INTERSPEECH 2023 · doi:10.21437/interspeech.2023-901 · Cited by 17
FairSSD: Understanding Bias in Synthetic Speech Detectors
Singh Yadav, A. K., Bhagtani, K., Salvi, D., Bestagini, P., & Delp, E. J. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00445 · Cited by 12
Tahaoglu, G. (2025) · Applied Sciences · doi:10.3390/app15179685 · Cited by 11
Robust Deepfake Audio Detection via Bi-Level Optimization
Li, M., Ahmadiadli, Y., & Zhang, X.-P. (2023) · 2023 IEEE 25th International Workshop on Multimedia Signal Processing (MMSP) · doi:10.1109/mmsp59012.2023.10337724 · Cited by 7
Trusted Media Challenge Dataset and User Study
Chen, W., Chua, S. L. B., Winkler, S., & Ng, S.-K. (2022) · Proceedings of the 31st ACM International Conference on Information & Knowledge Management · doi:10.1145/3511808.3557715 · Cited by 7
Fooling the Forgers: A Multi-Stage Framework for Audio Deepfake Detection
Kashyap, G. S., Siddiqui, Z. H., Azeez, M. A., Ali, R., Kumar, S., Kamuni, N., & Gao, J. (2025) · ICASSP 2025 - 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp49660.2025.10888175 · Cited by 4
Nguyen-Le, H.-H., Tran, V.-T., Nguyen, D.-T., & Le-Khac, N.-A. (2026) · Artificial Intelligence Review · doi:10.1007/s10462-026-11608-4 · Cited by 28
Metadata
- Authors
- Alzantot, M., Wang, Z., & Srivastava, M. B.
- Affiliations
- University of California, Los Angeles (US)
- Venue
- Interspeech 2019
- Publisher
- ISCA
- Published
- 2019-09-15
- Pages
- 1078-1082
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W2955459848
- Cited by
- 215
- References
- 28
- Citations by year
- 2026: 22 · 2025: 37 · 2024: 38 · 2023: 41 · 2022: 32 · 2021: 31 · 2020: 13 · 2019: 1
- FWCI
- 7.36
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Interspeech (USB) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Biometric Identification and Security
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Keywords
- speaker verification, deep residual convolutional neural network, replay attacks, ASVspoof 2019, spoofing countermeasures, Mel-frequency cepstral coefficients, model fusion, equal error rate
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.