RawNet: Advanced End-to-End Deep Neural Network Using Raw Waveforms for Text-Independent Speaker Verification
Open accessThe DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
Recently, direct modeling of raw waveforms using deep neural networks has been widely studied for a number of tasks in audio domains.In speaker verification, however, utilization of raw waveforms is in its preliminary phase, requiring further investigation.In this study, we explore end-to-end deep neural networks that input raw waveforms to improve various aspects: front-end speaker embedding extraction including model architecture, pre-training scheme, additional objective functions, and back-end classification.Adjustment of model architecture using a pre-training scheme can extract speaker embeddings, giving a significant improvement in performance.Additional objective functions simplify the process of extracting speaker embeddings by merging conventional two-phase processes: extracting utterance-level features such as i-vectors or x-vectors and the feature enhancement phase, e.g., linear discriminant analysis.Effective back-end classification models that suit the proposed speaker embedding are also explored.We propose an end-toend system that comprises two deep neural networks, one frontend for utterance-level speaker embedding extraction and the other for back-end classification.Experiments conducted on the VoxCeleb1 dataset demonstrate that the proposed model achieves state-of-the-art performance among systems without data augmentation.The proposed system is also comparable to the state-of-the-art x-vector system that adopts data augmentation.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
TensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008
Identity mappings in deep residual networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_38 · Cited by 10,741
Identity Mappings in Deep Residual Networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · arXiv · doi:10.48550/arxiv.1603.05027 · Cited by 10,665
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., et al. (2016) · arXiv · doi:10.48550/arxiv.1603.04467 · Cited by 9,408
A Discriminative Feature Learning Approach for Deep Face Recognition
Wen, Y., Zhang, K., Li, Z., & Qiao, Y. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46478-7_31 · Cited by 4,077
Cited by
Items 101–166 of 166
Rathod, V. U., Sable, N. P., Dhamdhere, P. B., Rathod, R. R., Zurange, S. Y., & Naik, D. R. (2024) · IEEE International Conference for Convergence in Technology (I2CT) · doi:10.1109/i2ct61223.2024.10543582 · Cited by 2
Li, Y., Li, H., Specia, L., & Schuller, B. W. (2026) · Scientific Reports · doi:10.1038/s41598-026-36044-w · Cited by 14
iWAX: interpretable Wav2vec-AASIST-XGBoost framework for voice spoofing detection
Lee, S., Choi, S., Kang, T., Chung, S., Han, S., Seo, J., Park, S., Kim, E. J., Oh, S., & Kwak, I. (2025) · Scientific Reports · doi:10.1038/s41598-025-24361-5 · Cited by 6
AVIR: Audio-Visual Information Refinement for Robust Multimodal Deepfake Detection
Liu, X., Yang, Y. Y., Li, X., Zhao, G., & Zhao, Y. (2026) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2026.3691216 · Cited by 2
Voiceproof: Speaker Verification with Captcha A Novel Biometric Access Control Mechanism
Nene, M. J., & Mohapatra, R. (2022) · International Conference for Advancement in Technology (ICONAT) · doi:10.1109/iconat53423.2022.9726035 · Cited by 2
Speaker recognition with global information modelling of raw waveforms
Wu, Y., Dong, J., Fang, Z., Zhang, G., & Rong, H. (2024) · Journal of Membrane Computing · doi:10.1007/s41965-024-00135-2 · Cited by 2
Kim, S., Jo, A.-H., & Kwak, K.-C. (2024) · Electronics · doi:10.3390/electronics13234836 · Cited by 2
Leveraging Neural Vocoder Artifacts for Improved Synthetic Speech Detection
Xue, J., Cui, S., & Zhang, W. (2024) · International Conference on Sensors, Signal and Image Processing (SSIP) · doi:10.1145/3725949.3725971 · Cited by 2
Kim, S., Kim, T., & Kwak, K.-C. (2025) · Electronics · doi:10.3390/electronics14183581 · Cited by 3
A Study on Angular Based Embedding Learning for Text-independent Speaker Verification
Chen, Z., Ren, Z., & Xu, S. (2019) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc47483.2019.9023165 · Cited by 2
A Chinese Speech Recognition System Based on Fusion Network Structure
Guo, L., Mu, S., Shi, C., Yan, B., Xiao, Z., & Yu, S. (2021) · IEEE International Conference on Communication Technology (ICCT) · doi:10.1109/icct52962.2021.9657881 · Cited by 2
LRPD: Large Replay Parallel Dataset
Yakovlev, I., Melnikov, M., Bukhal, N., Makarov, R., Alenin, A., Torgashov, N., & Okhotnikov, A. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746527 · Cited by 2
Phase perturbation improves channel robustness for speech spoofing countermeasures
Zang, Y., Zhang, Y., & Duan, Z. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-2039 · Cited by 4
Arora, S. V. (2024) · Network Computation in Neural Systems · doi:10.1080/0954898x.2024.2438128 · Cited by 1
Review and analysis of audio spoof countermeasures: an attack perspective
Chakravarty, N., & Dua, M. (2025) · International Journal of Speech Technology · doi:10.1007/s10772-025-10217-w · Cited by 4
Cheng, J., Zhong, J., Mai, J., & Zhao, S. (2025) · Communications in computer and information science · doi:10.1007/978-981-95-4100-3_29 · Cited by 1
DeepRawNet: empowering deepfake audio detection through dynamic enhancements
Alharbi, L. A., Alnahas, J., Javed, A., Alhakamy, A., Nawaz, M., Malik, H., Ilyas, H., & Alfaifi, F. (2026) · PeerJ Computer Science · doi:10.7717/peerj-cs.3670 · Cited by 2
Learning the Front-End Speech Feature with Raw Waveform for End-to-End Speaker Recognition
Liang, N., Xu, W. H., Luo, C., & Kang, W. (2020) · International Conference on Computing and Artificial Intelligence (ICCAI) · doi:10.1145/3404555.3404571 · Cited by 2
Sharma, D., & Buduru, A. B. (2022) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2022.findings-naacl.93 · Cited by 4
LA4OX - A Live Authentication for Online Exam
Quoc, T. N., & Phi, L. N. V. (2023) · International Conference on Knowledge and Systems Engineering/Proceedings · doi:10.1109/kse59128.2023.10299441 · Cited by 1
Meta-Learning Framework for End-to-End Imposter Identification in Unseen Speaker Recognition
Chaubey, A., Sinha, S., & Ghose, S. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389712 · Cited by 1
Sasmal, S., Dhote, P., Bhargava, M., Nikam, H., Patil, S., Mehta, S., Singh, L., & Kumar, A. (2023) · IEEE Pune Section International Conference (PuneCon) · doi:10.1109/punecon58714.2023.10449990 · Cited by 1
Channel Robust Strategies with Data Augmentation for Audio Anti-spoofing
Mamarasulov, S., Li, Y., & Wang, C. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-75764-8_7 · Cited by 1
Logistic Similarity Metric Learning via Affinity Matrix for Text-Independent Speaker Verification
Peng, J., Gu, R., & Zou, Y. (2019) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru46091.2019.9003995 · Cited by 1
Raw-x-vector: Multi-scale Time Domain Speaker Embedding Network.Preprint
Zhu, G., Jiang, F., & Duan, Z. (2020) · arXiv (Cornell University) · Cited by 1
Y-Vector: Multiscale Waveform Encoder for Speaker EmbeddingPreprint
Zhu, G., Jiang, F., & Duan, Z. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.12951 · Cited by 1
Seo, S., & Kim, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.13350
Self-citationSupervised attention for speaker recognitionPreprint
Kye, S. M., Chung, J. S., & Kim, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.05189
Partially-Connected Differentiable Architecture Search for Deepfake and Spoofing DetectionPreprint
Ge, W., Panariello, M., Patino, J., Todisco, M., & Evans, N. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.03123
Kim, J.-H., Shim, H.-J., Jung, J.-W., & Yu, H.-J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.06604
Self-citationLi, J., Yan, N., & Wang, L. (2021) · arXiv (Cornell University)
Guo, X. Y., Luo, C., Deng, A., & Deng, F. (2022) · AIMS Mathematics · doi:10.3934/math.2022355
Multimodal Diarization Systems by Training Enrollment Models as Identity Representations
Mingote, V., Viñals, I., Gimeno, P., Miguel, A., Ortega, A., & Lleida, E. (2022) · Applied Sciences · doi:10.3390/app12031141 · Cited by 1
Enhanced Speaker Embeddings with CNN-based Multi-scaling Features
Jakubec, M., Jarina, R., & Lieskovská, E. (2022) · International Conference Radioelektronika · doi:10.1109/radioelektronika54537.2022.9764919
C 6 Audio- und Musik-Retrieval
Eibl, M., Haupt, J., Kahl, S., Taubert, S., & Wilhelm-Stein, T. (2022) · De Gruyter eBooks · doi:10.1515/9783110769043-036
A comparison of temporal aggregators for speaker verification
Piccoli, F., Olearo, L., & Bianco, S. (2022) · International Conference on Consumer Electronics · doi:10.1109/icce-berlin56473.2022.9937132
Enhanced Feature Aggregation for Deep Neural Network Based Speaker Embedding
Thevagumaran, R., Sivaneswaran, T., & Karunarathne, B. (2022) · Moratuwa Engineering Research Conference (MERCon) · doi:10.1109/mercon55799.2022.9906175
Deep Learning Model CNN With LSTM For Speaker Recognition
Alkhatib, B., & Eddin, M. M. K. (2022) · Journal of Digital Information Management · doi:10.6025/jdim/2022/20/4/131-147
An improved Tibetan speaker recognition method based on ResNet
Gan, Z., Li, J., Qu, Z., & Yu, Y. (2023) · Asia Conference on Electrical, Power and Computer Engineering (EPCE) · doi:10.1109/epce58798.2023.00015
Raw Waveform-Based Speech Command Recognition with Impulsive Neural Networks
Chen, H., Hu, B., Chen, L., & Guan, Z. (2023) · Chinese Control and Decision Conference (CCDC) · doi:10.1109/ccdc58219.2023.10327106
ASF-Conformer: Audio Scoring Conformer with FFC for Speaker Verification in Noisy Environments
Zhang, X., Liu, H., Liu, C., Zhang, H., & Huo, Z. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-53311-2_8
Zheng, Q., Chen, Z., Jiang, X., Lin, M., Wang, M., & Lu, Y. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-024-19588-9 · Cited by 1
AAM-Sinc-MV1D:A Model of Short-term Speaker Recognition Based on The Raw Waveform
Zhao, Y. B., Zhang, L., Liu, X., & Hu, Y. (2024) · International Conference on Networking and Network Applications (NaNA) · doi:10.1109/nana63151.2024.00081
Bourib, S., & Touazi, A. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-70906-7_21
Emotion-Aware Synthetic Speech Detection with Multi-level Fusion Features
Xiang, L., Zhou, Z., & Liu, Y. (2025) · Lecture notes in networks and systems · doi:10.1007/978-981-96-3161-2_9
Deepfake Urdu Audio Detection using Spectral Features for Automatic Speaker Verification
Sajjad, Z., Alam, H., Nouman, A., Raja, A. S., Mir, J., & Shaukat, F. (2024) · International Multi-Topic Conference · doi:10.1109/inmic64792.2024.11004326 · Cited by 2
Enhancing Deepfake Detection: A Study Using WavLM and Advanced RawBoost Augmentation Techniques
Tri, N., Hoang, L. N., Viet, P. T., & Trung, K. P. (2024) · RIVF International Conference on Computing and Communication Technologies (RIVF) · doi:10.1109/rivf64335.2024.11009068
Venaik, U., Kushwaha, A., Nabeel Koya, A., & Shah, R. R. (2025) · doi:10.1145/3746265.3759675 · Cited by 4
Enhancing Model Robustness for Deepfake Singing Voice Detection through Data Augmentation
Samiul, I. J. A. M., Zaman, K., Li, K., Chaiwongyen, A., Okada, S., & Unoki, M. (2025) · Journal of Signal Processing · doi:10.2299/jsp.29.221
Improving Automatic Speech Recognition Model for Super-Elderly Voice Using Speech Synthesis Model
Uematsu, R., Leow, C. S., Kitaoka, N., & Nishizaki, H. (2025) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc65261.2025.11248972
Krzywdziak, J., Masztalski, P., Romaniuk, M., Dudek, M., Stepien, J., Matuszewski, M., & Hemmerling, D. (2025) · European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco63237.2025.11226451
Learning Relationship Between Speaker Embeddings and Descriptions of Speaker Traits
Liu, X., Yamagishi, J., Wang, X., & Cooper, E. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3648890
An, W., Li, R., Li, H., & Ge, H. (2026) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-026-11071-x · Cited by 1
A Robust Region-Aware Framework for Audio Forgery Localization
Luo, J., Wang, H., Liu, H., Hu, S. C., & Wang, K. (2026) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2026.3661237
Speech to speech translation system based on cloud-edge collaboration
Zhu, B., Chen, R., Zhang, C., & Zhang, X.-L. (2026) · Vicinagearth. · doi:10.1007/s44336-026-00033-4 · Cited by 1
Uzman Karışımı Füzyonu ile Öz-Denetimli Ses Temsilleri Kullanarak Derin Sahte Ses Tespiti
Tahaoğlu, G., & Düzgün, A. (2026) · Karadeniz Fen Bilimleri Dergisi · doi:10.31466/kfbd.1828944
Human assisted correction for speaker diarization of an incremental collection of documents
Prokopalo, Y. (2022) · theses.fr (ABES) · doi:10.70675/3d5bd7c8zb851z4f15zb277z08020c5b1683
End-to-End Modeling for Speech Spoofing and Deepfake Detection
Tak, H. (2023) · theses.fr (ABES) · doi:10.70675/aa9fb6cbz3f6az45bcz933fzf95d89893e59 · Cited by 4
Li, J., Mak, M., Rohdin, J., Plchot, O., Lee, K. A., & Heřmanský, H. (2026) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2026.3682044
Wei, H., You, W., Deng, D., Xu, C., Wang, Y., & Yang, G. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11461027
Enhancing Speaker Verification with Layer-Wise Mixture-of-Experts on Pre-Trained Models
Li, Y., Yu, Y., 涂永峰, Deng, S., & Gan, W. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11464967 · Cited by 1
Bathaei, S. F., Torkamanpary, A., & Amini, P. (2025) · International Conference on Signal Processing and Intelligent Systems (ICSPIS) · doi:10.1109/icspis68676.2025.11551696
Pakzad, A., Hourali, S., & Kiani, V. (2026) · IET Biometrics · doi:10.1049/bme2/5420687
Leveraging Mono-Modal Data to Generate Multimodal Representations for Industrial Anomaly Detection
Achkar, C. E., Makhoul, A., & Azar, J. (2026) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac69091.2026.00024
Nguyen, T. A., Dinh-Xuan, H., Doan, T.-P., & Jung, S. (2026) · IEEE Access · doi:10.1109/access.2026.3732510
Semantic-Aware Conformer With Multi-Scale Fusion for Speaker Verification
Chen, C., Li, D., Dong, S., Li, A., Yang, H., & Wang, L. (2026) · IEEE Signal Processing Letters · doi:10.1109/lsp.2026.3740632
Metadata
- Authors
- Jung, J.-W., Heo, H.-S., Kim, J.-H., Shim, H.-J., & Yu, H.-J.
- Affiliations
- University of Seoul (KR)
- Corresponding author
- Yu, Ha-Jin
- Venue
- Interspeech 2019
- Publisher
- ISCA
- Published
- 2019-09-15
- Pages
- 1268-1272
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W2972909277
- Cited by
- 166
- References
- 31
- Citations by year
- 2026: 15 · 2025: 20 · 2024: 28 · 2023: 21 · 2022: 35 · 2021: 24 · 2020: 20 · 2019: 3
- FWCI
- 7.84
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Interspeech (USB) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Ministry of Trade, Industry and Energy (10076583)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
- Keywords
- text-independent speaker verification, end-to-end deep neural network, pre-training, utterance-level features, i-vectors, x-vector, linear discriminant analysis, VoxCeleb1
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.