XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale
Open accessThe DOI matches its Crossref record; 75 of the 75 references it cites were found in a registry or an index.
Abstract
This paper presents XLS-R, a large-scale model for cross-lingual speech representation learning based on wav2vec 2.0.We train models with up to 2B parameters on nearly half a million hours of publicly available speech audio in 128 languages, an order of magnitude more public data than the largest known prior work.Our evaluation covers a wide range of tasks, domains, data regimes and languages, both high and low-resource.On the CoVoST-2 speech translation benchmark, we improve the previous state of the art by an average of 7.4 BLEU over 21 translation directions into English.For speech recognition, XLS-R improves over the best known prior work on BABEL, MLS, CommonVoice as well as VoxPopuli, lowering error rates by 14-34% relative on average.XLS-R also sets a new state of the art on VoxLin-gua107 language identification.Moreover, we show that with sufficient model size, cross-lingual pretraining can perform as well as English-only pretraining when translating English speech into other languages, a setting which favors monolingual pretraining.We hope XLS-R can help to improve speech processing tasks for many more languages of the world.Models and code are available at www.github.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Depending on the number of languages used for training, XLSR supports 53 languages (XLSR [124]) and 128 languages (XLS-R [125]).”
From Audio Deepfake Detection: What Has Been Achieved and What Lies Ahead (2025) · cites this paper as [125]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Part of this paper’s reference list could not be split into single entries.
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344
Kaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,690
Momentum Contrast for Unsupervised Visual Representation Learning
He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00975 · Cited by 13,347
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
Research works printed but not linked: 1
- [2]2. Rosana Ardila, Megan Branson, Kelly Davis, Michael Henretty, Michael Kohler, Josh Meyer, Reuben Morais, Lindsay Saunders, Francis M. Tyers, and Gregor Weber. Common voice: A massivelymultilingual speech corpus. Proc. of LREC , 2020.
Cited by
Items 101–200 of 978
SpeechLLM-as-Judges: Towards General and Interpretable Speech Quality Evaluation
Wang, H., Zhao, J., Yang, Y., Liu, S., Chen, J., Zhang, Y., Zhao, S., Li, J., Zhou, J., Sun, H., et al. (2026) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2026.acl-long.349 · Cited by 31
A Study of Gender Impact in Self-supervised Models for Speech-to-Text Systems
Boito, M. Z., Besacier, L., Tomashenko, N., & Estève, Y. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-353 · Cited by 35
Rouditchenko, A., Khurana, S., Thomas, S., Feris, R., Karlinsky, L., Kuehne, H., Harwath, D. F., Kingsbury, B. E. D., & Glass, J. R. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-1061 · Cited by 37
Benchmarking Representations for Speech, Music, and Acoustic Events
Quatra, M. L., Koudounas, A., Vaiani, L., Baralis, E., Cagliero, L., Garza, P., & Siniscalchi, S. M. (2024) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw62465.2024.10625960 · Cited by 52
Improving mispronunciation detection and diagnosis for non- native learners of the Arabic language
Alrashoudi, N., Al-Khalifa, H. S., & Alotaibi, Y. A. (2025) · Discover Computing · doi:10.1007/s10791-024-09489-8 · Cited by 36
Leveraging unsupervised and weakly-supervised data to improve direct speech-to-speech translation
Ye, J., Ding, Y., Bapna, A., Cherry, C., Zhang, Y., Conneau, A., & Morioka, N. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10938 · Cited by 31
Self-citationWang, P., & hamme, H. V. (2023) · EURASIP Journal on Audio Speech and Music Processing · doi:10.1186/s13636-023-00280-z · Cited by 27
Yeo, E. J., Choi, K., Kim, S., & Chung, M. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094605 · Cited by 22
End-to-End Automated Speech Recognition Using a Character Based Small Scale Transformer Architecture
Loubser, A., de Villiers, P., & Freitas, A. D. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124119 · Cited by 21
He, Y., Seng, K. P., & Ang, L.-M. (2025) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2025.3570383 · Cited by 22
BLASER: A Text-Free Speech-to-Speech Translation Evaluation Metric
Chen, M., Duquenne, P.-A., Andrews, P., Kao, J., Mourachko, A., Schwenk, H., & Costa‐jussà, M. R. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.504 · Cited by 46
Understanding and Bridging the Modality Gap for Speech Translation
Fang, Q., & Feng, Y. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.884 · Cited by 38
PEIT: Bridging the Modality Gap with Pre-trained Models for End-to-End Image Translation
Zhu, S., Li, S., Lei, Y., & Xiong, D. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.751 · Cited by 21
Wang, B., Tang, Y., Wei, F., Ba, Z., & Ren, K. (2024) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2024.3492796 · Cited by 20
NANSY++: Unified Voice Synthesis with Neural Analysis and Synthesis
Choi, H.-S., Yang, J., Lee, J., & Kim, H. (2022) · arXiv · doi:10.48550/arxiv.2211.09407 · Cited by 20
Distillation and Pruning for Scalable Self-Supervised Representation-Based Speech Quality Assessment
Stahl, B., & Gamper, H. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888007 · Cited by 20
Lee, J. W., Kim, E., Koo, J., & Lee, K. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-11460 · Cited by 33
Unveiling Interpretability in Self-Supervised Speech Representations for Parkinson's Diagnosis
Gimeno-Gómez, D., Botelho, C., Pompili, A., Abad, A., & Martínez-Hinarejos, C.-D. (2025) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2025.3539845 · Cited by 37
SVDD 2024: The Inaugural Singing Voice Deepfake Detection Challenge
Zhang, Y., Zang, Y., Shi, J., Yamamoto, R., Toda, T., & Duan, Z. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832284 · Cited by 20
Robust Speaker Recognition with Transformers Using wav2vec 2.0Preprint
Novoselov, S. V., Lavrentyeva, G., Avdeeva, A., Volokhov, V., & Gusev, A. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.15095 · Cited by 29
Shi, J., Inaguma, H., Ma, X., Kulikov, I., & Sun, A. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.02720 · Cited by 21
Automatic Speech Recognition Advancements for Indigenous Languages of the Americas
Romero, M. P., Gómez-Canaval, S., & Torre, I. G. (2024) · Applied Sciences · doi:10.3390/app14156497 · Cited by 23
Bloom Library: Multimodal Datasets in 300+ Languages for a Variety of Downstream Tasks
Leong, C., Nemecek, J., Mansdorfer, J., Filighera, A., Owodunni, A., & Whitenack, D. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.590 · Cited by 39
Ferraz, T. P., Boito, M. Z., Brun, C., & Nikoulina, V. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447520 · Cited by 37
Training-Free Deepfake Voice Recognition by Leveraging Large-Scale Pre-Trained Models
Pianese, A., Cozzolino, D., Poggi, G., & Verdoliva, L. (2024) · ACM Workshop on Information Hiding and Multimedia Security (IH&MMSec) · doi:10.1145/3658664.3659662 · Cited by 27
Sankar, A., Jain, S., Narasimhan, N., Choudhary, D., Suman, D., Khan, M. S. U. R., Kunchukuttan, A., Khapra, M. M., & Dabre, R. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-long.1582 · Cited by 26
Paralinguistics-Aware Speech-Empowered Large Language Models for Natural Conversation
Kim, H., Seo, S., Jeong, K., Kwon, O., Kim, S. Y., Kim, J., Lee, J., Song, E., Oh, M., Ha, J.-W., et al. (2024) · neural information processing systems · doi:10.52202/079017-4166 · Cited by 43
De’hubert: Disentangling Noise in a Self-Supervised Model for Robust Speech Recognition
Ng, D., Zhang, R., Yip, J. Q., Yang, Z., Ni, J., Zhang, C., Ma, Y., Ni, C., Chng, E. S., & Ma, B. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096603 · Cited by 19
Simple and Effective Unsupervised Speech Translation
Wang, C., Inaguma, H., Chen, P., Kulikov, I., Tang, Y., Hsu, W.-N., Auli, M., & Pino, J. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.602 · Cited by 24
Self-citationEMO-SUPERB: An In-depth Look at Speech Emotion RecognitionPreprint
Wu, H., Chou, H.-C., Chang, K.-W., Goncalves, L., Du, J., Jang, J. R., Lee, C.-C., & Lee, H.-Y. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.13018 · Cited by 37
Self-Supervised Pre-Training for Attention-Based Encoder-Decoder ASR Model
Gao, C., Cheng, G., Ta, L., Zhang, P., & Yan, Y. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3171967 · Cited by 18
ArTST: Arabic Text and Speech Transformer
Toyin, H. O., Djanibekov, A., Kulkarni, A., & Aldarmaki, H. (2023) · Arabic Natural Language Processing Conference (ArabicNLP) · doi:10.18653/v1/2023.arabicnlp-1.5 · Cited by 31
Emo-bias: A Large Scale Evaluation of Social Bias on Speech Emotion Recognition
Lin, Y., Wu, H., Chou, H.-C., Lee, C.-C., & Lee, H.-Y. (2024) · Interspeech (USB) · doi:10.21437/interspeech.2024-1073 · Cited by 18
Singing Voice Graph Modeling for SingFake Detection
Chen, X., Wu, H., Jang, R., & Lee, H.-Y. (2024) · Interspeech (USB) · doi:10.21437/interspeech.2024-1185 · Cited by 33
Qureshi, R., Sapkota, R., Shah, A., Muneer, A., Zafar, A. M., Vayani, A., Shoman, M., Eldaly, A. B. M., Zhang, K., Sadak, F., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2507.00951 · Cited by 21
Open-Emotion: A Reproducible EMO-Superb For Speech Emotion Recognition Systems
Wu, H., Chou, H.-C., Chang, K.-W., Goncalves, L., Du, J., Jang, J. R., Lee, C.-C., & Lee, H.-Y. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832296 · Cited by 17
Oh, H.-S., Lee, S.-H., Cho, D., & Lee, S. (2025) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2025.3530920 · Cited by 30
Vec-Tok Speech: Speech Vectorization and Tokenization for Neural Speech Generation
Zhu, X., Lv, Y., Lei, Y., Li, T., He, W., Zhou, H., Lu, H., & Xie, L. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3546559 · Cited by 20
Lehečka, J., Švec, J., Pražák, A., & Psutka, J. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10439 · Cited by 17
Improving Language Identification of Accented Speech
Kukk, K., & Alumäe, T. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10455 · Cited by 17
Federated Self-supervised Speech Representations: Are We There Yet?
Gao, Y., Fernández-Marqués, J., Parcollet, T., Mehrotra, A., & Lane, N. D. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10644 · Cited by 22
Thienpondt, J., & Demuynck, K. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10964 · Cited by 18
Gong, L., Zhang, J., Wei, M., Zhang, H., & Huang, Z. (2023) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3569934 · Cited by 27
Comprehensive Layer-wise Analysis of SSL Models for Audio Deepfake Detection
El Kheir, Y., Samih, Y., Maharjan, S., Polzehl, T., & Möller, S. (2025) · Findings of the Association for Computational Linguistics: NAACL 2025 · doi:10.18653/v1/2025.findings-naacl.227 · Cited by 16
T-Modules: Translation Modules for Zero-Shot Cross-Modal Machine Translation
Duquenne, P.-A., Gong, H., Sagot, B., & Schwenk, H. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.391 · Cited by 16
EmphAssess : a Prosodic Benchmark on Assessing Emphasis Transfer in Speech-to-Speech Models
de Seyssel, M., D’Avirro, A., Williams, A., & Emmanuel Dupoux, A. (2024) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2024.emnlp-main.30 · Cited by 16
Lin, H.-C., Lin, Y.-C., Chou, H.-C., & Lee, H.-Y. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10887615 · Cited by 24
Finnish parliament ASR corpus: Analysis, benchmarks and statistics
Virkkunen, A., Rouhe, A., Phan, N., & Kurimo, M. (2023) · Language Resources and Evaluation · doi:10.1007/s10579-023-09650-7 · Cited by 28
Diacritic Recognition Performance in Arabic ASR
Aldarmaki, H., & Ghannam, A. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-2344 · Cited by 30
Arisaputra, P., Handoyo, A. T., & Zahra, A. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2401.06832 · Cited by 16
Generalizable Audio Deepfake Detection via Latent Space Refinement and Augmentation
Huang, W., Gu, Y., Wang, Z., Zhu, H., & Qian, Y. (2025) · arXiv · doi:10.48550/arxiv.2501.14240 · Cited by 16
Dong, Z., Zhang, Z., Xu, W., Han, J., Ou, J., & Schuller, B. W. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446795 · Cited by 19
Pushing the Limits of Zero-shot End-to-End Speech Translation
Tsiamas, I., Gállego, G. I., Fonollosa, J., & Costa‐jussà, M. R. (2024) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2024.findings-acl.847 · Cited by 32
Deep Learning Framework for Speech Emotion Classification: A Survey of the State-of-the-Art
Akinpelu, S. A., & Viriri, S. (2024) · IEEE Access · doi:10.1109/access.2024.3474553 · Cited by 20
Respiratory sounds classification by fusing the time-domain and 2D spectral features
Dong, G., Shen, Y., Wang, J., Zhang, M., Sun, P., & Zhang, M. (2025) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2025.107790 · Cited by 15
Speech Resources in the Tamasheq Language
Boito, M. Z., Bougares, F., Barbier, F., Gahbiche, S., Barrault, L., Rouvier, M., & Estève, Y. (2022) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/2mt7chqqfiay · Cited by 32
ON-TRAC Consortium Systems for the IWSLT 2022 Dialect and Low-resource Speech Translation Tasks
Boito, M. Z., Ortega, J., Riguidel, H., Laurent, A., Barrault, L., Bougares, F., Chaabani, F., Nguyen, H., Barbier, F., Gahbiche, S., et al. (2022) · International Conference on Spoken Language Translation (IWSLT) · doi:10.18653/v1/2022.iwslt-1.28 · Cited by 30
Ji, H., Patel, T. B., & Scharenborg, O. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2206.12489 · Cited by 15
Martín-Doñas, J. M., Álvarez, A., Rosello, E., Gomez, A. M., & Peinado, A. M. (2024) · Interspeech 2024 · doi:10.21437/interspeech.2024-942 · Cited by 18
“In this work, we considered the Wav2Vec2 XLS-R-128 model proposed in [26] as the SSL embeddings extractor.”
MethodWavLM model ensemble for audio deepfake detection
Combei, D., Stan, A., Oneata, D., & Cucu, H. (2024) · The Automatic Speaker Verification Spoofing Countermeasures Workshop (ASVspoof 2024) · doi:10.21437/asvspoof.2024-25 · Cited by 15
“The XLS-R 2B variant of wav2vec [17] is a large-scale model for cross-lingual speech representation learning based on wav2vec 2.0.”
BackgroundMethodInfluentialSLIM: Style-Linguistics Mismatch Model for Generalized Audio Deepfake Detection
Zhu, Y., Koppisetti, S., Tran, T., & Bharaj, G. (2024) · Advances in Neural Information Processing Systems 37 · doi:10.52202/079017-2168 · Cited by 14
Robust Spoof Speech Detection Based on Multi-Scale Feature Aggregation and Dynamic Convolution
Wu, H., Zhang, J., Zhang, Z., Zhao, W., Gu, B., & Guo, W. (2024) · ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp48485.2024.10446612 · Cited by 14
Stoykova, R., Porter, K., & Beka, T. (2024) · Forensic Science International Synergy · doi:10.1016/j.fsisyn.2024.100563 · Cited by 16
Trident of Poseidon: A Generalized Approach for Detecting Deepfake Voices
Doan, T.-P., Dinh-Xuan, H., Ryu, T., Kim, I., Lee, W., Hong, K., & Jung, S. (2024) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3658644.3690311 · Cited by 26
MUSA: Multi-Lingual Speaker Anonymization via Serial Disentanglement
Yao, J., Wang, Q., Guo, P., Ning, Z., Yang, Y., Pan, Y., & Xie, L. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3555115 · Cited by 25
SMILE: Speech Meta In-Context Learning for Low-Resource Language Automatic Speech Recognition
Hsu, M.-H., & Lee, H.-Y. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11434760 · Cited by 14
Tjandra, A., Singhal, N., Zhang, D., Kalinli, O., Mohamed, A., Le, D., & Seltzer, M. L. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094667 · Cited by 31
Self-citationVoxArabica: A Robust Dialect-Aware Arabic Speech Recognition System
Waheed, A., Talafha, B., Sullivan, P., Elmadany, A., & Abdul-Mageed, M. (2023) · Arabic Natural Language Processing Conference (ArabicNLP) · doi:10.18653/v1/2023.arabicnlp-1.38 · Cited by 24
The First VoicePrivacy Attacker Challenge Evaluation PlanPreprint
Tomashenko, N., Miao, X., Vincent, E., & Yamagishi, J. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.07428 · Cited by 23
ESB: A Benchmark For Multi-Domain End-to-End Speech Recognition
Gandhi, S., von Platen, P., & Rush, A. M. (2022) · arXiv · doi:10.48550/arxiv.2210.13352 · Cited by 13
Tsiamas, I., Gállego, G. I., Escolano, C., Fonollosa, J., & Costa‐jussà, M. R. (2022) · International Conference on Spoken Language Translation (IWSLT) · doi:10.18653/v1/2022.iwslt-1.23 · Cited by 13
Dual-Branch Knowledge Distillation for Noise-Robust Synthetic Speech Detection
Fan, C., Ding, M., Tao, J., Fu, R., Yi, J., Wen, Z., & Lv, Z. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3389643 · Cited by 19
CPT-Boosted Wav2vec2.0: Towards Noise Robust Speech Recognition for Classroom Environments
Attia, A. A., Demszky, D., Ògúnremí, T., Liu, J., & Espy-Wilson, C. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890830 · Cited by 21
Learning ASR Pathways: A Sparse Multilingual ASR Model
Yang, M., Tjandra, A., Liu, C., Zhang, D., Le, D., & Kalinli, O. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094300 · Cited by 13
Self-citationHyperConformer: Multi-head HyperMixer for Efficient Speech Recognition
Mai, F., Zuluaga-Gómez, J., Parcollet, T., & Motlíček, P. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-1611 · Cited by 17
Improving Grammatical Error Correction with Multimodal Feature Integration
Fang, T., Hu, J., Wong, D. F., Wan, X., Chao, L. S., & Chang, T. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.594 · Cited by 23
The defender's perspective on automatic speaker verification: An overviewPreprint
Wu, H., Kang, J., Meng, L., Meng, H. M. L., & Lee, H.-Y. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.12804 · Cited by 22
Low-rank Adaptation Method for Wav2vec2-based Fake Audio DetectionPreprint
Wang, C., Yi, J., Zhang, X., Tao, J., Xu, L., & Fu, R. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2306.05617 · Cited by 25
Self-citationOWLS: Scaling Laws for Multilingual Speech Recognition and Translation ModelsPreprint
Chen, W., Tian, J., Peng, Y., Yan, B., Yang, C.-H. H., & Watanabe, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2502.10373 · Cited by 29
Voila: Voice-Language Foundation Models for Real-Time Autonomous Interaction and Voice Role-PlayPreprint
Shi, Y., Shu, Y., Dong, S., Liu, G., Sesay, J., Li, J., & Hu, Z. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.02707 · Cited by 21
Whisper-LM: Improving ASR Models with Language Models for Low-Resource LanguagesPreprint
de Zuazo, X., Navas, E., Saratxaga, I., & Rioja, I. H. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.23542 · Cited by 19
Ahn, T., Hong, Y., Im, Y., Kim, D. H., Kang, D., Jeong, J. W., Kim, J. W., Kim, M. J., Cho, A., Nam, H., et al. (2024) · Clinical Linguistics & Phonetics · doi:10.1080/02699206.2024.2387609 · Cited by 20
Learn and Don't Forget: Adding a New Language to ASR Foundation Models
Qian, M., Tang, S., Ma, R., Knill, K., & Gales, M. (2024) · Interspeech (USB) · doi:10.21437/interspeech.2024-1045 · Cited by 34
Dong, Z., Xu, W., Xu, X., & Zhang, Z. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2025.3546950 · Cited by 13
AccentBox: Towards High-Fidelity Zero-Shot Accent Generation
Zhong, J., Richmond, K., Su, Z., & Sun, S. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888332 · Cited by 34
Enhancing Expressive Voice Conversion with Discrete Pitch-Conditioned Flow Matching Model
Zuo, J., Ji, S., Fang, M., Jiang, Z. K., Cheng, X., Yang, Q., Liu, W., Zhang, G., Tu, Z., Guo, Y., et al. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889108 · Cited by 18
Are audio DeepFake detection models polyglots?
Marek, B., Kawa, P., & Syga, P. (2025) · Symposium on Security and Privacy in Speech Communication (SPSC) · doi:10.21437/spsc.2025-8 · Cited by 14
Phuong, T. D., Hoang, L.-V., & Tran, H. D. (2025) · Interspeech (USB) · doi:10.21437/interspeech.2025-1411 · Cited by 16
Xuan, X., Zhu, Z., Zhang, W., Lin, Y.-C., & Kinnunen, T. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11434679 · Cited by 22
Close, G., Ravenscroft, W., Hain, T., & Goetze, S. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095666 · Cited by 22
Cocktail Hubert: Generalized Self-Supervised Pre-Training for Mixture and Single-Source Speech
Fazel-Zarandi, M., & Hsu, W.-N. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096630 · Cited by 21
STT4SG-350: A Speech Corpus for All Swiss German Dialect Regions
Plüss, M., Deriu, J., Schraner, Y., Paonessa, C., Hartmann, J., Schmidt, L., Scheller, C., Hürlimann, M., Samardżić, T., Vogel, M., et al. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-short.150 · Cited by 12
ITALIC: An Italian Intent Classification Dataset
Koudounas, A., Quatra, M. L., Vaiani, L., Colomba, L., Attanasio, G., Pastor, E., Cagliero, L., & Baralis, E. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-1980 · Cited by 25
Direct speech-to-speech neural machine translation: A survey
Gupta, M., Dutta, M., & Maurya, C. K. (2025) · Speech Communication · doi:10.1016/j.specom.2025.103317 · Cited by 19
Fake Speech Wild: Detecting Deepfake Speech on Social Media Platform
Xie, Y., Fu, R., Wang, X., Wang, Z., Li, Y., Gao, Y., Wen, Z., Cheng, H., & Ye, L. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11461877 · Cited by 13
BEA-Base: A Benchmark for ASR of Spontaneous Hungarian
Mihajlik, P., Balog, A., Gráczi, T. E., Kohári, A., Tarján, B., & Mády, K. (2022) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/3gsn6yj7i7oq · Cited by 25
Agüero-Torales, M. M., López-Herrera, A. G., & Vilares, D. (2023) · Cognitive Computation · doi:10.1007/s12559-023-10165-0 · Cited by 17
Direct Text to Speech Translation System Using Acoustic Units
Mingote, V., Gimeno, P., Vicente, L., Khurana, S., Laurent, A., & Duret, J. (2023) · IEEE Signal Processing Letters · doi:10.1109/lsp.2023.3313513 · Cited by 11
The Applicability of Wav2Vec2 and Whisper for Low-Resource Maltese ASR
Williams, A., DeMarco, A., & Borg, C. (2023) · doi:10.21437/sigul.2023-9 · Cited by 18
Yusuyin, S., Ma, T., Huang, H., Zhao, W., & Ou, Z. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3550683 · Cited by 32
Metadata
- Authors
- Babu, A., Wang, C., Tjandra, A., Lakhotia, K., Xu, Q., Goyal, N., Singh, K., von Platen, P., Saraf, Y., Pino, J., Baevski, A., Conneau, A., & Auli, M.
- Venue
- Interspeech 2022
- Publisher
- ISCA
- Published
- 2022-09-18
- Pages
- 2278-2282
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W3213029956
- Cited by
- 586
- References
- 74
- Citations by year
- 2026: 110 · 2025: 182 · 2024: 120 · 2023: 131 · 2022: 43
- FWCI
- 65.75
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- cc-by
- Locations
- Interspeech (USB) (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
- Keywords
- XLS-R, self-supervised pre-training, wav2vec 2.0, multilingual speech models, speech translation, speech recognition, language identification, low-resource languages
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.