XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale
Open accessThe DOI matches its Crossref record; 75 of the 75 references it cites were found in a registry or an index.
Abstract
This paper presents XLS-R, a large-scale model for cross-lingual speech representation learning based on wav2vec 2.0.We train models with up to 2B parameters on nearly half a million hours of publicly available speech audio in 128 languages, an order of magnitude more public data than the largest known prior work.Our evaluation covers a wide range of tasks, domains, data regimes and languages, both high and low-resource.On the CoVoST-2 speech translation benchmark, we improve the previous state of the art by an average of 7.4 BLEU over 21 translation directions into English.For speech recognition, XLS-R improves over the best known prior work on BABEL, MLS, CommonVoice as well as VoxPopuli, lowering error rates by 14-34% relative on average.XLS-R also sets a new state of the art on VoxLin-gua107 language identification.Moreover, we show that with sufficient model size, cross-lingual pretraining can perform as well as English-only pretraining when translating English speech into other languages, a setting which favors monolingual pretraining.We hope XLS-R can help to improve speech processing tasks for many more languages of the world.Models and code are available at www.github.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Depending on the number of languages used for training, XLSR supports 53 languages (XLSR [124]) and 128 languages (XLS-R [125]).”
From Audio Deepfake Detection: What Has Been Achieved and What Lies Ahead (2025) · cites this paper as [125]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Part of this paper’s reference list could not be split into single entries.
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344
Kaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,690
Momentum Contrast for Unsupervised Visual Representation Learning
He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00975 · Cited by 13,347
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
Research works printed but not linked: 1
- [2]2. Rosana Ardila, Megan Branson, Kelly Davis, Michael Henretty, Michael Kohler, Josh Meyer, Reuben Morais, Lindsay Saunders, Francis M. Tyers, and Gregor Weber. Common voice: A massivelymultilingual speech corpus. Proc. of LREC , 2020.
Cited by
Robust Speech Recognition via Large-Scale Weak Supervision
Radford, A., Kim, J. W., Xu, T., Brockman, G., McLeavey, C., & Sutskever, I. (2022) · arXiv · doi:10.48550/arxiv.2212.04356 · Cited by 1,953
A comprehensive survey on applications of transformers for deep learning tasks
Islam, S., Elmekki, H., Elsebai, A., Bentahar, J., Drawel, N., Rjoub, G., & Pedrycz, W. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122666 · Cited by 487
Dawn of the Transformer Era in Speech Emotion Recognition: Closing the Valence Gap
Wagner, J., Triantafyllopoulos, A., Wierstorf, H., Schmitt, M., Burkhardt, F., Eyben, F., & Schuller, B. W. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3263585 · Cited by 395
FLEURS: FEW-Shot Learning Evaluation of Universal Representations of Speech
Conneau, A., Ma, M., Khanuja, S., Zhang, Y., Axelrod, V., Dalmia, S., Riesa, J., Rivera, C., & Bapna, A. (2023) · 2022 IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt54892.2023.10023141 · Cited by 197
Self-citationA review of deep learning techniques for speech processing
Mehrish, A., Majumder, N., Bharadwaj, R., Mihalcea, R., & Poria, S. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101869 · Cited by 389
Google USM: Scaling Automatic Speech Recognition Beyond 100 LanguagesPreprint
Zhang, Y., Han, W., Qin, J., Wang, Y.-Q., Bapna, A., Chen, Z., Chen, N., Li, B., Axelrod, V., Wang, G., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2303.01037 · Cited by 507
Self-supervised speech representation learning: A review
Mohamed, A., Lee, H.-Y., Borgholt, L., Havtorn, J. D., Edin, J., Igel, C., Kirchhoff, K., Li, S.-W., Livescu, K., Maaløe, L., et al. (2022) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3207050 · Cited by 372
“and conventionally used for evaluation, while their audio streams are also aggregated to build diversified and large-scale corpora for unsupervised pre-training [109], [123], [218].”
BackgroundInfluentialEstonian Speech Recognition and Transcription Editing Service
Olev, A., & Alumäe, T. (2022) · Baltic Journal of Modern Computing · doi:10.22364/bjmc.2022.10.3.14 · Cited by 315
Tak, H., Todisco, M., Wang, X., Jung, J.-W., Yamagishi, J., & Evans, N. (2022) · The Speaker and Language Recognition Workshop (Odyssey 2022) · doi:10.21437/odyssey.2022-16 · Cited by 237
Prompting Large Language Models with Speech Recognition Abilities
Fathullah, Y., Wu, C., Lakomkin, E., Jia, J., Shangguan, Y., Li, K., Guo, J., Xiong, W., Mahadeokar, J., Kalinli, O., et al. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447605 · Cited by 256
Recent Advances in Speech Language Models: A Survey
Cui, W., Yu, D., Jiao, X., Meng, Z., Zhang, G., Wang, Q., Guo, S. Y., & King, I. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-long.682 · Cited by 220
A Survey of Reasoning with Foundation ModelsPreprint
Sun, J., Zheng, C., Xie, E., Liu, Z., Chu, R., Liu, J., Xu, J., Ding, M., Li, H., Geng, M., et al. (2023) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/ac4sp · Cited by 158
Using transformers for multimodal emotion recognition: Taxonomies and state of the art review
Hazmoune, S., & Bougamouza, F. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.108339 · Cited by 167
mSLAM: Massively multilingual joint pre-training for speech and textPreprint
Bapna, A., Cherry, C., Zhang, Y., Ye, J., Johnson, M., Cheng, Y., Khanuja, S., Riesa, J., & Conneau, A. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.01374 · Cited by 155
Self-citationWavChat: A Survey of Spoken Dialogue ModelsPreprint
Ji, S., Chen, Y., Fang, M., Zuo, J., Lu, J., Wang, H., Jiang, Z., Zhou, L., Liu, S., Cheng, X., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2411.13577 · Cited by 167
Large Concept Models: Language Modeling in a Sentence Representation SpacePreprint
LCM Team, Barrault, L., Duquenne, P.-A., Elbayad, M., Kozhevnikov, A., Alastruey, B., Andrews, P., Meglioli, M. C., Couairon, G., Costa‐jussà, M. R., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2412.08821 · Cited by 174
Scaling Speech Technology to 1, 000+ Languages
Pratap, V., Tjandra, A., Shi, B., Tomasello, P., Babu, A., Kundu, S., Elkahky, A., Ni, Z., Vyas, A., Fazel-Zarandi, M., et al. (2023) · arXiv · doi:10.48550/arxiv.2305.13516 · Cited by 116
Self-citationSONAR: Sentence-Level Multimodal and Language-Agnostic RepresentationsPreprint
Duquenne, P.-A., Schwenk, H., & Sagot, B. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2308.11466 · Cited by 164
Pfeiffer, J., Ruder, S., Vulić, I., & Ponti, E. M. (2023) · Transactions on machine learning research · doi:10.48550/arxiv.2302.11529 · Cited by 172
Transformers in speech processing: Overcoming challenges and paving the future
Latif, S., Zaidi, S. A. M., Cuayáhuitl, H., Shamshad, F., Shoukat, M., Usama, M., & Qadir, J. (2025) · Computer Science Review · doi:10.1016/j.cosrev.2025.100768 · Cited by 126
A Survey on Speech Deepfake Detection
Li, M., Ahmadiadli, Y., & Zhang, X.-P. (2025) · ACM Computing Surveys · doi:10.1145/3714458 · Cited by 101
The Vicomtech Audio Deepfake Detection System Based on Wav2vec2 for the 2022 ADD Challenge
Martin-Donas, J. M., & Alvarez, A. (2022) · ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp43922.2022.9747768 · Cited by 100
Self-supervised Learning with Random-projection Quantizer for Speech RecognitionPreprint
Chiu, C., Qin, J., Zhang, Y., Yu, J., & Wu, Y. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.01855 · Cited by 270
Sekoyan, M., Koluguri, N. R., Tadevosyan, N., Zelasko, P., Bartley, T., Karpov, N., Balam, J., & Ginsburg, B. (2025) · arXiv · doi:10.48550/arxiv.2509.14128
Audio Deepfake Detection With Self-Supervised WavLM And Multi-Fusion Attentive Classifier
Guo, Y., Huang, H., Chen, X., Zhao, H., & Wang, Y. (2024) · ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp48485.2024.10447923 · Cited by 95
MAESTRO: Matched Speech Text Representations through Modality Matching
Chen, Z., Zhang, Y., Rosenberg, A., Ramabhadran, B., Moreno, P. J., Bapna, A., & Zen, H. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10937 · Cited by 127
Omnilingual ASR: Open-Source Multilingual Speech Recognition for 1600+ LanguagesPreprint
Omnilingual SONAR Team, Keren, G., Kozhevnikov, A., Meng, Y., Ropers, C., Setzler, M., Wang, S., Adebara, I., Auli, M., Balioglu, C., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.09690 · Cited by 121
Self-citationDou, F., Ye, J., Yuan, G., Lu, Q., Niu, W., Sun, H., Guan, L., Lu, G., Mai, G., Liu, N., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2309.07438 · Cited by 117
Zhao, J. S., & Zhang, W.-Q. (2022) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3184480 · Cited by 126
Audio Deepfake Detection with Self-Supervised XLS-R and SLS Classifier
Zhang, Q., Wen, S., & Hu, T. (2024) · Proceedings of the 32nd ACM International Conference on Multimedia · doi:10.1145/3664647.3681345 · Cited by 56
AI-Synthesized Voice Detection Using Neural Vocoder Artifacts
Sun, C., Jia, S., Hou, S., & Lyu, S. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00097 · Cited by 81
CVSS Corpus and Massively Multilingual Speech-to-Speech Translation
Ye, J., Ramanovich, M. T., Wang, Q., & Zen, H. (2022) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/38skf3jhvobn · Cited by 158
ML-SUPERB: Multilingual Speech Universal PERformance Benchmark
Shi, J., Berrebbi, D., Chen, W., Hu, E.-P., Huang, W.-P., Chung, H.-L., Chang, X., Li, S.-W. D., Mohamed, A., Lee, H.-Y., et al. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-1316 · Cited by 75
Ethical Challenges in the Development of Virtual Assistants Powered by Large Language Models
Piñeiro-Martín, A., García-Mateo, C., Docío-Fernández, L., & López-Pérez, M. D. C. (2023) · Electronics · doi:10.3390/electronics12143170 · Cited by 64
Less is More: Accurate Speech Recognition & Translation without Web-Scale Data
Puvvada, K. C., Żelasko, P., Huang, H., Hrinchuk, O., Koluguri, N. R., Dhawan, K., Majumdar, S., Rastorgueva, E., Chen, Z., Lavrukhin, V., et al. (2024) · Interspeech (USB) · doi:10.21437/interspeech.2024-2294 · Cited by 129
Audio Deepfake Detection: What Has Been Achieved and What Lies Ahead
Zhang, B., Cui, H., Nguyen, V., & Whitty, M. (2025) · Sensors · doi:10.3390/s25071989 · Cited by 72
Fake Audio Detection Based On Unsupervised Pretraining Models
Lv, Z., Zhang, S., Tang, K., & Hu, P. (2022) · ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp43922.2022.9747605 · Cited by 56
Bartelds, M., San, N., McDonnell, B., Jurafsky, D., & Wieling, M. B. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.42 · Cited by 120
Froiz-Míguez, I., Fraga‐Lamas, P., & Fernández‐Caramés, T. M. (2023) · IEEE Access · doi:10.1109/access.2023.3286391 · Cited by 71
The Codecfake Dataset and Countermeasures for the Universally Detection of Deepfake Audio
Xie, Y., Lu, Y., Fu, R., Wen, Z., Wang, Z., Tao, J., Qi, X., Wang, X., Liu, Y., Cheng, H., et al. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3525966 · Cited by 111
ChatVideo: A Tracklet-centric Multimodal and Versatile Video Understanding SystemPreprint
Wang, J., Chen, D., Luo, C., Dai, X., Yuan, L., Wu, Z., & Jiang, Y. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2304.14407 · Cited by 86
A Robust Audio Deepfake Detection System via Multi-View Feature
Yang, Y., Qin, H., Zhou, H., Wang, C., Guo, T., Han, K., & Wang, Y. (2024) · ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp48485.2024.10446560 · Cited by 61
Self-citationDomain Generalization via Aggregation and Separation for Audio Deepfake Detection
Xie, Y., Cheng, H., Wang, Y., & Ye, L. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3324724 · Cited by 59
Recent Advances in Discrete Speech Tokens: A Review
Guo, Y., Li, Z., Wang, H., Li, B., Shao, C., Zhang, H., Du, C., Chen, X., Liu, S., & Yu, K. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3643619 · Cited by 95
Lee, S.-H., Choi, H.-Y., Kim, S.-B., & Lee, S. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3584944 · Cited by 73
Reproducing Whisper-Style Training Using An Open-Source Toolkit And Publicly Available Data
Peng, Y., Tian, J., Yan, B., Berrebbi, D., Chang, X., Li, X., Shi, J., Arora, S., Chen, W., Sharma, R., et al. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389676 · Cited by 135
XLSR-Mamba: A Dual-Column Bidirectional State Space Model for Spoofing Attack Detection
Xiao, Y., & Das, R. K. (2025) · IEEE Signal Processing Letters · doi:10.1109/lsp.2025.3547861 · Cited by 103
The VoicePrivacy 2022 Challenge Evaluation PlanPreprint
Tomashenko, N., Wang, X., Miao, X., Nourtel, H., Champion, P., Todisco, M., Vincent, E., Evans, N., Yamagishi, J., & Bonastre, J.-F. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.12468 · Cited by 94
IndicSUPERB: A Speech Processing Universal Performance Benchmark for Indian Languages
Javed, T., Bhogale, K. S., Raman, A., Kumar, P., Kunchukuttan, A., & Khapra, M. M. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i11.26521 · Cited by 110
A conformer-based classifier for variable-length utterance processing in anti-spoofing
Rosello, E., Gomez-Alanis, A., Gomez, A. M., & Peinado, A. (2023) · INTERSPEECH 2023 · doi:10.21437/interspeech.2023-1820 · Cited by 47
ByT5 model for massively multilingual grapheme-to-phoneme conversion
Zhu, J. Y., Zhang, C., & Jurgens, D. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-538 · Cited by 47
SAMU-XLSR: Semantically-Aligned Multimodal Utterance-Level Cross-Lingual Speech Representation
Khurana, S., Laurent, A., & Glass, J. R. (2022) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3192714 · Cited by 84
SHAS: Approaching optimal Segmentation for End-to-End Speech Translation
Tsiamas, I., Gállego, G. I., Fonollosa, J. A. R., & Costa‐jussà, M. R. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-59 · Cited by 75
Joint speech and text machine translation for up to 100 languages
SEAMLESS Communication Team, Barrault, L., Chung, Y.-A., Meglioli, M. C., Dale, D., Dong, N., Duquenne, P.-A., Elsahar, H., Gong, H., Heffernan, K. S., et al. (2025) · Nature · doi:10.1038/s41586-024-08359-z · Cited by 87
Self-citationSeamless: Multilingual Expressive and Streaming Speech Translation
Communication, S., Barrault, L., Chung, Y.-A., Meglioli, M. C., Dale, D., Dong, N., Duppenthaler, M., Duquenne, P.-A., Ellis, B., Elsahar, H., et al. (2023) · arXiv · doi:10.48550/arxiv.2312.05187 · Cited by 45
Self-citationIntroduction to Neural Transfer Learning With Transformers for Social Science Text Analysis
Wankmüller, S. (2022) · Sociological Methods & Research · doi:10.1177/00491241221134527 · Cited by 46
Guo, D., Zhang, S., Zhang, J., Yang, B., & Lin, Y. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3569776 · Cited by 46
Choi, H.-Y., Lee, S.-H., & Lee, S. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29740 · Cited by 80
Vásquez-Correa, J. C., & Álvarez, A. (2023) · Sensors · doi:10.3390/s23041843 · Cited by 46
Berisha, V., & Liss, J. M. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01199-1 · Cited by 41
6G toward Metaverse: Technologies, Applications, and Challenges
Peng, H., Chen, P.-C., Chen, P.-H., Yang, Y.-S., Hsia, C.-C., & Wang, L. (2022) · IEEE VTS Asia Pacific Wireless Communications Symposium (APWCS) · doi:10.1109/apwcs55727.2022.9906483 · Cited by 49
Self-Supervised ASR Models and Features for Dysarthric and Elderly Speech Recognition
Hu, S., Xie, X., Geng, M., Jin, Z., Deng, J., Li, G., Wang, Y., Cui, M., Wang, T., Meng, H. M. L., et al. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3422839 · Cited by 60
Wav2Seq: Pre-Training Speech-to-Text Encoder-Decoder Models Using Pseudo Languages
Wu, F., Kim, K., Watanabe, S., Han, K. J., McDonald, R., Weinberger, K. Q., & Artzi, Y. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096988 · Cited by 40
Enhancing Cross-Language Multimodal Emotion Recognition With Dual Attention Transformers
Zaidi, S. A. M., Latif, S., & Qadir, J. (2024) · IEEE Open Journal of the Computer Society · doi:10.1109/ojcs.2024.3486904 · Cited by 51
Attia, A. A., Liu, J., Ai, W., Demszky, D., & Espy-Wilson, C. (2024) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v7i1.31618 · Cited by 38
Let’s Go Real Talk: Spoken Dialogue Model for Face-to-Face Conversation
Park, S. J., Kim, C., Rha, H., Kim, M., Hong, J. H., Yeo, J. H., & Ro, Y. M. (2024) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2024.acl-long.860 · Cited by 73
Parcollet, T., Nguyen, H., Evain, S. V., Boito, M. Z., Pupier, A., Mdhaffar, S., Le, H., Alisamir, S., Tomashenko, N., Dinarelli, M., et al. (2024) · Computer Speech & Language · doi:10.1016/j.csl.2024.101622 · Cited by 59
Quatra, M. L., Turco, M. F., Svendsen, T. K., Salvi, G., Orozco‐Arroyave, J. R., & Siniscalchi, S. M. (2024) · Interspeech (USB) · doi:10.21437/interspeech.2024-522 · Cited by 36
Findings of the VarDial Evaluation Campaign 2023
Aepli, N., Çöltekin, Ç., van der Goot, R., Jauhiainen, T., Kazzaz, M., Ljubešić, N., North, K., Plank, B., Scherrer, Y., & Zampieri, M. (2023) · Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial) · doi:10.18653/v1/2023.vardial-1.25 · Cited by 36
GenTranslate: Large Language Models are Generative Multilingual Speech and Machine Translators
Hu, Y., Chen, C., Yang, C.-H. H., Li, R., Zhang, D., Chen, Z., & Chng, E. S. (2024) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2024.acl-long.5 · Cited by 53
Yodas: Youtube-Oriented Dataset for Audio and Speech
Li, X., Takamichi, S., Saeki, T., Chen, W., Shiota, S., & Watanabe, S. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389689 · Cited by 125
Textless Unit-to-Unit Training for Many-to-Many Multilingual Speech-to-Speech Translation
Kim, M., Choi, J., Kim, D., & Ro, Y. M. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3444470 · Cited by 46
Sparsely Shared Lora on Whisper for Child Speech Recognition
Liu, W., Qin, Y. H., Peng, Z., & Lee, T. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447004 · Cited by 59
Neural representations for modeling variation in speech
Bartelds, M., de Vries, W., Sanal, F., Richter, C., Liberman, M., & Wieling, M. B. (2022) · Journal of Phonetics · doi:10.1016/j.wocn.2022.101137 · Cited by 57
Nowakowski, K., Ptaszynski, M. E., Murasaki, K., & Nieuważny, J. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.103148 · Cited by 51
Improving Massively Multilingual ASR with Auxiliary CTC Objectives
Chen, W., Yan, B., Shi, J., Peng, Y., Maiti, S., & Watanabe, S. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095326 · Cited by 55
Bridging the Data Provenance Gap Across Text, Speech and Video
Longpre, S., Singh, N., Cherep, M., Tiwary, K., Materzyńska, J., Brannon, W., Mahari, R., Obeng-Marnu, N., Dey, M., Hamdy, M., et al. (2024) · International Conference on Learning Representations · doi:10.48550/arxiv.2412.17847 · Cited by 51
Casablanca: Data and Models for Multidialectal Arabic Speech Recognition
Talafha, B., Kadaoui, K., Magdy, S. M., Habiboullah, M., Chafei, C. M., El-Shangiti, A. O., Zayed, H., Tourad, M. C., Alhamouri, R., Assi, R., et al. (2024) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2024.emnlp-main.1211 · Cited by 37
Cai, Z., & Li, M. (2023) · Computer Speech & Language · doi:10.1016/j.csl.2023.101597 · Cited by 44
The VoxCeleb Speaker Recognition Challenge: A Retrospective
Huh, J., Chung, J. S., Nagrani, A., Brown, A., Jung, J.-W., Garcia-Romero, D., & Zisserman, A. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3444456 · Cited by 43
The VoicePrivacy 2020 Challenge Evaluation PlanPreprint
Tomashenko, N., Srivastava, B. M. L., Wang, X., Vincent, E., Nautsch, A., Yamagishi, J., Evans, N., Patino, J., Bonastre, J.-F., Noé, .-G., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2205.07123 · Cited by 39
XTREME-S: Evaluating Cross-lingual Speech Representations
Conneau, A., Bapna, A., Zhang, Y., Ma, M., von Platen, P., Lozhkov, A., Cherry, C., Ye, J., Rivera, C., Kale, M., et al. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10007 · Cited by 44
Self-citationGeneralizable Audio Deepfake Detection via Latent Space Refinement and Augmentation
Huang, W. C., Gu, Y., Wang, Z., Zhu, H., & Qian, Y. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888328 · Cited by 45
A comprehensive survey with critical analysis for deepfake speech detection
Pham, L. D., Lam, P., Tran, D., Tang, H., Nguyen, T., Schindler, A., Skopik, F., Polonsky, A., & Vu, H. C. (2025) · Computer Science Review · doi:10.1016/j.cosrev.2025.100757 · Cited by 43
Efficient Self-Supervised Learning Representations for Spoken Language Identification
Liu, H., Garcia, L. P., Khong, A. W. H., Chng, E. S., Styles, S. J., & Khudanpur, S. P. (2022) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3201445 · Cited by 40
Xie, Y., Cheng, H., Wang, Y., & Ye, L. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448196 · Cited by 47
Zuluaga-Gómez, J., Nigmatulina, I., Prasad, A., Motlíček, P., Khalil, D., Madikeri, S. R., Tart, A., Szöke, I., Lenders, V., Rigault, M., et al. (2023) · Aerospace · doi:10.3390/aerospace10100898 · Cited by 26
Adnan, T., Abdelkader, A., Liu, Z., Hossain, E., Park, S., Islam, M. S., & Hoque, M. E. (2025) · npj Parkinson s Disease · doi:10.1038/s41531-025-00956-7 · Cited by 30
Post-training for Deepfake Speech Detection
Ge, W., Wang, X., Liu, X., & Yamagishi, J. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11434709 · Cited by 36
Textless Direct Speech-to-Speech Translation with Discrete Speech Representation
Li, X., Ye, J., & Chiu, C. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096797 · Cited by 41
DUB: Discrete Unit Back-translation for Speech Translation
Zhang, D., Ye, R., Ko, T., Wang, M., & Zhou, Y. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.447 · Cited by 35
Hwang, J.-S., Lee, S.-H., & Lee, S.-W. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106762 · Cited by 39
Adaptive multilingual speech recognition with pretrained models
Pham, N.-Q., Waibel, A. H., & Niehues, J. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-872 · Cited by 34
N-Shot Benchmarking of Whisper on Diverse Arabic Speech Recognition
Talafha, B., Waheed, A., & Abdul-Mageed, M. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-1044 · Cited by 40
Speech- and text-based classification of neuropsychiatric conditions in a multidiagnostic setting
Hansen, L., Rocca, R., Simonsen, A., Olsen, L. R., Parola, A., Bliksted, V., Ladegaard, N., Bang, D., Tylén, K., Weed, E., et al. (2023) · Nature Mental Health · doi:10.1038/s44220-023-00152-7 · Cited by 29
AfriSpeech-200: Pan-African Accented Speech Dataset for Clinical and General Domain ASR
Olatunji, T., Afonja, T., Yadavalli, A., Emezue, C. C., Singh, S., Dossou, B. F. P., Osuchukwu, J., Osei, S., Tonja, A. L., Etori, N. A., et al. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00627 · Cited by 82
Réby, K., Guilhelm, A., & Luca, L. D. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00184 · Cited by 33
Abdallah, A., Kaboudi, A., Kanoun, A., & Zaiem, S. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10445734 · Cited by 41
RepAugment: Input-Agnostic Representation-Level Augmentation for Respiratory Sound Classification
Kim, J.-W., Toikkanen, M., Bae, S., Kim, M., & Jung, H.-Y. (2024) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc53108.2024.10782363 · Cited by 38
The Responsible Foundation Model Development Cheatsheet: A Review of Tools & Resources
Longpre, S., Biderman, S., Albalak, A., Schoelkopf, H., McDuff, D., Kapoor, S., Klyman, K., Lo, K., Ilharco, G., San, N., et al. (2024) · Transactions on machine learning research · doi:10.48550/arxiv.2406.16746 · Cited by 37
Metadata
- Authors
- Babu, A., Wang, C., Tjandra, A., Lakhotia, K., Xu, Q., Goyal, N., Singh, K., von Platen, P., Saraf, Y., Pino, J., Baevski, A., Conneau, A., & Auli, M.
- Venue
- Interspeech 2022
- Publisher
- ISCA
- Published
- 2022-09-18
- Pages
- 2278-2282
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W3213029956
- Cited by
- 586
- References
- 74
- Citations by year
- 2026: 110 · 2025: 182 · 2024: 120 · 2023: 131 · 2022: 43
- FWCI
- 65.75
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- cc-by
- Locations
- Interspeech (USB) (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
- Keywords
- XLS-R, self-supervised pre-training, wav2vec 2.0, multilingual speech models, speech translation, speech recognition, language identification, low-resource languages
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.