XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale
Open accessThe DOI matches its Crossref record; 75 of the 75 references it cites were found in a registry or an index.
Abstract
This paper presents XLS-R, a large-scale model for cross-lingual speech representation learning based on wav2vec 2.0.We train models with up to 2B parameters on nearly half a million hours of publicly available speech audio in 128 languages, an order of magnitude more public data than the largest known prior work.Our evaluation covers a wide range of tasks, domains, data regimes and languages, both high and low-resource.On the CoVoST-2 speech translation benchmark, we improve the previous state of the art by an average of 7.4 BLEU over 21 translation directions into English.For speech recognition, XLS-R improves over the best known prior work on BABEL, MLS, CommonVoice as well as VoxPopuli, lowering error rates by 14-34% relative on average.XLS-R also sets a new state of the art on VoxLin-gua107 language identification.Moreover, we show that with sufficient model size, cross-lingual pretraining can perform as well as English-only pretraining when translating English speech into other languages, a setting which favors monolingual pretraining.We hope XLS-R can help to improve speech processing tasks for many more languages of the world.Models and code are available at www.github.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Depending on the number of languages used for training, XLSR supports 53 languages (XLSR [124]) and 128 languages (XLS-R [125]).”
From Audio Deepfake Detection: What Has Been Achieved and What Lies Ahead (2025) · cites this paper as [125]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Part of this paper’s reference list could not be split into single entries.
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344
Kaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,690
Momentum Contrast for Unsupervised Visual Representation Learning
He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00975 · Cited by 13,347
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
Research works printed but not linked: 1
- [2]2. Rosana Ardila, Megan Branson, Kelly Davis, Michael Henretty, Michael Kohler, Josh Meyer, Reuben Morais, Lindsay Saunders, Francis M. Tyers, and Gregor Weber. Common voice: A massivelymultilingual speech corpus. Proc. of LREC , 2020.
Cited by
Items 401–500 of 978
Ashihara, T., Delcroix, M., Ijima, Y., & Kashino, M. (2024) · IEEE Access · doi:10.1109/access.2024.3428364 · Cited by 5
Denisov, P., & Vu, T. (2024) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2024.findings-naacl.52 · Cited by 3
Mun, J., Kim, S., & Chung, M. (2024) · Interspeech (USB) · doi:10.21437/interspeech.2024-131 · Cited by 4
Wang, S.-H., Shi, J., Huang, C., Watanabe, S., & Lee, H.-Y. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832321 · Cited by 3
A Non-Intrusive Speech Quality Assessment Model using Whisper and Multi-Head Attention
Lin, G., Tsao, Y., & Chen, F. (2024) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc63619.2025.10848735 · Cited by 4
Enhancing Multilingual ASR for Unseen Languages via Language Embedding Modeling
Huang, S.-S., Huang, K.-P., Liu, A. T., & Lee, H.-Y. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890363 · Cited by 3
NEST: Self-supervised Fast Conformer as All-purpose Seasoning to Speech Processing Tasks
Huang, H., Park, T., Dhawan, K., Medennikov, I., Puvvada, K. C., Koluguri, N. R., Wang, W., Balam, J., & Ginsburg, B. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888249 · Cited by 11
Leveraging distance information for generalized spoofing speech detection
Lu, J., Zhang, Y., Li, Z., Shang, Z., Wang, W., & Zhang, P. (2025) · Computer Speech & Language · doi:10.1016/j.csl.2025.101804 · Cited by 3
Neighbors and relatives: How do speech embeddings reflect linguistic connections across the world?
Törö, T., Suni, A., & Šimko, J. (2025) · PLoS ONE · doi:10.1371/journal.pone.0330755 · Cited by 3
RPRA-ADD: Forgery Trace Enhancement-Driven Audio Deepfake Detection
Fu, R., Wang, X., Wen, Z., Tao, J., Xie, Y., Wang, Z., Qiang, C., Liu, X., Fan, C., Li, C., et al. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3646051 · Cited by 5
Exploration of Language Dependency for Japanese Self-Supervised Speech Representation Models
Ashihara, T., Moriya, T., Matsuura, K., & Tanaka, T. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096318 · Cited by 3
Jaisharma, K., & Deepa, N. (2023) · International Conference on Innovative Practices in Technology and Management (ICIPTM) · doi:10.1109/iciptm57143.2023.10118145 · Cited by 5
Addressing the semi-open set dialect recognition problem under resource-efficient considerations
Dey, S., & Saha, G. (2023) · Speech Communication · doi:10.1016/j.specom.2023.102957 · Cited by 3
Lam-Yee-Mui, L.-M., Ondel, L., & Klejch, O. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-1802 · Cited by 7
XLS-R fine-tuning on noisy word boundaries for unsupervised speech segmentation into words
Algayres, R., Diego-Simón, P., Sagot, B., & Emmanuel Dupoux, A. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.810 · Cited by 4
Wiepert, D. A., Utianski, R. L., Duffy, J. R., Stricker, J. L., Barnard, L. R., Josephs, K. A., Whitwell, J. L., Jones, D. T., & Botha, H. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389723 · Cited by 3
Denisov, P., & Vu, N. T. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389655 · Cited by 3
Latent Filling: Latent Space Data Augmentation for Zero-Shot Speech Synthesis
Bae, J.-S., Lee, J. Y., Lee, J., Mun, S., Kang, T., Cho, H. Y., & Kim, C. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446098 · Cited by 6
Understanding Probe Behaviors Through Variational Bounds of Mutual Information
Choi, K., Jung, J.-W., & Watanabe, S. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448065 · Cited by 12
Speech recognition as a supportive tool in the speech therapy game
Ondáš, S., Staš, J., & Ševc, R. (2024) · International Conference Radioelektronika · doi:10.1109/radioelektronika61599.2024.10524060 · Cited by 3
Training a Filter-Based Model of the Cochlea in the Context of Pre-Trained Acoustic Models
de Gibson, L. C., & Garner, P. N. (2024) · Acoustics · doi:10.3390/acoustics6020025 · Cited by 3
Chou, H.-C., Wu, H., & Lee, C.-C. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890558 · Cited by 3
Leveraging IPA and Articulatory Features as Effective Inductive Biases for Multilingual ASR Training
Lee, J. J., Mimura, M., & Kawahara, T. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889526 · Cited by 3
Discrete Speech Unit Extraction via Independent Component Analysis
Nakamura, T., Choi, K., Hojo, K., Bando, Y., Fukayama, S., & Watanabe, S. (2025) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw65056.2025.11011236 · Cited by 3
A Comprehensive Performance Evaluation of Whisper Models in Dysarthric Speech Recognition
Singh, S., Zhong, Z., Wang, Q., Mendes, C., Hasegawa‐Johnson, M., Abdulla, W. H., & Shahamiri, S. R. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-6960-8_6 · Cited by 6
Kinouchi, T., Ogawa, A., Wakabayashi, Y., Ohta, K., & Kitaoka, N. (2025) · Speech Communication · doi:10.1016/j.specom.2025.103303 · Cited by 3
ON-TRAC Consortium Systems for the IWSLT 2023 Dialectal and Low-resource Speech Translation Tasks
Laurent, A., Gahbiche, S., Nguyen, H., Elleuch, H., Bougares, F., Thiol, A., Riguidel, H., Mdhaffar, S., Laperrière, G., Maison, L., et al. (2023) · International Conference on Spoken Language Translation (IWSLT) · doi:10.18653/v1/2023.iwslt-1.18 · Cited by 3
TEVR: Improving Speech Recognition by Token Entropy Variance ReductionPreprint
Krabbenhöft, H. N., & Barth, E. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2206.12693 · Cited by 3
A Textless Metric for Speech-to-Speech ComparisonPreprint
Besacier, L., Ribeiro, S., Galibert, O., & Calapodescu, I. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2210.11835 · Cited by 3
Guimarães, H. R., Pimentel, A., Avila, A. R., Rezagholizadeh, M., & Falk, T. H. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2211.06562 · Cited by 4
Dialect Transfer for Swiss German Speech TranslationPreprint
Paonessa, C., Schraner, Y., Deriu, J., Hürlimann, M., Vogel, M., & Cieliebak, M. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.09088 · Cited by 3
A Quantitative Approach to Understand Self-Supervised Models as Cross-lingual Feature ExtractorsPreprint
Li, S. S., Xu, B., Zhang, X., Liu, H., Chao, W., & Garcia, L. P. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.15954 · Cited by 4
Shekoufandeh, G., Boersma, P., & van den Bosch, A. P. J. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2502.17284 · Cited by 3
Typhoon ASR Real-time: FastConformer-Transducer for Thai Automatic Speech RecognitionPreprint
Sirichotedumrong, W., Na-Thalang, A., Manakul, P., Taveekitworachai, P., Sripaisarnmongkol, S., & Pipatanakul, K. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.13044 · Cited by 3
VoxKnesset: A Large-Scale Longitudinal Hebrew Speech Dataset for Aging Speaker ModelingPreprint
Marmor, Y., Zulti, A., Krongauz, D. L., Gabet, A., Snapir, Y., Lifshitz, Y., & Segal, E. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.01270 · Cited by 5
Rahman, H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.04598 · Cited by 3
Hossain, N. M., Islam, R., & Obaidellah, U. H. B. (2026) · Research Square · doi:10.21203/rs.3.rs-9549878/v1 · Cited by 3
Floras 50: A Massively Multilingual Multitask Benchmark for Long-Form Conversational Speech
Chen, W., Yan, B., Chen, C., & Watanabe, S. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832167 · Cited by 5
DEEPFAKE AUDIO DETECTION USING YOLOV8 WITH MEL-SPECTROGRAM ANALYSIS: A CROSS-DATASET EVALUATION
Zbezhkhovska, U. (2025) · Radio Electronics Computer Science Control · doi:10.15588/1607-3274-2025-1-14 · Cited by 2
Ge, Z., Xu, X., Guo, H., & Schuller, B. W. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3581019 · Cited by 3
Tone in Perspective: A Computational Typological Analysis of Tone Function in ASR
Liang, S., & Levow, G. (2025) · Workshop on Research in Computational Linguistic Typology and Multilingual NLP (SIGTYP) · doi:10.18653/v1/2025.sigtyp-1.11 · Cited by 2
Exploring Cross-Utterance Speech Contexts for Conformer-Transducer Speech Recognition Systems
Cui, M., Geng, M., Deng, J., Deng, C., Kang, J., Hu, S., Li, G., Wang, T., Li, Z., Chen, X., et al. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3606235 · Cited by 4
XLSR-Kanformer: A KAN-Intergrated model for Synthetic Speech Detection
Dat, P. T., & Dat, T. H. (2025) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss65446.2025.11149956 · Cited by 9
Wang, H., Li, Z., Zhao, X., Chang, Z., & Hu, F. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3611506 · Cited by 2
Defending Speaker Verification Against Deepfake: A Multi-Step Approach
Doan, T.-P., Dinh-Xuan, H., Kim, I., Lee, W., Han, S., & Jung, S. (2025) · ACM Workshop on Deepfake, Deception, and Disinformation Security (3D-Sec) · doi:10.1145/3733813.3764373 · Cited by 5
Generalizable Audio Spoofing Detection using Non-Semantic Representations
Das, A., Kheir, Y. E., Franzreb, C., Herzig, T., Polzehl, T., & Möller, S. (2025) · Interspeech (USB) · doi:10.21437/interspeech.2025-1555 · Cited by 7
Yang, M., Gu, Y., He, Q., Zhang, P., He, H., Wang, Z., Zhu, H., Liu, J., & Wang, W. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3755593 · Cited by 4
Dong, Z., Guo, H., Xu, W., Zhao, H., & Zhang, Z. (2025) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2025.3622051 · Cited by 5
Hybrid model for classifying Indo Aryan and Tamil texts from historic manuscripts
Dinesh, P. M., Gopal, D., Vignesh, S., & Rani, S. S. (2025) · Scientific Reports · doi:10.1038/s41598-025-26640-7 · Cited by 2
Speech-to-Text Forced Alignment Benchmark
Deng, Y., Richardson, F. S., Steinberg, J., & Torres‐Carrasquillo, P. A. (2025) · International symposium on image and signal processing and analysis/ISPA ... · doi:10.1109/ispa66905.2025.11259471 · Cited by 2
Analytical Review of Speech and Multimodal Methods for Cognitive Impairments Recognition in People
Dolgushin, M., & Karpov, A. A. (2025) · Informatics and Automation · doi:10.15622/ia.24.6.6 · Cited by 2
Analysis and Classification of Normal vs. Pathological Infant Cries
Chaudhari, H., & Patil, H. A. (2025) · European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco63237.2025.11226653 · Cited by 2
Towards Building Speech Large Language Models for Multitask Understanding in Low-Resource Languages
Shao, M., Mu, B., Wang, C., Li, H., Yan, Y., Fu, Z., & Xie, L. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11462300 · Cited by 2
Self-citationRobust Detection of Partially Spoofed Audio Using Semantic-Aware Inconsistency Learning
Cao, J., Tian, H., Tian, P., Li, H., & Wang, J. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3617241 · Cited by 3
LJ-TTS: A Paired Real and Synthetic Speech Dataset for Single-Speaker TTS Analysis
Negroni, V., Salvi, D., Comanducci, L., Wani, T. M., Uecker, M., Amerini, I., Tubaro, S., & Bestagini, P. (2025) · Electronics · doi:10.3390/electronics15010169 · Cited by 3
MOSS: Multi-modal Source Separation and Feature Fusion for Music Deepfake Detection
Zhu, X., Li, W., Qiao, M., Yang, Z., & Wang, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-6960-1_38 · Cited by 2
Modern Speech Recognition for Romanian Language
Ungureanu, R.-D., & Dascălu, M. (2026) · Applied Sciences · doi:10.3390/app16041928 · Cited by 2
Evolutionary Multi-Objective Fusion of Deepfake Speech Detectors
Staněk, V., Perešíni, M., Sekanina, L., Firc, A., & Malinka, K. (2026) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec69861.2026.11727188 · Cited by 2
Multilingual Deepfake Speech Dataset for Robust and Generalizable Detection
Mawalim, C. O., Wang, Y., Adila, A., Okada, S., & Unoki, M. (2026) · IEEE Access · doi:10.1109/access.2026.3680508 · Cited by 3
RIRplay: Generation of a Replay Stereo Corpus for Voice Biometrics Anti-Spoofing
Sánchez-Valera, J. C., Peinado, A. M., Martín-Doñas, J. M., Gomez-Alanis, A., Gomez, A. M., & Todisco, M. (2026) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2026.3684815 · Cited by 4
Fine-Grained Frame Modeling in Multi-Head Self-Attention for Speech Deepfake Detection
Dat, P. T., Truong, D.-T., Hoang, L.-V., & Trang, N. T. T. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11464918 · Cited by 4
Evaluating Novel Speech Transcription Architectures on the Spanish RTVE2020 Database
Álvarez, A., Arzelus, H., Torre, I. G., & González-Docasal, A. (2022) · Applied Sciences · doi:10.3390/app12041889 · Cited by 2
Iterative pseudo-forced alignment by acoustic CTC loss for self-supervised ASR domain adaptation
López, F., & Luque, J. (2022) · IberSPEECH · doi:10.21437/iberspeech.2022-10 · Cited by 5
Wang, X., Wu, H., Ding, C., Huang, C., & Li, M. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095116 · Cited by 2
Towards continually learning new languages
Pham, Q., Niehues, J., & Waibel, A. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-1867 · Cited by 2
Modular Speech-to-Text Translation for Zero-Shot Cross-Modal Transfer
Duquenne, P.-A., Schwenk, H., & Sagot, B. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-2484 · Cited by 2
ASR pipeline for low-resourced languages: A case study on Pomak
Tsoukala, C., Kritsis, K., Douros, I., Katsamanis, A., Kokkas, N., Arampatzakis, V., Sevetlidis, V., Μαρκαντωνάτου, Σ., & Pavlidis, G. P. (2023) · Workshop on NLP Applications to Field Linguistics (Field Matters) · doi:10.18653/v1/2023.fieldmatters-1.5 · Cited by 2
Evaluating Self-Supervised Speech Models on a Taiwanese Hokkien Corpus
Chou, Y.-H., Chang, K., Wu, M.-J., Ou, W., Bi, A. W.-H., Yang, C., Chen, B., Pai, R.-W., Yeh, P.-Y., Chiang, J.-P., et al. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389734 · Cited by 2
Findings of the 2023 ML-Superb Challenge: Pre-Training And Evaluation Over More Languages And Beyond
Shi, J., Chen, W., Berrebbi, D., Wang, H.-H., Huang, W.-P., Hu, E.-P., Chuang, H.-L., Chang, X., Tang, Y., Li, S.-W. D., et al. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389628 · Cited by 2
Multimodal Modeling for Spoken Language Identification
Bharadwaj, S., Ma, M., Vashishth, S., Bapna, A., Ganapathy, S., Axelrod, V., Dalmia, S., Han, W., Zhang, Y., van Esch, D., et al. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448215 · Cited by 2
Guhr, O., Loitsch, C., Weber, G., & Böhme, H.-J. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-60615-1_15 · Cited by 2
Ухачевич, Т. Я., & Kustra, N. (2024) · Науковий вісник НЛТУ України · doi:10.36930/40340514 · Cited by 2
Efficiency-oriented approaches for self-supervised speech representation learning
Lugo, L., & Vielzeuf, V. (2023) · International Journal of Speech Technology · doi:10.1007/s10772-024-10121-9 · Cited by 2
Spoken Language Identification Using Rhythmic Categorization: Syllable-Timed and Stress-Timed
Dey, S., & Saha, G. (2024) · International Conference on Signal Processing and Communications (SPCOM) · doi:10.1109/spcom60851.2024.10631595 · Cited by 2
Zero-Shot vs. Few-Shot Multi-speaker TTS Using Pre-trained Czech SpeechT5 Model
Lehečka, J., Hanzlíček, Z., Matoušek, J., & Tihelka, D. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-70566-3_5 · Cited by 2
TM-PATHVQA: 90000+ Textless Multilingual Questions for Medical Visual Question Answering
Rajkhowa, T., Chowdhury, A. R., Nagaonkar, S., Tripathi, A. M., & Prasanna, M. (2024) · Interspeech (USB) · doi:10.21437/interspeech.2024-1036 · Cited by 4
The SETU-DCU Submissions to IWSLT 2024 Low-Resource Speech-to-Text Translation Tasks
Zafar, M., Castaldo, A., Nayak, P., Haque, R., Gajakos, N., & Way, A. (2024) · International Conference on Spoken Language Translation (IWSLT) · doi:10.18653/v1/2024.iwslt-1.12 · Cited by 2
Multimodal Emotion Recognition Harnessing the Complementarity of Speech, Language, and Vision
Thebaud, T., Favaro, A., Guan, Y., Yang, Y., Singh, P., Villalba, J., Moro-Velázquez, L., & Dehak, N. (2024) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3678957.3689332 · Cited by 2
EnvFake: An Initial Environmental-Fake Audio Dataset for Scene-Consistency Detection
Cheng, H., Li, K., Ye, L., & Wang, J. (2024) · International Symposium on Chinese Spoken Language Processing (ISCSLP) · doi:10.1109/iscslp63861.2024.10799995 · Cited by 7
Low-resource Language Adaptation with Ensemble of PEFT Approaches
Kwok, C. Y., Li, S., Yip, J. Q., & Chng, E. S. (2024) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc63619.2025.10848814 · Cited by 4
Empower Typed Descriptions by Large Language Models for Speech Emotion Recognition
Wu, H., Chou, H.-C., Chang, K.-W., Goncalves, L., Du, J., Jang, J. R., Lee, C.-C., & Lee, H.-Y. (2024) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc63619.2025.10848758 · Cited by 2
Mitigating Subgroup Disparities in Speech Models: A Divergence-Aware Dual Strategy
Koudounas, A., Pastor, E., de Alfaro, L., & Baralis, E. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3539429 · Cited by 3
Matějů, L., Nouza, J., Červa, P., & Žďánský, J. (2025) · Speech Communication · doi:10.1016/j.specom.2025.103221 · Cited by 2
Recursive Feature Learning from Pre-Trained Models for Spoofing Speech Detection
Guan, Y., Ai, Y., Li, Z., Peng, S., & Guo, W. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888985 · Cited by 3
Ren, Y., Li, Y., Sun, J., Chen, H., Ma, X., & Chen, Z. (2025) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2025.3548070 · Cited by 2
UMEDNet: a multimodal approach for emotion detection in the Urdu language
Majeed, A. A., & Mujtaba, H. (2025) · PeerJ Computer Science · doi:10.7717/peerj-cs.2861 · Cited by 2
InaSAS: Benchmarking Indonesian Speech Antispoofing Systems
Mawalim, C. O., Arief, S. A., & Lestari, D. P. (2025) · APSIPA Transactions on Signal and Information Processing · doi:10.1561/116.20240080 · Cited by 4
An Efficient Data Reuse with Tile-Based Adaptive Stationary for Transformer Accelerators
Li, T. Y., & Chang, T. (2025) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas56072.2025.11044288 · Cited by 2
Leveraging Neural Vocoder Artifacts for Improved Synthetic Speech Detection
Xue, J., Cui, S., & Zhang, W. (2024) · International Conference on Sensors, Signal and Image Processing (SSIP) · doi:10.1145/3725949.3725971 · Cited by 2
Frame-Level Temporal Difference Learning for Partial Deepfake Speech Detection
Li, M., Zhang, X.-P., & Zhao, L. Y. (2025) · IEEE Signal Processing Letters · doi:10.1109/lsp.2025.3592111 · Cited by 9
ZIPA: A family of efficient models for multilingual phone recognition
Zhu, J., Samir, F., Chodroff, E., & Mortensen, D. R. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-long.961 · Cited by 2
Three Years of VoiceMOS Challenges: Lessons Learned by the UWB-NTIS-TTS Team
Kunešová, M., Matoušek, J., Lehečka, J., Švec, J., Tihelka, D., & Hanzlíček, Z. (2025) · IEEE Access · doi:10.1109/access.2025.3596644 · Cited by 2
The ML-SUPERB 2.0 Challenge: Towards Inclusive ASR Benchmarking for All Language Varieties
Chen, W., Meng, C., Shi, J., Bartelds, M., Wang, S.-H., Wang, H.-H., Mosquera, R., Hincapie, S., Jurafsky, D., Anastasopoulos, A., et al. (2025) · Interspeech (USB) · doi:10.21437/interspeech.2025-1013 · Cited by 2
CA-SSLR: Condition-Aware Self-Supervised Learning Representation for Generalized Speech Processing
Lu, Y.-J., Liu, J., Thebaud, T., Moro-Velázquez, L., Rastrow, A., Dehak, N., & Villalba, J. (2024) · neural information processing systems · doi:10.52202/079017-1586 · Cited by 2
UniCoM: A Universal Code-Switching Speech Generator
Lee, S., Chung, W., Um, S., & Kang, H.-G. (2025) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2025.findings-emnlp.715 · Cited by 5
Exploring the Impact of Data Quantity on Asr in Extremely Low-Resource Languages
Cheng, Y.-F., Chen, L.-W., Lee, H.-S., & Wang, H. L. (2025) · International Conference on Speech Database and Assessments · doi:10.1109/o-cocosda68185.2025.11385096 · Cited by 2
CAMÕES: A Comprehensive Automatic Speech Recognition Benchmark for European Portuguese
Carvalho, C., Teixeira, F., Botelho, C., Pompili, A., Solera-Ureña, R., Paulo, S., Julião, M., Rolland, T., Mendonça, J., Pereira, D. A., et al. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11434700 · Cited by 7
Chung, H.-L., Li, J., Liu, P., Leung, W.-K., Wu, X., & Meng, H. M. L. (2022) · International Symposium on Chinese Spoken Language Processing (ISCSLP) · doi:10.1109/iscslp57327.2022.10038220 · Cited by 2
Metadata
- Authors
- Babu, A., Wang, C., Tjandra, A., Lakhotia, K., Xu, Q., Goyal, N., Singh, K., von Platen, P., Saraf, Y., Pino, J., Baevski, A., Conneau, A., & Auli, M.
- Venue
- Interspeech 2022
- Publisher
- ISCA
- Published
- 2022-09-18
- Pages
- 2278-2282
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W3213029956
- Cited by
- 586
- References
- 74
- Citations by year
- 2026: 110 · 2025: 182 · 2024: 120 · 2023: 131 · 2022: 43
- FWCI
- 65.75
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- cc-by
- Locations
- Interspeech (USB) (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
- Keywords
- XLS-R, self-supervised pre-training, wav2vec 2.0, multilingual speech models, speech translation, speech recognition, language identification, low-resource languages
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.