The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Unsupervised Cross-Lingual Representation Learning for Speech Recognition
Open accessAbstract
This paper presents XLSR which learns cross-lingual speech representations by pretraining a single model from the raw waveform of speech in multiple languages. We build on wav2vec 2.0 which is trained by solving a contrastive task over masked latent speech representations and jointly learns a quantization of the latents shared across languages. The resulting model is fine-tuned on labeled data and experiments show that cross-lingual pretraining significantly outperforms monolingual pretraining. On the CommonVoice benchmark, XLSR shows a relative phoneme error rate reduction of 72% compared to the best known results. On BABEL, our approach improves word error rate by 16% relative compared to a comparable system. Our approach enables a single multilingual speech recognition model which is competitive to strong individual models. Analysis shows that the latent discrete speech representations are shared across languages with increased sharing for related languages. We hope to catalyze research in low-resource speech understanding by releasing XLSR-53, a large model pretrained in 53 languages.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Depending on the number of languages used for training, XLSR supports 53 languages (XLSR [124]) and 128 languages (XLS-R [125]).”
From Audio Deepfake Detection: What Has Been Achieved and What Lies Ahead (2025) · cites this paper as [124]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Momentum Contrast for Unsupervised Visual Representation LearningPreprint
He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. B. (2019) · Computer Vision and Pattern Recognition · doi:10.48550/arxiv.1911.05722 · Cited by 16,250
Momentum Contrast for Unsupervised Visual Representation Learning
He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00975 · Cited by 13,347
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
A simple framework for contrastive learning of visual representations
Chen, T., Kornblith, S., Norouzi, M., & Hinton, G. (2020) · arXiv · doi:10.48550/arxiv.2002.05709 · Cited by 10,857
Representation Learning with Contrastive Predictive Coding
Oord, A. V. D., Li, Y., & Vinyals, O. (2018) · arXiv · doi:10.48550/arxiv.1807.03748 · Cited by 6,242
Unsupervised Cross-lingual Representation Learning at Scale
Conneau, A., Khandelwal, K., Goyal, N., Chaudhary, V., Wenzek, G., Guzmán, F., Grave, E., Ott, M., Zettlemoyer, L., & Stoyanov, V. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.747 · Cited by 5,637
Self-citationGraves, A., Fernández, S., Gomez, F., & Schmidhuber, J. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143891 · Cited by 5,370
Flagged first, then by citations
Research works printed but not linked: 2
- Mark JF Gales, Kate M Knill, and Anton Ragni. Low-resource speech recognition and keyword- spotting. In Proc. of SPECOM, pp. 3-19. Springer, 2017.
- Yonglong Tian, Dilip Krishnan, and Phillip Isola. Contrastive multiview coding. arXiv, 2019.
Cited by
Sorted by citations
Items 101–200 of 635
Klempíř, O., & Krupička, R. (2024) · Sensors · doi:10.3390/s24175520 · Cited by 23
San, N., Bartelds, M., Browne, M., Clifford, L., Gibson, F., Mansfield, J., Nash, D., Simpson, J., Turpin, M., Vollmer, M., et al. (2021) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru51503.2021.9688301 · Cited by 27
Self-Supervised Pre-Training for Attention-Based Encoder-Decoder ASR Model
Gao, C., Cheng, G., Ta, L., Zhang, P., & Yan, Y. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3171967 · Cited by 18
Carofilis, A., Alegre, E., Fidalgo, E., & Fernández-Robles, L. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3297961 · Cited by 19
XTREME-S: Evaluating Cross-lingual Speech Representations
Conneau, A., Bapna, A., Zhang, Y., Ma, M., von Platen, P., Lozhkov, A., Cherry, C., Ye, J., Rivera, C., Kale, M., et al. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10007 · Cited by 29
Self-citationHe, Y., Seng, K. P., & Ang, L.-M. (2025) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2025.3570383 · Cited by 21
Transfer Ability of Monolingual Wav2vec2.0 for Low-resource Speech Recognition
Cheng, Y., Wang, J., Cheng, N., Zhou, S., & Xu, B. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9533587 · Cited by 17
Automatic Speech Recognition for Uyghur, Kazakh, and Kyrgyz: An Overview
Du, W., Maimaitiyiming, Y., Nijat, M., Li, L., Hamdulla, A., & Wang, D. (2022) · Applied Sciences · doi:10.3390/app13010326 · Cited by 22
Explore the World of Audio Deepfakes: A Guide to Detection Techniques for Non-Experts
Schäfer, K., Choi, J., & Zmudzinski, S. (2024) · ACM International Workshop on Multimedia AI against Disinformation (MAD) · doi:10.1145/3643491.3660289 · Cited by 21
Recent Advances in Discrete Speech Tokens: A Review
Guo, Y., Li, Z., Wang, H., Li, B., Shao, C., Zhang, H., Du, C., Xie, C., Liu, S., & Yu, K. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3643619 · Cited by 58
Pseudo-Labeling for Massively Multilingual Speech Recognition
Lugosch, L., Likhomanenko, T., Synnaeve, G., & Collobert, R. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746832 · Cited by 19
Self-citationLanguage Adaptive Cross-Lingual Speech Representation Learning with Sparse Sharing Sub-Networks
Lu, Y., Huang, M., Qu, X., Wei, P., & Ma, Z. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747671 · Cited by 16
EmoFace: Audio-driven Emotional 3D Face Animation
Liu, C., Lin, Q., Zeng, Z., & Pan, Y. (2024) · IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr58804.2024.00060 · Cited by 16
Cross-Lingual Self-training to Learn Multilingual Representation for Low-Resource Speech Recognition
Zhang, Z., Song, Y., Wu, M., Fang, X., McLoughlin, I. V., & Dai, L.-R. (2022) · Circuits Systems and Signal Processing · doi:10.1007/s00034-022-02075-7 · Cited by 35
Improving Language Identification of Accented Speech
Kukk, K., & Alumäe, T. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10455 · Cited by 17
Parcollet, T., Nguyen, H., Evain, S. V., Boito, M. Z., Pupier, A., Mdhaffar, S., Le, H., Alisamir, S., Tomashenko, N., Dinarelli, M., et al. (2024) · Computer Speech & Language · doi:10.1016/j.csl.2024.101622 · Cited by 37
Takashima, R., Sawa, Y., Aihara, R., Takiguchi, T., & Imai, Y. (2024) · IEEE Access · doi:10.1109/access.2024.3374874 · Cited by 15
A comprehensive survey with critical analysis for deepfake speech detection
Pham, L. D., Lam, P., Tran, D., Tang, H., Nguyen, T., Schindler, A., Skopik, F., Polonsky, A., & Vu, H. C. (2025) · Computer Science Review · doi:10.1016/j.cosrev.2025.100757 · Cited by 28
van Staden, L., & Kamper, H. (2021) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt48900.2021.9383625 · Cited by 17
Wu, J., Polyak, A., Taigman, Y., Fong, J., Agrawal, P., & He, Q. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746282 · Cited by 15
Voice Conversion Can Improve ASR in Very Low-Resource Settings
Baas, M., & Kamper, H. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-112 · Cited by 18
WavLM model ensemble for audio deepfake detection
Combei, D., Stan, A., Oneata, D., & Cucu, H. (2024) · The Automatic Speaker Verification Spoofing Countermeasures Workshop (ASVspoof 2024) · doi:10.21437/asvspoof.2024-25 · Cited by 15
“The wav2vec family of models [10,16,17] remains the most popular option for deepfake detection [1–3,7,8,18,19].”
BackgroundEnd-to-End Automated Speech Recognition Using a Character Based Small Scale Transformer Architecture
Loubser, A., de Villiers, P., & Freitas, A. D. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124119 · Cited by 21
Self-Supervised End-to-End ASR for Low Resource L2 Swedish
Al-Ghezi, R., Getman, Y., Rouhe, A., Hildén, R., & Kurimo, M. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1710 · Cited by 19
Attention-Guided Adaptation for Code-Switching Speech Recognition
Aditya, B., Rohmatillah, M., Tai, L.-H., & Chien, J. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446258 · Cited by 14
Unsupervised contrastive learning: Shale porosity prediction based on conventional well logging
Qiao, L., Yang, S., Hu, Q., Wang, H., & He, T. (2024) · Physics of Fluids · doi:10.1063/5.0206449 · Cited by 14
Comparing CTC and LFMMI for Out-of-Domain Adaptation of wav2vec 2.0 Acoustic Model
Vyas, A., Madikeri, S. R., & Bourlard, H. A. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1683 · Cited by 15
Kessler, S., Thomas, B., & Karout, S. A. (2021) · arXiv (Cornell University) · Cited by 15
Jain, P., & Bhowmick, A. (2025) · EURASIP Journal on Audio Speech and Music Processing · doi:10.1186/s13636-025-00395-5 · Cited by 13
Kazakh Speech Recognition: Wav2vec2.0 vs. Whisper
Kozhirbayev, Z. (2023) · Journal of Advances in Information Technology · doi:10.12720/jait.14.6.1382-1389 · Cited by 17
Singh, N. K., Chanu, Y. J., & Pangsatabam, H. (2024) · Computer Speech & Language · doi:10.1016/j.csl.2024.101627 · Cited by 13
Nabende, J. N., Babirye, C., Nabende, P., Tusubira, J., Mukiibi, J., Wairagala, E. P., Mutebi, C., Bateesa, T. S., Nahabwe, A., Tusiime, H., et al. (2024) · Applied AI Letters · doi:10.1002/ail2.92 · Cited by 13
Chen, T., Lin, J., Yang, Z., Qing, C., Shi, Y., & Lin, L. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02358-x · Cited by 13
Multilingual Mix: Example Interpolation Improves Multilingual Neural Machine Translation
Cheng, Y., Bapna, A., Fırat, O., Cao, Y. J., Wang, P., & Macherey, W. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.282 · Cited by 14
Liu, H., Garcia, L. P., Khong, A. W. H., Styles, S. J., & Khudanpur, S. P. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-354 · Cited by 13
Multitask Detection of Speaker Changes, Overlapping Speech and Voice Activity Using Wav2vec 2.0
Kunešová, M., & Zajíc, Z. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094972 · Cited by 14
Dynamic Acoustic Unit Augmentation with BPE-Dropout for Low-Resource End-to-End Speech Recognition
Laptev, A., Andrusenko, A., Podluzhny, I., Mitrofanov, A., Medennikov, I., & Matveev, Y. N. (2021) · Sensors · doi:10.3390/s21093063 · Cited by 13
Using big data from long-form recordings to study development and optimize societal impact
Cychosz, M., & Cristià, A. (2022) · Advances in child development and behavior · doi:10.1016/bs.acdb.2021.12.001 · Cited by 13
Adaptation Algorithms for Speech Recognition: An OverviewPreprint
Bell, P., Fainberg, J., Klejch, O., Li, J., Renals, S. J., & Świętojański, P. (2020) · arXiv (Cornell University) · Cited by 12
Unsupervised Speaker Verification Using Pre-Trained Model and Label Correction
Chen, Z., Wang, J., Hu, W., Li, L., & Hong, Q. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094610 · Cited by 13
BLASER: A Text-Free Speech-to-Speech Translation Evaluation Metric
Chen, M., Duquenne, P.-A., Andrews, P., Kao, J., Mourachko, A., Schwenk, H., & Costa‐jussà, M. R. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.504 · Cited by 21
Transfer Learning for Personality Perception via Speech Emotion Recognition
Li, Y., Bell, P., & Lai, C. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-2061 · Cited by 12
Quantifying the Dialect Gap and its Correlates Across Languages
Kantharuban, A., Vulić, I., & Korhonen, A. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.481 · Cited by 22
AfriSpeech-200: Pan-African Accented Speech Dataset for Clinical and General Domain ASR
Olatunji, T., Afonja, T., Yadavalli, A., Emezue, C. C., Singh, S., Dossou, B. F. P., Osuchukwu, J., Osei, S., Tonja, A. L., Etori, N. A., et al. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00627 · Cited by 24
Ferraz, T. P., Boito, M. Z., Brun, C., & Nikoulina, V. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447520 · Cited by 19
Saliba, A., Li, Y., Sanabria, R., & Lai, C. (2024) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw62465.2024.10627629 · Cited by 12
Comparison of wav2vec 2.0 models on three speech processing tasks
Kunešová, M., Zajíc, Z., Šmídl, L., & Karafiát, M. (2024) · International Journal of Speech Technology · doi:10.1007/s10772-024-10140-6 · Cited by 13
UniTalker: Scaling up Audio-Driven 3D Facial Animation Through A Unified Model
Fan, X., Li, J., Lin, Z., Xiao, W., & Yang, L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72940-9_12 · Cited by 12
Machine Learning Approaches for Speech-Based Alzheimer’s Detection: A Comprehensive Survey
Sharafeldeen, A., Keowen, J., & Shaffie, A. (2025) · Computers · doi:10.3390/computers14020036 · Cited by 19
A Study of Gender Impact in Self-supervised Models for Speech-to-Text Systems
Boito, M. Z., Besacier, L., Tomashenko, N., & Estève, Y. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-353 · Cited by 23
Cancelable biometric schemes for Euclidean metric and Cosine metric
Jiang, Y., Shen, P., Zeng, L., Zhu, X., Jiang, D. M., & Chen, C. (2023) · Cybersecurity · doi:10.1186/s42400-023-00137-0 · Cited by 12
Virtuoso: Massive Multilingual Speech-Text Joint Semi-Supervised Learning for Text-to-Speech
Saeki, T., Zen, H., Chen, Z., Morioka, N., Wang, G., Zhang, Y., Bapna, A., Rosenberg, A., & Ramabhadran, B. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095702 · Cited by 12
A Novel Online Quizzing System for Blind People by implementing Modern Voice Recognition Techniques
Kamra, V., Singh, A., Sharma, P., & Yadav, R. (2023) · IEEE Delhi Section Conference (DELCON) · doi:10.1109/delcon57910.2023.10127578 · Cited by 12
K-Wav2vec 2.0: Automatic Speech Recognition based on Joint Decoding of Graphemes and Syllables
Kim, J., & Kang, P. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-547 · Cited by 15
Indonesian Automatic Speech Recognition with XLSR-53
Arisaputra, P., & Zahra, A. (2022) · Ingénierie des systèmes d information · doi:10.18280/isi.270614 · Cited by 18
End-to-End Zero-Shot Voice Conversion with Location-Variable Convolutions
Kang, W., Hasegawa‐Johnson, M., & Roy, D. K. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-2298 · Cited by 13
Transduce and Speak: Neural Transducer for Text-To-Speech with Semantic Token Prediction
Kim, M., Jeong, M., Choi, B. J., Lee, D., & Kim, N. S. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389791 · Cited by 11
Magic Dust for Cross-Lingual Adaptation of Monolingual Wav2vec-2.0
Khurana, S., Laurent, A., & Glass, J. R. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746276 · Cited by 12
Prosody Modelling With Pre-Trained Cross-Utterance Representations for Improved Speech Synthesis
Zhang, Y.-J., Zhang, C., Song, W. G., Zhang, Z., Wu, Y., & He, X. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3278184 · Cited by 12
The Applicability of Wav2Vec2 and Whisper for Low-Resource Maltese ASR
Williams, A., DeMarco, A., & Borg, C. (2023) · doi:10.21437/sigul.2023-9 · Cited by 11
Learning ASR Pathways: A Sparse Multilingual ASR Model
Yang, M., Tjandra, A., Liu, C., Zhang, D., Le, D., & Kalinli, O. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094300 · Cited by 13
Exploiting Pre-Trained ASR Models for Alzheimer's Disease Recognition Through Spontaneous SpeechPreprint
Qin, Y. H., Liu, W., Peng, Z., Ng, S.-I., Li, J., Hu, H., & Lee, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.01493 · Cited by 17
T-Modules: Translation Modules for Zero-Shot Cross-Modal Machine Translation
Duquenne, P.-A., Gong, H., Sagot, B., & Schwenk, H. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.391 · Cited by 16
Multilingual Word Error Rate Estimation: E-Wer3
Chowdhury, S. A., & Ali, A. M. A. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095888 · Cited by 13
CML-TTS: A Multilingual Dataset for Speech Synthesis in Low-Resource Languages
de Oliveira, F. S., Casanova, E., Cândido, A., Soares, A. S., & Filho, A. R. G. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-40498-6_17 · Cited by 12
Multilingual end-to-end ASR for low-resource Turkic languages with common alphabets
Bekarystankyzy, A., Mamyrbayev, O. J., Mendes, M., Fazylzhanova, A., & Assam, M. (2024) · Scientific Reports · doi:10.1038/s41598-024-64848-1 · Cited by 10
Spoken language identification: An overview of past and present research trends
O’Shaughnessy, D. D. (2024) · Speech Communication · doi:10.1016/j.specom.2024.103167 · Cited by 10
ON-TRAC Consortium Systems for the IWSLT 2022 Dialect and Low-resource Speech Translation Tasks
Boito, M. Z., Ortega, J., Riguidel, H., Laurent, A., Barrault, L., Bougares, F., Chaabani, F., Nguyen, H., Barbier, F., Gahbiche, S., et al. (2022) · International Conference on Spoken Language Translation (IWSLT) · doi:10.18653/v1/2022.iwslt-1.28 · Cited by 15
Multilingual and Multimodal Abuse Detection
Sharon, R., Shah, H., Mukherjee, D., & Gupta, V. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10629 · Cited by 10
SecretGen: Privacy Recovery on Pre-trained Models via Distribution Discrimination
Yuan, Z., Wu, F., Long, Y., Xiao, C., & Li, B. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20065-6_9 · Cited by 11
Zero-Shot Normalization Driven Multi-Speaker Text to Speech Synthesis
Kumar, N., Narang, A., & Lall, B. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3169634 · Cited by 11
Guillaume, S., Wisniewski, G., Macaire, C., Jacques, G., Michaud, A., Galliot, B., Coavoux, M., Rossato, S., Nguyễn, M., & Fily, M. (2022) · Workshop on the Use of Computational Methods in the Study of Endangered Languages (ComputEL) · doi:10.18653/v1/2022.computel-1.21 · Cited by 12
Reitmaier, T., Wallington, E., Klejch, O., Markl, N., Lam-Yee-Mui, L.-M., Pearson, J. S., Jones, M., Bell, P., & Robinson, S. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581385 · Cited by 9
Pretraining Approaches for Spoken Language Recognition: TalTech Submission to the OLR 2021 Challenge
Alumäe, T., & Kukk, K. (2022) · The Speaker and Language Recognition Workshop (Odyssey) · doi:10.21437/odyssey.2022-34 · Cited by 9
Paraskevopoulos, G., Kouzelis, T., Rouvalis, G., Katsamanis, A., Katsouros, V., & Potamianos, A. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3328280 · Cited by 9
Raychawdhary, N., Das, A. K., Dozier, G. V., & Seals, C. (2023) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2023.semeval-1.208 · Cited by 10
Huang, K.-P., Yang, C.-K., Fu, Y.-K., Dunbar, E., & Lee, H.-Y. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446737 · Cited by 9
Wang, C., Wu, Y., Liu, S., Li, J., Qian, Y., Kumatani, K., & Wei, F. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.05233 · Cited by 14
ASR4REAL: An extended benchmark for speech modelsPreprint
Rivière, M., Copet, J., & Synnaeve, G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.08583 · Cited by 15
ITALIC: An Italian Intent Classification Dataset
Koudounas, A., Quatra, M. L., Vaiani, L., Colomba, L., Attanasio, G., Pastor, E., Cagliero, L., & Baralis, E. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-1980 · Cited by 12
Ahn, T., Hong, Y., Im, Y., Kim, D. H., Kang, D., Jeong, J. W., Kim, J. W., Kim, M. J., Cho, A., Nam, H., et al. (2024) · Clinical Linguistics & Phonetics · doi:10.1080/02699206.2024.2387609 · Cited by 12
Purohit, T., Ruvolo, B., Orozco‐Arroyave, J. R., & Magimai.-Doss, M. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890852 · Cited by 11
Mekhfioui, M., Fadel, W., Hammouch, F.-E., Laayati, O., Bouchouirbat, M., Bazi, N. E., Satif, A., Boujiha, T., & Chebak, A. (2025) · Technologies · doi:10.3390/technologies13040130 · Cited by 8
Advancements in Multilingual Speech Technologies for Human-Computer Interaction
Ravikumar, R. N., Aarthi, S., Usmani, M. A., Rai, P. K., Xusinovna, J. M., & Narboshova, M. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-3048-8.ch004 · Cited by 8
JHU IWSLT 2022 Dialect Speech Translation System Description
Yang, J., Hussein, A., Wiesner, M., & Khudanpur, S. P. (2022) · International Conference on Spoken Language Translation (IWSLT) · doi:10.18653/v1/2022.iwslt-1.29 · Cited by 8
Soky, K., Li, S., Chu, C., & Kawahara, T. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095644 · Cited by 10
Cocktail Hubert: Generalized Self-Supervised Pre-Training for Mixture and Single-Source Speech
Fazel-Zarandi, M., & Hsu, W.-N. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096630 · Cited by 12
SADA: Saudi Audio Dataset for Arabic
Alharbi, S., Alowisheq, A., Tüske, Z., Darwish, K. M., Alrajeh, A., Alrowithi, A., Tamran, A. B., Ibrahim, A., Aloraini, R., Alnajim, R., et al. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446243 · Cited by 8
Bestow: Efficient and Streamable Speech Language Model with The Best of Two Worlds in GPT and T5
Chen, Z., Huang, H., Hrinchuk, O., Puvvada, K. C., Koluguri, N. R., Żelasko, P., Balam, J., & Ginsburg, B. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832146 · Cited by 23
Bravo-Rocca, G., Liu, P., Guitart, J., Dholakia, A., Ellison, D. D., Falkanger, J., & Hodak, M. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.117232 · Cited by 9
When Is TTS Augmentation Through a Pivot Language Useful?
Robinson, N. R., Ogayo, P., Gangu, S. R., Mortensen, D. R., & Watanabe, S. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-11203 · Cited by 8
Triantafyllopoulos, A., Fendler, M., Batliner, A. M., Gerczuk, M., Amiriparian, S., Berghaus, T. M., & Schuller, B. W. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10333 · Cited by 11
Le, H., Barbier, F., Nguyen, H., Tomashenko, N., Mdhaffar, S., Gahbiche, S., Lecouteux, B., Schwab, D., & Estève, Y. (2021) · International Conference on Spoken Language Translation (IWSLT) · doi:10.18653/v1/2021.iwslt-1.20 · Cited by 9
Zhao, J., Shi, G.-X., Wang, G.-B., & Zhang, W.-Q. (2021) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru51503.2021.9688260 · Cited by 9
Zhang, Z., Song, Y., Wu, M., Fang, X., & Dai, L.-R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.08207 · Cited by 8
A Brief Overview of Unsupervised Neural Speech Representation LearningPreprint
Borgholt, L., Havtorn, J. D., Edin, J., Maaløe, L., & Igel, C. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.01829 · Cited by 15
Automatic Recognition of Continuous Malayalam Speech using Pretrained Multilingual Transformers
Manohar, K., Menon, G. G., Abraham, A., Rajan, R., & Jayan, A. R. (2023) · International Conference on Intelligent Systems for Communication, IoT and Security (ICISCoIS) · doi:10.1109/iciscois56541.2023.10100598 · Cited by 9
Samin, A. M., Kobir, M. H., Rafee, M. M. S., Ahmed, M. F., Hasan, M., Ghosh, P. P., Kibria, S., & Rahman, M. S. (2024) · IEEE Access · doi:10.1109/access.2024.3371478 · Cited by 8
Towards Quantifying and Reducing Language Mismatch Effects in Cross-Lingual Speech Anti-Spoofing
Liu, T., Kukanov, I., Pan, Z., Wang, Q., Sailor, H. B., & Lee, K. A. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832142 · Cited by 9
Analyzing Generative AI and Machine Learning in Auto-Assessing Schizophrenia’s Negative Symptoms
Liu, C., Chan, Y.-H., Ho, M.-Y., Liu, C., Lu, M., Liao, Y.-A., Hsieh, M. H., & Tseng, Y. J. (2025) · Schizophrenia Bulletin · doi:10.1093/schbul/sbaf102 · Cited by 7
Metadata
- Authors
- Conneau, A., Baevski, A., Collobert, R., Mohamed, A., & Auli, M.
- Affiliations
- Meta (United Kingdom) (GB)
- ORCID
- Auli, Michael
- Venue
- Interspeech 2021
- Publisher
- ISCA
- Published
- 2021-08-30
- Pages
- 2426-2430
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W3037057938
- Cited by
- 637
- References
- 47
- Citations by year
- 2026: 60 · 2025: 136 · 2024: 115 · 2023: 155 · 2022: 103 · 2021: 61
- FWCI
- 50.12
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Interspeech (USB) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
- Keywords
- cross-lingual representation learning, multilingual speech recognition, XLS-R, wav2vec 2.0, contrastive learning, shared latent representation, Common Voice, Babel
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review