The DOI matches its Crossref record; 107 of the 114 references it cites were found in a registry or an index.
BigSSL: Exploring the Frontier of Large-Scale Semi-Supervised Learning for Automatic Speech Recognition
Open accessAbstract
We summarize the results of a host of efforts using giant automatic speech recognition (ASR) models pre-trained using large, diverse unlabeled datasets containing approximately a million hours of audio. We find that the combination of pre-training, self-training and scaling up model size greatly increases data efficiency, even for extremely large tasks with tens of thousands of hours of labeled data. In particular, on an ASR task with 34 k hours of labeled data, by fine-tuning an 8 billion parameter pre-trained Conformer model we can match state-of-the-art (SoTA) performance with only 3% of the training data and significantly improve SoTA with the full training set. We also report on the universal benefits gained from using big pre-trained and self-trained models for a large set of downstream tasks that cover a wide range of speech domains and span multiple orders of magnitudes of dataset sizes, including obtaining SoTA performance on many public benchmarks. In addition, we utilize the learned representation of pre-trained networks to achieve SoTA results on non-ASR tasks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Some of these tests produce very low error rates that even outperform those achieved through manual transcription [Zhang et al. 2022].”
From Measuring the Accuracy of Automatic Speech Recognition Solutions (2023) · cites this paper as Zhang et al. 2022
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Representation Learning with Contrastive Predictive Coding
Oord, A. V. D., Li, Y., & Vinyals, O. (2018) · arXiv · doi:10.48550/arxiv.1807.03748 · Cited by 6,242
“Librispeech: an ASR corpus based on public domain audio books,”
Panayotov, V., Chen, G., Povey, D., & Khudanpur, S. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178964 · Cited by 6,072
Graves, A., Fernández, S., Gomez, F., & Schmidhuber, J. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143891 · Cited by 5,370
Kaldi Speech Recognition Toolkit
Povey, D. (2024) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · doi:10.57702/jb3fvbn9 · Cited by 5,270
SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition
Park, D. S., Chan, W., Zhang, Y., Chiu, C.-C., Zoph, B., Cubuk, E. D., & Le, Q. V. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-2680 · Cited by 3,558
Self-citationTransformer-XL: Attentive language models beyond a fixed-length context
Dai, Z., Yang, Z., Yang, Y., Carbonell, J., Le, Q., & Salakhutdinov, R. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1285 · Cited by 3,169
Self-citation
Research works printed but not linked: 2
- Zavaliagkos, 1998, Utilizing untranscribed training data to improve performance, 301
- Radford, 2019, Language models are unsupervised multitask learners, OpenAI blog, 1, 9
Cited by
Sorted by citations
WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing
Chen, S., Wang, C., Chen, Z., Wu, Y., Liu, S., Chen, Z., Li, J., Kanda, N., Yoshioka, T., Xiao, X., et al. (2022) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3188113 · Cited by 1,926
Self-citationXLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale
Babu, A., Wang, C., Tjandra, A., Lakhotia, K., Xu, Q., Goyal, N., Singh, K., von Platen, P., Saraf, Y., Pino, J., et al. (2022) · Interspeech 2022 · doi:10.21437/interspeech.2022-143 · Cited by 586
Machine Learning Methods for Small Data Challenges in Molecular Science
Dou, B., Zhu, Z., Merkurjev, E., Ke, L., Chen, L., Jian, J., Zhu, Y., Liu, J., Zhang, B., & Wei, G. (2023) · Chemical Reviews · doi:10.1021/acs.chemrev.3c00189 · Cited by 548
CLAP Learning Audio Concepts from Natural Language Supervision
Elizalde, B., Deshmukh, S., Ismail, M. A., & Wang, H. (2023) · ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp49357.2023.10095889 · Cited by 449
Recent Advances in End-to-End Automatic Speech Recognition
Li, J. (2022) · APSIPA Transactions on Signal and Information Processing · doi:10.1561/116.00000050 · Cited by 451
A review of deep learning techniques for speech processing
Mehrish, A., Majumder, N., Bharadwaj, R., Mihalcea, R., & Poria, S. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101869 · Cited by 389
End-to-End Speech Recognition: A Survey
Prabhavalkar, R., Hori, T., Sainath, T. N., Schlüter, R., & Watanabe, S. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3328283 · Cited by 298
Self-citationFLEURS: FEW-Shot Learning Evaluation of Universal Representations of Speech
Conneau, A., Ma, M., Khanuja, S., Zhang, Y., Axelrod, V., Dalmia, S., Riesa, J., Rivera, C. E., & Bapna, A. (2023) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt54892.2023.10023141 · Cited by 430
Self-citationContrastive self-supervised learning: review, progress, challenges and future research directions
Kumar, P., Rawat, P., & Chauhan, S. (2022) · International Journal of Multimedia Information Retrieval · doi:10.1007/s13735-022-00245-6 · Cited by 125
Galić, I., Habijan, M., Leventić, H., & Romić, K. (2023) · Electronics · doi:10.3390/electronics12214411 · Cited by 116
Unispeech-Sat: Universal Speech Representation Learning With Speaker Aware Pre-Training
Chen, S., Wu, Y., Wang, C., Chen, Z., Chen, Z., Liu, S., Wu, J., Qian, Y., Wei, F., Li, J., et al. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747077 · Cited by 95
Self-citationBaşarslan, M. S., & Kayaalp, F. (2023) · Journal of Cloud Computing Advances Systems and Applications · doi:10.1186/s13677-022-00386-3 · Cited by 88
BYOL for Audio: Exploring Pre-Trained General-Purpose Audio Representations
Niizumi, D., Takeuchi, D., Ohishi, Y., Harada, N., & Kashino, K. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3221007 · Cited by 84
SLAM: A Unified Encoder for Speech and Language Modeling via Speech-Text Joint Pre-TrainingPreprint
Bapna, A., Chung, Y.-A., Wu, N., Gulati, A., Ye, J., Clark, J. H., Johnson, M., Riesa, J., Conneau, A., & Zhang, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.10329 · Cited by 95
Self-citationFavaro, A., Tsai, Y.-T., Butala, A., Thebaud, T., Villalba, J., Dehak, N., & Moro-Velázquez, L. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107559 · Cited by 61
Evaluating Self-Supervised Speech Representations for Speech Emotion Recognition
Atmaja, B. T., & Sasou, A. (2022) · IEEE Access · doi:10.1109/access.2022.3225198 · Cited by 47
Measuring the Accuracy of Automatic Speech Recognition Solutions
Kuhn, K., Kersken, V., Reuter, B., Egger, N., & Zimmermann, G. (2023) · ACM Transactions on Accessible Computing · doi:10.1145/3636513 · Cited by 44
Effects of Data Augmentations on Speech Emotion Recognition
Atmaja, B. T., & Sasou, A. (2022) · Sensors · doi:10.3390/s22165941 · Cited by 46
TRILLsson: Distilled Universal Paralinguistic Speech Representations
Shor, J., & Venugopalan, S. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-118 · Cited by 42
Self-citationPARP: Prune, Adjust and Re-Prune for Self-Supervised Speech RecognitionPreprint
Lai, C.-I., Zhang, Y., Liu, A. H., Chang, S., Liao, Y.-L., Chuang, Y.-S., Qian, K., Khurana, S., Cox, D., & Glass, J. R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.05933 · Cited by 46
Self-citationSelf-Supervised Representations in Speech-Based Depression Detection
Wu, W., Zhang, C., & Woodland, P. C. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094910 · Cited by 47
Voice Interaction Recognition Design in Real-Life Scenario Mobile Robot Applications
Li, S., Liu, Y., Chen, Y.-C., Feng, H.-M., Shen, P.-K., & Wu, Y.-C. (2023) · Applied Sciences · doi:10.3390/app13053359 · Cited by 41
Self-citationMasked Modeling Duo: Towards a Universal Audio Pre-Training Framework
Niizumi, D., Takeuchi, D., Ohishi, Y., Harada, N., & Kashino, K. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3389636 · Cited by 48
Universal Paralinguistic Speech Representations Using self-Supervised Conformers
Shor, J., Jansen, A., Han, W., Park, D., & Zhang, Y. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747197 · Cited by 34
Self-citationMasked Modeling Duo: Learning Representations by Encouraging Both Networks to Model the Input
Niizumi, D., Takeuchi, D., Ohishi, Y., Harada, N., & Kashino, K. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10097236 · Cited by 37
Massively Multilingual ASR: A Lifelong Learning Solution
Li, B., Pang, R., Zhang, Y., Sainath, T. N., Strohman, T., Haghani, P., Zhu, Y., Farris, B., Gaur, N., & Prasad, M. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746594 · Cited by 32
Self-citationWhy does Self-Supervised Learning for Speech Recognition Benefit Speaker Recognition?
Chen, S., Wu, Y., Wang, C., Liu, S., Chen, Z., Wang, P., Liu, G., Li, J., Wu, J., Yu, X., et al. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10019 · Cited by 33
Self-citationJiang, S., & Chen, Z. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e21625 · Cited by 31
Self-citationTowards Better Domain Adaptation for Self-Supervised Models: A Case Study of Child ASR
Fan, R., Zhu, Y., Wang, J., & Alwan, A. A. (2022) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3200910 · Cited by 37
Pseudo Label Is Better Than Human Label
Hwang, D., Sim, K. C., Huo, Z., & Strohman, T. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-11034 · Cited by 29
Self-citationYang, C.-H. H., Li, B., Zhang, Y., Chen, N., Prabhavalkar, R., Sainath, T. N., & Strohman, T. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094903 · Cited by 25
Self-citationFavaro, A., Butala, A., Thebaud, T., Villalba, J., Dehak, N., & Moro-Velázquez, L. (2024) · npj Parkinson s Disease · doi:10.1038/s41531-024-00817-9 · Cited by 22
Autoregressive Predictive Coding: A Comprehensive Study
Yang, G.-P., Yeh, S.-L., Chung, Y.-A., Glass, J. R., & Tang, H. (2022) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3203608 · Cited by 24
Kanda, N., Wu, J., Wang, X., Chen, Z., Li, J., & Yoshioka, T. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095367 · Cited by 20
Self-citationEfficient Domain Adaptation for Speech Foundation Models
Li, B., Hwang, D., Huo, Z., Bai, J., Prakash, G., Sainath, T. N., Sim, K. C., Zhang, Y., Han, W., Strohman, T., et al. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096330 · Cited by 22
Self-citationMassively Multilingual Shallow Fusion with Large Language Models
Hu, K., Sainath, T. N., Li, B., Du, N., Huang, Y., Dai, A. M., Zhang, Y., Cabrera, R., Chen, Z., & Strohman, T. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094796 · Cited by 19
Self-citationGabler, P., Geiger, B. C., Schuppler, B., & Kern, R. (2023) · Information · doi:10.3390/info14020137 · Cited by 24
Kim, J.-Y., & Lee, S.-H. (2024) · IEEE Access · doi:10.1109/access.2024.3447770 · Cited by 17
Hassan, M. A., Rehmat, A., Khan, M. U. G., & Yousaf, M. H. (2022) · Mathematical Problems in Engineering · doi:10.1155/2022/6825555 · Cited by 15
MelHuBERT: A Simplified Hubert on Mel Spectrograms
Lin, T.-Q., Lee, H.-Y., & Tang, H. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389700 · Cited by 15
Parameter Efficient Finetuning for Speech Emotion Recognition and Domain Adaptation
Lashkarashvili, N., Wu, W., Sun, G., & Woodland, P. C. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446272 · Cited by 15
An end-to-end continuous Kannada ASR system under uncontrolled environment
Thimmaraja Yadava, G., Nagaraja, B. G., & Jayanna, H. S. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-15854-4 · Cited by 12
Lai, H., Hu, C.-C., Wen, C.-H., Wu, J., Pai, N., Yeh, C., & Lin, C. (2024) · IEEE Access · doi:10.1109/access.2024.3430296 · Cited by 11
Transformers in speech processing: Overcoming challenges and paving the future
Latif, S., Zaidi, S. A. M., Cuayáhuitl, H., Shamshad, F., Shoukat, M., Usama, M., & Qadir, J. (2025) · Computer Science Review · doi:10.1016/j.cosrev.2025.100768 · Cited by 116
Wav2vec-S: Semi-Supervised Pre-Training for Low-Resource ASR
Zhu, H., Wang, L., Cheng, G., Wang, J., Zhang, P., & Yan, Y. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-909 · Cited by 12
Unsupervised Data Selection via Discrete Speech Representation for ASR
Lu, Z., Wang, Y., Zhang, Y., Han, W., Chen, Z., & Haghani, P. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-399 · Cited by 11
Self-citationProsody Modelling With Pre-Trained Cross-Utterance Representations for Improved Speech Synthesis
Zhang, Y.-J., Zhang, C., Song, W. G., Zhang, Z., Wu, Y., & He, X. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3278184 · Cited by 12
Self-citationSpeech Intelligibility Classifiers from 550k Disordered Speech Samples
Venugopalan, S., Tobin, J., Yang, S., Seaver, K., Cave, R., Jiang, P.-P., Zeghidour, N., Heywood, R., Green, J. R., & Brenner, M. P. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095933 · Cited by 11
Diagonal State Space Augmented Transformers for Speech Recognition
Saon, G., Gupta, A., & Cui, X. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096271 · Cited by 10
A semi-supervised framework for computational fluid dynamics prediction
Wang, X., Dong, Y., Zou, S., Zhang, L., & Deng, X. (2024) · Applied Soft Computing · doi:10.1016/j.asoc.2024.111422 · Cited by 12
Parameter-Efficient Learning for Text-to-Speech Accent Adaptation
Yang, L.-J., Yang, C.-H. H., & Chien, J. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-1212 · Cited by 11
Non-intrusive speech quality assessment: A survey
Shen, K., Yan, D., Hu, J., & Ye, Z. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127471 · Cited by 11
Unstructured Pruning and Low Rank Factorisation of Self-Supervised Pre-Trained Speech Models
Wang, H., & Zhang, W.-Q. (2024) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2024.3433616 · Cited by 10
Learning Mask Scalars for Improved Robust Automatic Speech Recognition
Narayanan, A., Walker, J., Panchapagesan, S., Howard, N., & Koizumi, Y. (2023) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt54892.2023.10022813 · Cited by 9
Huang, W., Allauzen, C., Chen, T., Gupta, K., Hu, K., Qin, J., Zhang, Y., Wang, Y., Chang, S.-Y., & Sainath, T. N. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448361 · Cited by 13
Self-citationTranscription Accuracy of Automatic Speech Recognition for Orthodontic Clinical Records
O’Kane, R., Stonehouse‐Smith, D., Ota, L. C. U., Patel, R., Johnson, N., Slipper, C., Seehra, J., Papageorgiou, S. N., & Cobourne, M. T. (2025) · Journal of Dental Research · doi:10.1177/00220345251382452 · Cited by 8
Semi-Supervised Contrastive Learning for Time Series Classification in Healthcare
Liu, X., Liu, Z., Li, J., & Zhang, X. (2024) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2024.3400885 · Cited by 7
Improving Deliberation by Text-Only and Semi-Supervised Training
Hu, K., Sainath, T. N., He, Y., Prabhavalkar, R., Strohman, T., Mavandadi, S., & Wang, W. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-243 · Cited by 11
Self-citationBridging the Granularity Gap for Acoustic Modeling
Xu, C., Zhang, Y., Jiao, C., Liu, X., Hu, C., Zeng, X., Xiao, T., Ma, A., Wang, H., & Zhu, J. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.688 · Cited by 7
Self-citationHow to Estimate Model Transferability of Pre-Trained Speech Models?
Chen, Z.-C., Yang, C.-H. H., Li, B., Zhang, Y., Chen, N., Chang, S.-Y., Prabhavalkar, R., Lee, H.-Y., & Sainath, T. N. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-1079 · Cited by 14
Self-citationSim, K. C., Huo, Z., Munkhdalai, T., Siddhartha, N., Stooke, A., Meng, Z., Li, B., & Sainath, T. N. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10445894 · Cited by 6
Self-citationPark, D., Yu, Y., Katabi, D., & Kim, H. K. (2023) · IEEE Signal Processing Letters · doi:10.1109/lsp.2023.3298532 · Cited by 7
Self-citationSoltani, R., Benmohamed, E., & Ltifi, H. (2024) · Neural Computing and Applications · doi:10.1007/s00521-024-10519-1 · Cited by 6
Detecting adversarial examples using image reconstruction differences
Sun, J., & Yi, M. (2023) · Soft Computing · doi:10.1007/s00500-023-07961-z · Cited by 6
Distilled Non-Semantic Speech Embeddings with Binary Neural Networks for Low-Resource Devices
Lee, H., & Saeed, A. (2022) · Pattern Recognition Letters · doi:10.1016/j.patrec.2023.11.028 · Cited by 5
Mask-Conformer: Augmenting Conformer with Mask-Predict Decoder
Higuchi, Y., Rosenberg, A., Wang, Y., Baskar, M. K., & Ramabhadran, B. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389803 · Cited by 5
Self-citationComparison of Soft and Hard Target RNN-T Distillation for Large-Scale ASR
Hwang, D., Sim, K. C., Zhang, Y., & Strohman, T. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096418 · Cited by 6
Self-citationCTCBERT: Advancing Hidden-Unit Bert with CTC Objectives
Fan, R., Wang, Y., Gaur, Y., & Li, J. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094922 · Cited by 7
Self-citationZhang, L. (2024) · Service Oriented Computing and Applications · doi:10.1007/s11761-024-00398-8 · Cited by 5
Pre-Finetuning for Few-Shot Emotional Speech Recognition
Chen, M., & Zhou, Y. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-136 · Cited by 7
Self-supervised random forests for robust voice activity detection with limited labeled data
Bhat, M., & Keskar, R. B. (2025) · Applied Acoustics · doi:10.1016/j.apacoust.2025.110636 · Cited by 4
Tompkins, D. G., Kumar, K., & Wu, J. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747250 · Cited by 4
More Speaking or More Speakers?
Berrebbi, D., Collobert, R., Jaitly, N., & Likhomanenko, T. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096078 · Cited by 4
Foundation Models for Speech, Images, Videos, and Control
Paaß, G., & Giesselbach, S. (2023) · Artificial intelligence: foundations, theory, and algorithms/Artificial intelligence: Foundations, theory, and algorithms · doi:10.1007/978-3-031-23190-2_7 · Cited by 6
RAttSR: A Novel Low-Cost Reconstructed Attention-Based End-to-End Speech Recognizer
Paul, B., & Phadikar, S. (2023) · Circuits Systems and Signal Processing · doi:10.1007/s00034-023-02570-5 · Cited by 4
Bittar, A., Dixon, P. R., Samragh, M., Nishu, K., & Naik, D. K. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447485 · Cited by 4
Weighted Ensemble Learning for Accident Severity Classification Using Social Media Data
Raul, S. K., Rout, R. R., & Somayajulu, D. V. L. N. (2024) · SN Computer Science · doi:10.1007/s42979-024-02870-w · Cited by 4
Henkel, O., Horne-Robinson, H., Hills, L., Roberts, B., & McGrane, J. A. (2025) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-024-00435-9 · Cited by 6
Resource-Efficient Transfer Learning from Speech Foundation Model Using Hierarchical Feature Fusion
Huo, Z., Sim, K. C., Li, B., Hwang, D., Sainath, T. N., & Strohman, T. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096799 · Cited by 5
Self-citationKMSAV: Korean multi‐speaker spontaneous audiovisual dataset
Park, K., Oh, C., & Dong, S. (2024) · ETRI Journal · doi:10.4218/etrij.2023-0352 · Cited by 4
Multilingual Speech Recognition using Knowledge Transfer across Learning ProcessesPreprint
Lahiri, R., Kumatani, K., Sun, E., & Qian, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.07909 · Cited by 4
Improving Audio Classification Method by Combining Self-Supervision with Knowledge Distillation
Gong, X., Duan, H., Yang, Y., Tan, L., Wang, J., & Vasilakos, A. V. (2023) · Electronics · doi:10.3390/electronics13010052 · Cited by 3
Jing, W., Lu, L., Liu, Q., & Chen, Z. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.130005 · Cited by 3
Self-citationKnowledge Management Framework Over Low Resource Indian Colloquial Language Audio Contents
Srivatsa, S., Aparna, M., Madhavan, G. S., & Srinivasa, S. (2024) · Joint International Conference on Data Science & Management of Data (CODS-COMAD) · doi:10.1145/3632410.3632483 · Cited by 3
Multi-Head Attention-Enhanced Speech Recognition for Reduced Data Requirements
Li, Y., Zhou, Y., Qiu, Z., Wang, Y., Wang, J., & Huang, G. (2024) · Electronics · doi:10.3390/electronics14010128 · Cited by 4
Self-citationToken-Weighted RNN-T For Learning From Flawed Data
Keren, G., Zhou, W. M., & Kalinli, O. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832209 · Cited by 3
Li, Z., Xia, T., Chang, Y., & Wu, Y. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130711 · Cited by 5
Self-citationCross-Training: A Semi-Supervised Training Scheme for Speech Recognition
Khorram, S., Tripathi, A., Kim, J., Han, L., Zhang, Q., Prabhavalkar, R., & Sak, H. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096978 · Cited by 3
Novel Rifle Number Recognition Based on Improved YOLO in Military Environment
Kwon, H., & Lee, S. (2024) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2023.042466 · Cited by 3
Task Vector Algebra for ASR Models
Ramesh, G., Audhkhasi, K., & Ramabhadran, B. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447848 · Cited by 3
Self-citationDeep learning-based Soft word embedding approach for sentiment analysis
Ouni, C., Benmohamed, E., & Ltifi, H. (2024) · Procedia Computer Science · doi:10.1016/j.procs.2024.09.720 · Cited by 3
Xu, C., Liu, X., Zhang, Y., Ma, A., Xiao, T., Zhu, J., Man, D., & Yang, W. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3555070 · Cited by 3
Self-citationSpeech Feature Extraction in Broadcast Hosting Based on Fluctuating Equation Inversion
Xu, C. (2024) · Journal of Advanced Computational Intelligence and Intelligent Informatics · doi:10.20965/jaciii.2024.p0762 · Cited by 2
Boosting grapevine phenological stages prediction based on climatic data by pseudo-labeling approach
Fasihi, M., Sodini, M., Falcon, A., Degano, F., Sivilotti, P., & Serra, G. (2025) · Artificial Intelligence in Agriculture · doi:10.1016/j.aiia.2025.03.003 · Cited by 4
Kermanshahi, M. A., Akbari, A., Nasersharif, B., & Kabudian, S. J. (2025) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2025.110851 · Cited by 2
Revealing the Role of Audio Channels in ASR Performance Degradation
Huang, K., Chen, L.-W., Lee, H.-S., Chen, B., & Wang, H.-M. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11434673 · Cited by 2
Thimmaraja Yadava, G., Nagaraja, B. G., Jayanna, H. S., & Shivakumar, B. R. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-16554-9 · Cited by 2
UniEnc-CASSNAT: An Encoder-Only Non-Autoregressive ASR for Speech SSL Models
Fan, R., Shankar, N. B., & Alwan, A. A. (2024) · IEEE Signal Processing Letters · doi:10.1109/lsp.2024.3365036 · Cited by 2
Retracted: Exploring Reinforcement Learning in Large-Scale Data Processing
Bhambu, P., Kumar, R., Sharmila, P., Patil, V. D., Khurana, S., & Vivek, V. (2023) · International Conference on Smart Generation Computing, Communication and Networking (SMART GENCON) · doi:10.1109/smartgencon60755.2023.10442194 · Cited by 3
RetractedHamzaoui, Bachiri, Ouassam, E., Mouncif, H., & Bouikhalene, B. (2024) · International Conference on Networking, Information Systems & Security (NISS) · doi:10.1145/3659677.3659823 · Cited by 4
Metadata
- Authors
- Zhang, Y., Park, D. S., Han, W., Qin, J., Gulati, A., Shor, J., Jansen, A., Xu, Y., Huang, Y., Wang, S., Zhou, Z., Li, B., Ma, M., Chan, W., Yu, J., Wang, Y., Cao, L., Sim, K. C., Ramabhadran, B., Sainath, T. N., Beaufays, F., Chen, Z., Le, Q. V., Chiu, C.-C., Pang, R., & Wu, Y.
- Affiliations
- Google (United States) (US)
- Google, Inc., USA
- ORCID
- Venue
- IEEE Journal of Selected Topics in Signal Processing
- Published
- 2022-10
- Volume
- 16
- Issue
- 6
- Pages
- 1519-1532
- ISSN
- 1932-4553 (ISSN-L)
- 1941-0484
- OpenAlex
- W3204696009
- Cited by
- 161
- References
- 114
- Citations by year
- 2026: 11 · 2025: 28 · 2024: 40 · 2023: 51 · 2022: 28
- FWCI
- 12.09
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Journal of Selected Topics in Signal Processing (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- speech recognition, pre-training, self-training, data efficiency, conformational isomers, model scaling, transfer learning, representation learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
