SUPERB: Speech Processing Universal PERformance Benchmark
The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
Self-supervised learning (SSL) has proven vital for advancing research in natural language processing (NLP) and computer vision (CV).The paradigm pretrains a shared model on large volumes of unlabeled data and achieves state-of-the-art (SOTA) for various tasks with minimal adaptation.However, the speech processing community lacks a similar setup to systematically explore the paradigm.To bridge this gap, we introduce Speech processing Universal PERformance Benchmark (SUPERB).SUPERB is a leaderboard to benchmark the performance of a shared model across a wide range of speech processing tasks with minimal architecture changes and labeled data.Among multiple usages of the shared model, we especially focus on extracting the representation learned from SSL for its preferable re-usability.We present a simple framework to solve SUPERB tasks by learning task-specialized lightweight prediction heads on top of the frozen shared model.Our results demonstrate that the framework is promising as SSL representations show competitive generalizability and accessibility across SUPERB tasks.We release SUPERB as a challenge with a leaderboard 1 and a benchmark toolkit 2 to fuel the research in representation learning and general speech processing.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“According to [14], the authors have also indicated that by weighting the representations of different layers, self-supervised model has shown great potential in various speech downstream tasks.”
From Audio Deepfake Detection With Self-Supervised WavLM And Multi-Fusion Attentive Classifier (2024) · cites this paper as [14]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Self-citationBERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Self-citationDeep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
Self-citationRepresentation Learning with Contrastive Predictive Coding
Oord, A. V. D., Li, Y., & Vinyals, O. (2018) · arXiv · doi:10.48550/arxiv.1807.03748 · Cited by 6,242
“Librispeech: an ASR corpus based on public domain audio books,”
Panayotov, V., Chen, G., Povey, D., & Khudanpur, S. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178964 · Cited by 6,072
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
Wang, A., Singh, A., Michael, J., Hill, F., Levy, O., & Bowman, S. (2018) · Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP · doi:10.18653/v1/w18-5446 · Cited by 4,222
IEMOCAP: Interactive emotional dyadic motion capture database
Busso, C., Bulut, M., Lee, C.-C., Kazemzadeh, A., Mower, E., Kim, S., Chang, J. N., Lee, S., & Narayanan, S. S. (2008) · Language Resources and Evaluation · doi:10.1007/s10579-008-9076-6 · Cited by 3,869
HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units
Hsu, W.-N., Bolte, B., Tsai, Y.-H. H., Lakhotia, K., Salakhutdinov, R., & Mohamed, A. (2021) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2021.3122291 · Cited by 2,983
Self-citationDeep Clustering for Unsupervised Learning of Visual Features
Caron, M., Bojanowski, P., Joulin, A., & Douze, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_9 · Cited by 2,674
X-Vectors: Robust DNN Embeddings for Speaker Recognition
Snyder, D., Garcia-Romero, D., Sell, G., Povey, D., & Khudanpur, S. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8461375 · Cited by 2,620
Research works printed but not linked: 2
- [13][13] A. Baevski, S. Schneider, and M. Auli, 'vq-wav2vec: Selfsupervised learning of discrete speech representations,' in ICLR , 2020. -
- [25][25] X. Anguera, L. Rodriguez-Fuentes, A. Buzo, F. Metze, I. Sz¨ oke, and M. Penagarikano, 'Quesst2014: Evaluating query-byexample speech search in a zero-resource setting with real-life queries,' in ICASSP , 2015, pp. 5833-5837. -
Cited by
Items 201–300 of 756
Estimating the Uncertainty in Emotion Attributes using Deep Evidential Regression
Wu, W., Zhang, C., & Woodland, P. C. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.873 · Cited by 24
Fine-Tuning Self-Supervised Learning Models for End-to-End Pronunciation Scoring
Zahran, A., Fahmy, A. A., Wassif, K. T., & Bayomi, H. (2023) · IEEE Access · doi:10.1109/access.2023.3317236 · Cited by 19
Automatic Recognition of Emotions in Speech With Large Self-Supervised Learning Transformer Models
Gavali, M. P., & Verma, A. (2023) · International Conference on Artificial Intelligence, Blockchain, and Internet of Things (AIBThings) · doi:10.1109/aibthings58340.2023.10292462 · Cited by 12
Speech self-supervised representations benchmarking: A case for larger probing heads
Zaiem, S., Kemiche, Y., Parcollet, T., Essid, S., & Ravanelli, M. (2024) · Computer Speech & Language · doi:10.1016/j.csl.2024.101695 · Cited by 31
Saliba, A., Li, Y., Sanabria, R., & Lai, C. (2024) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw62465.2024.10627629 · Cited by 17
Self-citationOpen Implementation and Study of Best-RQ for Speech Processing
Whetten, R., Parcollet, T., Dinarelli, M., & Estève, Y. (2024) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw62465.2024.10626364 · Cited by 28
USED: Universal Speaker Extraction and Diarization
Ao, J., Yldrm, M. S., Tao, R., Ge, M., Wang, S., Qian, Y., & Li, H. (2024) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3511268 · Cited by 21
Angra, A., Muralikrishna, H., Dinesh, D. A., & Thenkanidiyoor, V. (2024) · IEEE Access · doi:10.1109/access.2024.3523951 · Cited by 14
An empirical evaluation of deep semi-supervised learning
Fredriksson, T., Bosch, J., & Olsson, H. H. (2025) · International Journal of Data Science and Analytics · doi:10.1007/s41060-024-00713-8 · Cited by 13
Computer Audition: From Task-Specific Machine Learning to Foundation Models
Triantafyllopoulos, A., Tsangko, I., Gebhard, A., Mesaros, A., Virtanen, T. I., & Schuller, B. W. (2025) · Proceedings of the IEEE · doi:10.1109/jproc.2025.3593952 · Cited by 20
Xie, Y., Arildsen, T., & Tan, Z. (2021) · Machine learning for signal processing ... · doi:10.1109/mlsp52302.2021.9596320 · Cited by 12
On the Use of External Data for Spoken Named Entity Recognition
Pasad, A., Wu, F., Shon, S., Livescu, K., & Han, K. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.53 · Cited by 22
Supervision-Guided Codebooks for Masked Prediction in Speech Pre-training
Wang, C., Wang, Y., Wu, Y., Chen, S., Li, J., Liu, S., & Wei, F. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-936 · Cited by 17
Wav2vec-S: Semi-Supervised Pre-Training for Low-Resource ASR
Zhu, H., Wang, L., Cheng, G., Wang, J., Zhang, P., & Yan, Y. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-909 · Cited by 17
Lodagala, V. S., Ghosh, S., & Umesh, S. (2023) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt54892.2023.10022552 · Cited by 19
Unsupervised Speaker Verification Using Pre-Trained Model and Label Correction
Chen, Z., Wang, J., Hu, W., Li, L., & Hong, Q. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094610 · Cited by 14
Zero-Shot Text-to-Speech Synthesis Conditioned Using Self-Supervised Speech Representation Model
Fujita, K., Ashihara, T., Kanagawa, H., Moriya, T., & Ijima, Y. (2023) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw59220.2023.10193459 · Cited by 23
Textless Speech Emotion Conversion using Decomposed and Discrete RepresentationsPreprint
Kreuk, F., Polyak, A., Copet, J., Kharitonov, E., Nguyen, T. A., Rivière, M., Hsu, W.-N., Mohamed, A., Dupoux, E., & Adi, Y. (2021) · arXiv (Cornell University) · Cited by 12
Self-citationSpeech Foundation Models on Intelligibility Prediction for Hearing-Impaired Listeners
Cuervo, S., & Marxer, R. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447907 · Cited by 24
Benchmarking Representations for Speech, Music, and Acoustic Events
Quatra, M. L., Koudounas, A., Vaiani, L., Baralis, E., Cagliero, L., Garza, P., & Siniscalchi, S. M. (2024) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw62465.2024.10625960 · Cited by 53
How Should We Extract Discrete Audio Tokens from Self-Supervised Models?
Mousavi, P., Duret, J., Zaiem, S., Libera, L. D., Ploujnikov, A., Subakan, C., & Ravanelli, M. (2024) · Interspeech (USB) · doi:10.21437/interspeech.2024-2135 · Cited by 42
Context-aware data augmentation for enhanced speech command recognition in industrial environments
Simone, G. D., Greco, A., Rosa, F., Saggese, A., & Vento, M. (2025) · Scientific Reports · doi:10.1038/s41598-025-01886-3 · Cited by 13
A Performance Benchmarking Review of Transformers for Speaker-Independent Speech Emotion Recognition
Portal, F., de Lope, J., & Graña, M. (2025) · International Journal of Neural Systems · doi:10.1142/s0129065725300013 · Cited by 13
Federated Learning for ASR Based on wav2vec 2.0
Nguyen, T., Mdhaffar, S., Tomashenko, N., Bonastre, J.-F., & Estève, Y. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096426 · Cited by 25
Robustdistiller: Compressing Universal Speech Representations for Enhanced Environment Robustness
Guimarães, H. R., Pimentel, A., Avila, A. R., Rezagholizadeh, M., Chen, B., & Falk, T. H. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095480 · Cited by 25
Prosody Modelling With Pre-Trained Cross-Utterance Representations for Improved Speech Synthesis
Zhang, Y.-J., Zhang, C., Song, W. G., Zhang, Z., Wu, Y., & He, X. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3278184 · Cited by 16
Analysis of Oral Exams With Speaker Diarization and Speech Emotion Recognition: A Case Study
Beccaro, W., Ramírez, M. A., Liaw, W., & Guimarães, H. R. (2023) · IEEE Transactions on Education · doi:10.1109/te.2023.3321155 · Cited by 12
Feng, T., Hebbar, R., & Narayanan, S. S. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446616 · Cited by 21
How Does End-To-End Speech Recognition Training Impact Speech Enhancement Artifacts?
Iwamoto, K., Ochiai, T., Delcroix, M., Ikeshita, R., Sato, H. P., Araki, S., & Katagiri, S. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447750 · Cited by 18
Selective HuBERT: Self-Supervised Pre-Training for Target Speaker in Clean and Mixture Speech
Lin, J., Ge, M., Wang, W., Li, H., & Feng, M. (2024) · IEEE Signal Processing Letters · doi:10.1109/lsp.2024.3383794 · Cited by 17
Mandarin-English Code-switching Speech Recognition with Self-supervised Speech Representation ModelsPreprint
Tseng, L.-H., Fu, Y.-K., Chang, H.-J., & Lee, H.-Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.03504 · Cited by 21
Self-citationGuo, D., Zhang, Z., Yang, B., Zhang, J., & Lin, Y. (2023) · IEEE Transactions on Circuits & Systems II Express Briefs · doi:10.1109/tcsii.2023.3269051 · Cited by 10
Self-citationHuang, R., Zhang, C., Ren, Y., Zhao, Z., & Yu, D. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.508 · Cited by 20
Savchenko, A. V., & Sidorova, A. P. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00488 · Cited by 18
Mohan, J., Reddy, M. S., Premjith, B., Jyothish Lal, G., & Chakravarthi, B. R. (2025) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3712260 · Cited by 17
Leveraging Content and Acoustic Representations for Speech Emotion Recognition
Dutta, S., & Ganapathy, S. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3603853 · Cited by 20
Domain Adversarial Training for Mitigating Gender Bias in Speech-based Mental Health Detection
Kim, J.-W., Yoon, H., Oh, W., Jung, D., Yoon, S.-H., Kim, D.-J., Lee, D., Lee, S.-Y., & Yang, C.-M. (2025) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc58623.2025.11253190 · Cited by 16
On Compressing Sequences for Self-Supervised Speech Models
Meng, Y., Chen, H.-J., Shi, J., Watanabe, S., Garcia, L. P., Lee, H.-Y., & Tang, H. (2023) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt54892.2023.10022991 · Cited by 19
Self-citationHuang, K.-P., Fu, Y.-K., Hsu, T.-Y., Ritter-Gutierrez, F., Wang, F.-L., Tseng, L.-H., Zhang, Y., & Lee, H.-Y. (2023) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt54892.2023.10022474 · Cited by 10
Self-citationImproving Few-Shot Learning for Talking Face System with TTS Data Augmentation
Chen, Q., Ma, Z., Liu, T., Tan, X., Lu, Q., Yu, K., & Chen, X. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094777 · Cited by 12
Liu, X., Li, X., & Serrà, J. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096478 · Cited by 15
Exploring Subgroup Performance in End-to-End Speech Models
Koudounas, A., Pastor, E., Attanasio, G., Mazzia, V., Giollo, M., Gueudré, T., Cagliero, L., de Alfaro, L., Baralis, E., & Amberti, D. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095284 · Cited by 13
Avoid Overthinking in Self-Supervised Models for Speech Recognition
Berrebbi, D., Yan, B., & Watanabe, S. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095335 · Cited by 13
Self-citationCan Self-Supervised Neural Representations Pre-Trained on Human Speech distinguish Animal Callers?
Sarkar, E., & Magimai.-Doss, M. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-1968 · Cited by 26
Disentanglement in a GAN for Unconditional Speech Synthesis
Baas, M., & Kamper, H. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3359352 · Cited by 13
Temporal Shift Module with Pretrained Representations for Speech Emotion Recognition
Shen, S., Liu, F., Wang, H., Wang, Y., & Zhou, A. (2024) · Intelligent Computing · doi:10.34133/icomputing.0073 · Cited by 11
Efficient Adapter Tuning of Pre-Trained Speech Models for Automatic Speaker Verification
Sang, M., & Hansen, J. H. L. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446686 · Cited by 18
A perceptual similarity space for speech based on self-supervised speech representations
Chernyak, B. R., Bradlow, A. R., Keshet, J., & Goldrick, M. (2024) · The Journal of the Acoustical Society of America · doi:10.1121/10.0026358 · Cited by 17
Membership Inference Attacks Against Self-supervised Speech Models
Tseng, W.-C., Kao, W.-T., & Lee, H.-Y. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-11245 · Cited by 26
Self-citationA Systematic Comparison of Phonetic Aware Techniques for Speech Enhancement
Tal, O., Mandel, M., Kreuk, F., & Adi, Y. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-695 · Cited by 12
PADA: Pruning Assisted Domain Adaptation for Self-Supervised Speech Representations
Lodagala, V. S., Ghosh, S., & Umesh, S. (2023) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt54892.2023.10022820 · Cited by 11
Gao, C., Marsic, I., Sarcevic, A., Gestrich-Thompson, W. V., & Burd, R. S. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3580798 · Cited by 14
Sakti, S., & Titalim, B. A. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389730 · Cited by 15
A Brief Overview of Unsupervised Neural Speech Representation LearningPreprint
Borgholt, L., Havtorn, J. D., Edin, J., Maaløe, L., & Igel, C. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.01829 · Cited by 16
Topological Data Analysis for Speech Processing
Tulchinskii, E., Kuznetsov, K., Kushnareva, L., Cherniavskii, D., Barannikov, S., Piontkovskaya, I., Nikolenko, S., & Burnaev, E. V. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-1861 · Cited by 12
Unstructured Pruning and Low Rank Factorisation of Self-Supervised Pre-Trained Speech Models
Wang, H., & Zhang, W.-Q. (2024) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2024.3433616 · Cited by 17
Bautista, J. L., & Shin, H. (2025) · Applied Sciences · doi:10.3390/app15020623 · Cited by 13
Speech Tasks Relevant to Sleepiness Determined With Deep Transfer Learning
Tran, B., Zhu, Y., Liang, X., Schwoebel, J. W., & Warrenburg, L. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747000 · Cited by 12
Self-Supervised Speech Representation Learning for Keyword-Spotting With Light-Weight Transformers
Gao, C., Gu, Y., Calivá, F., & Liu, Y. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095929 · Cited by 9
Oota, S. R., Pahwa, K., Marreddy, M., Gupta, M., & Bapi, R. S. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096248 · Cited by 18
An Adapter Based Multi-Label Pre-Training for Speech Separation and Enhancement
Wang, T., Chen, X., Chen, Z., Yu, S., & Zhu, W. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094883 · Cited by 11
Cocktail Hubert: Generalized Self-Supervised Pre-Training for Mixture and Single-Source Speech
Fazel-Zarandi, M., & Hsu, W.-N. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096630 · Cited by 21
Zhu, Z., & Sato, Y. (2023) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw59220.2023.10193018 · Cited by 9
Masuyama, Y., Chang, X., Zhang, W., Cornell, S., Wang, Z.-Q., Ono, N., Qian, Y., & Watanabe, S. (2023) · IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) · doi:10.1109/waspaa58266.2023.10248096 · Cited by 9
Self-citationRobust speech command recognition in challenging industrial environments
Bini, S., Carletti, V., Saggese, A., & Vento, M. (2024) · Computer Communications · doi:10.1016/j.comcom.2024.107938 · Cited by 11
Rethinking Mamba in Speech Processing by Self-Supervised Models
Zhang, X., Ma, J., Shahin, M. A., Ahmed, B., & Epps, J. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889111 · Cited by 30
Self-supervised Representation Learning for Speech Processing
Lee, H.-Y., Mohamed, A., Watanabe, S., Sainath, T. N., Livescu, K., Li, S.-W. D., Yang, S.-W., & Kirchhoff, K. (2022) · doi:10.18653/v1/2022.naacl-tutorials.2 · Cited by 14
Self-citationA Speech Representation Anonymization Framework via Selective Noise Perturbation
Tran, M., & Soleymani, M. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095173 · Cited by 10
Close, G., Ravenscroft, W., Hain, T., & Goetze, S. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095666 · Cited by 22
Augmentation Invariant Discrete Representation for Generative Spoken Language Modeling
Gat, I., Kreuk, F., Nguyen, T. A., Lee, A., Copet, J., Synnaeve, G., Dupoux, E., & Adi, Y. (2023) · International Conference on Spoken Language Translation (IWSLT) · doi:10.18653/v1/2023.iwslt-1.46 · Cited by 30
ProsAudit, a prosodic benchmark for self-supervised speech models
de Seyssel, M., Lavechin, M., Titeux, H., Thomas, A., Virlet, G., Revilla, A. S., Wisniewski, G., Ludusan, B., & Dupoux, E. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-438 · Cited by 28
SVEva Fair: A Framework for Evaluating Fairness in Speaker VerificationPreprint
Toussaint, W., & Ding, A. Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.12049 · Cited by 17
Playlogue: Dataset and Benchmarks for Analyzing Adult-Child Conversations During Play
Kalanadhabhatta, M., Rastikerdar, M. M., Rahman, T., Grabell, A. S., & Ganesan, D. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3699775 · Cited by 13
Tzeng, J.-T., Leem, S.-G., Salman, A. N., Lee, C.-C., & Busso, C. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10887569 · Cited by 11
Audio Embedding-Aware Dialogue Policy Learning
Zorrilla, A. L., Torres, M. I., & Cuayáhuitl, H. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3225658 · Cited by 15
Token2vec: A Joint Self-Supervised Pre-Training Framework Using Unpaired Speech and Text
Yue, X., Ao, J., Gao, X., & Li, H. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096923 · Cited by 12
Non-Intrusive Speech Quality Assessment Based on Deep Neural Networks for Speech Communication
Liu, M., Wang, J., Wang, F., Xiang, F., & Chen, J. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3321076 · Cited by 8
Park, S., Mark, M., Park, B., & Hong, H. (2023) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2023.041332 · Cited by 12
Train Long and Test Long:Leveraging Full Document Contexts in Speech Processing
Chen, W., Kano, T., Ogawa, A., Delcroix, M., & Watanabe, S. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446727 · Cited by 16
Self-citationLearning Arousal-Valence Representation from Categorical Emotion Labels of Speech
Zhou, E., Zhang, Y., & Duan, Z. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10445890 · Cited by 10
Leveraging Self-Supervised Speech Representations for Domain Adaptation in Speech Enhancement
Lee, C.-H., Yang, C. J., Srinivasa, R. S., Saidutta, Y. M., Cho, J., Shen, Y., & Jin, H. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447573 · Cited by 10
DiffDub: Person-Generic Visual Dubbing Using Inpainting Renderer with Diffusion Auto-Encoder
Liu, T., Du, C., Fan, S., Chen, F., & Yu, K. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446049 · Cited by 9
Matassoni, M., Fong, S., & Brutti, A. (2024) · Applied Sciences · doi:10.3390/app14093876 · Cited by 10
Double Multi-Head Attention Multimodal System for Odyssey 2024 Speech Emotion Recognition Challenge
Costa, F., India, M., & Hernando, J. (2024) · The Speaker and Language Recognition Workshop (Odyssey) · doi:10.21437/odyssey.2024-38 · Cited by 9
SpeechPrompt: Prompting Speech Language Models for Speech Processing Tasks
Chang, K.-W., Wu, H., Wang, Y.-K., Wu, Y.-K., Shen, H., Tseng, W.-C., Kang, I.-T., Li, S.-W. D., & Lee, H.-Y. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3436618 · Cited by 21
Self-citationESPnet-ONNX: Bridging a Gap Between Research and Production
Someki, M., Higuchi, Y., Hayashi, T., & Watanabe, S. (2022) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.23919/apsipaasc55919.2022.9979824 · Cited by 11
Self-citationJang, K., Kim, S., Yun, S.-Y., & Kim, H. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-1329 · Cited by 12
Domain Adaptation of Low-Resource Target-Domain Models Using Well-Trained ASR Conformer Models
Sukhadia, V. N., & Umesh, S. (2023) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt54892.2023.10023233 · Cited by 8
Differential Impacts of Monologue and Conversation on Speech Emotion Recognition
Chien, W.-S., Upadhyay, S. G., Lin, W.-C., Busso, C., & Lee, C.-C. (2024) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2024.3509138 · Cited by 8
Latency-Aware Pruning and Quantization of Self-Supervised Speech Transformers for Edge Devices
Ebrahimipour, S. M., Mozafari, S. H., Clark, J. J., Gross, W. J., & Meyer, B. H. (2026) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3746638 · Cited by 8
Improving Label-Deficient Keyword Spotting Through Self-Supervised Pretraining
Bovbjerg, H. S., & Tan, Z. (2023) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw59220.2023.10193371 · Cited by 8
Slaughter, I., Greenberg, C. S., Schwartz, R., & Caliskan, A. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.602 · Cited by 25
Prompting and Adapter Tuning For Self-Supervised Encoder-Decoder Speech Model
Chang, K., Chen, M.-H., Lin, Y., Hsu, J. N., Huang, P. K.-M., Huang, C., Li, S.-W. D., & Lee, H.-Y. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389731 · Cited by 11
Self-citationConversational Speech Recognition by Learning Audio-Textual Cross-Modal Contextual Representation
Wei, K., Li, B., Lv, H., Lü, Q., Jiang, N., & Xie, L. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3389630 · Cited by 13
CL-MASR: A Continual Learning Benchmark for Multilingual ASR
Libera, L. D., Mousavi, P., Zaiem, S., Subakan, C., & Ravanelli, M. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3487410 · Cited by 24
Khan, M. S., Quatra, M. L., Hung, K.-H., Fu, S., Siniscalchi, S. M., & Tsao, Y. (2024) · IEEE International Workshop on Multimedia Signal Processing (MMSP) · doi:10.1109/mmsp61759.2024.10743615 · Cited by 9
Zhang, Z., Xu, W., Dong, Z., Wang, K., Wu, Y., Peng, J., Wang, R., & Huang, D. (2024) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2024.3506554 · Cited by 18
SQ-Whisper: Speaker-Querying Based Whisper Model for Target-Speaker ASR
Guo, P., Chang, X., Lv, H., Watanabe, S., & Xie, L. (2024) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3513835 · Cited by 18
Self-citationTTSDS - Text-to-Speech Distribution Score
Minixhofer, C., Klejch, O., & Bell, P. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832178 · Cited by 32
Metadata
- Authors
- Yang, S.-W., Chi, P.-H., Chuang, Y.-S., Lai, C.-I. J., Lakhotia, K., Lin, Y. Y., Liu, A. T., Shi, J., Chang, X., Lin, G.-T., Huang, T.-H., Tseng, W.-C., Lee, K.-T., Liu, D.-R., Huang, Z., Dong, S., Li, S.-W., Watanabe, S., Mohamed, A., & Lee, H.-Y.
- Affiliations
- National Taiwan University (TW)
- Meta (United States) (US)
- Johns Hopkins University (US)
- Carnegie Mellon University (US)
- Amazon (United States) (US)
- ORCID
- Venue
- Interspeech 2021
- Publisher
- ISCA
- Published
- 2021-08-30
- Pages
- 1194-1198
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W3197580070
- Cited by
- 681
- References
- 40
- Citations by year
- 2026: 67 · 2025: 138 · 2024: 157 · 2023: 205 · 2022: 108 · 2021: 6
- FWCI
- 54.87
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Interspeech (USB) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- self-supervised learning, speech processing, benchmark, shared models, representation learning, frozen pre-trained models, task generalization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.