SUPERB: Speech Processing Universal PERformance Benchmark
The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
Self-supervised learning (SSL) has proven vital for advancing research in natural language processing (NLP) and computer vision (CV).The paradigm pretrains a shared model on large volumes of unlabeled data and achieves state-of-the-art (SOTA) for various tasks with minimal adaptation.However, the speech processing community lacks a similar setup to systematically explore the paradigm.To bridge this gap, we introduce Speech processing Universal PERformance Benchmark (SUPERB).SUPERB is a leaderboard to benchmark the performance of a shared model across a wide range of speech processing tasks with minimal architecture changes and labeled data.Among multiple usages of the shared model, we especially focus on extracting the representation learned from SSL for its preferable re-usability.We present a simple framework to solve SUPERB tasks by learning task-specialized lightweight prediction heads on top of the frozen shared model.Our results demonstrate that the framework is promising as SSL representations show competitive generalizability and accessibility across SUPERB tasks.We release SUPERB as a challenge with a leaderboard 1 and a benchmark toolkit 2 to fuel the research in representation learning and general speech processing.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“According to [14], the authors have also indicated that by weighting the representations of different layers, self-supervised model has shown great potential in various speech downstream tasks.”
From Audio Deepfake Detection With Self-Supervised WavLM And Multi-Fusion Attentive Classifier (2024) · cites this paper as [14]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Self-citationBERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Self-citationDeep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
Self-citationRepresentation Learning with Contrastive Predictive Coding
Oord, A. V. D., Li, Y., & Vinyals, O. (2018) · arXiv · doi:10.48550/arxiv.1807.03748 · Cited by 6,242
“Librispeech: an ASR corpus based on public domain audio books,”
Panayotov, V., Chen, G., Povey, D., & Khudanpur, S. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178964 · Cited by 6,072
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
Wang, A., Singh, A., Michael, J., Hill, F., Levy, O., & Bowman, S. (2018) · Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP · doi:10.18653/v1/w18-5446 · Cited by 4,222
IEMOCAP: Interactive emotional dyadic motion capture database
Busso, C., Bulut, M., Lee, C.-C., Kazemzadeh, A., Mower, E., Kim, S., Chang, J. N., Lee, S., & Narayanan, S. S. (2008) · Language Resources and Evaluation · doi:10.1007/s10579-008-9076-6 · Cited by 3,869
HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units
Hsu, W.-N., Bolte, B., Tsai, Y.-H. H., Lakhotia, K., Salakhutdinov, R., & Mohamed, A. (2021) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2021.3122291 · Cited by 2,983
Self-citationDeep Clustering for Unsupervised Learning of Visual Features
Caron, M., Bojanowski, P., Joulin, A., & Douze, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_9 · Cited by 2,674
X-Vectors: Robust DNN Embeddings for Speaker Recognition
Snyder, D., Garcia-Romero, D., Sell, G., Povey, D., & Khudanpur, S. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8461375 · Cited by 2,620
Research works printed but not linked: 2
- [13][13] A. Baevski, S. Schneider, and M. Auli, 'vq-wav2vec: Selfsupervised learning of discrete speech representations,' in ICLR , 2020. -
- [25][25] X. Anguera, L. Rodriguez-Fuentes, A. Buzo, F. Metze, I. Sz¨ oke, and M. Penagarikano, 'Quesst2014: Evaluating query-byexample speech search in a zero-resource setting with real-life queries,' in ICASSP , 2015, pp. 5833-5837. -
Cited by
Items 501–600 of 756
Ashihara, T., Delcroix, M., Ijima, Y., & Kashino, M. (2024) · IEEE Access · doi:10.1109/access.2024.3428364 · Cited by 6
Fang, H.-C., Ye, N.-X., Shih, Y.-J., Peng, P., Wang, H.-F., Berry, L., Lee, H.-Y., & Harwath, D. F. (2024) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw62465.2024.10625802 · Cited by 2
Self-citationWang, S.-H., Shi, J., Huang, C., Watanabe, S., & Lee, H.-Y. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832321 · Cited by 4
Self-citationEmpower Typed Descriptions by Large Language Models for Speech Emotion Recognition
Wu, H., Chou, H.-C., Chang, K.-W., Goncalves, L., Du, J., Jang, J. R., Lee, C.-C., & Lee, H.-Y. (2024) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc63619.2025.10848758 · Cited by 2
Self-citationMitigating Subgroup Disparities in Speech Models: A Divergence-Aware Dual Strategy
Koudounas, A., Pastor, E., de Alfaro, L., & Baralis, E. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3539429 · Cited by 3
M-BEST-RQ: A Multi-Channel Speech Foundation Model for Smart Glasses
Yang, Y., Raj, D., Lin, J., Moritz, N., Jia, J., Keren, G., Lakomkin, E., Huang, Y. A., Donley, J., Mahadeokar, J., et al. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890482 · Cited by 4
Carvalho, C., & Abad, A. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889725 · Cited by 2
Performance-Weighted Ensemble Learning for Speech Classification
Atmaja, B. T., Sasou, A., & Burkhardt, F. (2025) · International Conference on Artificial Intelligence in Information and Communication (ICAIIC) · doi:10.1109/icaiic64266.2025.10920862 · Cited by 2
Multidisciplinary characterization of embarrassment through behavioral and acoustic modeling
Šipka, D., Vlasenko, B., Stein, M., Dierks, T., Magimai.-Doss, M., & Morishima, Y. (2025) · Scientific Reports · doi:10.1038/s41598-025-94051-9 · Cited by 2
PAT: Parameter-Free Audio-Text Aligner to Boost Zero-Shot Audio Classification
Seth, A., Selvakumar, R. K., Kumar, S., Ghosh, S., & Manocha, D. (2025) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2025.naacl-long.616 · Cited by 3
Ogg, M., & Kitchell, L. M. (2026) · eNeuro · doi:10.1523/eneuro.0370-25.2026 · Cited by 2
Is Smaller Always Faster? Tradeoffs in Compressing Self-Supervised Speech Transformers
Lin, T.-Q., Yang, T.-H., Chang, C.-Y., Chen, K.-M., Feng, T.-H., Lee, H.-Y., & Tang, H. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11434686 · Cited by 10
Self-citationSpeakerbox: Few-Shot Learning for Speaker Identification with Transformers
Brown, E. M., Huynh, T., & Weber, N. (2023) · The Journal of Open Source Software · doi:10.21105/joss.05132 · Cited by 2
Phone and Speaker Spatial Organization in Self-Supervised Speech Representations
Riera, P., Cerdeiro, M., Pepino, L., & Ferrer, L. (2023) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw59220.2023.10193460 · Cited by 2
UniX-Encoder: A Universal X-Channel Speech Encoder for AD-HOC Microphone Array Speech Processing
Huang, Z., Shao, Y., Zhang, S., & Yu, D. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448072 · Cited by 2
Self-citationAn Adapter-Based Unified Model for Multiple Spoken Language Processing Tasks
Suresh, V., Aït-Mokhtar, S., Brun, C., & Calapodescu, I. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448240 · Cited by 3
Explaining Speech Classification Models via Word-Level Audio Segments and Paralinguistic Features
Pastor, E., Koudounas, A., Attanasio, G., Hovy, D., & Baralis, E. (2024) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2024.eacl-long.136 · Cited by 14
Once-for-All Sequence Compression for Self-Supervised Speech Models
Chen, H.-J., Meng, Y., & Lee, H.-Y. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095025 · Cited by 8
Self-citationEditorial Editorial of Special Issue on Self-Supervised Learning for Speech and Audio Processing
Lee, H.-Y., Watanabe, S., Livescu, K., Mohamed, A., & Sainath, T. N. (2022) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3205434 · Cited by 2
Self-citationCL-MASR: A Continual Learning Benchmark for Multilingual ASRPreprint
Libera, L. D., Mousavi, P., Zaiem, S., Subakan, C., & Ravanelli, M. (2023) · doi:10.36227/techrxiv.24430876.v1 · Cited by 4
Spectral Salt-and-Pepper Patch Masking for Self-Supervised Speech Representation Learning
Kim, J.-W., Chung, H., & Jung, H. (2023) · Mathematics · doi:10.3390/math11153418 · Cited by 1
Niwa, S., Shiota, S., & Kiya, H. (2023) · European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco58844.2023.10289898 · Cited by 1
Complex Feature Information Enhanced Speech Emotion Recognition
Yue, P., Zheng, S., & Li, T. (2023) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc58517.2023.10317348 · Cited by 1
Improving End-to-End Automatic Speech Recognition with Multi-Layer-Enriched Supervised Learning
Zhao, J., Li, R., & An, W. (2023) · IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC) · doi:10.1109/icspcc59353.2023.10400369 · Cited by 1
Efficiency-oriented approaches for self-supervised speech representation learning
Lugo, L., & Vielzeuf, V. (2023) · International Journal of Speech Technology · doi:10.1007/s10772-024-10121-9 · Cited by 2
EmoTalker: Audio Driven Emotion Aware Talking Head Generation
Shen, X., Khan, F. F., & Elhoseiny, M. (2024) · Lecture notes in computer science · doi:10.1007/978-981-96-0917-8_8 · Cited by 6
Efficient Audio Deepfake Detection using WavLM with Early Exiting
Pimentel, A., Zhu, Y. M., Guimarães, H. R., & Falk, T. H. (2024) · IEEE International Workshop on Information Forensics and Security · doi:10.1109/wifs61860.2024.10810699 · Cited by 5
Leveraging Self-Supervised Models for Automatic Whispered Speech Recognition
Farhadipour, A., Asadi, H., & Dellwo, V. (2024) · International Conference on Computer and Knowledge Engineering · doi:10.1109/iccke65377.2024.10874445 · Cited by 4
TS-SUPERB: A Target Speech Processing Benchmark for Speech Self-Supervised Learning Models
Peng, J., Ashihara, T., Delcroix, M., Ochiai, T., Plchot, O., Araki, S., & Černocký, J. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10887574 · Cited by 1
How Redundant Is the Transformer Stack in Speech Representation Models?
Dorszewski, T., Jacobsen, A. K., Tětková, L., & Hansen, L. K. (2024) · IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp49660.2025.10887866 · Cited by 6
Effective Techniques for Scaling Audio Encoder Pretraining
Kim, B., Bydlon, A., Tang, Q., Phan, H., Kao, C.-C., Zhang, T., & Wang, C. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890012 · Cited by 1
NEST: Self-supervised Fast Conformer as All-purpose Seasoning to Speech Processing Tasks
Huang, H., Park, T., Dhawan, K., Medennikov, I., Puvvada, K. C., Koluguri, N. R., Wang, W., Balam, J., & Ginsburg, B. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888249 · Cited by 11
DQ-Data2vec: Decoupling Quantization for Multilingual Speech Recognition
Shao, Q., Dong, L., Wei, K., Sun, S., & Xie, L. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3551074 · Cited by 1
Zhou, H., Cao, B., Mo, C., Li, L., & Wang, S. X. (2025) · IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) · doi:10.1109/waspaa66052.2025.11230944 · Cited by 1
Noro: Noise-Robust One-Shot Voice Conversion with Hidden Speaker Representation Learning
He, H., Song, Y., Wang, Y., Li, H., Zhang, X., Wang, L., Huang, G., Chng, E. S., & Wu, Z. (2025) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc65261.2025.11249193 · Cited by 2
Phukan, O. C., Akhtar, M. M., Girish, Behera, S. R., Bhagath, P., Reddy, P. B., & Buduru, A. B. (2025) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc65261.2025.11249312 · Cited by 5
Memory-Efficient Training for Deep Speaker Embedding Learning in Speaker Verification
Liu, B., & Qian, Y. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3639717 · Cited by 2
Cross-Attention Reprogramming for ASR: Bridging Discrete Speech Units and Pretrained Language Models
Liao, P.-J., Lee, H.-Y., & Wang, H. L. (2025) · IEEE Access · doi:10.1109/access.2025.3649090 · Cited by 1
Self-citationDFWe: Efficient knowledge distillation of fine-tuned Whisper encoder for speech emotion recognition
Ma, Y., Jiang, X., Sang, J., & Li, R. (2026) · Pattern Recognition · doi:10.1016/j.patcog.2026.113161 · Cited by 1
Kuang, J., Li, M., Jin, G., Wang, Z., & Xiao, Y. (2025) · International Conference on Machine Learning, Computational Intelligence and Pattern Recognition (MLCIPR) · doi:10.1109/mlcipr68329.2025.11407293 · Cited by 1
Revealing the Truth with ConLLM for Detecting Multi-Modal Deepfakes
Kashyap, G. S., Joshi, H., Jain, N., Shabbir, E., Gao, J., Joshi, N., & Naseem, U. (2026) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2026.findings-eacl.102 · Cited by 4
Chen, S.-J., & Hansen, J. H. L. (2026) · Speech Communication · doi:10.1016/j.specom.2026.103380 · Cited by 1
Codec2Vec: Self-Supervised Speech Representation Learning Using Neural Speech Codecs
Tseng, W.-C., & Harwath, D. F. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11434617 · Cited by 1
Self-citationSEF-MK: Speaker-Embedding-Free Voice Anonymization through Multi-k-means Quantization
Tang, B., Miao, X., Wang, X., & Li, M. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11434785 · Cited by 4
Emphasis Sensitivity in Speech Representations
Cassini, S. R., Hain, T., & Ragni, A. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11434710 · Cited by 2
CAMÕES: A Comprehensive Automatic Speech Recognition Benchmark for European Portuguese
Carvalho, C., Teixeira, F., Botelho, C., Pompili, A., Solera-Ureña, R., Paulo, S., Julião, M., Rolland, T., Mendonça, J., Pereira, D. A., et al. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11434700 · Cited by 7
Charting 15 Years of Progress in Deep Learning for Speech Emotion Recognition: A Replication Study
Triantafyllopoulos, A., Batliner, A. M., & Schuller, B. W. (2026) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2026.3680663 · Cited by 4
Textless and Non-Parallel Speech-to-Speech Emotion Style Transfer
Dutta, S., Jain, A., & Ganapathy, S. (2026) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2026.3684421 · Cited by 4
Räsänen, O. J. (2026) · Advances in child development and behavior · doi:10.1016/bs.acdb.2026.03.001 · Cited by 2
Frontend Token Enhancement for Token-Based Speech Recognition
Ashihara, T., Horiguchi, S., Matsuura, K., Ochiai, T., & Delcroix, M. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11462694 · Cited by 1
Multi-Layer Attentive Probing Improves Transfer of Audio Representations for Bioacoustics
Miron, M., Robinson, D., Hagiwara, M., Parcollet, T., Cauzinille, J., Narula, G., Alizadeh, M., Gilsenan-McMahon, E., Keen, S. C., Chemla, E., et al. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11464333 · Cited by 2
Enhancing Speaker Verification with Layer-Wise Mixture-of-Experts on Pre-Trained Models
Li, Y., Yu, Y., 涂永峰, Deng, S., & Gan, W. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11464967 · Cited by 1
Tyagi, S., & Szénási, S. (2026) · Algorithms · doi:10.3390/a19050416 · Cited by 1
Cui, Y., Zhang, X., Li, J., & Song, Z. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2671420 · Cited by 1
MoE Adapter for Large Audio Language Models: Sparsity, Disentanglement, and Gradient-Conflict-Free
Lei, Y., He, S., Jing, H., Zhang, D., Luo, X., Zhu, D., Feng, S., Liu, R., Jingzhou, H. E., Sun, Y., et al. (2026) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2026.findings-acl.840 · Cited by 1
Awan, W. N., Paasivaara, M., & Gloor, P. A. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3786580.3786987 · Cited by 1
A survey of parameter-efficient fine-tuning techniques for audio foundation models
Yadla, P. (2026) · International Journal of Speech Technology · doi:10.1007/s10772-025-10245-6 · Cited by 1
Chen, J., Gao, X., Tatsuya, K., & Chen, N. F. (2026) · IEEE Signal Processing Letters · doi:10.1109/lsp.2026.3717524 · Cited by 1
Kadyrbek, N., & Мансурова, М. (2026) · Big Data and Cognitive Computing · doi:10.3390/bdcc10080251 · Cited by 1
Fong, J., Lyth, D., Henter, G. E., Tang, H., & King, S. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10138 · Cited by 1
Frost, G., Morris, E., van Vüren, J. M. J., & Niesler, T. (2022) · Communications in computer and information science · doi:10.1007/978-3-031-22321-1_17 · Cited by 1
ASBERT: ASR-Specific Self-Supervised Learning with Self-Training
Kim, H. Y., Kim, B.-Y., Yoo, S. W., Lim, Y., Lim, Y., & Lee, H. (2023) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt54892.2023.10023214 · Cited by 1
Self-citationZhu, Z., & Sato, Y. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096578 · Cited by 1
Spectral Clustering-Aware Learning of Embeddings for Speaker Diarisation
Lee, E. P. C., Sun, G., Zhang, C., & Woodland, P. C. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096993 · Cited by 1
Environment-Aware Knowledge Distillation for Improved Resource-Constrained Edge Speech Recognition
Pimentel, A., Guimarães, H. R., Avila, A. R., & Falk, T. H. (2023) · Applied Sciences · doi:10.3390/app132312571 · Cited by 3
XLS-R fine-tuning on noisy word boundaries for unsupervised speech segmentation into words
Algayres, R., Diego-Simón, P., Sagot, B., & Dupoux, E. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.810 · Cited by 4
Denisov, P., & Vu, N. T. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389655 · Cited by 3
Anand, N., Sirigiraju, M., & Yarra, C. (2023) · IEEE India Conference · doi:10.1109/indicon59947.2023.10440736 · Cited by 1
Seth, A., Ghosh, S., Umesh, S., & Manocha, D. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446335 · Cited by 1
Leveraging Confidence Models for Identifying Challenging Data Subgroups in Speech Models
Koudounas, A., Pastor, E., Mazzia, V., Giollo, M., Gueudré, T., Reale, E., Attanasio, G., Cagliero, L., Cumani, S., de Alfaro, L., et al. (2024) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw62465.2024.10626001 · Cited by 4
SOA: Reducing Domain Mismatch in SSL Pipeline by Speech Only Adaptation for Low Resource ASR
Shankar, N. B., Fan, R., & Alwan, A. A. (2024) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw62465.2024.10625884 · Cited by 1
SVQ-MAE: an efficient speech pre-training framework with constrained computational resources
Zhuang, X., Qian, Y., & Wang, M. (2024) · EURASIP Journal on Audio Speech and Music Processing · doi:10.1186/s13636-024-00375-1 · Cited by 1
Ensemble Knowledge Distillation from Speech SSL Models Considering Inter-Teacher Differences
Liao, P.-J., Lee, H.-Y., & Wang, H. (2024) · International Symposium on Chinese Spoken Language Processing (ISCSLP) · doi:10.1109/iscslp63861.2024.10800400 · Cited by 2
Self-citationESPnet-EZ: Python-Only ESPnet For Easy Fine-Tuning And Integration
Someki, M., Choi, K., Arora, S., Chen, W., Cornell, S., Han, J., Peng, Y., Shi, J., Srivastav, V., & Watanabe, S. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832148 · Cited by 3
Self-citationExploring Self-Supervised Representations for Text-Dependent Speaker Verification
Sreekanth, S. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832312 · Cited by 1
Multi-Label Emotion Share Regression from Speech Using Pre-Trained Self-Supervised Learning Models
Atmaja, B. T., & Sasou, A. (2024) · IEEE Region 10 Conference (TENCON) · doi:10.1109/tencon61640.2024.10903112 · Cited by 1
Noise-Aware Self-Supervised Variational Autoencoder for Speech Enhancement
Dixit, A., Nataraj, K. S., & Tiwari, N. (2025) · Circuits Systems and Signal Processing · doi:10.1007/s00034-025-03036-6 · Cited by 2
Multiview Canonical Correlation Analysis for Automatic Pathological Speech Detection
Kaloga, Y., Sheikh, S. A., & Kodrasi, I. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888902 · Cited by 2
Noise-Agnostic Multitask Whisper Training for Reducing False Alarm Errors in Call-for-Help Detection
Ryu, M., Kim, J.-W., Oh, M., Lee, S., & Park, H. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890654 · Cited by 5
Reszka, J., Janbakhshi, P., Purohit, T., & Mohammadi, S. (2025) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw65056.2025.11011023 · Cited by 1
VocalTrust: Preventing Impostors to Enhance Trustworthiness of Voice Authentication
Li, K., Baird, C., & Lin, D. (2025) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac65507.2025.00139 · Cited by 1
Big Model only for Hard Audios: Sample Dependent Whisper Model Selection for Efficient Inferences
Malard, H., Zaiem, S., & Algayres, R. (2025) · European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco63237.2025.11226271 · Cited by 3
Exploring the Impact of Data Quantity on Asr in Extremely Low-Resource Languages
Cheng, Y.-F., Chen, L.-W., Lee, H.-S., & Wang, H. L. (2025) · International Conference on Speech Database and Assessments · doi:10.1109/o-cocosda68185.2025.11385096 · Cited by 2
Self-citationLayer-Aware TDNN: Speaker Recognition Using Multi-Layer Features from Pre-Trained Models
Kim, J. S., Park, H. J., Shin, W., Yun, J., & Han, S. W. (2026) · International Conference on Artificial Intelligence in Information and Communication (ICAIIC) · doi:10.1109/icaiic68212.2026.11454394 · Cited by 3
HighRateMOS: Sampling-Rate Aware Modeling for Speech Quality Assessment
Ren, W., Lin, Y., Huang, W.-C., Zezario, R. E., Fu, S., Huang, S.-F., Cooper, E., Wu, H., Wei, H., Wang, H., et al. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11434689 · Cited by 4
Self-citationEvaluating Novel Speech Transcription Architectures on the Spanish RTVE2020 Database
Álvarez, A., Arzelus, H., Torre, I. G., & González-Docasal, A. (2022) · Applied Sciences · doi:10.3390/app12041889 · Cited by 2
Adversarial Input Ablation for Audio-Visual Learning
Xu, D., & Harwath, D. F. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746436 · Cited by 1
LeBenchmark, un référentiel d'évaluation pour le français oral
Le, H., Alisamir, S., Dinarelli, M., Ringeval, F., Evain, S. V., Nguyen, H., Boito, M. Z., Mdhaffar, S., Tong, Z., Tomashenko, N., et al. (2022) · Journées d'Études sur la Parole (JEP) · doi:10.21437/jep.2022-5 · Cited by 5
Lux, F., Chen, C., & Vu, N. T. (2023) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt54892.2023.10022897 · Cited by 2
Masked Token Similarity Transfer for Compressing Transformer-Based ASR Models
Choi, E., Lim, Y., Kim, B.-Y., Kim, H. Y., Lee, H., Lim, Y., Yu, S. W., & Yoo, S. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096531 · Cited by 2
Self-citationSLICER: Learning Universal Audio Representations Using Low-Resource Self-Supervised Pre-Training
Seth, A., Ghosh, S., Umesh, S., & Manocha, D. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096970 · Cited by 4
Bootstrapping meaning through listening: Unsupervised learning of spoken sentence embeddings
Zhu, J., Tian, Z., Liu, Y., Zhang, C., & Lo, C.-W. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.81 · Cited by 1
Learnable Sparsity Structured Pruning for Acoustic Pre-trained Models
Wang, S., Wang, H., Li, J., & Zhang, W.-Q. (2023) · doi:10.1145/3614008.3614020 · Cited by 2
Reprogramming Self-supervised Learning-based Speech Representations for Speaker Anonymization
Chen, X., Li, S., Li, J., Huang, H., Cao, Y., & He, L. J. (2023) · ACM International Conference on Multimedia in Asia (MMAsia) · doi:10.1145/3595916.3626366 · Cited by 1
Self-citationTowards Matching Phones and Speech Representations
Yang, G.-P., & Tang, H. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389757 · Cited by 1
MASR: Multi-Label Aware Speech Representation
Raj, A., Bharadwaj, S., Ganapathy, S., Ma, M., & Vashishth, S. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389783 · Cited by 1
Towards a Unified End-to-End Language Understanding System for Speech and Text Inputs
Li, M., Zorilă, C., Do, C.-T., & Doddipatla, R. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389768 · Cited by 1
Guimarães, H. R., Zhu, Y. M., Mengara, O., Avila, A. R., & Falk, T. H. (2023) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc53992.2023.10394252 · Cited by 2
Are Soft Prompts Good Zero-Shot Learners for Speech Recognition?
Ng, D., Zhang, C., Zhang, R., Ma, Y., Ritter-Gutierrez, F., Nguyen, T. H., Ni, C., Zhao, S., Chng, E. S., & Ma, B. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447746 · Cited by 1
On the Disentanglement and Robustness of Self-Supervised Speech Representations
Song, Y., Kim, D., Madhu, N., & Kang, H.-G. (2024) · International Conference on Electronics, Information, and Communication (ICEIC) · doi:10.1109/iceic61013.2024.10457271 · Cited by 4
Metadata
- Authors
- Yang, S.-W., Chi, P.-H., Chuang, Y.-S., Lai, C.-I. J., Lakhotia, K., Lin, Y. Y., Liu, A. T., Shi, J., Chang, X., Lin, G.-T., Huang, T.-H., Tseng, W.-C., Lee, K.-T., Liu, D.-R., Huang, Z., Dong, S., Li, S.-W., Watanabe, S., Mohamed, A., & Lee, H.-Y.
- Affiliations
- National Taiwan University (TW)
- Meta (United States) (US)
- Johns Hopkins University (US)
- Carnegie Mellon University (US)
- Amazon (United States) (US)
- ORCID
- Venue
- Interspeech 2021
- Publisher
- ISCA
- Published
- 2021-08-30
- Pages
- 1194-1198
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W3197580070
- Cited by
- 681
- References
- 40
- Citations by year
- 2026: 67 · 2025: 138 · 2024: 157 · 2023: 205 · 2022: 108 · 2021: 6
- FWCI
- 54.87
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Interspeech (USB) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- self-supervised learning, speech processing, benchmark, shared models, representation learning, frozen pre-trained models, task generalization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.