SUPERB: Speech Processing Universal PERformance Benchmark
The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
Self-supervised learning (SSL) has proven vital for advancing research in natural language processing (NLP) and computer vision (CV).The paradigm pretrains a shared model on large volumes of unlabeled data and achieves state-of-the-art (SOTA) for various tasks with minimal adaptation.However, the speech processing community lacks a similar setup to systematically explore the paradigm.To bridge this gap, we introduce Speech processing Universal PERformance Benchmark (SUPERB).SUPERB is a leaderboard to benchmark the performance of a shared model across a wide range of speech processing tasks with minimal architecture changes and labeled data.Among multiple usages of the shared model, we especially focus on extracting the representation learned from SSL for its preferable re-usability.We present a simple framework to solve SUPERB tasks by learning task-specialized lightweight prediction heads on top of the frozen shared model.Our results demonstrate that the framework is promising as SSL representations show competitive generalizability and accessibility across SUPERB tasks.We release SUPERB as a challenge with a leaderboard 1 and a benchmark toolkit 2 to fuel the research in representation learning and general speech processing.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“According to [14], the authors have also indicated that by weighting the representations of different layers, self-supervised model has shown great potential in various speech downstream tasks.”
From Audio Deepfake Detection With Self-Supervised WavLM And Multi-Fusion Attentive Classifier (2024) · cites this paper as [14]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Self-citationBERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Self-citationDeep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
Self-citationRepresentation Learning with Contrastive Predictive Coding
Oord, A. V. D., Li, Y., & Vinyals, O. (2018) · arXiv · doi:10.48550/arxiv.1807.03748 · Cited by 6,242
“Librispeech: an ASR corpus based on public domain audio books,”
Panayotov, V., Chen, G., Povey, D., & Khudanpur, S. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178964 · Cited by 6,072
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
Wang, A., Singh, A., Michael, J., Hill, F., Levy, O., & Bowman, S. (2018) · Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP · doi:10.18653/v1/w18-5446 · Cited by 4,222
IEMOCAP: Interactive emotional dyadic motion capture database
Busso, C., Bulut, M., Lee, C.-C., Kazemzadeh, A., Mower, E., Kim, S., Chang, J. N., Lee, S., & Narayanan, S. S. (2008) · Language Resources and Evaluation · doi:10.1007/s10579-008-9076-6 · Cited by 3,869
HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units
Hsu, W.-N., Bolte, B., Tsai, Y.-H. H., Lakhotia, K., Salakhutdinov, R., & Mohamed, A. (2021) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2021.3122291 · Cited by 2,983
Self-citationDeep Clustering for Unsupervised Learning of Visual Features
Caron, M., Bojanowski, P., Joulin, A., & Douze, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_9 · Cited by 2,674
X-Vectors: Robust DNN Embeddings for Speaker Recognition
Snyder, D., Garcia-Romero, D., Sell, G., Povey, D., & Khudanpur, S. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8461375 · Cited by 2,620
Research works printed but not linked: 2
- [13][13] A. Baevski, S. Schneider, and M. Auli, 'vq-wav2vec: Selfsupervised learning of discrete speech representations,' in ICLR , 2020. -
- [25][25] X. Anguera, L. Rodriguez-Fuentes, A. Buzo, F. Metze, I. Sz¨ oke, and M. Penagarikano, 'Quesst2014: Evaluating query-byexample speech search in a zero-resource setting with real-life queries,' in ICASSP , 2015, pp. 5833-5837. -
Cited by
Items 401–500 of 756
Yet Another Model for Arabic Dialect Identification
Kulkarni, A., & Aldarmaki, H. (2023) · Arabic Natural Language Processing Conference (ArabicNLP) · doi:10.18653/v1/2023.arabicnlp-1.37 · Cited by 9
Adapting Large-Scale Pre-trained Models for Unified Dialect Speech Recognition Model
Toyama, T., Kai, A., Kamiya, Y., & TAKAHASHI, N. (2024) · Acta Physica Polonica A · doi:10.12693/aphyspola.146.413 · Cited by 3
Grouped Knowledge Distillation with Adaptive Logit Softening for Speaker Recognition
Gan, C.-X., Tu, Y., Jin, Z., Mak, M., & Lee, K. A. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10887814 · Cited by 3
Self-citationHyeon, J., Oh, Y., Lee, Y., & Choi, H. (2025) · IEEE International Conference on Big Data and Smart Computing (BigComp) · doi:10.1109/bigcomp64353.2025.00047 · Cited by 4
Unifying Diarization, Separation, and ASR with Multi-Speaker Encoder
Shakeel, M., Sudo, Y., Peng, Y., Lin, C.-J., & Watanabe, S. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11434654 · Cited by 7
Self-citationBenchmarking Self-Supervised Audio Representations for IoT-Enabled Acoustic Beehive Monitoring
Guimarães, H. R., Abdollahi, M., Zhu, Y. M., Maucourt, S., Coallier, N., Giovenazzo, P., & Falk, T. H. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3599483 · Cited by 8
MixPQ: Joint Pruning and Quantization for Speech and Language Foundation Models Compression
Liu, B., Gu, T., Wang, H., & Qian, Y. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3613948 · Cited by 3
Kim, J.-W., Yoon, H., Kim, B., Lee, S.-Y., 김대진, Moon, S.-E., Choi, Y., & Yang, C.-M. (2026) · Communications Medicine · doi:10.1038/s43856-025-01326-3 · Cited by 5
AudioJudge: Understanding What Works in Large Audio Model Based Speech Evaluation
Manakul, P., Gan, W. H., Ryan, M. J., Khan, A. S., Sirichotedumrong, W., Pipatanakul, K., Held, W. A., & Yang, D. (2026) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2026.eacl-long.168 · Cited by 32
Ali, H., Subramani, S., Adupa, N. S., Bollinani, L., El-Loh, S., & Malik, H. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11434712 · Cited by 7
When to Use Efficient Self Attention? Profiling Text, Speech and Image Transformer Variants
Diwan, A., Choi, E., & Harwath, D. F. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-short.141 · Cited by 4
PhISANet: Phonetically Informed Speech Animation Network
Medina, S., Taylor, S. L., Stoll, C., Edwards, G., Hauptmann, A. G., Watanabe, S., & Matthews, I. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448411 · Cited by 3
Self-citationInvestigating Self-Supervised Deep Representations for EEG-Based Auditory Attention Decoding
Thakkar, K., Hai, J., & Elhilali, M. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448271 · Cited by 3
Yolwas, N., Sun, L., Li, X., Liu, Q., & Wang, Z. (2024) · Journal of Shanghai Jiaotong University (Science) · doi:10.1007/s12204-024-2738-8 · Cited by 3
Wang, H.-F., Shih, Y.-J., Chang, H.-J., Berry, L., Peng, P., Lee, H.-Y., Wang, H., & Harwath, D. F. (2024) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw62465.2024.10625827 · Cited by 3
Self-citationWavRx: A Disease-Agnostic, Generalizable, and Privacy-Preserving Speech Health Diagnostic Model
Zhu, Y. M., & Falk, T. H. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3454550 · Cited by 7
SEMPI: A Database for Understanding Social Engagement in Video-Mediated Multiparty Interaction
Siniukov, M., Yin, Y., Fast, E., Qi, Y., Monga, A., Kim, A., & Soleymani, M. (2024) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3678957.3685752 · Cited by 5
Property Neurons in Self-Supervised Speech Transformers
Lin, T.-Q., Lin, G.-T., Lee, H.-Y., & Tang, H. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832151 · Cited by 9
Self-citationVisinger2+: End-to-End Singing Voice Synthesis Augmented by Self-Supervised Learning Representation
Yu, Y., Shi, J., Wu, Y., Tang, Y., & Watanabe, S. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832313 · Cited by 12
Self-citationSelf-supervised Learning for Acoustic Few-Shot Classification
Liang, J., Meyer, B., Lee, I. N., & Do, T.-T. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890060 · Cited by 8
Fan, X., Gao, H., Chen, Z., Chang, P., Han, M., & Hasegawa‐Johnson, M. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00447 · Cited by 4
Progressive Residual Extraction Based Pre-Training for Speech Representation Learning
Wang, T., Li, J., Ma, Z., Cao, R., Chen, X., Wang, L., Ge, M., Wang, X., Wang, Y. G., Dang, J., et al. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3564118 · Cited by 3
Identifying Speaker Information in Feed-Forward Layers of Self-Supervised Speech Transformers
Lin, T.-Q., Cheng, H.-C., Lee, H.-Y., & Tang, H. (2025) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc65261.2025.11249191 · Cited by 5
Self-citationYadav, H. N., Sitaram, S., & Shah, R. R. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096167 · Cited by 3
Measuring the Impact of Domain Factors in Self-Supervised Pre-Training
Sanabria, R., Hsu, W.-N., Baevski, A., & Auli, M. (2023) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw59220.2023.10193184 · Cited by 10
Poncelet, J., & hamme, H. V. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446344 · Cited by 4
CLAP4Emo: ChatGPT-Assisted Speech Emotion Retrieval with Natural Language Supervision
Lin, W.-C., Ghaffarzadegan, S., Bondi, L., Kumar, A., Das, S., & Wu, H.-H. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447102 · Cited by 10
MOS-FAD: Improving Fake Audio Detection Via Automatic Mean Opinion Score Prediction
Zhou, W., Yang, Z., Chu, C., Li, S., Dabre, R., Zhao, Y., & Kawahara, T. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446041 · Cited by 12
Self-citationDistilling Hubert with LSTMs via Decoupled Knowledge Distillation
de Oliveira, D., & Gerkmann, T. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446456 · Cited by 4
On The Choice of the Optimal Temporal Support for Audio Classification with Pre-Trained Embeddings
Quélennec, A., Olvera, M., Peeters, G. G., & Essid, S. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447963 · Cited by 6
EMOVA: Emotion-driven neural volumetric avatar
Hwang, J., Kim, B.-G., Kim, T., Oh, H., & Kang, J. (2024) · Image and Vision Computing · doi:10.1016/j.imavis.2024.105043 · Cited by 3
Speech-Forensics: Towards Comprehensive Synthetic Speech Dataset Establishment and Analysis
Ji, Z., Lin, C., Wang, H., & Shen, C. (2024) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2024/46 · Cited by 11
Zero-Shot Multi-Task Cough Sound Analysis with Speech Foundation Model Embeddings
Laska, B., Xi, P., Valdés, J. J., Wallace, B., & Goubran, R. A. (2024) · IEEE International Symposium on Medical Measurements and Applications (MeMeA) · doi:10.1109/memea60663.2024.10596816 · Cited by 3
Investigation of Speaker Representation for Target-Speaker Speech Processing
Ashihara, T., Moriya, T., Horiguchi, S., Peng, J., Ochiai, T., Delcroix, M., Matsuura, K., & Satō, H. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832160 · Cited by 3
BAHBench: A Unified Benchmark for Evaluating Bio-Acoustic Health With Acoustic Foundation Models
Xu, W., Dong, Z., Peng, J., Wang, R., & Zhang, Z. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2025.3543968 · Cited by 7
Optimization of modular multi-speaker distant conversational speech recognition
Hu, Q., Sun, T., Chen, X., Rong, X., & Lu, J. Z. (2025) · Computer Speech & Language · doi:10.1016/j.csl.2025.101816 · Cited by 3
Discrete Speech Unit Extraction via Independent Component Analysis
Nakamura, T., Choi, K., Hojo, K., Bando, Y., Fukayama, S., & Watanabe, S. (2025) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw65056.2025.11011236 · Cited by 8
Self-citationCharacterizing the Adversarial Vulnerability of Speech self-Supervised Learning
Wu, H., Zheng, B., Li, X., Wu, X., Lee, H.-Y., & Meng, H. M. L. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747242 · Cited by 4
Self-citationExploring Speaker Age Estimation on Different Self-Supervised Learning Models
Truong, D.-T., Anh, T. T., & Siong, C. E. (2022) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.23919/apsipaasc55919.2022.9979878 · Cited by 3
UFO2: A Unified Pre-Training Framework for Online and Offline Speech Recognition
Fu, L., Li, S., Li, Q., Deng, L., Li, F., Fan, L., Chen, M., & He, X. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096387 · Cited by 5
Self-citationMaekaku, T., Fujita, Y., Chang, X., & Watanabe, S. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095280 · Cited by 3
Self-citationJohnson, A., Shetty, V. M., Mari Ostendorf, E., & Alwan, A. A. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096614 · Cited by 3
End-to-end speech recognition with reinforcement learning
陈, 紫., & 张, 文. (2023) · International Conference on Electronic Technology and Information Science (ICETIS) · doi:10.1117/12.2682509 · Cited by 3
Yang, H., Zhao, J., Haffari, G., & Shareghi, E. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.141 · Cited by 3
Multilingual Models with Language Embeddings for Low-resource Speech Recognition
Lam-Yee-Mui, L.-M., Kheder, W. B., Le, V.-B., Barras, C., & Gauvain, J. (2023) · doi:10.21437/sigul.2023-18 · Cited by 4
Automatic classification of emotions in speech: methods and data
Lemaev, V. I., & Lukashevich, N. V. (2024) · Litera · doi:10.25136/2409-8698.2024.4.70472 · Cited by 3
Language-agnostic Age and Gender Classification of Voice using Self-supervised Pre-training
Lastow, F., Ekberg, E., & Nugues, P. (2022) · Swedish Artificial Intelligence Society Workshop (SAIS) · doi:10.1109/sais55783.2022.9833071 · Cited by 7
ON-TRAC Consortium Systems for the IWSLT 2023 Dialectal and Low-resource Speech Translation Tasks
Laurent, A., Gahbiche, S., Nguyen, H., Elleuch, H., Bougares, F., Thiol, A., Riguidel, H., Mdhaffar, S., Laperrière, G., Maison, L., et al. (2023) · International Conference on Spoken Language Translation (IWSLT) · doi:10.18653/v1/2023.iwslt-1.18 · Cited by 3
Singing Beat Tracking With Self-supervised Front-end and Linear TransformersPreprint
Heydari, M., & Duan, Z. (2022) · doi:10.36227/techrxiv.20743012.v1 · Cited by 3
Scaling-up Behavioral Observation with Computational Behavior RecognitionPreprint
Lønfeldt, N. N., Das, S., Frumosu, F. D., Mora‐Jensen, A. C., Pagsberg, A. K., & Clemmensen, L. K. H. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/m4p6f · Cited by 4
Ni, J. (2023) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/168430 · Cited by 4
Exploring Effective Distillation of Self-Supervised Speech Models for Automatic Speech Recognition
Wang, Y., Tang, C., Ma, Z., Zheng, Z., Chen, X., & Zhang, W.-Q. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389746 · Cited by 3
A Comprehensive Exploration of Fine-Tuning WavLM for Enhancing Speech Emotion Recognition
Ali, F. M., Arymurthy, A. M., & Prasojo, R. E. (2023) · International Seminar on Research of Information Technology and Intelligent Systems (ISRITI) · doi:10.1109/isriti60336.2023.10467733 · Cited by 4
Coarse-to-fine Alignment Makes Better Speech-image Retrieval
Zhou, L., & Li, Y. (2024) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme57554.2024.10687580 · Cited by 2
Chinese Speech Emotion Recognition Based on Pre-Trained Model
Xu, S., Jiang, N., Lian, S., & Pan, J. (2024) · International Conference on Big Data & Artificial Intelligence & Software Engineering (ICBASE) · doi:10.1109/icbase63199.2024.10762569 · Cited by 2
EH-MAM: Easy-to-Hard Masked Acoustic Modeling for Self-Supervised Speech Representation Learning
Seth, A., Selvakumar, R. K., Sakshi, S., Kumar, S., Ghosh, S., & Manocha, D. (2024) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2024.emnlp-main.366 · Cited by 6
An Analysis of Linear Complexity Attention Substitutes With Best-RQ
Whetten, R., Parcollet, T., Moumen, A., Dinarelli, M., & Estève, Y. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832323 · Cited by 3
Should Audio Front-Ends be Adaptive? Comparing Learnable and Adaptive Front-Ends
Zhang, Q., Wickramasinghe, B., Ambikairajah, E., Sethu, V., & Li, H. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3542281 · Cited by 5
Information disentanglement-based self-supervised learning speech pretrained large model
Wang, L., Jiang, Y., Wang, T., Wang, X., & Jianwu, 党. D. (2025) · Journal of Image and Graphics · doi:10.11834/jig.240607 · Cited by 2
StableQuant: Layer Adaptive Post-Training Quantization for Speech Foundation Models
Hong, Y., Han, H.-W., Chung, W.-J., & Kang, H.-G. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888735 · Cited by 3
Phukan, O. C., Akhtar, M. M., Girish, Behera, S. R., Kalita, S., Buduru, A. B., Sharma, R., & Prasanna, S. R. M. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889257 · Cited by 2
MT2KD: Toward a General-Purpose Encoder for Speech, Speaker, and Audio Events
Yang, X., Li, Q., Zhang, C., & Woodland, P. C. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3594300 · Cited by 4
Shah, S. B., & Johnson, K. T. (2025) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2025.emnlp-main.1693 · Cited by 4
Position Paper: Towards a Unified Representation Evaluation Framework Beyond Downstream Tasks
Plachouras, C., Guinot, J., Fazekas, G., Quinton, E., Benetos, E., & Pauwels, J. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11229333 · Cited by 3
Speech-to-Text Forced Alignment Benchmark
Deng, Y., Richardson, F. S., Steinberg, J., & Torres‐Carrasquillo, P. A. (2025) · International symposium on image and signal processing and analysis/ISPA ... · doi:10.1109/ispa66905.2025.11259471 · Cited by 4
Design and Deployment of a Standard Framework for Audio Neural Networks Embedding Models
Giacomelli, S., Centofanti, C., Graziosi, F., & Rinaldi, C. (2025) · IEEE Symposium on Computers and Communications (ISCC) · doi:10.1109/iscc65549.2025.11326439 · Cited by 2
Speech emotion recognition: A systematic mega-review of techniques and pipelines
Chakhtouna, A., Sekkate, S., & Adib, A. (2026) · Information Fusion · doi:10.1016/j.inffus.2026.104161 · Cited by 6
Selection of Layers from Self-supervised Learning Models for Predicting Mean-Opinion-Score of Speech
Liang, X., Cumlin, F., Ungureanu, V., Reddy, C. K. A., Schüldt, C., & Chatterjee, S. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11433842 · Cited by 8
On the Use of Self-Supervised Representation Learning for Speaker Diarization and Separation
Baroudi, S., Bredin, H., Razik, J., & Marxer, R. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11434629 · Cited by 3
AudioLens: A Closer Look at Auditory Attribute Perception of Large Audio-Language Models
Yang, C.-K., Ho, N., Lee, Y., & Lee, H.-Y. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11434723 · Cited by 28
Self-citationImproving Speech Enhancement with Multi-Metric Supervision from Learned Quality Assessment
Wang, W., Zhang, W., Li, C., Shi, J., Watanabe, S., & Qian, Y. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11434718 · Cited by 5
Self-citationA Superb-Style Benchmark of Self-Supervised Speech Models for Audio Deepfake Detection
Ali, H., Adupa, N. S., Subramani, S., & Malik, H. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11460421 · Cited by 10
Generalized Zero-Shot Audio-to-Intent Classification
Elluru, V. R., Kulshreshtha, D., Paturi, R., Bodapati, S., & Ronanki, S. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389657 · Cited by 2
A Statistical WavLM Embedding Features with Auto-Encoder for Speech Emotion Recognition
Chakhtouna, A., Sekkate, S., & Adib, A. (2024) · Studies in computational intelligence · doi:10.1007/978-3-031-50381-8_19 · Cited by 2
Multimodal Emotion Recognition Harnessing the Complementarity of Speech, Language, and Vision
Thebaud, T., Favaro, A., Guan, Y., Yang, Y., Singh, P., Villalba, J., Moro-Velázquez, L., & Dehak, N. (2024) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3678957.3689332 · Cited by 2
Convexity Based Pruning of Speech Representation Models
Dorszewski, T., Tětková, L., & Hansen, L. K. (2024) · Machine learning for signal processing ... · doi:10.1109/mlsp58920.2024.10734716 · Cited by 4
Si, Y., Li, Y., Tan, J., Chen, G., Li, Q., & Russo, M. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3527147 · Cited by 8
Estimating the Completeness of Discrete Speech Units
Yeh, S.-L., & Tang, H. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832198 · Cited by 11
Efficient Training of Self-Supervised Speech Foundation Models on a Compute Budget
Liu, A. T., Lin, Y., Wu, H., WINKLER, S. S., & Lee, H.-Y. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832361 · Cited by 3
Self-citationChou, H.-C., Wu, H., & Lee, C.-C. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890558 · Cited by 3
Emotion information recovery potential of wav2vec2 network fine-tuned for speech recognition task
Purohit, T., & Magimai.-Doss, M. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890800 · Cited by 2
Coughprint: Distilled Cough Representations From Speech Foundation Model Embeddings
Laska, B., Xi, P., Valdés, J. J., Wallace, B., Green, J. R., Goubran, R. A., & Knoefel, F. D. (2025) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2025.3568985 · Cited by 2
A correlation-permutation approach for speech-music encoders model merging
Ritter-Gutierrez, F., Lin, Y., Wong, J. H. M., Lee, H.-Y., Chng, E. S., & Chen, N. F. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11433848 · Cited by 4
Self-citationVaiani, L., Koudounas, A., Quatra, M. L., Cagliero, L., Garza, P., & Baralis, E. (2022) · doi:10.1145/3551876.3554801 · Cited by 5
Deep Spectro-temporal Artifacts for Detecting Synthesized Speech
Liu, X., Liu, M., Zhang, L., Zhang, L., Zeng, C., Li, K., Li, N., Lee, K. A., Wang, L., & Dang, J. (2022) · doi:10.1145/3552466.3556527 · Cited by 7
Self-citationAtmaja, B. T., Zanjabila, & Sasou, A. (2022) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.23919/apsipaasc55919.2022.9980310 · Cited by 2
Kawamura, K., & Rekimoto, J. (2022) · International Conference on Machine Learning and Applications · doi:10.1109/icmla55696.2022.00051 · Cited by 4
Chen, X., Ma, Z., Tang, C., Wang, Y., & Zheng, Z. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095130 · Cited by 2
Data2vec-Aqc: Search for the Right Teaching Assistant in the Teacher-Student Training Setup
Lodagala, V. S., Ghosh, S., & Umesh, S. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094726 · Cited by 2
Exploration of Language Dependency for Japanese Self-Supervised Speech Representation Models
Ashihara, T., Moriya, T., Matsuura, K., & Tanaka, T. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096318 · Cited by 3
Lam-Yee-Mui, L.-M., Ondel, L., & Klejch, O. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-1802 · Cited by 7
DistilALHuBERT: A Distilled Parameter Sharing Audio Representation Model
Wang, H., Wang, S., Gong, Y., & Zhang, W.-Q. (2023) · doi:10.1145/3614008.3614015 · Cited by 3
Compressing Wav2vec2 for Embedded Applications
Ludwig, O., & Claes, T. (2023) · Machine learning for signal processing ... · doi:10.1109/mlsp55844.2023.10285964 · Cited by 3
Khorrami, K., Blandón, M. A. C., Virtanen, T. I., & Räsänen, O. J. (2023) · European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco58844.2023.10290051 · Cited by 3
Nasersharif, B., & Azad, M. (2023) · doi:10.1109/icee59167.2023.10334799 · Cited by 3
Findings of the 2023 ML-Superb Challenge: Pre-Training And Evaluation Over More Languages And Beyond
Shi, J., Chen, W., Berrebbi, D., Wang, H.-H., Huang, W.-P., Hu, E.-P., Chuang, H.-L., Chang, X., Tang, Y., Li, S.-W. D., et al. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389628 · Cited by 19
Self-citationFastInject: Injecting Unpaired Text Data into CTC-Based ASR Training
Deng, K., & Woodland, P. C. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447838 · Cited by 2
Maekaku, T., Shi, J., Chang, X., Fujita, Y., & Watanabe, S. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448052 · Cited by 2
Self-citationFederated Learning for ASR Based on FedEA
Tuo, J., Shang, K., Ma, X., Cui, M., Liu, Y., & Wang, Y. (2024) · IEEE Advanced Information Technology, Electronic and Automation Control Conference (IAEAC) · doi:10.1109/iaeac59436.2024.10503668 · Cited by 2
Metadata
- Authors
- Yang, S.-W., Chi, P.-H., Chuang, Y.-S., Lai, C.-I. J., Lakhotia, K., Lin, Y. Y., Liu, A. T., Shi, J., Chang, X., Lin, G.-T., Huang, T.-H., Tseng, W.-C., Lee, K.-T., Liu, D.-R., Huang, Z., Dong, S., Li, S.-W., Watanabe, S., Mohamed, A., & Lee, H.-Y.
- Affiliations
- National Taiwan University (TW)
- Meta (United States) (US)
- Johns Hopkins University (US)
- Carnegie Mellon University (US)
- Amazon (United States) (US)
- ORCID
- Venue
- Interspeech 2021
- Publisher
- ISCA
- Published
- 2021-08-30
- Pages
- 1194-1198
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W3197580070
- Cited by
- 681
- References
- 40
- Citations by year
- 2026: 67 · 2025: 138 · 2024: 157 · 2023: 205 · 2022: 108 · 2021: 6
- FWCI
- 54.87
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Interspeech (USB) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- self-supervised learning, speech processing, benchmark, shared models, representation learning, frozen pre-trained models, task generalization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.