SUPERB: Speech Processing Universal PERformance Benchmark
The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
Self-supervised learning (SSL) has proven vital for advancing research in natural language processing (NLP) and computer vision (CV).The paradigm pretrains a shared model on large volumes of unlabeled data and achieves state-of-the-art (SOTA) for various tasks with minimal adaptation.However, the speech processing community lacks a similar setup to systematically explore the paradigm.To bridge this gap, we introduce Speech processing Universal PERformance Benchmark (SUPERB).SUPERB is a leaderboard to benchmark the performance of a shared model across a wide range of speech processing tasks with minimal architecture changes and labeled data.Among multiple usages of the shared model, we especially focus on extracting the representation learned from SSL for its preferable re-usability.We present a simple framework to solve SUPERB tasks by learning task-specialized lightweight prediction heads on top of the frozen shared model.Our results demonstrate that the framework is promising as SSL representations show competitive generalizability and accessibility across SUPERB tasks.We release SUPERB as a challenge with a leaderboard 1 and a benchmark toolkit 2 to fuel the research in representation learning and general speech processing.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“According to [14], the authors have also indicated that by weighting the representations of different layers, self-supervised model has shown great potential in various speech downstream tasks.”
From Audio Deepfake Detection With Self-Supervised WavLM And Multi-Fusion Attentive Classifier (2024) · cites this paper as [14]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Self-citationBERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Self-citationDeep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
Self-citationRepresentation Learning with Contrastive Predictive Coding
Oord, A. V. D., Li, Y., & Vinyals, O. (2018) · arXiv · doi:10.48550/arxiv.1807.03748 · Cited by 6,242
“Librispeech: an ASR corpus based on public domain audio books,”
Panayotov, V., Chen, G., Povey, D., & Khudanpur, S. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178964 · Cited by 6,072
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
Wang, A., Singh, A., Michael, J., Hill, F., Levy, O., & Bowman, S. (2018) · Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP · doi:10.18653/v1/w18-5446 · Cited by 4,222
IEMOCAP: Interactive emotional dyadic motion capture database
Busso, C., Bulut, M., Lee, C.-C., Kazemzadeh, A., Mower, E., Kim, S., Chang, J. N., Lee, S., & Narayanan, S. S. (2008) · Language Resources and Evaluation · doi:10.1007/s10579-008-9076-6 · Cited by 3,869
HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units
Hsu, W.-N., Bolte, B., Tsai, Y.-H. H., Lakhotia, K., Salakhutdinov, R., & Mohamed, A. (2021) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2021.3122291 · Cited by 2,983
Self-citationDeep Clustering for Unsupervised Learning of Visual Features
Caron, M., Bojanowski, P., Joulin, A., & Douze, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_9 · Cited by 2,674
X-Vectors: Robust DNN Embeddings for Speaker Recognition
Snyder, D., Garcia-Romero, D., Sell, G., Povey, D., & Khudanpur, S. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8461375 · Cited by 2,620
Research works printed but not linked: 2
- [13][13] A. Baevski, S. Schneider, and M. Auli, 'vq-wav2vec: Selfsupervised learning of discrete speech representations,' in ICLR , 2020. -
- [25][25] X. Anguera, L. Rodriguez-Fuentes, A. Buzo, F. Metze, I. Sz¨ oke, and M. Penagarikano, 'Quesst2014: Evaluating query-byexample speech search in a zero-resource setting with real-life queries,' in ICASSP , 2015, pp. 5833-5837. -
Cited by
Items 601–700 of 756
Wav2vec-S: Semi-Supervised Pre-Training for Speech RecognitionPreprint
Zhu, H., Wang, L., Hou, Y., Wang, J., Cheng, G., Zhang, P., & Yan, Y. (2021) · arXiv (Cornell University) · Cited by 1
Singing Beat Tracking With Self-supervised Front-end and Linear TransformersPreprint
Heydari, M., & Duan, Z. (2022) · doi:10.36227/techrxiv.20743012 · Cited by 1
Survey on Multimodal Transformers for RobotsPreprint
Miyazawa, K., & Nagai, T. (2023) · doi:10.36227/techrxiv.21993317.v1 · Cited by 4
Masked Autoencoders with Multi-Window Local-Global Attention Are Better Audio LearnersPreprint
Yadav, S., Theodoridis, S., Hansen, L. K., & Tan, Z.-H. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2306.00561 · Cited by 12
Enhancing spoken language identification and diarization for multilingual speech
Liu, H. (2023) · doi:10.32657/10356/168498 · Cited by 1
k2SSL: A Faster and Better Framework for Self-Supervised Speech Representation LearningPreprint
Yang, Y., Zhuo, J., Jin, Z., & Chen, X. (2024) · Qeios · doi:10.32388/2c9tpu · Cited by 1
Informed Speech Self-supervised Representation Learning
Zaiem, S. (2024) · theses.fr (ABES) · doi:10.70675/dc53ad72z177fz4bb4z91fbzd00576ba3f2e · Cited by 2
Yang, C., Yu, C., Chen, H., Zhu, J., Chen, J., Chen, K., Wang, W., Wang, Y., Jiang, Y., Jiang, Y., et al. (2026) · arXiv · doi:10.48550/arxiv.2606.01802
“…show that acoustic and speaker-related cues concentrate in lower and intermediate layers while deeper layers drift toward lexical and semantic content [19, 20], and that a learnable combination of all layers consistently outperforms the last-layer representation across diverse speech tasks [21].”
Self-citationAn Empirical Study of Weakly Supervised Audio Tagging Embeddings for General Audio Representations
Dinkel, H., Yan, Z., Wang, Y., Zhang, J., & Wang, Y. (2022) · The Speaker and Language Recognition Workshop (Odyssey) · doi:10.21437/odyssey.2022-54 · Cited by 1
End-to-End Myanmar Speech Recognition with Human-Machine Cooperation
Wang, F., Yang, Y., & Yang, J. K. (2022) · International Conference on Asian Language Processing · doi:10.1109/ialp57159.2022.9961316
Low-Cost Training of Speech Recognition System for Hindi ASR Challenge 2022
Zatvornitskiy, A. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20980-2_60
Improving end-to-end transformer model architecture in ASR
Zhao, Y. (2023) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/166407
Real-Time Speech Interruption Analysis: from Cloud to Client Deployment
Fu, Q., Fu, S., Fan, Y., Wu, Y., Chen, Z., Gupchup, J., & Cutler, R. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095639
Chen, J., & Sakti, S. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095119
Auxiliary Pooling Layer For Spoken Language Understanding
Ma, Y., Nguyen, T. H., Ni, J., Wang, W., Chen, Q., Zhang, C., & Ma, B. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10097130
Syllable and Morpheme Segmentation of Macedonian Language
Mitreska, M., & Zdravkova, K. (2023) · International Convention on Information and Communication Technology, Electronics and Microelectronics · doi:10.23919/mipro57284.2023.10159815
Improving information fusion in deep learning
Don, D. P. M. K. (2023) · Queensland University of Technology · doi:10.5204/thesis.eprints.241291
Speech Emotion Recognition Using Global-Aware Cross-Modal Feature Fusion Network
Li, F., & Luo, J. (2023) · Lecture notes in computer science · doi:10.1007/978-981-99-4742-3_17
Sobre auto-aprendizado de representações para realce da voz 3D.
Guimarães, H. R. (2022) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.3.2022.tde-26072023-090438
Unfused: Unsupervised Finetuning Using Self Supervised Distillation
Seth, A., Ghosh, S., Umesh, S., & Manocha, D. (2023) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw59220.2023.10193076
Zhao, J., Yang, H., Haffari, G., & Shareghi, E. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.142 · Cited by 3
Latent Regression Bayesian Network for Speech Representation
Xu, L., Zhao, Y., Xu, X., Liu, Y., & Ji, Q. (2023) · Electronics · doi:10.3390/electronics12153342
Speech Taskonomy: Which Speech Tasks are the most Predictive of fMRI Brain Activity?
Oota, S. R., Agarwal, V., Marreddy, M., Gupta, M., & Bapi, R. S. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-121 · Cited by 7
Group Masked Model Learning for General Audio Representation
Atito, S., Awais, M., Alex, T., & Kittler, J. (2023) · Proceedings - International Conference on Image Processing · doi:10.1109/icip49359.2023.10222551 · Cited by 1
Apparent personality prediction from speech using expert features and wav2vec 2.0
Barchi, R. G., Pepino, L., Gauder, L., Estienne, L., Meza, M., Riera, P., & Ferrer, L. (2023) · Workshop on Speech, Music and Mind (SMM) · doi:10.21437/smm.2023-5 · Cited by 2
It’s What You Say and How You Say It: Exploring Audio and Textual Features for Podcast Data
Shah, N., Srivastava, V. P., Bhardwaj, M., Kadlay, S., Agrawal, D. M., Bhat, S., & Pedanekar, N. (2023) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc58517.2023.10317306
Somatisation Disorder Detection via Speech: Introducing a Self-Supervised Learning Model
Bao, Z., Qian, K., Zhao, Z., Sun, M., Huang, R., Xu, D., Hu, B., Yamamoto, Y., & Schuller, B. W. (2023) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc40787.2023.10340705
FusDom: Combining in-Domain and Out-of-Domain Knowledge for Continuous Self-Supervised Learning
Seth, A., Ghosh, S., Umesh, S., & Manocha, D. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448147 · Cited by 1
Learning Contextualized Representation on Discrete Space Via Hierarchical Product Quantization
Kim, H. Y., Kim, B.-Y., Lim, Y., Park, J., Park, J.-S., Lim, Y., Yu, S. W., & Lee, H. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446474
Self-citationAdvancing Paraphasia Detection with End-to-End Learning: A Comparative Approach Study (Preprint)Preprint
Perez, M., Le, D., Romana, A., Jones, E., Licata, K., & Provost, E. M. (2024) · doi:10.2196/preprints.59340
Sudo, Y., Takigahira, M., Tsuru, H., Nakadai, K., & Nakajima, H. (2024) · Advanced Robotics · doi:10.1080/01691864.2024.2379384
Attention or Convolution: Transformer Encoders in Audio Language Models for Inference Efficiency
Jeon, S., Yeh, C.-F., Inan, H., Hsu, W.-N., Rungta, R., Mehdad, Y., & Bikel, D. M. (2024) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw62465.2024.10626117
Investigating Self-Supervised Features for Expressive, Multilingual Voice Conversion
Martín-Cortinas, Á., Sáez-Trigueros, D., Beringer, G., Vallés-Ṕerez, I., Barra-Chicote, R., Vecino, B. T., Gabryś, A., Merritt, T., Biliński, P., & Lorenzo-Trueba, J. (2024) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw62465.2024.10627128 · Cited by 2
Cross-Attention Dual-Stream Fusion for Speech Emotion Recognition
Yu, S., Meng, J., Zhu, B., & Sun, Q. (2024) · IEEE Pacific Rim Conference on Communications, Computers and Signal Processing (PACRIM) · doi:10.1109/pacrim61180.2024.10690221 · Cited by 1
ERVQ: Leverage Residual Vector Quantization for Speech Emotion Recognition
Xie, J., Xiang, Y., Wang, H., Wu, X., Wu, Z., & Meng, H. M. L. (2024) · International Symposium on Chinese Spoken Language Processing (ISCSLP) · doi:10.1109/iscslp63861.2024.10800636
Xie, J., Song, C., Xiang, Y., Wang, H., Wu, X., Wu, Z., & Meng, H. M. L. (2024) · International Symposium on Chinese Spoken Language Processing (ISCSLP) · doi:10.1109/iscslp63861.2024.10799993
TeleSpeechPT: Large-Scale Chinese Multi-dialect and Multi-accent Speech Pre-training
Chen, H., Li, Z., Xia, G., Liu, B., Yang, Y., Kang, J., & Li, J. (2024) · Communications in computer and information science · doi:10.1007/978-981-96-1045-7_15
Efficient Extraction of Noise-Robust Discrete Units from Self-Supervised Speech Models
Poncelet, J., Wang, Y., & hamme, H. V. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832141 · Cited by 1
Lee, S.-W. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832334
BEES: A New Acoustic Task for Blended Emotion Estimation in Speech
Li, X., Shi, X., Si, Y., Zhang, Z., Cui, F., Li, Y., Liu, Y., Unoki, M., & Akagi, M. (2024) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc63619.2025.10848842
Enhancing Neural Speech Embeddings for Generative Speech Models
Kim, D., Song, Y., Madhu, N., & Kang, H.-G. (2024) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc63619.2025.10849285
Nakata, W., Saeki, T., Saito, Y., Takamichi, S., & Saruwatari, H. (2024) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc63619.2025.10849090
Analysis of Various Self-Supervised Learning Models for Automatic Pronunciation Assessment
Lee, H., Kim, S., & Chung, M. (2024) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc63619.2025.10848954
Self-citationWu, C.-W., & Chen, B. (2024) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc63619.2025.10849101
Li, X., Shi, X., Unoki, M., Toda, T., & Akagi, M. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5129679
Learning Rich Speech Representations with Acoustic-Semantic Factorization
Niu, M., Sadoughi, N., Yanamandra, A., Wang, P., Liu, Z., Bhat, V., & Norred, S. E. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889923 · Cited by 1
Wang, J.-Y., Li, S., Lu, L., Kao, S., & Jang, J. R. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10887674
Self-citationBridging the Modality Gap for Speech-image Retrieval with Text Supervision
Yang, Y., Zhou, L., Li, Y., & Ma, G. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890484
Evaluation of Deep Audio Representations for Hearables
Gröger, F., Baumann, P., Amruthalingam, L., Simon, L., Giurda, R., & Lionetti, S. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10887737 · Cited by 3
Sritharan, B., Thayasivam, U., & Bandara, S. J. (2025) · IEEE Symposium on Computational Intelligence in Natural Language Processing and Social Media (CI-NLPSoMe) · doi:10.1109/ci-nlpsome64976.2025.10970770
Emotional Style Transfer With Intensity Control in Zero-Shot TTS
Wang, H., Qiang, C., Wang, T., Gong, C., & Wang, L. (2025) · IEEE Signal Processing Letters · doi:10.1109/lsp.2025.3592588 · Cited by 2
An Exploration of ECAPA-TDNN and x-vector Speaker Representations in Zero-Shot Multi-speaker TTS
Kunešová, M., Hanzlíček, Z., & Matoušek, J. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-02548-7_8
Speaker Group Encoding in Self-supervised Speech Recognition Models
Herron, F. E., Rossato, S., Allauzen, A., Favre, B., & Portet, F. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-02548-7_11 · Cited by 5
Wang, C., & Wang, C. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-3453-1_15
Liu, Y., Yang, X., & Qu, D. (2025) · Signal Image and Video Processing · doi:10.1007/s11760-025-04859-1
Tin, A., & Hasegawa‐Johnson, M. (2025) · Machine learning for signal processing ... · doi:10.1109/mlsp62443.2025.11204211
Probing Layer-Wise Self-Supervised Representations for Low-Resource Spoken Language Identification
Dey, S., & Saha, G. (2025) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2025.3626261
k2SSL: A Faster and Better Framework for Self-Supervised Speech Representation Learning
Yang, Y., Zhuo, J., Jin, Z., Ma, Z., Yang, X., Yao, Z., Guo, L., Kang, W., Kuang, F., Lin, L., et al. (2025) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme59968.2025.11209883 · Cited by 10
Self-supervised Contrastive Learning for Content-Centric Speech Representation
Li, J., Dong, L., Wang, W., Yu, Z., & Gao, S. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-2725-0_1
Nkululeko 1.0: A Python package to predict speaker characteristics with a high-level interface
Burkhardt, F., & Atmaja, B. T. (2025) · The Journal of Open Source Software · doi:10.21105/joss.08049
Softprox: A Post-Finetuning Methodology to Mitigate Softmax Bottlenecks in Transformer Workloads
Parvathy, A. M., Roy, S., Ghosh, S. K., Raha, A., Mathaikutty, D. A., & Raghunathan, A. (2025) · IEEE transactions on circuits and systems for artificial intelligence. · doi:10.1109/tcasai.2025.3628250
Rehman, A., Jayathunge, K., Zhang, J.-J., & Yang, X. (2025) · International Conference on Speech Technology and Human-Computer Dialogue (SpeD) · doi:10.1109/sped67700.2025.11252189
Progress and Challenges in DNN-Based Objective Quality Assessment of Synthesized Speech
Cooper, E. (2025) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc65261.2025.11249252
Yamashita, N., Yamamoto, M., & Kawaguchi, Y. (2025) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc65261.2025.11249181
Fast and Speaker-Independent Utterance Selection for ASR-Free CALL Systems of Minority Languages
Koshikawa, T., Ito, A., & Nose, T. (2025) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc65261.2025.11249176
PUNSER: Large-Scale Pre-Trained and Unified Model for Practical Speech Emotion Recognition
Hayashizaki, Y., Nose, T., Kobayashi, S., Fukayama, S., & Ito, A. (2025) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc65261.2025.11248989
KG-STFT: Knowledge Graph-Guided Human-Generated Spatial-Temporal Cross-task Fine-Tuning
Hu, M., Zhang, X., Li, Y., & Luo, J. (2025) · ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (SIGSPATIAL GIS) · doi:10.1145/3748636.3762743
Advancing depression detection in audio through innovative semi-supervised learning technology
Liu, Y., Li, X., Cai, Y., Xu, J., Hu, J., Zhang, Y., & Chen, Y. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.115126 · Cited by 2
Learning Relationship Between Speaker Embeddings and Descriptions of Speaker Traits
Liu, X., Yamagishi, J., Wang, X., & Cooper, E. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3648890
Luan, Y., Speights, M. L., Dozier, G. V., & Seals, C. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-13187-4_13 · Cited by 1
Speaker-Conditioned U-Shaped Diarization With Speaker Extraction-Guided Enhancement
Tran, N. H. A., Hoang, N. C., & Nguyen, Q. C. (2026) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2026.3654140
MIX-PC: Enabling Efficient DNN Inference with Mixed Numeric Precision Compilation Optimization
Huang, S., Liu, F., Wang, Z., Yang, N., Li, H., Jiang, L., & Guan, H. (2026) · ACM Transactions on Architecture and Code Optimization · doi:10.1145/3785473
Petrache, M., Carvallo, A., Silva, V., Barceló, P., & Peña, M. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.01.30.702650
Interpreting Speaker Characteristics in the Dimensions of Self-Supervised Speech Features
van Rensburg, K. J., van Niekerk, B., & Kamper, H. (2026) · IEEE Signal Processing Letters · doi:10.1109/lsp.2026.3716838
Song, X., Wang, R., & Wei, Z. (2025) · International Conference on Electronic Information Engineering and Computer Communication (EIECC) · doi:10.1109/eiecc67963.2025.11409625
Dual-Path Multi-Scale Fusion Framework for Enhanced Anonymous Speaker Verification
Chen, O. T.-C., Tsai, Y.-C., & Ha, M.-H. (2025) · IEEE Annual Congress on Artificial Intelligence of Things (AIoT) · doi:10.1109/aiot66900.2025.00041
Lin, J., Ao, J., Ge, M., Feng, M., & Li, H. (2026) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2026.3675810
CVSM: Contrastive Vocal Similarity Modeling
Garoufis, C., Zlatintsi, A., & Maragos, P. A. (2026) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2026.3677618
Design and Efficiency of Cascaded Learning Models for Robust Monaural Speech Separation
Dang, S. (2025) · Institutional Repositories DataBase (IRDB)
Tsai, Y.-T., Lin, Y., Chou, H.-C., & Lee, H.-Y. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11434684 · Cited by 5
Self-citationEmoTale: An Enacted Speech-emotion Dataset in Danish
Hjuler, M. J., Skat-Rørdam, H. V., Clemmensen, L. K. H., & Das, S. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11434666
Can self-supervised speech models predict the perceived acceptability of prosodic variation?
Wallbridge, S., Adigwe, A., & Bell, P. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11434724
ULTRAS - Unified Learning of Transformer Representations for Audio and Speech Signals
Ameenudeen, P. E., Narayanan, C. K., & Ganapathy, S. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11434696 · Cited by 1
JOOCI: a Novel Method for Learning Comprehensive Speech Representations
Yadav, H. N., Sitaram, S., & Shah, R. R. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11434653
Unifying Model and Layer Fusion for Speech Foundation Models
Shih, Y.-J., & Harwath, D. F. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11434659
Evaluating Self-Supervised Speech Models Via Text-Based LLMs
Maekaku, T., Goto, K., Tian, J., Shinohara, Y., & Watanabe, S. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11434740
Self-citationRobust Speech Emotion Recognition via Classifier Retraining on Mixup-Augmented Representations
Lee, S.-W. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11434603
State-of-the-art Embeddings with Video-free Segmentation of the Source VoxCeleb Data
Barahona, S., Mošnery, L., Stafylakisz, T., Plchoty, O., Pengy, J., Burgety, L., & Černockyý, J. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11434721
Wong, J. H. M., Huzaifah, M., Sailor, H. B., Sun, S., Tan, K. M., Wang, B., Wang, Q., Zhang, W., Zou, X., Chen, N. F., et al. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11434599 · Cited by 1
Utilizing Kolmogorov-Arnold Network in Self-Supervised Learning for Speaker Diarization
Vu, M., Dat, P. T., Teh, K. K., Nguyen, V. T., & Dat, T. H. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11434699
Enhancing Dialogue Annotation with Speaker Characteristics Leveraging a Frozen LLM
Thebaud, T., Lu, Y.-J., Wiesner, M., Viechnicki, P. D., & Dehak, N. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11434755 · Cited by 5
End-to-End Modeling for Speech Spoofing and Deepfake Detection
Tak, H. (2023) · theses.fr (ABES) · doi:10.70675/aa9fb6cbz3f6az45bcz933fzf95d89893e59 · Cited by 4
Unsupervised multilingual models of speech representation, an approach inspired by cognitive science
de Seyssel, M. (2023) · theses.fr (ABES) · doi:10.70675/2974e23cz54f3z4282z8000z612287446e7f · Cited by 2
Generating diverse synthetic data for ASR training data augmentation
Ogun, S. (2024) · theses.fr (ABES) · doi:10.70675/71c45896z7718z43c4z9f38zac28fa30879c
Spoken Language Modeling from Raw Audio
Nguyen, T. A. (2024) · theses.fr (ABES) · doi:10.70675/e81cb131z2de8z4c0fz86f5zd983c6cb8744 · Cited by 1
Development of Hybrid Feature Based Models for Dysarthric Speech Recognition
Aryza, F. N., & Hidayat, S. (2026) · International Journal of Online and Biomedical Engineering (iJOE) · doi:10.3991/ijoe.v22i04.59849
文敬, 野., Xiang, L., Zhao, X., & Zong, C. (2026) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2026.3683357 · Cited by 1
Effective Multi-Scale Temporal Modeling for Small-Data Speech Rate Classification
Zheng, Q., & Abliz, W. (2025) · International Conference on Artificial Intelligence, Digital Media Technology and Interaction Design (ICADI) · doi:10.1145/3795926.3796024
Metadata
- Authors
- Yang, S.-W., Chi, P.-H., Chuang, Y.-S., Lai, C.-I. J., Lakhotia, K., Lin, Y. Y., Liu, A. T., Shi, J., Chang, X., Lin, G.-T., Huang, T.-H., Tseng, W.-C., Lee, K.-T., Liu, D.-R., Huang, Z., Dong, S., Li, S.-W., Watanabe, S., Mohamed, A., & Lee, H.-Y.
- Affiliations
- National Taiwan University (TW)
- Meta (United States) (US)
- Johns Hopkins University (US)
- Carnegie Mellon University (US)
- Amazon (United States) (US)
- ORCID
- Venue
- Interspeech 2021
- Publisher
- ISCA
- Published
- 2021-08-30
- Pages
- 1194-1198
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W3197580070
- Cited by
- 681
- References
- 40
- Citations by year
- 2026: 67 · 2025: 138 · 2024: 157 · 2023: 205 · 2022: 108 · 2021: 6
- FWCI
- 54.87
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Interspeech (USB) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- self-supervised learning, speech processing, benchmark, shared models, representation learning, frozen pre-trained models, task generalization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.