Emotion Recognition from Speech Using wav2vec 2.0 Embeddings
Open accessThe DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
Emotion recognition datasets are relatively small, making the use of the more sophisticated deep learning approaches challenging. In this work, we propose a transfer learning method for speech emotion recognition where features extracted from pre-trained wav2vec 2.0 models are modeled using simple neural networks. We propose to combine the output of several layers from the pre-trained model using trainable weights which are learned jointly with the downstream model. Further, we compare performance using two different wav2vec 2.0 models, with and without finetuning for speech recognition. We evaluate our proposed approaches on two standard emotion databases IEMOCAP and RAVDESS, showing superior performance compared to results in the literature.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Previous work [5, 12, 13] has demonstrated that the intermediate feature of self-supervised model contains certain discriminative information.”
From Audio Deepfake Detection With Self-Supervised WavLM And Multi-Fusion Attentive Classifier (2024) · cites this paper as [13]
The cited source says what the claim attributes to it.
In the citing paper
“Nevertheless, previous works have shown that for other tasks, for example, speaker verification or emotion recognition, more discriminative information can be obtained from the first or intermediate layers [12, 13].”
From The Vicomtech Audio Deepfake Detection System Based on Wav2vec2 for the 2022 ADD Challenge (2022) · cites this paper as [13]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
“Librispeech: an ASR corpus based on public domain audio books,”
Panayotov, V., Chen, G., Povey, D., & Khudanpur, S. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178964 · Cited by 6,072
Graves, A., Fernández, S., Gomez, F., & Schmidhuber, J. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143891 · Cited by 5,370
IEMOCAP: Interactive emotional dyadic motion capture database
Busso, C., Bulut, M., Lee, C.-C., Kazemzadeh, A., Mower, E., Kim, S., Chang, J. N., Lee, S., & Narayanan, S. S. (2008) · Language Resources and Evaluation · doi:10.1007/s10579-008-9076-6 · Cited by 3,869
Categorical Reparameterization with Gumbel-Softmax
Jang, E., Gu, S., & Poole, B. (2016) · arXiv · doi:10.48550/arxiv.1611.01144 · Cited by 3,616
Conformer: Convolution-augmented Transformer for Speech Recognition
Gulati, A., Qin, J., Chiu, C.-C., Parmar, N., Zhang, Y., Yu, J., Han, W., Wang, S., Zhang, Z., Wu, Y., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.08100 · Cited by 3,150
Conformer: Convolution-augmented Transformer for Speech Recognition
Gulati, A., Qin, J., Chiu, C.-C., Parmar, N., Zhang, Y., Yu, J., Han, W., Wang, S., Zhang, Z., Wu, Y., et al. (2020) · Interspeech 2020 · doi:10.21437/interspeech.2020-3015 · Cited by 3,150
Research works printed but not linked: 2
- [15]15. M. Sarma, P. Ghahremani, D. Povey, N. K. Goel, K. K. Sarma, and N. Dehak, "Emotion identification from raw speech signals using dnns." in Interspeech, 2018.
- [37]37. P. Riera, L. Ferrer, A. Gravano, and L. Gauder, "No sample left behind: Towards a comprehensive evaluation of speech emotion recognition system," in Proc. Workshop on Speech, Music and Mind 2019, 2019.
Cited by
Dawn of the Transformer Era in Speech Emotion Recognition: Closing the Valence Gap
Wagner, J., Triantafyllopoulos, A., Wierstorf, H., Schmitt, M., Burkhardt, F., Eyben, F., & Schuller, B. W. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3263585 · Cited by 395
Multimodal Emotion Recognition on RAVDESS Dataset Using Transfer Learning
Luna-Jiménez, C., Griol, D., Callejas, Z., Kleinlein, R., Montero, J. M., & Fernández-Martínez, F. (2021) · Sensors · doi:10.3390/s21227665 · Cited by 161
Exploring Wav2vec 2.0 Fine Tuning for Improved Speech Emotion Recognition
Chen, L.-W., & Rudnicky, A. I. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095036 · Cited by 257
A systematic literature review of speech emotion recognition approaches
Singh, Y. B., & Goel, S. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.04.028 · Cited by 174
Speech Emotion Recognition Using Self-Supervised Features
Morais, E. D. S., Hoory, R., Zhu, W., Gat, I., Damasceno, M., & Aronowitz, H. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747870 · Cited by 203
Wang, Y., Boumadane, A., & Heba, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.02735 · Cited by 93
Luna-Jiménez, C., Kleinlein, R., Griol, D., Callejas, Z., Montero, J. M., & Fernández-Martínez, F. (2021) · Applied Sciences · doi:10.3390/app12010327 · Cited by 149
Large-Scale Self-Supervised Speech Representation Learning for Automatic Speaker Verification
Chen, Z., Chen, S., Wu, Y., Qian, Y., Wang, C., Liu, S., Qian, Y., & Zeng, M. (2022) · ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp43922.2022.9747814 · Cited by 112
M-SENA: An Integrated Platform for Multimodal Sentiment Analysis
Mao, H., Yuan, Z., Xu, H., Yu, W., Liu, Y., & Gao, K. (2022) · Annual Meeting of the Association for Computational Linguistics: System Demonstrations (ACL Demo) · doi:10.18653/v1/2022.acl-demo.20 · Cited by 148
Fine-Tuning Wav2Vec2 for Speaker Recognition
Vaessen, N., & van Leeuwen, D. A. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746952 · Cited by 149
The Vicomtech Audio Deepfake Detection System Based on Wav2vec2 for the 2022 ADD Challenge
Martin-Donas, J. M., & Alvarez, A. (2022) · ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp43922.2022.9747768 · Cited by 100
Speech emotion recognition approaches: A systematic review
Hashem, A., Arif, M., & Alghamdi, M. (2023) · Speech Communication · doi:10.1016/j.specom.2023.102974 · Cited by 122
Audio Deepfake Detection With Self-Supervised WavLM And Multi-Fusion Attentive Classifier
Guo, Y., Huang, H., Chen, X., Zhao, H., & Wang, Y. (2024) · ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp48485.2024.10447923 · Cited by 95
Multimodal Emotion Recognition with High-Level Speech and Text Features
Makiuchi, M. R., Uto, K., & Shinoda, K. (2021) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru51503.2021.9688036 · Cited by 116
Speech Emotion Recognition via CNN-Transformer and multidimensional attention mechanism
Tang, X., Huang, J., Lin, Y., Dang, T., & Cheng, J. (2025) · Speech Communication · doi:10.1016/j.specom.2025.103242 · Cited by 91
Speaker Normalization for Self-Supervised Speech Emotion Recognition
Gat, I., Aronowitz, H., Zhu, W., Morais, E. D. S., & Hoory, R. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747460 · Cited by 86
Transformers in speech processing: Overcoming challenges and paving the future
Latif, S., Zaidi, S. A. M., Cuayáhuitl, H., Shamshad, F., Shoukat, M., Usama, M., & Qadir, J. (2025) · Computer Science Review · doi:10.1016/j.cosrev.2025.100768 · Cited by 126
Investigating Self-Supervised Learning for Speech Enhancement and Separation
Huang, Z., Watanabe, S., Yang, S.-W., Garcia, L. P., & Khudanpur, S. P. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746303 · Cited by 105
Zhang, X., Zhang, X., Chen, W., Li, C., & Yu, C. (2024) · Scientific Reports · doi:10.1038/s41598-024-60278-1 · Cited by 68
Cross-lingual Self-Supervised Speech Representations for Improved Dysarthric Speech Recognition
Hernandez, A., Pérez-Toro, P. A., Noeth, E., Orozco-Arroyave, J. R., Maier, A., & Yang, S. H. (2022) · Interspeech 2022 · doi:10.21437/interspeech.2022-10674 · Cited by 56
Chi, N., Washington, P. Y., Kline, A., Husic, A., Hou, C., He, C., Dunlap, K., & Wall, D. P. (2022) · JMIR Pediatrics and Parenting · doi:10.2196/35406 · Cited by 77
Multi-Lingual Multi-Task Speech Emotion Recognition Using wav2vec 2.0
Sharma, M. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747417 · Cited by 89
Detecting Dysfluencies in Stuttering Therapy Using wav2vec 2.0
Bayerl, S. P., Wagner, D., Noeth, E., & Riedhammer, K. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10908 · Cited by 96
A conformer-based classifier for variable-length utterance processing in anti-spoofing
Rosello, E., Gomez-Alanis, A., Gomez, A. M., & Peinado, A. (2023) · INTERSPEECH 2023 · doi:10.21437/interspeech.2023-1820 · Cited by 47
Wang, H., Jin, Z., Geng, M., Hu, S., Li, G., Wang, T., Xu, H., & Liu, X. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447702 · Cited by 78
A Vector Quantized Masked Autoencoder for Speech Emotion Recognition
Sadok, S., Leglaive, S., & Séguier, R. (2023) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw59220.2023.10193151 · Cited by 61
Srinivasan, S., Huang, Z., & Kirchhoff, K. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747754 · Cited by 57
Unveiling embedded features in Wav2vec2 and HuBERT msodels for Speech Emotion Recognition
Chakhtouna, A., Sekkate, S., & Adib, A. (2024) · Procedia Computer Science · doi:10.1016/j.procs.2024.02.074 · Cited by 47
Bautista, J. L., Lee, Y. K., & Shin, H. S. (2022) · Electronics · doi:10.3390/electronics11233935 · Cited by 47
Exploration of a Self-Supervised Speech Model: A Study on Emotional Corpora
Li, Y., Mohamied, Y., Bell, P., & Lai, C. (2023) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt54892.2023.10023428 · Cited by 73
Hsu, J.-H., & Wu, C. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2023.3258900 · Cited by 47
Exploring Self-Supervised Pre-Trained ASR Models for Dysarthric and Elderly Speech Recognition
Hu, S., Xie, X., Jin, Z., Geng, M., Wang, Y., Cui, M., Deng, J., Liu, X., & Meng, H. M. L. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10097275 · Cited by 61
Self-Supervised ASR Models and Features for Dysarthric and Elderly Speech Recognition
Hu, S., Xie, X., Geng, M., Jin, Z., Deng, J., Li, G., Wang, Y., Cui, M., Wang, T., Meng, H. M. L., et al. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3422839 · Cited by 60
A review of natural language processing in contact centre automation
Shah, S., Ghomeshi, H., Vakaj, E., Cooper, E., & Fouad, S. (2023) · Pattern Analysis and Applications · doi:10.1007/s10044-023-01182-8 · Cited by 61
Leveraging TCN and Transformer for effective visual-audio fusion in continuous emotion recognition
Zhou, W., Lu, J., Xiong, Z., & Wang, W. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00610 · Cited by 57
Multi-level Fusion of Wav2vec 2.0 and BERT for Multimodal Emotion Recognition
Zhao, Z., Wang, Y., & Wang, Y. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10230 · Cited by 54
Learning Speech Emotion Representations in the Quaternion Domain
Guizzo, E., Weyde, T., Scardapane, S., & Comminiello, D. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3250840 · Cited by 43
Emotion Neural Transducer for Fine-Grained Speech Emotion Recognition
Shen, S., Gao, Y. M., Liu, F., Wang, H., & Zhou, A. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446974 · Cited by 53
Leveraging Speech PTM, Text LLM, And Emotional TTS For Speech Emotion Recognition
Ma, Z., Wu, W., Zheng, Z., Guo, Y., Chen, Q., Zhang, S., & Chen, X. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10445906 · Cited by 58
Feng, T., & Narayanan, S. (2023) · 2023 11th International Conference on Affective Computing and Intelligent Interaction (ACII) · doi:10.1109/acii59096.2023.10388152 · Cited by 34
Fully Automated End-to-End Fake Audio Detection
Wang, C., Yi, J., Tao, J., Sun, H., Chen, X., Tian, Z., Ma, H., Fan, C., & Fu, R. (2022) · Proceedings of the 1st International Workshop on Deepfake Detection for Audio Multimedia · doi:10.1145/3552466.3556530 · Cited by 30
Multi-modal Facial Affective Analysis based on Masked Autoencoder
Zhang, W., Ma, B., Qiu, F., & Ding, Y. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00615 · Cited by 63
Designing and Evaluating Speech Emotion Recognition Systems: A Reality Check Case Study with IEMOCAP
Antoniou, N., Katsamanis, A., Γιαννακόπουλος, Θ., & Narayanan, S. S. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096808 · Cited by 56
Javanmardi, F., Kadiri, S. R., & Alku, P. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3392829 · Cited by 49
The MuSe 2024 Multimodal Sentiment Analysis Challenge: Social Perception and Humor Recognition
Amiriparian, S., Christ, L., Kathan, A., Gerczuk, M., Müller, N., Klug, S., Stappen, L., Konig, A. S., Cambria, E., Schuller, B. W., et al. (2024) · doi:10.1145/3689062.3689088 · Cited by 43
Shen, S., Liu, F., & Zhou, A. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095193 · Cited by 40
Performance-Efficiency Trade-Offs in Unsupervised Pre-Training for Speech Recognition
Wu, F., Kim, K., Pan, J. S., Han, K. J., Weinberger, K. Q., & Artzi, Y. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747432 · Cited by 48
DanXe: An extended artificial intelligence framework to analyze and promote dance heritage
Stacchio, L., Garzarella, S., Cascarano, P., Filippo, A. D., Cervellati, E., & Marfia, G. (2024) · Digital Applications in Archaeology and Cultural Heritage · doi:10.1016/j.daach.2024.e00343 · Cited by 42
Speech Emotion Recognition on MELD and RAVDESS Datasets Using CNN
Waleed, G. T., & Shaker, S. H. (2025) · Information · doi:10.3390/info16070518 · Cited by 33
Probing speech emotion recognition transformers for linguistic knowledge
Triantafyllopoulos, A., Wagner, J., Wierstorf, H., Schmitt, M., Reichel, U. D., Eyben, F., Burkhardt, F., & Schuller, B. W. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10371 · Cited by 34
Wav2vec2-based Paralinguistic Systems to Recognise Vocalised Emotions and Stuttering
Grósz, T., Porjazovski, D., Getman, Y., Kadiri, S., & Kurimo, M. (2022) · Proceedings of the 30th ACM International Conference on Multimedia · doi:10.1145/3503161.3551572 · Cited by 28
Latif, S., Usama, M., Malik, M. I., & Schuller, B. W. (2025) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2024.3504833 · Cited by 47
Yuan, Z., Chen, C. L. P., Li, S., & Zhang, T. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448044 · Cited by 37
The Influence of Dataset Partitioning on Dysfluency Detection Systems
Bayerl, S. P., Wagner, D., Nöth, E., Bocklet, T., & Riedhammer, K. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-16270-1_35 · Cited by 52
Feng, T., & Narayanan, S. S. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448130 · Cited by 54
Anti-Spoofing Using Transfer Learning with Variational Information Bottleneck
Eom, Y., Lee, Y., Um, J. S., & Kim, H. R. (2022) · Interspeech 2022 · doi:10.21437/interspeech.2022-10200 · Cited by 23
Emotion recognition of human speech using deep learning method and MFCC features
Hazra, S. K., Ema, R. R., Galib, S. M., Kabir, S. S., & Adnan, M. N. (2022) · RADIOELECTRONIC AND COMPUTER SYSTEMS · doi:10.32620/reks.2022.4.13 · Cited by 26
Towards Multimodal Prediction of Spontaneous Humor: A Novel Dataset and First Results
Christ, L., Amiriparian, S., Kathan, A., Müller, N., Konig, A. S., & Schuller, B. W. (2024) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2024.3475736 · Cited by 41
Hou, R., Fütterer, T., Bühler, B., Bozkir, E., Gerjets, P. H., Trautwein, U., & Kasneci, E. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-64302-6_5 · Cited by 38
Knowledge-Aware Bayesian Co-Attention for Multimodal Emotion Recognition
Zhao, Z., Wang, Y., & Wang, Y. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095798 · Cited by 25
Rekimoto, J. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580706 · Cited by 43
Sun, D., He, Y., & Han, J. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096586 · Cited by 24
Chou, H.-C., Goncalves, L., Leem, S.-G., Salman, A. N., Lee, C.-C., & Busso, C. (2025) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2024.3411290 · Cited by 22
Kakouros, S., Stafylakis, T., Mošner, L., & Burget, L. (2023) · ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp49357.2023.10094673 · Cited by 22
Klempíř, O., & Krupička, R. (2024) · Sensors · doi:10.3390/s24175520 · Cited by 30
Music Theory-Inspired Acoustic Representation for Speech Emotion Recognition
Li, X., Shi, X., Hu, D., Li, Y., Zhang, Q., Wang, Z., Unoki, M., & Akagi, M. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3289312 · Cited by 26
Deschamps-Berger, T., Lamel, L. F., & Devillers, L. Y. (2022) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3536220.3558038 · Cited by 32
Lee, C.-C., Chaspari, T., Provost, E. M., & Narayanan, S. S. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2023.3276209 · Cited by 31
A multimodal dynamical variational autoencoder for audiovisual speech representation learning
Sadok, S., Leglaive, S., Girin, L., Alameda-Pineda, X., & Séguier, R. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106120 · Cited by 32
Ülgen, İ. R., Du, Z., Busso, C., & Şişman, B. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447060 · Cited by 36
Audio Anti-Spoofing Based on Audio Feature Fusion
Zhang, J., Tu, G., Liu, S., & Cai, Z. (2023) · Algorithms · doi:10.3390/a16070317 · Cited by 24
A Joint Network Based on Interactive Attention for Speech Emotion Recognition
Hu, Y., Hou, S., Yang, H., Huang, H., & He, L. (2023) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme55011.2023.00295 · Cited by 28
Cross-Corpus Speech Emotion Recognition with HuBERT Self-Supervised Representation
Pastor, M., Ribas, D., Ortega, A., Miguel, A. D., & Lleida, E. (2022) · IberSPEECH · doi:10.21437/iberspeech.2022-16 · Cited by 28
DBT: multimodal emotion recognition based on dual-branch transformer
Yi, Y., Tian, Y., He, C., Fan, Y., Hu, X., & Xu, Y. (2022) · The Journal of Supercomputing · doi:10.1007/s11227-022-05001-5 · Cited by 21
Parameter Efficient Transfer Learning for Various Speech Processing Tasks
Otake, S., Kawakami, R., & Inoue, N. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096311 · Cited by 19
Multimodal Speech Emotion Recognition Using Modality-Specific Self-Supervised Frameworks
Patamia, R. A., Santos, P. E., Acheampong, K. N., Ekong, F., Sarpong, K., & Kun, S. (2023) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc53992.2023.10394418 · Cited by 20
Improving Domain Generalization in Speech Emotion Recognition with Whisper
Goron, E., Asai, L., Rut, E., & Dinov, M. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446997 · Cited by 41
Speech Emotion Recognition Using Dual-Stream Representation and Cross-Attention Fusion
Yu, S., Meng, J., Fan, W., Chen, Y., Zhu, B., Yu, H., Xie, Y., & Sun, Q. (2024) · Electronics · doi:10.3390/electronics13112191 · Cited by 24
Uncertainty-Based Learning of a Lightweight Model for Multimodal Emotion Recognition
Rădoi, A., & Cioroiu, G. (2024) · IEEE Access · doi:10.1109/access.2024.3450674 · Cited by 18
Accent-Robust Automatic Speech Recognition Using Supervised and Unsupervised Wav2vec EmbeddingsPreprint
Li, J., Manohar, V., Chitkara, P., Tjandra, A., Picheny, M., Zhang, F., Zhang, X., & Saraf, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.03520 · Cited by 29
Context-based emotion recognition: A survey
Abbas, R., Ni, B., Ma, R., Li, T., Lu, Y., & Li, X. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.129073 · Cited by 24
Automatic Speech Disfluency Detection Using wav2vec2.0 for Different Languages with Variable Lengths
Liu, J., Wumaier, A., Wei, D., & Guo, S. (2023) · Applied Sciences · doi:10.3390/app13137579 · Cited by 25
Liu, K., Wei, J., Zou, J., Wang, P., Yang, Y., & Shen, H. T. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3410133 · Cited by 22
Baradaran, F., Farzan, A., Danishvar, S., & Sheykhivand, S. (2023) · Electronics · doi:10.3390/electronics12102216 · Cited by 16
Enhancing Two-Stage Finetuning for Speech Emotion Recognition Using Adapters
Gao, Y., Shi, H., Chu, C., & Kawahara, T. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446645 · Cited by 26
Ibrahim, K. M., Perzo, A., & Leglaive, S. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10445740 · Cited by 21
GCF2-Net: global-aware cross-modal feature fusion network for speech emotion recognition
Li, F., Luo, J., Wang, L., Liu, W., & Sang, X. (2023) · Frontiers in Neuroscience · doi:10.3389/fnins.2023.1183132 · Cited by 15
VoicePM: A Robust Privacy Measurement on Voice Anonymity
Zhang, S., Li, Z., & Das, A. (2023) · ACM Conference on Security and Privacy in Wireless and Mobile Networks (WiSec) · doi:10.1145/3558482.3590175 · Cited by 24
Li, J., Hasegawa‐Johnson, M., & McElwain, N. L. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-460 · Cited by 28
Frame-Level Emotional State Alignment Method for Speech Emotion Recognition
Li, Q., Gao, Y., Wang, C., Deng, Y., Xue, J., Han, Y., & Li, Y. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446812 · Cited by 20
ELP-Adapters: Parameter Efficient Adapter Tuning for Various Speech Processing Tasks
Inoue, N., Otake, S., Hirose, T., Ohi, M., & Kawakami, R. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3434445 · Cited by 17
Chakhtouna, A., Sekkate, S., & Adib, A. (2025) · Annals of Telecommunications · doi:10.1007/s12243-025-01088-y · Cited by 15
A Multimodal Deep Learning Approach for Legal English Learning in Intelligent Educational Systems
Chen, Y., Huang, C., Gao, S., Lyu, Y., Chen, X., Liu, С., Bao, D., & Lv, C. (2025) · Sensors · doi:10.3390/s25113397 · Cited by 15
Domain-Informed Probing of wav2vec 2.0 Embeddings for Phonetic Features
English, P. C., Kelleher, J. D., & Carson-Berndsen, J. (2022) · SIGMORPHON Workshop on Computational Research in Phonetics, Phonology, and Morphology (SIGMORPHON) · doi:10.18653/v1/2022.sigmorphon-1.9 · Cited by 44
Spectrogram Features for Audio and Speech Analysis
McLoughlin, I. V., Pham, L. D., Song, Y., Miao, X., Phan, H., Cai, P., Gu, Q., Nan, J., Song, H., & Soh, D. C. L. (2026) · Applied Sciences · doi:10.3390/app16020572 · Cited by 26
Combining wav2vec 2.0 Fine-Tuning and ConLearnNet for Speech Emotion Recognition
Sun, C., Zhou, Y., Huang, X. M., Yang, J., & Hou, X. (2024) · Electronics · doi:10.3390/electronics13061103 · Cited by 17
Large-Scale Nonverbal Vocalization Detection Using Transformers
Tzirakis, P., Baird, A., Brooks, J. A., Gagne, C., Kim, L., Opara, M., Gregory, C., Metrick, J., Boseck, G., Tiruvadi, V., et al. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095294 · Cited by 25
Pan, Y., Mirheidari, B., Blackburn, D. J., & Christensen, H. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3533363 · Cited by 24
A literature review on automated machine learning
Alcobaça, E., & de Carvalho, A. C. P. L. F. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11397-2 · Cited by 17
Nasersharif, B., & Namvarpour, M. (2024) · The Journal of Supercomputing · doi:10.1007/s11227-024-06158-x · Cited by 14
Metadata
- Authors
- Pepino, L., Riera, P., & Ferrer, L.
- Affiliations
- Universidad de Buenos Aires (AR)
- Consejo Nacional de Investigaciones Científicas y Técnicas (AR)
- Venue
- Interspeech 2021
- Publisher
- ISCA
- Published
- 2021-08-30
- Pages
- 3400-3404
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W3144073776
- Cited by
- 389
- References
- 37
- Citations by year
- 2026: 78 · 2025: 80 · 2024: 74 · 2023: 100 · 2022: 48 · 2021: 9
- FWCI
- 64.26
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- cc-by
- Locations
- Interspeech (USB) (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Keywords
- speech emotion recognition, wav2vec 2.0, transfer learning, fine-tuning, IEMOCAP, RAVDESS
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.