Emotion Recognition from Speech Using wav2vec 2.0 Embeddings
Open accessThe DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
Emotion recognition datasets are relatively small, making the use of the more sophisticated deep learning approaches challenging. In this work, we propose a transfer learning method for speech emotion recognition where features extracted from pre-trained wav2vec 2.0 models are modeled using simple neural networks. We propose to combine the output of several layers from the pre-trained model using trainable weights which are learned jointly with the downstream model. Further, we compare performance using two different wav2vec 2.0 models, with and without finetuning for speech recognition. We evaluate our proposed approaches on two standard emotion databases IEMOCAP and RAVDESS, showing superior performance compared to results in the literature.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Previous work [5, 12, 13] has demonstrated that the intermediate feature of self-supervised model contains certain discriminative information.”
From Audio Deepfake Detection With Self-Supervised WavLM And Multi-Fusion Attentive Classifier (2024) · cites this paper as [13]
The cited source says what the claim attributes to it.
In the citing paper
“Nevertheless, previous works have shown that for other tasks, for example, speaker verification or emotion recognition, more discriminative information can be obtained from the first or intermediate layers [12, 13].”
From The Vicomtech Audio Deepfake Detection System Based on Wav2vec2 for the 2022 ADD Challenge (2022) · cites this paper as [13]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
“Librispeech: an ASR corpus based on public domain audio books,”
Panayotov, V., Chen, G., Povey, D., & Khudanpur, S. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178964 · Cited by 6,072
Graves, A., Fernández, S., Gomez, F., & Schmidhuber, J. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143891 · Cited by 5,370
IEMOCAP: Interactive emotional dyadic motion capture database
Busso, C., Bulut, M., Lee, C.-C., Kazemzadeh, A., Mower, E., Kim, S., Chang, J. N., Lee, S., & Narayanan, S. S. (2008) · Language Resources and Evaluation · doi:10.1007/s10579-008-9076-6 · Cited by 3,869
Categorical Reparameterization with Gumbel-Softmax
Jang, E., Gu, S., & Poole, B. (2016) · arXiv · doi:10.48550/arxiv.1611.01144 · Cited by 3,616
Conformer: Convolution-augmented Transformer for Speech Recognition
Gulati, A., Qin, J., Chiu, C.-C., Parmar, N., Zhang, Y., Yu, J., Han, W., Wang, S., Zhang, Z., Wu, Y., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.08100 · Cited by 3,150
Conformer: Convolution-augmented Transformer for Speech Recognition
Gulati, A., Qin, J., Chiu, C.-C., Parmar, N., Zhang, Y., Yu, J., Han, W., Wang, S., Zhang, Z., Wu, Y., et al. (2020) · Interspeech 2020 · doi:10.21437/interspeech.2020-3015 · Cited by 3,150
Research works printed but not linked: 2
- [15]15. M. Sarma, P. Ghahremani, D. Povey, N. K. Goel, K. K. Sarma, and N. Dehak, "Emotion identification from raw speech signals using dnns." in Interspeech, 2018.
- [37]37. P. Riera, L. Ferrer, A. Gravano, and L. Gauder, "No sample left behind: Towards a comprehensive evaluation of speech emotion recognition system," in Proc. Workshop on Speech, Music and Mind 2019, 2019.
Cited by
Items 201–300 of 424
Speech Emotion Classification: A Survey of the State-of-the-Art
Akinpelu, S. A., & Viriri, S. (2023) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-031-25271-6_24 · Cited by 4
Learning Multilingual Expressive Speech Representation for Prosody Prediction without Parallel Data
Duret, J., Estève, Y., & Parcollet, T. (2023) · ISCA Speech Synthesis Workshop (SSW) · doi:10.21437/ssw.2023-29 · Cited by 7
Muralikrishna, H., Angra, A., Dileep, D., Madhushankara, M., & Reddy, C. S. (2025) · International Journal of Information Technology · doi:10.1007/s41870-025-02992-1 · Cited by 3
Korkmaz, Y., & Jararweh, Y. (2026) · Cluster Computing · doi:10.1007/s10586-025-05883-z · Cited by 4
I Feel Stressed Out: A Mandarin Speech Stress Dataset with New Paradigm
Chen, S., Xing, X., Liang, G., & Xu, X. (2022) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.23919/apsipaasc55919.2022.9980183 · Cited by 3
WavRx: A Disease-Agnostic, Generalizable, and Privacy-Preserving Speech Health Diagnostic Model
Zhu, Y. M., & Falk, T. H. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3454550 · Cited by 7
Das, A. K., Reddy, K. A., Bomminayuni, H., & Naskar, R. (2024) · IEEE India Conference · doi:10.1109/indicon63790.2024.10958507 · Cited by 3
Chen, C., & Huang, L. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.111439 · Cited by 5
Krebbers, D., Kaya, H., & Karpov, A. A. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20980-2_34 · Cited by 3
FF-GLAM-cs: a fusion framework based on GLAM with channel shuffle for speech emotion recognition
Wang, J., Zheng, Z., Liang, Y., Qin, J., & Wang, W. (2023) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-023-01948-w · Cited by 3
Effects of Facial Expressions and Gestures on the Trustworthiness of a Person
Lutfi, S. L., Lahasan, B. M., Luna-Jiménez, C., Bamasood, Z. A., & Akhtar, Z. (2023) · IEEE Access · doi:10.1109/access.2023.3334270 · Cited by 5
Mansourian, N., Mohammadi, A., Ahmad, M. O., & Swamy, M. N. S. (2025) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc58623.2025.11254389 · Cited by 3
Nonwords Pronunciation Classification in Language Development Tests for Preschool Children
Baumann, I., Wagner, D., Bayerl, S. P., & Bocklet, T. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10777 · Cited by 8
DynamicMBFN: Dynamic Multimodal Bottleneck Fusion Network for Multimodal Emotion Recognition
Sun, Y., Cheng, D., Chen, Y., & He, Z. (2023) · International Symposium on Computer Technology and Information Science (ISCTIS) · doi:10.1109/isctis58954.2023.10213035 · Cited by 4
Moreno-Acevedo, S. A., Vásquez-Correa, J. C., Martín-Doñas, J. M., & Álvarez, A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-70566-3_10 · Cited by 3
DualVoice: A Speech Interaction Method Using Whisper-Voice as Commands
Rekimoto, J. (2022) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3491101.3519700 · Cited by 3
Learning a Bimodal Emotion Recognition System Based on Small Amount of Speech Data
Furutani, J., Kang, X., Kiuchi, K., Nishimura, R., Sasayama, M., & Matsumoto, K. (2022) · International Conference on Systems and Informatics (ICSAI) · doi:10.1109/icsai57119.2022.10005454 · Cited by 3
Speech Emotion Classification from Affective Dimensions: Limitation and Advantage
Shamsi, M. (2023) · International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW) · doi:10.1109/aciiw59127.2023.10388084 · Cited by 2
A Comprehensive Exploration of Fine-Tuning WavLM for Enhancing Speech Emotion Recognition
Ali, F. M., Arymurthy, A. M., & Prasojo, R. E. (2023) · International Seminar on Research of Information Technology and Intelligent Systems (ISRITI) · doi:10.1109/isriti60336.2023.10467733 · Cited by 4
Lesyk, E., Arias‐Vergara, T., Nöth, E., Maier, A., Orozco‐Arroyave, J. R., & Pérez-Toro, P. A. (2024) · Human-Centric Intelligent Systems · doi:10.1007/s44230-024-00088-w · Cited by 4
A Time-Distributed CNN-LSTM with Attention Model for Speech Based Emotion Recognition
Deshpande, K., Sodhi, M. S., Raniyer, N., & Rao, M. (2024) · International Conference on Digital Medicine and Image Processing (DMIP) · doi:10.1145/3705927.3705939 · Cited by 2
Domain-Specific Adaptation in Speech Emotion Recognition Using Emotional Distribution Alignment
Naini, A. R., Robinson, D., Richerson, E., & Busso, C. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890089 · Cited by 2
Phukan, O. C., Akhtar, M. M., Girish, Behera, S. R., Kalita, S., Buduru, A. B., Sharma, R., & Prasanna, S. R. M. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889257 · Cited by 2
Mena, C. D. H., Padilla-Ortíz, A. L., & Orduña-Bustamante, F. (2025) · Computer Speech & Language · doi:10.1016/j.csl.2025.101856 · Cited by 3
Shi, Q. (2025) · International Journal of High Speed Electronics and Systems · doi:10.1142/s0129156425408253 · Cited by 3
Liang, B., Ma, C., & Lei, M. (2025) · Frontiers in Physiology · doi:10.3389/fphys.2025.1612900 · Cited by 5
Gupta, M., & Vishwakarma, V. (2025) · International Conference on Electronics and Sustainable Communication Systems (ICESC) · doi:10.1109/icesc65114.2025.11212452 · Cited by 2
Speech emotion recognition: A systematic mega-review of techniques and pipelines
Chakhtouna, A., Sekkate, S., & Adib, A. (2026) · Information Fusion · doi:10.1016/j.inffus.2026.104161 · Cited by 6
Multi-scale local-global fusion network with temporal attention for speech emotion recognition
Ma, W., & Jin, N. (2026) · Neural Computing and Applications · doi:10.1007/s00521-026-12157-1 · Cited by 2
Driver Speech Detection in Real Driving Scenario
Bhattacharjee, M., Baghel, S., & Prasanna, S. R. M. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-48309-7_16 · Cited by 2
Chou, H.-C. (2024) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc63619.2025.10848651 · Cited by 2
Emotion information recovery potential of wav2vec2 network fine-tuned for speech recognition task
Purohit, T., & Magimai.-Doss, M. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890800 · Cited by 2
Semi-Supervised Learning for Multimodal Speech and Emotion Recognition
Li, Y. (2021) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3462244.3481274 · Cited by 3
Vaiani, L., Koudounas, A., Quatra, M. L., Cagliero, L., Garza, P., & Baralis, E. (2022) · doi:10.1145/3551876.3554801 · Cited by 5
An emotion recognition system: bridging the gap between humans-machines interaction
Nouman, A., Iqbal, H., & Saleem, M. K. (2023) · IAES International Journal of Robotics and Automation (IJRA) · doi:10.11591/ijra.v12i4.pp315-324 · Cited by 2
Fine-tuning the Wav2Vec2 Model for Automatic Speech Emotion Recognition System
Kayande, D. D., Sonowal, I. B., & Bhukya, R. K. (2023) · International Conference on Speech Database and Assessments · doi:10.1109/o-cocosda60357.2023.10482992 · Cited by 6
Ghaleb, E., Khaertdinov, B., Pouw, W. T. J. L., Rasenberg, M., Holler, J., Özyürek, A., & Fernández, R. (2024) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3678957.3685707 · Cited by 3
Hybrid Contrastive Learning Decoupling Speech Emotion Recognition
Li, C., Gu, Y., Zhang, H., Liu, L., Lin, H. X., & Wang, S. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889881 · Cited by 3
Healthcall Corpus and Transformer Embeddings from Healthcare Customer-Agent Conversations
Lackovic, N., Montacié, C., Lequilliec, C., & Caraty, M.-J. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096196 · Cited by 2
Guo, T., Li, S., Kidani, S., Okada, S., & Unoki, M. (2023) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc58517.2023.10317449 · Cited by 1
Complex Feature Information Enhanced Speech Emotion Recognition
Yue, P., Zheng, S., & Li, T. (2023) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc58517.2023.10317348 · Cited by 1
Enhancing Arabic Speech Emotion Recognition with Deep Learning
Hassanain, M., Shehata, N., Mohamed, A. S. A., Hammad, M., Alqasaby, S., & Zaky, A. B. (2024) · International Japan-Africa Conference on Electronics, Communications, and Computations (JAC-ECC) · doi:10.1109/jac-ecc64419.2024.11061247 · Cited by 1
Ren, J., Cai, X., Ye, M., & Luo, H. Y. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-9894-3_15 · Cited by 1
Unified Acoustic Representation Learning for Vietnamese Speech Classification Tasks
Ha, X.-T., Nguyen, V., Do, T.-N., Phan, T.-K., & Mạc, Đ.-K. (2025) · International Conference on Multimedia Analysis and Pattern Recognition (MAPR) · doi:10.1109/mapr67746.2025.11133876 · Cited by 1
Jiang, C.-S., Liu, Z., Fukushima, E. F., & She, J. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3620303 · Cited by 2
Harnessing Multimodal Unlabeled Data for Enhanced Speech Emotion Recognition
Goncalves, L., & Busso, C. (2025) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2025.3647876 · Cited by 1
Optimizing Speech Emotion Recognition with Attention-Driven Deep CRNN
Popescu, V.-D., & Giurgiu, M. (2025) · Telecommunications Forum (TELFOR) · doi:10.1109/telfor67910.2025.11314307 · Cited by 1
MuLER: Multiplet-Loss for Emotion Recognition
Slimi, A., Zrigui, M., & Nicolas, H. (2022) · International Conference on Multimedia Retrieval · doi:10.1145/3512527.3531406 · Cited by 2
Wav2pos: Exploring syntactic analysis from audio for Highland Puebla Nahuatl
Pugh, R., P.Sreedhar, V. S., & Tyers, F. M. (2024) · Workshop on Natural Language Processing for Indigenous Languages of the Americas (AmericasNLP) · doi:10.18653/v1/2024.americasnlp-1.13 · Cited by 1
(2025) · International journal of intelligent engineering and systems · doi:10.22266/ijies2025.0531.50 · Cited by 1
Mathematical modeling of the interaction between endocrine systems and EEG signals
Liu, W. (2025) · Frontiers in Endocrinology · doi:10.3389/fendo.2025.1543185 · Cited by 1
Research on Cross-Platform Data Fusion and Intelligent Analysis Methods for Online Communication
Yuzhao, Z. (2025) · International Journal of High Speed Electronics and Systems · doi:10.1142/s0129156425408769 · Cited by 1
Neonatal Pain Speech Emotion Recognition Based on Multiscale Multilevel MAE Network
Yan, J., Sun, W., Sun, B., Zhou, X., Lu, G., Li, X., & Zheng, X. (2025) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2025.3625592 · Cited by 3
Phukan, O. C., Akhtar, M. M., Girish, Behera, S. R., Bhagath, P., Reddy, P. B., & Buduru, A. B. (2025) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc65261.2025.11249312 · Cited by 1
Designing Emotionally Safe Learning Spaces Using Audio Intelligence for Inclusive Education
Banda, L. G., Tanmayee, H. N., & Jaiswal, R. R. (2026) · European Journal of Educational Research · doi:10.12973/eu-jer.15.2.513 · Cited by 4
Onyekwelu-Udoka, L., Islam, M. S., & Hasan, M. S. (2025) · IEEE International Conference on Computing, Applications and Systems (COMPAS) · doi:10.1109/compas67506.2025.11381853 · Cited by 4
Mallarapu, S., Liu, X., Zargarian, P., Mottaghian, S., Suresha, R., Jain, V., & Bayat, A. (2026) · Computers · doi:10.3390/computers15030161 · Cited by 3
Chen, S.-J., & Hansen, J. H. L. (2026) · Speech Communication · doi:10.1016/j.specom.2026.103380 · Cited by 1
George, S. M., & Ilyas, P. M. (2026) · Multimedia Tools and Applications · doi:10.1007/s11042-026-21508-y · Cited by 1
Kravchuk, D. А., & Kotenko, A. S. (2026) · Proceedings of the Southwest State University Series IT Management Computer Science Computer Engineering Medical Equipment Engineering · doi:10.21869/2223-1536-2026-16-1-93-106 · Cited by 1
Measuring Cognitive Load Index in Online Learning: A Multi‐Modal Approach
Rahimi, F., Sadeghi-Niaraki, A., Hussain, J., Song, H., Wang, H., & Choi, S.-M. (2026) · Journal of Computer Assisted Learning · doi:10.1002/jcal.70252 · Cited by 1
Sousa, P., Lima, R. C., García-Segovia, P., Alcañíz, M., & Cunha, L. M. (2026) · Food Research International · doi:10.1016/j.foodres.2026.119483 · Cited by 1
Tyagi, S., & Szénási, S. (2026) · Algorithms · doi:10.3390/a19050416 · Cited by 1
Luo, Z., Xu, H., & Wu, S. (2026) · Electronics · doi:10.3390/electronics15112313 · Cited by 2
Real-Time Speech Emotion Recognition with a CNN-BiLSTM-Attention Deep Learning Model
Zennou, H., Ouadad, R., Ouhda, M., & Baslam, M. (2026) · Engineering Technology & Applied Science Research · doi:10.48084/etasr.17495 · Cited by 1
TURK-SER: A Speech Emotion Recognition Dataset and Benchmark for Turkish
Eriş, M., Eriş, F. G., & Akbal, E. (2026) · International Journal of Innovative Engineering Applications · doi:10.46460/ijiea.1887612 · Cited by 1
A Speech Emotion Recognition Model Combining WavLM Pre-Trained Features and Attention Mechanism
Huang, X. S., Wang, Y., Huang, H. G., Zhou, C., Zhou, X., & Chen, Y. (2026) · Electronics · doi:10.3390/electronics15132855 · Cited by 2
Lee, E., Kim, S., Im, S., Oh, H., & Kang, S. (2026) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3831648 · Cited by 1
A Hierarchical Regression Chain Framework for Affective Vocal Burst Recognition
Li, J., Wu, X., Song, K., Li, D., Liu, X., & Meng, H. M. L. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096395 · Cited by 1
Speech Emotion Recognition Using Dual Global Context Attention and Time-Frequency Features
Zhang, P., Bai, X., Zhao, J., Liang, Y., Wang, F., & Wu, X.-M. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10192031 · Cited by 2
A physical exertion inspired multi-task learning framework for detecting out-of-breath speech
Sahoo, S., & Dandapat, S. (2023) · Computer Speech & Language · doi:10.1016/j.csl.2023.101556 · Cited by 1
Feng, T., Bose, D., Shi, X., & Narayanan, S. S. (2023) · Symposium on Security and Privacy in Speech Communication (SPSC) · doi:10.21437/spsc.2023-2 · Cited by 1
Bilingual ASR model with language identification for Brazilian Portuguese and South-American Spanish
Farias, F., Castañeda, W. A. C., Lobato, W., & Amadeus, M. (2023) · Anais de XXXV Simpósio Brasileiro de Telecomunicações e Processamento de Sinais · doi:10.14209/sbrt.2023.1570916069 · Cited by 1
Few Shot Learning Guided by Emotion Distance for Cross-corpus Speech Emotion Recognition
Yue, P., Wu, Y., Qu, L., Zheng, S., Zhao, S., & Li, T. (2023) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc58517.2023.10317289 · Cited by 1
Speech Emotion Recognition Using Multi-Modal Feature Fusion Network
Li, F., Luo, J., & Liu, W. (2023) · International Conference on Pattern Recognition and Artificial Intelligence (PRAI) · doi:10.1109/prai59366.2023.10332053 · Cited by 2
Shu, N., Wang, Y., Caulley, D., & Anderson, D. V. (2024) · IEEE International Conference on Edge Computing and Communications (EDGE) · doi:10.1109/edge62653.2024.00028 · Cited by 1
Transfer Learning of Large Speech Models for Italian Speech Emotion Recognition
D’Asaro, F., Villacís, J. J. M., & Rizzo, G. F. (2024) · IEEE International Conference on Application of Information and Communication Technologies (AICT) · doi:10.1109/aict61888.2024.10740425 · Cited by 3
Investigating the Utility of wav2vec 2.0 Hidden Layers for Detecting Multiple Sclerosis
Gosztolya, G., Tóth, L., Svindt, V., Bóna, J., & Hoffmann, I. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-77961-9_22 · Cited by 1
Takahashi, K., Wakabayashi, Y., Ohta, K., Kobayashi, A., & Kitaoka, N. (2024) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc63619.2025.10849215 · Cited by 1
Parameter-Efficient Federal-Tuning Enhances Privacy Preserving for Speech Emotion Recognition
Chen, H., Zhao, H., Gao, Y., Liu, Y., & Zhang, Z. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890565 · Cited by 1
Chen, L., Lou, H., Yue, P., & Chen, J. (2025) · IEEE Access · doi:10.1109/access.2025.3571711 · Cited by 2
Lux, F., Chen, C., & Vu, N. T. (2023) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt54892.2023.10022897 · Cited by 2
A multimodal dynamical variational autoencoder for audiovisual speech representation learningPreprint
Sadok, S., Leglaive, S., Girin, L., Alameda-Pineda, X., & Séguier, R. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.03582 · Cited by 1
Catania, F. (2023) · doi:10.36227/techrxiv.22821992 · Cited by 2
Audiovisual speech representation learning applied to emotion recognition
Sadok, S. (2024) · theses.fr (ABES) · doi:10.70675/0f15a36fzecf8z4cffz94e7z120e7d8fd39d · Cited by 4
Audio Embeddings Help to Learn Better Dialogue Policies
Zorrilla, A. L., Torres, M. I., & Cuayáhuitl, H. (2021) · Lincoln Repository (University of Lincoln) · doi:10.1109/asru51503.2021.9688296 · Cited by 3
Multi-modal Korean Emotion Recognition with Consistency Regularization
Kim, J., & Kang, P. (2021) · Journal of Korean Institute of Industrial Engineers · doi:10.7232/jkiie.2021.47.6.549
Emotion Recognition using Nonverbal Cues
Lavanya, D. V. J., Bhargavi, V., Priya, G. M., & Mande, R. (2022) · International Conference on Inventive Computation Technologies (ICICT) · doi:10.1109/icict54344.2022.9850533
Speech Emotion Recognition in Italian Using Wav2Vec 2Preprint
Catania, F. (2023) · doi:10.36227/techrxiv.22821992.v1 · Cited by 13
Specialized Semantic Enrichment of Speech Representations
Laperrière, G., Nguyen, H. H., Ghannay, S., Jabaian, B., & Estève, Y. (2023) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw59220.2023.10193452
Semantic Enrichment Towards Efficient Speech Representations
Laperrière, G., Nguyen, H. H., Ghannay, S., Jabaian, B., & Estève, Y. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-2234
Identifying Subjects Wearing a Mask from the Speech by Means of Encoded Speech Representations
Egas-López, J. V., & Gosztolya, G. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-40498-6_12
Investigational breakthrough of speech emotion recognition
Thirunavukkarasu, H., & Devadoss, A. K. V. (2023) · AIP conference proceedings · doi:10.1063/5.0153475
Design of Intelligent models for Multimodal Socio-Affective Computing
Luna-Jiménez, C. (2023) · UPM Digital Archive (Technical University of Madrid) · doi:10.20868/upm.thesis.74338
Apparent personality prediction from speech using expert features and wav2vec 2.0
Barchi, R. G., Pepino, L., Gauder, L., Estienne, L., Meza, M., Riera, P., & Ferrer, L. (2023) · Workshop on Speech, Music and Mind (SMM) · doi:10.21437/smm.2023-5 · Cited by 2
Self-citationAudio Based Facial Expression Generation On Ar Applications
Shah, S., Shah, D. D., Shah, Y., Dedhia, M., & Shekokar, N. M. (2023) · International Conference on Computing, Communication and Networking Technologies (ICCCNT) · doi:10.1109/icccnt56998.2023.10306892
Emotion Recognition Based on Wasserstein Distance Fusion of Audiovisual Features
Ai, N., Zhang, S., Yi, N., & Ma, Z. (2023) · International Conference on Robotics, Control and Automation Engineering (RCAE) · doi:10.1109/rcae59706.2023.10398807
Pengolahan Korpus Dataset Audio Bacaan Al-Qur’an Menggunakan Metode Wav2Vec 2.0
Aminudin, A., Nuryasin, I., Amien, S., Wicaksono, G. W., Chandranegara, D. R., Thoifah, I., Rizky, W., Ferdiansyah, D., Azzahra, K., Lathifah, F., et al. (2024) · Jurnal Edukasi dan Penelitian Informatika (JEPIN) · doi:10.26418/jp.v10i1.71576
Alqurashi, N., Li, Y., & Sidorov, K. A. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650087
Metadata
- Authors
- Pepino, L., Riera, P., & Ferrer, L.
- Affiliations
- Universidad de Buenos Aires (AR)
- Consejo Nacional de Investigaciones Científicas y Técnicas (AR)
- Venue
- Interspeech 2021
- Publisher
- ISCA
- Published
- 2021-08-30
- Pages
- 3400-3404
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W3144073776
- Cited by
- 389
- References
- 37
- Citations by year
- 2026: 78 · 2025: 80 · 2024: 74 · 2023: 100 · 2022: 48 · 2021: 9
- FWCI
- 64.26
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- cc-by
- Locations
- Interspeech (USB) (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Keywords
- speech emotion recognition, wav2vec 2.0, transfer learning, fine-tuning, IEMOCAP, RAVDESS
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.