The DOI matches its Crossref record; 165 of the 165 references it cites were found in a registry or an index.
Speech emotion recognition: Emotional models, databases, features, preprocessing methods, supporting modalities, and classifiers
Abstract
Abstract Speech is the most natural way of expressing ourselves as humans. It is only natural then to extend this communication medium to computer applications. We define speech emotion recognition (SER) systems as a collection of methodologies that process and classify speech signals to detect the embedded emotions. SER is not a new field, it has been around for over two decades, and has regained attention thanks to the recent advancements. These novel studies make use of the advances in all fields of computing and technology, making it necessary to have an update on the current methodologies and techniques that make SER possible. We have identified and discussed distinct areas of SER, provided a detailed survey of current literature of each, and also listed the current challenges.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Development and validation of brief measures of positive and negative affect: The PANAS scales.
Watson, D., Clark, L. A., & Tellegen, A. (1988) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.54.6.1063 · Cited by 32,433
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Caruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636
A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.52 · Cited by 2,797
Emotion recognition in human-computer interaction
Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kollias, S., Fellenz, W., & Taylor, J. G. (2001) · IEEE Signal Processing Magazine · doi:10.1109/79.911197 · Cited by 2,603
A database of German emotional speech
Burkhardt, F., Paeschke, A., Rolfes, M., Sendlmeier, W. F., & Weiss, B. (2005) · Interspeech 2005 · doi:10.21437/interspeech.2005-446 · Cited by 2,365
Universals and cultural differences in facial expressions of emotion.
Ekman, P. (1972) · Medical Entomology and Zoology · Cited by 2,273
Nebraska Symposium on Motivation, 1969.
Schwartz, S., Arnold, W. J., & Levine, D. (1971) · American Sociological Review · doi:10.2307/2093748 · Cited by 2,171
Survey on speech emotion recognition: Features, classification schemes, and databases
El Ayadi, M., Kamel, M. S., & Karray, F. (2011) · Pattern Recognition · doi:10.1016/j.patcog.2010.09.020 · Cited by 2,073
Evidence for a three-factor theory of emotions
Russell, J. A., & Mehrabian, A. (1977) · Journal of Research in Personality · doi:10.1016/0092-6566(77)90037-x · Cited by 1,940
Vocal affect expression: A review and a model for future research.
Scherer, K. R. (1986) · Psychological Bulletin · doi:10.1037//0033-2909.99.2.143 · Cited by 1,767
Plutchik, R. (2001) · American Scientist · doi:10.1511/2001.4.344 · Cited by 1,419
Emotion in the Human Face: Guidelines for Research and an Integration of Findings
Ekman, P., Friesen, W. V., & Ellsworth, P. C. (1972) · Cited by 1,279
Ekman, P., & Oster, H. (1979) · Annual Review of Psychology · doi:10.1146/annurev.ps.30.020179.002523 · Cited by 1,178
On a simple algorithm to calculate the 'energy' of a signal
Kaiser, J. F. (2002) · International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1990.115702 · Cited by 1,173
Murray, I. R., & Arnott, J. L. (1993) · The Journal of the Acoustical Society of America · doi:10.1121/1.405558 · Cited by 1,098
Speech emotion recognition using deep 1D & 2D CNN LSTM networks
Zhao, J., Mao, X., & Chen, L. (2019) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2018.08.035 · Cited by 1,044
Emotional speech recognition: Resources, features, and methods
Ververidis, D., & Kotropoulos, C. (2006) · Speech Communication · doi:10.1016/j.specom.2006.04.003 · Cited by 925
Speech emotion recognition using hidden Markov models
Nwe, T. L., Foo, S. W., & De Silva, L. C. (2003) · Speech Communication · doi:10.1016/s0167-6393(03)00099-2 · Cited by 920
Adieu features? End-to-end speech emotion recognition using a deep convolutional recurrent network
Trigeorgis, G., Ringeval, F., Brueckner, R., Marchi, E., Nicolaou, M. A., Schuller, B., & Zafeiriou, S. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7472669 · Cited by 904
Analysis of emotion recognition using facial expressions, speech and multimodal information
Busso, C., Deng, Z., Yildirim, S., Bulut, M., Lee, C. M., Kazemzadeh, A., Lee, S., Neumann, U., & Narayanan, S. (2004) · Proceedings of the 6th international conference on Multimodal interfaces · doi:10.1145/1027933.1027968 · Cited by 840
Speech emotion recognition using deep neural network and extreme learning machine
Han, K., Yu, D., & Tashev, I. (2014) · Interspeech 2014 · doi:10.21437/interspeech.2014-57 · Cited by 794
Toward an affect-sensitive multimodal human-computer interaction
Pantic, M., & Rothkrantz, L. J. M. (2003) · Proceedings of the IEEE · doi:10.1109/jproc.2003.817122 · Cited by 791
The role of voice quality in communicating emotion, mood and attitude
Gobl, C. (2003) · Speech Communication · doi:10.1016/s0167-6393(02)00082-1 · Cited by 787
Introducing the RECOLA multimodal corpus of remote collaborative and affective interactions
Ringeval, F., Sonderegger, A., Sauer, J., & Lalanne, D. (2013) · 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2013.6553805 · Cited by 771
Automatic speech emotion recognition using recurrent neural networks with local attention
Mirsamadi, S., Barsoum, E., & Zhang, C. (2017) · 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2017.7952552 · Cited by 770
End-to-End Multimodal Emotion Recognition using Deep Neural Networks
Tzirakis, P., Trigeorgis, G., Nicolaou, M. A., Schuller, B., & Zafeiriou, S. (2017) · arXiv · doi:10.48550/arxiv.1704.08619 · Cited by 752
McKeown, G., Valstar, M., Cowie, R., Pantic, M., & Schroder, M. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.20 · Cited by 665
Emotion recognition from speech: a review
Koolagudi, S. G., & Rao, K. S. (2012) · International Journal of Speech Technology · doi:10.1007/s10772-011-9125-1 · Cited by 641
Proceedings of the 25th ACM international conference on Multimedia
(2017) · doi:10.1145/3123266 · Cited by 618
The eNTERFACE’05 Audio-Visual Emotion Database
Martin, O., Kotsia, I., Macq, B., & Pitas, I. (2006) · 22nd International Conference on Data Engineering Workshops (ICDEW'06) · doi:10.1109/icdew.2006.145 · Cited by 615
Hidden Markov model-based speech emotion recognition
Schuller, B., Rigoll, G., & Lang, M. (2003) · 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698) · doi:10.1109/icme.2003.1220939 · Cited by 570
Mao, Q., Dong, M., Huang, Z., & Zhan, Y. (2014) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2014.2360798 · Cited by 568
Speech emotion recognition: two decades in a nutshell, benchmarks, and ongoing trends
Schuller, B. W. (2018) · Communications of the ACM · doi:10.1145/3129340 · Cited by 541
3-D Convolutional Recurrent Neural Networks With Attention Model for Speech Emotion Recognition
Chen, M., He, X., Yang, J., & Zhang, H. (2018) · IEEE Signal Processing Letters · doi:10.1109/lsp.2018.2860246 · Cited by 503
Communicating emotion: The role of prosodic features.
Frick, R. W. (1985) · Psychological Bulletin · doi:10.1037//0033-2909.97.3.412 · Cited by 464
Nicolaou, M. A., Gunes, H., & Pantic, M. (2011) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.9 · Cited by 450
Features and classifiers for emotion recognition from speech: a survey from 2000 to 2011
Anagnostopoulos, C.-N., Iliou, T., & Giannoukos, I. (2015) · Artificial Intelligence Review · doi:10.1007/s10462-012-9368-5 · Cited by 428
Schuller, B., Rigoll, G., & Lang, M. (2004) · 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.2004.1326051 · Cited by 426
Nonlinear feature based classification of speech under stress.
Zhou, G., Hansen, J. H. L., & Kaiser, J. F. (2001) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.905995 · Cited by 409
Speech Emotion Recognition Using Fourier Parameters
Wang, K., An, N., Li, B. N., Zhang, Y., & Li, L. (2015) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2015.2392101 · Cited by 408
The Vera am Mittag German audio-visual emotional speech database
Grimm, M., Kroschel, K., & Narayanan, S. (2008) · 2008 IEEE International Conference on Multimedia and Expo · doi:10.1109/icme.2008.4607572 · Cited by 407
Speech emotion recognition using convolutional and Recurrent Neural Networks
Lim, W., Jang, D., & Lee, T. (2016) · 2016 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA) · doi:10.1109/apsipa.2016.7820699 · Cited by 405
Automatic speech emotion recognition using modulation spectral features
Wu, S., Falk, T. H., & Chan, W.-Y. (2011) · Speech Communication · doi:10.1016/j.specom.2010.08.013 · Cited by 389
High-level feature representation using recurrent neural network for speech emotion recognition
Lee, J., & Tashev, I. (2015) · Interspeech 2015 · doi:10.21437/interspeech.2015-336 · Cited by 388
2008 IEEE International Conference on Multimedia and Expo
(2008) · doi:10.1109/icme13235.2008 · Cited by 386
Sparse Autoencoder-Based Feature Transfer Learning for Speech Emotion Recognition
Deng, J., Zhang, Z., Marchi, E., & Schuller, B. (2013) · 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction · doi:10.1109/acii.2013.90 · Cited by 366
Emotion recognition by speech signals
Kwon, O.-W., Chan, K., Hao, J., & Lee, T.-W. (2003) · 8th European Conference on Speech Communication and Technology (Eurospeech 2003) · doi:10.21437/eurospeech.2003-80 · Cited by 366
Vocal Expression and Perception of Emotion
Bachorowski, J.-A. (1999) · Current Directions in Psychological Science · doi:10.1111/1467-8721.00013 · Cited by 363
Emotion recognition using a hierarchical binary decision tree approach
Lee, C.-C., Mower, E., Busso, C., Lee, S., & Narayanan, S. (2011) · Speech Communication · doi:10.1016/j.specom.2011.06.004 · Cited by 355
Some useful properties of Teager's energy operators
Kaiser, J. F. (1993) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1993.319457 · Cited by 346
Emotion Recognition in Speech Using Neural Networks
Nicholson, J., Takahashi, K., & Nakatsu, R. (2000) · Neural Computing & Applications · doi:10.1007/s005210070006 · Cited by 344
EMOTION RECOGNITION BY SPEECH SIGNAL
Kwon, O., Chan, K.-H., & Hao, J. (2003) · Interspeech (USB) · Cited by 338
Wöllmer, M., Eyben, F., Reiter, S., Schuller, B., Cox, C., Douglas-Cowie, E., & Cowie, R. (2008) · Interspeech 2008 · doi:10.21437/interspeech.2008-192 · Cited by 328
Evidence for Nonlinear Sound Production Mechanisms in the Vocal Tract
Teager, H. M., & Teager, S. M. (1990) · Speech Production and Speech Modelling · doi:10.1007/978-94-009-2037-8_10 · Cited by 326
Getting started with SUSAS: a speech under simulated and actual stress database
Hansen, J. H. L., & Bou-Ghazale, S. E. (1997) · 5th European Conference on Speech Communication and Technology (Eurospeech 1997) · doi:10.21437/eurospeech.1997-494 · Cited by 302
Primitives-based evaluation and estimation of emotions in speech
Grimm, M., Kroschel, K., Mower, E., & Narayanan, S. (2007) · Speech Communication · doi:10.1016/j.specom.2007.01.010 · Cited by 291
Analysis of Emotionally Salient Aspects of Fundamental Frequency for Emotion Detection
Busso, C., Lee, S., & Narayanan, S. (2009) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2008.2009578 · Cited by 278
EMOTION IN SPEECH: RECOGNITION AND APPLICATION TO CALL CENTERS
Petrushin, V. A. (1999) · Cited by 276
Autoencoder-based Unsupervised Domain Adaptation for Speech Emotion Recognition
Deng, J., Zhang, Z., Eyben, F., & Schuller, B. (2014) · IEEE Signal Processing Letters · doi:10.1109/lsp.2014.2324759 · Cited by 270
Wu, C.-H., & Liang, W.-B. (2011) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2010.16 · Cited by 266
Speech emotion recognition based on HMM and SVM
Lin, Y.-L., & Wei, G. (2005) · 2005 International Conference on Machine Learning and Cybernetics · doi:10.1109/icmlc.2005.1527805 · Cited by 260
Emotion detection from text and speech: a survey
Sailunaz, K., Dhaliwal, M., Rokne, J., & Alhajj, R. (2018) · Social Network Analysis and Mining · doi:10.1007/s13278-018-0505-2 · Cited by 260
Speech production and speech modelling
Gabbouj, M. (1991) · Signal Processing · doi:10.1016/0165-1684(91)90075-t · Cited by 257
Detection of Clinical Depression in Adolescents’ Speech During Family Interactions
Low, L.-S. A., Maddage, M. C., Lech, M., Sheeber, L. B., & Allen, N. B. (2011) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2010.2091640 · Cited by 256
Emotion recognition in spontaneous speech using GMMs
Neiberg, D., Elenius, K., & Laskowski, K. (2006) · Interspeech 2006 · doi:10.21437/interspeech.2006-277 · Cited by 247
AFEW-VA database for valence and arousal estimation in-the-wild
Kossaifi, J., Tzimiropoulos, G., Todorovic, S., & Pantic, M. (2017) · Image and Vision Computing · doi:10.1016/j.imavis.2017.02.001 · Cited by 236
Speech emotion recognition using hidden Markov models
Nogueiras, A., Moreno, A., Bonafonte, A., & Mariño, J. B. (2001) · 7th European Conference on Speech Communication and Technology (Eurospeech 2001) · doi:10.21437/eurospeech.2001-627 · Cited by 232
Class-level spectral features for emotion recognition
Bitouk, D., Verma, R., & Nenkova, A. (2010) · Speech Communication · doi:10.1016/j.specom.2010.02.010 · Cited by 219
Acoustics, Speech and Signal Processing (ICASSP), 2015 IEEE International Conference on
Wu, Z., Valentini-Botinhao, C., Watts, O., & King, S. (2015) · Cited by 218
BAUM-1: A Spontaneous Audio-Visual Face Database of Affective and Mental States
Zhalehpour, S., Onder, O., Akhtar, Z., & Erdem, C. E. (2017) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2016.2553038 · Cited by 216
Speech Emotion Recognition Using Support Vector Machine
Pan, Y., Shen, P., & Shen, L. (2012) · Cited by 211
Acoustic feature selection for automatic emotion recognition from speech
Rong, J., Li, G., & Chen, Y.-P. P. (2009) · Information Processing & Management · doi:10.1016/j.ipm.2008.09.003 · Cited by 210
Emotion Recognition Based on Joint Visual and Audio Cues
Sebe, N., Cohen, I., Gevers, T., & Huang, T. S. (2006) · 18th International Conference on Pattern Recognition (ICPR'06) · doi:10.1109/icpr.2006.489 · Cited by 202
EMOVO Corpus: an Italian Emotional Speech Database
Costantini, G., Iaderola, I., Paoloni, A., & Todisco, M. (2014) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/4i4sxkp59t9f · Cited by 199
GMM Supervector Based SVM with Spectral Features for Speech Emotion Recognition
Hu, H., Xu, M.-X., & Wu, W. (2007) · 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07 · doi:10.1109/icassp.2007.366937 · Cited by 198
Schuller, B., Müller, R., Eyben, F., Gast, J., Hörnler, B., Wöllmer, M., Rigoll, G., Höthker, A., & Konosu, H. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2009.02.013 · Cited by 194
Emotion recognition from speech using global and local prosodic features
Rao, K. S., Koolagudi, S. G., & Vempada, R. R. (2013) · International Journal of Speech Technology · doi:10.1007/s10772-012-9172-2 · Cited by 184
Automatic Speech Emotion Recognition using Support Vector Machine
Shen, P., Changjun, Z., & Chen, X. (2011) · Proceedings of 2011 International Conference on Electronic & Mechanical Engineering and Information Technology · doi:10.1109/emeit.2011.6023178 · Cited by 184
Multimodal human emotion/expression recognition
Chen, L. S., Huang, T. S., Miyasato, T., & Nakatsu, R. (2002) · Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.1998.670976 · Cited by 183
Stress and Emotion Classification using Jitter and Shimmer Features
Li, X., Tao, J., Johnson, M. T., Soltis, J. M., Savage, A., Leong, K. M., & Newman, J. D. (2007) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2007.367261 · Cited by 180
An Attention Pooling Based Representation Learning Method for Speech Emotion Recognition
Li, P., Song, Y., McLoughlin, I., Guo, W., & Dai, L. (2018) · Interspeech 2018 · doi:10.21437/interspeech.2018-1242 · Cited by 179
Domain Adversarial for Acoustic Emotion Recognition
Abdelwahab, M., & Busso, C. (2018) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2018.2867099 · Cited by 178
Bimodal Emotion Recognition using Speech and Physiological Changes
Kim, J. (2007) · doi:10.5772/4754 · Cited by 168
Wollmer, M., Schuller, B., Eyben, F., & Rigoll, G. (2010) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2010.2057200 · Cited by 165
Semisupervised Autoencoders for Speech Emotion Recognition
Deng, J., Xu, X., Zhang, Z., Frühholz, S., & Schuller, B. W. (2017) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2017.2759338 · Cited by 164
Voiced/Unvoiced Decision for Speech Signals Based on Zero-Crossing Rate and Energy
Bachu, R. G., Kopparthi, S., Adapa, B., & Barkana, B. D. (2010) · Advanced Techniques in Computing Sciences and Software Engineering · doi:10.1007/978-90-481-3660-5_47 · Cited by 162
Emotion recognition from speech signals using new harmony features
Yang, B., & Lugger, M. (2010) · Signal Processing · doi:10.1016/j.sigpro.2009.09.009 · Cited by 161
Transfer Learning for Improving Speech Emotion Classification Accuracy
Latif, S., Rana, R. K., Younis, M. S., Qadir, J., & Epps, J. (2018) · Interspeech (USB) · doi:10.21437/interspeech.2018-1625 · Cited by 153
Eyben, F., Wöllmer, M., Graves, A., Schuller, B. W., Douglas‐Cowie, E., & Cowie, R. (2009) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-009-0032-6 · Cited by 152
Speaker Independent Speech Emotion Recognition by Ensemble Classification
Schuller, B. W., Reiter, S. A., Müller, R., Al-Hames, M., Lang, M., & Rigoll, G. (2005) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2005.1521560 · Cited by 149
Automatic statistical analysis of the signal and prosodic signs of emotion in speech
Cowie, R., & Douglas‐Cowie, E. (1996) · International Conference on Spoken Language Processing (ICSLP) · doi:10.1109/icslp.1996.608027 · Cited by 147
Audio–Visual Affective Expression Recognition Through Multistream Fused HMM
Zeng, Z., Tu, J., Pianfetti, B., & Huang, T. S. (2008) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2008.921737 · Cited by 145
Automatic emotion recognition using prosodic parameters
Luengo, I., Navas, E., Hernáez, I., & Sánchez, J. (2005) · Interspeech (USB) · doi:10.21437/interspeech.2005-324 · Cited by 144
The Relevance of Voice Quality Features in Speaker Independent Emotion Recognition
Lugger, M., & Yang, B. (2007) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2007.367152 · Cited by 144
Jointly Predicting Arousal, Valence and Dominance with Multi-Task Learning
Parthasarathy, S., & Busso, C. (2017) · Interspeech (USB) · doi:10.21437/interspeech.2017-1494 · Cited by 142
Schuller, B. W., Müller, R., Lang, M. K., & Rigoll, G. (2005) · Interspeech (USB) · doi:10.21437/interspeech.2005-379 · Cited by 141
Spoken emotion recognition using hierarchical classifiers
Albornoz, E. M., Milone, D. H., & Rufiner, H. L. (2010) · Computer Speech & Language · doi:10.1016/j.csl.2010.10.001 · Cited by 140
AVEC 2016 - Depression, Mood, and Emotion Recognition Workshop and ChallengePreprint
Valstar, M., Gratch, J. S., Schuller, B. W., Ringeval, F., Lalanne, D., Torres, M. T., Scherer, S. J., Stratou, G., Cowie, R., & Pantić, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.01600 · Cited by 133
CHEAVD: a Chinese natural emotional audio–visual database
Li, Y., Tao, J., Chao, L., Bao, W., & Liu, Y. (2016) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-016-0406-z · Cited by 131
Design, recording and verification of a danish emotional speech database
Engberg, I. S., Hansen, A. V., Andersen, O., & Dalsgaard, P. (1997) · European Conference on Speech Communication and Technology (Eurospeech) · doi:10.21437/eurospeech.1997-482 · Cited by 130
Huang, C.-W., & Narayanan, S. S. (2017) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2017.8019296 · Cited by 130
Progressive Neural Networks for Transfer Learning in Emotion Recognition
Gideon, J., Khorram, S., Aldeneh, Z., Dimitriadis, D., & Provost, E. M. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-1637 · Cited by 129
Emotion Recognition using Mel-Frequency Cepstral Coefficients
Sato, N., & Obuchi, Y. (2007) · Journal of Natural Language Processing · doi:10.5715/jnlp.14.4_83 · Cited by 124
Unsupervised learning in cross-corpus acoustic emotion recognition
Zhang, Z., Weninger, F. J., Wöllmer, M., & Schuller, B. W. (2011) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2011.6163986 · Cited by 123
Variational Autoencoders for Learning Latent Representations of Speech Emotion: A Preliminary Study
Latif, S., Rana, R. K., Qadir, J., & Epps, J. (2018) · Interspeech (USB) · doi:10.21437/interspeech.2018-1568 · Cited by 122
Error weighted semi-coupled hidden Markov model for audio-visual emotion recognition
Lin, J.-C., Wu, C.-H., & Wei, W.-L. (2012) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2011.2171334 · Cited by 121
A review on emotion recognition using speech
Basu, S., Chakraborty, J., Bag, A., & Aftabuddin, M. (2017) · International Conference Inventive Communication and Computational Technologies · doi:10.1109/icicct.2017.7975169 · Cited by 119
CRoss-lingual and Multilingual Speech Emotion Recognition on English and French
Neumann, M., & Vu, N. T. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8462162 · Cited by 114
An articulatory study of emotional speech production
Lee, S., Yıldırım, S., Kazemzadeh, A., & Narayanan, S. S. (2005) · Interspeech (USB) · doi:10.21437/interspeech.2005-325 · Cited by 106
Adversarial Auto-Encoders for Speech Based Emotion Recognition
Sahu, S., Gupta, R., Sivaraman, G., AbdAlmageed, W., & Espy-Wilson, C. (2017) · Interspeech (USB) · doi:10.21437/interspeech.2017-1421 · Cited by 101
Robust Speech Recognition and Understanding
Grimm, M., & Kroschel, K. (2007) · doi:10.5772/35 · Cited by 100
Recognition of emotional‐prosodic meanings in speech by autistic, schizophrenic, and normal children
Lancker, D. V., Cornelius, C., & Kreiman, J. E. (1989) · Developmental Neuropsychology · doi:10.1080/87565648909540433 · Cited by 94
Kim, J., Englebienne, G., Truong, K. P., & Evers, V. (2017) · Interspeech (USB) · doi:10.21437/interspeech.2017-736 · Cited by 94
Recognising Emotions from Keyboard Stroke Pattern
Khanna, P., & Sasikumar, M. (2010) · International Journal of Computer Applications · doi:10.5120/1614-2170 · Cited by 93
2016 IEEE International Conference on Multimedia and Expo (ICME)
(2016) · doi:10.1109/icme36285.2016 · Cited by 93
Unsupervised Learning Approach to Feature Analysis for Automatic Speech Emotion Recognition
Eskimez, Ş. E., Duan, Z., & Heinzelman, W. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8462685 · Cited by 79
Proceedings of the 5th international conference on Multimodal interfaces
(2003) · doi:10.1145/958432 · Cited by 79
Advanced Techniques in Computing Sciences and Software Engineering
Elleithy, K. M. (2010) · Springer eBooks · doi:10.1007/978-90-481-3660-5 · Cited by 76
Real time speech emotion recognition using RGB image classification and transfer learning
Stolar, M. N., Lech, M., Bolia, R. S., & Skinner, M. (2017) · International Conference on Signal Processing and Communication Systems · doi:10.1109/icspcs.2017.8270472 · Cited by 74
Speech-based recognition of self-reported and observed emotion in a dimensional space
Truong, K. P., van Leeuwen, D. A., & de Jong, F. M. G. (2012) · Speech Communication · doi:10.1016/j.specom.2012.04.006 · Cited by 73
Multi-level Speech Emotion Recognition Based on HMM and ANN
Mao, X., Chen, L., & Fu, L. (2009) · doi:10.1109/csie.2009.113 · Cited by 72
Recognizing Affect from Linguistic Information in 3D Continuous Space
Schuller, B. W. (2011) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.17 · Cited by 69
Recognition of Emotion from Speech: A Review
Ramakrishnan, S. (2012) · InTech eBooks · doi:10.5772/39246 · Cited by 68
A comparative analysis of classifiers in emotion recognition through acoustic features
Kuchibhotla, S., Vankayalapati, H. D., Vaddi, R., & Anne, K. R. (2014) · International Journal of Speech Technology · doi:10.1007/s10772-014-9239-3 · Cited by 66
Discretized Continuous Speech Emotion Recognition with Multi-Task Deep Recurrent Neural Network
Le, D., Aldeneh, Z., & Provost, E. M. (2017) · Interspeech (USB) · doi:10.21437/interspeech.2017-94 · Cited by 66
The USC Creative IT Database: A Multimodal Database of Theatrical Improvisation
Metallinou, A., Lee, C.-C., Busso, C., Carnicke, S. M., & Narayanan, S. S. (2010) · Cited by 63
Borchert, M., & Düsterhöft, A. (2006) · International Conference on Natural Language Processing and Knowledge Engineering (NLPKE) · doi:10.1109/nlpke.2005.1598724 · Cited by 63
Recognizing emotions in spoken dialogue with hierarchically fused acoustic and lexical features
Tian, L., Moore, J. D., & Lai, C. (2016) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2016.7846319 · Cited by 63
Emotion Recognition Using Physiological and Speech Signal in Short-Term Observation
Kim, J., & André, E. (2006) · Lecture notes in computer science · doi:10.1007/11768029_6 · Cited by 61
Two-stream emotion recognition for call center monitoring
Gupta, P., & Rajput, N. (2007) · Interspeech (USB) · doi:10.21437/interspeech.2007-609 · Cited by 59
Wu, C., Lin, J., & Wei, W.-L. (2013) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2013.2269314 · Cited by 58
Detection of stress and emotion in speech using traditional and FFT based log energy features
Nwe, T. L., Foo, S. W., & Silva, L. C. D. (2004) · International Conference on Information, Communications & Signal Processing (ICICS) · doi:10.1109/icics.2003.1292741 · Cited by 58
Spectral and Cepstral Audio Noise Reduction Techniques in Speech Emotion Recognition
Pohjalainen, J., Ringeval, F., Zhang, Z., & Schuller, B. W. (2016) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2964284.2967306 · Cited by 55
Prediction-based learning for continuous emotion recognition in speech
Han, J., Zhang, Z., Ringeval, F., & Schuller, B. W. (2017) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2017.7953109 · Cited by 53
Emotion Recognition in Chinese Natural Speech by Combining Prosody and Voice Quality Features
Zhang, S. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-87734-9_52 · Cited by 51
2006 IEEE International Conference on Multimedia and Expo (ICME)
(2005) · IEEE Transactions on Circuits & Systems II Express Briefs · doi:10.1109/tcsii.2005.859418 · Cited by 49
Reconstruction-error-based learning for continuous emotion recognition in speech
Han, J., Zhang, Z., Ringeval, F., & Schuller, B. W. (2017) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2017.7952580 · Cited by 48
Tsihrintzis, G. A., Virvou, M. K., Alepis, E., & Σταθοπούλου, Ι. (2008) · International Conference on Information Technology: New Generations · doi:10.1109/itng.2008.152 · Cited by 44
Learning spectro-temporal features with 3D CNNs for speech emotion recognition
Kim, J., Truong, K. P., Englebienne, G., & Evers, V. (2017) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2017.8273628 · Cited by 44
Psychological Motivated Multi-Stage Emotion Classification Exploiting Voice Quality Features
Lugger, M., & Yang, B. (2008) · InTech eBooks · doi:10.5772/6383 · Cited by 43
Emotion Recognition for Affect Aware Video Games
Szwoch, M., & Szwoch, W. (2014) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-10662-5_28 · Cited by 39
Emotion recognition and its application to computer agents with spontaneous interactive capabilities
Nakatsu, R., Nicholson, J., & Tosa, N. (1999) · Creativity and Cognition · doi:10.1145/317561.317585 · Cited by 39
Lotfian, R., & Busso, C. (2018) · Interspeech (USB) · doi:10.21437/interspeech.2018-2464 · Cited by 39
Combining semantic and acoustic features for valence and arousal recognition in speech
Karadogan, S. G., & Larsen, J. O. (2012) · International Workshop on Cognitive Information Processing (CIP) · doi:10.1109/cip.2012.6232924 · Cited by 35
Recognizing emotion from Turkish speech using acoustic features
Oflazoglu, C., & Yıldırım, S. (2013) · EURASIP Journal on Audio Speech and Music Processing · doi:10.1186/1687-4722-2013-26 · Cited by 35
A Study of Speech Emotion Recognition and Its Application to Mobile Services
Yoon, W.-J., Cho, Y.-H., & Park, K.-S. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-73549-6_74 · Cited by 34
Multi-stage classification of emotional speech motivated by a dimensional emotion model
Xiao, Z., Dellandréa, E., Dou, W., & Chen, L. (2009) · Multimedia Tools and Applications · doi:10.1007/s11042-009-0319-3 · Cited by 31
Speech Enhancement, Modeling and Recognition- Algorithms and Applications
Ramakrishnan, S. (2012) · InTech eBooks · doi:10.5772/2391 · Cited by 27
Towards Conditional Adversarial Training for Predicting Emotions from Speech
Han, J., Zhang, Z., Ren, Z. X., Ringeval, F., & Schuller, B. W. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8462579 · Cited by 27
Emotional Prosody Speech and Transcripts
Liberman, M., Davis, K., Grossman, M., Martey, N., & Bell, J. (2002) · Americanae (AECID Library) · doi:10.35111/37ff-a902 · Cited by 25
LSTM Based Cross-corpus and Cross-task Acoustic Emotion Recognition
Kaya, H., Fedotov, D., Yeşilkanat, A., Verkholyak, O., Zhang, Y., & Karpov, A. A. (2018) · Interspeech (USB) · doi:10.21437/interspeech.2018-2298 · Cited by 22
Proceedings of the seventh ACM international conference on Multimedia (Part 2)
Robertson, I. (1999) · doi:10.1145/319878 · Cited by 20
Automatic measurement of affective valence and arousal in speech
Asgari, M., Kiss, G., van Santen, J. P. H., Izhak Shafran, J., & Song, X. B. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6853740 · Cited by 15
Sahu, S., Gupta, R., Sivaraman, G., & Espy-Wilson, C. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8462065 · Cited by 15
Emotion recognition from multi-modal information
Wu, C., Lin, J., Wei, W.-L., & Cheng, K.-C. (2013) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipa.2013.6694347 · Cited by 6
Cited by
Enhancements in Immediate Speech Emotion Detection: Harnessing Prosodic and Spectral Characteristics
Shah, Z., Zhiyong, S., & ., A. (2024) · International Journal of Innovative Science and Research Technology (IJISRT) · doi:10.38124/ijisrt/ijisrt24apr872 · Cited by 1,663
A systematic review on affective computing: emotion models, databases, and recent advances
Wang, Y., Song, W., Tao, W., Liotta, A., Yang, D., Li, X., Gao, S., Sun, Y., Ge, W., Zhang, W., et al. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.03.009 · Cited by 615
A comprehensive survey on feature selection in the various fields of machine learning
Dhal, P., & Azad, C. (2022) · Applied Intelligence · doi:10.1007/s10489-021-02550-9 · Cited by 495
A Comprehensive Review of Speech Emotion Recognition Systems
Wani, T. M., Gunawan, T. S., Qadri, S. A. A., Kartiwi, M., & Ambikairajah, E. (2021) · IEEE Access · doi:10.1109/access.2021.3068045 · Cited by 376
Deep Learning Techniques for Speech Emotion Recognition, from Databases to Models
Abbaschian, B. J., Sierra-Sosa, D., & Elmaghraby, A. (2021) · Sensors · doi:10.3390/s21041249 · Cited by 293
Metadata
- Authors
- Akçay, M. B., & Oğuz, K.
- Venue
- Speech Communication
- Publisher
- Elsevier BV
- Published
- 2020-01
- Volume
- 116
- Pages
- 56-76
- ISSN
- 0167-6393 (ISSN-L)
- OpenAlex
- W2997399314
- Cited by
- 721
- References
- 165
- FWCI
- 84.48
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.