The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Speech emotion recognition: two decades in a nutshell, benchmarks, and ongoing trends
Open accessAbstract
Tracing 20 years of progress in making machines hear our emotions based on speech signal properties.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Development and validation of brief measures of positive and negative affect: The PANAS scales.
Watson, D., Clark, L. A., & Tellegen, A. (1988) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.54.6.1063 · Cited by 32,433
Picard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.52 · Cited by 2,797
Survey on speech emotion recognition: Features, classification schemes, and databases
El Ayadi, M., Kamel, M. S., & Karray, F. (2011) · Pattern Recognition · doi:10.1016/j.patcog.2010.09.020 · Cited by 2,073
Learning to Classify Text Using Support Vector Machines: Methods, Theory and Algorithms
Joachims, T. (2002) · Cited by 932
Emotional speech recognition: Resources, features, and methods
Ververidis, D., & Kotropoulos, C. (2006) · Speech Communication · doi:10.1016/j.specom.2006.04.003 · Cited by 925
Adieu features? End-to-end speech emotion recognition using a deep convolutional recurrent network
Trigeorgis, G., Ringeval, F., Brueckner, R., Marchi, E., Nicolaou, M. A., Schuller, B., & Zafeiriou, S. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7472669 · Cited by 904
Self-citationThe Expression of Emotion in Man and Animals
Darwin, C. D. (2020) · Cited by 649
Emotion recognition from speech: a review
Koolagudi, S. G., & Rao, K. S. (2012) · International Journal of Speech Technology · doi:10.1007/s10772-011-9125-1 · Cited by 641
Mao, Q., Dong, M., Huang, Z., & Zhan, Y. (2014) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2014.2360798 · Cited by 568
Features and classifiers for emotion recognition from speech: a survey from 2000 to 2011
Anagnostopoulos, C.-N., Iliou, T., & Giannoukos, I. (2015) · Artificial Intelligence Review · doi:10.1007/s10462-012-9368-5 · Cited by 428
Deep learning for robust feature generation in audiovisual emotion recognition
Kim, Y., Lee, H., & Provost, E. M. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638346 · Cited by 401
Gunes, H., & Schuller, B. (2013) · Image and Vision Computing · doi:10.1016/j.imavis.2012.06.016 · Cited by 360
Self-citationThe visual microphone: passive recovery of sound from video
Davis, A., Rubinstein, M., Wadhwa, N., Mysore, G. J., Durand, F., & Freeman, W. T. (2014) · ACM Transactions on Graphics · doi:10.1145/2601097.2601119 · Cited by 359
Challenges in real-life emotion annotation and machine learning based detection
Devillers, L., Vidrascu, L., & Lamel, L. (2005) · Neural Networks · doi:10.1016/j.neunet.2005.03.007 · Cited by 342
Wöllmer, M., Eyben, F., Reiter, S., Schuller, B., Cox, C., Douglas-Cowie, E., & Cowie, R. (2008) · Interspeech 2008 · doi:10.21437/interspeech.2008-192 · Cited by 328
Self-citationDeep neural networks for acoustic emotion recognition: Raising the benchmarks
Stuhlsatz, A., Meyer, C., Eyben, F., Zielke, T., Meier, G., & Schuller, B. (2011) · 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2011.5947651 · Cited by 288
Self-citationOn the Acoustics of Emotion in Audio: What Speech, Music, and Sound have in Common
Weninger, F., Eyben, F., Schuller, B. W., Mortillaro, M., & Scherer, K. R. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00292 · Cited by 278
Self-citationSpeech emotion recognition: Features and classification models
Chen, L., Mao, X., Xue, Y., & Cheng, L. L. (2012) · Digital Signal Processing · doi:10.1016/j.dsp.2012.05.007 · Cited by 246
Emotion Recognition In The Wild Challenge 2014: Baseline, Data and Protocol
Dhall, A., Goecke, R., Joshi, J., Sikka, K., & Gedeon, T. (2014) · Proceedings of the 16th International Conference on Multimodal Interaction · doi:10.1145/2663204.2666275 · Cited by 216
Combining acoustic and language information for emotion recognition
Lee, C. M., Narayanan, S. S., & Pieraccini, R. (2002) · 7th International Conference on Spoken Language Processing (ICSLP 2002) · doi:10.21437/icslp.2002-296 · Cited by 165
Semisupervised Autoencoders for Speech Emotion Recognition
Deng, J., Xu, X., Zhang, Z., Frühholz, S., & Schuller, B. W. (2017) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2017.2759338 · Cited by 164
Self-citationVoice-only communication enhances empathic accuracy
Kraus, M. W. (2017) · American Psychologist · doi:10.1037/amp0000147 · Cited by 162
Schmitt, M., Ringeval, F., & Schuller, B. W. (2016) · Interspeech (USB) · doi:10.21437/interspeech.2016-1124 · Cited by 161
Self-citationDellaert, F., Polzin, T., & Waibel, A. (1996) · 4th International Conference on Spoken Language Processing (ICSLP 1996) · doi:10.21437/icslp.1996-462 · Cited by 158
Elimination of verbal cues in judgments of emotion from voice.
Kramer, E. (1964) · Journal of Abnormal & Social Psychology · doi:10.1037/h0042473 · Cited by 111
Learning representations of emotional speech with deep convolutional generative adversarial networks
Chang, J., & Scherer, S. J. (2017) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2017.7952656 · Cited by 108
Combining active learning and semi-supervised learning to construct SVM classifier
Leng, Y., Xu, X., & Qi, G. (2013) · Knowledge-Based Systems · doi:10.1016/j.knosys.2013.01.032 · Cited by 107
Computationally modeling human emotion
Marsella, S., & Gratch, J. S. (2014) · Communications of the ACM · doi:10.1145/2631912 · Cited by 97
Supervised domain adaptation for emotion recognition from speech
Abdelwahab, M., & Busso, C. (2015) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2015.7178934 · Cited by 87
Life-like communication agent-emotion sensing character "MIC" and feeling session character "MUSE"
Tosa, N., & Nakatsu, R. (2002) · Proceedings of the Third IEEE International Conference on Multimedia Computing and Systems · doi:10.1109/mmcs.1996.534948 · Cited by 76
Sentiment analysis and opinion mining: on optimal parameters and performances
Schuller, B. W., Mousa, A. E.-D., & Vasileios, V. (2015) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1159 · Cited by 54
Self-citationSpeech Emotion Recognition using an Enhanced Co-Training Algorithm
Liu, J., Chen, C., Bu, J., You, M., & Tao, J. (2007) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2007.4284821 · Cited by 41
VOCAL PITCH DURING SIMULATED EMOTION.
Fairbanks, G., & Pronovost, W. (1938) · Science · doi:10.1126/science.88.2286.382 · Cited by 39
Bhaykar, M., Yadav, J., & Rao, K. S. (2013) · National Conference on Communications · doi:10.1109/ncc.2013.6487998 · Cited by 39
Emotion recognition using synthetic speech as neutral reference
Lotfian, R., & Busso, C. (2015) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2015.7178874 · Cited by 17
Ram, C. S., & Ponnusamy, R. (2016) · World Applied Sciences Journal · Cited by 3
Cited by
Engaged to a Robot? The Role of AI in Service
Huang, M.-H., & Rust, R. T. (2021) · Journal of Service Research · doi:10.1177/1094670520902266 · Cited by 1,185
Akçay, M. B., & Oğuz, K. (2020) · Speech Communication · doi:10.1016/j.specom.2019.12.001 · Cited by 721
Speech Emotion Recognition Using Deep Learning Techniques: A Review
Khalil, R. A., Jones, E., Babar, M. I., Jan, T., Zafar, M. H., & Alhussain, T. (2019) · IEEE Access · doi:10.1109/access.2019.2936124 · Cited by 702
Dawn of the Transformer Era in Speech Emotion Recognition: Closing the Valence Gap
Wagner, J., Triantafyllopoulos, A., Wierstorf, H., Schmitt, M., Burkhardt, F., Eyben, F., & Schuller, B. W. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3263585 · Cited by 395
Self-citationA Comprehensive Review of Speech Emotion Recognition Systems
Wani, T. M., Gunawan, T. S., Qadri, S. A. A., Kartiwi, M., & Ambikairajah, E. (2021) · IEEE Access · doi:10.1109/access.2021.3068045 · Cited by 376
Metadata
- Authors
- Schuller, B. W.
- Venue
- Communications of the ACM
- Published
- 2018-04-24
- Volume
- 61
- Issue
- 5
- Pages
- 90-99
- ISSN
- 0001-0782 (ISSN-L)
- 1557-7317
- OpenAlex
- W2803098682
- Cited by
- 541
- References
- 37
- FWCI
- 63.24
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.