The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abandoning emotion classes - towards continuous emotion recognition with modelling of long-range dependencies
Abstract
Class based emotion recognition from speech, as performed in most works up to now, entails many restrictions for practical applications. Human emotion is a continuum and an automatic emotion recognition system must be able to recognise it as such. We present a novel approach for continuous emotion recognition based on Long Short-Term Memory Recurrent Neural Networks which include modelling of long-range dependencies between observations and thus outperform techniques like Support-Vector Regression. Transferring the innovative concept of additionally modelling emotional history to the classification of discrete levels for the emotional dimensions “valence ” and “activation ” we also apply Conditional Random Fields which prevail over the commonly used Support-Vector Machines. Experiments conducted on data that was recorded while humans interacted with a Sensitive Artificial Listener prove that for activation the derived classifiers perform as well as human annotators.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,935
FEELTRACE: an instrument for recording perceived emotion in real time
Cowie, R., Douglas‐Cowie, E., Savvidou, S. M., & McMahon, E. R. (2000) · Research Portal (Queen's University Belfast) · Cited by 539
Self-citationDouglas-Cowie, E., Cowie, R., Sneddon, I., Cox, C., Lowry, O., McRorie, M., Martin, J.-C., Devillers, L., Abrilian, S., Batliner, A., et al. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74889-2_43 · Cited by 321
Self-citationHow to find trouble in communication
Batliner, A., Fischer, K., Huber, R., Spilker, J., & Nöth, E. (2003) · Speech Communication · doi:10.1016/s0167-6393(02)00079-1 · Cited by 280
Schuller, B., Batliner, A., Seppi, D., Steidl, S., Vogt, T., Wagner, J., Devillers, L., Vidrascu, L., Amir, N., Kessous, L., et al. (2007) · Interspeech 2007 · doi:10.21437/interspeech.2007-612 · Cited by 191
Self-citationBiologically Plausible Speech Recognition with LSTM Neural Nets
Graves, A., Eck, D., Beringer, N., & Schmidhuber, J. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-27835-1_10 · Cited by 109
On the Necessity and Feasibility of Detecting a Driver’s Emotional State While Driving
Grimm, M., Kroschel, K., Harris, H., Nass, C., Schuller, B. W., Rigoll, G., & Moosmayr, T. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-74889-2_12 · Cited by 99
Self-citationMultimodal databases of everyday emotion: facing up to complexity
Douglas‐Cowie, E., Devillers, L. Y., Martin, J., Cowie, R., Savvidou, S., Abrilian, S., & Cox, C. (2005) · Interspeech (USB) · doi:10.21437/interspeech.2005-381 · Cited by 90
Self-citationBrute-forcing hierarchical functionals for paralinguistics: A waste of feature space?
Schuller, B. W., Wimmer, M., Mösenlechner, L., Kern, C., Arsić, D., & Rigoll, G. (2008) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2008.4518656 · Cited by 60
Self-citation
Cited by
Context-Dependent Sentiment Analysis in User-Generated Videos
Poria, S., Cambria, E., Hazarika, D., Majumder, N., Zadeh, A., & Morency, L.-P. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1081 · Cited by 939
Schuller, B., Batliner, A., Steidl, S., & Seppi, D. (2011) · Speech Communication · doi:10.1016/j.specom.2011.01.011 · Cited by 758
Self-citationAkçay, M. B., & Oğuz, K. (2020) · Speech Communication · doi:10.1016/j.specom.2019.12.001 · Cited by 721
Recent Advances in Recurrent Neural Networks
Salehinejad, H., Sankar, S., Barfett, J., Colak, E., & Valaee, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.01078 · Cited by 562
Analysis of EEG Signals and Facial Expressions for Continuous Emotion Detection
Soleymani, M., Asghari-Esfeden, S., Fu, Y., & Pantic, M. (2016) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2015.2436926 · Cited by 552
Speech emotion recognition: two decades in a nutshell, benchmarks, and ongoing trends
Schuller, B. W. (2018) · Communications of the ACM · doi:10.1145/3129340 · Cited by 541
Self-citationNicolaou, M. A., Gunes, H., & Pantic, M. (2011) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.9 · Cited by 450
“Performance comparison shows that the proposed output-associative fusion framework provides a significantly improved prediction accuracy compared to feature-level and model-level fusion via BLSTM-NNs.”
BackgroundMethodAutomatic, Dimensional and Continuous Emotion Recognition
Gunes, H., & Pantic, M. (2010) · International Journal of Synthetic Emotions · doi:10.4018/jse.2010101605 · Cited by 426
OpenEAR — Introducing the munich open-source emotion and affect recognition toolkit
Eyben, F., Wollmer, M., & Schuller, B. (2009) · 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops · doi:10.1109/acii.2009.5349350 · Cited by 418
Self-citationAutomatic speech emotion recognition using modulation spectral features
Wu, S., Falk, T. H., & Chan, W.-Y. (2011) · Speech Communication · doi:10.1016/j.specom.2010.08.013 · Cited by 389
Cross-Corpus Acoustic Emotion Recognition: Variances and Strategies
Schuller, B., Vlasenko, B., Eyben, F., Wollmer, M., Stuhlsatz, A., Wendemuth, A., & Rigoll, G. (2010) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2010.8 · Cited by 388
Self-citationGunes, H., & Schuller, B. (2013) · Image and Vision Computing · doi:10.1016/j.imavis.2012.06.016 · Cited by 360
Self-citationEmotion representation, analysis and synthesis in continuous space: A survey
Gunes, H., Schuller, B., Pantic, M., & Cowie, R. (2011) · Face and Gesture 2011 · doi:10.1109/fg.2011.5771357 · Cited by 322
Self-citationLSTM-Modeling of continuous emotions in an audiovisual affect recognition framework
Wöllmer, M., Kaiser, M., Eyben, F., Schuller, B., & Rigoll, G. (2013) · Image and Vision Computing · doi:10.1016/j.imavis.2012.03.001 · Cited by 288
Self-citationBehavioral Signal Processing: Deriving Human Behavioral Informatics From Speech and Language
Narayanan, S., & Georgiou, P. G. (2013) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2236291 · Cited by 294
Deep neural networks for acoustic emotion recognition: Raising the benchmarks
Stuhlsatz, A., Meyer, C., Eyben, F., Zielke, T., Meier, G., & Schuller, B. (2011) · 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2011.5947651 · Cited by 288
Self-citationSpeech Emotion Classification Using Attention-Based LSTM
Xie, Y., Liang, R., Liang, Z., Huang, C., Zou, C., & Schuller, B. (2019) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2019.2925934 · Cited by 282
Self-citationEnd-to-End Speech Emotion Recognition Using Deep Neural Networks
Tzirakis, P., Zhang, J., & Schuller, B. W. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8462677 · Cited by 277
Self-citationAcoustic emotion recognition: A benchmark comparison of performances
Schuller, B., Vlasenko, B., Eyben, F., Rigoll, G., & Wendemuth, A. (2009) · 2009 IEEE Workshop on Automatic Speech Recognition & Understanding · doi:10.1109/asru.2009.5372886 · Cited by 267
Self-citationAFEW-VA database for valence and arousal estimation in-the-wild
Kossaifi, J., Tzimiropoulos, G., Todorovic, S., & Pantic, M. (2017) · Image and Vision Computing · doi:10.1016/j.imavis.2017.02.001 · Cited by 236
Building autonomous sensitive artificial listeners
Schroder, M., Bevacqua, E., Cowie, R., Eyben, F., Gunes, H., Heylen, D., ter Maat, M., McKeown, G., Pammi, S., Pantic, M., et al. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.34 · Cited by 185
Self-citationMulti-Modal Audio, Video and Physiological Sensor Learning for Continuous Emotion Prediction
Brady, K., Gwon, Y., Khorrami, P., Godoy, E., Campbell, W., Dagli, C., & Huang, T. S. (2016) · Proceedings of the 6th International Workshop on Audio/Visual Emotion Challenge · doi:10.1145/2988257.2988264 · Cited by 110
Zhang, Y., Liu, Y., Weninger, F., & Schuller, B. (2017) · 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2017.7953106 · Cited by 55
Self-citationStrength modelling for real-worldautomatic continuous affect recognition from audiovisual signals
Han, J., Zhang, Z., Cummins, N., Ringeval, F., & Schuller, B. (2017) · Image and Vision Computing · doi:10.1016/j.imavis.2016.11.020 · Cited by 53
Self-citationA Listening Agent Exhibiting Variable Behaviour
Bevacqua, E., Mancini, M., & Pelachaud, C. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-85483-8_27 · Cited by 50
Transfer learning emotion manifestation across music and speech
Coutinho, E., Deng, J., & Schuller, B. (2014) · 2014 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2014.6889814 · Cited by 36
Self-citationMultimodal continuous affect recognition based on LSTM and multiple kernel learning
Wei, J., Pei, E., Jiang, D., Sahli, H., Xie, L., & Fu, Z. (2014) · Signal and Information Processing Association Annual Summit and Conference (APSIPA), 2014 Asia-Pacific · doi:10.1109/apsipa.2014.7041743 · Cited by 17
Adaptive Domain-Aware Representation Learning for Speech Emotion Recognition
Fan, W., Xu, X., Xing, X., & Huang, D. (2020) · Interspeech 2020 · doi:10.21437/interspeech.2020-2572 · Cited by 14
Metadata
- Authors
- Wöllmer, M., Eyben, F., Reiter, S., Schuller, B., Cox, C., Douglas-Cowie, E., & Cowie, R.
- Venue
- Interspeech 2008
- Publisher
- ISCA
- Published
- 2008-09-22
- Pages
- 597-600
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W211912913
- Cited by
- 328
- References
- 11
- FWCI
- 40.00
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.