The DOI matches its Crossref record; 226 of the 226 references it cites were found in a registry or an index.
Recognising realistic emotions and affect in speech: State of the art and lessons learnt from the first challenge
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Data Mining: Practical Machine Learning Tools and Techniques
(2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,437
Jolliffe, I. (2005) · Encyclopedia of Statistics in Behavioral Science · doi:10.1002/0470013192.bsa501 · Cited by 14,310
Learning the parts of objects by non-negative matrix factorization
Lee, D. D., & Seung, H. S. (1999) · Nature · doi:10.1038/44565 · Cited by 13,868
Introduction to Statistical Pattern Recognition
(1990) · Elsevier eBooks · doi:10.1016/c2009-0-27872-x · Cited by 11,031
An algorithm for suffix stripping
Porter, M. F. (1980) · Program · doi:10.1108/eb046814 · Cited by 8,096
Text categorization with Support Vector Machines: Learning with many relevant features
Joachims, T. (1998) · Lecture Notes in Computer Science · doi:10.1007/bfb0026683 · Cited by 7,999
Wolpert, D. H. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80023-1 · Cited by 7,951
Independent Component Analysis
(2004) · Independent Component Analysis · doi:10.7551/mitpress/3717.003.0014 · Cited by 7,903
Praat: Doing Phonetics by Computer
(2011) · Ear & Hearing · doi:10.1097/aud.0b013e31821473f7 · Cited by 7,863
Thumbs up?: sentiment classification using machine learning techniques
Pang, B., Lee, L., & Vaithyanathan, S. (2002) · Proceedings of the ACL-02 conference on Empirical methods in natural language processing - EMNLP '02 · doi:10.3115/1118693.1118704 · Cited by 7,024
Research works printed but not linked: 37
- Al-Hames, M., Rigoll, G., 2006. Reduced complexity and scaling for asynchronous HMMs in a bimodal input fusion application. In: Proc. ICASSP, Toulouse, France, pp. 757–760. · doi:10.1109/icassp.2006.1661386
- Armstrong, 2007, Significance tests harm progress in forecasting, Internat. J. Forecast., 23, 321, 10.1016/j.ijforecast.2007.03.004 · DOI
- Batliner, A., Steidl, S., Schuller, B., Seppi, D., Vogt, T., Devillers, L., Vidrascu, L., Amir, N., Kessous, L., Aharonson, V., 2007. The impact of F0 extraction errors on the classification of prominence and emotion. In: Proc. ICPhS, Saarbrücken, Germany, pp. 2201–2204.
- Batliner, A., Fischer, K., Huber, R., Spilker, J., Nöth, E., 2000. Desperately seeking emotions: actors, wizards, and human beings. In: Proc. ISCA Workshop on Speech and Emotion, Newcastle, Northern Ireland, pp. 195–200.
- Batliner, A., Hacker, C., Steidl, S., Nöth, E., Haas, J., 2004. From emotion to interaction: lessons from real human–machine-dialogues. In: Proc. Tutorial and Research Workshop on Affective Dialogue Systems, Kloster Irsee, Germany, pp. 1–12. · doi:10.1007/978-3-540-24842-2_1
- Batliner, A., Steidl, S., Nöth, E., 2007a. Laryngealizations and emotions: How many Babushkas? In: Proc. Internat. Workshop on Paralinguistic Speech – between Models and Data (ParaLing’07), Saarbrücken, Germany, pp. 17–22.
- Batliner, A., Schuller, B., Schaeffler, S., Steidl, S., 2008a. Mothers, adults, children, pets — towards the acoustics of intimacy. In: Proc. ICASSP 2008, Las Vegas, NV, pp. 4497–4500. · doi:10.1109/icassp.2008.4518655
- Boda, P.P., 2004. Multimodal integration in a wider sense. In: Proc. COLING 2004 Satellite Workshop on Robust and Adaptive Information Processing for Mobile Speech Interfaces, Geneva, Switzerland, pp. 22–30.
- Campbell, N., Kashioka, H., Ohara, R., 2005. No laughing matter. In: Proc. Interspeech, Lisbon, Portugal, pp. 465–468. · doi:10.21437/interspeech.2005-317
- Ding, H., Qian, B., Li, Y., Tang, Z., 2006. A method combining lpc-based cepstrum and harmonic product spectrum for pitch detection. In: Proc. 2006 Internat. Conf. on Intelligent Information Hiding and Multimedia, IEEE, pp. 537–540.
- Elliott, C., 1992. The affective reasoner: a process model of emotions in a multi-agent system. Ph.D. Thesis, Dissertation, Northwestern University.
- Fattah, S.A., Zhu, W.P., Ahmad, M.O., 2008. A cepstral domain algorithm for formant frequency estimation from noise-corrupted speech. In: Internat. Conf. on Neural Networks and Signal Processing 2008, Zhenjiang, China, pp. 114–119. · doi:10.1109/icnnsp.2008.4590321
- Fei, Z., Huang, X., Wu, L., 2006. Mining the relation between sentiment expression and target using dependency of words. In: Proc. 20th Pacific Asia Conf. on Language, Information and Computation (PACLIC20), Wuhan, China, pp. 257–264.
- Forbes-Riley, K., Litman, D., 2004. Predicting emotion in spoken dialogue fromm multiple knowledge sources. In: Proc. Human Language Technology Conf. of the North American Chap. of the Assoc. for Computational Linguistics, Boston, MA, USA, no pagination.
- Goertzel, B., Silverman, K., Hartley, C., Bugaj, S., Ross, M., 2000. The baby webmind project. In: Proc. Annual Conf. of The Society for the Study of Artificial Intelligence and the Simulation of Behaviour (AISB), no pagination.
- Hirschberg, J., Liscombe, J., Venditti, J., 2003. Experiments in emotional speech. In: Proc. ISCA and IEEE Workshop on Spontaneous Speech Processing and Recognition, Tokyo, Japan, pp. 1–7.
- Hui, L., Dai, B.-Q., Wei, L., 2006. A pitch detection algorithm based on amdf and acf. In: Proc. ICASSP, Toulouse, France, p. I.
- Inanoglu, Z., Caneel, R., 2005. Emotive alert: HMM-based emotion detection in voicemail messages. In: Proc. 10th Internat. Conf. on Intelligent User Interfaces, San Diego, CA, USA, pp. 251–253. · doi:10.1145/1040830.1040885
- Kim, E., Hyun, K., Kim, S., Kwak, Y., 2007. Emotion interactive robot focus on speaker independently emotion recognition. In: Proc. IEEE/ASME Internat. Conf. on Advanced Intelligent Mechatronics, Zurich, Switzerland, pp. 1–6. · doi:10.1109/aim.2007.4412451
- Laskowski, K., 2009. Contrasting emotion-bearing laughter types in multiparticipant vocal activity detection for meetings. In: Proc. ICASSP, IEEE, Taipei, Taiwan, pp. 4765–4768. · doi:10.1109/icassp.2009.4960696
- Nose, T., Kato, Y., Kobayashi, T., 2007. Style estimation of speech based on multiple regression hidden semi-markov model. In: Proc. Interspeech, Antwerp, Belgium, pp. 2285–2288. · DOI
- Schiel, F., 1999. Automatic phonetic transcription of non-prompted speech. In: Proc. ICPhS, San Francisco, CA, USA, pp. 607–610.
- Schröder, M., Pirker, H., Lamolle, M., 2006. First suggestions for an emotion annotation and representation language. In: Devillers, L., Martin, J.-C., Cowie, R., Douglas-Cowie, E., Batliner, A. (Eds.), Proc. Satellite Workshop of LREC 2006 on Corpora for Research on Emotion and Affect, Genoa, Italy, pp. 88–92.
- Schuller, B., Köhler, N., Müller, R., Rigoll, G., 2006b. Recognition of interest in human conversational speech. In: Proc. Interspeech, Pittsburgh, PA, USA, pp. 793–796. · doi:10.21437/interspeech.2006-273
- Seppi, D., Gerosa, M., Schuller, B., Batliner, A., Steidl, S., 2008b. Detecting problems in spoken child–computer interaction. In: Proc. 1st Workshop on Child, Computer and Interaction, Chania, Greece, no pagination.
- Shaver, 1992, Cross-cultural similarities and differences in emotion and its representation: a prototype approach, Emotion, 175
- Sood, S., Krishnamurthy, A., 2004. A robust on-the-fly pitch (otfp) estimation algorithm. In: Proc. 12th Annual ACM Internat. Conf. on Multimedia (MULTIMEDIA ’04). ACM, New York, NY, USA, pp. 280–283. · doi:10.1145/1027527.1027591
- Steidl, S., Ruff, C., Batliner, A., Nöth, E., Haas, J., 2004. Looking at the last two turns, I’d say this dialogue is doomed — measuring dialogue success. In: Sojka, P., Kopeček, I., Pala, K. (Eds.), 7th Internat. Conf. on Text, Speech and Dialogue, TSD 2004, Berlin, Heidelberg, pp. 629–636. · doi:10.1007/978-3-540-30120-2_79
- Steidl, S., Batliner, A., Nöth, E., Hornegger, A., 2008. Quantification of segmentation and fo errors and their effect on emotion recognition. In: 11th Internat. Conf. on Text, Speech and Dialogue, TSD 2008, pp. 525–534. · doi:10.1007/978-3-540-87391-4_67
- Steidl, S., 2009. Automatic classification of emotion-related user states in spontaneous children’s speech. Logos Verlag, Berlin, Germany, (Ph.D. Thesis, FAU Erlangen-Nuremberg).
- Takahashi, K., 2004. Remarks on emotion recognition from bio-potential signals. In: Proc. 2nd Internat. Conf. on Autonomous Robots and Agents, pp. 186–191.
- Ververidis, D., Kotropoulos, C., 2003. A review of emotional speech databases. In: PCI 2003, 9th Panhellenic Conf. on Informatics, November 1–23, 2003, Thessaloniki, Greece, pp. 560–574.
- Ververidis, D., Kotropoulos, C., 2006. Fast sequential floating forward selection applied to emotional speech features estimated on DES and SUSAS data collection. In: Proc. European Signal Processing Conf. (EUSIPCO 2006), Florence, Italy, no pagination.
- Vidrascu, L., Devillers, L., 2007. Five emotion classes in real-world call center data: the use of various types of paralinguistic features. In: Proc. PARALING07, pp. 11–16.
- Wu, S., Falk, T., Chan, W.-Y., 2008b. Long-term spectro-temporal information for improved automatic speech emotion classification. In: Proc. INTERSPEECH, Brisbane, Australia, pp. 638–641. · doi:10.21437/interspeech.2008-201
- Young, S., Evermann, G., Gales, M., Hain, T., D.Kershaw, Liu, X., Moore, G., Odell, J., Ollason, D., Povey, D., Valtchev, V., Woodland, P., 2006. The HTK Book, for htk version 3.4 Edition, Cambridge University Engineering Department.
- Zhe, X., Boucouvalas, A., 2002. Text-to-emotion engine for real time internet communication. In: Proc. Internat. Symp. on Communication Systems, Networks, and DSPs, Staffordshire University, pp. 164–168.
Cited by
New Avenues in Opinion Mining and Sentiment Analysis
Cambria, E., Schuller, B., Xia, Y., & Havasi, C. (2013) · IEEE Intelligent Systems · doi:10.1109/mis.2013.30 · Cited by 1,285
Self-citationAffective Computing and Sentiment Analysis
Cambria, E. (2016) · IEEE Intelligent Systems · doi:10.1109/mis.2016.31 · Cited by 1,204
A review of depression and suicide risk assessment using speech analysis
Cummins, N., Scherer, S., Krajewski, J., Schnieder, S., Epps, J., & Quatieri, T. F. (2015) · Speech Communication · doi:10.1016/j.specom.2015.03.004 · Cited by 1,003
Speech emotion recognition using deep neural network and extreme learning machine
Han, K., Yu, D., & Tashev, I. (2014) · Interspeech 2014 · doi:10.21437/interspeech.2014-57 · Cited by 794
Introducing the RECOLA multimodal corpus of remote collaborative and affective interactions
Ringeval, F., Sonderegger, A., Sauer, J., & Lalanne, D. (2013) · 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2013.6553805 · Cited by 771
Trull, T. J., & Ebner-Priemer, U. (2013) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050212-185510 · Cited by 761
Schuller, B., Steidl, S., Batliner, A., Vinciarelli, A., Scherer, K., Ringeval, F., Chetouani, M., Weninger, F., Eyben, F., Marchi, E., et al. (2013) · Interspeech 2013 · doi:10.21437/interspeech.2013-56 · Cited by 731
Self-citationSpeech Emotion Recognition Using Deep Learning Techniques: A Review
Khalil, R. A., Jones, E., Babar, M. I., Jan, T., Zafar, M. H., & Alhussain, T. (2019) · IEEE Access · doi:10.1109/access.2019.2936124 · Cited by 702
A survey of multimodal sentiment analysis
Soleymani, M., Garcia, D., Jou, B., Schuller, B., Chang, S.-F., & Pantic, M. (2017) · Image and Vision Computing · doi:10.1016/j.imavis.2017.08.003 · Cited by 601
Self-citationFeatures and classifiers for emotion recognition from speech: a survey from 2000 to 2011
Anagnostopoulos, C.-N., Iliou, T., & Giannoukos, I. (2015) · Artificial Intelligence Review · doi:10.1007/s10462-012-9368-5 · Cited by 428
Efficient emotion recognition from speech using deep learning on spectrograms
Satt, A., Rozenberg, S., & Hoory, R. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-200 · Cited by 422
Gunes, H., & Schuller, B. (2013) · Image and Vision Computing · doi:10.1016/j.imavis.2012.06.016 · Cited by 360
Self-citationAnalyzing Speech to Detect Financial Misreporting
HOBSON, J. L., MAYEW, W. J., & VENKATACHALAM, M. (2012) · Journal of Accounting Research · doi:10.1111/j.1475-679x.2011.00433.x · Cited by 346
Affective Computing and Sentiment Analysis
Cambria, E., Das, D., Bandyopadhyay, S., & Feraco, A. (2017) · Socio-Affective Computing · doi:10.1007/978-3-319-55394-8_1 · Cited by 342
MMGCN: Multimodal Fusion via Deep Graph Convolution Network for Emotion Recognition in Conversation
Hu, J., Liu, Y., Zhao, J., & Jin, Q. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.440 · Cited by 326
Towards Measuring Stress with Smartphones and Wearable Devices During Workday and Sleep
Muaremi, A., Arnrich, B., & Tröster, G. (2013) · BioNanoScience · doi:10.1007/s12668-013-0089-2 · Cited by 302
Behavioral Signal Processing: Deriving Human Behavioral Informatics From Speech and Language
Narayanan, S., & Georgiou, P. G. (2013) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2236291 · Cited by 294
Paralinguistics in speech and language—State-of-the-art and the challenge
Schuller, B., Steidl, S., Batliner, A., Burkhardt, F., Devillers, L., Müller, C., & Narayanan, S. (2013) · Computer Speech & Language · doi:10.1016/j.csl.2012.02.005 · Cited by 284
Self-citationOn the Acoustics of Emotion in Audio: What Speech, Music, and Sound have in Common
Weninger, F., Eyben, F., Schuller, B. W., Mortillaro, M., & Scherer, K. R. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00292 · Cited by 278
Self-citationDetecting Depression Severity from Vocal Prosody
Yang, Y., Fairbairn, C., & Cohn, J. F. (2013) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2012.38 · Cited by 277
Sewa db: A rich database for audio-visual emotion and sentiment research in the wild
Kossaifi, J., Walecki, R., Panagakis, Y., Shen, J., Schmitt, M., Ringeval, F., Han, J., Pandit, V., Toisoul, A., Schuller, B., et al. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2944808 · Cited by 243
Self-citationThe INTERSPEECH 2012 speaker trait challenge
Schuller, B., Steidl, S., Batliner, A., Nöth, E., Vinciarelli, A., Burkhardt, F., Son, R. V., Weninger, F., Eyben, F., Bocklet, T., et al. (2012) · Interspeech 2012 · doi:10.21437/interspeech.2012-86 · Cited by 211
Self-citationAn experimental study of speech emotion recognition based on deep convolutional neural networks
Zheng, W. Q., Yu, J. S., & Zou, Y. X. (2015) · 2015 International Conference on Affective Computing and Intelligent Interaction (ACII) · doi:10.1109/acii.2015.7344669 · Cited by 187
Multimodal Multi-task Learning for Dimensional and Continuous Emotion Recognition
Chen, S., Jin, Q., Zhao, J., & Wang, S. (2017) · Proceedings of the 7th Annual Workshop on Audio/Visual Emotion Challenge · doi:10.1145/3133944.3133949 · Cited by 147
A hybrid latent space data fusion method for multimodal emotion recognition
Nemati, S., Rohani, R., Basiri, M. E., Abdar, M., Yen, N. Y., & Makarenkov, V. (2019) · IEEE Access · doi:10.1109/access.2019.2955637 · Cited by 98
Schuller, B. W., Batliner, A., Bergler, C., Mascolo, C., Han, J., Lefter, I., Kaya, H., Amiriparian, S., Baird, A., Stappen, L., et al. (2021) · Interspeech 2021 · doi:10.21437/interspeech.2021-19 · Cited by 89
Self-citationSemi-supervised Multi-modal Emotion Recognition with Cross-Modal Distribution Matching
Liang, J., Li, R., & Jin, Q. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413579 · Cited by 73
Applying multiple classifiers and non-linear dynamics features for detecting sleepiness from speech
Krajewski, J., Schnieder, S., Sommer, D., Batliner, A., & Schuller, B. (2012) · Neurocomputing · doi:10.1016/j.neucom.2011.12.021 · Cited by 67
Self-citationDNN-based Emotion Recognition Based on Bottleneck Acoustic Features and Lexical Features
Kim, E., & Shin, J. W. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683077 · Cited by 54
Automatic analysis of speech F0 contour for the characterization of mood changes in bipolar patients
Guidi, A., Vanello, N., Bertschy, G., Gentili, C., Landini, L., & Scilingo, E. P. (2015) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2014.10.011 · Cited by 43
Video emotion recognition in the wild based on fusion of multimodal features
Chen, S., Li, X., Jin, Q., Zhang, S., & Qin, Y. (2016) · Proceedings of the 18th ACM International Conference on Multimodal Interaction · doi:10.1145/2993148.2997629 · Cited by 20
(2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-72038-8 · Cited by 11
Vacher, M., Aman, F., Rossato, S., Portet, F., & Lecouteux, B. (2019) · ACM Transactions on Accessible Computing · doi:10.1145/3310132 · Cited by 10
An Improved Multimodal Dimension Emotion Recognition Based on Different Fusion Methods
Su, H., Liu, B., Tao, J., Dong, Y., Huang, J., Lian, Z., & Song, L. (2020) · 2020 15th IEEE International Conference on Signal Processing (ICSP) · doi:10.1109/icsp48669.2020.9321008 · Cited by 10
Cloud-Based Sentiment Analysis for Interactive Agents
Keijsers, M., Bartneck, C., & Kazmi, H. S. (2019) · Proceedings of the 7th International Conference on Human-Agent Interaction · doi:10.1145/3349537.3351883 · Cited by 9
CoWME: a general framework to evaluate cognitive workload during multimodal interaction
Calandra, D. M., Caso, A., Cutugno, F., Origlia, A., & Rossi, S. (2013) · Proceedings of the 15th ACM on International conference on multimodal interaction · doi:10.1145/2522848.2522867 · Cited by 7
Metadata
- Authors
- Schuller, B., Batliner, A., Steidl, S., & Seppi, D.
- Venue
- Speech Communication
- Publisher
- Elsevier BV
- Published
- 2011-11
- Volume
- 53
- Issue
- 9-10
- Pages
- 1062-1087
- ISSN
- 0167-6393 (ISSN-L)
- OpenAlex
- W1987048275
- Cited by
- 758
- References
- 226
- FWCI
- 77.10
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.