The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Prosody-based automatic detection of annoyance and frustration in human-computer dialog
Abstract
We investigate the use of prosody for the detection of frustration and annoyance in natural human-computer dialog. In addition to prosodic features, we examine the contribution of language model information and speaking "style". Results show that a prosodic model can predict whether an utterance is neutral versus "annoyed or frustrated" with an accuracy on par with that of human interlabeler agreement. Accuracy increases when discriminating only "frustrated" from other utterances, and when using only those utterances on which labelers originally agreed. Furthermore, prosodic model accuracy degrades only slightly when using recognized versus true words. Language model features, even if based on true words, are relatively poor predictors of frustration. Finally, we find that hyperarticulation is not a good predictor of emotion; the two phenomena often occur independently.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Emotion recognition in human-computer interaction
Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kollias, S., Fellenz, W., & Taylor, J. G. (2001) · IEEE Signal Processing Magazine · doi:10.1109/79.911197 · Cited by 2,603
Emotion Recognition in Speech Using Neural Networks
Nicholson, J., Takahashi, K., & Nakatsu, R. (2000) · Neural Computing & Applications · doi:10.1007/s005210070006 · Cited by 344
Dellaert, F., Polzin, T., & Waibel, A. (1996) · 4th International Conference on Spoken Language Processing (ICSLP 1996) · doi:10.21437/icslp.1996-462 · Cited by 158
Recognition of negative emotions from the speech signal
Lee, C. M., Narayanan, S. S., & Pieraccini, R. (2005) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2001.1034632 · Cited by 151
THE SRI MARCH 2000 HUB-5 CONVERSATIONAL SPEECH TRANSCRIPTION SYSTEM
Stolcke, A., Bratt, H., Butzberger, J., Franco, H., Gadde, V. R. R., Richey, C., Shriberg, E. E., Weng, F. Y., & Zheng, J. (2000) · Cited by 145
Self-citationDARPA communicator dialog travel planning systems: the june 2000 data collection
Walker, M. A., Aberdeen, J. S., Boland, J., Bratt, E. O., Garofolo, J. S., Hirschman, L., Le, A., Lee, S. C., Narayanan, S. S., Papineni, K., et al. (2001) · European Conference on Speech Communication and Technology (Eurospeech) · doi:10.21437/eurospeech.2001-355 · Cited by 109
Emotion recognition and synthesis system on speech
Moriyama, T., & Ozawa, S. (2003) · IEEE International Conference on Multimedia Computing and Systems (ICMCS) · doi:10.1109/mmcs.1999.779310 · Cited by 53
Cited by
A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.52 · Cited by 2,797
Survey on speech emotion recognition: Features, classification schemes, and databases
El Ayadi, M., Kamel, M. S., & Karray, F. (2011) · Pattern Recognition · doi:10.1016/j.patcog.2010.09.020 · Cited by 2,073
Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications
Calvo, R. A., & D'Mello, S. (2010) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2010.1 · Cited by 1,893
EEG Emotion Recognition Using Dynamical Graph Convolutional Neural Networks
Song, T., Zheng, W., Song, P., & Cui, Z. (2020) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2817622 · Cited by 1,597
Differential entropy feature for EEG-based emotion classification
Duan, R.-N., Zhu, J.-Y., & Lu, B.-L. (2013) · 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER) · doi:10.1109/ner.2013.6695876 · Cited by 1,100
Toward detecting emotions in spoken dialogs
Lee, C. M., & Narayanan, S. S. (2005) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/tsa.2004.838534 · Cited by 988
Baker, R. S. J. D., D'Mello, S. K., Rodrigo, M. M. T., & Graesser, A. C. (2010) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2009.12.003 · Cited by 936
Emotional speech recognition: Resources, features, and methods
Ververidis, D., & Kotropoulos, C. (2006) · Speech Communication · doi:10.1016/j.specom.2006.04.003 · Cited by 925
Schuller, B., Batliner, A., Steidl, S., & Seppi, D. (2011) · Speech Communication · doi:10.1016/j.specom.2011.01.011 · Cited by 758
Automatic speech recognition and speech variability: A review
Benzeghiba, M., De Mori, R., Deroo, O., Dupont, S., Erbes, T., Jouvet, D., Fissore, L., Laface, P., Mertins, A., Ris, C., et al. (2007) · Speech Communication · doi:10.1016/j.specom.2007.02.006 · Cited by 529
Sharma, N., & Gedeon, T. (2012) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2012.07.003 · Cited by 510
Features and classifiers for emotion recognition from speech: a survey from 2000 to 2011
Anagnostopoulos, C.-N., Iliou, T., & Giannoukos, I. (2015) · Artificial Intelligence Review · doi:10.1007/s10462-012-9368-5 · Cited by 428
EEG-based emotion recognition during watching movies
Nie, D., Wang, X.-W., Shi, L.-C., & Lu, B.-L. (2011) · 2011 5th International IEEE/EMBS Conference on Neural Engineering · doi:10.1109/ner.2011.5910636 · Cited by 360
Challenges in real-life emotion annotation and machine learning based detection
Devillers, L., Vidrascu, L., & Lamel, L. (2005) · Neural Networks · doi:10.1016/j.neunet.2005.03.007 · Cited by 342
D’Mello, S. K., & Graesser, A. (2010) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-010-9074-4 · Cited by 323
Douglas-Cowie, E., Cowie, R., Sneddon, I., Cox, C., Lowry, O., McRorie, M., Martin, J.-C., Devillers, L., Abrilian, S., Batliner, A., et al. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74889-2_43 · Cited by 321
Ensemble methods for spoken emotion recognition in call-centres
Morrison, D., Wang, R., & De Silva, L. C. (2007) · Speech Communication · doi:10.1016/j.specom.2006.11.004 · Cited by 320
Automatic detection of learner’s affect from conversational cues
D’Mello, S. K., Craig, S. D., Witherspoon, A., McDaniel, B., & Graesser, A. (2008) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-007-9037-6 · Cited by 317
Paralinguistics in speech and language—State-of-the-art and the challenge
Schuller, B., Steidl, S., Batliner, A., Burkhardt, F., Devillers, L., Müller, C., & Narayanan, S. (2013) · Computer Speech & Language · doi:10.1016/j.csl.2012.02.005 · Cited by 284
Enriching speech recognition with automatic detection of sentence boundaries and disfluencies
Liu, Y., Shriberg, E., Stolcke, A., Hillard, D., Ostendorf, M., & Harper, M. (2006) · IEEE Transactions on Audio, Speech and Language Processing · doi:10.1109/tasl.2006.878255 · Cited by 270
Self-citationEmotion Recognition based on Phoneme Classes
Lee, C. M., Yildirim, S., Bulut, M., Kazemzadeh, A., Busso, C., Deng, Z., Lee, S., & Narayanan, S. (2004) · Interspeech 2004 · doi:10.21437/interspeech.2004-322 · Cited by 228
“Such cues have been known to be an important indicator to emotional states [5], and thus used in the design of many emotion recognition systems [6][7][8][9].”
BackgroundA survey of affect recognition methods: audio, visual and spontaneous expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2007) · Proceedings of the 9th international conference on Multimodal interfaces · doi:10.1145/1322192.1322216 · Cited by 144
Influence of contextual information in emotion annotation for spoken dialogue systems
Callejas, Z., & López-Cózar, R. (2008) · Speech Communication · doi:10.1016/j.specom.2008.01.001 · Cited by 86
Inel, O., Khamkham, K., Cristea, T., Dumitrache, A., Rutjes, A., van der Ploeg, J., Romaszko, L., Aroyo, L., & Sips, R.-J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-11915-1_31 · Cited by 57
Speech-based characterization of dopamine replacement therapy in people with Parkinson’s disease
Norel, R., Agurto, C., Heisig, S., Rice, J. J., Zhang, H., Ostrand, R., Wacnik, P. W., Ho, B. K., Ramos, V. L., & Cecchi, G. A. (2020) · npj Parkinson's Disease · doi:10.1038/s41531-020-0113-5 · Cited by 45
Aroyo, L., & Welty, C. (2014) · Human Computation · doi:10.15346/hc.v1i1.3 · Cited by 43
Error-correction detection and response generation in a spoken dialogue system
Bulyko, I., Kirchhoff, K., Ostendorf, M., & Goldberg, J. (2005) · Speech Communication · doi:10.1016/j.specom.2004.09.009 · Cited by 36
Metadata
- Authors
- Ang, J., Dhillon, R., Krupski, A., Shriberg, E., & Stolcke, A.
- Venue
- 7th International Conference on Spoken Language Processing (ICSLP 2002)
- Publisher
- ISCA
- Published
- 2002-09-16
- Pages
- 2037-2040
- OpenAlex
- W1514944708
- Cited by
- 386
- References
- 7
- FWCI
- 32.17
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.