The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Emotion recognition using a hierarchical binary decision tree approach
Abstract
Automated emotion state tracking is a crucial element in the computational study of human communication behaviors. It is important to design robust and reliable emotion recognition systems that are suitable for real-world applications both to enhance analytical abilities to support human decision making and to design human-machine interfaces that facilitate efficient communication. We introduce a hierarchical computational structure to recognize emotions. The proposed structure maps an input speech utterance into one of the multiple emotion classes through subsequent layers of binary classifications. The key idea is that the levels in the tree are designed to solve the easiest classification tasks first, allowing us to mitigate error propagation. We evaluated the classification framework on two different emotional databases using acoustic features, the AIBO database and the USC IEMOCAP database. In the case of the AIBO database, we obtain a balanced recall on each of the individual emotion classes using this hierarchical structure. The performance measure of the average unweighted recall on the evaluation data set improves by 3.37% absolute (8.82% relative) over a Support Vector Machine baseline model. In the USC IEMOCAP database, we obtain an absolute improvement of 7.44% (14.58%) over a baseline Support Vector Machine modeling. The results demonstrate that the presented hierarchical approach is effective for classifying emotional utterances in multiple database contexts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
(1990) · Choice Reviews Online · doi:10.5860/choice.27-3338 · Cited by 35,305
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
Hosmer, D. W., & Lemeshow, S. (2000) · doi:10.1002/0471722146 · Cited by 20,302
Hapeman, D. E. (1991) · Technometrics · doi:10.1080/00401706.1991.10484817 · Cited by 9,373
Making Large-Scale SVM Learning Practical
Joachims, T. (1998) · RePEc: Research Papers in Economics · doi:10.17877/de290r-14262 · Cited by 4,411
IEMOCAP: Interactive emotional dyadic motion capture database
Busso, C., Bulut, M., Lee, C.-C., Kazemzadeh, A., Mower, E., Kim, S., Chang, J. N., Lee, S., & Narayanan, S. S. (2008) · Language Resources and Evaluation · doi:10.1007/s10579-008-9076-6 · Cited by 3,869
Self-citationFleiss, J. L., & Agresti, A. (1991) · Journal of the American Statistical Association · doi:10.2307/2290537 · Cited by 2,641
Wiley Series in Probability and Mathematics Statistics
(1981) · Wiley Series in Probability and Statistics · doi:10.1002/0471725250.scard · Cited by 2,220
Interactive Robots as Social Partners and Peer Tutors for Children: A Field Trial
Kanda, T., Hirano, T., Eaton, D., & Ishiguro, H. (2004) · Human-Computer Interaction · doi:10.1207/s15327051hci1901&2_4 · Cited by 1,003
Toward detecting emotions in spoken dialogs
Lee, C. M., & Narayanan, S. S. (2005) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/tsa.2004.838534 · Cited by 988
Self-citationThe INTERSPEECH 2009 emotion challenge
Schuller, B., Steidl, S., & Batliner, A. (2009) · Interspeech 2009 · doi:10.21437/interspeech.2009-103 · Cited by 938
Large-Scale Bayesian Logistic Regression for Text Categorization
Genkin, A., Lewis, D. D., & Madigan, D. (2007) · Technometrics · doi:10.1198/004017007000000245 · Cited by 808
Relational Meaning and Discrete Emotions
Lazarus, R. S. (2001) · Appraisal Processes in Emotion · doi:10.1093/oso/9780195130072.003.0003 · Cited by 563
Brave, S., Nass, C., & Hutchinson, K. (2005) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2004.11.002 · Cited by 511
On measuring performance in category judgment studies of nonverbal behavior
Wagner, H. L. (1993) · Journal of Nonverbal Behavior · doi:10.1007/bf00987006 · Cited by 450
(2008) · Cited by 412
Multimodal affect recognition in learning environments
Kapoor, A., & Picard, R. W. (2005) · Proceedings of the 13th annual ACM international conference on Multimedia · doi:10.1145/1101149.1101300 · Cited by 339
Analysis of Emotionally Salient Aspects of Fundamental Frequency for Emotion Detection
Busso, C., Lee, S., & Narayanan, S. (2009) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2008.2009578 · Cited by 278
Self-citationAffective multimodal human-computer interaction
Pantic, M., Sebe, N., Cohn, J. F., & Huang, T. (2005) · Proceedings of the 13th annual ACM international conference on Multimedia · doi:10.1145/1101149.1101299 · Cited by 234
A Framework for Automatic Human Emotion Classification Using Emotion Profiles
Mower, E., Mataric, M. J., & Narayanan, S. (2011) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2010.2076804 · Cited by 215
Self-citationSchuller, B., Batliner, A., Seppi, D., Steidl, S., Vogt, T., Wagner, J., Devillers, L., Vidrascu, L., Amir, N., Kessous, L., et al. (2007) · Interspeech 2007 · doi:10.21437/interspeech.2007-612 · Cited by 191
Prendinger, H., Mori, J., & Ishizuka, M. (2005) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2004.11.009 · Cited by 155
Creating conversational interfaces for children
Narayanan, S. S., & Potamianos, A. (2002) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.985544 · Cited by 144
Self-citationSpoken emotion recognition using hierarchical classifiers
Albornoz, E. M., Milone, D. H., & Rufiner, H. L. (2010) · Computer Speech & Language · doi:10.1016/j.csl.2010.10.001 · Cited by 140
Lee, C.-C., Black, M., Katsamanis, A., Lammert, A. C., Baucom, B., Christensen, A., Georgiou, P., & Narayanan, S. S. (2010) · Interspeech (USB) · doi:10.21437/interspeech.2010-287 · Cited by 110
Self-citationDetecting emotional state of a child in a conversational computer game
Yıldırım, S., Narayanan, S. S., & Potamianos, A. (2010) · Computer Speech & Language · doi:10.1016/j.csl.2009.12.004 · Cited by 94
Self-citationMetallinou, A., Lee, S., & Narayanan, S. (2010) · 2010 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2010.5494890 · Cited by 89
Self-citationEmotion recognition using a hierarchical binary decision tree approach
Lee, C.-C., Mower, E., Busso, C., Lee, S., & Narayanan, S. S. (2009) · Interspeech (USB) · doi:10.21437/interspeech.2009-105 · Cited by 65
Self-citationMulti-class and hierarchical SVMs for emotion recognition
Hassan, A., & Damper, R. I. (2010) · Interspeech (USB) · doi:10.21437/interspeech.2010-644 · Cited by 57
Visual emotion recognition using compact facial representations and viseme information
Metallinou, A., Busso, C., Lee, S., & Narayanan, S. S. (2010) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2010.5494893 · Cited by 52
Self-citationAutomatic classification of married couples' behavior using audio features
Black, M., Katsamanis, A., Lee, C.-C., Lammert, A. C., Baucom, B., Christensen, A., Georgiou, P., & Narayanan, S. S. (2010) · Interspeech (USB) · doi:10.21437/interspeech.2010-574 · Cited by 50
Self-citation
Cited by
Akçay, M. B., & Oğuz, K. (2020) · Speech Communication · doi:10.1016/j.specom.2019.12.001 · Cited by 721
Evaluating deep learning architectures for Speech Emotion Recognition
Fayek, H. M., Lech, M., & Cavedon, L. (2017) · Neural Networks · doi:10.1016/j.neunet.2017.02.013 · Cited by 554
Emotion Recognition from Speech Using wav2vec 2.0 Embeddings
Pepino, L., Riera, P., & Ferrer, L. (2021) · Interspeech 2021 · doi:10.21437/interspeech.2021-703 · Cited by 389
Cross-Corpus Acoustic Emotion Recognition: Variances and Strategies
Schuller, B., Vlasenko, B., Eyben, F., Wollmer, M., Stuhlsatz, A., Wendemuth, A., & Rigoll, G. (2010) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2010.8 · Cited by 388
Kanjo, E., Younis, E. M. G., & Ang, C. S. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.09.001 · Cited by 293
Metadata
- Authors
- Lee, C.-C., Mower, E., Busso, C., Lee, S., & Narayanan, S.
- Venue
- Speech Communication
- Publisher
- Elsevier BV
- Published
- 2011-11
- Volume
- 53
- Issue
- 9-10
- Pages
- 1162-1171
- ISSN
- 0167-6393 (ISSN-L)
- OpenAlex
- W2153720647
- Cited by
- 355
- References
- 32
- FWCI
- 19.37
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
