The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Emotion Recognition of Affective Speech Based on Multiple Classifiers Using Acoustic-Prosodic Information and Semantic Labels
Abstract
This work presents an approach to emotion recognition of affective speech based on multiple classifiers using acoustic-prosodic information (AP) and semantic labels (SLs). For AP-based recognition, acoustic and prosodic features including spectrum, formant, and pitch-related features are extracted from the detected emotional salient segments of the input speech. Three types of models, GMMs, SVMs, and MLPs, are adopted as the base-level classifiers. A Meta Decision Tree (MDT) is then employed for classifier fusion to obtain the AP-based emotion recognition confidence. For SL-based recognition, semantic labels derived from an existing Chinese knowledge base called HowNet are used to automatically extract Emotion Association Rules (EARs) from the recognized word sequence of the affective speech. The maximum entropy model (MaxEnt) is thereafter utilized to characterize the relationship between emotional states and EARs for emotion recognition. Finally, a weighted product fusion method is used to integrate the AP-based and SL-based recognition results for the final emotion decision. For evaluation, 2,033 utterances for four emotional states (Neutral, Happy, Angry, and Sad) are collected. The speaker-independent experimental results reveal that the emotion recognition performance based on MDT can achieve 80.00 percent, which is better than each individual classifier. On the other hand, an average recognition accuracy of 80.92 percent can be obtained for SL-based recognition. Finally, combining acoustic-prosodic information and semantic labels can achieve 83.55 percent, which is superior to either AP-based or SL-Based approaches. Moreover, considering the individual personality trait for personalized application, the recognition accuracy of the proposed approach can be further improved to 85.79 percent.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
(1992) · Cited by 23,431
Mining association rules between sets of items in large databases
Agrawal, R., Imieliński, T., & Swami, A. (1993) · Proceedings of the 1993 ACM SIGMOD international conference on Management of data · doi:10.1145/170035.170072 · Cited by 14,907
Praat: Doing Phonetics by Computer
(2011) · Ear & Hearing · doi:10.1097/aud.0b013e31821473f7 · Cited by 7,863
Lecture Notes in Artificial Intelligence
Brézillon, P., & Bouquet, P. (1999) · Cited by 7,473
Mining association rules between sets of items in large databases
Agrawal, R., Imieliński, T., & Swami, A. (1993) · ACM SIGMOD Record · doi:10.1145/170036.170072 · Cited by 4,551
A maximum entropy approach to natural language processing
Berger, A. L., Pietra, V. J. D., & Pietra, S. A. D. (1996) · doi:10.5555/234285.234289 · Cited by 3,065
Devijver, P. A., & Kittler, J. (1982) · Prentice-Hall International eBooks · Cited by 2,910
Advances in Large-Margin Classifiers
(2000) · The MIT Press eBooks · doi:10.7551/mitpress/1113.001.0001 · Cited by 1,869
Spoken Language Processing: A Guide to Theory, Algorithm, and System Development
Huang, X., Acero, A., Hon, H.-W., & Reddy, R. (2001) · Cited by 1,593
Platt, J. C. (2000) · Advances in Large-Margin Classifiers · doi:10.7551/mitpress/1113.003.0008 · Cited by 1,156
Boersma, P. (1993) · Cited by 1,046
Toward detecting emotions in spoken dialogs
Lee, C. M., & Narayanan, S. S. (2005) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/tsa.2004.838534 · Cited by 988
The INTERSPEECH 2009 emotion challenge
Schuller, B., Steidl, S., & Batliner, A. (2009) · Interspeech 2009 · doi:10.21437/interspeech.2009-103 · Cited by 938
Speech emotion recognition using hidden Markov models
Nwe, T. L., Foo, S. W., & De Silva, L. C. (2003) · Speech Communication · doi:10.1016/s0167-6393(03)00099-2 · Cited by 920
Passion and reason: making sense of our emotions
(1995) · Choice Reviews Online · doi:10.5860/choice.32-4774 · Cited by 458
Schuller, B., Rigoll, G., & Lang, M. (2004) · 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.2004.1326051 · Cited by 426
Prosody-based automatic segmentation of speech into sentences and topics
Shriberg, E., Stolcke, A., Hakkani-Tür, D., & Tür, G. (2000) · Speech Communication · doi:10.1016/s0167-6393(00)00028-5 · Cited by 424
Spoken dialogue management using probabilistic reasoning
Roy, N., Pineau, J., & Thrun, S. (2000) · Proceedings of the 38th Annual Meeting on Association for Computational Linguistics - ACL '00 · doi:10.3115/1075218.1075231 · Cited by 285
Emotion recognition in speech signal: experimental study, development, and application
Petrushin, V. A. (2000) · 6th International Conference on Spoken Language Processing (ICSLP 2000) · doi:10.21437/icslp.2000-791 · Cited by 246
Emotion recognition from text using semantic labels and separable mixture models
Wu, C.-H., Chuang, Z.-J., & Lin, Y.-C. (2006) · ACM Transactions on Asian Language Information Processing · doi:10.1145/1165255.1165259 · Cited by 242
Self-citationCombining Classifiers with Meta Decision Trees
Todorovski, L., & Džeroski, S. (2003) · Machine Learning · doi:10.1023/a:1021709817809 · Cited by 204
De Silva, L. C., & Ng, P. C. (2002) · Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580) · doi:10.1109/afgr.2000.840655 · Cited by 196
Affective Information Processing
Tao, J., & Tan, T. (2008) · Springer eBooks · doi:10.1007/978-1-84800-306-4 · Cited by 107
BabyEars: A recognition system for affective vocalizations
Slaney, M., & McRoberts, G. W. (2003) · Speech Communication · doi:10.1016/s0167-6393(02)00049-3 · Cited by 107
Emotion detection in task-oriented spoken dialogues
Devillers, L. Y., Lamel, L. F., & Vasilescu, I. (2003) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2003.1221370 · Cited by 87
Extracting social meaning: identifying interactional style in spoken conversation
Jurafsky, D., Ranganath, R., & McFarland, D. A. (2009) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/1620754.1620847 · Cited by 79
Emotion recognition using a hierarchical binary decision tree approach
Lee, C.-C., Mower, E., Busso, C., Lee, S., & Narayanan, S. S. (2009) · Interspeech (USB) · doi:10.21437/interspeech.2009-105 · Cited by 65
Personality Traits and Sex Differences in Emotion Recognition among African Americans and Caucasians
Terracciano, A., Merritt, M. M., Zonderman, A. B., & Evans, M. K. (2003) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1280.032 · Cited by 43
Emotion Perception and Recognition from Speech
Wu, C., Yeh, J., & Chuang, Z.-J. (2008) · Springer eBooks · doi:10.1007/978-1-84800-306-4_6 · Cited by 27
Self-citationSpecialized acoustic models for hyperarticulated speech
Soltau, H., & Waibel, A. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2000.862098 · Cited by 25
Lucero, J. C. (1999) · Journal of Sound and Vibration · doi:10.1006/jsvi.1998.2072 · Cited by 25
Luengo, I., Navas, E., & Hernáez, I. (2009) · Interspeech (USB) · doi:10.21437/interspeech.2009-108 · Cited by 23
Exploring the benefits of discretization of acoustic features for speech emotion recognition
Vogt, T., & André, E. (2009) · Interspeech 2009 · doi:10.21437/interspeech.2009-107 · Cited by 19
Two-Level Fusion to Improve Emotion Classification in Spoken Dialogue Systems
López-Cózar, R., Callejas, Z., Kroul, M., Nouza, J., & Silovský, J. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-87391-4_78 · Cited by 8
Emotion Recognition from Speech Using IG-Based Feature Compensation
Wu, C., & Chuang, Z.-J. (2008) · Cited by 4
Self-citationAcoustic models for hyperarticulated speech
Soltau, H., & Waibel, A. (2000) · doi:10.5445/ir/31452000 · Cited by 3
Cited by
A review of affective computing: From unimodal analysis to multimodal fusion
Poria, S., Cambria, E., Bajpai, R., & Hussain, A. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.02.003 · Cited by 1,644
Context-Dependent Sentiment Analysis in User-Generated Videos
Poria, S., Cambria, E., Hazarika, D., Majumder, N., Zadeh, A., & Morency, L.-P. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1081 · Cited by 939
Emotion recognition using multi-modal data and machine learning techniques: A tutorial and review
Zhang, J., Yin, Z., Chen, P., & Nichele, S. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.01.011 · Cited by 806
Akçay, M. B., & Oğuz, K. (2020) · Speech Communication · doi:10.1016/j.specom.2019.12.001 · Cited by 721
A Review and Meta-Analysis of Multimodal Affect Detection Systems
D'mello, S. K., & Kory, J. (2015) · ACM Computing Surveys · doi:10.1145/2682899 · Cited by 628
Metadata
- Authors
- Wu, C.-H., & Liang, W.-B.
- Venue
- IEEE Transactions on Affective Computing
- Published
- 2011-01
- Volume
- 2
- Issue
- 1
- Pages
- 10-21
- ISSN
- 1949-3045 (ISSN-L)
- OpenAlex
- W2168465881
- Cited by
- 266
- References
- 37
- FWCI
- 10.39
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.