IEMOCAP: interactive emotional dyadic motion capture database
The DOI matches its Crossref record; 55 of the 57 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The Interactive Emotional Dyadic Motion Capture (IEMOCAP) dataset, assembled by the Signal Analysis and Interpretation Lab (SAIL) at the University of Southern California, serves as a prominent multimodal resource for emotion recognition research [24].”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [24]
In the citing paper
“The dataset amalgamates diverse modalities such as video, speech, facial motion capture, and text data, enabling comprehensive examination of emotional states in interactive circumstances.”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [24]
In the citing paper
“IEMOCAP comprises 4784 improvised and 5255 scripted conversations, providing a wide spectrum of emotional contexts for analysis.”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [24]
In the citing paper
“The dialogues span nine discrete emotions (happiness, sadness, anger, surprise, fear, disgust, frustration, excitement, and neutrality), in addition to continuous emotional dimensions like activation, arousal, and dominance, facilitating a more dynamic emotional analysis.”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [24]
In the citing paper
“We generate open-ended AQAs about speech using the four commonly used datasets IEMOCAP [23], MOSEI [24], LibriTTS [25], and Vox-Celeb2 [26,27].”
From Joint Audio and Speech Understanding (2023) · cites this paper as [23]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931 · cited 1×
“The Cronbach alpha coefficients were computed to test the reliabilities of the evaluations between the two raters [25].”
MethodStatistical Methods for Rates and Proportions
Fleiss, J. L., Levin, B., & Paik, M. C. (2003) · Wiley Series in Probability and Statistics · doi:10.1002/0471445428 · Cited by 18,646
Statistical Methods for Rates and Proportions.
Everitt, B. S., & Fleiss, J. L. (1981) · Biometrics · doi:10.2307/2530193 · Cited by 8,990
Lecture Notes in Artificial Intelligence
Brézillon, P., & Bouquet, P. (1999) · Cited by 7,473
Picard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
Constants across cultures in the face and emotion.
Ekman, P., & Friesen, W. V. (1971) · Journal of Personality and Social Psychology · doi:10.1037/h0030377 · Cited by 5,509 · cited 3×
“, combinations of the ‘‘basic emotions’’ (Ekman and Friesen 1971)).”
BackgroundHall, E. T. (1973) · Leonardo · doi:10.2307/1572461 · Cited by 4,859
Least-Squares Fitting of Two 3-D Point Sets
Arun, K. S., Huang, T. S., & Blostein, S. D. (1987) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1987.4767965 · Cited by 3,952
Emotion recognition in human-computer interaction
Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kollias, S., Fellenz, W., & Taylor, J. G. (2001) · IEEE Signal Processing Magazine · doi:10.1109/79.911197 · Cited by 2,603
Signal Processing: Image Communication
Iosifidis, A., Tefas, A., Pitas, I., & Gabbouj, M. (2018) · Cited by 1,128
Toward detecting emotions in spoken dialogs
Lee, C. M., & Narayanan, S. S. (2005) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/tsa.2004.838534 · Cited by 988
Self-citationAnalysis of emotion recognition using facial expressions, speech and multimodal information
Busso, C., Deng, Z., Yildirim, S., Bulut, M., Lee, C. M., Kazemzadeh, A., Lee, S., Neumann, U., & Narayanan, S. (2004) · Proceedings of the 6th international conference on Multimodal interfaces · doi:10.1145/1027933.1027968 · Cited by 840
Self-citationDescribing the emotional states that are expressed in speech
Cowie, R., & Cornelius, R. R. (2003) · Speech Communication · doi:10.1016/s0167-6393(02)00071-7 · Cited by 604
ANVIL - a generic annotation tool for multimodal dialogue
Kipp, M. (2001) · 7th European Conference on Speech Communication and Technology (Eurospeech 2001) · doi:10.21437/eurospeech.2001-354 · Cited by 570
Embodiment in conversational interfaces: Rea
Cassell, J., Bickmore, T., Billinghurst, M., Campbell, L., Chang, K., Vilhjálmsson, H., & Yan, H. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.303150 · Cited by 566
Emotional speech: Towards a new generation of databases
Douglas-Cowie, E., Campbell, N., Cowie, R., & Roach, P. (2003) · Speech Communication · doi:10.1016/s0167-6393(02)00070-5 · Cited by 461
Experiencing emotion : a cross-cultural study
Scherer, K. R., Wallbott, H. G., & Summerfield, A. B. (1986) · Medical Entomology and Zoology · Cited by 419
Human Ethology: Claims and Limits of a New Discipline.
Lockard, J. S., von Cranach, M., & Werner-Reimers-Stiftung (1982) · Man · doi:10.2307/2802049 · Cited by 414
The Vera am Mittag German audio-visual emotional speech database
Grimm, M., Kroschel, K., & Narayanan, S. (2008) · 2008 IEEE International Conference on Multimedia and Expo · doi:10.1109/icme.2008.4607572 · Cited by 407
Self-citationThe SPHINX-II speech recognition system: an overview
Huang, X., Alleva, F., Hon, H.-W., Hwang, M.-Y., Lee, K.-F., & Rosenfeld, R. (1993) · Computer Speech & Language · doi:10.1006/csla.1993.1007 · Cited by 368
MPEG-4 Facial Animation: The Standard,Implementation and Applications
Pakštas, A., Forchheimer, R., & Pandzic, I. S. (2002) · John Wiley & Sons, Inc. eBooks · Cited by 346
Challenges in real-life emotion annotation and machine learning based detection
Devillers, L., Vidrascu, L., & Lamel, L. (2005) · Neural Networks · doi:10.1016/j.neunet.2005.03.007 · Cited by 342
Facial emotion recognition using multi-modal information
De Silva, L. C., Miyasato, T., & Nakatsu, R. (2002) · Proceedings of ICICS, 1997 International Conference on Information, Communications and Signal Processing. Theme: Trends in Information Systems Engineering and Wireless Multimedia Communications (Cat. No.97TH8237) · doi:10.1109/icics.1997.647126 · Cited by 319 · cited 2×
“Notice that some emotions are better perceived from audio (e.g., sadness) while others from video (e.g., anger) (De Silva et al. 1997).”
BackgroundMethodPrimitives-based evaluation and estimation of emotions in speech
Grimm, M., Kroschel, K., Mower, E., & Narayanan, S. (2007) · Speech Communication · doi:10.1016/j.specom.2007.01.010 · Cited by 291
Self-citationGratch, J., Okhmatovskaia, A., Lamothe, F., Marsella, S., Morales, M., van der Werf, R. J., & Morency, L.-P. (2006) · Lecture Notes in Computer Science · doi:10.1007/11821830_2 · Cited by 247 · cited 2×
“This implies that the speech of the active speaker is linked to the listener’s gestures, which can be exploited to improve human machine interfaces (e.g., Virtual Rapport (Gratch et al. 2006)).”
BackgroundDrenth, M. (2001) · Cited by 239
Gesture-Based Affective Computing on Motion Capture Data
Kapur, A., Kapur, A., Virji-Babul, N., Tzanetakis, G., & Driessen, P. F. (2005) · Lecture Notes in Computer Science · doi:10.1007/11573548_1 · Cited by 202
Face and 2-D mesh animation in MPEG-4
Tekalp, A. M., & Ostermann, J. (2000) · Signal Processing: Image Communication · doi:10.1016/s0923-5965(99)00055-7 · Cited by 200
MPEG‐4 Facial Animation: The Standard, Implementation And Applications
(2002) · Wiley eBooks · doi:10.1002/0470854626 · Cited by 192
Swarbrooke, J. (2007) · Elsevier eBooks · doi:10.1016/b978-0-7506-6735-7.50049-x · Cited by 182
Rigid Head Motion in Expressive Speech Animation: Analysis and Synthesis
Busso, C., Deng, Z., Grimm, M., Neumann, U., & Narayanan, S. (2007) · IEEE Transactions on Audio, Speech and Language Processing · doi:10.1109/tasl.2006.885910 · Cited by 180
Self-citationEvaluation of natural emotions using self assessment manikins
Grimm, M., & Kroschel, K. (2005) · IEEE Workshop on Automatic Speech Recognition and Understanding, 2005. · doi:10.1109/asru.2005.1566530 · Cited by 179
Lost Luggage: A Field Study of Emotion–Antecedent Appraisal
Scherer, K. R., & Ceschi, G. (1997) · Motivation and Emotion · doi:10.1023/a:1024498629430 · Cited by 165
Using Actor Portrayals to Systematically Study Multimodal Emotion Expression: The GEMEP Corpus
Bänziger, T., & Scherer, K. R. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-74889-2_42 · Cited by 157
Beyond emotion archetypes: Databases for emotion modelling using neural networks
Cowie, R., Douglas‐Cowie, E., & Cox, C. (2005) · Neural Networks · doi:10.1016/j.neunet.2005.03.002 · Cited by 155
Interrelation Between Speech and Facial Gestures in Emotional Utterances: A Single Subject Study
Busso, C., & Narayanan, S. S. (2007) · IEEE Transactions on Audio, Speech and Language Processing · doi:10.1109/tasl.2007.905145 · Cited by 149
Self-citationModeling naturalistic affective states via facial and vocal expressions recognition
Caridakis, G., Malatesta, L., Kessous, L., Amir, N., Raouzaiou, A., & Karpouzis, K. (2006) · Proceedings of the 8th international conference on Multimodal interfaces · doi:10.1145/1180995.1181029 · Cited by 131
Natural head motion synthesis driven by acoustic prosodic features
Busso, C., Deng, Z., Neumann, U., & Narayanan, S. S. (2005) · Computer Animation and Virtual Worlds · doi:10.1002/cav.80 · Cited by 98
Self-citationSteidl, S., Levit, M., Batliner, A., Noth, E., & Niemann, H. (2006) · Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005. · doi:10.1109/icassp.2005.1415114 · Cited by 94
Multimodal databases of everyday emotion: facing up to complexity
Douglas‐Cowie, E., Devillers, L. Y., Martin, J., Cowie, R., Savvidou, S., Abrilian, S., & Cox, C. (2005) · Interspeech (USB) · doi:10.21437/interspeech.2005-381 · Cited by 90
A State of the Art Review on Emotional Speech Databases
Ververidis, D., & Kotropoulos, K. (2003) · Cited by 90
Automatic analysis and recognition of brow actions and head motion in spontaneous facial behavior
Cohn, J. F., Reed, L. I., Ambadar, Z., Xiao, J., & Moriyama, T. (2005) · 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583) · doi:10.1109/icsmc.2004.1398367 · Cited by 88
Using neutral speech models for emotional speech analysis
Busso, C., Lee, S., & Narayanan, S. S. (2007) · Interspeech 2007 · doi:10.21437/interspeech.2007-605 · Cited by 82
Self-citationThe SmartKom Multimodal Corpus at BAS
Schiel, F., Steininger, S., & Türk, U. (2002) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/33yzs36hh5o2 · Cited by 64
Facial actions as visual cues for personality
Arya, A., Jefferies, L. N., Enns, J. T., & DiPaola, S. (2006) · Computer Animation and Virtual Worlds · doi:10.1002/cav.140 · Cited by 57
WHERE DID THE ANGER GO? THE ROLE OF CONTEXT IN INTERPRETING EMOTION IN SPEECH
Cauldwell, R. T. (2000) · Cited by 51
The expression and perception of emotions: comparing assessments of self versus others
Busso, C., & Narayanan, S. S. (2008) · Interspeech (USB) · doi:10.21437/interspeech.2008-92 · Cited by 42
Self-citationZara, A., Maffiolo, V., Martin, J. C., & Devillers, L. Y. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-74889-2_41 · Cited by 41
Busso, C., & Narayanan, S. S. (2008) · Interspeech (USB) · doi:10.21437/interspeech.2008-463 · Cited by 39
Self-citationInterplay between linguistic and affective goals in facial expression during emotional utterances
Busso, C., & Narayanan, S. S. (2006) · Cited by 39
Self-citationAn analysis of multimodal cues of interruption in dyadic spoken interactions
Lee, C.-C., Lee, S., & Narayanan, S. S. (2008) · Interspeech (USB) · doi:10.21437/interspeech.2008-366 · Cited by 31
Self-citationA Framework for Eliciting Emotional Speech: Capitalizing on the Actor’s Process
Hirschberg, J., & Enos, F. (2006) · HAL AMU · doi:10.7916/d88s4zcg · Cited by 31
Desperately Seeking Emotions Or: Actors, Wizards, And Human Beings
Batliner, A., Fischer, K., Huber, R., Spilker, J., & Nöth, E. (2000) · OPUS (Augsburg University) · Cited by 31
Joint Analysis of the Emotional Fingerprint in the Face and Speech: A single subject study
Busso, C., & Narayanan, S. S. (2007) · IEEE International Workshop on Multimedia Signal Processing (MMSP) · doi:10.1109/mmsp.2007.4412814 · Cited by 21
Self-citationThe SAFE Corpus: illustrating extreme emotions in dynamic situations
Clavel, C., Vasilescu, I., Devillers, L. Y., Gaël Richard, A., Ehrette, T., & Sedogbo, C. (2006) · HAL · Cited by 7
Research works printed but not linked: 4
- Amir, N., Ron, S., & Laor, N. (2000). Analysis of an emotional speech corpus in Hebrew based on objective criteria. In ISCA Tutorial and Research Workshop (ITRW) on Speech and Emotion (pp. 29–33). Newcastle, Northern Ireland, UK.
- Busso, C., & Narayanan, S. (2008b). Recording audio-visual emotional databases from actors: A closer look. In Second International Workshop on Emotion: Corpora for Research on Emotion and Affect, International Conference on Language Resources and Evaluation (LREC 2008) (pp. 17–22). Marrakech, Morocco.
- Fischer, L., Brauns, D., & Belschak, F. (2002). Zur Messung von Emotionen in der angewandten Forschung. Lengerich: Pabst Science Publishers.
- Vidrascu, L., & Devillers, L. (2006). Real-life emotions in naturalistic data recorded in a medical call center. In First International Workshop on Emotion: Corpora for Research on Emotion and Affect (International conference on Language Resources and Evaluation (LREC 2006)) (pp. 20–24). Genoa, Italy.
Cited by
Multimodal Transformer for Unaligned Multimodal Language Sequences
Tsai, Y.-H. H., Bai, S., Liang, P. P., Kolter, J. Z., Morency, L.-P., & Salakhutdinov, R. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1656 · Cited by 2,259
A review of affective computing: From unimodal analysis to multimodal fusion
Poria, S., Cambria, E., Bajpai, R., & Hussain, A. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.02.003 · Cited by 1,644
Multimodal Language Analysis in the Wild: CMU-MOSEI Dataset and Interpretable Dynamic Fusion Graph
Bagher Zadeh, A., Liang, P. P., Poria, S., Cambria, E., & Morency, L.-P. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1208 · Cited by 1,433
MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversations
Poria, S., Hazarika, D., Majumder, N., Naik, G., Cambria, E., & Mihalcea, R. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1050 · Cited by 1,416
“Busso et al. (2008) used two famous emotion taxonomies in order to manually label the dataset in utterance level: discrete categorical based annotations (i.e., labels such as happiness, anger, and sadness), and continuous attribute based annotations (i.e., activation, valence, and dominance).”
BackgroundMethodInfluentialEfficient Low-rank Multimodal Fusion With Modality-Specific Factors
Liu, Z., Shen, Y., Lakshminarasimhan, V. B., Liang, P. P., Bagher Zadeh, A., & Morency, L.-P. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1209 · Cited by 1,170
“We perform our experiments on the following multi-modal datasets, CMU-MOSI (Zadeh et al., 2016a POM (Park et al., 2014b), and IEMOCAP (Busso et al., 2008) for sentiment analysis, speaker traits recognition, and emotion recognition task, where the goal is to identify speakers emotions based on the speakers’ verbal and…”
BackgroundMethodInfluential
Metadata
- Authors
- Busso, C., Bulut, M., Lee, C.-C., Kazemzadeh, A., Mower, E., Kim, S., Chang, J. N., Lee, S., & Narayanan, S. S.
- Affiliations
- University of Southern California (US)
- Corresponding author
- Busso, Carlos
- Venue
- Language Resources and Evaluation
- Published
- 2008-11-05
- Volume
- 42
- Issue
- 4
- Pages
- 335-359
- ISSN
- 1574-020X (ISSN-L)
- 1574-0218
- OpenAlex
- W2146334809
- Cited by
- 3,869
- References
- 57
- Citations by year
- 2026: 518 · 2025: 651 · 2024: 503 · 2023: 534 · 2022: 393 · 2021: 397 · 2020: 266 · 2019: 189 · 2018: 133 · 2017: 68 · 2016: 40 · 2015: 54 · 2014: 36 · 2013: 35 · 2012: 19
- FWCI
- 15.00
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Language Resources and Evaluation (publishedVersion)
- Funders
- National Science Foundation
- Multidisciplinary University Research Initiative
- Office of Naval Research
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Human Motion and Animation
- Social Sciences › Psychology › Social Psychology › Health, Education, and Physical Culture
- Keywords
- IEMOCAP, emotion corpus, dyadic interaction, motion capture, facial expressions, hand gestures, speech and gesture, multimodal communication, emotion induction, happiness, anger, sadness, frustration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.