NNIME: The NTHU-NTUA Chinese interactive multimodal emotion corpus
The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
The increasing availability of large-scale emotion corpus along with the advancement in emotion recognition algorithms have enabled the emergence of next-generation human-machine interfaces. This paper describes a newly-collected multimodal corpus, i.e., the NTHU-NTUA Chinese Interactive Emotion Corpus (NNIME). The database is a result of the collaborative work between engineers and drama experts. This database includes recordings of 44 subjects engaged in spontaneous dyadic spoken interactions. The multimodal data includes approximately 11-hour worth of audio, video, and electrocardiogram data recorded continuously and synchronously. The database is also completed with a rich set of emotion annotations on discrete and continuous-in-time annotation by a total of 49 annotators. Thees emotion annotations include a diverse perspectives: peer-report, director-report, self-report, and observer-report. This carefully-engineered data collection and annotation processes provide an additional valuable resource to quantify and investigate various aspects of affective phenomenon and human communication. To our best knowledge, the NNIME is one of the few large-scale Chinese affective dyadic interaction database that have been systematically collected, organized, and to be publicly-released to the research community.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Structurally, the NNIME dataset comprises 6701 sentences and includes both discrete and continuous emotion labels.”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [29]
In the citing paper
“The NTHU-NTUA Chinese Interactive Emotion Corpus (NNIME) [29] is a groundbreaking initiative aimed at creating an interactive multimodal corpus for Chinese emotional expressions.”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [29]
Citations
Cites
Picard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
Praat, a system for doing phonetics by computer
Boersma, P. (2002) · UvA-DARE (University of Amsterdam) · Cited by 4,417
IEMOCAP: Interactive emotional dyadic motion capture database
Busso, C., Bulut, M., Lee, C.-C., Kazemzadeh, A., Mower, E., Kim, S., Chang, J. N., Lee, S., & Narayanan, S. S. (2008) · Language Resources and Evaluation · doi:10.1007/s10579-008-9076-6 · Cited by 3,869 · cited 6×
“Furthermore, due to its similarity in the design with the IEMOCAP and the CreativeIT, the idiosyncratic factor in the database design can be much mitigated.”
MethodSelf-citationAction Recognition with Improved Trajectories
Wang, H., & Schmid, C. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.441 · Cited by 3,407
Exploiting Generative Models in Discriminative Classifiers
Jaakkola, T., & Haussler, D. H. (1998) · Cited by 1,271
The devil is in the details: an evaluation of recent feature encoding methods
Chatfield, K., Lempitsky, V., Vedaldi, A., & Zisserman, A. (2011) · Procedings of the British Machine Vision Conference 2011 · doi:10.5244/c.25.76 · Cited by 834 · cited 1×
“In order to encode the sequence of LLDs to a fixed-length high-dimensional session-level features, we use the GMM based Fishervector encoding [30], [31], i.”
MethodIntroducing the RECOLA multimodal corpus of remote collaborative and affective interactions
Ringeval, F., Sonderegger, A., Sauer, J., & Lalanne, D. (2013) · 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2013.6553805 · Cited by 771 · cited 4×
“RECOLA [17] 46 6 Audio, Video, ECG, EDA Dyadic French Spont.”
BackgroundInfluentialFEELTRACE: an instrument for recording perceived emotion in real time
Cowie, R., Douglas‐Cowie, E., Savvidou, S. M., & McMahon, E. R. (2000) · Research Portal (Queen's University Belfast) · Cited by 539
Effects of Dyadic Interaction on Argumentive Reasoning
Kuhn, D., Shaw, V., & Felton, M. (1997) · Cognition and Instruction · doi:10.1207/s1532690xci1503_1 · Cited by 475 · cited 1×
“Dyadic interaction is a basic unit of face-to-face interaction providing an important gateway for humans to convey emotion, communicate information, and foster mutual understanding [4], [5], [6], [7].”
BackgroundMother and infant at play: The dyadic interaction involving facial, vocal, and gaze behaviors.
Stern, D. N. (1974) · Cited by 459
Research works printed but not linked: 5
- busso, 2008, Recording audio-visual emotional databases from actors: a closer look, Second International Workshop on Emotion Corpora for Research on Emotion and Affect International conference on Language Resources and Evaluation (LREC 2008), 17
- knapp, 2013, Nonverbal communication in human interaction Cengage Learning
- 10.1037/0033-2909.89.1.101 · doi:10.1037/0033-2909.89.1.101 · Paper page
- 10.1037/0012-1649.33.3.538 · doi:10.1037/0012-1649.33.3.538 · Paper page
- nogueiras, 2002, Speech emotion recognition using hidden markov models, speech prosody 2002, an International Conference France, 11
Cited by
A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face
Lian, H., Lu, C., Li, S., Zhao, Y., Tang, C., & Zong, Y. (2023) · Entropy · doi:10.3390/e25101440 · Cited by 224
“The NTHU-NTUA Chinese Interactive Emotion Corpus (NNIME) [29] is a ground-breaking initiative aimed at creating an interactive multimodal corpus for Chinese emotional expressions.”
BackgroundSpeech Emotion Recognition Using Deep Neural Network Considering Verbal and Nonverbal Speech Sounds
Huang, K.-Y., Wu, C.-H., Hong, Q.-B., Su, M.-H., & Chen, Y.-H. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8682283 · Cited by 116
“Different from other scripted emotion speech database or segmented audio from dramas, NTHU-NTUA Chinese Interactive Multimodal Emotion Corpus (NNIME) [18], one of the few large-scale Chinese affective dyadic interaction database which contains various emotional nonverbal sounds, such as laughter,”
BackgroundInfluentialMulti-modal emotion recognition using EEG and speech signals
Wang, Q., Wang, M., Yang, Y., & Zhang, X. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.105907 · Cited by 100
George, S. M., & Ilyas, P. M. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.127015 · Cited by 125
Speech Emotion Recognition Considering Nonverbal Vocalization in Affective Conversations
Hsu, J.-H., Su, M.-H., Wu, C., & Chen, Y. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3076364 · Cited by 84
Chou, H.-C., & Lee, C.-C. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8682170 · Cited by 90
“, NNIME [20], to further justify its robustness.”
BackgroundSelf-citationMultimodal emotion recognition: A comprehensive review, trends, and challenges
Ramaswamy, M. P. A., & Palaniswamy, S. (2024) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1563 · Cited by 70
Khan, U. A., Xu, Q., Liu, Y. M., Lagstedt, A., Alamäki, A. V., & Kauttonen, J. (2024) · Multimedia Systems · doi:10.1007/s00530-024-01302-2 · Cited by 85
A Comprehensive Survey on Tiny Machine Learning for Human Behavior Analysis
Lamaakal, I., Essahraui, S., Maleh, Y., Makkaoui, K. E., Ouahbi, I., Bouami, M. F., El‐Latif, A. A. A., Almousa, M., Peng, J., & Niyato, D. T. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3565688 · Cited by 76
“The NNIME Dataset [223] is a multimodal database, including audio, video, and ECG records.”
Context-Aware Personality Inference in Dyadic Scenarios: Introducing the UDIVA Dataset
Palmero, C., Selva, J., Smeureanu, S., Jacques, J. C. S., Clapés, A., Moseguí, A., Zhang, Z., Gallardo, D., Guilera, G., Leiva, D., et al. (2021) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw52041.2021.00005 · Cited by 90
“In di vi du al Stable (across sessions) Age Self-reported [17, 75]→ [0, 1] 1D Gender Self-reported {F,M} → {0, 1} 1D”
BackgroundMethodHEU Emotion: a large-scale database for multimodal emotion recognition in the wild
Chen, J., Wang, C., Wang, K., Yin, C., Zhao, C., Xu, T., Zhang, X., Huang, Z., Liu, M., & Yang, T. (2021) · Neural Computing and Applications · doi:10.1007/s00521-020-05616-w · Cited by 65
“It can be found in previous work that bored is selected in FABO dataset [20], disappointed is collected in NNIME dataset [6], and confused is marked in EMOTIC dataset [28].”
BackgroundMethodInfluentialDeep Learning Approaches for Stress Detection: A Survey
Kyrou, M., Kompatsiaris, I., & Petrantonakis, P. C. (2024) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2024.3455371 · Cited by 66
“…drove the same highway under four distinct conditions: no distraction, cognitive distraction, emotional distraction, and sensorimotor distraction. b) NTHU-NTUA Chinese Interactive Multimodal Emotion Corpus (NNIME): NNIME [93] is a multimodal database consisting of audio, video, and ECG recordings.”
Siddiqui, M. F. H., Dhakal, P., Yang, X., & Javaid, A. Y. (2022) · Multimodal Technologies and Interaction · doi:10.3390/mti6060047 · Cited by 59
Busso, C., Lotfian, R., Sridhar, K., Salman, A. N., Lin, W.-C., Goncalves, L., Parthasarathy, S., Naini, A. R., Leem, S.-G., Martinez-Lucas, L., et al. (2026) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2026.3678489 · Cited by 63
“…semi-structured scenarios designed to evoke natural emotional responses [6], [7], [8], recording colloquial conversation between participants [9], [10], utilizing acted TV shows as source for emotional content [11], [12], [13], and collecting data from audio and video sharing platforms [14],…”
Self-citationDeep Cross-Corpus Speech Emotion Recognition: Recent Advances and Perspectives
Zhang, S., Liu, R., Tao, X., & Zhao, X. (2021) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2021.784514 · Cited by 58
“NNIME The NTHU-NTUA Chinese Interactive Emotion Corpus (NNIME) (Chou et al., 2017) is a multimodal spontaneous emotional database, collected from 44 speakers (22 females, 22 males), involved in spontaneous dyadic spoken interactions.”
BackgroundEAV: EEG-Audio-Video Dataset for Emotion Recognition in Conversational Contexts
Lee, M.-H., Shomanov, A., Begim, B., Kabidenova, Z., Nyssanbay, A., Yazıcı, A., & Lee, S. (2024) · Scientific Data · doi:10.1038/s41597-024-03838-4 · Cited by 63
“These dialogues were skillfully performed by professional actors 15,17,18,20,22 , or they involved participants engaging with examiners 16,19 in predefined interaction scenarios designed to elicit specific target emotions.”
BackgroundEssahraui, S., Lamaakal, I., Maleh, Y., Makkaoui, K. E., Bouami, M. F., Ouahbi, I., El‐Latif, A. A. A., Almousa, M., & Rodrigues, J. J. P. C. (2025) · IEEE Access · doi:10.1109/access.2025.3589938 · Cited by 44
“The NNIME dataset [67] includes synchronized audio, video, and ECG recordings from 44 professionally trained actors participating in 102 dyadic interaction sessions.”
Survey of deep emotion recognition in dynamic data using facial, speech and textual cues
Zhang, T., & Tan, Z. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-023-17944-9 · Cited by 46
A review and critical analysis of multimodal datasets for emotional AI
Al-Azani, S., & El-Alfy, E.-S. M. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11271-1 · Cited by 40
Dudzik, B., Jansen, M.-P., Burger, F., Kaptein, F., Broekens, J., Heylen, D., Hung, H., Neerincx, M. A., & Truong, K. P. (2019) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2019.8925446 · Cited by 32
“conversation language is Chinese [16] or Dutch [18] for all captured interactions.”
BackgroundLee, C.-C., Chaspari, T., Provost, E. M., & Narayanan, S. S. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2023.3276209 · Cited by 31
Self-citationLu, C.-C., Li, J.-L., & Lee, C.-C. (2018) · doi:10.1145/3266302.3266306 · Cited by 21
“We evaluate this front-end network on two separate emotion corpora, the USC IEMOCAP database [5] and the NNIME database [7].”
BackgroundMethodSelf-citationEmojilization: An Automated Method For Speech to Emoji-Labeled Text
Hu, J., Xu, Q., Fu, L. P., & Xu, Y. (2019) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3290607.3313071 · Cited by 19
“11 Mandarin conversations[6] with different topics, different emotional atmospheres, and by different speakers were prepared.”
BackgroundOpen-Emotion: A Reproducible EMO-Superb For Speech Emotion Recognition Systems
Wu, H., Chou, H.-C., Chang, K.-W., Goncalves, L., Du, J., Jang, J. R., Lee, C.-C., & Lee, H.-Y. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832296 · Cited by 17
“The BIIC-NNIME [8], referred to as NNIME , consists of video, audio, and physiology recordings of dyadic conversations acted by 43 actors in Mandarin Chinese.”
Self-citationReview and Comparative Analysis of Databases for Speech Emotion Recognition
Serrano, S., Serghini, O., Esposito, G., Carbone, S., Mento, C., Floris, A., Porcu, S., & Atzori, L. (2025) · Data · doi:10.3390/data10100164 · Cited by 15
Al-Saadawi, H. F. T., Daş, B., & Daş, R. (2024) · Displays · doi:10.1016/j.displa.2024.102731 · Cited by 15
Werewolf-XL: A Database for Identifying Spontaneous Affect in Large Competitive Group Interactions
Zhang, K., Wu, X., Xie, X., Zhang, X., Zhang, H., Chen, X., & Sun, L. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2021.3101563 · Cited by 13
“The NTHU-NTUA interactive multi-modal emotion (NNIME) corpus [35] contains approximately 11 h of audio, video, and ECG data of 44 subjects engaged in carefully-designe-d spontaneous dyadic spoken interactions.”
BackgroundMethodInfluentialResearch on Chinese Speech Emotion Recognition Based on Deep Neural Network and Acoustic Features
Lee, M.-C., Yeh, S., Chang, J.-W., & Chen, Z.-Y. (2022) · Sensors · doi:10.3390/s22134744 · Cited by 15
Chang, C.-M., Su, B.-H., Lin, S.-C., Li, J.-L., & Lee, C.-C. (2017) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2017.8273627 · Cited by 13
“In this work, we utilize two emotion corpora: one of them is an English database, the USC CreativeIT database (CIT) [16], and a Chinese database, the NTHU-NTUA Chinese Interactive Multimodal Emotion Corpus (NNIME) [17].”
BackgroundMethodSelf-citationAffective Computing Databases: In-Depth Analysis of Systematic Reviews and Surveys
Vaz, P. J., Rodrigues, J. M. F., & Cardoso, P. J. S. (2024) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2024.3507289 · Cited by 14
voc2vec: A Foundation Model for Non-Verbal Vocalization
Koudounas, A., Quatra, M. L., Siniscalchi, S. M., & Baralis, E. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890672 · Cited by 11
“NNIME [26] is a Chinese affective dataset that features dyadic interactions in naturalistic settings.”
A Cantonese Audio-Visual Emotional Speech (CAVES) dataset
Chong, C. S., Davis, C., & Kim, J. (2023) · Behavior Research Methods · doi:10.3758/s13428-023-02270-7 · Cited by 12
“The second dataset is the National Tsing Hua Univer-sity-National Taiwan University of Arts Chinese Interactive Emotion (NNIME) dataset (Chou et al., 2017).”
MethodChien, W.-S., Chou, H.-C., & Lee, C.-C. (2021) · Companion Publication of the International Conference on Multimodal Interaction (ICMI Companion) · doi:10.1145/3461615.3485411 · Cited by 10
“The number of multi-head attentions is 8, the number of BLSTM nodes is fixed as [2, 4, 8], batch size is fixed as [8, 16], the max epoch is 1000, the drop out is set to 0.”
BackgroundMethodSelf-citationCross-corpus speech emotion recognition using subspace learning and domain adaption
Cao, X., Jia, M., Ru, J., & Pai, T. (2022) · EURASIP Journal on Audio Speech and Music Processing · doi:10.1186/s13636-022-00264-5 · Cited by 9
“• I-N: IEMOCAP is the source domain dataset, and NNIME is the target domain dataset.”
MethodInfluentialChou, H.-C., & Lee, C.-C. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-1714 · Cited by 8
“Specifically, we proposed a network architecture to perform per-rater emotion recognition by simultaneously leveraging the label uncertainty and the co-raters annotations on the IEMOCAP [22] and the NNIME [23] database.”
MethodSelf-citationEMOLIPS: Towards Reliable Emotional Speech Lip-Reading
Ryumin, D., Рюмина, Е. В., & Ivanko, D. (2023) · Mathematics · doi:10.3390/math11234787 · Cited by 6
“The NNIME [95] is a Chinese interactive multimodal emotion corpus.”
BackgroundDeep Emotion Recognition using Facial, Speech and Textual Cues: A SurveyPreprint
Zhang, T., & Tan, Z. (2021) · doi:10.36227/techrxiv.15184302.v2 · Cited by 9
Chang, C.-M., & Lee, C.-C. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8683059 · Cited by 4
“The NNIME is a new multimodal Mandarin Chinese affective interaction corpus.”
MethodSelf-citationRISC: A Corpus for Shout Type Classification and Shout Intensity Prediction
Fukumori, T., Ishida, T., & Yamashita, Y. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3473302 · Cited by 4
“Hsu et al. [35] assigned labels of either “laughter,” “breathing,” “shout,” or “background” to a subset of the speech samples in the emotional speech corpus named NNIME [36].”
BackgroundSpeech Emotion Recognition Applied to Real-World Medical Consultation
Huang, C.-T., Huang, C., Yang, H., & Li, Y. (2024) · Studies in health technology and informatics · doi:10.3233/shti231139 · Cited by 3
Datasets for Valence and Arousal Inference: A Survey
Schneider, H. M., Pavlitska, S., Gremmelmaier, H., & Zöllner, J. M. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00563 · Cited by 4
Vaiani, L., Koudounas, A., Quatra, M. L., Cagliero, L., Garza, P., & Baralis, E. (2022) · doi:10.1145/3551876.3554801 · Cited by 5
“Nonverbal Vocalization [16, 18] is a specific AER subtask (hereafter denoted by AER-NV), which has already been addressed in the context of multimodal learning [10].”
BackgroundCai, T., Wang, S., Xiong, Y., & Zhong, X. R. (2024) · Communications in computer and information science · doi:10.1007/978-981-97-0730-0_19 · Cited by 3
Deep Emotion Recognition using Facial, Speech and Textual Cues: A SurveyPreprint
Zhang, T., & Tan, Z. (2021) · doi:10.36227/techrxiv.15184302 · Cited by 4
Jiang, Z., Long, Y., Zhang, X., Liu, Y., & Bai, X. (2025) · Behavior Research Methods · doi:10.3758/s13428-024-02595-x · Cited by 2
“…corpora: one is the database of Chinese vocal emotional stimuli developed in Canada (Liu & Pell, 2012), and the other is the NTHU-NTUA [National Tsing Hua University–National Taiwan University of Arts] Chinese Interactive Multimodal Emotion Corpus (NNIME; Chou et al., 2017) created in Taiwan.”
A Chinese natural speech complex emotion dataset based on emotion vector annotation method
Wu, X., Song, C., Xiang, S., Cao, R., Feng, C., Yilahun, H., Xu, M., Hamdulla, A., & Zheng, T. F. (2025) · Language Resources and Evaluation · doi:10.1007/s10579-025-09845-0 · Cited by 4
“In elicited datasets (e.g., NNIME (Chou et al., 2017)), speakers are asked to communicate spontaneously based on a topic rather than relying on a specific script.”
Song, Y., Chen, J., & Lin, L. (2025) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2025.109377 · Cited by 2
Empower Typed Descriptions by Large Language Models for Speech Emotion Recognition
Wu, H., Chou, H.-C., Chang, K.-W., Goncalves, L., Du, J., Jang, J. R., Lee, C.-C., & Lee, H.-Y. (2024) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc63619.2025.10848758 · Cited by 2
“In future work, we will use other databases containing typed descriptions, such as MSP-IMPROV [5] and NNIME [32] and other LLMs to investigate the generalization of the proposed method.”
Self-citationLi, J.-L., & Lee, C.-C. (2018) · Interspeech (USB) · doi:10.21437/interspeech.2018-1455 · Cited by 2
“We evaluate our proposed framework for the task of dialog-level emotion recognition in two different databases: the Cre-ativeIT (CIT) [20] and the NNIME database [21].”
MethodSelf-citationChang, C.-M., & Lee, C.-C. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2021.3126145 · Cited by 3
“The NNIME is a public multimodal Mandarin Chinese corpus that uses a similar setup as the USC CreativeIT database [16].”
MethodSelf-citationAnalytical Review of Methods for Automatic Analysis of Extra-Linguistic Units in Spontaneous Speech
Поволоцкая, А. А., & Karpov, A. A. (2024) · Informatics and Automation · doi:10.15622/ia.23.1.1 · Cited by 2
Cheng, M., Tseng, C., Fujiwara, K., Schneider, V., & Kitamura, Y. (2025) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii67994.2025.11772167 · Cited by 12
Chou, H.-C., Chang, C.-M., Liu, Y.-S., Kao, S.-K., & Lee, C.-C. (2017) · International Conference on Computational Linguistics
Self-citationDo Minority Views in Perceptual Evaluations Affect Confidence of Speech Emotion Classifiers?
Chou, H.-C. (2022) · International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW) · doi:10.1109/aciiw57231.2022.10085994
“, USC-IEMOCAP [32], MSPIMPROV [33], and NTHU-NNIME [34]), I choose to use the MSP-Podcast corpus [35] to evaluate our proposed method because the data source is in the wild instead acted emotional”
MethodSelf-citationMMEmAsis: multimodal emotion and sentiment analysis
Kiselev, G., Lubysheva, Y. M., & Weizenfeld, D. (2024) · Вестник Российского университета дружбы народов. Серия: Математика, информатика, физика · doi:10.22363/2658-4670-2024-32-4-370-379
Bridging the Modality Gap: Semantic-Calibrated Zero-shot Speech Emotion Captioning
Wang, J., Zhang, X., & Qu, X. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11229201 · Cited by 1
Bahrova, J., Augustýnek, M., Kubíček, J., Tomaszek, L., & Malčík, M. (2026) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2026.3682324
“(Table S13 lists additional video-based datasets, [68], [70], [95], [98], [99], [101], [102], [103], [104], [105], [106], [107], [108], [109], [110], [111], [112], [113], [114], [115], [116], [117], [118], [119], [120], [121].)”
Priyadarshini, S. B. B., Panda, S., Dutta, P. K., & Ortiz, F. (2026) · Springer tracts in additive manufacturing · doi:10.1007/978-3-032-21869-8_28
Wang, J., Wu, H., Li, L., Fang, X., & Li, Q. (2026) · Scientific Data · doi:10.1038/s41597-026-08006-4
Jostschulte, J. (2026) · International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW) · doi:10.1109/aciiw71585.2026.11712071
“In this case annotation of data can be conducted using the Self-Assessment Manikin (SAM) [15] like in [11] or reduced to the two dimensions valence and arousal like in [16].”
Metadata
- Authors
- Chou, H.-C., Lin, W.-C., Chang, L.-C., Li, C.-C., Ma, H.-P., & Lee, C.-C.
- Affiliations
- National Tsing Hua University (TW)
- National Taiwan University of Arts (TW)
- Venue
- 2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII)
- Publisher
- IEEE
- Published
- 2017-10
- Pages
- 292-298
- ISSN
- 2156-8103 (ISSN-L)
- OpenAlex
- W2785952417
- Cited by
- 57
- References
- 29
- Citations by year
- 2026: 4 · 2025: 10 · 2024: 13 · 2023: 5 · 2022: 6 · 2021: 9 · 2020: 1 · 2019: 5 · 2018: 2 · 2017: 2
- FWCI
- 3.14
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Affective Computing and Intelligent Interaction and workshops (publishedVersion)
- Funders
- National Taiwan University
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Social Sciences › Linguistics and Language › Linguistic Studies and Language Acquisition
- Keywords
- dyadic interaction, spontaneous conversation, emotion annotation, electrocardiogram, human-machine interaction, emotional communication
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.