The SEMAINE Database: Annotated Multimodal Records of Emotionally Colored Conversations between a Person and a Limited Agent

McKeown, G., Valstar, M., Cowie, R., Pantic, M., Schroder, M.·2012·IEEE Transactions on Affective Computing
DOI 10.1109/t-affc.2011.20

Cited by (664)

Items 401–500 of 664

  1. The MSP-Podcast Corpus
    Carlos Busso, Reza Lotfian, Kusha Sridhar, Ali N. Salman, Wei-Cheng Lin, Lucas Goncalves, Srinivas Parthasarathy, Abinay Reddy Naini, Seong-Gyun Leem, Luz Martinez-Lucas et al. · 2026 · IEEE Transactions on Affective Computing
  2. Advancements in Multimodal Emotion Recognition: Integrating Facial Expressions and Physiological Signals
    Ajantha Devi Vairamani · 2024 · The Springer series in applied machine learning
  3. Real-Time Emotion Recognition from Natural Bodily Expressions in Child-Robot Interaction
    Weiyi Wang, Γεώργιος Αθανασόπουλος, Georgios Patsis, Valentin Enescu, Hichem Sahli B · 2015 · Lecture notes in computer science
  4. Cross-Corpus Experiments on Laughter and Emotion Detection in HRI with Elderly People
    Marie Tahon, Mohamed A. Sehili, Laurence Y. Devillers · 2015 · Lecture notes in computer science
  5. Emotion Understanding Using Multimodal Information Based on Autobiographical Memories for Alzheimer’s Patients
    Juan Manuel Fernández Montenegro, Athanasios Gkelias, Vasileios Argyriou · 2017 · Lecture notes in computer science
  6. Crowdsourcing Emotional Speech
    Jennifer G. Smith, Andreas Tsiartas, Valerie Wagner, Elizabeth E. Shriberg, Nikoletta Bassiou · 2018 · IEEE International Conference on Acoustics Speech and Signal Processing
  7. Leveraging the Dynamics of Non-Verbal Behaviors For Social Attitude Modeling
    Soumia Dermouche, Catherine Pélachaud · 2020 · IEEE Transactions on Affective Computing
  8. Introducing MULAI : A Multimodal Database of Laughter during Dyadic Interactions
    Michel-Pierre Jansen, Khiet P. Truong, Dirk Heylen, Deniece S. Nazareth · 2020 · University of Twente Research Information
  9. MEMOS: A Multi-modal Emotion Stream Database for Temporal Spontaneous Emotional State Detection
    Yan Li, Xiaohan Xia, Dongmei Jiang, Hichem Sahli B, Ramesh Jain · 2020 · Companion Publication of the International Conference on Multimodal Interaction (ICMI Companion)
  10. Knowing Your Annotator: Rapidly Testing the Reliability of Affect Annotation
    Matthew Barthet, Chintan G. Trivedi, Kosmas Pinitas, Emmanouil Xylakis, Konstantinos Makantasis, Antonios Liapis, Georgios N. Yannakakis · 2023 · International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW)
  11. Modelling of Emotional Development within Human-Computer-Interaction
    Ingo Siegert, Kim Hartmann, Stefan Glüge, Andreas Wendemuth · 2013 · DuEPublico (University of Duisburg-Essen)
  12. A study of social-affective communication: Automatic prediction of emotion triggers and responses in television talk shows
    Nurul Lubis, Sakriani Sakti, Graham Neubig, Koichiro Yoshino, Tomoki Toda, Satoshi Nakamura · 2015 · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU)
  13. Temporal Association Rules for Modelling Multimodal Social Signals
    Thomas Janssoone · 2015 · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
  14. A Multimodal Annotation Schema for Non-Verbal Affective Analysis in the Health-Care Domain
    Federico M. Sukno, Mónica Domínguez, Adrià Ruiz, Dominik Schiller, Florian Lingenfelser, Louisa Pragst, Ekeni Kamateri, Stefanos Vrochidis · 2016
  15. Robust modeling of epistemic mental states
    A K M Mahbubur Rahman, Asm Iftekhar Anam, Mohammed Yeasin · 2020 · Multimedia Tools and Applications
  16. Contactless Human Emotion Analysis Across Different Modalities
    Nazmun Nahid, Arafat Rahman, Md Atiqur Rahman Ahad · 2021 · Intelligent systems reference library
  17. Emotion recognition based on the energy distribution of plosive syllables
    Abdellah Agrima, Ilham Mounir, Abdelmajid Farchi, Laila Elmaazouzi, Badia Mounir · 2022 · International Journal of Power Electronics and Drive Systems/International Journal of Electrical and Computer Engineering
  18. Automatic gaze analysis in multiparty conversations based on Collective First-Person Vision
    Shiro Kumano, Kazuhiro Otsuka, Ryo Ishii, Junji Yamato · 2015 · International Conference on Automatic Face and Gesture Recognition
  19. Domain adversarial learning for emotion recognition
    Zheng Lian, Jianhua Tao, Bin Liu, Jian Huang · 2019 · arXiv (Cornell University)
  20. Deep Emotion Recognition using Facial, Speech and Textual Cues: A Survey
    Tao Zhang, Zhenhua Tan · 2021
  21. GFT Facial Expression Database
    Jeffrey M. Girard, Wen-Sheng Chu, László A. Jeni, Jeffrey F. Cohn, Fernando N. de la Torre, Michael A. Sayette · 2018
  22. SAAML: A Framework for Semi-supervised Affective Adaptation via Metric Learning
    Minh Tran, Yelin Kim, Che-Chun Su, Cheng-Hao Kuo, M. Soleymani · 2023 · ACM Multimedia
  23. Multimodal Emotion Detection and Analysis from Conversational Data
    Abhinay Jatoth, Faranak Abri, Tien Nguyen · 2025 · Journal of Advances in Information Technology
  24. Empirical analysis of continuous affect
    Peter Robinson, Tadas Baltrušaitis · 2015 · International Conference on Affective Computing and Intelligent Interaction and workshops
  25. Play SMILE Game with ERiSA: A User Study on Game Companions
    Andry Chowanda, Peter Blanchfield, Martin Flintham, Michel Valstar · 2015
  26. Emotion Mining: from Unimodal to Multimodal Approaches
    Chiara Zucco, Barbara Calabrese, Mario Cannataro · 2021 · Lecture notes in computer science
  27. A Neural Architecture Search for Automated Multimodal Learning
    Anuraj Singh, Haritha Nair · 2022 · Expert Systems with Applications
  28. Compensation Techniques for Speaker Variability in Continuous Emotion Prediction
    Ting Dang, Vidhyasaharan Sethu, Eliathamby Ambikairajah A · 2018 · IEEE Transactions on Affective Computing
  29. DBATES: Dataset for Discerning Benefits of Audio, Textual, and Facial Expression Features in Competitive Debate Speeches
    Taylan Sen, Gazi Naven, Luke Gerstner, Daryl Bagley, Raiyan Abdul Baten, Wasifur Rahman, Md Kamrul Hasan, Kurtis Glenn Haut, Abdullah Al Mamun, Samiha Samrose et al. · 2021 · IEEE Transactions on Affective Computing
  30. Building autonomous sensitive artificial listeners (Extended abstract)
    Marc Schroder, Elisabetta Bevacqua, Roddy Cowie, Florian Eyben, Hatice Güneş, Dirk Heylen, Mark ter Maat, Gary John McKeown, Sathish Pammi, Maja Pantić et al. · 2015 · International Conference on Affective Computing and Intelligent Interaction and workshops
  31. A longitudinal database of Irish political speech with annotations of speaker ability
    Ailbhe Cullen, Naomi Harte · 2017 · Language Resources and Evaluation
  32. Multimodal cross-context recognition of negative interactions
    Iulia Lefter, Léon J. M. Rothkrantz · 2017 · International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW)
  33. Automatic speech discrete labels to dimensional emotional values conversion method
    Shaoling Jing, Xia Mao, Lijiang Chen · 2018 · IET Biometrics
  34. Emotion Recognition Using a Convolutional Neural Network
    Ramón Zataraín Cabada, María Lucía Barrón Estrada, Francisco González-Hernández, Hector Rodriguez-Rangel · 2018 · Lecture notes in computer science
  35. Deep Analysis for Speech Emotion Recognization
    Sudipta Bhattacharya, Samarjeet Borah, Brojo Kishore Mishra, Nabanita Das · 2022 · International Conference on Computer Science, Engineering and Applications (ICCSEA)
  36. Agreement and disagreement classification of dyadic interactions using vocal and gestural cues
    Hossein Khaki, Elif Bozkurt, Engin Erzin · 2016 · IEEE International Conference on Acoustics Speech and Signal Processing
  37. Automated Mental State Detection for Mental Health Care
    Sidney K. D'Mello · 2016 · Elsevier eBooks
  38. Emotion Recognition Based Preference Modelling in Argumentative Dialogue Systems
    Niklas Rach, Klaus Weber, Annalena Bea Aicher, Florian Lingenfelser, Elisabeth André, Wolfgang Minker · 2019 · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops)
  39. A Comprehensive Survey on Datasets for Affective Computing and Mental Disorder
    Rodrigo Bessa Sze, Wladmir Cardoso Brandão · 2025 · IEEE Transactions on Affective Computing
  40. Detection of nonlinguistic vocalizations using ALISP sequencing
    Sathish Pammi, Houssemeddine Khemiri, Dijana Petrovska‐Delacrétaz, Gérard Chollet · 2013 · IEEE International Conference on Acoustics Speech and Signal Processing
  41. Real-time Incremental Processing
    Florian Eyben · 2015 · Springer theses
  42. Eliciting Positive Emotional Impact in Dialogue Response Selection
    Nurul Lubis, Sakriani Sakti, Koichiro Yoshino, Satoshi Nakamura · 2018 · Lecture notes in electrical engineering
  43. Impact of Annotation Modality on Label Quality and Model Performance in the Automatic Assessment of Laughter In-the-Wild
    Jose Vargas Quiros, Laura Cabrera-Quirós, Catharine Oertel, Hayley Hung · 2023 · IEEE Transactions on Affective Computing
  44. EMOLIPS: Towards Reliable Emotional Speech Lip-Reading
    Dmitry Ryumin, Елена Витальевна Рюмина, Denis Ivanko · 2023 · Mathematics
  45. Multimodal Fusion with LLMs for Engagement Prediction in Natural Conversation
    Cheng Ma, Hyekang Kevin Joo, Alexandria Katarina Vail, Sunreeta Bhattacharya, Álvaro Fernández García, Kailana Baker-Matsuoka, Sheryl Mathew, Lori L. Holt, Fernando De la Torre · 2025 · Companion Publication of the International Conference on Multimodal Interaction (ICMI Companion)
  46. Identity-Free Artificial Emotional Intelligence via Micro-Gesture Understanding
    Rong Gao, Xiaojing Liu, Bohao Xing, Zitong Yu, Bjorn W. Schuller, Heikki A. Kalviainen · 2026 · IEEE Transactions on Affective Computing
  47. Fusion of Valence and Arousal Annotations through Dynamic Subjective Ordinal Modelling
    Adrià Ruiz, Oriol Martínez, Xavier Binefa, Federico M. Sukno · 2017 · International Conference on Automatic Face and Gesture Recognition
  48. Gestural prosody and the expression of emotions: A perceptual and acoustic experiment.
    Mario Augusto de Souza Fontes, Sandra Madureira · 2015 · ICPhS
  49. Gesture based fear recognition using nonperformance dataset from VR horror games
    Xinyi Fu, Cheng Qi Xue, Qiuyi Yin, Yu Jiang, Ye Li, Yichen Cai, Weilin Sun · 2021 · International Conference on Affective Computing and Intelligent Interaction and workshops
  50. PUMAVE-D: panjab university multilingual audio and video facial expression dataset
    Lovejit Singh, Naveen Aggarwal, Sarbjeet Singh · 2022 · Multimedia Tools and Applications
  51. Understanding conversational interaction in multiparty conversations: the EVA Corpus
    Izidor Mlakar, Darinka Verdonik, Simona Majhenič, Matej Rojc · 2022 · Language Resources and Evaluation
  52. The eHRI database: a multimodal database of engagement in human–robot interactions
    Ege Kesim, Tugce Numanoglu, Öykü Zeynep Bayramoğlu, Bekir Berker Türker, Nusrah Hussain, Tevfik Metin Sezgin, Y. Yemez, Engin Erzin · 2023 · Language Resources and Evaluation
  53. Multi-modal Arousal and Valence Estimation under Noisy Conditions
    Denis Dresvyanskiy, Maxim Markitantov, Jiawei Yu, Heysem Kaya, Alexey Anatolievich Karpov · 2024 · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
  54. Differential Evolution to Optimize Hidden Markov Models Training: Application to Facial Expression Recognition
    Khadoudja Ghanem, Amer Draa, Elvis Vyumvuhore, Arsene Simbabawe · 2015 · Journal of Computing and Information Technology
  55. Emotion recognition from multi-modal information
    Chung‐Hsien Wu, Jen‐Chun Lin, Wen-Li Wei, Kuan-Chun Cheng · 2013 · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC)
  56. Unsupervised Counselor Dialogue Clustering for Positive Emotion Elicitation in Neural Dialogue System
    Nurul Lubis, Sakriani Sakti, Koichiro Yoshino, Satoshi Nakamura · 2018 · Annual Meeting of the Special Interest Group on Discourse and Dialogue
  57. Detecting User's Likes and Dislikes for a Virtual Negotiating Agent
    Caroline Langlet, Chloé Clavel · 2018 · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
  58. Speech, Head, and Eye-based Cues for Continuous Affect Prediction
    Jonny O’Dwyer · 2019 · International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW)
  59. A Character Expression Model Affecting Spoken Dialogue Behaviors
    Kenta Yamamoto, Koji Inoue, Shizuka Nakamura, Katsuya Takanashi, Tatsuya Kawahara · 2020 · Lecture notes in electrical engineering
  60. Emotion and Disposition Detection in Medical Machines: Chances and Challenges
    Kim Hartmann, Ingo Siegert, Dmytro Prylipko · 2014 · International series on intelligent systems, control and automation: science and engineering
  61. Surprise and human-agent interactions
    Chloé Clavel · 2015 · Review of Cognitive Linguistics
  62. Towards 4D Coupled Models of Conversational Facial Expression Interactions
    Jason Vandeventer, Lukas Gräser, Magdalena Rychlowska, Paul L. Rosin, Dave Marshall · 2015 · British Machine Vision Conference (BMVC)
  63. Affective Voice Recognition of Older Adults1
    Alexander Hong, Yuma Tsuboi, Goldie Nejat, Beno Benhabib · 2016 · Journal of Medical Devices
  64. Multimodal Surveillance: Behavior analysis for recognizing stress and aggression
    Iulia Lefter · 2014 · Research Repository (Delft University of Technology)
  65. Human-Robot Interactions for Single Robots and Multi-Robot Teams
    Alexander Hong · 2016 · TSpace (University of Toronto)
  66. Inferring Dynamic Representations of Facial Actions from a Still Image
    Siyang Song, Enrique Sánchez, Linlin Shen, Alan Johnston, Michel Valstar · 2019 · arXiv (Cornell University)
  67. Proceedings of The 3rd Workshop on e-Commerce and NLP
    2020
  68. People make mistakes: Obtaining accurate ground truth from continuous annotations of subjective constructs
    Brandon M. Booth, Shrikanth Shri Narayanan · 2024 · Behavior Research Methods
  69. Analysis of the Impact of Foreign Language Learners Emotional State on Learning Outcomes
    Qiangwei Lu · 2025 · IEEE Access
  70. Emotion Detection in Conversation Using Class Weights
    Chandni Dave, Manish Khare · 2021 · International Conference on Soft Computing & Machine Intelligence (ISCMI)
  71. “xīnlĭ” The Social Media App to Replenish Mental Health with the Aid of an Egocentric Network
    Shadini Kalansooriya, Aloka Kaluarachchi, Chamudi Weerawickrama, Didula Nanayakkara, Dharshana Kasthurirathna, Dimuth Adeepa · 2022 · IEEE Region Humanitarian Technology Conference
  72. Dimensional Emotion Annotation for Spontaneous Tunisian Dialect Speech
    Latifa Iben Nasr, Abir Masmoudi, Lamia Hadrich Belguith · 2024 · IEEE International Conference on Enabling Technologies: Infrastructure for Collaborative Enterprises (WETICE)
  73. A Multimodal Approach for Emotion Recognition in Conversations Using the MELD Dataset
    Jiarong He · 2025 · Asia-Europe Conference on Cybersecurity, Internet of Things and Soft Computing (CITSC)
  74. Datasets for Valence and Arousal Inference: A Survey
    Helen M. Schneider, Svetlana Pavlitska, Helen Gremmelmaier, J. Marius Zöllner · 2025 · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
  75. Enhancing emotion classification on the ISEAR dataset using fine-tuning and data augmentation with hybrid transformer models
    Uzair Muhammad, Khalil Ullah, Ibrar Hussain, Sulaiman Sulmi Almutairi, Ikram Syed, Mohammed Abohashrh · 2025 · PeerJ Computer Science
  76. Late Integration Of Features For Acoustic Emotion Recognition
    Ailbhe Cullen, Naomi Harte · 2013 · Zenodo (CERN European Organization for Nuclear Research)
  77. Continuous Emotion Recognition: Another Look at the Regression Problem
    Pouria Fewzee, Fakhri Karray · 2013 · International Conference on Affective Computing and Intelligent Interaction and workshops
  78. Facial Action Recognition in 2D and 3D
    Michel Valstar, Stefanos P. Zafeiriou, Maja Pantić · 2014 · Advances in computational intelligence and robotics book series
  79. Giving Computers Personality? Personality in Computers is in the Eye of the User
    Jörg Frommer, Dietmar Rösner, Julia Lange, Matthias Haase · 2013 · CRC Press eBooks
  80. Significance of exploring pitch only features for the recognition of spontaneous emotions from speech signals
    A Pooja, D. Pravena, D. Govind · 2017 · International Conference on Advances in Computing, Communications and Informatics (ICACCI)
  81. Multimodal user state and trait recognition: an overview
    Björn Wolfgang Schuller · 2018 · ACM eBooks
  82. RETRACTED ARTICLE: An adaptive speech signal processing for COVID-19 detection using deep learning approach
    Kawther A. Al‐Dhlan · 2021 · International Journal of Speech Technology · Retracted
  83. Sequential Models for Automatic Personality Recognition from Multimodal Information in Social Interactions
    Jeanfed Ramirez Lima, Hugo Jair Escalante, Luis Villaseñor-Pineda · 2022 · IEEE International Autumn Meeting on Power, Electronics and Computing (ROPEC)
  84. Findings of WASSA 2023 Shared Task on Empathy, Emotion and Personality Detection in Conversation and Reactions to News Articles
    Valentin Barrière, João Sedoc, Shabnam Tafreshi, Salvatore Giorgi · 2023 · Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis (WASSA)
  85. From Chatter to Matter: Addressing Critical Steps of Emotion Recognition Learning in Task-oriented Dialogue
    Shutong Feng, Nurul Lubis, Benjamin Ruppik, Christian Geishauser, Michael C. Heck, Hsien-chin Lin, Carel van Niekerk, Renato Vukovic, Milica Gašić · 2023 · Annual Meeting of the Special Interest Group on Discourse and Dialogue
  86. Trusted emotion recognition based on multiple signals captured from video and its application in intelligent education
    Junjie Zhang, Cheng Fei, Yaqian Zheng, Kun Zheng, Sarah Mazhar, Yu Li · 2024 · Electronic Research Archive
  87. Interactive Conversational Head Generation
    Mohan Zhou, Yalong Bai, Wei Zhang, Ting Yao, Tiejun Zhao · 2025 · IEEE Transactions on Pattern Analysis and Machine Intelligence
  88. Continuous affect prediction using eye gaze
    Jonny O’Dwyer, Ronan Flynn, Niall Murray · 2017 · Irish Signals and Systems Conference
  89. Artificial Neural Network vs. Support Vector Machine For Speech Emotion Recognition
    Mohamed. A. Ahmad · 2023 · Tikrit Journal of Pure Science
  90. The Multimodal Dataset of Negative Affect and Aggression
    Iulia Lefter, Siska Fitrianie · 2018 · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
  91. Joint Multi-Dimensional Model for Global and Time-Series Annotations
    Anil Ramakrishna, Rahul Gupta, Shrikanth Shri Narayanan · 2020 · IEEE Transactions on Affective Computing
  92. To Improve Is to Change: Towards Improving Mood Prediction by Learning Changes in Emotion
    Soujanya Narayana, Ramanathan Subramanian, Ibrahim Radwan, Roland Goecke · 2022 · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
  93. Deep Learning-Based Assessment of Facial Periodic Affect in Work-Like Settings
    Siyang Song, Yiming Luo, Vincenzo Ronca, Gianluca Borghini, Hesam Sagha, Vera Rick, Alexander Mertens, Hatice Güneş · 2023 · Lecture notes in computer science
  94. Towards the generation of dialogue acts in socio-affective ECAs: a corpus-based prosodic analysis
    Rachel Bawden, Chloé Clavel, Frédéric Landragin · 2015 · Language Resources and Evaluation
  95. A New Multi-modal Dataset for Human Affect Analysis
    Haolin Wei, David S. Monaghan, Noel Edward O'Connor, Patricia Scanlon · 2014 · Lecture notes in computer science
  96. Disposition Recognition from Spontaneous Speech Towards a Combination with Co-speech Gestures
    Ronald Böck, Kirsten Bergmann, Petra Jaecks · 2015 · Lecture notes in computer science
  97. Emotion Recognition Modulating the Behavior of Intelligent Systems
    Asim Smailagic, Daniel P. Siewiorek, Alexander I. Rudnicky, Sandeep Nallan Chakravarthula, Anshuman Kar, Nivedita Jagdale, Saksham Gautam, Rohit Vijayaraghavan, Shaurya Jagtap · 2013 · IEEE International Symposium on Multimedia (ISM)
  98. Construction and analysis of social-affective interaction corpus in English and Indonesian
    Nurul Lubis, Sakriani Sakti, Graham Neubig, Tomoki Toda, Satoshi Nakamura · 2015 · International Conference Oriental COCOSDA held jointly with Conference on Asian Spoken Language Research and Evaluation
  99. SubjectBook
    Salah Taamneh, Malcolm Dcosta, Kyeong-An Kwon, Ioannis T. Pavlidis · 2016 · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA)
  100. Construction of Japanese Audio-Visual Emotion Database and Its Application in Emotion Recognition
    Nurul Lubis, Randy Gómez, Sakriani Sakti, Keisuke Nakamura, Koichiro Yoshino, Satoshi Nakamura, Kazuhiro Nakadai · 2016 · Language Resources and Evaluation Conference (LREC)