The SEMAINE Database: Annotated Multimodal Records of Emotionally Colored Conversations between a Person and a Limited Agent

McKeown, G., Valstar, M., Cowie, R., Pantic, M., Schroder, M.·2012·IEEE Transactions on Affective Computing
DOI 10.1109/t-affc.2011.20

Cited by (664)

Items 301–400 of 664

  1. MMDA: A Multimodal Dataset for Depression and Anxiety Detection
    Yueqi Jiang, Ziyang Zhang, Xiao Na Sun · 2023 · Lecture notes in computer science
  2. Analyzing Continuous-Time and Sentence-Level Annotations for Speech Emotion Recognition
    Luz Martinez-Lucas, Wei-Cheng Lin, Carlos Busso · 2024 · IEEE Transactions on Affective Computing
  3. Predicting Emotionally Salient Regions Using Qualitative Agreement of Deep Neural Network Regressors
    Srinivas Parthasarathy, Carlos Busso · 2018 · IEEE Transactions on Affective Computing
  4. The Audio-Visual Arabic Dataset for Natural Emotions
    Ftoon Abu Shaqra, Rehab Duwairi, Mahmoud Al‐Ayyoub · 2019 · International Conference on Future Internet of Things and Cloud (FiCloud)
  5. Advances in Emotion Recognition: Link to Depressive Disorder
    Xiaotong Cheng, Xiaoxia Wang, Tan-Te Ouyang, Zhengzhi Feng · 2020 · IntechOpen eBooks
  6. Investigating Context Awareness of Affective Computing Systems: A Critical Approach
    Aggeliki Vlachostergiou, G. Caridakis, S. Kollias · 2014 · International Conference on Intelligent Human Computer Interaction
  7. Use of a Hierarchical Oligonucleotide Primer Extension Approach for Multiplexed Relative Abundance Analysis of Methanogens in Anaerobic Digestion Systems
    Jer‐Horng Wu, Hui-Ping Chuang, Mao-Hsuang Hsu, Wei‐Yu Chen · 2013 · Applied and Environmental Microbiology
  8. Automatic Recognition of Affective Laughter in Spontaneous Dyadic Interactions from Audiovisual Signals
    Reshmashree B. Kantharaju, Fabien Ringeval, Laurent Besacier · 2018 · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
  9. MSP-Face Corpus
    Andrea Vidal, Ali N. Salman, Wei-Cheng Lin, Carlos Busso · 2020 · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
  10. Automatic Engagement Recognition for Distance Learning Systems: A Literature Study of Engagement Datasets and Methods
    Shofiyati Nur Karimah, Shinobu Hasegawa · 2021 · Lecture notes in computer science
  11. Cross-corpus analysis for acoustic recognition of negative interactions
    Iulia Lefter, Harold T. Nefs, Catholijn M. Jonker, Léon J. M. Rothkrantz · 2015 · International Conference on Affective Computing and Intelligent Interaction and workshops
  12. Spontaneous and Non-Spontaneous 3D Facial Expression Recognition Using a Statistical Model with Global and Local Constraints
    Diego Fabiano, Shaun J. Canavan · 2018 · Proceedings - International Conference on Image Processing
  13. Human emotion recognition by analyzing facial expressions, heart rate and blogs using deep learning method
    Rajib Ghosh, Ditipriya Sinha · 2022 · Innovations in Systems and Software Engineering
  14. From the Lab to the Wild: Affect Modeling Via Privileged Information
    Konstantinos Makantasis, Kosmas Pinitas, Antonios Liapis, Georgios N. Yannakakis · 2023 · IEEE Transactions on Affective Computing
  15. Empathic Grounding: Explorations using Multimodal Interaction and Large Language Models with Conversational Agents
    Mehdi Arjmand, Farnaz Nouraei, Ian Steenstra, Timothy Bickmore · 2024 · ACM International Conference on Intelligent Virtual Agents (IVA)
  16. Grounding the detection of the user’s likes and dislikes on the topic structure of human-agent interactions
    Caroline Langlet, Chloé Clavel · 2016 · Knowledge-Based Systems
  17. Facial Action Unit Recognition Augmented by Their Dependencies
    Longfei Hao, Shangfei Wang, Guozhu Peng, Qiang Ji · 2018 · International Conference on Automatic Face and Gesture Recognition
  18. Construction and analysis of Indonesian Emotional Speech Corpus
    Nurul Lubis, Dessi Puji Lestari, Ayu Purwarianti, Sakriani Sakti, Satoshi Nakamura · 2014 · International Conference on Speech Database and Assessments
  19. Predicting Folds in Poker Using Action Unit Detectors and Decision Trees
    Doratha Vinkemeier, Michel Valstar, Jonathan S. Gratch · 2018 · International Conference on Automatic Face and Gesture Recognition
  20. MES-P: An Emotional Tonal Speech Dataset in Mandarin with Distal and Proximal Labels
    Zhongzhe Xiao, Ying‐Yeh Chen, Weibei Dou, Zhi Tao, Liming Chen · 2019 · IEEE Transactions on Affective Computing
  21. A Large Scale Speech Sentiment Corpus
    Eric Chen, Zhiyun Lu, Hao Xu, Liangliang Cao, Yu Zhang, James Fan · 2020 · Language Resources and Evaluation
  22. Self-supervised learning of Dynamic Representations for Static Images
    Siyang Song, Enrique Sánchez, Linlin Shen, Michel Valstar · 2021 · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition
  23. Continuous prediction of perceived traits and social dimensions in space and time
    Oya Çeliktutan, Hatice Güneş · 2014 · Proceedings - International Conference on Image Processing
  24. A database for emotional interactions of the elderly
    Kunxia Wang, Zongbao Zhu, Shidong Wang, Xiao Na Sun, Lian Li · 2016 · IEEE/ACIS International Conference on Computer and Information Science (ICIS)
  25. The JESTKOD database: an affective multimodal database of dyadic interactions
    Elif Bozkurt, Hossein Khaki, Sinan Keçeci, Bekir Berker Türker, Y. Yemez, Engin Erzin · 2016 · Language Resources and Evaluation
  26. RFAU: A Database for Facial Action Unit Analysis in Real Classrooms
    Qiaoping Hu, Chuanneng Mei, Fei Jiang, Ruimin Shen, Yitian Zhang, Ce Wang, Junpeng Zhang · 2020 · IEEE Transactions on Affective Computing
  27. Distributional analysis of copredication: Towards distinguishing systematic polysemy from coercion
    Elisabetta Ježek, Laure Vieu · 2014 · Pisa University Press eBooks
  28. 4D Cardiff Conversation Database (4D CCDb): A 4D database of natural,dyadic conversations
    Andrew D. Marshall, Paul L. Rosin, Jason Vandeventer, Andrew J. Aubrey · 2015 · ORCA Online Research @Cardiff (Cardiff University)
  29. Machine Learning Methods for Social Signal Processing
    Ognjen Oggi Rudovic, Mihalis A. Nicolaou, Vladimir Pavlović · 2017 · Cambridge University Press eBooks
  30. DialogueCRN: Contextual Reasoning Networks for Emotion Recognition in Conversations
    Dou Hu, Lingwei Wei, Xiaoyong Huai · 2021 · arXiv (Cornell University)
  31. Audio spectrogram analysis in IoT paradigm for the classification of psychological-emotional characteristics
    Ankit Kumar, Sushil Kumar Singh, Indu Bhardwaj, Prakash Kumar Singh, Ashish Kumar Khanna, Biswajit Brahma · 2024 · International Journal of Information Technology
  32. Topic Switch Models for Dialogue Management in Virtual Humans
    Wenjue Zhu, Andry Chowanda, Michel Valstar · 2016 · Lecture notes in computer science
  33. Joint Discrete and Continuous Emotion Prediction Using Ensemble and End-to-End Approaches
    Ehab A. AlBadawy, Yelin Kim · 2018 · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
  34. The OMG-Empathy Dataset: Evaluating the Impact of Affective Behavior in Storytelling
    Pablo V. A. Barros, Nikhil Churamani, Angelica Lim, Stefan Wermter · 2019 · International Conference on Affective Computing and Intelligent Interaction and workshops
  35. Detecting Depression in Videos using Uniformed Local Binary Pattern on Facial Features
    Bryan G. Dadiz, Conrado R. Ruiz Jr. · 2018 · Lecture notes in electrical engineering
  36. Towards a Better Gold Standard
    Chen Wang, Phil Lopes, Thierry Pun, Guillaume Chanel · 2018
  37. From Smart to Personal Environment: Integrating Emotion Recognition into Smart Houses
    Dmitrii Fedotov, Yuki Matsuda, Wolfgang Minker · 2019 · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops)
  38. Analysis of conversational listening skills toward agent-based social skills training
    Hiroki Tanaka, Hidemi Iwasaka, Hideki Negoro, Satoshi Nakamura · 2019 · Journal on Multimodal User Interfaces
  39. Personality-Based Affective Adaptation Methods for Intelligent Systems
    Krzysztof Kutt, Dominika Drążyk, Szymon Bobek, Grzegorz Jacek Nalepa · 2020 · Sensors
  40. NAA: A multimodal database of negative affect and aggression
    Iulia Lefter, Catholijn M. Jonker, Stéphanie Klein Tuente, Wim Veling, Stefan Bogaerts · 2017 · International Conference on Affective Computing and Intelligent Interaction and workshops
  41. Different Contextual Window Sizes Based RNNs for Multimodal Emotion Detection in Interactive Conversations
    Helang Lai, Hongying Chen, Shuangyan Wu · 2020 · IEEE Access
  42. Enriching Existing Conversational Emotion Datasets with Dialogue Acts using Neural Annotators
    Chandrakant Bothe, C. Weber, Sven Magg, Stefan Wermter · 2019 · arXiv.org
  43. A multimodal fusion-based deep learning framework combined with local-global contextual TCNs for continuous emotion recognition from videos
    Congbao Shi, Yuanyuan Zhang, Baolin Liu · 2024 · Applied Intelligence
  44. On the Influence of Emotional Feedback on Emotion Awareness and Gaze Behavior
    Fabien Ringeval, Andreas Sonderegger, Basilio Noris, Aude Billard, Juergen Sauer, Denis Lalanne · 2013 · International Conference on Affective Computing and Intelligent Interaction and workshops
  45. Relevance units machine based dimensional and continuous speech emotion prediction
    Fengna Wang, H. Sahli, Junbin Gao, Dong-Mei Jiang, W. Verhelst · 2015 · Multimedia tools and applications
  46. Dynamic Behavior Analysis via Structured Rank Minimization
    Christos Georgakis, Yannis Panagakis, Maja Pantić · 2017 · International Journal of Computer Vision
  47. Automatic recognition of self-reported and perceived emotions
    Biqiao Zhang, Emily Mower Provost · 2018 · Elsevier eBooks
  48. Adapting sentiment analysis to face-to-face human-agent interactions: From the detection to the evaluation issues
    Caroline Langlet, Chloé Clavel · 2015 · International Conference on Affective Computing and Intelligent Interaction and workshops
  49. Building a Corpus and a Local Binary Pattern Recognizer for Learning-Centered Emotions
    Ramón Zataraín Cabada, María Lucía Barrón Estrada, Francisco González-Hernández, Raúl Oramas Bustillos, Giner Alor‐Hernández, Carlos Alberto Reyes-Garcia · 2017 · Lecture notes in computer science
  50. EmoTour
    Yuki Matsuda, Dmitrii Fedotov, Yuta Takahashi, Yutaka Arakawa, Keiichi Yasumoto, Wolfgang Minker · 2018 · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp)
  51. A Cantonese Audio-Visual Emotional Speech (CAVES) dataset
    Chee Seng Chong, Chris Davis, Jeesun Kim · 2023 · Behavior Research Methods
  52. Multi-corpus Experiment on Continuous Speech Emotion Recognition: Convolution or Recurrence?
    Manon Macary, Martin Lebourdais, Marie Tahon, Yannick Estève, Anthony Rousseau · 2020 · Lecture notes in computer science
  53. Investigation of the Effect of Increased Dimension Levels in Speech Emotion Recognition
    Haiyan Wang, Xiaohui Zhao, Yanping Zhao · 2022 · IEEE Access
  54. Continuous Mapping of Personality Traits
    Heysem Kaya, Albert Ali Salah · 2014
  55. An investigation of emotion changes from speech
    Zhaocheng Huang · 2015 · International Conference on Affective Computing and Intelligent Interaction and workshops
  56. Do you speak to a human or a virtual agent? automatic analysis of user’s social cues during mediated communication
    Magalie Ochs, Nathan Libermann, Axel Boidin, Thierry Chaminade · 2017 · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
  57. Handling missing labels and class imbalance challenges simultaneously for facial action unit recognition
    Yongqiang Li, Baoyuan Wu, Yong-Ping Zhao, Hongxun Yao, Qiang Ji · 2019 · Multimedia Tools and Applications
  58. Evaluation of syllable rate estimation in expressive speech and its contribution to emotion recognition
    Mohammed Abdelwahab, Carlos Busso · 2014 · IEEE Spoken Language Technology Workshop (SLT)
  59. Using Nonverbal Cues in Empathic Multi-Modal LLM-Driven Chatbots for Mental Health Support MHCI039
    Matthias Schmidmaier, Jonathan Rupp, Cedrik Harrich, Sven Mayer · 2025 · Proceedings of the ACM on Human-Computer Interaction
  60. Review and Comparative Analysis of Databases for Speech Emotion Recognition
    Salvatore Serrano, Omar Serghini, Giulia Esposito, Silvia Carbone, C. Mento, A. Floris, Simone Porcu, L. Atzori · 2025 · International Conference on Data Technologies and Applications
  61. Emotion and Its Triggers in Human Spoken Dialogue: Recognition and Analysis
    Nurul Lubis, Sakriani Sakti, Graham Neubig, Tomoki Toda, Ayu Purwarianti, Satoshi Nakamura · 2016 · Signals and communication technology
  62. MuDERI: Multimodal Database for Emotion Recognition Among Intellectually Disabled Individuals
    Jainendra Shukla, Miguel Barreda-Ángeles, Joan Oliver, Domènec Puig · 2016 · Lecture notes in computer science
  63. Analysis of Depression Based on Facial Cues on A Captured Motion Picture
    Bryan G. Dadiz, Nelson Marcos · 2018 · IEEE International Conference on Signal and Image Processing (ICSIP)
  64. Biosignal-based user-independent recognition of emotion and personality with importance weighting
    Shun Katada, Shogo Okada · 2022 · Multimedia Tools and Applications
  65. FEAFA+: an extended well-annotated dataset for facial expression analysis and 3D facial animation
    Wei Gan, Jian Xue, Ke Lu, Yanfu Yan, Pengcheng Gao, Jiayi Lyu · 2022 · International Conference on Digital Image Processing
  66. Factor Analysis Based Speaker Normalisation for Continuous Emotion Prediction
    Ting Dang, Vidhyasaharan Sethu, Eliathamby Ambikairajah A · 2016 · Interspeech (USB)
  67. The development of the Athens Emotional States Inventory (AESI): collection, validation and automatic processing of emotionally loaded sentences
    Chaspari, Theodora, Soldatos, Constantin, Maragos, Petros · 2015 · The World Journal of Biological Psychiatry
  68. Modeling Emotion Dynamics in Song Lyrics with State Space Models
    Yingjin Song, Daniel Beck · 2023 · Transactions of the Association for Computational Linguistics
  69. Navigating sentiment analysis through fusion, learning, utterance, and attention Methods: An extensive four-fold perspective survey
    Bhavana Verma, Priyanka Meel, Dinesh Kumar Vishwakarma · 2025 · Engineering Applications of Artificial Intelligence
  70. A Comprehensive Review of Unimodal and Multimodal Emotion Detection: Datasets, Approaches, and Limitations
    Priyanka Thakur, Nirmal Kaur, Naveen Aggarwal, Sarbjeet Singh · 2025 · Expert Systems
  71. Significance of natural elicitation in developing simulated full blown speech emotion databases
    D. Pravena, S Nandhakumar, D. Govind · 2016 · IEEE Students’ Technology Symposium
  72. Sequential Modeling by Leveraging Non-Uniform Distribution of Speech Emotion
    Wei-Cheng Lin, Carlos Busso · 2023 · IEEE/ACM Transactions on Audio Speech and Language Processing
  73. EmoTwiCS: a corpus for modelling emotion trajectories in Dutch customer service dialogues on Twitter
    Sofie Labat, Thomas Demeester, Véronique Hoste · 2023 · Language Resources and Evaluation
  74. PsyMo: A Dataset for Estimating Self-Reported Psychological Traits from Gait
    Adrian Cosma, Emilian Rǎdoi · 2024 · IEEE Winter Conference on Applications of Computer Vision
  75. Continuous affect prediction using eye gaze and speech
    Jonny O’Dwyer, Ronan Flynn, Niall Murray · 2017 · IEEE International Conference on Bioinformatics and Biomedicine (BIBM)
  76. Fifty Shades of Green
    Brandon M. Booth, Shrikanth Shri Narayanan · 2020 · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
  77. Acoustic and lexical representations for affect prediction in spontaneous conversations
    Houwei Cao, Arman Savran, Ragini Verma, Ani Nenkova · 2014 · Computer Speech & Language
  78. Glowworm swarm based fuzzy classifier with dual features for speech emotion recognition
    B. Rajasekhar, Maddu Kamaraju, V. Sumalatha · 2019 · Evolutionary Intelligence
  79. Personality Perception of Robot Avatar Teleoperators in Solo and Dyadic Tasks
    Paul Bremner, Oya Çeliktutan, Hatice Güneş · 2017 · Frontiers in Robotics and AI
  80. Leveraging the Deep Learning Paradigm for Continuous Affect Estimation from Facial Expressions
    Meshia Cédric Oveneke, Yong Hui Zhao, Ercheng Pei, Abel Díaz Berenguer, Dongmei Jiang, Hichem Sahli B · 2019 · IEEE Transactions on Affective Computing
  81. Generating Emotionally Aligned Responses in Dialogues using Affect Control Theory
    Nabiha Asghar, Ivan Kobyzev, Jesse Hoey, Pascal Poupart, Muhammad Bilal Sheikh · 2020 · arXiv (Cornell University)
  82. A Comprehensive Survey on Multi-Modal Conversational Emotion Recognition with Deep Learning
    Yuntao Shou, Tao Meng, Wei Ai, Nan Yin, Keqin Li · 2024 · SSRN Electronic Journal
  83. IMAPS: A smart phone based real-time framework for prediction of affect in natural dyadic conversation
    A K M Mahbubur Rahman, Md. Iftekhar Tanveer, Asm Iftekhar Anam, Mohammed Yeasin · 2012 · Visual Communications and Image Processing
  84. Emotional and User-Specific Acoustic Cues for Improved Analysis of Naturalistic Interactions
    Ingo Siegert · 2015 · Künstliche Intell.
  85. Probabilistic Subpixel Temporal Registration for Facial Expression Analysis
    Evangelos Sarıyanidi, Hatice Güneş, Andrea Cavallaro · 2015 · Lecture notes in computer science
  86. COVID-19: Affect recognition through voice analysis during the winter lockdown in Scotland
    Sofia de la Fuente García, Fasih Haider, Saturnino F. Luz · 2021 · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)
  87. Whose emotion matters? Speaking activity localisation without prior knowledge
    Hugo Carneiro, Cornelius Weber, Stefan Wermter · 2023 · Neurocomputing
  88. Spectro-Temporal Energy Ratio Features for Single-Corpus and Cross-Corpus Experiments in Speech Emotion Recognition
    Cevahir Parlak, Banu Di̇ri̇, Yusuf Altun · 2023 · Arabian Journal for Science and Engineering
  89. Empathetic Response Generation for Distress Support
    Anuradha Welivita, Chun-Hung Yeh, Pearl Pu · 2023 · Annual Meeting of the Special Interest Group on Discourse and Dialogue
  90. Turing's menagerie: Talking lions, virtual bats, electric sheep and analogical peacocks: Common ground and common interest are necessary components of engagement
    Gary John McKeown · 2015 · International Conference on Affective Computing and Intelligent Interaction and workshops
  91. Facial Actions as Social Signals
    Michel Valstar, Stefanos P. Zafeiriou, Maja Pantić · 2017 · Cambridge University Press eBooks
  92. Recognizing Emotionally Coloured Dialogue Speech Using Speaker-Adapted DNN-CNN Bottleneck Features
    Kohei Mukaihara, Sakriani Sakti, Satoshi Nakamura · 2017 · Lecture notes in computer science
  93. Continuous facial expression recognition for affective interaction with virtual avatar
    Zhengkun Shang, Jyoti Joshi, Jesse Hoey · 2017 · Proceedings - International Conference on Image Processing
  94. Confusion Detection Dataset of Mouse and Eye Movements
    Michal Hučko, Róbert Móro, Mária Bieliková · 2020 · ACM Conference on User Modeling, Adaptation and Personalization (UMAP)
  95. Dual-Waveform Emotion Recognition Model for Conversations
    Jiayi Zhang, Zihe Liu, Peihang Liu, Bin Wu · 2021 · IEEE International Conference on Multimedia and Expo (ICME)
  96. A multi-modal deep learning system for Arabic emotion recognition
    Ftoon Abu Shaqra, Rehab Duwairi, Mahmoud Al‐Ayyoub · 2022 · International Journal of Speech Technology
  97. Prediction of Emotion Change From Speech
    Zhaocheng Huang, Julien Epps · 2018 · Frontiers in ICT
  98. Editorial: IEEE Transactions on Affective Computing—Challenges and Chances
    Björn Wolfgang Schuller · 2017 · IEEE Transactions on Affective Computing
  99. Multimodal Transformer Fusion for Emotion Recognition: A Survey
    Amdjed Belaref, Renaud Séguier · 2024
  100. Emozionalmente: A Crowdsourced Corpus of Simulated Emotional Speech in Italian
    Fabio Catania, Jordan W. Wilke, Franca Garzotto · 2025 · IEEE Transactions on Audio Speech and Language Processing