The SEMAINE Database: Annotated Multimodal Records of Emotionally Colored Conversations between a Person and a Limited Agent

McKeown, G., Valstar, M., Cowie, R., Pantic, M., Schroder, M.·2012·IEEE Transactions on Affective Computing
DOI 10.1109/t-affc.2011.20

Cited by (664)

Items 201–300 of 664

  1. Modeling both Intra- and Inter-modal Influence for Real-Time Emotion Detection in Conversations
    Dong Zhang, Weisheng Zhang, Shoushan Li, Qiaoming Zhu, Guodong Zhou · 2020 · ACM International Conference on Multimedia (ACM MM)
  2. Summarize before Aggregate: A Global-to-local Heterogeneous Graph Inference Network for Conversational Emotion Recognition
    Dongming Sheng, Dong Wang, Ying Shen, Hai-Tao Zheng, Haozhuang Liu · 2020 · International Conference on Computational Linguistics
  3. Learning a sparse codebook of facial and body microexpressions for emotion recognition
    Yale Song, Louis‐Philippe Morency, Randall Davis · 2013 · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
  4. The Ambiguous World of Emotion Representation
    Vidhyasaharan Sethu, E. Provost, J. Epps, C. Busso, Nicholas Cummins, Shrikanth S. Narayanan · 2019 · arXiv.org
  5. 3D model-based continuous emotion recognition
    Hui Chen, Jiangdong Li, Fengjun Zhang, Yang Li, Hongan Wang · 2015 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  6. Automatic Sentiment Detection in Naturalistic Audio
    Lakshmish Kaushik, Abhijeet Sangwan, John H. L. Hansen · 2017 · IEEE/ACM Transactions on Audio Speech and Language Processing
  7. EmoInt-Trans: A Multimodal Transformer for Identifying Emotions and Intents in Social Conversations
    Gopendra Vikram Singh, Mauajama Firdaus, Asif Ekbal, Pushpak Bhattacharyya · 2022 · IEEE/ACM Transactions on Audio Speech and Language Processing
  8. Practical considerations on the use of preference learning for ranking emotional speech
    Reza Lotfian, Carlos Busso · 2016 · IEEE International Conference on Acoustics Speech and Signal Processing
  9. Multimodal Analysis and Estimation of Intimate Self-Disclosure
    Mohammad Soleymani, Kalin Stefanov, Sin‐Hwa Kang, Jan Ondras, Jonathan S. Gratch · 2019 · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
  10. Understanding Naturalistic Facial Expressions with Deep Learning and Multimodal Large Language Models
    Yifan Bian, Dennis Küster, Hui Liu, Eva G. Krumhuber · 2023 · Sensors
  11. ERiSA: Building Emotionally Realistic Social Game-Agents Companions
    Andry Chowanda, Peter Blanchfield, Martin Flintham, Michel Valstar · 2014 · Lecture notes in computer science
  12. Virtual Human Questionnaire for Analysis of Depression, Anxiety and Personality
    Shashank Jaiswal, Michel Valstar, Keerthy Kusumam, Chris Greenhalgh · 2019 · ACM International Conference on Intelligent Virtual Agents (IVA)
  13. Shared acoustic codes underlie emotional communication in music and speech—Evidence from deep transfer learning
    Eduardo Coutinho, Björn Wolfgang Schuller · 2017 · PLoS ONE
  14. A review of multimodal-based emotion recognition techniques for cyberbullying detection in online social media platforms
    Shuai Wang, Abdul Samad Shibghatullah, Thirupattur Javid Iqbal, Kay Hooi Keoy · 2024 · Neural Computing and Applications
  15. EAV: EEG-Audio-Video Dataset for Emotion Recognition in Conversational Contexts
    Min-Ho Lee, Adai Shomanov, Balgyn Begim, Zhuldyz Kabidenova, Aruna Nyssanbay, Adnan Yazıcı, Seong–Whan Lee · 2024 · Scientific Data
  16. Emotion Recognition in the Wild
    Fabien Ringeval, Shahin Amiriparian, Florian Eyben, Klaus R. Scherer, Björn Wolfgang Schuller · 2014 · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
  17. An audio-visual dataset of human–human interactions in stressful situations
    Iulia Lefter, Gertjan J. Burghouts, Léon J. M. Rothkrantz · 2014 · Journal on Multimodal User Interfaces
  18. Let me tell you about your personality!: Real-time personality prediction from nonverbal behavioural cues
    Oya Çeliktutan, Evangelos Sarıyanidi, Hatice Güneş · 2015 · International Conference on Automatic Face and Gesture Recognition
  19. FEAFA: A Well-Annotated Dataset for Facial Expression Analysis and 3D Facial Animation
    Yanfu Yan, Ke Lü, Jian Xue, Pengcheng Gao, Jiayi Lyu · 2019 · IEEE International Conference on Multimedia & Expo Workshops (ICMEW)
  20. Pose-based Body Language Recognition for Emotion and Psychiatric Symptom Interpretation
    Zhengyuan Yang, Amanda Kay, Yuncheng Li, Wendi F. Cross, Jiebo Luo · 2021 · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition
  21. Continuous Emotion Recognition with Audio-visual Leader-follower Attentive Fusion
    Su Zhang, Yi Ding, Ziquan Wei, Cuntai Guan · 2021 · IEEE International Conference on Computer Vision Workshops
  22. Towards Robust Real-Time Valence Recognition from Facial Expressions for Market Research Applications
    Jens-Uwe Garbas, Tobias Ruf, Matthias Unfried, Anja Dieckmann · 2013 · International Conference on Affective Computing and Intelligent Interaction and workshops
  23. Facial Expression Recognition in the Presence of Speech Using Blind Lexical Compensation
    Soroosh Mariooryad, Carlos Busso · 2015 · IEEE Transactions on Affective Computing
  24. Detecting Learner Engagement in MOOCs using Automatic Facial Expression Recognition
    Dubbaka Abhilash, Anandha Gopalan · 2020 · IEEE Global Engineering Education Conference (EDUCON)
  25. Separable convolutional neural networks for facial expressions recognition
    Andry Chowanda · 2021 · Journal Of Big Data
  26. Effects of Physiological Signals in Different Types of Multimodal Sentiment Estimation
    Shun Katada, Shogo Okada, Kazunori Komatani · 2022 · IEEE Transactions on Affective Computing
  27. Impact of the face registration techniques on facial expressions recognition
    Benjamin Allaert, José Mennesson, Ioan Marius Bilasco, Chabane Djeraba · 2017 · Signal Processing Image Communication
  28. Distribution-based iterative pairwise classification of emotions in the wild using LGBP-TOP
    Timur R. Almaev, Anıl Yüce, Alexandru Ghitulescu, Michel Valstar · 2013 · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
  29. A survey of dialogic emotion analysis: Developments, approaches and perspectives
    Chenquan Gan, Jiahao Zheng, Qingyi Zhu, Yang Cao, Ye Zhu · 2024 · Pattern Recognition
  30. A review and critical analysis of multimodal datasets for emotional AI
    Sadam Al-Azani, El-Sayed M. El-Alfy · 2025 · Artificial Intelligence Review
  31. Robust Canonical Correlation Analysis: Audio-visual fusion for learning continuous interest
    Mihalis A. Nicolaou, Yannis Panagakis, Stefanos P. Zafeiriou, Maja Pantić · 2014 · IEEE International Conference on Acoustics Speech and Signal Processing
  32. Improving the Accuracy of Automatic Facial Expression Recognition in Speaking Subjects with Deep Learning
    Sathya Buršić, Giuseppe Boccignone, Alfio Ferrara, Alessandro D’Amelio, Raffaella Lanzarotti · 2020 · Applied Sciences
  33. Within and cross-corpus speech emotion recognition using latent topic model-based features
    Mohit Shah, Chaitali Chakrabarti, Andreas Spanias · 2015 · EURASIP Journal on Audio Speech and Music Processing
  34. Using Agreement on Direction of Change to Build Rank-Based Emotion Classifiers
    Srinivas Parthasarathy, Roddy Cowie, Carlos Busso · 2016 · IEEE/ACM Transactions on Audio Speech and Language Processing
  35. Hierarchical sparse coding framework for speech emotion recognition
    Diana Torres-Boza, Meshia Cédric Oveneke, Fengna Wang, Dongmei Jiang, Werner Verhelst, Hichem Sahli B · 2018 · Speech Communication
  36. Identification of psychological stress from speech signal using deep learning algorithm
    Ankit Kumar, Mohd Akbar Shaun, Brijesh Kumar Chaurasia · 2024 · e-Prime - Advances in Electrical Engineering Electronics and Energy
  37. The Artificial Social Agent Questionnaire (ASAQ) — Development and evaluation of a validated instrument for capturing human interaction experiences with artificial social agents
    Siska Fitrianie, Merijn Bruijnes, Amal Abdulrahman, Willem‐Paul Brinkman · 2025 · International Journal of Human-Computer Studies
  38. Facial Action Unit Recognition and Intensity Estimation Enhanced Through Label Dependencies
    Shangfei Wang, Longfei Hao, Qiang Ji · 2018 · IEEE Transactions on Image Processing
  39. First Impressions: A Survey on Vision-Based Apparent Personality Trait Analysis
    Julio C. S. Jacques, Yağmur Güçlütürk, Marc Pérez, Umut Güçlü, Carlos Andújar, Xavier Baró, Hugo Jair Escalante, Isabelle Guyon, Marcel A. J. van Gerven, Rob van Lier et al. · 2018 · RECERCAT (Consorci de Serveis Universitaris de Catalunya)
  40. Live human–robot interactive public demonstrations with automatic emotion and personality prediction
    Hatice Güneş, Oya Çeliktutan, Evangelos Sarıyanidi · 2019 · Philosophical Transactions of the Royal Society B Biological Sciences
  41. Assessing speaker independence on a speech-based depression level estimation system
    Paula Lopez‐Otero, Laura Docío-Fernández, Carmén García Mateo · 2015 · Pattern Recognition Letters
  42. Comparison of Wearable and Clinical Devices for Acquisition of Peripheral Nervous System Signals
    Bizzego, Andrea, Gabrieli, Giulio, Furlanello, Cesare, Esposito, Gianluca · 2020 · Sensors
  43. Data-Driven Affective Filtering for Images and Videos
    Teng Li, Bingbing Ni, Mengdi Xu, Meng Wang, Qingwei Gao, Shuicheng Yan · 2015 · IEEE Transactions on Cybernetics
  44. Action Units and Their Cross-Correlations for Prediction of Cognitive Load during Driving
    Anıl Yüce, Hua Gao, Gabriel Louis Cuendet, Jean‐Philippe Thiran · 2016 · IEEE Transactions on Affective Computing
  45. Development of simulated emotion speech database for excitation source analysis
    D. Pravena, D. Govind · 2017 · International Journal of Speech Technology
  46. Computational Study of Primitive Emotional Contagion in Dyadic Interactions
    Giovanna Varni, I. Hupont, C. Clavel, M. Chetouani · 2020 · IEEE Transactions on Affective Computing
  47. Multimodal Behavior Modeling for Socially Interactive Agents
    Catherine Pélachaud, Carlos Busso, Dirk Heylen · 2021 · ACM eBooks
  48. A Survey of the Trends in Facial and Expression Recognition Databases and Methods
    Sohini Roychowdhury, Michelle Emmons · 2015 · International Journal of Computer Science & Engineering Survey
  49. Dynamic Facial Models for Video-Based Dimensional Affect Estimation
    Siyang Song, Enrique Sánchez, Mani Kumar Tellamekala, Linlin Shen, Alan Johnston, Michel Valstar · 2019 · IEEE International Conference on Computer Vision Workshops
  50. Modeling Multiple Temporal Scales of Full-Body Movements for Emotion Classification
    Cigdem Beyan, Sukumar Karumuri, Gualtiero Volpe, Antonio Camurri, Radosław Niewiadomski · 2021 · IEEE Transactions on Affective Computing
  51. Multimodal Human-Agent Dialogue Corpus with Annotations at Utterance and Dialogue Levels
    Kazunori Komatani, Shogo Okada · 2021 · International Conference on Affective Computing and Intelligent Interaction and workshops
  52. LSTM Based Cross-corpus and Cross-task Acoustic Emotion Recognition
    Heysem Kaya, Dmitrii Fedotov, Ali Yeşilkanat, Oxana Verkholyak, Yang Zhang, Alexey Anatolievich Karpov · 2018 · Interspeech (USB)
  53. Correlated-spaces regression for learning continuous emotion dimensions
    Mihalis A. Nicolaou, Stefanos P. Zafeiriou, Maja Pantić · 2013 · ACM International Conference on Multimedia (ACM MM)
  54. AM-FED+: An Extended Dataset of Naturalistic Facial Expressions Collected in Everyday Settings
    Daniel McDuff, May Amr, Rana el Kaliouby · 2018 · IEEE Transactions on Affective Computing
  55. Automated Pain Detection from Facial Expressions using FACS: A Review
    Zhanli Chen, Rashid Ansari, Diana J. Wilkie · 2018 · arXiv (Cornell University)
  56. Automatic analysis of facial attractiveness from video
    Sacide Kalaycı, Hazım Kemal Ekenel, Hatice Güneş · 2014 · Proceedings - International Conference on Image Processing
  57. An Investigation of Partition-Based and Phonetically-Aware Acoustic Features for Continuous Emotion Prediction from Speech
    Zhaocheng Huang, Julien Epps · 2018 · IEEE Transactions on Affective Computing
  58. Affective facial computing: Generalizability across domains
    Jeffrey F. Cohn, Itır Önal Ertuğrul, Wen-Sheng Chu, Jeffrey M. Girard, László A. Jeni, Zakia Hammal · 2018 · Elsevier eBooks
  59. E m o A s s i s t: emotion enabled assistive tool to enhance dyadic conversation for the blind
    A K M Mahbubur Rahman, Asm Iftekhar Anam, Mohammed Yeasin · 2016 · Multimedia Tools and Applications
  60. Using Temporal Association Rules for the Synthesis of Embodied Conversational Agents with a Specific Stance
    Thomas Janssoone, Chloé Clavel, Kévin Bailly, Gaël Richard A · 2016 · Lecture notes in computer science
  61. A Novel Method for Human Bias Correction of Continuous- Time Annotations
    Brandon M. Booth, Karel Mundnich, Shrikanth Shri Narayanan · 2018 · IEEE International Conference on Acoustics Speech and Signal Processing
  62. Lexical Dependent Emotion Detection Using Synthetic Speech Reference
    Reza Lotfian, Carlos Busso · 2019 · IEEE Access
  63. Emotion analysis from faces for social robotics
    Antonio Greco, Antonio Roberto, Alessia Saggese, Mario Vento, Vincenzo Vigilante · 2019 · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics
  64. The LDOS-PerAff-1 corpus of facial-expression video clips with affective, personality and user-interaction metadata
    Marko Tkalčič, Andrej Košir, Jurij Franc Tasič · 2012 · Journal on Multimodal User Interfaces
  65. The Cost of Dichotomizing Continuous Labels for Binary Classification Problems: Deriving a Bayesian-Optimal Classifier
    Soroosh Mariooryad, Carlos Busso · 2015 · IEEE Transactions on Affective Computing
  66. Multimodal-multisensor affect detection
    Sidney K. D’Mello, Nigel Bosch, Huili Chen · 2018 · ACM eBooks
  67. An Engineering View on Emotions and Speech: From Analysis and Predictive Models to Responsible Human-Centered Applications
    Chi-Chun Lee, Theodora Chaspari, Emily Mower Provost, Shrikanth Shri Narayanan · 2023 · Proceedings of the IEEE
  68. Speech Emotion Diarization: Which Emotion Appears When?
    Yingzhi Wang, Mirco Ravanelli, Alya Yacoubi · 2023 · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU)
  69. MAPTRAITS 2014 - The First Audio/Visual Mapping Personality Traits Challenge - An Introduction
    Oya Çeliktutan, Florian Eyben, Evangelos Sarıyanidi, Hatice Güneş, Björn Wolfgang Schuller · 2014 · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
  70. Multimodal databases
    Michel Valstar · 2019 · ACM eBooks
  71. Audiovisual Detection of Laughter in Human-Machine Interaction
    Stavros Petridis, Maelle Leveque, Maja Pantić · 2013 · International Conference on Affective Computing and Intelligent Interaction and workshops
  72. Viewpoint Robustness of Automated Facial Action Unit Detection Systems
    Shushi Namba, Wataru Sato, Sakiko Yoshikawa · 2021 · Applied Sciences
  73. Moving From Narrative to Interactive Multi-Modal Sentiment Analysis: A Survey
    Junxia Ma, Lu Rong, Yazhou Zhang, Prayag Tiwari · 2023 · ACM Transactions on Asian and Low-Resource Language Information Processing
  74. Emotion Fusion-Sense (Emo Fu-Sense) – A novel multimodal emotion classification technique
    Muhammad Umair, Nasir Rashid, Umar Shahbaz Khan, Amir Hamza, Javaid Iqbal · 2024 · Biomedical Signal Processing and Control
  75. Setwise Comparison
    Advait Sarkar, Cecily P Morrison, Jonas F. Dorn, Rishi Bedi, Saskia Steinheimer, Jacques L. Boisvert, Jessica Burggraaff, Marcus D’Souza, Peter Kontschieder, Samuel Rota Bulò et al. · 2016 · CHI Conference on Human Factors in Computing Systems
  76. Dancing with Physio: A Mobile Game with Physiologically Aware Virtual Humans
    Jorge Arroyo-Palacios, Mel Slater · 2015 · IEEE Transactions on Affective Computing
  77. ILHAIRE Laughter Database
    Gary John McKeown, Roddy Cowie, William J. Curran, Willibald Ruch, Ellen Douglas‐Cowie · 2012 · Research Portal (Queen's University Belfast)
  78. Application of Emotion Recognition and Modification for Emotional Telugu Speech Recognition
    Vishnu Vidyadhara Raju, Krishna Gurugubelli, Anil Kumar Vuppala · 2018 · Mobile Networks and Applications
  79. AlloSat: A New Call Center French Corpus for Satisfaction and Frustration Analysis
    Manon Macary, Marie Tahon, Yannick Estève, Rousseau, Anthony · 2020 · HAL
  80. Automatic Recognition of Personality Traits
    Sidorov Maxim Yuryevich, Stefan Ultes, Alexander Schmitt · 2014
  81. Laughter Research: A Review of the ILHAIRE Project
    Stéphane Dupont, Hüseyin Çakmak, Will Curran, Thierry Dutoit, Jennifer Hofmann, Gary John McKeown, Olivier Pietquin, Tracey Platt, Willibald Ruch, Jérôme Urbain · 2016 · Intelligent systems reference library
  82. VEATIC: Video-based Emotion and Affect Tracking in Context Dataset
    Zhihang Ren, Jefferson Ortega, Yifan Wang, Zhimin Chen, Yunhui Guo, Stella X. Yu, David C. Whitney · 2024 · IEEE Winter Conference on Applications of Computer Vision
  83. A Three-stage multimodal emotion recognition network based on text low-rank fusion
    Linlin Zhao, Youlong Yang, Tong Ning · 2024 · Multimedia Systems
  84. Emotion recognition using synthetic speech as neutral reference
    Reza Lotfian, Carlos Busso · 2015 · IEEE International Conference on Acoustics Speech and Signal Processing
  85. Hilbert–Huang–Hurst‐based non‐linear acoustic feature vector for emotion classification with stochastic models and learning systems
    Vinícius Jefferson Dias Vieira, R. Coelho, Francisco de Assis · 2020 · IET Signal Processing
  86. MUSER: MUltimodal Stress detection using Emotion Recognition as an Auxiliary Task
    Yiqun Yao, Michalis Papakostas, Mihai G. Burzo, Mohamed Abouelenien, Rada F. Mihalcea · 2021 · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
  87. First Impressions - Predicting User Personality from Twitter Profile Images
    Abhinav Dhall, Jesse Hoey · 2016 · Lecture notes in computer science
  88. A defensive attention mechanism to detect deepfake content across multiple modalities
    Asha, S., Vinod, P., Menon, Varun G. · 2024 · Multimedia Systems
  89. Analysis of Automated Clinical Depression Diagnosis in a Chinese Corpus
    Kaining Mao, Deborah Baofeng Wang, Tiansheng Zheng, Rongqi Jiao, Yanhui Zhu, Bin Wu, Qian Lei, Wei Lyu, Jie Chen, Minjie Ye · 2023 · IEEE Transactions on Biomedical Circuits and Systems
  90. MAPTRAITS 2014
    Oya Çeliktutan, Florian Eyben, Evangelos Sarıyanidi, Hatice Güneş, Björn Wolfgang Schuller · 2014
  91. Audio-visual emotion challenge 2012
    Laurens van der Maaten · 2012 · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
  92. Crowdsourcing Empathetic Intelligence
    Christina Katsimerou, Joris Albeda, Alina Huldtgren, Ingrid E. J. Heynderickx, Judith Redi · 2016 · ACM Transactions on Intelligent Systems and Technology
  93. Real-world automatic continuous affect recognition from audiovisual signals
    Panagiotis Tzirakis, Stefanos P. Zafeiriou, Björn Schuller · 2019 · Multimodal Behavior Analysis in the Wild
  94. A Deep Learning System for Sentiment Analysis of Service Calls
    Yanan Jia · 2020 · Workshop on e-Commerce and NLP (ECNLP)
  95. Analysis of different affective state multimodal recognition approaches with missing data-oriented to virtual learning environments
    Camilo Salazar, Edwin Montoya, José Aguilar · 2021 · Heliyon
  96. Review on Automated Depression Detection from audio visual clue using Sentiment Analysis
    Uma Yadav, Ashish Kumar Sharma · 2021 · International Conference on Electronics and Sustainable Communication Systems (ICESC)
  97. Improving social relationships in face-to-face human-agent interactions: when the agent wants to know user's likes and dislikes
    Caroline Langlet, Chloé Clavel · 2015
  98. Capturing Feature and Label Relations Simultaneously for Multiple Facial Action Unit Recognition
    Shangfei Wang, Shan Wu, Guozhu Peng, Qiang Ji · 2017 · IEEE Transactions on Affective Computing
  99. Affect-LM: A Neural Language Model for Customizable Affective Text Generation
    Sayan Ghosh, Mathieu Chollet, Eugene Laksana, Louis‐Philippe Morency, Stefan J. Scherer · 2017 · arXiv (Cornell University)
  100. AVCAffe: A Large Scale Audio-Visual Dataset of Cognitive Load and Affect for Remote Work
    Pritam Sarkar, Aaron Posen, Ali Etemad · 2023 · Proceedings of the AAAI Conference on Artificial Intelligence