The SEMAINE Database: Annotated Multimodal Records of Emotionally Colored Conversations between a Person and a Limited Agent

McKeown, G., Valstar, M., Cowie, R., Pantic, M., Schroder, M.·2012·IEEE Transactions on Affective Computing
DOI 10.1109/t-affc.2011.20

Cited by (664)

Items 501–600 of 664

  1. Mutual information-based selection of audiovisual affective features to predict instantaneous emotional state
    Sudipta Paul, Nurani Saoda, S. M. Mahbubur Rahman, Dimitrios Hatzinakos · 2016 · International Conference on Computer and Information Technology (ICCIT)
  2. Cognitive Behaviour Analysis Based on Facial Information Using Depth Sensors
    Juan Manuel Fernández Montenegro, Barbara Villarini, Athanasios Gkelias, Vasileios Argyriou · 2018 · Lecture notes in computer science
  3. Processing negative emotions through social communication: Multimodal database construction and analysis
    Nurul Lubis, Michael C. Heck, Sakriani Sakti, Koichiro Yoshino, Satoshi Nakamura · 2017 · International Conference on Affective Computing and Intelligent Interaction and workshops
  4. Context Modeling for Cross-Corpus Dimensional Acoustic Emotion Recognition: Challenges and Mixup
    Dmitrii Fedotov, Heysem Kaya, Alexey Anatolievich Karpov · 2018 · Lecture notes in computer science
  5. MU Face Emotion - Building a Large Dataset for Emotional Facial Expression in Psychological Domain
    Sukrit Jaidee, Konlakorn Wongpatikaseree, Narit Hnoohom, Sumeth Yuenyong, Panida Yomaboot · 2022 · International Conference on Knowledge and Systems Engineering/Proceedings
  6. Character expression for spoken dialogue systems with semi-supervised learning using Variational Auto-Encoder
    Kenta Yamamoto, Koji Inoue, Tatsuya Kawahara · 2022 · Computer Speech & Language
  7. Audio and Text-Based Emotion Recognition System Using Deep Learning
    Palash Thakur, Ronit Shahu, Vikas Gupta · 2023 · Lecture notes in electrical engineering
  8. OCAE: Organization-Controlled Autoencoder for Unsupervised Speech Emotion Analysis
    Siwei Wang, Catherine Soladié, Renaud Séguier · 2019 · International Conference on Frontiers of Signal Processing (ICFSP)
  9. Aff-Wild Database and AffWildNet
    Mengyao Liu, Dimitrios Kollias · 2019 · arXiv (Cornell University)
  10. Learning Graph Representation of Person-specific Cognitive Processes from Audio-visual Behaviours for Automatic Personality Recognition
    Siyang Song, Zilong Shao, Shashank Jaiswal, Linlin Shen, Michel Valstar, Hatice Güneş · 2021 · arXiv (Cornell University)
  11. Proceedings of the First Workshop on Aggregating and Analysing Crowdsourced Annotations for NLP
    2019
  12. Deep Emotion Recognition using Facial, Speech and Textual Cues: A Survey
    Tao Zhang, Zhenhua Tan · 2021
  13. MYFED: a dataset of affective face videos for investigation of emotional facial dynamics as a soft biometric for person identification
    Zeynep Nur Saracbasi, Çiğdem Eroğlu Erdem, M. Taşkıran, Nihan Kahraman · 2024 · Machine Vision and Applications
  14. Recommendations to support interaction with broadcast debates: a study on older adults’ interaction with The Moral Maze
    Rolando Medellin-Gasque, Chris Reed, Vicki L. Hanson · 2014 · AI & Society
  15. Human Affect Recognition System based on Survey of Recent Approaches
    Shweta Malwatkar, Rekha S. Sugandhi, R. Anjali · 2017 · International Journal of Computer Applications
  16. Visual Methods for Sign Language Recognition: A Modality-Based Review
    Bassem Seddik, Najoua Essoukri Ben Amara · 2021 · Smart sensors, measurement and instrumentation
  17. A Friend in Need Is a Friend Indeed: Investigating the Quality of Training Data from Peers for Auto-generating Empathetic Textual Responses to Non-Sensitive Posts in a Cohort of College Students
    Ravi S. Sharma, Jamshidbek Mirzakhalov, Pratool Bharti, Raj Goyal, Trine Schmidt, Sriram Chellappan · 2023 · ACM Journal on Computing and Sustainable Societies
  18. Video-driven speaker-listener generation based on Transformer and neural renderer
    Daowu Yang, Qi Yang, Wen Jiang, Jifeng Chen, Zhengxi Shao, Qiong Liu · 2024 · Multimedia Tools and Applications
  19. A Review of the Research Status of Dimensional Emotion Model
    瑛 熊 · 2024 · Advances in Psychology
  20. Enhancing Healthcare Integration With IoT for Seamless and Responsive Patient Care
    A. V. Kalpana, T. Chandrasekar, Renugadevi Ramalingam, S. P. Tamizhselvi, T. Ramesh, M. Chitra · 2024 · Advances in medical diagnosis, treatment, and care (AMDTC) book series
  21. Optimizing Neural Response Generator with Emotional Impact Information
    Nurul Lubis, Sakriani Sakti, Koichiro Yoshino, Satoshi Nakamura · 2018 · IEEE Spoken Language Technology Workshop (SLT)
  22. Switching Wizard of Oz for the online evaluation of backchannel behavior
    Ronald W. Poppe, Mark ter Maat, Dirk Heylen · 2013 · Journal on Multimodal User Interfaces
  23. Hidden Markov Models for Modeling Occurrence Order of Facial Temporal Dynamics
    Khadoudja Ghanem · 2013 · Lecture notes in computer science
  24. Facial expression analysis and the affect space
    Varun Jain, Evanthia Mavridou, James L. Crowley, Augustin Lux · 2015 · Pattern Recognition and Image Analysis
  25. HCI and Natural Progression of Context-Related Questions
    Aggeliki Vlachostergiou, George Caridakis, Amaryllis T. Raouzaiou, Stefanos Kollias · 2015 · Lecture notes in computer science
  26. Détection des états affectifs lors d'interactions parlées : robustesse des indices non verbaux
    Laurence Y. Devillers, Marie Tahon, Mohamed A. Sehili, Agnès Delaborde · 2014 · HAL
  27. EmoGame: Towards a Self-Rewarding Methodology for Capturing Children Faces in an Engaging Context
    Benjamin Allaert, José Mennesson, Ioan Marius Bilasco · 2016 · Lecture notes in computer science
  28. Emotion Recognition from Speech
    Andreas Wendemuth, Bogdan Vlasenko, Ingo Siegert, Ronald Böck, Friedhelm Schwenker, Günther Palm · 2017 · Cognitive technologies
  29. Facial Expression Grounded Conversational Dialogue Generation
    Bernd Huber, Daniel McDuff · 2018 · International Conference on Automatic Face and Gesture Recognition
  30. A Chronic Psychiatric Disorder Detection Using Ensemble Classification
    V. J. Jithin, G. Manoj Reddy, R. Anand, S. Lalitha · 2020 · Communications in computer and information science
  31. Weak Ground Truth Determination of Continuous Human-Rated Data
    Andrej Košir, Gregor Strle, Marko Meža · 2020 · IEEE Access
  32. Contrastive Learning for Domain Transfer in Cross-Corpus Emotion Recognition
    Yufeng Yin, Liupei Lu, Yao Xiao, Zhi Jie Xu, Kaijie Cai, Haonan Jiang, Jonathan S. Gratch, Mohammad Soleymani · 2021 · International Conference on Affective Computing and Intelligent Interaction and workshops
  33. Semantic-aware Responsive Listener Head Synthesis
    Wei Zhao, Peng Xiao, Rongju Zhang, Yijun Wang, Jianxin Lin · 2022 · ACM International Conference on Multimedia (ACM MM)
  34. Inferring Causal Factors of Core Affect Dynamics on Social Participation through the Lens of the Observer
    Alessandro D’Amelio, Sabrina Patania, Sathya Buršić, Vittorio Cuculo, Giuseppe Boccignone · 2023 · Sensors
  35. Farmer Assistant System: An Integrated Crop Disease Detection and Remedial Approach
    Rohith Suram, K. Kalaiselvi, K. Jaswanth Reddy · 2023 · International Conference on Research Methodologies in Knowledge Management, Artificial Intelligence and Telecommunication Engineering (RMKMATE)
  36. Establishing Ground Truth on Pyschophysiological Models for Training Machine Learning Algorithms: Options for Ground Truth Proxies
    Keith Brawner, Michael W. Boyce · 2017 · Lecture notes in computer science
  37. EmoLiTe — A database for emotion detection during literary text reading
    Rebekah Wegener, Christian Kohlschein, Sabina Jeschke, Stella Neumann · 2017 · International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW)
  38. A Survey on Image Acquisition Protocols for Non-posed Facial Expression Recognition Systems
    Priya Saha, Debotosh Bhattacharjee, Barin Kumar De, Mita Nasipuri · 2019 · Multimedia Tools and Applications
  39. PAGAN: Platform for Audiovisual General-purpose ANnotation
    Dávid Melhárt, Antonios Liapis, Georgios N. Yannakakis · 2019 · International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW)
  40. Understanding Human Activities Through 3D Sensors
    J.F. Montenegro, Barbara Villarini, Athanasios Gkelias, V. Argyriou · 2018 · Lecture notes in computer science
  41. MES-P: an Emotional Tonal Speech Dataset in Mandarin Chinese with Distal and Proximal Labels
    Zhongzhe Xiao, Ying‐Yeh Chen, Weibei Dou, Zhi Tao, Liming Chen · 2018 · arXiv (Cornell University)
  42. Alzheimer's Disease Diagnosis Based on Cognitive Methods in Virtual Environments and Emotions Analysis
    Montenegro, Juan Manuel Fernández · 2018 · Research Repository (Kingston University London)
  43. Weakly Supervised Learning for Facial Behavior Analysis: A Review
    R. Gnana Praveen, Patrick Cardinal, Éric Granger · 2024
  44. Mutual impact of acoustic and linguistic representations for continuous emotion recognition in call-center conversations
    Marie Tahon, Manon Macary, Yannick Estève, Daniel Luzzati · 2021
  45. A Survey on Physiological Signal-Based Emotion Recognition
    Zeeshan Ahmad, Naimul Khan · 2023
  46. Affective computing framework for social emotion elicitation and recognition using artificial intelligence
    José Llanes-Jurado · 2024
  47. Facial Liveness Detection for Biometric User Identification
    Renát Haluška, Matúš Pleva, Jozef Sedlák, Marianna Koctúrová, Samuel Andrečík, Ľuboš Ovseník · 2024 · International Conference Radioelektronika
  48. ECFCON: Emotion Consequence Forecasting in Conversations
    Xincheng Ju, Dong Zhang, Suyang Zhu, Junhui Li, Shoushan Li, Guodong Zhou · 2024 · ACM International Conference on Multimedia (ACM MM)
  49. MSP-GEO Corpus: A Multimodal Database for Understanding Video-Learning Experience
    Ali N. Salman, Ning Wang, Luz Martinez-Lucas, Andrea Vidal, Carlos Busso · 2024 · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
  50. Participant Engagement and Data Quality: Lessons Learned from a Mental Wellness Crowdsensing Study
    Enshi Zhang, Rafael Trujillo, Christian Poellabauer · 2025 · Proceedings of the ACM on Human-Computer Interaction
  51. Knowledge Discovery and Scientometric Analysis of Conversational Artificial Intelligence (CAI) for Mental Health
    Muhammad Luthfi Hidayat, Istiak Ahmad, Moh. Hasbi Assidiqi, Tariq Jamil Saifullah Khanzada, Maram Meccawy · 2025 · International Conference on Innovation in Artificial Intelligence and Internet of Things (AIIT)
  52. Negative selection-based artificial immune system (NegSl-AIS) - A hybrid multimodal emotional effect classification model
    Muhammad Umair, Nasir Rashid, Umar Shahbaz Khan, Amir Hamza, Ayesha Zeb, Tahir Habib Nawaz, Ali Raza Ansari · 2025 · Results in Engineering
  53. Cross-Cultural Nuances of Micro-Expressions and Action Units: A Comparative Study
    Xiaobai Li, Xinglong Mao, Hao Zou, Jingjing Chen, Sirui Zhao · 2025 · IEEE International Conference on Multimedia and Expo workshops
  54. Why Robots Are Bad at Detecting Their Mistakes: Limitations of Miscommunication Detection in Human-Robot Dialogue
    Ruben Janssens, J. Bock, Sofie Labat, Eva Verhelst, Véronique Hoste, Tony Belpaeme · 2025 · IEEE RO-MAN
  55. A method for extraction of affective audio-visual facial clips from movies
    Cigdem Turan, C. Kansin, Sasan Zhalehpour, Z. Aydin, Çiğdem Eroğlu Erdem · 2013 · Signal Processing and Communications Applications Conference (SIU)
  56. Construction of English-French Multimodal Affective Conversational Corpus from TV Dramas
    Sashi Novitasari, Quoc Truong, Sakriani Sakti, Dessi Puji Lestari, Satoshi Nakamura · 2018 · Language Resources and Evaluation Conference (LREC)
  57. Demonstrating and Learning Multimodal Socio-communicative Behaviors for HRI: Building Interactive Models from Immersive Teleoperation Data
    Gérard Bailly, Frédéric Elisei · 2018
  58. Trapezoidal Segment Sequencing: A Novel Approach for Fusion of Human-Produced Continuous Annotations
    Brandon M. Booth, Shrikanth Shri Narayanan · 2020 · IEEE International Conference on Acoustics Speech and Signal Processing
  59. Publishing PAROLE SIMPLE CLIPS as linguistic linked open data
    Khan, Fahad, Francesca Frontini · 2014 · Pisa University Press eBooks
  60. Design and Construction of Japanese Multimodal Utterance Corpus with Improved Emotion Balance and Naturalness
    Daisuke Horii, Akinori Ito, Takashi Nose · 2022 · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC)
  61. EMOTION RECOGNITION FROM EEG SIGNALS BASED ON OPTIMIZATION OF MUTUAL INFORMATION
    Snigdha Madhab Ghosh, Sharba Bandyopadhvay, Debjani Mitra · 2023 · International Symposium on Devices, Circuits and Systems (ISDCS)
  62. CH-MEAD: A Chinese Multimodal Conversational Emotion Analysis Dataset with Fine-Grained Emotion Taxonomy
    Yu-Ping Ruan, Shukai Zheng, Jiantao Huang, Xiaoning Zhang, Yulong Liu, Taihao Li · 2023 · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC)
  63. A Multimodal, Multilabel Approach to Recognize Emotions in Oral History Interviews
    Anargh Viswanath, Michael Gref, Teena Hassan, Christoph Schmidt · 2024 · International Conference on Affective Computing and Intelligent Interaction and workshops
  64. Neurological and Mental Disorders
    Victor A. Bernstam · 2019 · CRC Press eBooks
  65. BAREM: A multimodal dataset of individuals interacting with an e-service platform
    Romain Belmonte, Amel Aissaoui, Sofiane Mihoubi, Benjamin Allaert, José Mennesson, Ioan Marius Bilasco, Laurent Goncalves · 2021 · International Workshop on Content-Based Multimedia Indexing (CBMI)
  66. I Probe, Therefore I Am: Designing a Virtual Journalist with Human Emotions
    Kevin K. Bowden, Nilsson, Tommy, Christine Spencer, Kübra Cengiz, Alexandru Ghitulescu, Jelte van Waterschoot · 2017 · arXiv (Cornell University)
  67. Affective computing using speech and eye gaze: a review and bimodal system proposal for continuous affect prediction
    Jonny O’Dwyer, Niall Murray, Ronan Flynn · 2018 · arXiv (Cornell University)
  68. Emotion-Aware and Human-Like Autonomous Agents
    Nabiha Asghar · 2019 · UWSpace (University of Waterloo)
  69. Impact of multiple modalities on emotion recognition: investigation into 3d facial landmarks, action units, and physiological data
    Diego Fabiano, Manikandan Jaishanker, Shaun J. Canavan · 2020 · arXiv (Cornell University)
  70. MUSER: MUltimodal Stress Detection using Emotion Recognition as an Auxiliary Task
    Yiqun Yao, Michalis Papakostas, Mihai G. Burzo, Mohamed Abouelenien, Rada F. Mihalcea · 2021 · arXiv (Cornell University)
  71. Mutual impact of acoustic and linguistic representations for continuous emotion recognition in call-center conversations
    Marie Tahon, Manon Macary, Yannick Estève, Daniel Luzzati · 2021
  72. Affective behavior modeling on social networks
    Waleed Ragheb · 2020
  73. Static vs. dynamic features for automatic analysis of facial attractiveness
    Sacide Kalaycı, Hazım Kemal Ekenel, Hatice Güneş · 2014 · Signal Processing and Communications Applications Conference (SIU)
  74. Continuous prediction of trait impressions
    Oya Çeliktutan, Hatice Güneş · 2014 · Signal Processing and Communications Applications Conference (SIU)
  75. ALISP-Based Data Compression for Generic Audio Indexing
    Houssemeddine Khemiri, Dijana Petrovska‐Delacrétaz, Gérard Chollet · 2014 · DCC
  76. A Database of Full Body Virtual Interactions Annotated with Expressivity Scores
    Virginie Demulier, Elisabetta Bevacqua, Florian Focone, Tom Giraud, Pamela Carreno‐Medrano, Brice Isableu, Sylvie Gibet, Pierre De Loor, Jean‐Claude Martin · 2014 · Language Resources and Evaluation Conference (LREC)
  77. Understanding of the Biological Process of Nonverbal Communication: Facial Emotion and Expression Recognition
    Alberto Cruz, Bir Bhanu, Ninad S. Thakoor · 2015 · Computational biology
  78. Affective Speech Recognition
    Fewzee Youssefi, Seyyed Pouria · 2015 · UWSpace (University of Waterloo)
  79. Annotation of complex emotions in real-life dialogues: The case of empathy
    Morena Danieli, Giuseppe Riccardi, Firoj Alam · 2014 · Pisa University Press eBooks
  80. A Revisit to the Incorporation of Context - Awareness in Affective Computing Systems.
    Aggeliki Vlachostergiou, Stefanos Kollias · 2015
  81. Modélisation des questions de l’agent pour l’analyse des affects, jugements et appréciations de l’utilisateur dans les interactions humain-agent
    Caroline Langlet, Chloé Clavel · 2014 · HAL
  82. Context Recognition Methods using Audio Signals for Human-Machine Interaction
    Mohit Shah · 2015
  83. Head motion synthesis: evaluation and a template motion approach
    David Adam Braude · 2016 · ERA
  84. Research on the Enterprise Resource Management System and Auxiliary Performance Evaluation Mechanism based on Oracle Database Optimization and Security Enhancement
    Lei Liu, Yang Hua, Alian Wesmmian · 2017 · International Journal of Future Generation Communication and Networking
  85. Field Studies with Multimedia Big Data: Opportunities and Challenges (Extended Version)
    Mario Michael Krell, Julia Bernd, Li, Yifan, Daniel Ma, Jaeyoung Choi, Ellsworth, Michael, Damian Borth, Gerald H Friedland · 2017 · arXiv (Cornell University)
  86. Methods and challenges for creating an emotional audio-visual database
    Meghna Abhishek Pandharipande, Rupayan Chakraborty, Sunil Kumar Kopparapu · 2017 · International Conference on Speech Database and Assessments
  87. Literature Survey and Datasets
    Soujanya Poria, Amir Hussain, Erik Cambria · 2018 · Socio-affective computing
  88. Features Extraction based on an Origami Representation of 3D Landmarks
    Juan Manuel Fernández Montenegro, Mahdi Maktabdar Oghaz, Athanasios Gkelias, Georgios Tzimiropoulos, Vasileios Argyriou · 2019 · International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP)
  89. Neurological and mental disorders
    Tarakad S. Ramachandran · 2013 · Oxford University Press eBooks
  90. “You Can Do It!”—Crowdsourcing Motivational Speech and Text Messages
    Roelof A. J. de Vries, Khiet P. Truong, Jaebok Kim, Vanessa Evers · 2019 · Human-computer interaction series
  91. Objective Human Affective Vocal Expression Detection and Automatic Classification with Stochastic Models and Learning Systems
    Vinícius Jefferson Dias Vieira, R. Coelho, Francisco de Assis · 2019 · arXiv (Cornell University)
  92. Interpretable Deep Neural Networks for Facial Expression and Dimensional Emotion Recognition in-the-wild
    Valentin Richer, Dimitrios Kollias · 2019 · arXiv (Cornell University)
  93. Computer Assisted Annotation of Tension Development in TED Talks through Crowdsourcing
    Seungwon Yoon, Wonsuk Yang, Jong Hyuk Park · 2019
  94. Enriching Existing Conversational Emotion Datasets with Dialogue Acts using Neural Annotators
    Chandrakant Bothe, Cornelius Weber, Sven Magg, Stefan Wermter · 2019 · arXiv (Cornell University)
  95. Neurological and Mental Disorders
    Kaneez Fatima-Shad, Kamil Hakan Doğan · 2019 · IntechOpen eBooks
  96. Learning an Unsupervised and Interpretable Representation of Emotion from Speech
    Siwei Wang, Catherine Soladié, Renaud Séguier · 2020 · Lecture notes in computer science
  97. A Methond of Building Phoneme-Level Chinese Audio-Visual Emotional Database
    Xiaoye Zhang, Shaobin Li, Yang Wang, Shuchun Li · 2020 · International Conference on Culture-oriented Science & Technology (ICCST)
  98. Multi-modal Sequence-to-sequence Model for Continuous Affect Prediction in the Wild Using Deep 3D Features
    Sowmya Rasipuram, Junaid Hamid Bhat, Anutosh Maitra · 2020 · International Conference on Automatic Face and Gesture Recognition
  99. Subjectbook: Data Management and Visualization Methods for Affective Studies
    Salah Taamneh · 2016
  100. Analysis of Facial Emotional Characteristics: Impact of Culture and Gender
    Yintao Ma · 2021 · UWSpace (University of Waterloo)