Recognition of emotions using multimodal physiological signals and an ensemble deep learning model

Yin, Zhong, Zhao, Mengyuan, Wang, Yongxiong, Yang, Jingdong, Zhang, Jianhua·2017·Computer Methods and Programs in Biomedicine
DOI 10.1016/j.cmpb.2016.12.005

Cited by (414)

Items 301–400 of 414

  1. Video Relationship Detection Using Mixture of Experts
    Ala Shaabana, Zahra Gharaee, Paul Fieguth · 2023 · IEEE Access
  2. Exploring the Dynamics of Canine-Assisted Interactions: A Wearable Approach to Understanding Interspecies Well-Being
    Timothy Holder, Colt Nichols, Emily Summers, David L. Roberts, Alper Y. Bozkurt · 2024 · Animals
  3. Seismocardiography for Emotion Recognition: A Study on EmoWear With Insights From DEAP
    Mohammad Hasan Rahmani, Rafael Berkvens, Maarten Weyn · 2025 · IEEE Transactions on Affective Computing
  4. Radio Frequency Sensing–Based Human Emotion Identification by Leveraging 2D Transformation Techniques and Deep Learning Models
    Najah Abed Abuali, Ihtesham Jadoon, Farman Ullah, Mohammad Hayajneh, Shayma Alkobaisi · 2025 · IEEE Open Journal of the Computer Society
  5. Addressing the Learning Gap with Adaptive Learning
    Soukaina Hakkal, Ayoub Ait Lahcen · 2025 · Springer eBooks
  6. Comprehensive analysis of the state of art on emotion recognition using EEG
    Anju Mishra, Priya Ranjan · 2026 · Computers & Electrical Engineering
  7. Virtual Reality Exposure Therapy and Physiological Data Analysis for Treatment of Stress Disorders
    Charles V. Trappey, Amy J.C. Trappey, Chia‐Ming Chang, Ming-Jhen Tsai, Routine R. T. Kuo, Aislyn P. C. Lin · 2021 · Advances in medical technologies and clinical practice book series
  8. Average Power Based EEG Channel Selection Method for Emotion Recognition
    Md. Shahriar Rahman, Nadia Tasnim Mim, Jonayed Ahmed Riduan, Ridwane-Ul-Islam, Most. Mahjabin, Mohammed Abid Abrar, Mohammad Zavid Parvez · 2022 · Advances in intelligent systems and computing
  9. Emerging Techniques for Online Learning Analytics
    Yidan Wang, Xiaoran Huang, Qijing Yu, YuXuan Lai · 2023 · Communications in computer and information science
  10. Enhancing Education through Multimodal Learning Analytics and AI-as-a-Service
    Diego Monsalves, Fabián Riquelme, Héctor Cornide-Reyes · 2023 · IEEE CHILEAN Conference on Electrical, Electronics Engineering, Information and Communication Technologies (CHILECON)
  11. A Resilient Overlay for Human Emotion Recognition Using Mixed Frameworks in Machine-Human Interactions
    Fayaz Ahmad Fayaz, Arun Malik, Isha Batra, Syed Immamul Ansarullah · 2024 · SN Computer Science
  12. Switch fusion for continuous emotion estimation from multiple physiological signals
    Tu N. Vu, Van Thong Huynh, Seungwon Kim, Ji-eun Shin, Hyung-Jeong Yang, Soo-Hyung Kim · 2025 · Biomedical Signal Processing and Control
  13. ECG-EmotionNet: Nested Mixture of Expert (NMoE) Adaptation of ECG-Foundation Model for Driver Emotion Recognition
    Nastaran Mansourian, Arash Mohammadi, M. Omair Ahmad, M.N.S. Swamy · 2025 · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)
  14. A Convolutional Neural Network Model for Decoding EEG signals in a Hand-Squeeze Task1
    Andi Partovi, Farhad Goodarzy, Ewan Scott Nurse, Philippa J. Karoly, Dean Freeston, Mark James Cook, Anthony Neville Burkitt, David Bruce Grayden · 2020 · International Winter Conference on Brain-Computer Interface (BCI)
  15. Music Therapy by Analyzing EEG Signals
    S. Anusooya, Anitha R, Jean Shilpa V, Anitha priyadarshini N, Aamira S.J, G Sowmyaa · 2020 · Bulletin of Scientific Research
  16. Analysis and Classification of Motor Imagery Using Deep Neural Network
    Isah Salim Ahmad, Shuai Zhang, Sani Saminu, Isselmou Abd El Kader, Jamilu Maaruf Musa, Imran Javid, Souha Kamhi, Ummay Kulsum · 2021 · Journal of Applied Materials and Technology
  17. The uptake of fatty acids by the liver.
    David Zakim, R B Cooper, Noa Noy · 1988 · PubMed Central
  18. Facial Expression Emotion through BCI-based Personal Traits and Emotion Classification
    Tae-Yeun Kim, Sang-Hyun Bae, Sung-Hwan Kim · 2020 · International Conference on Smart Media and Applications (SMA)
  19. Introduction to Applied Affective Computing
    Leimin Tian, Sharon L. Oviatt, Michał Muszyński, Brent C. Chamberlain, Jennifer Healey, Akane Sano · 2022 · ACM eBooks
  20. Emotion Recognition in the Wild
    Leimin Tian, Sharon L. Oviatt, Michał Muszyński, Brent C. Chamberlain, Jennifer Healey, Akane Sano · 2022 · ACM eBooks
  21. Manifold sorting feature selection for emotion recognition
    Zhaowen Xiao, Qingshan She, Lei Chen, Yuliang Ma · 2025 · Data Science and Informetrics
  22. Emotions in Motion: Examining the Effects of Psychophysiological States on Exercise Behavior and Athletic Performance
    Asia Joseph, Marcelo Bigliassi · 2025 · Springer eBooks
  23. Foundation Feature-Guided Hierarchical Fusion of EEG-Physiological for Emotion Estimation
    Haifeng Zhang, Von Ralph Dane Marquez Herbuela, Yukie Nagai · 2025 · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
  24. An emotion recognition approach using peripheral physiological signals based on hierarchical gated residuals and receptive field attention
    Yonghui Yu, Hongji Xu, Zhikai Xu, Yupeng Duan, Renzhuo Wang, Hao Zheng, Yiran Li, Yipeng Xu · 2025 · Engineering Applications of Artificial Intelligence
  25. A Review of Multimodal Emotion Recognition Technologies: Integrating Speech, Facial Expressions, and Physiological Signals
    Haorong Hu, Tianyi Sun · 2025 · International Conference on Image Processing, Computer Vision and Machine Learning (ICICML)
  26. Video-dominant emotion recognition for portable EEG-based devices
    Xinyi Wen, Wei Xu, Lei Tian, Cuijuan Guo, Jinjun Bai · 2026 · Scientific Reports
  27. A Novel Self-Supervised Learning Based on Masked Signal Modeling for Multimodal Physiological Emotion Recognition
    Xin Wan, Yongxiong Wang, Zhe Wang, Benke Liu · 2026 · IEEE Sensors Journal
  28. Structured and Factorized Multi-Modal Representation Learning for Physiological Affective State and Music Preference Inference
    Wenli Qu, Mujiangshan Wang · 2026 · Symmetry
  29. RoCoSense: Integrating Robotics, Smart Clothing and Big Data Clouds for Emotion Sensing
    Jun Yang, Mengchen Liu, Zeru Wei, Chao Han, Wei Li, Yiming Miao · 2018 · International Wireless Communications and Mobile Computing Conference (IWCMC)
  30. Non-generalized Analysis of the Multimodal Signals for Emotion Recognition: Preliminary Results
    Edwin Londoño-Delgado, Miguel A. Becerra, C. Duque-Mejía, Camilo Zapata-Hernandez, Cristian Mejía-Arboleda, Andrés Eduardo Castro-Ospina, Diego Hernán Peluffo-Ordóñez · 2019 · Lecture notes in computer science
  31. Emotion Recognition Using Chaotic Features And Symbolic Dynamic via Neural Networks
    M. Kanani, Mohammad Manthouri, Mehdi Abdossalehi · 2019 · International Conference on Knowledge-Based Engineering and Innovation
  32. A Systematic Review on Approaches to Recognize Emotions Using Electroencephalography (EEG) Signals
    Megha D. Bengalur, Aditya Kishore Saxena · 2021 · Advances in intelligent systems and computing
  33. Reinforcement Learning and Affective Computing
    Leimin Tian, Sharon L. Oviatt, Michał Muszyński, Brent C. Chamberlain, Jennifer Healey, Akane Sano · 2022 · ACM eBooks
  34. Emotional Correlation Test from Binary Gender Perspective using Kansei Engineering Approach on IVML Prototype
    Nur Faraha Mohd Naim, Mintae Hwang · 2023 · Journal of information and communication convergence engineering
  35. Empirical study of emotional state recognition using multimodal fusion framework
    Ruchilekha, Manoj Kumar Singh · 2023 · International Conference on Image, Video and Signal Processing (IVSP)
  36. Physiological Signals for Emotion Recognition
    Shruti G. Taley, M. A. Pund · 2023 · Algorithms for intelligent systems
  37. Learning Cross-Modal Factors from Multimodal Physiological Signals for Emotion Recognition
    Yuichi Ishikawa, Nao Kobayashi, Yasushi Naruse, Yugo Nakamura, Shigemi Ishida, Tsunenori Mine, Yutaka Arakawa · 2023 · Lecture notes in computer science
  38. Designing a Robust Concealer for Emotion Detection Using Various Paradigms for Machine Human Interaction
    Fayaz Ahmad Fayaz, Arun Malik, Shameem Khan, Anita K. Sharma, Ashaq Hussain Dar · 2024 · Lecture notes in networks and systems
  39. EEG-based emotion recognition using AR burg and ensemble machine learning models
    Abdülhamit Subaşı, Saeed Mian Qaisar · 2024 · Elsevier eBooks
  40. Brain Signal-Based Emotion Classification Using DEAP Corpus
    Bittu Kumar, M.A. Jahangeer Pasha, N. Apoorva, Kottapalli Dheeraj, S. Sivanand, Ashwini Kumar Varma · 2024 · International Conference on Electronics, Communication and Signal Processing (ICECSP)
  41. Emotion Assessment by Variability-Based Ranking of Coherence Features from EEG
    Iván De La Pava Panche, Andrés Marino Álvarez-Meza, Alvaro Angel Orozco · 2018 · Lecture notes in computer science
  42. Multi-Task Ensemble Learning for Affect Recognition
    Martin Gjoreski, Mitja Luštrek, Matjaž Gams · 2018 · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp)
  43. Electroencephalogram-based emotion recognition using a convolutional neural network
    Vladimir Savinov, Stepan Botman, Viktor Sapunov, V. A. Petrov, Ilia Samusev, Natalia Nikolaevna Shusharina · 2019 · Bulletin of Russian State Medical University
  44. Exploring user cognition difference and pleasure balance guidance method for product perceptible features in vehicle-mounted system
    Chao Zhang · 2021 · International Journal of Systems Assurance Engineering and Management
  45. A Spherical Phase Space Partitioning Based Symbolic Time Series Analysis (SPSP—STSA) for Emotion Recognition Using EEG Signals
    Hoda Tavakkoli, Ali Motie Nasrabadi · 2022 · Frontiers in Human Neuroscience
  46. AETIOLOGY ON EMOTION RECOGNITION STRATEGIES USING VIDEO, ELECTROENCEPHALOGRAM AND PHYSIOLOGICAL SIGNALS
    Jay Vala, Udesang K. Jaliya · 2023 · International Journal of Engineering Applied Sciences and Technology
  47. Ensemble emotion recognizing with multiple modal physiological signals
    Jing Zhang, Yong Zhang, Suhua Zhan, Cheng Cheng · 2020 · arXiv (Cornell University)
  48. Cross-individual Recognition of Emotions by a Dynamic Entropy based on Pattern Learning with EEG features
    Xiaolong Zhong, Zhong Yin · 2020 · arXiv (Cornell University)
  49. Adaptive In-network Collaborative Caching for Enhanced Ensemble Deep Learning at Edge
    Yana Qin, Danye Wu, Zhiwei Xu, Jie Tian, Yujun Zhang · 2020 · arXiv (Cornell University)
  50. Other Ensemble Approaches
    Verónica Bolón‐Canedo, Amparo Alonso‐Betanzos · 2018 · Intelligent systems reference library
  51. I Can Feel You Are Smiling Happily: Distinguishing between Real and Posed Smiles from Observers' Peripheral Physiology
    Md Zakir Hossain · 2018 · ANU Open Research (Australian National University)
  52. Определение эмоционального состояния свёрточной нейронной сетью по данным электроэнцефалографии
    В. Б. Савинов, Stepan Botman, Viktor Sapunov, В. А. Петров, И. Г. Самусев, Natalia Nikolaevna Shusharina · 2019 · Вестник Российского государственного медицинского университета
  53. Improving Understanding of EEG Measurements Using Transparent Machine Learning Models
    Chris Roadknight, Guanyu Zong, Prapa Rattadilok · 2019 · Lecture notes in computer science
  54. Brain Rhythm Sequencing and Its Application for EEG-based Emotion Recognition
    Jiawen Li, Shovan Barma, Sio Hang Pun, Mang I Vai, Feng Wan, Wai Sun Liu, Peng Un Mak · 2021 · IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA)
  55. EEG-Based Emotion Classification Using Entropy Features and Machine Learning Techniques
    Jianhua Zhang, Peng Chen, Rubin Wang · 2021 · Advances in cognitive neurodynamics
  56. Quantifying the effect of caloric and non-caloric sweeteners in the brain response using EEG and convolutional neural network
    Gustavo Voltani von Atzingen, Hubert Arteaga, Amanda Rodrigues da Silva, Nathalia Fontanari Ortega, Ernane José Xavier Costa, Ana Carolina de Sousa Silva · 2021 · bioRxiv (Cold Spring Harbor Laboratory)
  57. A Pervasive Multi-physiological Signal-Based Emotion Classification with Shapelet Transformation and Decision Fusion
    Shichao Zhang, Xiangwei Zheng, Mingzhe Zhang, Gengyuan Guo, Cun Ji · 2021 · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
  58. APPLICATIONS OF DEEP LEARNING TO IMPROVE THE QUALITY OF HEALTHCARE OUTCOMES
    Abdulrhman Samman Al-Asmari · 2022 · International Journal for Quality Research
  59. Deep Learning Models for Physiological Data Classification of Children During Computerized Auditory Tests
    Duygun Erol Barkana, Itır Kaşikçi, Hatice Köse, Elif Toprak, Selma Yılar, Dilara Demirpençe Seçinti · 2022 · Advances in computational intelligence and robotics book series
  60. Stress emotion classification using optimized convolutional neural network for online transfer learning dataset
    Georg Rose, M. Punithavalli · 2022 · Computer Methods in Biomechanics & Biomedical Engineering
  61. Future of Affective Computing and Applied Affective Computing
    Leimin Tian, Sharon L. Oviatt, Michał Muszyński, Brent C. Chamberlain, Jennifer Healey, Akane Sano · 2022 · ACM eBooks
  62. Multimodal Data Collection and Processing for Applied Affective Computing
    Leimin Tian, Sharon L. Oviatt, Michał Muszyński, Brent C. Chamberlain, Jennifer Healey, Akane Sano · 2022 · ACM eBooks
  63. Preface
    Leimin Tian, Sharon L. Oviatt, Michał Muszyński, Brent C. Chamberlain, Jennifer Healey, Akane Sano · 2022 · ACM eBooks
  64. Bibliography
    Leimin Tian, Sharon L. Oviatt, Michał Muszyński, Brent C. Chamberlain, Jennifer Healey, Akane Sano · 2022 · ACM eBooks
  65. Authors’ Biographies & Index
    Leimin Tian, Sharon L. Oviatt, Michał Muszyński, Brent C. Chamberlain, Jennifer Healey, Akane Sano · 2022 · ACM eBooks
  66. Applied Affective Computing in Built Environments
    Leimin Tian, Sharon L. Oviatt, Michał Muszyński, Brent C. Chamberlain, Jennifer Healey, Akane Sano · 2022 · ACM eBooks
  67. Machine Learning Approaches for Applied Affective Computing
    Leimin Tian, Sharon L. Oviatt, Michał Muszyński, Brent C. Chamberlain, Jennifer Healey, Akane Sano · 2022 · ACM eBooks
  68. Affective Computing for Enhancing Well-Being
    Leimin Tian, Sharon L. Oviatt, Michał Muszyński, Brent C. Chamberlain, Jennifer Healey, Akane Sano · 2022 · ACM eBooks
  69. Synthesizing Natural and Believable Emotional Expressions
    Leimin Tian, Sharon L. Oviatt, Michał Muszyński, Brent C. Chamberlain, Jennifer Healey, Akane Sano · 2022 · ACM eBooks
  70. Addressing Ethical Issues of Affective Computing
    Leimin Tian, Sharon L. Oviatt, Michał Muszyński, Brent C. Chamberlain, Jennifer Healey, Akane Sano · 2022 · ACM eBooks
  71. Emotions as Studied in Psychology and Cognitive Science
    Leimin Tian, Sharon L. Oviatt, Michał Muszyński, Brent C. Chamberlain, Jennifer Healey, Akane Sano · 2022 · ACM eBooks
  72. EEG Source Identification through Phase Space Reconstruction and Complex Networks
    Morteza Zangeneh Soroush · 2020 · bioRxiv (Cold Spring Harbor Laboratory)
  73. Study of mental state recognition using physiological signals in virtual environment
    Bilgin, Pinar · 2021
  74. RECOGNITION OF MENTAL DISORDERS FROM PHYSIOLOGICAL SIGNALS ANALYSIS
    Oleksandr Sukholeister, Adrian Nakonechnyi · 2022 · Measuring Equipment and Metrology
  75. A MODIFIED FUZZY SUPPORT VECTOR MACHINE CLASSIFICATION-BASED APPROACH FOR EMOTIONAL RECOGNITION USING PHYSIOLOGICAL SIGNALS
    Mohammad Bagher Menhaj · 2022 · Azerbaijan Journal of High Performance Computing
  76. EEG-based image classification using an efficient geometric deep network based on functional connectivity
    Haitham Sabah Hasan, Mais A. Al-Sharqi · 2023 · Periodicals of Engineering and Natural Sciences (PEN)
  77. Deep Multimodal Representation Learning for Emotion Recognition Using Dense Max-Margin Loss Function
    Muhammad Zubair, Sungpil Woo, Sunhwan Lim, Changwoo Yoon · 2023 · SSRN Electronic Journal
  78. СТРАТЕГІЇ ЗЛИТТЯ ФІЗІОЛОГІЧНИХ СИГНАЛІВ ДЛЯ РОЗПІЗНАВАННЯ ЕМОЦІЙ
    Oleksandr Sukholeister, Adrian Nakonechny · 2023 · Measuring and computing devices in technological processes
  79. Deploying Hybrid MAELM Approach for Human Emotion Detection Through Speech and Facial Expressions
    K. S. Kavi Kumar, S. Rukmani Devi, Nidhi Ranjan, Gitika Rath, Gomathinayagam Indira, Neerav Nishant · 2023 · International Conference on Innovative Mechanisms for Industry Applications
  80. Multimodal affective computing for video summarization
    Wai-Cheong Lincoln Lew · 2023
  81. “The reasons you believe …”: An exploratory study of text driven evidence gathering and prediction from first responder records justifying state authorised intervention for mental health episodes
    Sourav Das, Janet Catterall, Richard Stone, ALAN R. CLOUGH · 2024 · Computer Methods and Programs in Biomedicine
  82. Performance analysis of human emotion via speech recognition using artificial bee colony compared with particle swarm optimization algorithm
    E. M. Sree, V. Nagaraju, V. Thiruchelvam, Y. Susiapan · 2024 · AIP conference proceedings
  83. Fine-grained Dual-space Context Analysis Network for Multimodal Emotion Recognition
    Jinghao Li, Jiajia Tang, Wanzeng Kong, Yanyan Ying · 2024 · International Joint Conference on Neural Networks (IJCNN)
  84. Visual Emotion Recognition Through Affective Computing
    M. Praneesh · 2024 · The Springer series in applied machine learning
  85. Hear it here: Built environments predict ratings and descriptions of ambiguous sounds
    Brandon J. Forys, Emily Qi, Rebecca M. Todd, Alan F. Kingstone · 2025 · PLoS ONE
  86. Emotional state monitoring and applications with brain–computer interfaces
    Evin Şahin Sadık · 2025 · Elsevier eBooks
  87. Introduction to brain–computer interface: research trends and applications
    Saeed Mian Qaisar, Abdülhamit Subaşı · 2025 · Elsevier eBooks
  88. Electroencephalography-based emotion recognition with empirical mode decomposition and ensemble machine learning methods
    Abdülhamit Subaşı, Muhammed Enes Subasi, Saeed Mian Qaisar · 2025 · Elsevier eBooks
  89. A Computational Methodology Based on Maximum Overlap Discrete Wavelet Transform and Autoencoders for Early Prediction of Sudden Cardiac Death
    Manuel A. Centeno-Bautista, Andrea V. Perez-Sanchez, Juan P. Amézquita-Sánchez, David Camarena‐Martinez, Martin Valtierra‐Rodriguez · 2025 · Computation
  90. Bimodal Classification for Emotional Intelligence Using Peripheral Signals
    P. Y. Preema, J. Chandra, C. Steffi Angel · 2025 · Lecture notes in networks and systems
  91. Convolutional Neural Networks for Brain-Computer Interfaces
    Arvind Kumar Shukla, Nisha Rathore, Jyoti Prasad Patra, R. Dhivya, Abhendra Pratap Singh, B. Gayathri, D. Kirubakaran, V. Bhoopathy · 2025 · IGI Global eBooks
  92. Feature Fusion Classification for Emotional Intelligence Using Peripheral Signals
    P. Y. Preema, J. Chandra, C. Steffi Angel · 2025 · Lecture notes in networks and systems
  93. Thought Graph: Balancing Specificity and Uncertainty in LLM-Based Gene Set Annotation
    Kyle Cox, Gang Qu, Chi-Yang Hsu, Jiawei Xu, Yingtong Zhou, Zhen Tan, Mengzhou Hu, Tianlong Chen, Ziniu Hu, Zhongming Zhao et al. · 2025 · IEEE International Conference on Healthcare Informatics (ICHI)
  94. Ensembles of temporal models and forward-backward smoothing for surgical phase recognition
    Kiran Bhattacharyya, Aneeq Zia, Anthony Jarc · 2025 · medRxiv
  95. Joint Multi-level Attention and Consistency Aligned for Multimodal Emotion Recognition Based on Physiological Signals
    Yi Zeng, Y Yao, Shuaiqi Fu, Ganbo Cao, Jing Li, Yi Liu, Xiangdong Peng, Shuqiang Guo · 2025 · Lecture notes in computer science
  96. IoT - based Mood Sensing Ambience Creator
    Devata Anekar, Yashashwini Reddy, Harshada Gadade, Shaivi Jaiswal, Rishikesh Zadbuke, Vedant Zatale · 2025 · International Conference on Electronics and Sustainable Communication Systems (ICESC)
  97. SFHTNet: An EEG-Based Emotion Recognition Method Using Spatial Feature Encoding and Hierarchical Temporal Attention
    Tianyang Dong, Jiahao Bao, Wuchuan Liu, Wenyuan Ying · 2025 · Communications in computer and information science
  98. Improving EEG-Based Emotion Classification Using Other Physiological Signals
    Matteo Rogora, Hayato Oka, Keiko Ono · 2025 · International Conference on Intelligent Systems, Metaheuristics & Swarm Intelligence (ISMSI)
  99. Using Machine Learning to Model EEG-Derived Brain Activity During Emotion Regulation
    Mahdis Hojjati, Shyamal Y. Dharia, Sergio G. Camorlinga, Stephen D. Smith, Amy S. Desroches, Bronte D. Brenneman · 2025 · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)
  100. Personalized Sleep Prediction via Deep Adaptive Spatiotemporal Modeling and Sparse Data
    Xueyi Wang, Claudine J. C. Lamoth, Elisabeth Wilhelm · 2025 · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)