Recognition of emotions using multimodal physiological signals and an ensemble deep learning model

Yin, Zhong, Zhao, Mengyuan, Wang, Yongxiong, Yang, Jingdong, Zhang, Jianhua·2017·Computer Methods and Programs in Biomedicine
DOI 10.1016/j.cmpb.2016.12.005

Cited by (414)

Items 101–200 of 414

  1. Facial EMG sensing for monitoring affect using a wearable device
    Martin Gjoreski, Ivana Kiprijanovska, Simon Stankoski, Ifigeneia I. Mavridou, M. John Broulidakis, Hristijan Gjoreski, Charles C. Nduka · 2022 · Scientific Reports
  2. Identification of Sympathetic Nervous System Activation From Skin Conductance: A Sparse Decomposition Approach With Physiological Priors
    Md. Rafiul Amin, Rose T. Faghih · 2020 · IEEE Transactions on Biomedical Engineering
  3. A Survey on Databases for Multimodal Emotion Recognition and an Introduction to the VIRI (Visible and InfraRed Image) Database
    Mohammad Faridul Haque Siddiqui, Parashar Dhakal, Xiaoli Yang, Ahmad Y. Javaid · 2022 · Multimodal Technologies and Interaction
  4. ICA-Evolution Based Data Augmentation with Ensemble Deep Neural Networks Using Time and Frequency Kernels for Emotion Recognition from EEG-Data
    Jun-Su Kang, Swathi Kavuri, Minho Lee · 2019 · IEEE Transactions on Affective Computing
  5. Deep Learning Approach for Automatic Heartbeat Classification
    Roger de T. Guerra, Cristina Keiko Yamaguchi, Stéfano Frizzo Stefenon, Leandro dos Santos Coelho, Viviana Cocco Mariani · 2025 · Sensors
  6. Emotion classification on eye-tracking and electroencephalograph fused signals employing deep gradient neural networks
    Qun Wu, N. Dey, Fu-Qian Shi, R. G. Crespo, R. Sherratt · 2021 · Applied Soft Computing
  7. Deep belief network based affect recognition from physiological signals
    Piyush Kawde, Gyanendra K. Verma · 2017 · IEEE Uttar Pradesh Section International Conference on Electrical, Electronics and Computer Engineering (UPCON)
  8. Wearable biosensor network enabled multimodal daily-life emotion recognition employing reputation-driven imbalanced fuzzy classification
    Yixiang Dai, Xue Wang, Pengbo Zhang, Weihang Zhang · 2017 · Measurement
  9. Towards emotion recognition from contextual information using machine learning
    Martin G. Salido Ortega, Luis-Felipe Rodríguez, J. O. Gutierrez-Garcia · 2019 · Journal of Ambient Intelligence and Humanized Computing
  10. Attention-Based Temporal Graph Representation Learning for EEG-Based Emotion Recognition
    Chao Li, Feng Wang, Ziping Zhao, Haishuai Wang, Björn Wolfgang Schuller · 2024 · IEEE Journal of Biomedical and Health Informatics
  11. Multimodal Attention Network for Continuous-Time Emotion Recognition Using Video and EEG Signals
    Choi, Dong Yoon, Kim, Deok-Hwan, Song, Byung Cheol · 2020 · IEEE Access
  12. Emotion Recognition Using Fused Physiological Signals
    Diego Fabiano, Shaun J. Canavan · 2019 · International Conference on Affective Computing and Intelligent Interaction and workshops
  13. Optimization of Real-Time EEG Artifact Removal and Emotion Estimation for Human-Robot Interaction Applications
    Mikel Val-Calvo, José R. Álvarez, José Manuel Ferrández Vicente, Eduardo Fernández · 2019 · Frontiers in Computational Neuroscience
  14. Real-Time Multi-Modal Estimation of Dynamically Evoked Emotions Using EEG, Heart Rate and Galvanic Skin Response
    Mikel Val-Calvo, José R. Álvarez, José Manuel Ferrández Vicente, Alejandro Díaz‐Morcillo, Eduardo Fernández-Jover · 2020 · International Journal of Neural Systems
  15. Improved Deep Feature Learning by Synchronization Measurements for Multi-Channel EEG Emotion Recognition
    Chao Hao, Liang Dong, Yongli Liu, Baoyun Lu · 2020 · Complexity
  16. A fundamental overview of ensemble deep learning models and applications: systematic literature and state of the art
    Tawseef Ayoub Shaikh, Tabasum Rasool, Prabal Verma, Waseem Ahmad Mir · 2024 · Annals of Operations Research
  17. Exploring Motor Imagery Eeg Patterns for Stroke Patients with Deep Neural Networks
    Dawei Cheng, Ye Liu, Liqing Zhang · 2018 · IEEE International Conference on Acoustics Speech and Signal Processing
  18. EEG-Based Emotion Recognition Using an Improved Weighted Horizontal Visibility Graph
    Tianjiao Kong, Jie Shao, Jiuyuan Hu, Xin Mi Yang, Shiyiling Yang, Reza Malekian · 2021 · Sensors
  19. Emotion in a Century
    Thanyathorn Thanapattheerakul, Katherine Mao, Jacqueline Amoranto, Jonathan H. Chan · 2018
  20. The Application of Electroencephalogram in Driving Safety: Current Status and Future Prospects
    Yong Long Peng, Qian Xu, Shuxiang Lin, Xinghua Wang, Guoliang Xiang, Shufang Huang, Honghao Zhang, Chaojie Fan · 2022 · Frontiers in Psychology
  21. Hierarchical extreme puzzle learning machine-based emotion recognition using multimodal physiological signals
    Anushka Pradhan, Subodh Srivastava · 2023 · Biomedical Signal Processing and Control
  22. Quantitatively Interpreting Residents Happiness Prediction by Considering Factor–Factor Interactions
    Lin Li, Xiaohua Wu, Miao Kong, Jinhang Liu, Jianwei Zhang · 2023 · IEEE Transactions on Computational Social Systems
  23. Decoding emotion with phase–amplitude fusion features of EEG functional connectivity network
    Liangliang Hu, Congming Tan, Jiayang Xu, Rui Qiao, Yilin Hu, Yin Tian · 2024 · Neural Networks
  24. Correlated Attention Networks for Multimodal Emotion Recognition
    Jielin Qiu, Xiaoyu Li, Kai Hu · 2018 · IEEE International Conference on Bioinformatics and Biomedicine (BIBM)
  25. EEG based emotion recognition using minimum spanning tree
    Sajjad Farashi, Reza Khosrowabadi · 2020 · Physical and Engineering Sciences in Medicine
  26. Where Do We Stand in the Domestic Dog (Canis familiaris) Positive-Emotion Assessment: A State-of-the-Art Review and Future Directions
    Erika Csoltova, Emira Mehinagic · 2020 · Frontiers in Psychology
  27. EEG-based emotion recognition for road accidents in a simulated driving environment
    Jielin Chen, Xuefen Lin, Weifeng Ma, Yuchen Wang, Wei Hong Tang · 2023 · Biomedical Signal Processing and Control
  28. A Domain Generalization and Residual Network-Based Emotion Recognition from Physiological Signals
    Junnan Li, Jiang Li, Xiaoping Wang, Xin Zhan, Zhigang Zeng · 2023 · Cyborg and Bionic Systems
  29. A NOVEL METHOD OF EEG-BASED EMOTION RECOGNITION USING NONLINEAR FEATURES VARIABILITY AND DEMPSTER–SHAFER THEORY
    Morteza Zangeneh Soroush, Keivan Maghooli, Seyed Kamaledin Setarehdan, Ali Motie Nasrabadi · 2018 · Biomedical Engineering Applications Basis and Communications
  30. Experience with an Affective Robot Assistant for Children with Hearing Disabilities
    Pınar Uluer, Hatice Köse, Elif Gümüşlü, Duygun Erol Barkana · 2021 · International Journal of Social Robotics
  31. Emotion recognition with residual network driven by spatial-frequency characteristics of EEG recorded from hearing-impaired adults in response to video clips
    Zhongli Bai, Junjie Liu, Fazheng Hou, Yirui Chen, Meiyi Cheng, Zemin Mao, Yu Song, Qiang Gao · 2022 · Computers in Biology and Medicine
  32. A novel approach to emotion recognition using local subset feature selection and modified Dempster-Shafer theory
    M. Zangeneh Soroush, K. Maghooli, S. Setarehdan, A. Nasrabadi · 2018 · Behavioral and Brain Functions
  33. End-to-end Facial and Physiological Model for Affective Computing and Applications
    Joaquim Comas, Decky Aspandi, Xavier Binefa · 2020 · International Conference on Automatic Face and Gesture Recognition
  34. A Systematic Review on Emotion Recognition System Using Physiological Signals: Data Acquisition and Methodology
    K. Tawsif, Nor Azlina Ab. Aziz, Joseph Emerson Raja, Md. Jakir Hossen, M. Z. H. Jesmeen · 2022 · Emerging Science Journal
  35. Review of EEG Affective Recognition with a Neuroscience Perspective
    R. Lim, Wai-Cheong Lincoln Lew, Keng-Ang Kai · 2024 · Brain Science
  36. Multi-modal Emotion Recognition with Temporal-Band Attention Based on LSTM-RNN
    Jiamin Liu, Yuanqi Su, Yuehu Liu · 2018 · Lecture notes in computer science
  37. Emotion Recognition using EEG and Physiological Data for Robot-Assisted Rehabilitation Systems
    Elif Gümüşlü, Duygun Erol Barkana, Hatice Köse · 2020 · Companion Publication of the International Conference on Multimodal Interaction (ICMI Companion)
  38. Multi-modal emotion recognition using recurrence plots and transfer learning on physiological signals
    Rayan Elalamy, Marios Fanourakis, Guillaume Chanel · 2021 · International Conference on Affective Computing and Intelligent Interaction and workshops
  39. AttX: Attentive Cross-Connections for Fusion of Wearable Signals in Emotion Recognition
    Anubha Bhatti, Behnam Behinaein, Paul Hungler, Ali Etemad · 2022 · ACM Trans. Comput. Heal.
  40. A novel EEG-based approach to classify emotions through phase space dynamics
    Morteza Zangeneh Soroush, Keivan Maghooli, Seyed Kamaledin Setarehdan, Ali Motie Nasrabadi · 2019 · Signal Image and Video Processing
  41. Multimodal Approach for Emotion Recognition Based on Simulated Flight Experiments
    Válber César Cavalcanti Roza, Octavian Adrian Postolache · 2019 · Sensors
  42. Efficient emotion recognition using hyperdimensional computing with combinatorial channel encoding and cellular automata
    Alisha Menon, Anirudh Natarajan, Reva Agashe, Daniel Sun, Melvin Aristio, Harrison Liew, Yakun Sophia Shao, Jan M. Rabaey · 2022 · Brain Informatics
  43. Pre-training in Medical Data: A Survey
    Qiu, Yixuan, Lin, Feng, Chen, Weitong, Xu, Miao · 2023 · Machine Intelligence Research
  44. Utilizing Deep Learning Towards Multi-modal Bio-sensing and Vision-based Affective Computing
    Siddharth Siddharth, Tzyy‐Ping Jung, Terrence J. Sejnowski A B · 2019 · arXiv (Cornell University)
  45. Personality-Based Emotion Recognition Using EEG Signals with a CNN-LSTM Network
    Mohammad Saleh Khajeh Hosseini, Seyed Mohammad Firoozabadi, Kambiz Badie, Parviz Azadfallah · 2023 · Brain Sciences
  46. Emotion Recognition Based on Photoplethysmogram and Electroencephalogram
    Zhongkai Tong, XianXiang Chen, Zhengling He, Kai Tong, Zhen Fang, Xianlong Wang · 2018 · IEEE Annual International Computer Software and Applications Conference (COMPSAC)
  47. Visual Smoke Detection Based on Ensemble Deep CNNs
    Hongyan Liu, Fei Lei, Tong Chen, Cui Chunji, Wu Li · 2021 · Displays
  48. Developing an efficient functional connectivity-based geometric deep network for automatic EEG-based visual decoding
    Nastaran Khaleghi, Tohid Yousefi Rezaii, Soosan Beheshti, Saeed Meshgini · 2022 · Biomedical Signal Processing and Control
  49. Audio-visual stimulation based emotion classification by correlated EEG channels
    Mitul Kumar Ahirwal, Mangesh Ramaji Kose · 2019 · Health and Technology
  50. Affective brain-computer interfaces: Choosing a meaningful performance measuring metric
    Md Rakibul Mowla, Rachael I. Cano, Katie J. Dhuyvetter, David E. Thompson · 2020 · Computers in Biology and Medicine
  51. Two-stepped majority voting for efficient EEG-based emotion classification
    Aras Masood Ismael, Ömer Faruk Alçin, Karmand Hussein Abdalla, Abdulkadir Şengür · 2020 · Brain Informatics
  52. Emotion Recognition System Based on Two-Level Ensemble of Deep-Convolutional Neural Network Models
    Muhammad Hussain, Emad-ul-Haq Qazi, Hatim Aboalsamh, Ihsan Ullah · 2023 · IEEE Access
  53. Tonic and Phasic Decomposition of Skin Conductance Data: A Generalized-Cross-Validation-Based Block Coordinate Descent Approach
    Md. Rafiul Amin, Rose T. Faghih · 2019 · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)
  54. Cross-modal credibility modelling for EEG-based multimodal emotion recognition
    Yuzhe Zhang, Huan Liu, Di Wang, Dalin Zhang, Tianyu Lou, Qinghua Zheng, Chai Hiok Quek · 2024 · Journal of Neural Engineering
  55. Bimodal affect recognition based on autoregressive hidden Markov models from physiological signals
    Fatma Patlar Akbulut, Harry G. Perros, Muhammad Shahzad · 2020 · Computer Methods and Programs in Biomedicine
  56. Variational Autoencoder based Latent Factor Decoding of Multichannel EEG for Emotion Recognition
    Xiang Li, Zhigang Zhao, Dawei Song, Yazhou Zhang, Chunyang Niu, Junwei Zhang, Jidong Huo, Jing Li · 2019 · IEEE International Conference on Bioinformatics and Biomedicine (BIBM)
  57. A novel signal to image transformation and feature level fusion for multimodal emotion recognition
    Bahar Hatipoğlu Yılmaz, Cemal Köse · 2021 · Biomedizinische Technik/Biomedical Engineering
  58. EEG Emotion Recognition Based on Federated Learning Framework
    Chang Xu, Hong Liu, Wei Qi · 2022 · Electronics
  59. Time Synchronization of Multimodal Physiological Signals through Alignment of Common Signal Types and Its Technical Considerations in Digital Health
    Ran Xiao, Cheng Ding, Xiao Hu · 2022 · Journal of Imaging
  60. Emotion Recognition from Physiological Signals Using Parallel Stacked Autoencoders
    Sara Bagherzadeh, Keivan Maghooli, Javid Farhadi Sedehi, Morteza Zangeneh Soroush · 2018 · Neurophysiology
  61. Emotional State Recognition from Peripheral Physiological Signals Using Fused Nonlinear Features and Team-Collaboration Identification Strategy
    Li-Zheng Pan, Ze-Ming Yin, Shi-Gang She, Ai-Guo Song · 2020 · Entropy
  62. Deep Learning Method for Selecting Effective Models and Feature Groups in Emotion Recognition Using an Asian Multimodal Database
    Junho Maeng, Dong-Hyun Kang, Deok‐Hwan Kim · 2020 · Electronics
  63. A Survey of Approaches to Unobtrusive Sensing of Humans
    José Marcelo Fernandes, Jorge Sá Silva, André Rodrigues, Fernando Boavida · 2022 · ACM Computing Surveys
  64. SSVEP-Based Emotion Recognition for IoT via Multiobjective Neural Architecture Search
    Yipeng Du, Jian Liu, Xiang Wang, Peng Wang · 2022 · IEEE Internet of Things Journal
  65. Tensor Correlation Fusion for Multimodal Physiological Signal Emotion Recognition
    Jian Guo Shen, Kexin Zhu, Huakang Liu, Jinwen Wu, Kang Wang, Qunxi Dong · 2024 · IEEE Transactions on Computational Social Systems
  66. Cross-Subject Emotion Recognition with a Decision Tree Classifier Based on Sequential Backward Selection
    Wenge Jiang, Guangyuan Liu, Xingcong Zhao, Fu Sheng Yang · 2019 · International Conference on Intelligent Human-Machine Systems and Cybernetics
  67. Applied Affective Computing
    Leimin Tian, Sharon L. Oviatt, Michał Muszyński, Brent C. Chamberlain, Jennifer Healey, Akane Sano · 2022 · ACM eBooks
  68. Research on Multimodal Emotion Recognition Based on Fusion of Electroencephalogram and Electrooculography
    Jialai Yin, Minchao Wu, Yan Yang, Ping Li, Fan Li, Wen Zhao Liang, Zhao Lv · 2024 · IEEE Transactions on Instrumentation and Measurement
  69. EEG signal based Modified Kohonen Neural Networks for Classification of Human Mental Emotions
    D. Jude Hemanth · 2020 · Journal of Artificial Intelligence and Systems
  70. Emotion Recognition Based on EEG Brain Rhythm Sequencing Technique
    Jiawen Li, Shovan Barma, Sio Hang Pun, Mang I Vai, Peng Un Mak · 2022 · IEEE Transactions on Cognitive and Developmental Systems
  71. A happiness degree predictor using the conceptual data structure for deep learning architectures
    Pérez-Benito, Francisco Javier, Villacampa-Fernández, Patricia, Conejero, J. Alberto, García-Gómez, Juan M., Navarro-Pardo, Esperanza · 2019 · Computer Methods and Programs in Biomedicine
  72. A temporal-spectral graph convolutional neural network model for EEG emotion recognition within and across subjects
    Rui Li, Xuanwen Yang, Jun Lou, Junsong Zhang · 2024 · Brain Informatics
  73. EEG emotion recognition based on efficient-capsule network with convolutional attention
    Wei Hong Tang, Linhui Fan, Xuefen Lin, Yifan Gu · 2025 · Biomedical Signal Processing and Control
  74. Deep Learning-Based Optimal Smart Shoes Sensor Selection for Energy Expenditure and Heart Rate Estimation
    Heesang Eom, Jongryun Roh, Yuli Sun Hariyani, Suwhan Baek, Sukho Lee, Sayup Kim, Cheolsoo Park · 2021 · Sensors
  75. Robust Inference of Autonomic Nervous System Activation Using Skin Conductance Measurements: A Multi-Channel Sparse System Identification Approach
    Md. Rafiul Amin, Rose T. Faghih · 2019 · IEEE Access
  76. Multimodal emotion recognition by fusing complementary patterns from central to peripheral neurophysiological signals across feature domains
    Zhuang Ma, Ao Li, Jiehao Tang, Jianhua Zhang, Zhong Yin · 2025 · Engineering Applications of Artificial Intelligence
  77. Unsupervised representation learning based on the deep multi-view ensemble learning
    Maryam Koohzadi, Nasrollah Moghadam Charkari, Foad Ghaderi · 2019 · Applied Intelligence
  78. Multi-Channel EEG Based Emotion Recognition Using Temporal Convolutional Network and Broad Learning System
    Xue Jia, Tong Zhang, C. L. Philip Chen, Zhulin Liu, Long Chen, Guihua Wen, Bin Hu · 2020 · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics
  79. Exploring Seafarers’ Workload Recognition Model with EEG, ECG and Task Scenarios’ Complexity: A Bridge Simulation Study
    Yue Ma, Qing Liu, Liu Yang · 2022 · Journal of Marine Science and Engineering
  80. Innovations in Online Learning Analytics: A Review of Recent Research and Emerging Trends
    Yidan Wang, Yuxuan Lai, Xiaoran Huang · 2024 · IEEE Access
  81. Performance Comparison of Machine Learning Algorithms for EEG-Signal-Based Emotion Recognition
    Peng Chen, Jianhua Zhang · 2017 · Lecture notes in computer science
  82. Two sides of the same coin: adaptation of BCIs to internal states with user-centered design and electrophysiological features
    Yiyuan Han, Philipp Ziebell, Angela Riccio, Sebastian Halder · 2022 · Brain-Computer Interfaces
  83. Subject independent emotion recognition using EEG and physiological signals – a comparative study
    Manju Priya Arthanarisamy Ramaswamy, Suja Palaniswamy · 2022 · Applied Computing and Informatics
  84. Who is unhappy for Brexit? A machine-learning, agent-based study on financial instability
    Efstathios Polyzos, Aristeidis Samitas, Marina‐Selini Katsaiti · 2020 · International Review of Financial Analysis
  85. Accelerating 3D Convolutional Neural Network with Channel Bottleneck Module for EEG-Based Emotion Recognition
    Sungkyu Kim, Tae‐Seong Kim, Won Hee Lee · 2022 · Sensors
  86. EEG-based emotion recognition using dual tree complex wavelet transform and random subspace ensemble classifier
    Emrah Hançer, Abdülhamit Subaşı · 2022 · Computer Methods in Biomechanics & Biomedical Engineering
  87. Sparsity constrained differential evolution enabled feature-channel-sample hybrid selection for daily-life EEG emotion recognition
    Yixiang Dai, Xue Wang, Pengbo Zhang, Weihang Zhang, Junfeng Chen · 2018 · Multimedia Tools and Applications
  88. Incorporation of Multiple-Days Information to Improve the Generalization of EEG-Based Emotion Recognition Over Time
    Shuang Liu, Long Chen, Dongyue Guo, Xiaoya Liu, Yue Sheng, Yufeng Ke, Minpeng Xu, Xingwei An, Jiajia Yang, Dong Ming · 2018 · Frontiers in Human Neuroscience
  89. EEG-Based Cognitive State Assessment Using Deep Ensemble Model and Filter Bank Common Spatial Pattern
    Debashis Das Chakladar, Shubhashis Dey, Partha Pratim Roy, Masakazu Iwamura · 2021 · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition
  90. Stochastic weight averaging enhanced temporal convolution network for EEG-based emotion recognition
    Lijun Yang, Yixin Wang, Xiaohui Yang, Zheng Chen · 2023 · Biomedical Signal Processing and Control
  91. Selecting transferrable neurophysiological features for inter-individual emotion recognition via a shared-subspace feature elimination approach
    Wei Zhang, Zhong Yin, Zhanquan Sun, Ying Tian, Yagang Wang · 2020 · Computers in Biology and Medicine
  92. Multi-Modal Emotion Recognition Based On deep Learning Of EEG And Audio Signals
    Zhongjie Li, Gaoyan Zhang, Jianwu Dang, Longbiao Wang, Jianguo Wei · 2021 · International Joint Conference on Neural Networks (IJCNN)
  93. E-MFNN: an emotion-multimodal fusion neural network framework for emotion recognition
    Zhuen Guo, Mingqing Yang, Li Lin, Jisong Li, Shuyue Zhang, Qianbo He, Jiaqi Gao, Heling Meng, Xinran Chen, Yuehao Tao et al. · 2024 · PeerJ Computer Science
  94. Dynamical recursive feature elimination technique for neurophysiological signal-based emotion recognition
    Zhong Yin, Lei Liu, Li Liu, Jianhua Zhang, Yagang Wang · 2017 · Cognition Technology & Work
  95. “Be a Lighting Programmer”: Supporting Children Collaborative Learning through Tangible Programming System
    Xinyuan Wang, Qian Xing, Qiao Jin, Danli Wang · 2023 · International Journal of Human-Computer Interaction
  96. EEG-based emotion recognition using modified covariance and ensemble classifiers
    Abdülhamit Subaşı, Saeed Mian Qaisar · 2023 · Journal of Ambient Intelligence and Humanized Computing
  97. Electroencephalogram Emotion Recognition Based on A Stacking Classification Model
    Oiao Xie, Zhentao Liu, Xue-Wen Ding · 2018 · Chinese Control Conference (CCC)
  98. Reward-Penalty Weighted Ensemble for Emotion State Classification from Multi-Modal Data Streams
    Arijit Nandi, Fatos Xhafa, Laia Subirats, Santi Fort · 2022 · International Journal of Neural Systems
  99. Emotion Recognition Using Time-frequency Analysis of EEG Signals and Machine Learning
    Jianhua Zhang, Peng Chen, Stefano Nichele, Anis Yazidi · 2019 · IEEE Symposium Series on Computational Intelligence (SSCI)
  100. Graph-based learning of nonlinear physiological interactions for classification of emotions
    Huiyu Huang, Miaolin Fan, Chun-An Chou · 2023 · Pattern Recognition