The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Human emotion recognition using deep belief network architecture
Open accessAbstract
Abstract Recently, deep learning methodologies have become popular to analyse physiological signals in multiple modalities via hierarchical architectures for human emotion recognition. In most of the state-of-the-arts of human emotion recognition, deep learning for emotion classification was used. However, deep learning is mostly effective for deep feature extraction. Therefore, in this research, we applied unsupervised deep belief network (DBN) for depth level feature extraction from fused observations of Electro-Dermal Activity (EDA), Photoplethysmogram (PPG) and Zygomaticus Electromyography (zEMG) sensors signals. Afterwards, the DBN produced features are combined with statistical features of EDA, PPG and zEMG to prepare a feature-fusion vector. The prepared feature vector is then used to classify five basic emotions namely Happy, Relaxed, Disgust, Sad and Neutral. As the emotion classes are not linearly separable from the feature-fusion vector, the Fine Gaussian Support Vector Machine (FGSVM) is used with radial basis function kernel for non-linear classification of human emotions. Our experiments on a public multimodal physiological signal dataset show that the DBN, and FGSVM based model significantly increases the accuracy of emotion recognition rate as compared to the existing state-of-the-art emotion classification techniques.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neural networks and physical systems with emergent collective computational abilities.
Hopfield, J. J. (1982) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.79.8.2554 · Cited by 19,270
Russell, J. A. (1980) · Journal of Personality and Social Psychology · doi:10.1037/h0077714 · Cited by 16,334
DEAP: A Database for Emotion Analysis ;Using Physiological Signals
Koelstra, S., Muhl, C., Soleymani, M., Lee, J.-S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., & Patras, I. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.15 · Cited by 5,093
Emotion recognition in human-computer interaction
Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kollias, S., Fellenz, W., & Taylor, J. G. (2001) · IEEE Signal Processing Magazine · doi:10.1109/79.911197 · Cited by 2,603
Toward machine emotional intelligence: analysis of affective physiological state
Picard, R. W., Vyzas, E., & Healey, J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.954607 · Cited by 2,334
A review of affective computing: From unimodal analysis to multimodal fusion
Poria, S., Cambria, E., Bajpai, R., & Hussain, A. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.02.003 · Cited by 1,644
Feature Extraction and Selection for Emotion Recognition from EEG
Jenke, R., Peer, A., & Buss, M. (2014) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2014.2339834 · Cited by 1,081
Task Offloading for Mobile Edge Computing in Software Defined Ultra-Dense Network
Chen, M., & Hao, Y. (2018) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2018.2815360 · Cited by 1,068
Emotional state classification from EEG data using machine learning approach
Wang, X.-W., Nie, D., & Lu, B.-L. (2014) · Neurocomputing · doi:10.1016/j.neucom.2013.06.046 · Cited by 755
A robust human activity recognition system using smartphone sensors and deep learning
Hassan, M. M., Uddin, M. Z., Mohamed, A., & Almogren, A. (2018) · Future Generation Computer Systems · doi:10.1016/j.future.2017.11.029 · Cited by 656
Self-citationAudio-visual speech recognition using deep learning
Noda, K., Yamaguchi, Y., Nakadai, K., Okuno, H. G., & Ogata, T. (2015) · Applied Intelligence · doi:10.1007/s10489-014-0629-7 · Cited by 579
Improving BCI-based emotion recognition by combining EEG feature selection and kernel classifiers
Atkinson, J., & Campos, D. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.10.049 · Cited by 506
Fleury, A., Vacher, M., & Noury, N. (2010) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2009.2037317 · Cited by 489
Emotion recognition using wireless signals
Zhao, M., Adib, F., & Katabi, D. (2016) · Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking · doi:10.1145/2973750.2973762 · Cited by 461
EEG-based emotion recognition during watching movies
Nie, D., Wang, X.-W., Shi, L.-C., & Lu, B.-L. (2011) · 2011 5th International IEEE/EMBS Conference on Neural Engineering · doi:10.1109/ner.2011.5910636 · Cited by 360
Real-Time Movie-Induced Discrete Emotion Recognition from EEG Signals
Liu, Y.-J., Yu, M., Zhao, G., Song, J., Ge, Y., & Shi, Y. (2018) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2660485 · Cited by 356
Verma, G. K., & Tiwary, U. S. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.11.007 · Cited by 354
Autonomic specificity of discrete emotion and dimensions of affective space: a multivariate approach
Christie, I. C., & Friedman, B. H. (2004) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2003.08.002 · Cited by 347
Frantzidis, C. A., Bratsas, C., Papadelis, C. L., Konstantinidis, E., Pappas, C., & Bamidis, P. D. (2010) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2010.2041553 · Cited by 247
Cognitive Computing: Architecture, Technologies and Intelligent Applications
Chen, M., Herrera, F., & Hwang, K. (2018) · IEEE Access · doi:10.1109/access.2018.2791469 · Cited by 242
Autonomic computation offloading in mobile edge for IoT applications
Alam, M. G. R., Hassan, M. M., Uddin, M. Z., Almogren, A., & Fortino, G. (2019) · Future Generation Computer Systems · doi:10.1016/j.future.2018.07.050 · Cited by 217
Self-citationEEG correlates (event-related desynchronization) of emotional face elaboration: A temporal analysis
Balconi, M., & Lucchiari, C. (2006) · Neuroscience Letters · doi:10.1016/j.neulet.2005.09.004 · Cited by 213
Data-Driven Computing and Caching in 5G Networks: Architecture and Delay Analysis
Chen, M., Qian, Y., Hao, Y., Li, Y., & Song, J. (2018) · IEEE Wireless Communications · doi:10.1109/mwc.2018.1700216 · Cited by 195
Balconi, M., & Mazza, G. (2009) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2009.08.006 · Cited by 176
Liu, C., Conn, K., Sarkar, N., & Stone, W. (2008) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhsc.2008.04.003 · Cited by 163
Martini, N., Menicucci, D., Sebastiani, L., Bedini, R., Pingitore, A., Vanello, N., Milanesi, M., Landini, L., & Gemignani, A. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.01.060 · Cited by 157
Detecting Naturalistic Expressions of Nonbasic Affect Using Physiological Signals
AlZoubi, O., D’Mello, S. K., & Calvo, R. A. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2012.4 · Cited by 143
Ramírez-Gallego, S., Fernández, A., García, S., Chen, M., & Herrera, F. (2018) · Information Fusion · doi:10.1016/j.inffus.2017.10.001 · Cited by 140
Hinton, G. E. (2013) · Cognitive Science · doi:10.1111/cogs.12049 · Cited by 132
Affective Computing and Intelligent Interaction
D’Mello, S., Martin, J.-C., Schuller, B., & Graesser, A. C. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-24571-8 · Cited by 122
Kanjo, E., Younis, E. M. G., & Sherkat, N. (2018) · Information Fusion · doi:10.1016/j.inffus.2017.05.005 · Cited by 118
Converting Your Thoughts to Texts: Enabling Brain Typing via Deep Feature Learning of EEG Signals
Zhang, X., Yao, L., Sheng, Q. Z., Kanhere, S. S., Gu, T., & Zhang, D. (2018) · IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom.2018.8444575 · Cited by 117
Modeling Physiological Data with Deep Belief Networks.
Wang, D., & Shang, Y. (2013) · PubMed · doi:10.7763/ijiet.2013.v3.326 · Cited by 111
A real-time classification algorithm for EEG-based BCI driven by self-induced emotions
Iacoviello, D., Petracca, A., Spezialetti, M., & Placidi, G. (2015) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2015.08.011 · Cited by 104
Deep detection network for real-life traffic sign in vehicular networks
Yang, T., Long, X., Sangaiah, A. K., Zheng, Z., & Tong, C. (2018) · Computer Networks · doi:10.1016/j.comnet.2018.02.026 · Cited by 103
EEG Correlates of Different Emotional States Elicited during Watching Music Videos
Kroupi, E., Yazdani, A., & Ebrahimi, T. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-24571-8_58 · Cited by 101
Mehmood, R. M., & Lee, H. J. (2016) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2016.04.009 · Cited by 99
Adaptive Emotional Information Retrieval From EEG Signals in the Time-Frequency Domain
Petrantonakis, P. C., & Hadjileontiadis, L. J. (2012) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2187647 · Cited by 94
Khezri, M., Firoozabadi, M., & Sharafat, A. R. (2015) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2015.07.006 · Cited by 89
Analysis of physiological for emotion recognition with the IRS model
Li, C., Xu, C., & Feng, Z. (2015) · Neurocomputing · doi:10.1016/j.neucom.2015.07.112 · Cited by 83
Emotion Recognition Involving Physiological and Speech Signals: A Comprehensive Review
Ali, M., Mosa, A. H., Machot, F. A., & Kyamakya, K. (2017) · Studies in systems, decision and control · doi:10.1007/978-3-319-58996-1_13 · Cited by 74
Emotion recognition based on 3D fuzzy visual and EEG features in movie clips
Lee, G., Kwon, M., Sri, S. K., & Lee, M.-H. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.04.008 · Cited by 63
A hybrid-multi filter-wrapper framework to identify run-time behaviour for fast malware detection
Huda, S., Islam, R., Abawajy, J., Yearwood, J. L., Hassan, M. M., & Fortino, G. (2018) · Future Generation Computer Systems · doi:10.1016/j.future.2017.12.037 · Cited by 48
Self-citationHassan, M. M., Huda, S., Yearwood, J. L., Jelinek, H. F., & Almogren, A. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.08.004 · Cited by 39
Self-citationKonstantinidis, E. I., Frantzidis, C. A., Pappas, C., & Bamidis, P. D. (2012) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2012.03.008 · Cited by 32
Web of Objects Based Ambient Assisted Living Framework for Emergency Psychiatric State Prediction
Alam, M. G. R., Abedin, S. F., Ameen, M. A., & Hong, C. S. (2016) · Sensors · doi:10.3390/s16091431 · Cited by 28
Self-citationVideo Object Detection for Tractability with Deep Learning Method
Tian, B., Li, L., Qu, Y., & Li, Y. (2017) · International Conference on Advanced Cloud and Big Data · doi:10.1109/cbd.2017.75 · Cited by 28
EM-Psychiatry: An Ambient Intelligent System for Psychiatric Emergency
Alam, M. G. R., Haw, R., Kim, S. S., Azad, M. A. K., Abedin, S. F., & Hong, C. S. (2016) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2016.2610191 · Cited by 25
Self-citation
Cited by
Emotion recognition using multi-modal data and machine learning techniques: A tutorial and review
Zhang, J., Yin, Z., Chen, P., & Nichele, S. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.01.011 · Cited by 806
Feature dimensionality reduction: a review
Jia, W., Sun, M., Lian, J., & Hou, S. (2022) · Complex & Intelligent Systems · doi:10.1007/s40747-021-00637-x · Cited by 797
“The prepared feature fusion vector is generated by combing DBN with the statistical features of EDA, PPG and zEMG for emotion classification [162].”
MethodQiu, S., Zhao, H., Jiang, N., Wang, Z., Liu, L., An, Y., Zhao, H., Miao, X., Liu, R., & Fortino, G. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.11.006 · Cited by 671
Self-citationA systematic review on affective computing: emotion models, databases, and recent advances
Wang, Y., Song, W., Tao, W., Liotta, A., Yang, D., Li, X., Gao, S., Sun, Y., Ge, W., Zhang, W., et al. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.03.009 · Cited by 615
A Comprehensive Review of Speech Emotion Recognition Systems
Wani, T. M., Gunawan, T. S., Qadri, S. A. A., Kartiwi, M., & Ambikairajah, E. (2021) · IEEE Access · doi:10.1109/access.2021.3068045 · Cited by 376
Metadata
- Authors
- Hassan, M. M., Alam, M. G. R., Uddin, M. Z., Huda, S., Almogren, A., & Fortino, G.
- Venue
- Information Fusion
- Publisher
- Elsevier BV
- Published
- 2019-11
- Volume
- 51
- Pages
- 10-18
- ISSN
- 1566-2535 (ISSN-L)
- OpenAlex
- W2941914178
- Cited by
- 307
- References
- 49
- FWCI
- 43.50
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.