The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
EEG emotion recognition using fusion model of graph convolutional neural networks and LSTM
Abstract
Abstract In recent years, graph convolutional neural networks have become research focus and inspired new ideas for emotion recognition based on EEG. Deep learning has been widely used in emotion recognition, but it is still challenging to construct models and algorithms in practical applications. In this paper, we propose a novel emotion recognition method based on a novel deep learning model (ERDL). Firstly, EEG data is calibrated by 3s baseline data and divided into segments with 6s time window, and then differential entropy is extracted from each segment to construct feature cube. Secondly, the feature cube of each segment serves as input of the novel deep learning model which fuses graph convolutional neural network (GCNN) and long-short term memories neural networks (LSTM). In the fusion model, multiple GCNNs are applied to extract graph domain features while LSTM cells are used to memorize the change of the relationship between two channels within a specific time and extract temporal features, and Dense layer is used to attain the emotion classification results. At last, we conducted extensive experiments on DEAP dataset and experimental results demonstrate that the proposed method has better classification results than the state-of-the-art methods. We attained the average classification accuracy of 90.45% and 90.60% for valence and arousal in subject-dependent experiments while 84.81% and 85.27% in subject-independent experiments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
The graph neural network model
Scarselli, F., Gori, M., Tsoi, A. C., Hagenbuchner, M., & Monfardini, G. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2005605 · Cited by 9,582
Greff, K., Srivastava, R. K., Koutnik, J., Steunebrink, B. R., & Schmidhuber, J. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2582924 · Cited by 6,955
A Review of Recurrent Neural Networks: LSTM Cells and Network Architectures
Yu, Y., Si, X., Hu, C., & Zhang, J. (2019) · Neural Computation · doi:10.1162/neco_a_01199 · Cited by 5,591
DEAP: A Database for Emotion Analysis ;Using Physiological Signals
Koelstra, S., Muhl, C., Soleymani, M., Lee, J.-S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., & Patras, I. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.15 · Cited by 5,093
Hämäläinen, M., Hari, R., Ilmoniemi, R. J., Knuutila, J., & Lounasmaa, O. V. (1993) · Reviews of Modern Physics · doi:10.1103/revmodphys.65.413 · Cited by 4,684
Advances In Deep Learning On Graphs (Gsp'18 Workshop)
Defferrard, M. (2016) · Figshare · doi:10.5281/zenodo.1286817 · Cited by 4,613
A survey of decision tree classifier methodology
Safavian, S. R., & Landgrebe, D. (1991) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/21.97458 · Cited by 3,808
EEG Emotion Recognition Using Dynamical Graph Convolutional Neural Networks
Song, T., Zheng, W., Song, P., & Cui, Z. (2020) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2817622 · Cited by 1,597
EEG analysis based on time domain properties
Hjorth, B. (1970) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(70)90143-4 · Cited by 1,504
Emotions Recognition Using EEG Signals: A Survey
Alarcao, S. M., & Fonseca, M. J. (2019) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2714671 · Cited by 1,201
EEG-Based Emotion Recognition in Music Listening
Lin, Y.-P., Wang, C.-H., Jung, T.-P., Wu, T.-L., Jeng, S.-K., Duann, J.-R., & Chen, J.-H. (2010) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2010.2048568 · Cited by 1,021
What does the prefrontal cortex “do” in affect: perspectives on frontal EEG asymmetry research
Davidson, R. J. (2004) · Biological Psychology · doi:10.1016/j.biopsycho.2004.03.008 · Cited by 992
2018 International Joint Conference on Neural Networks (IJCNN)
(2018) · doi:10.1109/ijcnn40505.2018 · Cited by 746
Emotion Recognition From EEG Using Higher Order Crossings
Petrantonakis, P. C., & Hadjileontiadis, L. J. (2010) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2009.2034649 · Cited by 687
CayleyNets: Graph Convolutional Neural Networks With Complex Rational Spectral Filters
Levie, R., Monti, F., Bresson, X., & Bronstein, M. M. (2019) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2018.2879624 · Cited by 685
Emotion Recognition based on EEG using LSTM Recurrent Neural Network
Alhagry, S., Aly, A., & A., R. (2017) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2017.081046 · Cited by 645
(2014) · IEEE Pulse · doi:10.1109/mpul.2014.2316040 · Cited by 456
2015 International Joint Conference on Neural Networks (IJCNN)
(2015) · doi:10.1109/ijcnn34689.2015 · Cited by 397
Differential entropy feature for EEG-based vigilance estimation
Shi, L.-C., Jiao, Y.-Y., & Lu, B.-L. (2013) · 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2013.6611075 · Cited by 396
Emotion classification based on gamma-band EEG
Li, M., & Lu, B.-L. (2009) · 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society · doi:10.1109/iembs.2009.5334139 · Cited by 375
EEG-based emotion classification using deep belief networks
Zheng, W.-L., Zhu, J.-Y., Peng, Y., & Lu, B.-L. (2014) · 2014 IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2014.6890166 · Cited by 367
EEG-based emotion recognition during watching movies
Nie, D., Wang, X.-W., Shi, L.-C., & Lu, B.-L. (2011) · 2011 5th International IEEE/EMBS Conference on Neural Engineering · doi:10.1109/ner.2011.5910636 · Cited by 360
Real-Time Movie-Induced Discrete Emotion Recognition from EEG Signals
Liu, Y.-J., Yu, M., Zhao, G., Song, J., Ge, Y., & Shi, Y. (2018) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2660485 · Cited by 356
Hierarchical Convolutional Neural Networks for EEG-Based Emotion Recognition
Li, J., Zhang, Z., & He, H. (2018) · Cognitive Computation · doi:10.1007/s12559-017-9533-x · Cited by 337
Emotion Recognition Using Multimodal Deep Learning
Liu, W., Zheng, W.-L., & Lu, B.-L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46672-9_58 · Cited by 301
A Review on the Computational Methods for Emotional State Estimation from the Human EEG
Kim, M.-K., Kim, M., Oh, E., & Kim, S.-P. (2013) · Computational and Mathematical Methods in Medicine · doi:10.1155/2013/573734 · Cited by 293
Emotion recognition from multi-channel EEG data through Convolutional Recurrent Neural Network
Li, X., Song, D., Zhang, P., Yu, G., Hou, Y., & Hu, B. (2016) · 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm.2016.7822545 · Cited by 283
Self-citationSAE+LSTM: A New Framework for Emotion Recognition From Multi-Channel EEG
Xing, X., Li, Z., Xu, T., Shu, L., Hu, B., & Xu, X. (2019) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2019.00037 · Cited by 269
Self-citationAccurate EEG-Based Emotion Recognition on Combined Features Using Deep Convolutional Neural Networks
Chen, J. X., Zhang, P. W., Mao, Z. J., Huang, Y. F., Jiang, D. M., & Zhang, Y. N. (2019) · IEEE Access · doi:10.1109/access.2019.2908285 · Cited by 248
Self-citationAftanas, L. I., Reva, N. V., Varlamov, A. A., Pavlov, S. V., & Makhnev, V. P. (2004) · Neuroscience and Behavioral Physiology · doi:10.1023/b:neab.0000038139.39812.eb · Cited by 247
Frantzidis, C. A., Bratsas, C., Papadelis, C. L., Konstantinidis, E., Pappas, C., & Bamidis, P. D. (2010) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2010.2041553 · Cited by 247
Emotion recognition from EEG signals by using multivariate empirical mode decomposition
Mert, A., & Akan, A. (2018) · Pattern Analysis and Applications · doi:10.1007/s10044-016-0567-6 · Cited by 243
Video Captioning by Adversarial LSTM
Yang, Y., Zhou, J., Ai, J., Bin, Y., Hanjalic, A., Shen, H. T., & Ji, Y. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2855422 · Cited by 214
Candra, H., Yuwono, M., Chai, R., Handojoseno, A., Elamvazuthi, I., Nguyen, H. T., & Su, S. (2015) · 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2015.7320065 · Cited by 165
Feature extraction from EEGs associated with emotions
Musha, T., Terasaki, Y., Haque, H. A., & Ivamitsky, G. A. (1997) · Artificial Life and Robotics · doi:10.1007/bf02471106 · Cited by 160
Robust Spatial Filtering With Graph Convolutional Neural Networks
Such, F. P., Sah, S., Domínguez, M., Pillai, S., Zhang, C., Michael, A., Cahill, N. D., & Ptucha, R. (2017) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2017.2726981 · Cited by 147
Emotion Recognition Based on High-Resolution EEG Recordings and Reconstructed Brain Sources
Becker, H., Fleureau, J., Guillotel, P., Wendling, F., Merlet, I., & Albera, L. (2017) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2768030 · Cited by 129
Electroencephalogram-based emotion assessment system using ontology and data mining techniques
Chen, J., Hu, B., Moore, P. T., Zhang, X., & Ma, X. (2015) · Applied Soft Computing · doi:10.1016/j.asoc.2015.01.007 · Cited by 127
Self-citationReal-Time Fractal-Based Valence Level Recognition from EEG
Liu, Y., & Sourina, O. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-38803-3_6 · Cited by 123
Wang, X., Zhang, T., Xu, X., Chen, L., Xing, X., & Chen, C. L. P. (2018) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm.2018.8621147 · Cited by 122
Familiarity effects in EEG-based emotion recognition
Thammasan, N., Moriyama, K., Fukui, K., & Numao, M. (2016) · Brain Informatics · doi:10.1007/s40708-016-0051-5 · Cited by 112
EEG-based subject-dependent emotion recognition algorithm using fractal dimension
Liu, Y., & Sourina, O. (2014) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2014.6974415 · Cited by 86
EmotioNet: A 3-D Convolutional Neural Network for EEG-based Emotion Recognition
Wang, Y., Huang, Z., McCane, B., & Neo, P. S. ‐. (2018) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489715 · Cited by 86
Strengthen EEG-based emotion recognition using firefly integrated optimization algorithm
He, H. S., Tan, Y., Jun, Y., & Zhang, W. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106426 · Cited by 74
Unsupervised Learning in Reservoir Computing for EEG-Based Emotion Recognition
Fourati, R., Ammar, B., Medina, J., & Alimi, A. M. (2020) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.2982143 · Cited by 71
Application of deep belief networks in eeg-based dynamic music-emotion recognition
Thammasan, N., Fukui, K., & Numao, M. (2016) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2016.7727292 · Cited by 70
El-Alfy, E.-S. M., Zhao, D., Li, Y., Xie, S., & Liu, D. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-70090-8 · Cited by 66
PNN for EEG-based Emotion Recognition
Zhang, J., Chen, M., Hu, S., Cao, Y., & Kozma, R. (2016) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2016.7844584 · Cited by 60
Fine-grained facial expression analysis using dimensional emotion model
Zhou, F., Kong, S., Fowlkes, C. C., Chen, T., & Lei, B. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.01.067 · Cited by 58
Image Denoising with Graph-Convolutional Neural Networks
Valsesia, D., Fracastoro, G., & Magli, E. (2019) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2019.8803367 · Cited by 57
LSTM-Based End-to-End Framework for Biomedical Event Extraction
Yu, X., Rong, W., Liu, J., Zhou, D., Ouyang, Y., & Xiong, Z. (2019) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2019.2916346 · Cited by 35
Zhu, H., Lin, N., Leung, H. W. H., Leung, R., & Theodoidis, S. (2020) · IEEE Sensors Letters · doi:10.1109/lsens.2020.2995060 · Cited by 35
WPT-ANN and Belief Theory Based EEG/EMG Data Fusion for Movement Identification
Sbargoud, F., Djeha, M., Guiatni, M., & Ababou, N. (2019) · Traitement du signal · doi:10.18280/ts.360502 · Cited by 26
Two‐order graph convolutional networks for semi‐supervised classification
Fu, S., Liu, W., Li, S., & Zhou, Y. (2019) · IET Image Processing · doi:10.1049/iet-ipr.2018.6224 · Cited by 20
Using Support Vector Regression to estimate valence level from EEG
Lan, Z., Muller-Putz, G. R., Wang, L., Liu, Y., Sourina, O., & Scherer, R. (2016) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2016.7844624 · Cited by 16
2011 5th International IEEE/EMBS Conference on Neural Engineering
(2011) · doi:10.1109/ner15542.2011 · Cited by 15
Neurophysiological markers of identifying regret by 64 channels EEG signal
Lin, O., Liu, G., Yang, J.-M., & Du, Y.-Z. (2015) · International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP) · doi:10.1109/iccwamtip.2015.7494017 · Cited by 12
Unconscious Emotion Recognition based on Multi-scale Sample Entropy
Shi, Y., Zheng, X., & Li, T. (2018) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm.2018.8621185 · Cited by 11
Self-citation
Cited by
EEG Based Emotion Recognition: A Tutorial and Review
Li, X., Zhang, Y., Tiwari, P., Song, D., Hu, B., Yang, M., Zhao, Z., Kumar, N., & Marttinen, P. (2023) · ACM Computing Surveys · doi:10.1145/3524499 · Cited by 508
Self-citationSelf-Supervised Learning for Electroencephalography
Rafiei, M. H., Gauthier, L. V., Adeli, H., & Takabi, D. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3190448 · Cited by 317
Vistorte, A. O. R., Deroncele-Acosta, A., Ayala, J. L. M., Barrasa, A., López-Granero, C., & Martí-González, M. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1387089 · Cited by 281
Graph-Based Deep Learning for Medical Diagnosis and Analysis: Past, Present and Future
Ahmedt-Aristizabal, D., Armin, M. A., Denman, S., Fookes, C., & Petersson, L. (2021) · Sensors · doi:10.3390/s21144758 · Cited by 272
Emotion recognition in EEG signals using deep learning methods: A review
Jafari, M., Shoeibi, A., Khodatars, M., Bagherzadeh, S., Shalbaf, A., García, D. L., Gorriz, J. M., & Acharya, U. R. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107450 · Cited by 240
Metadata
- Authors
- Yin, Y., Zheng, X., Hu, B., Zhang, Y., & Cui, X.
- Venue
- Applied Soft Computing
- Publisher
- Elsevier BV
- Published
- 2021-03
- Volume
- 100
- Pages
- 106954
- ISSN
- 1568-4946 (ISSN-L)
- OpenAlex
- W3108087271
- Cited by
- 466
- References
- 63
- FWCI
- 51.59
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.