The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
EEG-Based Emotion Recognition Using Regularized Graph Neural Networks
Open accessAbstract
Electroencephalography (EEG) measures the neuronal activities in different brain regions via electrodes. Many existing studies on EEG-based emotion recognition do not fully exploit the topology of EEG channels. In this article, we propose a regularized graph neural network (RGNN) for EEG-based emotion recognition. RGNN considers the biological topology among different brain regions to capture both local and global relations among different EEG channels. Specifically, we model the inter-channel relations in EEG signals via an adjacency matrix in a graph neural network where the connection and sparseness of the adjacency matrix are inspired by neuroscience theories of human brain organization. In addition, we propose two regularizers, namely node-wise domain adversarial training (NodeDAT) and emotion-aware distribution learning (EmotionDL), to better handle cross-subject EEG variations and noisy labels, respectively. Extensive experiments on two public datasets, SEED, and SEED-IV, demonstrate the superior performance of our model than state-of-the-art models in most experimental settings. Moreover, ablation studies show that the proposed adjacency matrix and two regularizers contribute consistent and significant gain to the performance of our RGNN model. Finally, investigations on the neuronal activities reveal important brain regions and inter-channel relations for EEG-based emotion recognition.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
(2014) · Cited by 33,419
On Information and Sufficiency
Kullback, S., & Leibler, R. A. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729694 · Cited by 20,193
Complex brain networks: graph theoretical analysis of structural and functional systems
Bullmore, E., & Sporns, O. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2575 · Cited by 11,820
A Comprehensive Survey on Graph Neural Networks
Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., & Yu, P. S. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2978386 · Cited by 11,000
The graph neural network model
Scarselli, F., Gori, M., Tsoi, A. C., Hagenbuchner, M., & Monfardini, G. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2005605 · Cited by 9,582
Graph neural networks: A review of methods and applications
Zhou, J., Cui, G., Hu, S., Zhang, Z., Yang, C., Liu, Z., Wang, L., Li, C., & Sun, M. (2020) · AI Open · doi:10.1016/j.aiopen.2021.01.001 · Cited by 6,880
Domain Adaptation via Transfer Component Analysis
Pan, S. J., Tsang, I. W., Kwok, J. T., & Yang, Q. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2091281 · Cited by 4,753
Spectral Networks and Locally Connected Networks on Graphs
Bruna, J., Zaremba, W., Szlam, A., & LeCun, Y. (2013) · arXiv · doi:10.48550/arxiv.1312.6203 · Cited by 3,983
(2012) · MPG.PuRe (Max Planck Society) · doi:10.5555/2188385.2188410 · Cited by 3,603
The economy of brain network organization
Bullmore, E., & Sporns, O. (2012) · Nature Reviews Neuroscience · doi:10.1038/nrn3214 · Cited by 3,284
Zheng, W.-L., & Lu, B.-L. (2015) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2015.2431497 · Cited by 2,595
Efficiency and Cost of Economical Brain Functional Networks
Achard, S., & Bullmore, E. (2007) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0030017 · Cited by 2,553
EEG Emotion Recognition Using Dynamical Graph Convolutional Neural Networks
Song, T., Zheng, W., Song, P., & Cui, Z. (2020) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2817622 · Cited by 1,597
Correcting Sample Selection Bias by Unlabeled Data
Huang, J., Smola, A. J., Gretton, A., Borgwardt, K. M., & Schölkopf, B. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0080 · Cited by 1,571
Mehrabian, A. (1996) · Current Psychology · doi:10.1007/bf02686918 · Cited by 1,493
Making Deep Neural Networks Robust to Label Noise: A Loss Correction Approach
Patrini, G., Rozza, A., Menon, A. K., Nock, R., & Qu, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.240 · Cited by 1,399
Neurophysiological Architecture of Functional Magnetic Resonance Images of Human Brain
Salvador, R., Suckling, J., Coleman, M. R., Pickard, J. D., Menon, D., & Bullmore, E. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhi016 · Cited by 1,344
Unsupervised Visual Domain Adaptation Using Subspace Alignment
Fernando, B., Habrard, A., Sebban, M., & Tuytelaars, T. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.368 · Cited by 1,314
EmotionMeter: A Multimodal Framework for Recognizing Human Emotions
Zheng, W.-L., Liu, W., Lu, Y., Lu, B.-L., & Cichocki, A. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2797176 · Cited by 1,276
Emotions Recognition Using EEG Signals: A Survey
Alarcao, S. M., & Fonseca, M. J. (2019) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2714671 · Cited by 1,201
Domain-adversarial training of neural networks
GaninYaroslav, UstinovaEvgeniya, AjakanHana, GermainPascal, LarochelleHugo, LavioletteFrançois, MarchandMario, & LempitskyVictor (2016) · Journal of Machine Learning Research · doi:10.5555/2946645.2946704 · Cited by 1,201
Ray, W. J., & Cole, H. W. (1985) · Science · doi:10.1126/science.3992243 · Cited by 1,140
Feature Extraction and Selection for Emotion Recognition from EEG
Jenke, R., Peer, A., & Buss, M. (2014) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2014.2339834 · Cited by 1,081
EEG-Based Emotion Recognition in Music Listening
Lin, Y.-P., Wang, C.-H., Jung, T.-P., Wu, T.-L., Jeng, S.-K., Duann, J.-R., & Chen, J.-H. (2010) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2010.2048568 · Cited by 1,021
Class Noise vs. Attribute Noise: A Quantitative Study
Zhu, X., & Wu, X. (2004) · Artificial Intelligence Review · doi:10.1007/s10462-004-0751-8 · Cited by 893
Deep Reconstruction-Classification Networks for Unsupervised Domain Adaptation
Ghifary, M., Kleijn, W. B., Zhang, M., Balduzzi, D., & Li, W. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_36 · Cited by 877
Emotional state classification from EEG data using machine learning approach
Wang, X.-W., Nie, D., & Lu, B.-L. (2014) · Neurocomputing · doi:10.1016/j.neucom.2013.06.046 · Cited by 755
Graph analysis of the human connectome: Promise, progress, and pitfalls
Fornito, A., Zalesky, A., & Breakspear, M. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.04.087 · Cited by 743
Frontal brain electrical activity (EEG) distinguishes valence and intensity of musical emotions
Schmidt, L. A., & Trainor, L. J. (2001) · Cognition and Emotion · doi:10.1080/0269993004200187 · Cited by 617
Spatial–Temporal Recurrent Neural Network for Emotion Recognition
Zhang, T., Zheng, W., Cui, Z., Zong, Y., & Li, Y. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2788081 · Cited by 595
Deep Label Distribution Learning With Label Ambiguity
Gao, B.-B., Xing, C., Xie, C.-W., Wu, J., & Geng, X. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2689998 · Cited by 508
Collobert, R., Sinz, F. H., Weston, J., & Bottou, L. (2006) · doi:10.5555/1248547.1248609 · Cited by 466
Training Convolutional Networks with Noisy Labels
Sukhbaatar, S., Bruna, J., Paluri, M., Bourdev, L. D., & Fergus, R. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.2080 · Cited by 443
Universal facial expressions in emotion.
Ekman, P. (1970) · Cited by 432
Imaging human connectomes at the macroscale
Craddock, R. C., Jbabdi, S., Yan, C.-G., Vogelstein, J. T., Castellanos, F. X., Di Martino, A., Kelly, C., Heberlein, K., Colcombe, S., & Milham, M. P. (2013) · Nature Methods · doi:10.1038/nmeth.2482 · Cited by 419
Differential entropy feature for EEG-based vigilance estimation
Shi, L.-C., Jiao, Y.-Y., & Lu, B.-L. (2013) · 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2013.6611075 · Cited by 396
EEG Based Emotion Recognition by Combining Functional Connectivity Network and Local Activations
Li, P., Liu, H., Si, Y., Li, C., Li, F., Zhu, X., Huang, X., Zeng, Y., Yao, D., Zhang, Y., et al. (2019) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2019.2897651 · Cited by 396
A Bi-Hemisphere Domain Adversarial Neural Network Model for EEG Emotion Recognition
Li, Y., Zheng, W., Zong, Y., Cui, Z., Zhang, T., & Zhou, X. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2885474 · Cited by 389
A Novel Bi-Hemispheric Discrepancy Model for EEG Emotion Recognition
Li, Y., Wang, L., Zheng, W., Zong, Y., Qi, L., Cui, Z., Zhang, T., & Song, T. (2021) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2020.2999337 · Cited by 369
EEG-based emotion classification using deep belief networks
Zheng, W.-L., Zhu, J.-Y., Peng, Y., & Lu, B.-L. (2014) · 2014 IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2014.6890166 · Cited by 367
Lan, Z., Sourina, O., Wang, L., Scherer, R., & Muller-Putz, G. R. (2019) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2018.2826840 · Cited by 357
Hierarchical Convolutional Neural Networks for EEG-Based Emotion Recognition
Li, J., Zhang, Z., & He, H. (2018) · Cognitive Computation · doi:10.1007/s12559-017-9533-x · Cited by 337
Transfer adaptation learning: A decade survey
Zhang, L., & Gao, X. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3183326 · Cited by 314
Multichannel EEG-Based Emotion Recognition via Group Sparse Canonical Correlation Analysis
Zheng, W. (2017) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2016.2587290 · Cited by 303
Emotion recognition from multi-channel EEG data through Convolutional Recurrent Neural Network
Li, X., Song, D., Zhang, P., Yu, G., Hou, Y., & Hu, B. (2016) · 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm.2016.7822545 · Cited by 283
Zhang, D., Yao, L., Zhang, X., Wang, S., Chen, W., Boots, R., & Benatallah, B. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11496 · Cited by 210
Computer-Aided Diagnosis of Depression Using EEG Signals
Acharya, U. R., Sudarshan, V. K., Adeli, H., Santhosh, J., Koh, J. E. W., & Adeli, A. (2015) · European Neurology · doi:10.1159/000381950 · Cited by 197
Probabilistic Common Spatial Patterns for Multichannel EEG Analysis
Wu, W., Chen, Z., Gao, X., Li, Y., Brown, E. N., & Gao, S. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2330598 · Cited by 194
Cross-Subject Emotion Recognition Using Deep Adaptation Networks
Li, H., Jin, Y.-M., Zheng, W.-L., & Lu, B.-L. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-04221-9_36 · Cited by 179
Support Vector Machines with the Ramp Loss and the Hard Margin Loss
Brooks, J. P. (2011) · Operations Research · doi:10.1287/opre.1100.0854 · Cited by 145
Chai, X., Wang, Q., Zhao, Y.-P., Li, Y., Liu, D., Liu, X., & Bai, O. (2017) · Sensors · doi:10.3390/s17051014 · Cited by 135
Bayesian Machine Learning: EEG\/MEG signal processing measurements
Wu, W., Nagarajan, S. S., & Chen, Z. S. (2015) · IEEE Signal Processing Magazine · doi:10.1109/msp.2015.2481559 · Cited by 120
Hybrid Graph Convolutional Networks for Semi-Supervised Classification
(2019) · International Workshop on Computer Science and Engineering (WCSE) · doi:10.18178/wcse.2019.06.016 · Cited by 116
Deep Physiological Affect Network for the Recognition of Human Emotions
Kim, B. H., & Jo, S. (2018) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2790939 · Cited by 114
EEG phase synchronization during emotional response to positive and negative film stimuli
Costa, T., Rognoni, E., & Galati, D. (2006) · Neuroscience Letters · doi:10.1016/j.neulet.2006.06.039 · Cited by 111
RSTFC: A Novel Algorithm for Spatio-Temporal Filtering and Classification of Single-Trial EEG
Qi, F., Li, Y., & Wu, W. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2402694 · Cited by 92
Identifying Functional Brain Connectivity Patterns for EEG-Based Emotion Recognition
Wu, X., Zheng, W., & Lu, B. (2019) · International IEEE/EMBS Conference on Neural Engineering · doi:10.1109/ner.2019.8717035 · Cited by 69
EEG-Based Emotion Recognition via Fast and Robust Feature Smoothing
Tang, C. C., Wang, D., Tan, A., & Miao, C. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-70772-3_8 · Cited by 28
Self-citation
Research works printed but not linked: 11
- 10.1080/02699930126048 · doi:10.1080/02699930126048 · Paper page
- 10.5555/3042817.3043083 · doi:10.5555/3042817.3043083
- Zheng, Personalizing EEG-based affective models with transfer learning, 2732
- Wu, Simplifying graph convolutional networks, 6861
- Akin, 2002, Comparison of wavelet transform and FFT methods in the analysis of EEG signals, J. Med. Syst., 26, 241, 10.1023/A:1015075101937 · doi:10.1023/a:1015075101937
- 10.1090/cbms/092 · DOI · Paper page
- Defferrard, Convolutional neural networks on graphs with fast localized spectral filtering, 3844
- Veličković, Graph attention networks
- Van Rooyen, Learning with symmetric label noise: The importance of being unhinged, 10
- Xu, How powerful are graph neural networks?
- Glorot, Understanding the difficulty of training deep feedforward neural networks, 249
Cited by
EEG Conformer: Convolutional Transformer for EEG Decoding and Visualization
Song, Y., Zheng, Q., Liu, B., & Gao, X. (2023) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2022.3230250 · Cited by 1,095
A systematic review on affective computing: emotion models, databases, and recent advances
Wang, Y., Song, W., Tao, W., Liotta, A., Yang, D., Li, X., Gao, S., Sun, Y., Ge, W., Zhang, W., et al. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.03.009 · Cited by 615
EEG Based Emotion Recognition: A Tutorial and Review
Li, X., Zhang, Y., Tiwari, P., Song, D., Hu, B., Yang, M., Zhao, Z., Kumar, N., & Marttinen, P. (2023) · ACM Computing Surveys · doi:10.1145/3524499 · Cited by 508
Khare, S. K., Blanes-Vidal, V., Nadimi, E. S., & Acharya, U. R. (2024) · Information Fusion · doi:10.1016/j.inffus.2023.102019 · Cited by 469
Contrastive Learning of Subject-Invariant EEG Representations for Cross-Subject Emotion Recognition
Shen, X., Liu, X., Hu, X., Zhang, D., & Song, S. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2022.3164516 · Cited by 296
Metadata
- Authors
- Zhong, P., Wang, D., & Miao, C.
- Venue
- IEEE Transactions on Affective Computing
- Published
- 2022-07-01
- Volume
- 13
- Issue
- 3
- Pages
- 1290-1301
- ISSN
- 1949-3045 (ISSN-L)
- 2371-9850
- OpenAlex
- W3024961463
- Cited by
- 910
- References
- 59
- FWCI
- 73.56
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- Funders
- Alibaba Innovative Research Program
- Alibaba-NTU Singapore Joint Research Institute (Alibaba-NTU-AIR2019B1)
- National Innovation Challenge on Active and Confident Ageing (MOH/NIC/COG04/2017, MOH/NIC/HAIG03/2017)
- National Research Foundation Singapore
- NRF Investigatorship Programme (NRF-NRFI05-2019-0002)
- AI Singapore Programme (AISG-GC-2019-003)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.