The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
From Regional to Global Brain: A Novel Hierarchical Spatial-Temporal Neural Network Model for EEG Emotion Recognition
Abstract
In this paper, we propose a novel Electroencephalograph (EEG) emotion recognition method inspired by neuroscience with respect to the brain response to different emotions. The proposed method, denoted by R2G-STNN, consists of spatial and temporal neural network models with regional to global hierarchical feature learning process to learn discriminative spatial-temporal EEG features. To learn the spatial features, a bidirectional long short term memory (BiLSTM) network is adopted to capture the intrinsic spatial relationships of EEG electrodes within brain region and between brain regions, respectively. Considering that different brain regions play different roles in the EEG emotion recognition, a region-attention layer into the R2G-STNN model is also introduced to learn a set of weights to strengthen or weaken the contributions of brain regions. Based on the spatial feature sequences, BiLSTM is adopted to learn both regional and global spatial-temporal features and the features are fitted into a classifier layer for learning emotion-discriminative features, in which a domain discriminator working corporately with the classifier is used to decrease the domain shift between training and testing data. Finally, to evaluate the proposed method, we conduct both subject-dependent and subject-independent EEG emotion recognition experiments on SEED database, and the experimental results show that the proposed method achieves state-of-the-art performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Least Squares Support Vector Machine Classifiers
Suykens, J. A. K., & Vandewalle, J. (1999) · Neural Processing Letters · doi:10.1023/a:1018628609742 · Cited by 9,362
Domain-Adversarial Training of Neural Networks
Ganin, Y., Ustinova, E., Ajakan, H., Germain, P., Larochelle, H., Laviolette, F., Marchand, M., & Lempitsky, V. (2017) · Advances in Computer Vision and Pattern Recognition · doi:10.1007/978-3-319-58347-1_10 · Cited by 8,318
Nonlinear Component Analysis as a Kernel Eigenvalue Problem
Schölkopf, B., Smola, A., & Müller, K.-R. (1998) · Neural Computation · doi:10.1162/089976698300017467 · Cited by 8,084
Picard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
Greff, K., Srivastava, R. K., Koutnik, J., Steunebrink, B. R., & Schmidhuber, J. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2582924 · Cited by 6,955
Large-Scale Machine Learning with Stochastic Gradient Descent
Bottou, L. (2010) · Proceedings of COMPSTAT'2010 · doi:10.1007/978-3-7908-2604-3_16 · Cited by 5,795
Domain Adaptation via Transfer Component Analysis
Pan, S. J., Tsang, I. W., Kwok, J. T., & Yang, Q. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2091281 · Cited by 4,753
Emotional processing in anterior cingulate and medial prefrontal cortex
Etkin, A., Egner, T., & Kalisch, R. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.11.004 · Cited by 3,059 · cited 1×
“The recent neuroscience researches showed that human’s emotion is closely related to a variety of brain cortex regions [17], such as the orbital frontal cortex, ventral medial prefrontal cortex, amygdala [18][19][20].”
BackgroundZheng, W.-L., & Lu, B.-L. (2015) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2015.2431497 · Cited by 2,595
Self-citationThe brain basis of emotion: a meta-analytic review
Lindquist, K. A., Wager, T. D., Kober, H., Bliss-Moreau, E., & Barrett, L. F. (2012) · Behavioral and Brain Sciences · doi:10.1017/s0140525x11000446 · Cited by 2,320 · cited 1×
“Consequently, the EEG signals associated with different brain regions would contribute differently to emotion recognition [21][22][23][24] and hence making use of the spatial information of EEG signals would be helpful for emotion recognition and could provide a physiological explanation to understand human emotion.”
BackgroundGeodesic flow kernel for unsupervised domain adaptation
Gong, B., Shi, Y., Sha, F., & Grauman, K. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247911 · Cited by 2,093
Mauss, I. B., & Robinson, M. D. (2009) · Cognition and Emotion · doi:10.1080/02699930802204677 · Cited by 2,078
Emotion, cognition, and behavior
Dolan, R. J. (2002) · Science · doi:10.1126/science.1076358 · Cited by 1,979
The five percent electrode system for high-resolution EEG and ERP measurements
Oostenveld, R., & Praamstra, P. (2001) · Clinical Neurophysiology · doi:10.1016/s1388-2457(00)00527-7 · Cited by 1,909
EEG Emotion Recognition Using Dynamical Graph Convolutional Neural Networks
Song, T., Zheng, W., Song, P., & Cui, Z. (2020) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2817622 · Cited by 1,597
Self-citationFrontal EEG asymmetry as a moderator and mediator of emotion
Coan, J. A., & Allen, J. J. B. (2004) · Biological Psychology · doi:10.1016/j.biopsycho.2004.03.002 · Cited by 1,426
Unsupervised Visual Domain Adaptation Using Subspace Alignment
Fernando, B., Habrard, A., Sebban, M., & Tuytelaars, T. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.368 · Cited by 1,314
Feature Extraction and Selection for Emotion Recognition from EEG
Jenke, R., Peer, A., & Buss, M. (2014) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2014.2339834 · Cited by 1,081
EEG-Based Emotion Recognition in Music Listening
Lin, Y.-P., Wang, C.-H., Jung, T.-P., Wu, T.-L., Jeng, S.-K., Duann, J.-R., & Chen, J.-H. (2010) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2010.2048568 · Cited by 1,021
Affective style, psychopathology, and resilience: Brain mechanisms and plasticity
Davidson, R. J. (2000) · American Psychologist · doi:10.1037/0003-066x.55.11.1196 · Cited by 890
Collobert, R., Sinz, F. H., Weston, J., & Bottou, L. (2006) · doi:10.5555/1248547.1248609 · Cited by 466
Canonical Correlation Analysis
Thompson, B. (2005) · Encyclopedia of Statistics in Behavioral Science · doi:10.1002/0470013192.bsa068 · Cited by 457
A functional architecture of the human brain: emerging insights from the science of emotion
Lindquist, K. A., & Barrett, L. F. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.09.005 · Cited by 407
Exploring EEG Features in Cross-Subject Emotion Recognition
Li, X., Song, D., Zhang, P., Zhang, Y., Hou, Y., & Hu, B. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00162 · Cited by 367
Multichannel EEG-Based Emotion Recognition via Group Sparse Canonical Correlation Analysis
Zheng, W. (2017) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2016.2587290 · Cited by 303
Self-citationNeural correlates of social and nonsocial emotions: An fMRI study
Britton, J. C., Phan, K. L., Taylor, S. F., Welsh, R. C., Berridge, K. C., & Liberzon, I. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2005.11.027 · Cited by 301
Recurrent Neural Networks for driver activity anticipation via sensory-fusion architecture
Jain, A., Singh, A., Koppula, H. S., Soh, S., & Saxena, A. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487478 · Cited by 271 · cited 1×
“The conventional single directional long short term memory (LSTM) network [26] is a special type of recurrent neural network (RNN) [27], which usually consists of three gates and a cell state for dealing with the long-term dependence of data sample sequence.”
BackgroundA Least-squares Approach to Direct Importance Estimation
KanamoriTakafumi, HidoShohei, & SugiyamaMasashi (2009) · Journal of Machine Learning Research · doi:10.5555/1577069.1755831 · Cited by 243
Domain Invariant Transfer Kernel Learning
Long, M., Wang, J., Sun, J., & Yu, P. S. (2015) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2014.2373376 · Cited by 217
A Novel Neural Network Model based on Cerebral Hemispheric Asymmetry for EEG Emotion Recognition
Li, Y., Zheng, W., Cui, Z., Zhang, T., & Zong, Y. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/216 · Cited by 197
Self-citationSelective Transfer Machine for Personalized Facial Expression Analysis
Chu, W.-S., De la Torre, F., & Cohn, J. F. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2547397 · Cited by 192
regional Brain Activity in Emotion: A Framework for Understanding Cognition in Depresion
Heller, W., & Nitscke, J. B. (1997) · Cognition & Emotion · doi:10.1080/026999397379845a · Cited by 182
Sangineto, E., Zen, G., Ricci, E., & Sebe, N. (2014) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2647868.2654916 · Cited by 150
A Review on Nonlinear Methods Using Electroencephalographic Recordings for Emotion Recognition
García-Martínez, B., Martínez‐Rodrigo, A., Alcaraz, R., & Fernández‐Caballero, A. (2019) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2890636 · Cited by 138
Practical emotional neural networks
Lotfi, E., & Akbarzadeh-T, M.-R. (2014) · Neural Networks · doi:10.1016/j.neunet.2014.06.012 · Cited by 134
Zhou, Y., Ramanarayanan, V., Suendermann‐Oeft, D., Wang, X., Zechner, K., Chen, L., Tao, J., Ivanou, A., & Qian, Y. (2015) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2015.7404814 · Cited by 93
EEG Emotion Recognition Based on Graph Regularized Sparse Linear Regression
Li, Y., Zheng, W., Cui, Z., Zong, Y., & Ge, S. (2018) · Neural Processing Letters · doi:10.1007/s11063-018-9829-1 · Cited by 90
Self-citationA Case-Based Reasoning Model for Depression Based on Three-Electrode EEG Data
Cai, H., Zhang, X., Zhang, Y., Wang, Z., & Hu, B. (2018) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2801289 · Cited by 88
Attentional Bias Pattern Recognition in Spiking Neural Networks from Spatio-Temporal EEG Data
Doborjeh, Z., Doborjeh, M., & Kasabov, N. K. (2017) · Cognitive Computation · doi:10.1007/s12559-017-9517-x · Cited by 55
Emotional State Recognition with EEG Signals Using Subject Independent Approach
Pandey, P., & Seeja, K. R. (2018) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-981-10-7641-1_10 · Cited by 41
Research works printed but not linked: 6
- 10.3390/a10020063 · DOI
- 10.1109/TCDS.2016.2587290 · DOI · Paper page
- 10.1023/A:I0I0933404324 · doi:10.1023/a:i0i0933404324
- 10.5555/3157382.3157527 · doi:10.5555/3157382.3157527
- Sugiyama, Direct importance estimation with model selection and its application to covariate shift adaptation, 1433
- Zheng, Personalizing EEG-based affective models with transfer learning, 2732
Cited by
EEG Conformer: Convolutional Transformer for EEG Decoding and Visualization
Song, Y., Zheng, Q., Liu, B., & Gao, X. (2023) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2022.3230250 · Cited by 1,095
EEG Based Emotion Recognition: A Tutorial and Review
Li, X., Zhang, Y., Tiwari, P., Song, D., Hu, B., Yang, M., Zhao, Z., Kumar, N., & Marttinen, P. (2023) · ACM Computing Surveys · doi:10.1145/3524499 · Cited by 508
Liu, W., Qiu, J.-L., Zheng, W.-L., & Lu, B.-L. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2021.3071170 · Cited by 452
Self-citationTransfer Learning for EEG-Based Brain–Computer Interfaces: A Review of Progress Made Since 2016
Wu, D., Xu, Y., & Lu, B.-L. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2020.3007453 · Cited by 434
TSception: Capturing Temporal Dynamics and Spatial Asymmetry From EEG for Emotion Recognition
Ding, Y., Robinson, N., Zhang, S., Zeng, Q., & Guan, C. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2022.3169001 · Cited by 428
Metadata
- Authors
- Li, Y., Zheng, W., Wang, L., Zong, Y., & Cui, Z.
- Venue
- IEEE Transactions on Affective Computing
- Published
- 2022-04-01
- Volume
- 13
- Issue
- 2
- Pages
- 568-578
- ISSN
- 1949-3045 (ISSN-L)
- 2371-9850
- OpenAlex
- W2950162539
- Cited by
- 313
- References
- 41
- FWCI
- 23.50
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Funders
- National Key Research and Development Program of China (2015CB351704)
- National Key R&D Program of China (2018YFB1305200)
- National Natural Science Foundation of China (61572009, 61772276)
- Jiangsu Provincial Key Research and Development Program (BE2016616)
- China Scholarship Council (201706090224)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.