The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
TSception: Capturing Temporal Dynamics and Spatial Asymmetry From EEG for Emotion Recognition
Open accessAbstract
The high temporal resolution and the asymmetric spatial activations are essential attributes of electroencephalogram (EEG) underlying emotional processes in the brain. To learn the temporal dynamics and spatial asymmetry of EEG towards accurate and generalized emotion recognition, we propose TSception, a multi-scale convolutional neural network that can classify emotions from EEG. TSception consists of dynamic temporal, asymmetric spatial, and high-level fusion layers, which learn discriminative representations in the time and channel dimensions simultaneously. The dynamic temporal layer consists of multi-scale 1D convolutional kernels whose lengths are related to the sampling rate of EEG, which learns the dynamic temporal and frequency representations of EEG. The asymmetric spatial layer takes advantage of the asymmetric EEG patterns for emotion, learning the discriminative global and hemisphere representations. The learned spatial representations will be fused by a high-level fusion layer. Using more generalized cross-validation settings, the proposed method is evaluated on two publicly available datasets DEAP and MAHNOB-HCI. The performance of the proposed network is compared with prior reported methods such as SVM, KNN, FBFgMDM, FBTSC, Unsupervised learning, DeepConvNet, ShallowConvNet, and EEGNet. TSception achieves higher classification accuracies and F1 scores than other methods in most of the experiments. The codes are available at: https://github.com/yi-ding-cs/TSception
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370
EEGNet: a compact convolutional neural network for EEG-based brain-computer interfaces
Lawhern, V. J., Solon, A. J., Waytowich, N. R., Gordon, S. M., Hung, C. P., & Lance, B. J. (2018) · Journal of Neural Engineering · doi:10.1088/1741-2552/aace8c · Cited by 5,115 · cited 8×
“TSception is compared with several deep and non-deep state-of-the-art methods in the BCI domain, namely SVM [33], KNN [34], DeepConvNet [15], ShallowConvNet [15], EEGNet [18], Unsupervised learning [38], FBFgMDM [39], and FBTSC [39].”
BackgroundMethodInfluentialEEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfaces
Lawhern, V. J., Solon, A. J., Waytowich, N. R., Gordon, S. M., Hung, C. P., & Lance, B. J. (2016) · arXiv · doi:10.48550/arxiv.1611.08024 · Cited by 5,105
DEAP: A Database for Emotion Analysis ;Using Physiological Signals
Koelstra, S., Muhl, C., Soleymani, M., Lee, J.-S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., & Patras, I. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.15 · Cited by 5,093
Deep learning with convolutional neural networks for EEG decoding and visualization
Schirrmeister, R. T., Springenberg, J. T., Fiederer, L. D. J., Glasstetter, M., Eggensperger, K., Tangermann, M., Hutter, F., Burgard, W., & Ball, T. (2017) · Human Brain Mapping · doi:10.1002/hbm.23730 · Cited by 3,751
Bias in error estimation when using cross-validation for model selection
Varma, S., & Simon, R. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-91 · Cited by 2,485 · cited 2×
“For a more robust evaluation of the networks, nested cross-validation [42] is further adopted with the inner loop being 5-fold cross-validation and the outer loop being leave-one-trial-out cross-validation.”
MethodEmotion, cognition, and behavior
Dolan, R. J. (2002) · Science · doi:10.1126/science.1076358 · Cited by 1,979
Deep learning for electroencephalogram (EEG) classification tasks: a review
Craik, A., He, Y., & Contreras-Vidal, J. L. (2019) · Journal of Neural Engineering · doi:10.1088/1741-2552/ab0ab5 · Cited by 1,758
Synaptic plasticity and depression: new insights from stress and rapid-acting antidepressants
Duman, R. S., Aghajanian, G. K., Sanacora, G., & Krystal, J. H. (2016) · Nature Medicine · doi:10.1038/nm.4050 · Cited by 1,750
A Multimodal Database for Affect Recognition and Implicit Tagging
Soleymani, M., Lichtenauer, J., Pun, T., & Pantic, M. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.25 · Cited by 1,664
Filter Bank Common Spatial Pattern (FBCSP) in Brain-Computer Interface
Ang, K. K., Chin, Z. Y., Zhang, H., & Guan, C. (2008) · 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence) · doi:10.1109/ijcnn.2008.4634130 · Cited by 1,514
Self-citationEmotions Recognition Using EEG Signals: A Survey
Alarcao, S. M., & Fonseca, M. J. (2019) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2714671 · Cited by 1,201
Identifying Stable Patterns over Time for Emotion Recognition from EEG
Zheng, W.-L., Zhu, J.-Y., & Lu, B.-L. (2019) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2712143 · Cited by 990
Visual attention detection in video sequences using spatiotemporal cues
Zhai, Y., & Shah, M. (2006) · Proceedings of the 14th ACM international conference on Multimedia · doi:10.1145/1180639.1180824 · Cited by 959
A novel deep learning approach for classification of EEG motor imagery signals
Tabar, Y. R., & Halici, U. (2017) · Journal of Neural Engineering · doi:10.1088/1741-2560/14/1/016003 · Cited by 859
Carpenter, J. K., Andrews, L. A., Witcraft, S. M., Powers, M. B., Smits, J. A. J., & Hofmann, S. G. (2018) · Depression and Anxiety · doi:10.1002/da.22728 · Cited by 846
EEG delta oscillations as a correlate of basic homeostatic and motivational processes
Knyazev, G. G. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2011.10.002 · Cited by 776 · cited 1×
“Note that the delta band 0.3-4Hz is included since it also contributes to an individual’s affective state [42], [43].”
BackgroundInfluentialAMIGOS: A Dataset for Affect, Personality and Mood Research on Individuals and Groups
Miranda-Correa, J. A., Abadi, M. K., Sebe, N., & Patras, I. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2884461 · Cited by 709
Learning Temporal Information for Brain-Computer Interface Using Convolutional Neural Networks
Sakhavi, S., Guan, C., & Yan, S. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2789927 · Cited by 656
Self-citationForebrain emotional asymmetry: a neuroanatomical basis?
Craig, A. D. (. (2005) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.10.005 · Cited by 626
Spatial–Temporal Recurrent Neural Network for Emotion Recognition
Zhang, T., Zheng, W., Cui, Z., Zong, Y., & Li, Y. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2788081 · Cited by 595
Lane, R. D., Ryan, L., Nadel, L., & Greenberg, L. (2015) · Behavioral and Brain Sciences · doi:10.1017/s0140525x14000041 · Cited by 552
Improving BCI-based emotion recognition by combining EEG feature selection and kernel classifiers
Atkinson, J., & Campos, D. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.10.049 · Cited by 506
Greenberg, L. S. (2004) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.388 · Cited by 489
EEG-Based Spatio–Temporal Convolutional Neural Network for Driver Fatigue Evaluation
Gao, Z., Wang, X., Yang, Y., Mu, C., Cai, Q., Dang, W., & Zuo, S. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2886414 · Cited by 482
Right Hemisphere Lateralization for Emotion in the Human Brain: Interactions with Cognition
Schwartz, G. E., Davidson, R. J., & Maer, F. (1975) · Science · doi:10.1126/science.1179210 · Cited by 447
EEG Based Emotion Recognition by Combining Functional Connectivity Network and Local Activations
Li, P., Liu, H., Si, Y., Li, C., Li, F., Zhu, X., Huang, X., Zeng, Y., Yao, D., Zhang, Y., et al. (2019) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2019.2897651 · Cited by 396
A Bi-Hemisphere Domain Adversarial Neural Network Model for EEG Emotion Recognition
Li, Y., Zheng, W., Zong, Y., Cui, Z., Zhang, T., & Zhou, X. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2885474 · Cited by 389
Emotion, Cognition, and Behavior
(2001) · Science · doi:10.1126/science.291.5508.1449e · Cited by 376
(2017) · The SAGE Encyclopedia of Abnormal and Clinical Psychology · doi:10.4135/9781483365817.n533 · Cited by 367
Exploring EEG Features in Cross-Subject Emotion Recognition
Li, X., Song, D., Zhang, P., Zhang, Y., Hou, Y., & Hu, B. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00162 · Cited by 367
Subject-Independent Brain–Computer Interfaces Based on Deep Convolutional Neural Networks
Kwon, O.-Y., Lee, M.-H., Guan, C., & Lee, S.-W. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2946869 · Cited by 347
Self-citationHierarchical Convolutional Neural Networks for EEG-Based Emotion Recognition
Li, J., Zhang, Z., & He, H. (2018) · Cognitive Computation · doi:10.1007/s12559-017-9533-x · Cited by 337
Li, Y., Zheng, W., Wang, L., Zong, Y., & Cui, Z. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2019.2922912 · Cited by 313
Humour appreciation: a role of the right frontal lobe
Shammi, P., & Stuss, D. T. (1999) · Brain · doi:10.1093/brain/122.4.657 · Cited by 307
Kragel, P. A., Kano, M., Van Oudenhove, L., Ly, H. G., Dupont, P., Rubio, A., Delon-Martin, C., Bonaz, B. L., Manuck, S. B., Gianaros, P. J., et al. (2018) · Nature Neuroscience · doi:10.1038/s41593-017-0051-7 · Cited by 272
Fahimi, F., Zhang, Z., Goh, W. B., Lee, T.-S., Ang, K. K., & Guan, C. (2019) · Journal of Neural Engineering · doi:10.1088/1741-2552/aaf3f6 · Cited by 264
Self-citationDeep Convolutional Neural Networks for mental load classification based on EEG data
Jiao, Z., Gao, X., Wang, Y., Li, J., & Xu, H. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.12.002 · Cited by 227
Zhang, X., Liu, J., Shen, J., Li, S., Hou, K., Hu, B., Gao, J., Zhang, T., & Hu, B. (2021) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.2987575 · Cited by 206
Generalized Anxiety Disorder, worry and attention to threat: A systematic review
Goodwin, H., Yiend, J., & Hirsch, C. R. (2017) · Clinical Psychology Review · doi:10.1016/j.cpr.2017.03.006 · Cited by 163
A Multi-view CNN with Novel Variance Layer for Motor Imagery Brain Computer Interface
Mane, R., Robinson, N., Vinod, A. P., Lee, S., & Guan, C. (2020) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc44109.2020.9175874 · Cited by 150
Self-citationAllen, J. J. B., Keune, P. M., Schönenberg, M., & Nusslock, R. (2017) · Psychophysiology · doi:10.1111/psyp.13028 · Cited by 142
EEG-Based Emotion Recognition Using Hierarchical Network With Subnetwork Nodes
Yang, Y., Wu, Q. M. J., Zheng, W.-L., & Lu, B.-L. (2018) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2017.2685338 · Cited by 141
Dennis, T. A., & Solomon, B. (2010) · Biological Psychology · doi:10.1016/j.biopsycho.2010.09.008 · Cited by 137
TSception:A Deep Learning Framework for Emotion Detection Using EEG
Ding, Y., Robinson, N., Zeng, Q., Chen, D., Wai, A. A. P., Lee, T.-S. W., & Guan, C. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9206750 · Cited by 136
Self-citationEmotion regulation therapy for generalized anxiety disorder
Fresco, D. M., Mennin, D. S., Heimberg, R. G., & Ritter, M. (2013) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2013.02.001 · Cited by 120
Effects of Antipsychotic Treatment on Emotion Perception Deficits in First-Episode Schizophrenia
Herbener, E. S., Hill, S. K., Marvin, R. W., & Sweeney, J. A. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.9.1746 · Cited by 118
Asymmetric Spatial Pattern for EEG-based emotion detection
Huang, D., Guan, C., Ang, K. K., Zhang, H., & Pan, Y. (2012) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2012.6252390 · Cited by 113
Self-citationAn unsupervised EEG decoding system for human emotion recognition
Liang, Z., Oba, S., & Ishii, S. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.04.003 · Cited by 112
A closed-loop, music-based brain-computer interface for emotion mediation
Ehrlich, S. K., Agres, K., Guan, C., & Cheng, G. (2019) · PLoS ONE · doi:10.1371/journal.pone.0213516 · Cited by 110
Self-citationThe effects of valence and arousal on the neural activity leading to subsequent memory
Mickley Steinmetz, K. R., & Kensinger, E. A. (2009) · Psychophysiology · doi:10.1111/j.1469-8986.2009.00868.x · Cited by 106 · cited 1×
“This is consistent with previous literatures [46], [47], [48].”
ResultAppriou, A., Cichocki, A. S., & Lotte, F. (2020) · IEEE Systems Man and Cybernetics Magazine · doi:10.1109/msmc.2020.2968638 · Cited by 102
Daly, I. P., Williams, D. A. H., Hwang, F., Kirke, A., Miranda, E. R., & Nasuto, S. J. (2019) · Scientific Reports · doi:10.1038/s41598-019-45105-2 · Cited by 83
Right hemisphere ventral stream for emotional prosody identification: Evidence from acute stroke
Sheppard, S. M., Keator, L. M., Breining, B. L., Wright, A. E., Saxena, S., Tippett, D. C., & Hillis, A. E. (2020) · Neurology · doi:10.1212/wnl.0000000000008870 · Cited by 39
EEG-based Valence Level Recognition for Real-Time Applications
Liu, Y., & Sourina, O. (2012) · International Conference on Cyberworlds (CW) · doi:10.1109/cw.2012.15 · Cited by 38
Variational Pathway Reasoning for EEG Emotion Recognition
Zhang, T., Cui, Z., Xu, C., Zheng, W., & Yang, J. J. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i03.5657 · Cited by 37
EEG Representation in Deep Convolutional Neural Networks for Classification of Motor Imagery
Robinson, N., Lee, S., & Guan, C. (2019) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2019.8914184 · Cited by 36
Self-citationA novel dynamic brain network in arousal for brain states and emotion analysis
Gao, Y., Cao, Z., Liu, J., & Zhang, J. (2021) · Mathematical Biosciences & Engineering · doi:10.3934/mbe.2021368 · Cited by 17
Multivariate Models for Decoding Hearing Impairment using EEG Gamma-Band Power Spectral Density
Mahmud, M. S., Ahmed, F., Yeasin, M., Alain, C., & Bidelman, G. M. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9206731 · Cited by 15
Cited by
EEG-Deformer: A Dense Convolutional Transformer for Brain-Computer Interfaces
Ding, Y., Li, Y., Sun, H., Liu, R., Tong, C., Liu, C., Zhou, X., & Guan, C. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3504604 · Cited by 120
Self-citationIENet: a robust convolutional neural network for EEG based brain-computer interfaces
Du, Y., & Liu, J. (2022) · Journal of Neural Engineering · doi:10.1088/1741-2552/ac7257 · Cited by 34
“Moreover, EEG-BCI technologies in non-medical scenarios, such as spellers [8], wheelchair control [9], robotic arm [10] and emotion recognition [11], have shown great potential [3, 6] and are extending into new application areas [12–15].”
Background
Metadata
- Authors
- Ding, Y., Robinson, N., Zhang, S., Zeng, Q., & Guan, C.
- Venue
- IEEE Transactions on Affective Computing
- Published
- 2023-07-01
- Volume
- 14
- Issue
- 3
- Pages
- 2238-2250
- ISSN
- 1949-3045 (ISSN-L)
- 2371-9850
- OpenAlex
- W3140416091
- Cited by
- 428
- References
- 62
- FWCI
- 64.77
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.