The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
EEG-based emotion recognition using an end-to-end regional-asymmetric convolutional neural network
Abstract
Abstract Emotion recognition based on electroencephalography (EEG) is of great important in the field of Human–Computer Interaction (HCI), which has received extensive attention in recent years. Most traditional methods focus on extracting features in time domain and frequency domain. The spatial information from adjacent channels and symmetric channels is often ignored. To better learn spatial representation, in this paper, we propose an end-to-end Regional-Asymmetric Convolutional Neural Network (RACNN) for emotion recognition, which consists of temporal, regional and asymmetric feature extractors. Specifically, continuous 1D convolution layers are employed in temporal feature extractor to learn time–frequency representations. Then, regional feature extractor consists of two 2D convolution layers to capture regional information among physically adjacent channels. Meanwhile, we propose an Asymmetric Differential Layer (ADL) in asymmetric feature extractor by taking the asymmetry property of emotion responses into account, which can capture the discriminative information between left and right hemispheres of the brain. To evaluate our model, we conduct extensive experiments on two publicly available datasets, i.e., DEAP and DREAMER. The proposed model can obtain recognition accuracies over 95% for valence and arousal classification tasks on both datasets, significantly outperforming the state-of-the-art methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
(2014) · Cited by 33,419
Picard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
EEGNet: a compact convolutional neural network for EEG-based brain-computer interfaces
Lawhern, V. J., Solon, A. J., Waytowich, N. R., Gordon, S. M., Hung, C. P., & Lance, B. J. (2018) · Journal of Neural Engineering · doi:10.1088/1741-2552/aace8c · Cited by 5,115
EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfaces
Lawhern, V. J., Solon, A. J., Waytowich, N. R., Gordon, S. M., Hung, C. P., & Lance, B. J. (2016) · arXiv · doi:10.48550/arxiv.1611.08024 · Cited by 5,105
DEAP: A Database for Emotion Analysis ;Using Physiological Signals
Koelstra, S., Muhl, C., Soleymani, M., Lee, J.-S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., & Patras, I. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.15 · Cited by 5,093
Emotional processing in anterior cingulate and medial prefrontal cortex
Etkin, A., Egner, T., & Kalisch, R. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.11.004 · Cited by 3,059
Zheng, W.-L., & Lu, B.-L. (2015) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2015.2431497 · Cited by 2,595
Emotion, cognition, and behavior
Dolan, R. J. (2002) · Science · doi:10.1126/science.1076358 · Cited by 1,979
EEG Emotion Recognition Using Dynamical Graph Convolutional Neural Networks
Song, T., Zheng, W., Song, P., & Cui, Z. (2020) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2817622 · Cited by 1,597
Katsigiannis, S., & Ramzan, N. (2018) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2017.2688239 · Cited by 1,135
EEG-Based Emotion Recognition Using Regularized Graph Neural Networks
Zhong, P., Wang, D., & Miao, C. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.2994159 · Cited by 910
Emotional state classification from EEG data using machine learning approach
Wang, X.-W., Nie, D., & Lu, B.-L. (2014) · Neurocomputing · doi:10.1016/j.neucom.2013.06.046 · Cited by 755
2018 International Joint Conference on Neural Networks (IJCNN)
(2018) · doi:10.1109/ijcnn40505.2018 · Cited by 746
Emotion Recognition From EEG Using Higher Order Crossings
Petrantonakis, P. C., & Hadjileontiadis, L. J. (2010) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2009.2034649 · Cited by 687
Lateral brain function, emotion, and conceptualization.
Tucker, D. M. (1981) · Psychological Bulletin · doi:10.1037//0033-2909.89.1.19 · Cited by 677
Spatial–Temporal Recurrent Neural Network for Emotion Recognition
Zhang, T., Zheng, W., Cui, Z., Zong, Y., & Li, Y. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2788081 · Cited by 595
Ecg pattern analysis for emotion detection
Agrafioti, F., Hatzinakos, D., & Anderson, A. K. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.28 · Cited by 476
A Bi-Hemisphere Domain Adversarial Neural Network Model for EEG Emotion Recognition
Li, Y., Zheng, W., Zong, Y., Cui, Z., Zhang, T., & Zhou, X. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2885474 · Cited by 389
Emotion classification based on gamma-band EEG
Li, M., & Lu, B.-L. (2009) · 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society · doi:10.1109/iembs.2009.5334139 · Cited by 375
A Novel Bi-Hemispheric Discrepancy Model for EEG Emotion Recognition
Li, Y., Wang, L., Zheng, W., Zong, Y., Qi, L., Cui, Z., Zhang, T., & Song, T. (2021) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2020.2999337 · Cited by 369
Exploring EEG Features in Cross-Subject Emotion Recognition
Li, X., Song, D., Zhang, P., Zhang, Y., Hou, Y., & Hu, B. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00162 · Cited by 367
Emotion Recognition from Multi-Channel EEG through Parallel Convolutional Recurrent Neural Network
Yang, Y., Wu, Q., Qiu, M., Wang, Y., & Chen, X. (2018) · 2018 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489331 · Cited by 325
Self-citationLi, Y., Zheng, W., Wang, L., Zong, Y., & Cui, Z. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2019.2922912 · Cited by 313
Emotion Recognition Using Multimodal Deep Learning
Liu, W., Zheng, W.-L., & Lu, B.-L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46672-9_58 · Cited by 301
Emotion recognition from multi-channel EEG data through Convolutional Recurrent Neural Network
Li, X., Song, D., Zhang, P., Yu, G., Hou, Y., & Hu, B. (2016) · 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm.2016.7822545 · Cited by 283
Investigating models of affect: Relationships among EEG alpha asymmetry, depression, and anxiety.
Mathersul, D., Williams, L. M., Hopkinson, P. J., & Kemp, A. H. (2008) · Emotion · doi:10.1037/a0012811 · Cited by 275
Differing emotional response from right and left hemispheres
DIMOND, S. J., FARRINGTON, L., & JOHNSON, P. (1976) · Nature · doi:10.1038/261690a0 · Cited by 259
Bristle-sensors—low-cost flexible passive dry EEG electrodes for neurofeedback and BCI applications
Grozea, C., Voinescu, C. D., & Fazli, S. (2011) · Journal of Neural Engineering · doi:10.1088/1741-2560/8/2/025008 · Cited by 256
EEG-Based Emotion Recognition using 3D Convolutional Neural Networks
Salama, E. S., A.El-Khoribi, R., E.Shoman, M., & A.Wahby, M. (2018) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2018.090843 · Cited by 249
Accurate EEG-Based Emotion Recognition on Combined Features Using Deep Convolutional Neural Networks
Chen, J. X., Zhang, P. W., Mao, Z. J., Huang, Y. F., Jiang, D. M., & Zhang, Y. N. (2019) · IEEE Access · doi:10.1109/access.2019.2908285 · Cited by 248
Bagged support vector machines for emotion recognition from speech
Bhavan, A., Chauhan, P., Hitkul, & Shah, R. R. (2019) · Knowledge-Based Systems · doi:10.1016/j.knosys.2019.104886 · Cited by 248
Emotion Recognition using Multimodal Residual LSTM Network
Ma, J., Tang, H., Zheng, W.-L., & Lu, B.-L. (2019) · Proceedings of the 27th ACM International Conference on Multimedia · doi:10.1145/3343031.3350871 · Cited by 230
CLU-CNNs: Object detection for medical images
Li, Z., Dong, M., Wen, S., Hu, X., Zhou, P., & Zeng, Z. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.04.028 · Cited by 203
Computer-Aided Diagnosis of Depression Using EEG Signals
Acharya, U. R., Sudarshan, V. K., Adeli, H., Santhosh, J., Koh, J. E. W., & Adeli, A. (2015) · European Neurology · doi:10.1159/000381950 · Cited by 197
Multimodal Emotion Recognition Using Deep Neural Networks
Tang, H., Liu, W., Zheng, W.-L., & Lu, B.-L. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-70093-9_86 · Cited by 194
Practical emotional neural networks
Lotfi, E., & Akbarzadeh-T, M.-R. (2014) · Neural Networks · doi:10.1016/j.neunet.2014.06.012 · Cited by 141
Generating Realistic Videos From Keyframes With Concatenated GANs
Wen, S., Liu, W., Yang, Y., Huang, T., & Zeng, Z. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2867934 · Cited by 133
Intelligent facial emotion recognition using moth-firefly optimization
Zhang, L., Mistry, K., Neoh, S. C., & Lim, C. P. (2016) · Knowledge-Based Systems · doi:10.1016/j.knosys.2016.08.018 · Cited by 128
EEG-based emotion recognition approach for e-healthcare applications
Ali, M., Mosa, A. H., Machot, F. A., & Kyamakya, K. (2016) · International Conference on Ubiquitous and Future Networks · doi:10.1109/icufn.2016.7536936 · Cited by 126
Multimodal Emotion Recognition Using Deep Canonical Correlation AnalysisPreprint
Liu, W., Qiu, J., Zheng, W., & Lu, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.05349 · Cited by 119
Joint Blind Source Separation for Neurophysiological Data Analysis: Multiset and multimodal methods
Chen, X., Wang, Z. J., & McKeown, M. J. (2016) · IEEE Signal Processing Magazine · doi:10.1109/msp.2016.2521870 · Cited by 105
Self-citationFiorini, L., Mancioppi, G., Semeraro, F., Fujita, H., & Cavallo, F. (2019) · Knowledge-Based Systems · doi:10.1016/j.knosys.2019.105217 · Cited by 83
Yang, Y., Gao, Z., Wang, X.-M., Li, Y., Han, J., Marwan, N., & Kurths, J. (2018) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.5023857 · Cited by 79
A novel convolutional neural networks for emotion recognition based on EEG signal
Wen, Z., Xu, R., & Du, J. (2017) · International Conference on Security, Pattern Analysis, and Cybernetics (SPAC) · doi:10.1109/spac.2017.8304360 · Cited by 70
End-to-End Detection-Segmentation System for Face Labeling
Wen, S., Dong, M., Yang, Y., Zhou, P., Huang, T., & Chen, Y. (2019) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2019.2947319 · Cited by 69
Multimodal Physiological Signal Emotion Recognition Based on Convolutional Recurrent Neural Network
Liao, J., Zhong, Q., Zhu, Y., & Cai, D. (2020) · IOP Conference Series Materials Science and Engineering · doi:10.1088/1757-899x/782/3/032005 · Cited by 63
Liu, Y.-H., Wu, C., Cheng, W.-T., Hsiao, Y.-T., Chen, P.-M., & Teng, J. (2014) · Sensors · doi:10.3390/s140813361 · Cited by 54
Integrating Facial Expression and Body Gesture in Videos for Emotion Recognition
Yan, J., Zheng, W., Minhai, X. I. N., & Yan, J. (2014) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.e97.d.610 · Cited by 42
Correlated Attention Networks for Multimodal Emotion Recognition
Qiu, J., Li, X., & Hu, K. (2018) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm.2018.8621129 · Cited by 39
Emotion recognition and its application to computer agents with spontaneous interactive capabilities
Nakatsu, R., Nicholson, J., & Tosa, N. (1999) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/319463.319641 · Cited by 13
Cited by
A systematic review on affective computing: emotion models, databases, and recent advances
Wang, Y., Song, W., Tao, W., Liotta, A., Yang, D., Li, X., Gao, S., Sun, Y., Ge, W., Zhang, W., et al. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.03.009 · Cited by 615
EEG Based Emotion Recognition: A Tutorial and Review
Li, X., Zhang, Y., Tiwari, P., Song, D., Hu, B., Yang, M., Zhao, Z., Kumar, N., & Marttinen, P. (2023) · ACM Computing Surveys · doi:10.1145/3524499 · Cited by 508
Houssein, E. H., Hammad, A., & Ali, A. A. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-07292-4 · Cited by 426
Self-Supervised Learning for Electroencephalography
Rafiei, M. H., Gauthier, L. V., Adeli, H., & Takabi, D. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3190448 · Cited by 317
Contrastive Learning of Subject-Invariant EEG Representations for Cross-Subject Emotion Recognition
Shen, X., Liu, X., Hu, X., Zhang, D., & Song, S. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2022.3164516 · Cited by 296
Metadata
- Authors
- Cui, H., Liu, A., Zhang, X., Chen, X., Wang, K., & Chen, X.
- Venue
- Knowledge-Based Systems
- Publisher
- Elsevier BV
- Published
- 2020-10
- Volume
- 205
- Pages
- 106243
- ISSN
- 0950-7051 (ISSN-L)
- OpenAlex
- W3043308633
- Cited by
- 284
- References
- 53
- FWCI
- 34.47
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.