Multi-Domain Encoding of Spatiotemporal Dynamics in EEG for Emotion Recognition
The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Abstract
The common goal of the studies is to map any emotional states encoded from electroencephalogram (EEG) into 2-dimensional arousal-valance scores. It is still challenging due to each emotion having its specific spatial structure and dynamic dependence over the distinct time segments among EEG signals. This paper aims to model human dynamic emotional behavior by considering the location connectivity and context dependency of brain electrodes. Thus, we designed a hybrid EEG modeling method that mainly adopts the attention mechanism, combining a multi-domain spatial transformer (MST) module and a dynamic temporal transformer (DTT) module, named MSDTTs. Specifically, the MST module extracts single-domain and cross-domain features from different brain regions and fuses them into multi-domain spatial features. Meanwhile, the temporal dynamic excitation (TDE) is inserted into the multi-head convolutional transformer to form the DTT module. These two blocks work together to activate and extract the emotion-related dynamic temporal features within the DTT module. Furthermore, we place the convolutional mapping into the transformer structure to mine the static context features among the keyframes. Overall results show that high classification accuracy of 98.91%/0.14% was obtained by the $\beta$ frequency band of the DEAP dataset, and 97.52%/0.12% and 96.70%/0.26% were obtained by the $\gamma$ frequency band of SEED and SEED-IV datasets. Empirical experiments indicate that our proposed method can achieve remarkable results in comparison with state-of-the-art algorithms.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Still, more and more researchers use multimodal models that integrate multiple data and features to carry out emotion recognition, which can extract more abundant features and improve the effect of emotion recognition.”
From Multimodal Emotion Recognition From EEG Signals and Facial Expressions (2023) · cites this paper as [10]
In the citing paper
“Still, more and more researchers use multimodal models that integrate multiple data and features to carry out emotion recognition, which can extract more abundant features and improve the effect of emotion recognition.”
From Multimodal Emotion Recognition From EEG Signals and Facial Expressions (2023) · cites this paper as [10]
Citations
Cites
1 retracted
RETRACTED ARTICLE: EEG signal classification using LSTM and improved neural network algorithms
Nagabushanam, P., Thomas George, S., & Radha, S. (2020) · Soft Computing · doi:10.1007/s00500-019-04515-0 · Cited by 169 · cited 1×
“[28] designed a two-layer LSTM and a four-layer improved neural network deep learning algorithm to classify EEG signals.”
MethodRetractedBaumeister, R. F., Bratslavsky, E., Finkenauer, C., & Vohs, K. D. (2001) · Review of General Psychology · doi:10.1037/1089-2680.5.4.323 · Cited by 7,678
DEAP: A Database for Emotion Analysis ;Using Physiological Signals
Koelstra, S., Muhl, C., Soleymani, M., Lee, J.-S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., & Patras, I. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.15 · Cited by 5,093 · cited 1×
“Abundant experimental results on the DEAP [21], SEED [22], and SEED-IV [23] datasets confirm the effectiveness of the MSDTTs model.”
MethodZheng, W.-L., & Lu, B.-L. (2015) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2015.2431497 · Cited by 2,595 · cited 2×
“These results obviously conform to the existing studies that show positive emotions are easier to recognize with relativelyhighaccuraciescompareswithnegativeemotions[22].”
MethodResultEEG Emotion Recognition Using Dynamical Graph Convolutional Neural Networks
Song, T., Zheng, W., Song, P., & Cui, Z. (2020) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2817622 · Cited by 1,597 · cited 1×
“Song et al. [25] simulated the spatial arrangement of EEG signals by constructing an adjacency matrix and utilized a graph convolution neural network (GCNN) to extract more discriminative EEG features, thereby improving the ability to identify emotions.”
MethodEmotionMeter: A Multimodal Framework for Recognizing Human Emotions
Zheng, W.-L., Liu, W., Lu, Y., Lu, B.-L., & Cichocki, A. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2797176 · Cited by 1,276 · cited 1×
“Abundant experimental results on the DEAP [21], SEED [22], and SEED-IV [23] datasets confirm the effectiveness of the MSDTTs model.”
MethodSelf-citationEEG-Based Emotion Recognition in Music Listening
Lin, Y.-P., Wang, C.-H., Jung, T.-P., Wu, T.-L., Jeng, S.-K., Duann, J.-R., & Chen, J.-H. (2010) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2010.2048568 · Cited by 1,021 · cited 1×
“For example, references [16] and [17] extracted some differential features from the perspective of the left and right hemispheres, such as PSD and DE.”
BackgroundMultimodal Emotion Recognition in Response to Videos
Soleymani, M., Pantic, M., & Pun, T. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.37 · Cited by 722 · cited 1×
“The results reveal that the valence dimension is better in human emotional response, which is also consistent with the conclusion in [40].”
ResultEEG-Based Emotion Recognition via Channel-Wise Attention and Self Attention
Tao, W., Li, C., Song, R., Cheng, J., Liu, Y., Wan, F., & Chen, X. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.3025777 · Cited by 581 · cited 1×
“For example, Tao et al. [31] designed an attention-based convolutional recursive neural network (ACRNN) by integrating attention, CNN, and RNN to enhance the accuracy of EEG-based emotion recognition.”
MethodA Bi-Hemisphere Domain Adversarial Neural Network Model for EEG Emotion Recognition
Li, Y., Zheng, W., Zong, Y., Cui, Z., Zhang, T., & Zhou, X. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2885474 · Cited by 389 · cited 1×
“Reference [18] constructed an emotion model based on the differences between the left and right hemispheres, called the BiDANN model.”
Method
Cited by
Abibullaev, B., Keutayeva, A., & Zollanvari, A. (2023) · IEEE Access · doi:10.1109/access.2023.3329678 · Cited by 179
Multimodal Emotion Recognition From EEG Signals and Facial Expressions
Wang, S., Qu, J., Zhang, Y., & Zhang, Y. (2023) · IEEE Access · doi:10.1109/access.2023.3263670 · Cited by 124
“Still, more and more researchers use multimodal models that integrate multiple data and features to carry out emotion recognition, which can extract more abundant features and improve the effect of emotion recognition [10].”
BackgroundSelf-citationCheng, C., Yu, Z., Zhang, Y., & Feng, L. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3319315 · Cited by 72
“Cheng et al. [36] designed a multidomain hybrid model to capture spatiotemporal features in EEG signals.”
Self-citationTransformers in biosignal analysis: A review
Anwar, A., Khalifa, Y., Coyle, J. L., & Sejdić, E. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102697 · Cited by 81
Identifying Stable EEG Patterns in Manipulation Task for Negative Emotion Recognition
Pei, Y., Zhao, S., Xie, L., Luo, Z., Zhou, D., Ma, C., Ye, Y., & Yin, E. (2025) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2025.3551330 · Cited by 56
“This section introduces the DBT, derived from ViT, a competitive method for sequence recognition tasks [57], [58], [59], [60].”
Metadata
- Authors
- Cheng, C., Zhang, Y., Liu, L., Liu, W., & Feng, L.
- Affiliations
- Dalian University of Technology (CN)
- Liaoning Normal University (CN)
- Venue
- IEEE Journal of Biomedical and Health Informatics
- Published
- 2023-03
- Volume
- 27
- Issue
- 3
- Pages
- 1342-1353
- ISSN
- 2168-2194 (ISSN-L)
- 2168-2208
- OpenAlex
- W4312457096
- Cited by
- 29
- References
- 47
- Citations by year
- 2026: 6 · 2025: 11 · 2024: 7 · 2023: 5
- FWCI
- 5.30
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Journal of Biomedical and Health Informatics (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Natural Science Foundation of China (61972064, 61772252)
- LiaoNing Revitalization Talents Program (XLYC1806006)
- Fundamental Research Funds for the Central Universities (DU19RC(3)012)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
- Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › ECG Monitoring and Analysis
- Keywords
- EEG-based emotion recognition, spatiotemporal dynamics, attention mechanism, cross-domain feature fusion, DEAP dataset, SEED dataset, SEED-IV dataset
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Multi-Domain Encoding of Spatiotemporal Dynamics in EEG for Emotion Recognition. https://app.cochat.ai/papers/10.1109/jbhi.2022.3232497
- The paper
- Cheng, C., Zhang, Y., Liu, L., Liu, W., & Feng, L. (2023). Multi-Domain Encoding of Spatiotemporal Dynamics in EEG for Emotion Recognition. IEEE Journal of Biomedical and Health Informatics. https://doi.org/10.1109/jbhi.2022.3232497
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.