Cited by 508Emotion and Mood RecognitionEEG and Brain-Computer InterfacesGaze Tracking and Assistive Technology

EEG Based Emotion Recognition: A Tutorial and Review

Open access
Li, Xiang, Zhang, Yazhou, Tiwari, Prayag, Song, Dawei, Hu, Bin, Yang, Meihong, Zhao, Zhigang, Kumar, Neeraj +1 more·2023·ACM Computing Surveys

Abstract

Emotion recognition technology through analyzing the EEG signal is currently an essential concept in Artificial Intelligence and holds great potential in emotional health care, human-computer interaction, multimedia content recommendation, etc. Though there have been several works devoted to reviewing EEG-based emotion recognition, the content of these reviews needs to be updated. In addition, those works are either fragmented in content or only focus on specific techniques adopted in this area but neglect the holistic perspective of the entire technical routes. Hence, in this paper, we review from the perspective of researchers who try to take the first step on this topic. We review the recent representative works in the EEG-based emotion recognition research and provide a tutorial to guide the researchers to start from the beginning. The scientific basis of EEG-based emotion recognition in the psychological and physiological levels is introduced. Further, we categorize these reviewed works into different technical routes and illustrate the theoretical basis and the research motivation, which will help the readers better understand why those techniques are studied and employed. At last, existing challenges and future investigations are also discussed in this paper, which guides the researchers to decide potential future research directions.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3524499

Cites

225 of 225 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Emotions cannot be reliably captured with unimodal signals because genuine emotion can be hidden by different facial expressions or tones.

    “emotions are considered a complex representation that cannot be reliably captured with unimodal signals, since genuine emotion can be hidden by different facial expressions or tones [11].”

    From Multimodal Emotion Recognition Based on Facial Expressions, Speech, and EEG (2024) · cites this paper as [11]

    Section 5.3 says people may conceal feelings behind social masks and that a single modality may be insufficient for accurate recognition; the introduction (1:2) says deliberate concealment can affect facial- or speech-based methods. The claim overstates this as a categorical inability to capture emotion reliably with any unimodal signal, whereas the review discusses limitations that may arise. (LLM, conf=0.86)

    Experimental — accuracy not yet measured
  • EEG signals extracted from the central nervous system can more accurately and objectively reflect changes in people's emotions than other signals.

    “EEG signals extracted from the central nervous system can more accurately and objectively reflect changes in people's emotions than other signals [2], [11].”

    From Multimodal Emotion Recognition Based on Facial Expressions, Speech, and EEG (2024) · cites this paper as [11]

    Section 2.2 says EEG records central nervous system activity and is an effective measure for studying emotion. The introduction (p. 1:2) notes that facial and speech cues can be affected when people conceal their feelings, but it does not establish that EEG reflects emotional changes more accurately and objectively than other signals generally. (LLM, conf=0.84)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 9

  1. [8]8. Michel Valstar, Björn Schuller, Kirsty Smith, Florian Eyben, Bihan Jiang, Sanjay Bilakhia, Sebastian Schnieder, Roddy Cowie, and Maja Pantic. Avec 2013: the continuous audio/visual emotion and depression recognition challenge. In Proceedings of the 3rd ACM international workshop on Audio/visual emotion challenge, pages 3-10, 2013.
  2. [33]33. Robert Plutchik and Henry Kellerman. Theories of emotion, volume 1. Academic Press, 2013.
  3. [82]82. C J Stam. Nonlinear dynamical analysis of eeg and meg. Clinical Neurophysiology, 116(10):2266-2301, 2005.
  4. [122]122. Seong Youb Chung and Hyun Joong Yoon. Affective classification using bayesian classifier and supervised learning. In Proceedings of the 2012 12th International Conference on Control, Automation and Systems, pages 1768-1771. IEEE, 2012.
  5. [132]132. Samarth Tripathi, Shrinivas Acharya, Ranti Dev Sharma, Sudhanshi Mittal, and Samit Bhattacharya. Using deep and convolutional neural networks for accurate emotion classification on deap dataset. In Proceedings of the 21st AAAI Conference on Artificial Intelligence, pages 4746-4752. AAAI Press, 2017.
  6. [134]134. Sara Sabour, Nicholas Frosst, and Geoffrey E Hinton. Dynamic routing between capsules. In Proceedings of the 31st International Conference on Neural Information Processing Systems, pages 3859-3869, 2017.
  7. [142]142. Yang Li, Wenming Zheng, Zhen Cui, Tong Zhang, and Yuan Zong. A novel neural network model based on cerebral hemispheric asymmetry for eeg emotion recognition. In IJCAI, pages 1561-1567, 2018.
  8. [177]177. I Pava, A Álvarez, Paula Herrera, Germán Castellanos-Domínguez, and A Orozco. Gender effects on an eeg-based emotion level classification system. In Iberoamerican Congress on Pattern Recognition, pages 810-819. Springer, Cham, 2018.
  9. [221]221. S. Katsigiannis and N. Ramzan. Dreamer: A database for emotion recognition through eeg and ecg signals from wireless low-cost off-the-shelf devices. IEEE Journal of Biomedical & Health Informatics, pages 1-1, 2017.

Cited by

Sorted by citations

Authors
Li, X., Zhang, Y., Tiwari, P., Song, D., Hu, B., Yang, M., Zhao, Z., Kumar, N., & Marttinen, P.
Affiliations
  • Qilu University of Technology (CN)
  • Zhengzhou University of Light Industry (CN)
  • Aalto University (FI)
  • Beijing Institute of Technology (CN)
  • Thapar Institute of Engineering & Technology (IN)
Venue
ACM Computing Surveys
Published
2022-11-21
Volume
55
Issue
4
Pages
1-57
ISSN
  • 0360-0300 (ISSN-L)
  • 1557-7341
OpenAlex
W4220866631
Cited by
508
References
225
Citations by year
2026: 93 · 2025: 191 · 2024: 138 · 2023: 71 · 2022: 15
FWCI
95.20
Type
journal article
Language
en
Open access
Locations
  • ACM Computing Surveys (publishedVersion)
  • Aaltodoc (Aalto University) (submittedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • Major Science and Technology Innovation Projects of Key R&D Programs of Shandong Province (2019JZZY010108, 2019JZZY010113)
  • Natural Science Foundation of China (U1636203, and 62006212)
  • Natural Science Foundation of Shandong Province
  • Research on Cross-domain Emotion Recognition Based on Large-scale Pre-trained EEG Model
  • State Key Lab. for Novel Software Technology in Nanjing University (KFKT2021B41)
  • Industrial Science and Technology Research Project of Henan Province (222102210031)
  • Academy of Finland (336033, and 315896)
  • Business Finland (884/31/2018)
  • EU H2020 (101016775)
Topics
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
  • Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
  • Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
Keywords
EEG-based emotion recognition, EEG, emotion recognition, human-computer interaction

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review