The DOI matches its Crossref record; 80 of the 80 references it cites were found in a registry or an index.
EEG-Based Emotion Recognition: A State-of-the-Art Review of Current Trends and Opportunities
Open accessAbstract
Emotions are fundamental for human beings and play an important role in human cognition. Emotion is commonly associated with logical decision making, perception, human interaction, and to a certain extent, human intelligence itself. With the growing interest of the research community towards establishing some meaningful “emotional” interactions between humans and computers, the need for reliable and deployable solutions for the identification of human emotional states is required. Recent developments in using electroencephalography (EEG) for emotion recognition have garnered strong interest from the research community as the latest developments in consumer-grade wearable EEG solutions can provide a cheap, portable, and simple solution for identifying emotions. Since the last comprehensive review was conducted back from the years 2009 to 2016, this paper will update on the current progress of emotion recognition using EEG signals from 2016 to 2019. The focus on this state-of-the-art review focuses on the elements of emotion stimuli type and presentation approach, study size, EEG hardware, machine learning classifiers, and classification approach. From this state-of-the-art review, we suggest several future research opportunities including proposing a different approach in presenting the stimuli in the form of virtual reality (VR). To this end, an additional section devoted specifically to reviewing only VR studies within this research domain is presented as the motivation for this proposed new approach using VR as the stimuli presentation device. This review paper is intended to be useful for the research community working on emotion recognition using EEG signals as well as for those who are venturing into this field of research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Measuring emotion: The self-assessment manikin and the semantic differential
Bradley, M. M., & Lang, P. J. (1994) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(94)90063-9 · Cited by 9,538
Constants across cultures in the face and emotion.
Ekman, P., & Friesen, W. V. (1971) · Journal of Personality and Social Psychology · doi:10.1037/h0030377 · Cited by 5,509
DEAP: A Database for Emotion Analysis ;Using Physiological Signals
Koelstra, S., Muhl, C., Soleymani, M., Lee, J.-S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., & Patras, I. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.15 · Cited by 5,093
The emotion probe: Studies of motivation and attention.
Lang, P. J. (1995) · American Psychologist · doi:10.1037//0003-066x.50.5.372 · Cited by 2,746
Ekman, P. (1992) · Psychological Review · doi:10.1037//0033-295x.99.3.550 · Cited by 2,372
Mauss, I. B., & Robinson, M. D. (2009) · Cognition and Emotion · doi:10.1080/02699930802204677 · Cited by 2,078
A Multimodal Database for Affect Recognition and Implicit Tagging
Soleymani, M., Lichtenauer, J., Pun, T., & Pantic, M. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.25 · Cited by 1,664
EEG Emotion Recognition Using Dynamical Graph Convolutional Neural Networks
Song, T., Zheng, W., Song, P., & Cui, Z. (2020) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2817622 · Cited by 1,597
The contextual brain: implications for fear conditioning, extinction and psychopathology
Maren, S., Phan, K. L., & Liberzon, I. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3492 · Cited by 1,547
Plutchik, R. (2001) · American Scientist · doi:10.1511/2001.4.344 · Cited by 1,419
Cerebral location of international 10–20 system electrode placement
Homan, R. W., Herman, J., & Purdy, P. (1987) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(87)90206-9 · Cited by 1,407
Emotions Recognition Using EEG Signals: A Survey
Alarcao, S. M., & Fonseca, M. J. (2019) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2714671 · Cited by 1,201 · cited 5×
“Since the last comprehensive review for emotion recognition was published by Alarcao and Fonseca [22], this review paper will serve as an update on the previously reviewed paper.”
BackgroundMethodInfluentialBillinghurst, M., Clark, A., & Lee, G. (2015) · Foundations and Trends® in Human—Computer Interaction · doi:10.1561/1100000049 · Cited by 1,191
Katsigiannis, S., & Ramzan, N. (2018) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2017.2688239 · Cited by 1,135
Basic Emotions, Natural Kinds, Emotion Schemas, and a New Paradigm
Izard, C. E. (2007) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2007.00044.x · Cited by 1,110
Using the International 10-20 EEG System for Positioning of Transcranial Magnetic Stimulation
Herwig, U., Satrapi, P., & Schönfeldt-Lecuona, C. (2003) · Brain Topography · doi:10.1023/b:brat.0000006333.93597.9d · Cited by 1,098
Emotion Theory and Research: Highlights, Unanswered Questions, and Emerging Issues
Izard, C. E. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.60.110707.163539 · Cited by 1,088
Emotion recognition based on physiological changes in music listening
Kim, J., & Andre, E. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.26 · Cited by 1,082
Feature Extraction and Selection for Emotion Recognition from EEG
Jenke, R., Peer, A., & Buss, M. (2014) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2014.2339834 · Cited by 1,081
EEG-Based Emotion Recognition in Music Listening
Lin, Y.-P., Wang, C.-H., Jung, T.-P., Wu, T.-L., Jeng, S.-K., Duann, J.-R., & Chen, J.-H. (2010) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2010.2048568 · Cited by 1,021
Removal of Artifacts from EEG Signals: A Review
Jiang, X., Bian, G.-B., & Tian, Z. (2019) · Sensors · doi:10.3390/s19050987 · Cited by 826
Marchewka, A., Żurawski, Ł., Jednoróg, K., & Grabowska, A. (2014) · Behavior Research Methods · doi:10.3758/s13428-013-0379-1 · Cited by 786
Virtual reality and mixed reality for virtual learning environments
Pan, Z., Cheok, A. D., Yang, H., Zhu, J., & Shi, J. (2006) · Computers & Graphics · doi:10.1016/j.cag.2005.10.004 · Cited by 613
ASCERTAIN: Emotion and Personality Recognition Using Commercial Sensors
Subramanian, R., Wache, J., Abadi, M. K., Vieriu, R. L., Winkler, S., & Sebe, N. (2018) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2016.2625250 · Cited by 535
The temple university hospital EEG data corpus
Obeid, I., & Picone, J. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00196 · Cited by 528
Javadzadeh, Y., & Hamedeyaz, S. (2014) · Trends in Helicobacter pylori Infection · doi:10.5772/57353 · Cited by 477
Methods for artifact detection and removal from scalp EEG: A review
Islam, M. K., Rastegarnia, A., & Yang, Z. (2016) · Neurophysiologie Clinique/Clinical Neurophysiology · doi:10.1016/j.neucli.2016.07.002 · Cited by 457
Emotion Recognition Using Bio-sensors: First Steps towards an Automatic System
Haag, A., Goronzy, S., Schaich, P., & Williams, J. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24842-2_4 · Cited by 451
New technology trends in education: Seven years of forecasts and convergence
Martin, S., Diaz, G., Sancristobal, E., Gil, R., Castro, M., & Peire, J. (2011) · Computers & Education · doi:10.1016/j.compedu.2011.04.003 · Cited by 449
Ahern, G. L., & Schwartz, G. E. (1985) · Neuropsychologia · doi:10.1016/0028-3932(85)90081-8 · Cited by 437
A multimodal approach to estimating vigilance using EEG and forehead EOG
Zheng, W.-L., & Lu, B.-L. (2017) · Journal of Neural Engineering · doi:10.1088/1741-2552/aa5a98 · Cited by 424 · cited 1×
“As for video-related contents, SEED [124–126], DREAMER [127], and ASCERTAIN [107] do provide their video database either openly or upon request.”
BackgroundWhy bodies? Twelve reasons for including bodily expressions in affective neuroscience
de Gelder, B. (2009) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2009.0190 · Cited by 420
Immersive VR and Education: Embodied Design Principles That Include Gesture and Hand Controls
Johnson-Glenberg, M. C. (2018) · Frontiers in Robotics and AI · doi:10.3389/frobt.2018.00081 · Cited by 416
Marín-Morales, J., Higuera-Trujillo, J. L., Greco, A., Guixeres, J., Llinares, C., Scilingo, E. P., Alcañiz, M., & Valenza, G. (2018) · Scientific Reports · doi:10.1038/s41598-018-32063-4 · Cited by 411
Bi-modal emotion recognition from expressive face and body gestures
Gunes, H., & Piccardi, M. (2007) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2006.09.007 · Cited by 382
Emotion recognition from physiological signals using wireless sensors for presence technologies
Nasoz, F., Alvarez, K., Lisetti, C. L., & Finkelstein, N. (2004) · Cognition, Technology & Work · doi:10.1007/s10111-003-0143-x · Cited by 367
DECAF: MEG-Based Multimodal Database for Decoding Affective Physiological Responses
Abadi, M. K., Subramanian, R., Kia, S. M., Avesani, P., Patras, I., & Sebe, N. (2015) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2015.2392932 · Cited by 365
Casson, A. J. (2019) · Biomedical Engineering Letters · doi:10.1007/s13534-018-00093-6 · Cited by 340
Li, Y., Zheng, W., Wang, L., Zong, Y., & Cui, Z. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2019.2922912 · Cited by 313
Emotion Recognition from EEG Signals Using Multidimensional Information in EMD Domain
Zhuang, N., Zeng, Y., Tong, L., Zhang, C., Zhang, H., & Yan, B. (2017) · BioMed Research International · doi:10.1155/2017/8317357 · Cited by 283
Hassouneh, A., Mutawa, A. M., & Murugappan, M. (2020) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2020.100372 · Cited by 275
Ip, H. H. S., Wong, S. W. L., Chan, D. F. Y., Byrne, J., Li, C., Yuan, V. S. N., Lau, K. S. Y., & Wong, J. Y. W. (2018) · Computers & Education · doi:10.1016/j.compedu.2017.09.010 · Cited by 272
Emotion recognition from EEG signals by using multivariate empirical mode decomposition
Mert, A., & Akan, A. (2018) · Pattern Analysis and Applications · doi:10.1007/s10044-016-0567-6 · Cited by 243
Soft, Comfortable Polymer Dry Electrodes for High Quality ECG and EEG Recording
Chen, Y.-H., De Beeck, M., Vanderheyden, L., Carrette, E., Mihajlović, V., Vanstreels, K., Grundlehner, B., Gadeyne, S., Boon, P., & Van Hoof, C. (2014) · Sensors · doi:10.3390/s141223758 · Cited by 238
Real-time EEG-based emotion monitoring using stable features
Lan, Z., Sourina, O., Wang, L., & Liu, Y. (2016) · The Visual Computer · doi:10.1007/s00371-015-1183-y · Cited by 222
Multi-channel EEG-based emotion recognition via a multi-level features guided capsule network
Liu, Y., Ding, Y., Li, C., Cheng, J., Song, R., Wan, F., & Chen, X. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.103927 · Cited by 219
Mehrabian, A. (1997) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/bf02229025 · Cited by 194
Study of Resting-State Functional Connectivity Networks Using EEG Electrodes Position As Seed
Rojas, G., Álvarez, C., Montoya, C., de la Iglesia-Vayá, M., Cisternas, J. E., & Gálvez, M. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00235 · Cited by 185
Di Flumeri, G., Aricò, P., Borghini, G., Sciaraffa, N., Di Florio, A., & Babiloni, F. (2019) · Sensors · doi:10.3390/s19061365 · Cited by 173
Improving EEG-Based Emotion Classification Using Conditional Transfer Learning
Lin, Y.-P., & Jung, T.-P. (2017) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2017.00334 · Cited by 167
Understanding emotion with brain networks
Pessoa, L. (2017) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2017.09.005 · Cited by 167
EEG-Based Emotion Recognition Using Hierarchical Network With Subnetwork Nodes
Yang, Y., Wu, Q. M. J., Zheng, W.-L., & Lu, B.-L. (2018) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2017.2685338 · Cited by 141
Neural Substrates of Childhood Anxiety Disorders
Blackford, J. U., & Pine, D. S. (2012) · Child and Adolescent Psychiatric Clinics of North America · doi:10.1016/j.chc.2012.05.002 · Cited by 138
EEG-Based Affect and Workload Recognition in a Virtual Driving Environment for ASD Intervention
Fan, J., Wade, J. W., Key, A. P. F., Warren, Z. E., & Sarkar, N. (2017) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2017.2693157 · Cited by 132
Goosens, K. A., & Maren, S. (2002) · Hippocampus · doi:10.1002/hipo.10099 · Cited by 126
Internal Emotion Classification Using EEG Signal With Sparse Discriminative Ensemble
Ullah, H., Uzair, M., Mahmood, A., Ullah, M., Khan, S. D., & Cheikh, F. A. (2019) · IEEE Access · doi:10.1109/access.2019.2904400 · Cited by 125
Familiarity effects in EEG-based emotion recognition
Thammasan, N., Moriyama, K., Fukui, K., & Numao, M. (2016) · Brain Informatics · doi:10.1007/s40708-016-0051-5 · Cited by 123
Arousal and Valence Recognition of Affective Sounds Based on Electrodermal Activity
Greco, A., Valenza, G., Citi, L., & Scilingo, E. P. (2016) · IEEE Sensors Journal · doi:10.1109/jsen.2016.2623677 · Cited by 121
Emotion Recognition through Physiological Signals for Human-Machine Communication
Maaoui, C., & Pruski, A. (2010) · Cutting Edge Robotics 2010 · doi:10.5772/10312 · Cited by 109 · cited 1×
“According to previous researchers, over the last decade of research on emotion recognition using physiological signals, many have deployed numerous methods of classifiers to classify the different types of emotional states [132].”
BackgroundAesthetic preference recognition of 3D shapes using EEG
Chew, L. H., Teo, J., & Mountstephens, J. (2015) · Cognitive Neurodynamics · doi:10.1007/s11571-015-9363-z · Cited by 102
Self-citationEmotion Regulation Using Virtual Environments and Real-Time fMRI Neurofeedback
Lorenzetti, V., Melo, B. R. P., Basílio, R., Suo, C., Yücel, M., Tierra-Criollo, C. J., & Moll, J. (2018) · Frontiers in Neurology · doi:10.3389/fneur.2018.00390 · Cited by 91
Neural activities associated with emotion recognition observed in men and women
Lee, T., Liu, H.-L., Chan, C. C. H., Fang, S.-Y., & Gao, J. (2004) · Molecular Psychiatry · doi:10.1038/sj.mp.4001595 · Cited by 79
Automatic detection of EEG artefacts arising from head movements using EEG and gyroscope signals
O’Regan, S., Faul, S., & Marnane, W. P. (2012) · Medical Engineering & Physics · doi:10.1016/j.medengphy.2012.08.017 · Cited by 76
Emotion Classification through Nonlinear EEG Analysis Using Machine Learning Methods
Soroush, M. Z., Maghooli, K., Setarehdan, S. K., & Nasrabadi, A. M. (2018) · International Clinical Neuroscience Journal · doi:10.15171/icnj.2018.26 · Cited by 76
Emotion classification using EEG signals based on tunable‐ Q wavelet transform
Krishna, A. H., Sri, A. B., Priyanka, K. Y. V. S., Taran, S., & Bajaj, V. (2018) · IET Science Measurement & Technology · doi:10.1049/iet-smt.2018.5237 · Cited by 67
Single-Trial Cognitive Stress Classification Using Portable Wireless Electroencephalography
Blanco, J. A., Vanleer, A., Calibo, T. K., & Firebaugh, S. L. (2019) · Sensors · doi:10.3390/s19030499 · Cited by 62
Improved emotion recognition in Spanish social media through incorporation of lexical knowledge
Plaza-del-Arco, F. M., Valdivia, M. T. M., López, L. A. U., & Mitkov, R. (2019) · Future Generation Computer Systems · doi:10.1016/j.future.2019.09.034 · Cited by 59
Horvat, M., Dobrinic, M., Novosel, M., & Jercic, P. (2018) · 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO) · doi:10.23919/mipro.2018.8400184 · Cited by 49
Improved artefact removal from EEG using Canonical Correlation Analysis and spectral slope
Janani, A. S., Grummett, T. S., Lewis, T. W., Fitzgibbon, S. P., Whitham, E. M., DeLosAngeles, D., Bakhshayesh, H., Willoughby, J. O., & Pope, K. J. (2018) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2018.01.004 · Cited by 43
Constantinescu, A. C., Wolters, M. K., Moore, A., & MacPherson, S. E. (2016) · Behavior Research Methods · doi:10.3758/s13428-016-0750-0 · Cited by 39
Balducci, F., Grana, C., & Cucchiara, R. (2016) · The Visual Computer · doi:10.1007/s00371-016-1320-2 · Cited by 30
Real-Time Electroencephalography-Based Emotion Recognition System
Sarno, R., Munawar, M. N., & Nugraha, B. T. (2016) · International Review on Computers and Software (IRECOS) · doi:10.15866/irecos.v11i5.9334 · Cited by 29
Music emotion recognition based on two-level support vector classification
Lin, C., Liu, M.-Y., Weiwei, H., et al. (2016) · International Conference on Machine Learning and Cybernetics · doi:10.1109/icmlc.2016.7860930 · Cited by 28
Development of computational models of emotions: A software engineering perspective
Osuna, E., Rodríguez, L.-F., Gutiérrez-García, J. O., & Castro, L. A. (2019) · Cognitive Systems Research · doi:10.1016/j.cogsys.2019.11.001 · Cited by 28
Beemster, T. T., van Velzen, J. M., van Bennekom, C. A. M., Reneman, M. F., & Frings‐Dresen, M. H. W. (2018) · Journal of Occupational Rehabilitation · doi:10.1007/s10926-018-9767-9 · Cited by 26
A Preliminary Study on Precision Image Guidance for Electrode Placement in an EEG Study
Jeon, S., Chien, J., Song, C., & Hong, J. (2017) · Brain Topography · doi:10.1007/s10548-017-0610-y · Cited by 21
Bialas, P., & Milanowski, P. (2014) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2014.6944857 · Cited by 12
Szentkirályi, A., WONG, K. K. H., Grunstein, R. R., D'Rozario, A. L., & Kim, J. W. (2017) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2017.08.004 · Cited by 8
Clinical Affective Neuroscience
Penner, A. E., & Stoddard, J. (2018) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2018.07.877 · Cited by 7
Enhancing simulations with intra-subject variability for improved psychophysical assessments
Rinderknecht, M. D., Lambercy, O., & Gassert, R. (2018) · PLoS ONE · doi:10.1371/journal.pone.0209839 · Cited by 6
Cited by
EEG Based Emotion Recognition: A Tutorial and Review
Li, X., Zhang, Y., Tiwari, P., Song, D., Hu, B., Yang, M., Zhao, Z., Kumar, N., & Marttinen, P. (2023) · ACM Computing Surveys · doi:10.1145/3524499 · Cited by 508
Emotion recognition in EEG signals using deep learning methods: A review
Jafari, M., Shoeibi, A., Khodatars, M., Bagherzadeh, S., Shalbaf, A., García, D. L., Gorriz, J. M., & Acharya, U. R. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107450 · Cited by 240
Automated emotion recognition: Current trends and future perspectives
Maithri, M., Raghavendra, U., Gudigar, A., Samanth, J., Barua, P. D., Murugappan, M., Chakole, Y., & Acharya, U. R. (2022) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2022.106646 · Cited by 172
A State-of-the-Art Review of EEG-Based Imagined Speech Decoding
Lopez-Bernal, D., Balderas, D., Ponce, P., & Molina, A. (2022) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2022.867281 · Cited by 107
“Moreover, it has also been used to recognize and classify emotions (Kaur et al., 2018; Suhaimi et al., 2020) and sleep stages (Chen et al., 2018), as well as to bring the opportunity of performing normal movements to people with motor disabilities (Antelis et al., 2018; Attallah et al., 2020;…”
BackgroundJadhav, V., Tiwari, N., & Chawla, M. (2023) · ITM Web of Conferences · doi:10.1051/itmconf/20235302011 · Cited by 11
Metadata
- Authors
- Suhaimi, N. S., Mountstephens, J., & Teo, J.
- Venue
- Computational Intelligence and Neuroscience
- Publisher
- Wiley
- Published
- 2020-09-16
- Volume
- 2020
- Pages
- 1-19
- ISSN
- 1687-5265 (ISSN-L)
- 1687-5273
- OpenAlex
- W3087220290
- Cited by
- 357
- References
- 80
- FWCI
- 41.64
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.