The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Real-Time Movie-Induced Discrete Emotion Recognition from EEG Signals
Abstract
Recognition of a human's continuous emotional states in real time plays an important role in machine emotional intelligence and human-machine interaction. Existing real-time emotion recognition systems use stimuli with low ecological validity (e.g., picture, sound) to elicit emotions and to recognise only valence and arousal. To overcome these limitations, in this paper, we construct a standardised database of 16 emotional film clips that were selected from over one thousand film excerpts. Based on emotional categories that are induced by these film clips, we propose a real-time movie-induced emotion recognition system for identifying an individual's emotional states through the analysis of brain waves. Thirty participants took part in this study and watched 16 standardised film clips that characterise real-life emotional experiences and target seven discrete emotions and neutrality. Our system uses a 2-s window and a 50 percent overlap between two consecutive windows to segment the EEG signals. Emotional states, including not only the valence and arousal dimensions but also similar discrete emotions in the valence-arousal coordinate space, are predicted in each window. Our real-time system achieves an overall accuracy of 92.26 percent in recognising high-arousal and valenced emotions from neutrality and 86.63 percent in recognising positive from negative emotions. Moreover, our system classifies three positive emotions (joy, amusement, tenderness) with an average of 86.43 percent accuracy and four negative emotions (anger, disgust, fear, sadness) with an average of 65.09 percent accuracy. These results demonstrate the advantage over the existing state-of-the-art real-time emotion recognition systems from EEG signals in terms of classification accuracy and the ability to recognise similar discrete emotions that are close in the valence-arousal coordinate space.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
Development and validation of brief measures of positive and negative affect: The PANAS scales.
Watson, D., Clark, L. A., & Tellegen, A. (1988) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.54.6.1063 · Cited by 32,433
Delorme, A., & Makeig, S. (2004) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2003.10.009 · Cited by 24,371
Measuring emotion: The self-assessment manikin and the semantic differential
Bradley, M. M., & Lang, P. J. (1994) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(94)90063-9 · Cited by 9,538
Event-related EEG/MEG synchronization and desynchronization: basic principles
Pfurtscheller, G., & Lopes da Silva, F. H. (1999) · Clinical Neurophysiology · doi:10.1016/s1388-2457(99)00141-8 · Cited by 7,328
(2005) · CTIT technical reports series · Cited by 5,307
DEAP: A Database for Emotion Analysis ;Using Physiological Signals
Koelstra, S., Muhl, C., Soleymani, M., Lee, J.-S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., & Patras, I. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.15 · Cited by 5,093
Emotion elicitation using films
Gross, J. J., & Levenson, R. W. (1995) · Cognition & Emotion · doi:10.1080/02699939508408966 · Cited by 2,179
Mauss, I. B., & Robinson, M. D. (2009) · Cognition and Emotion · doi:10.1080/02699930802204677 · Cited by 2,078
Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications
Calvo, R. A., & D'Mello, S. (2010) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2010.1 · Cited by 1,893 · cited 1×
“nition, such as self-report, startle, behavioral responses, and physiological measures [3], [4].”
BackgroundA Multimodal Database for Affect Recognition and Implicit Tagging
Soleymani, M., Lichtenauer, J., Pun, T., & Pantic, M. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.25 · Cited by 1,664
Mehrabian, A. (1996) · Current Psychology · doi:10.1007/bf02686918 · Cited by 1,493
Mining event-related brain dynamics
Makeig, S., Debener, S., Onton, J., & Delorme, A. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.03.008 · Cited by 1,493
The world of emotions is not two-dimensional
Fontaine, J. R. J., Scherer, K. R., Roesch, E. B., & Ellsworth, P. C. (2007) · Psychological Science · doi:10.1111/j.1467-9280.2007.02024.x · Cited by 1,179
Event-related cortical desynchronization detected by power measurements of scalp EEG
Pfurtscheller, G., & Aranibar, A. (1977) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(77)90235-8 · Cited by 1,108
(2011) · Speech and Audio Signal Processing · doi:10.1002/9781118142882.ch8 · Cited by 1,084
Event-related synchronization (ERS): an electrophysiological correlate of cortical areas at rest
Pfurtscheller, G. (1992) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(92)90133-3 · Cited by 981
Schaefer, A., Nils, F., Sanchez, X., & Philippot, P. (2010) · Cognition & Emotion · doi:10.1080/02699930903274322 · Cited by 875
Aftanas, L. I., & Golocheikine, S. A. (2001) · Neuroscience Letters · doi:10.1016/s0304-3940(01)02094-8 · Cited by 865
Harmon-Jones, E., & Sigelman, J. (2001) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.80.5.797 · Cited by 758
Anxious or Angry? Effects of Discrete Emotions on the Perceived Helpfulness of Online Reviews1
Yin, D., Bond, S. D., & Zhang, H. (2014) · MIS Quarterly · doi:10.25300/misq/2014/38.2.10 · Cited by 757
Multimodal Emotion Recognition in Response to Videos
Soleymani, M., Pantic, M., & Pun, T. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.37 · Cited by 722
Sammler, D., Grigutsch, M., Fritz, T., & Koelsch, S. (2007) · Psychophysiology · doi:10.1111/j.1469-8986.2007.00497.x · Cited by 599
Clarifying the emotive functions of asymmetrical frontal cortical activity
Harmon‐Jones, E. (2003) · Psychophysiology · doi:10.1111/1469-8986.00121 · Cited by 557
Analysis of EEG Signals and Facial Expressions for Continuous Emotion Detection
Soleymani, M., Asghari-Esfeden, S., Fu, Y., & Pantic, M. (2016) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2015.2436926 · Cited by 552
Clemmensen, L., Hastie, T., Witten, D., & Ersbøll, B. (2011) · Technometrics · doi:10.1198/tech.2011.08118 · Cited by 534
Jirayucharoensak, S., Pan-Ngum, S., & Israsena, P. (2014) · The Scientific World Journal · doi:10.1155/2014/627892 · Cited by 486
Harmon-Jones, E. (2004) · Biological Psychology · doi:10.1016/j.biopsycho.2004.03.003 · Cited by 414
Inducing and assessing differentiated emotion-feeling states in the laboratory
Philippot, P. (1993) · Cognition and Emotion · doi:10.1080/02699939308409183 · Cited by 390
EEG-based emotion recognition during watching movies
Nie, D., Wang, X.-W., Shi, L.-C., & Lu, B.-L. (2011) · 2011 5th International IEEE/EMBS Conference on Neural Engineering · doi:10.1109/ner.2011.5910636 · Cited by 360
Mapping discrete and dimensional emotions onto the brain: controversies and consensus
Hamann, S. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.07.006 · Cited by 316
LIRIS-ACCEDE: A Video Database for Affective Content Analysis
Baveye, Y., Dellandrea, E., Chamaret, C., & Chen, L. (2015) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2015.2396531 · Cited by 306
Violation of expectancy, loss of control, and anger expressions in young infants.
Lewis, M., Alessandri, S. M., & Sullivan, M. W. (1990) · Developmental Psychology · doi:10.1037//0012-1649.26.5.745 · Cited by 281
Real-Time EEG-Based Emotion Recognition and Its Applications
Liu, Y., Sourina, O., & Nguyen, M. K. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-22336-5_13 · Cited by 266
Self-citationFrantzidis, C. A., Bratsas, C., Papadelis, C. L., Konstantinidis, E., Pappas, C., & Bamidis, P. D. (2010) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2010.2041553 · Cited by 247
Aftanas, L. I., Varlamov, A. A., Pavlov, S. V., Makhnev, V. P., & Reva, N. V. (2001) · Neuroscience Letters · doi:10.1016/s0304-3940(01)01703-7 · Cited by 244
Real‐Time EEG‐Based Happiness Detection System
Jatupaiboon, N., Pan-ngum, S., & Israsena, P. (2013) · The Scientific World Journal · doi:10.1155/2013/618649 · Cited by 234
EEG correlates (event-related desynchronization) of emotional face elaboration: A temporal analysis
Balconi, M., & Lucchiari, C. (2006) · Neuroscience Letters · doi:10.1016/j.neulet.2005.09.004 · Cited by 213
Separating emotion and motivational direction in fear and anger: Effects on frontal asymmetry.
Wacker, J., Heldmann, M., & Stemmler, G. (2003) · Emotion · doi:10.1037/1528-3542.3.2.167 · Cited by 179
On the Selective Relation of Frontal Cortical Asymmetry and Anger-Out Versus Anger-Control.
Hewig, J. S., Hagemann, D., Seifert, J., Naumann, E., & Bartussek, D. (2004) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.87.6.926 · Cited by 178
High-frequency broadband modulation of electroencephalographic spectra
Onton, J., & Makeig, S. (2009) · Frontiers in Human Neuroscience · doi:10.3389/neuro.09.061.2009 · Cited by 169
Bekkedal, M. Y. V., Rossi, J., & Panksepp, J. (2011) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2011.05.001 · Cited by 159
EEG-Based Lapse Detection With High Temporal Resolution
Davidson, P. R., Jones, R. D., & Peiris, M. T. R. (2007) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2007.893452 · Cited by 158
Trait anger predicts relative left frontal cortical activation to anger-inducing stimuli
Harmon‐Jones, E. (2007) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2007.03.020 · Cited by 145
EEG artifact elimination by extraction of ICA-component features using image processing algorithms
Radüntz, T., Scouten, J., Hochmuth, O., & Meffert, B. (2015) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2015.01.030 · Cited by 133
Briesemeister, B. B., Tamm, S., Heine, A., & Jacobs, A. M. (2013) · Psychology · doi:10.4236/psych.2013.43a039 · Cited by 125
Ubiquitous emotion-aware computing
van den Broek, E. L. (2011) · Personal and Ubiquitous Computing · doi:10.1007/s00779-011-0479-9 · Cited by 120
Hadjidimitriou, S., & Hadjileontiadis, L. J. (2013) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2013.6 · Cited by 104
Individual differences in anger and sad expressions during extinction: antecedents and consequences
Lewis, M., Sullivan, M. W., Ramsay, D. S., & Alessandri, S. M. (1992) · Infant Behavior and Development · doi:10.1016/0163-6383(92)80012-j · Cited by 97
Affective motivational direction drives asymmetric frontal hemisphere activation
Poole, B. D., & Gable, P. A. (2014) · Experimental Brain Research · doi:10.1007/s00221-014-3902-4 · Cited by 88
Adaptive Emotional Information Retrieval From EEG Signals in the Time-Frequency Domain
Petrantonakis, P. C., & Hadjileontiadis, L. J. (2012) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2187647 · Cited by 87
Jenkins, L. M., & Andrewes, D. G. (2012) · Brain Impairment · doi:10.1017/brimp.2012.18 · Cited by 62
Rybak, M., Crayton, J. W., Young, I. J., Herba, E., & Konopka, L. M. (2006) · Clinical EEG and Neuroscience · doi:10.1177/155005940603700105 · Cited by 50
Cited by
EEG Emotion Recognition Using Dynamical Graph Convolutional Neural Networks
Song, T., Zheng, W., Song, P., & Cui, Z. (2020) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2817622 · Cited by 1,597
Rashid, M., Sulaiman, N., P. P. Abdul Majeed, A., Musa, R. M., Ab. Nasir, A. F., Bari, B. S., & Khatun, S. (2020) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2020.00025 · Cited by 506
EEG Based Emotion Recognition: A Tutorial and Review
Li, X., Zhang, Y., Tiwari, P., Song, D., Hu, B., Yang, M., Zhao, Z., Kumar, N., & Marttinen, P. (2023) · ACM Computing Surveys · doi:10.1145/3524499 · Cited by 508
EEG emotion recognition using fusion model of graph convolutional neural networks and LSTM
Yin, Y., Zheng, X., Hu, B., Zhang, Y., & Cui, X. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106954 · Cited by 466
An Efficient LSTM Network for Emotion Recognition From Multichannel EEG Signals
Du, X., Ma, C., Zhang, G., Li, J., Lai, Y.-K., Zhao, G., Deng, X., Liu, Y.-J., & Wang, H. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.3013711 · Cited by 357
Self-citation
Metadata
- Authors
- Liu, Y.-J., Yu, M., Zhao, G., Song, J., Ge, Y., & Shi, Y.
- Venue
- IEEE Transactions on Affective Computing
- Published
- 2018-10-01
- Volume
- 9
- Issue
- 4
- Pages
- 550-562
- ISSN
- 1949-3045 (ISSN-L)
- 2371-9850
- OpenAlex
- W2580887161
- Cited by
- 356
- References
- 53
- FWCI
- 32.95
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.