The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
MPED: A Multi-Modal Physiological Emotion Database for Discrete Emotion Recognition
Open accessAbstract
To explore human emotions, in this paper, we design and build a multi-modal physiological emotion database, which collects four modal physiological signals, i.e., electroencephalogram (EEG), galvanic skin response, respiration, and electrocardiogram (ECG). To alleviate the influence of culture dependent elicitation materials and evoke desired human emotions, we specifically collect an emotion elicitation material database selected from more than 1500 video clips. By the considerable amount of strict man-made labeling, we elaborately choose 28 videos as standardized elicitation samples, which are assessed by psychological methods. The physiological signals of participants were synchronously recorded when they watched these standardized video clips that described six discrete emotions and neutral emotion. With three types of classification protocols, different feature extraction methods and classifiers (support vector machine and k-NearestNeighbor) were used to recognize the physiological responses of different emotions, which presented the baseline results. Simultaneously, we present a novel attention-long short-term memory (A-LSTM), which strengthens the effectiveness of useful sequences to extract more discriminative features. In addition, correlations between the EEG signals and the participants' ratings are investigated. The database has been made publicly available to encourage other researchers to use it to evaluate their own emotion estimation methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Self-citationLIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
Development and validation of brief measures of positive and negative affect: The PANAS scales.
Watson, D., Clark, L. A., & Tellegen, A. (1988) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.54.6.1063 · Cited by 32,433
Russell, J. A. (1980) · Journal of Personality and Social Psychology · doi:10.1037/h0077714 · Cited by 16,334 · cited 1×
“Russell [11] proposed the valence-arousal scale dimensional model and Mehrabian [12] proposed the pleasure-arousal-dominance scale model.”
BackgroundMeasuring emotion: The self-assessment manikin and the semantic differential
Bradley, M. M., & Lang, P. J. (1994) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(94)90063-9 · Cited by 9,538
Machine learning in automated text categorization
Sebastiani, F. (2002) · ACM Computing Surveys · doi:10.1145/505282.505283 · Cited by 7,926
(2005) · CTIT technical reports series · Cited by 5,307
DEAP: A Database for Emotion Analysis ;Using Physiological Signals
Koelstra, S., Muhl, C., Soleymani, M., Lee, J.-S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., & Patras, I. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.15 · Cited by 5,093
Functional neuroanatomy of emotion: A meta-analysis of emotion activation studies in PET and fMRI
Phan, K. L., Wager, T., Taylor, S. F., & Liberzon, I. (2002) · NeuroImage · doi:10.1006/nimg.2002.1087 · Cited by 3,502
Looking at pictures: Affective, facial, visceral, and behavioral reactions
LANG, P. J., GREENWALD, M. K., BRADLEY, M. M., & HAMM, A. O. (1993) · Psychophysiology · doi:10.1111/j.1469-8986.1993.tb03352.x · Cited by 3,190
The somatic marker hypothesis and the possible functions of the prefrontal cortex
Damasio, A. R. (1996) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1996.0125 · Cited by 2,847 · cited 1×
“Besides, some works [56], [57] proved that the prefrontal part is highly related with human emotions.”
BackgroundGraves, A. (2012) · Studies in Computational Intelligence · doi:10.1007/978-3-642-24797-2_4 · Cited by 2,727
Zheng, W.-L., & Lu, B.-L. (2015) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2015.2431497 · Cited by 2,595
Self-citationEmotion elicitation using films
Gross, J. J., & Levenson, R. W. (1995) · Cognition & Emotion · doi:10.1080/02699939508408966 · Cited by 2,179
Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex
Cardinal, R. N., Parkinson, J. A., Hall, J., & Everitt, B. J. (2002) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(02)00007-6 · Cited by 2,129
A review on Hilbert‐Huang transform: Method and its applications to geophysical studies
Huang, N. E., & Wu, Z. (2008) · Reviews of Geophysics · doi:10.1029/2007rg000228 · Cited by 1,803
Universals and cultural differences in the judgments of facial expressions of emotion.
Ekman, P., Friesen, W. V., O'Sullivan, M., Chan, A., Diacoyanni-Tarlatzis, I., Heider, K., Krause, R., LeCompte, W. A., Pitcairn, T., Ricci-Bitti, P. E., et al. (1987) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.53.4.712 · Cited by 1,763
A Multimodal Database for Affect Recognition and Implicit Tagging
Soleymani, M., Lichtenauer, J., Pun, T., & Pantic, M. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.25 · Cited by 1,664
Oxytocin Modulates Neural Circuitry for Social Cognition and Fear in Humans
Kirsch, P., Esslinger, C., Chen, Q., Mier, D., Lis, S., Siddhanti, S., Gruppe, H., Mattay, V. S., Gallhofer, B., & Meyer-Lindenberg, A. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.3984-05.2005 · Cited by 1,639
EEG Emotion Recognition Using Dynamical Graph Convolutional Neural Networks
Song, T., Zheng, W., Song, P., & Cui, Z. (2020) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2817622 · Cited by 1,597
Self-citationEEG analysis based on time domain properties
Hjorth, B. (1970) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(70)90143-4 · Cited by 1,504
Mehrabian, A. (1996) · Current Psychology · doi:10.1007/bf02686918 · Cited by 1,493
The world of emotions is not two-dimensional
Fontaine, J. R. J., Scherer, K. R., Roesch, E. B., & Ellsworth, P. C. (2007) · Psychological Science · doi:10.1111/j.1467-9280.2007.02024.x · Cited by 1,179
Katsigiannis, S., & Ramzan, N. (2018) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2017.2688239 · Cited by 1,135
Emotion recognition based on physiological changes in music listening
Kim, J., & Andre, E. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.26 · Cited by 1,082
Neural bases of the non-conscious perception of emotional signals
Tamietto, M., & de Gelder, B. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2889 · Cited by 1,042
EEG-Based Emotion Recognition in Music Listening
Lin, Y.-P., Wang, C.-H., Jung, T.-P., Wu, T.-L., Jeng, S.-K., Duann, J.-R., & Chen, J.-H. (2010) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2010.2048568 · Cited by 1,021
Miserendino, M. J. D., Sananes, C. B., Melia, K. R., & Davis, M. (1990) · Nature · doi:10.1038/345716a0 · Cited by 824 · cited 1×
“Due to well-established neural circuits in preference for fear processing [49], [50], fear emotion can be more easily distinguished from other negative emotions [51].”
BackgroundEmotion Recognition From EEG Using Higher Order Crossings
Petrantonakis, P. C., & Hadjileontiadis, L. J. (2010) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2009.2034649 · Cited by 687
Addressing the Rare Word Problem in Neural Machine Translation
Luong, T., Sutskever, I., Le, Q., Vinyals, O., & Zaremba, W. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1002 · Cited by 619
Sammler, D., Grigutsch, M., Fritz, T., & Koelsch, S. (2007) · Psychophysiology · doi:10.1111/j.1469-8986.2007.00497.x · Cited by 599
Spatial–Temporal Recurrent Neural Network for Emotion Recognition
Zhang, T., Zheng, W., Cui, Z., Zong, Y., & Li, Y. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2788081 · Cited by 595
Self-citationEmotions in social psychology : essential readings
Parrott, W. G. (2001) · Cited by 535
A fast pathway for fear in human amygdala
Méndez-Bértolo, C., Moratti, S., Toledano, R., Lopez-Sosa, F., Martínez-Alvarez, R., Mah, Y. H., Vuilleumier, P., Gil-Nagel, A., & Strange, B. A. (2016) · Nature Neuroscience · doi:10.1038/nn.4324 · Cited by 392
Real-Time Movie-Induced Discrete Emotion Recognition from EEG Signals
Liu, Y.-J., Yu, M., Zhao, G., Song, J., Ge, Y., & Shi, Y. (2018) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2660485 · Cited by 356
A real-time automated system for the recognition of human facial expressions
Anderson, K., & McOwan, P. W. (2006) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2005.854502 · Cited by 355
Mapping discrete and dimensional emotions onto the brain: controversies and consensus
Hamann, S. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.07.006 · Cited by 316
A Deep Neural Network-Driven Feature Learning Method for Multi-view Facial Expression Recognition
Zhang, T., Zheng, W., Cui, Z., Zong, Y., Yan, J., & Yan, K. (2016) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2016.2598092 · Cited by 314
Self-citationMultichannel EEG-Based Emotion Recognition via Group Sparse Canonical Correlation Analysis
Zheng, W. (2017) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2016.2587290 · Cited by 303
Self-citationFacial Expression Recognition Using Kernel Canonical Correlation Analysis (KCCA)
Zheng, W., Zhou, X., Zou, C., & Zhao, L. (2006) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2005.860849 · Cited by 263
Self-citationRespiratory feedback in the generation of emotion
Philippot, P., Chapelle, G., & Blairy, S. (2002) · Cognition & Emotion · doi:10.1080/02699930143000392 · Cited by 260
Toward an EEG-Based Recognition of Music Liking Using Time-Frequency Analysis
Hadjidimitriou, S. K., & Hadjileontiadis, L. J. (2012) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2012.2217495 · Cited by 260
Interdisciplinary Mathematical Sciences
(2012) · Interdisciplinary mathematical sciences · doi:10.1142/ims · Cited by 208
Feature extraction from EEGs associated with emotions
Musha, T., Terasaki, Y., Haque, H. A., & Ivamitsky, G. A. (1997) · Artificial Life and Robotics · doi:10.1007/bf02471106 · Cited by 160
Emotion Recognition Based on High-Resolution EEG Recordings and Reconstructed Brain Sources
Becker, H., Fleureau, J., Guillotel, P., Wendling, F., Merlet, I., & Albera, L. (2017) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2768030 · Cited by 136
Protein Secondary Structure Prediction with Long Short Term Memory NetworksPreprint
Sønderby, S. K., & Winther, O. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.7828 · Cited by 131
EEG-based vigilance estimation using extreme learning machines
Shi, L.-C., & Lu, B. (2012) · Neurocomputing · doi:10.1016/j.neucom.2012.02.041 · Cited by 123
Emotion Detection in the Loop from Brain Signals and Facial Images
Savran, A., Çiftçi, K., Chanel, G., Mota, J., Viet, L. H., Sankur, B., Akarun, L., Caplier, A., & Rombaut, M. (2006) · Archive ouverte UNIGE (University of Geneva) · Cited by 105
EEG Emotion Recognition Based on Graph Regularized Sparse Linear Regression
Li, Y., Zheng, W., Cui, Z., Zong, Y., & Ge, S. (2018) · Neural Processing Letters · doi:10.1007/s11063-018-9829-1 · Cited by 90
Self-citationThe Analysis of Emotion Recognition from GSR Based on PSO
Wu, G., Liu, G., & Hao, M. (2010) · Information Processing and Trusted Computing · doi:10.1109/iptc.2010.60 · Cited by 82
The Research on Emotion Recognition from ECG Signal
Cai, J., Liu, G., & Hao, M. (2009) · doi:10.1109/itcs.2009.108 · Cited by 82
Feature Selection Based Transfer Subspace Learning for Speech Emotion Recognition
Song, P., & Zheng, W. (2018) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2800046 · Cited by 78
Self-citationEstimation of task workload from EEG data: New and current tools and perspectives
Kothe, C. A., & Makeig, S. (2011) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/iembs.2011.6091615 · Cited by 67
Ben‐Ze’ev, A. (1987) · Philosophical Studies · doi:10.1007/bf00354055 · Cited by 51
Cited by
EEG Based Emotion Recognition: A Tutorial and Review
Li, X., Zhang, Y., Tiwari, P., Song, D., Hu, B., Yang, M., Zhao, Z., Kumar, N., & Marttinen, P. (2023) · ACM Computing Surveys · doi:10.1145/3524499 · Cited by 508
Khare, S. K., Blanes-Vidal, V., Nadimi, E. S., & Acharya, U. R. (2024) · Information Fusion · doi:10.1016/j.inffus.2023.102019 · Cited by 469
Clustering-Based Speech Emotion Recognition by Incorporating Learned Features and Deep BiLSTM
Mustaqeem, Sajjad, M., & Kwon, S. (2020) · IEEE Access · doi:10.1109/access.2020.2990405 · Cited by 402
A Novel Bi-Hemispheric Discrepancy Model for EEG Emotion Recognition
Li, Y., Wang, L., Zheng, W., Zong, Y., Qi, L., Cui, Z., Zhang, T., & Song, T. (2021) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2020.2999337 · Cited by 369
Self-citationGraph-Based Deep Learning for Medical Diagnosis and Analysis: Past, Present and Future
Ahmedt-Aristizabal, D., Armin, M. A., Denman, S., Fookes, C., & Petersson, L. (2021) · Sensors · doi:10.3390/s21144758 · Cited by 272
Metadata
- Authors
- Song, T., Zheng, W., Lu, C., Zong, Y., Zhang, X., & Cui, Z.
- Venue
- IEEE Access
- Published
- 2019
- Volume
- 7
- Pages
- 12177-12191
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W2911220936
- Cited by
- 336
- References
- 54
- FWCI
- 33.85
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.