The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Emotion recognition based on physiological changes in music listening
Open accessAbstract
Little attention has been paid so far to physiological signals for emotion recognition compared to audiovisual emotion channels such as facial expression or speech. This paper investigates the potential of physiological signals as reliable channels for emotion recognition. All essential stages of an automatic recognition system are discussed, from the recording of a physiological dataset to a feature-based multiclass classification. In order to collect a physiological dataset from multiple subjects over many weeks, we used a musical induction method which spontaneously leads subjects to real emotional states, without any deliberate lab setting. Four-channel biosensors were used to measure electromyogram, electrocardiogram, skin conductivity and respiration changes. A wide range of physiological features from various analysis domains, including time/frequency, entropy, geometric analysis, subband spectra, multiscale entropy, etc., is proposed in order to find the best emotion-relevant features and to correlate them with emotional states. The best features extracted are specified in detail and their effectiveness is proven by classification results. Classification of four musical emotions (positive/high arousal, negative/high arousal, negative/low arousal, positive/low arousal) is performed by using an extended linear discriminant analysis (pLDA). Furthermore, by exploiting a dichotomic property of the 2D emotion model, we develop a novel scheme of emotion-specific multilevel dichotomous classification (EMDC) and compare its performance with direct multiclass classification using the pLDA. Improved recognition accuracy of 95\% and 70\% for subject-dependent and subject-independent classification, respectively, is achieved by using the EMDC scheme.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
James, W. (1913) · Henry Holt and Company eBooks · doi:10.1037/11059-000 · Cited by 25,226
Physiological time-series analysis using approximate entropy and sample entropy
Richman, J. S., & Moorman, J. R. (2000) · American Journal of Physiology-Heart and Circulatory Physiology · doi:10.1152/ajpheart.2000.278.6.h2039 · Cited by 7,880
A Real-Time QRS Detection Algorithm
Pan, J., & Tompkins, W. J. (1985) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.1985.325532 · Cited by 7,855
Statistical pattern recognition: a review
Jain, A. K., Duin, P. W., & Mao, J. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.824819 · Cited by 6,767
Cognitive, social, and physiological determinants of emotional state.
Schachter, S., & Singer, J. (1962) · Psychological Review · doi:10.1037/h0046234 · Cited by 6,223
The principles of psychology, Vol I.
James, W. (1890) · doi:10.1037/10538-000 · Cited by 4,514
Combining Pattern Classifiers: Methods and Algorithms
Bagui, S. C. (2005) · Technometrics · doi:10.1198/tech.2005.s320 · Cited by 3,202
Combining Pattern Classifiers: Methods and Algorithms
Kuncheva, L. I. (2004) · Wiley eBooks · doi:10.1002/0471660264 · Cited by 3,005
The emotion probe: Studies of motivation and attention.
Lang, P. J. (1995) · American Psychologist · doi:10.1037//0003-066x.50.5.372 · Cited by 2,746
Emotion recognition in human-computer interaction
Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kollias, S., Fellenz, W., & Taylor, J. G. (2001) · IEEE Signal Processing Magazine · doi:10.1109/79.911197 · Cited by 2,603
Multiscale entropy analysis of biological signals
Costa, M., Goldberger, A. L., & Peng, C.-K. (2005) · Physical Review E · doi:10.1103/physreve.71.021906 · Cited by 2,482
Toward machine emotional intelligence: analysis of affective physiological state
Picard, R. W., Vyzas, E., & Healey, J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.954607 · Cited by 2,334
Emotion elicitation using films
Gross, J. J., & Levenson, R. W. (1995) · Cognition & Emotion · doi:10.1080/02699939508408966 · Cited by 2,179
Feature selection: evaluation, application, and small sample performance
Jain, A., & Zongker, D. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.574797 · Cited by 2,171
Meyer, L. B. (1961) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226521374.001.0001 · Cited by 1,957
The James-Lange Theory of Emotions: A Critical Examination and an Alternative Theory
Cannon, W. B. (1927) · The American Journal of Psychology · doi:10.2307/1415404 · Cited by 1,899
Tooby, J., & Cosmides, L. (1990) · Ethology and Sociobiology · doi:10.1016/0162-3095(90)90017-z · Cited by 1,787
Using discriminant eigenfeatures for image retrieval
Swets, D. L., & Weng, J. J. (1996) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.531802 · Cited by 1,620
Positive emotions speed recovery from the cardiovascular sequelae of negative emotions
L. Fredrickson, B., & Levenson, R. W. (1998) · Cognition and Emotion · doi:10.1080/026999398379718 · Cited by 1,592
The amygdala: Neurobiological aspects of emotion, memory, and mental dysfunction.
Aggleton, J. P. (1992) · Wiley-Liss eBooks · Cited by 1,536
Classification by pairwise coupling
Hastie, T., & Tibshirani, R. (1998) · The Annals of Statistics · doi:10.1214/aos/1028144844 · Cited by 1,299
The amygdala: Neurobiological aspects of emotion, memory and mental dysfunction
Scheel-Krüger, J. (1993) · Journal of Chemical Neuroanatomy · doi:10.1016/0891-0618(93)90037-5 · Cited by 1,267
Voluntary Facial Action Generates Emotion‐Specific Autonomic Nervous System Activity
Levenson, R. W., Ekman, P., & Friesen, W. V. (1990) · Psychophysiology · doi:10.1111/j.1469-8986.1990.tb02330.x · Cited by 1,248
Schlosberg, H. (1954) · Psychological Review · doi:10.1037/h0054570 · Cited by 1,057
Kraehenbuehl, D., & Meyer, L. B. (1957) · Journal of Music Theory · doi:10.2307/843099 · Cited by 1,026
An exploratory study of musical emotions and psychophysiology.
Krumhansl, C. L. (1997) · Canadian Journal of Experimental Psychology / Revue canadienne de psychologie expérimentale · doi:10.1037/1196-1961.51.4.336 · Cited by 1,017
The psychophysiology of emotion.
Larsen, J. T., Berntson, G. G., Poehlmann, K. M., Ito, T. A., & Cacioppo, J. T. (1993) · Cited by 956
Emotion recognition system using short-term monitoring of physiological signals
Kim, K. H., Bang, S. W., & Kim, S. R. (2004) · Medical & Biological Engineering & Computing · doi:10.1007/bf02344719 · Cited by 944
Emotion Elicitation Using Films
Rottenberg, J., Ray, R. D., & Gross, J. J. (2007) · Handbook of Emotion Elicitation and Assessment · doi:10.1093/oso/9780195169157.003.0002 · Cited by 838
Another approach to polychotomous classification
Friedman, J. H. (1996) · Medical Entomology and Zoology · Cited by 577
Emotion Recognition Using Bio-sensors: First Steps towards an Automatic System
Haag, A., Goronzy, S., Schaich, P., & Williams, J. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24842-2_4 · Cited by 451
Kamen, P. W., Krum, H., & Tonkin, A. M. (1996) · Clinical Science · doi:10.1042/cs0910201 · Cited by 424
Emotion and autonomic nervous system activity in the Minangkabau of West Sumatra.
Levenson, R. W., Ekman, P., Heider, K., & Friesen, W. V. (1992) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.62.6.972 · Cited by 391
Emotion recognition from physiological signals using wireless sensors for presence technologies
Nasoz, F., Alvarez, K., Lisetti, C. L., & Finkelstein, N. (2004) · Cognition, Technology & Work · doi:10.1007/s10111-003-0143-x · Cited by 367
StatLog: Comparison of classification algorithms on large real-world problems
KING, R. D., FENG, C., & SUTHERLAND, A. (1995) · Applied Artificial Intelligence · doi:10.1080/08839519508945477 · Cited by 320
Handbook of social psychophysiology
Van Toller, S. (1990) · Biological Psychology · doi:10.1016/0301-0511(90)90082-8 · Cited by 313
The argument and evidence about universals in facial expressions of emotion.
Ekman, P. (1989) · Cited by 312
Comparative study of techniques for large-scale feature selection
(1994) · Machine Intelligence and Pattern Recognition · doi:10.1016/b978-0-444-81892-8.50040-7 · Cited by 307
Perception of the Major/Minor Distinction: IV. Emotional Connotations in Young Children
Kastner, M. P., & Crowder, R. G. (1990) · Music Perception · doi:10.2307/40285496 · Cited by 272
Constraints for emotion specificity in fear and anger: The context counts
STEMMLER, G., HELDMANN, M., PAULS, C. A., & SCHERER, T. (2001) · Psychophysiology · doi:10.1017/s0048577201991668 · Cited by 260
Guzzetta, C. E. (1989) · PubMed · Cited by 238
Davis, W. B., & Thaut, M. H. (1989) · Journal of Music Therapy · doi:10.1093/jmt/26.4.168 · Cited by 196
The Autonomic Differentiation of Emotions Revisited: Convergent and Discriminant Validation
Stemmler, G. (1989) · Psychophysiology · doi:10.1111/j.1469-8986.1989.tb03163.x · Cited by 189
The Pattern of Sympathovagal Balance Explored in the Frequency Domain
Malliani, A. (1999) · Physiology · doi:10.1152/physiologyonline.1999.14.3.111 · Cited by 189
Emotion regulation in action: emotional reactivity in experiential avoidance
Sloan, D. M. (2004) · Behaviour Research and Therapy · doi:10.1016/j.brat.2003.08.006 · Cited by 182
On multiscale entropy analysis for physiological data
Thuraisingham, R. A., & Gottwald, G. A. (2006) · Physica A: Statistical Mechanics and its Applications · doi:10.1016/j.physa.2005.10.008 · Cited by 168
The Structure of emotion : psychophysiological, cognitive, and clinical aspects
Birbaumer, N., & Öhman, A. (1993) · Cited by 123
Digital processing of affective signals
Healey, J., & Picard, R. W. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1998.679699 · Cited by 122
Sound Sentiment: An Essay on the Musical Emotions
Davies, S., & Kivy, P. (1991) · Journal of Aesthetics and Art Criticism · doi:10.2307/431655 · Cited by 105
Consciousness and the galvanometer.
McCurdy, H. G. (1950) · Psychological Review · doi:10.1037/h0057490 · Cited by 54
Cited by
DEAP: A Database for Emotion Analysis ;Using Physiological Signals
Koelstra, S., Muhl, C., Soleymani, M., Lee, J.-S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., & Patras, I. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.15 · Cited by 5,093
A Multimodal Database for Affect Recognition and Implicit Tagging
Soleymani, M., Lichtenauer, J., Pun, T., & Pantic, M. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.25 · Cited by 1,664
EEG-Based Emotion Recognition in Music Listening
Lin, Y.-P., Wang, C.-H., Jung, T.-P., Wu, T.-L., Jeng, S.-K., Duann, J.-R., & Chen, J.-H. (2010) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2010.2048568 · Cited by 1,021
Identifying Stable Patterns over Time for Emotion Recognition from EEG
Zheng, W.-L., Zhu, J.-Y., & Lu, B.-L. (2019) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2712143 · Cited by 990
A review of emotion recognition using physiological signals
Shu, L., Xie, J., Yang, M., Li, Z., Li, Z., Liao, D., Xu, X., & Yang, X. (2018) · Sensors · doi:10.3390/s18072074 · Cited by 923
Metadata
- Authors
- Kim, J., & Andre, E.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2008-12
- Volume
- 30
- Issue
- 12
- Pages
- 2067-2083
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2164368909
- Cited by
- 1,082
- References
- 50
- FWCI
- 46.91
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.