The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Emotion recognition based on physiological changes in music listening
Open accessAbstract
Little attention has been paid so far to physiological signals for emotion recognition compared to audiovisual emotion channels such as facial expression or speech. This paper investigates the potential of physiological signals as reliable channels for emotion recognition. All essential stages of an automatic recognition system are discussed, from the recording of a physiological dataset to a feature-based multiclass classification. In order to collect a physiological dataset from multiple subjects over many weeks, we used a musical induction method which spontaneously leads subjects to real emotional states, without any deliberate lab setting. Four-channel biosensors were used to measure electromyogram, electrocardiogram, skin conductivity and respiration changes. A wide range of physiological features from various analysis domains, including time/frequency, entropy, geometric analysis, subband spectra, multiscale entropy, etc., is proposed in order to find the best emotion-relevant features and to correlate them with emotional states. The best features extracted are specified in detail and their effectiveness is proven by classification results. Classification of four musical emotions (positive/high arousal, negative/high arousal, negative/low arousal, positive/low arousal) is performed by using an extended linear discriminant analysis (pLDA). Furthermore, by exploiting a dichotomic property of the 2D emotion model, we develop a novel scheme of emotion-specific multilevel dichotomous classification (EMDC) and compare its performance with direct multiclass classification using the pLDA. Improved recognition accuracy of 95\% and 70\% for subject-dependent and subject-independent classification, respectively, is achieved by using the EMDC scheme.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
James, W. (1913) · Henry Holt and Company eBooks · doi:10.1037/11059-000 · Cited by 25,226
Physiological time-series analysis using approximate entropy and sample entropy
Richman, J. S., & Moorman, J. R. (2000) · American Journal of Physiology-Heart and Circulatory Physiology · doi:10.1152/ajpheart.2000.278.6.h2039 · Cited by 7,880
A Real-Time QRS Detection Algorithm
Pan, J., & Tompkins, W. J. (1985) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.1985.325532 · Cited by 7,855
Statistical pattern recognition: a review
Jain, A. K., Duin, P. W., & Mao, J. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.824819 · Cited by 6,767
Cognitive, social, and physiological determinants of emotional state.
Schachter, S., & Singer, J. (1962) · Psychological Review · doi:10.1037/h0046234 · Cited by 6,223
The principles of psychology, Vol I.
James, W. (1890) · doi:10.1037/10538-000 · Cited by 4,514
Combining Pattern Classifiers: Methods and Algorithms
Bagui, S. C. (2005) · Technometrics · doi:10.1198/tech.2005.s320 · Cited by 3,202
Combining Pattern Classifiers: Methods and Algorithms
Kuncheva, L. I. (2004) · Wiley eBooks · doi:10.1002/0471660264 · Cited by 3,005
The emotion probe: Studies of motivation and attention.
Lang, P. J. (1995) · American Psychologist · doi:10.1037//0003-066x.50.5.372 · Cited by 2,746
Emotion recognition in human-computer interaction
Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kollias, S., Fellenz, W., & Taylor, J. G. (2001) · IEEE Signal Processing Magazine · doi:10.1109/79.911197 · Cited by 2,603
Cited by
DEAP: A Database for Emotion Analysis ;Using Physiological Signals
Koelstra, S., Muhl, C., Soleymani, M., Lee, J.-S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., & Patras, I. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.15 · Cited by 5,093
A Multimodal Database for Affect Recognition and Implicit Tagging
Soleymani, M., Lichtenauer, J., Pun, T., & Pantic, M. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.25 · Cited by 1,664
EEG-Based Emotion Recognition in Music Listening
Lin, Y.-P., Wang, C.-H., Jung, T.-P., Wu, T.-L., Jeng, S.-K., Duann, J.-R., & Chen, J.-H. (2010) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2010.2048568 · Cited by 1,021
Identifying Stable Patterns over Time for Emotion Recognition from EEG
Zheng, W.-L., Zhu, J.-Y., & Lu, B.-L. (2019) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2712143 · Cited by 990
A review of emotion recognition using physiological signals
Shu, L., Xie, J., Yang, M., Li, Z., Li, Z., Liao, D., Xu, X., & Yang, X. (2018) · Sensors · doi:10.3390/s18072074 · Cited by 923
Emotion recognition using multi-modal data and machine learning techniques: A tutorial and review
Zhang, J., Yin, Z., Chen, P., & Nichele, S. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.01.011 · Cited by 806
Multimodal Emotion Recognition in Response to Videos
Soleymani, M., Pantic, M., & Pun, T. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.37 · Cited by 722
Emotion Recognition from Physiological Signal Analysis: A Review
Egger, M., Ley, M., & Hanke, S. (2019) · Electronic Notes in Theoretical Computer Science · doi:10.1016/j.entcs.2019.04.009 · Cited by 561
EEG Based Emotion Recognition: A Tutorial and Review
Li, X., Zhang, Y., Tiwari, P., Song, D., Hu, B., Yang, M., Zhao, Z., Kumar, N., & Marttinen, P. (2023) · ACM Computing Surveys · doi:10.1145/3524499 · Cited by 508
Ecg pattern analysis for emotion detection
Agrafioti, F., Hatzinakos, D., & Anderson, A. K. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.28 · Cited by 476
Emotion recognition using wireless signals
Zhao, M., Adib, F., & Katabi, D. (2016) · Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking · doi:10.1145/2973750.2973762 · Cited by 461
Liu, W., Qiu, J.-L., Zheng, W.-L., & Lu, B.-L. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2021.3071170 · Cited by 452
Recognition of emotions using multimodal physiological signals and an ensemble deep learning model
Yin, Z., Zhao, M., Wang, Y., Yang, J., & Zhang, J. (2017) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2016.12.005 · Cited by 416
Gunes, H., & Schuller, B. (2013) · Image and Vision Computing · doi:10.1016/j.imavis.2012.06.016 · Cited by 360
Verma, G. K., & Tiwary, U. S. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.11.007 · Cited by 354
MPED: A Multi-Modal Physiological Emotion Database for Discrete Emotion Recognition
Song, T., Zheng, W., Lu, C., Zong, Y., Zhang, X., & Cui, Z. (2019) · IEEE Access · doi:10.1109/access.2019.2891579 · Cited by 336
Bota, P. J., Wang, C., Fred, A. L. N., & Placido Da Silva, H. (2019) · IEEE Access · doi:10.1109/access.2019.2944001 · Cited by 322
Walter, S., Gruss, S., Ehleiter, H., Tan, J., Traue, H. C., Crawcour, S., Werner, P., Al-Hamadi, A., & Andrade, A. O. (2013) · 2013 IEEE International Conference on Cybernetics (CYBCO) · doi:10.1109/cybconf.2013.6617456 · Cited by 278
Feature Extraction and Selection for Emotion Recognition from Electrodermal Activity
Shukla, J., Barreda-Angeles, M., Oliver, J., Nandi, G. C., & Puig, D. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2019.2901673 · Cited by 253
Sewa db: A rich database for audio-visual emotion and sentiment research in the wild
Kossaifi, J., Walecki, R., Panagakis, Y., Shen, J., Schmitt, M., Ringeval, F., Han, J., Pandit, V., Toisoul, A., Schuller, B., et al. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2944808 · Cited by 243
Development and Evaluation of an Ambulatory Stress Monitor Based on Wearable Sensors
Choi, J., Ahmed, B., & Gutierrez-Osuna, R. (2012) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2011.2169804 · Cited by 221
Yin, Z., Wang, Y., Liu, L., Zhang, W., & Zhang, J. (2017) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2017.00019 · Cited by 155
The effects of autism and alexithymia on physiological and verbal responsiveness to music
Allen, R., Davis, R., & Hill, E. (2013) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-012-1587-8 · Cited by 132
Kanjo, E., Younis, E. M. G., & Sherkat, N. (2018) · Information Fusion · doi:10.1016/j.inffus.2017.05.005 · Cited by 118
Taran, S., & Bajaj, V. (2019) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2019.03.015 · Cited by 110
Khezri, M., Firoozabadi, M., & Sharafat, A. R. (2015) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2015.07.006 · Cited by 89
Emotion Recognition Based on Weighted Fusion Strategy of Multichannel Physiological Signals
Wei, W., Jia, Q., Feng, Y., & Chen, G. (2018) · Computational Intelligence and Neuroscience · doi:10.1155/2018/5296523 · Cited by 82
Kukolja, D., Popović, S., Horvat, M., Kovač, B., & Ćosić, K. (2014) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2014.05.006 · Cited by 66
Speech Emotion Recognition via an Attentive Time–Frequency Neural Network
Lu, C., Zheng, W., Lian, H., Zong, Y., Tang, C., Li, S., & Zhao, Y. (2023) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2022.3219825 · Cited by 51
“For this purpose, high-arousal and positive-valence emotions, e.g., happy , cheerful , and low-arousal and negative-valence emotions, e.g., sad , tired , are selected as comparison for attention visualization [37], [38].”
Goshvarpour, A., Abbasi, A., & Goshvarpour, A. (2017) · Australasian Physical & Engineering Sciences in Medicine · doi:10.1007/s13246-017-0571-1 · Cited by 46
Abadi, M. K., Correa, J. A. M., Wache, J., Yang, H., Patras, I., & Sebe, N. (2015) · 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2015.7163100 · Cited by 36
Li, F., Yang, L., Shi, H., & Liu, C. (2017) · Artery Research · doi:10.1016/j.artres.2017.02.003 · Cited by 38
On the Generality of Codebook Approach for Sensor-Based Human Activity Recognition
Shirahama, K., & Grzegorzek, M. (2017) · Electronics · doi:10.3390/electronics6020044 · Cited by 29
Khalaf, A., Nabian, M., Fan, M., Yin, Y., Wormwood, J., Siegel, E., Quigley, K. S., Barrett, L. F., Akcakaya, M., Chou, C.-A., et al. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.112890 · Cited by 25
Interactive emotional content communications system using portable wireless biofeedback device
Kim, D., Kim, J., Lee, E., Whang, M., & Cho, Y. (2011) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2011.6131173 · Cited by 22
Self-citationModeling User’s Social Attitude in a Conversational System
Baur, T., Schiller, D., & André, E. (2016) · Human–Computer Interaction Series · doi:10.1007/978-3-319-31413-6_10 · Cited by 5
Toward augmented familiarity of the audience with digital musical instruments
Capra, O., Berthaut, F., & Grisoni, L. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01692-0_37 · Cited by 4
Metadata
- Authors
- Kim, J., & Andre, E.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2008-12
- Volume
- 30
- Issue
- 12
- Pages
- 2067-2083
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2164368909
- Cited by
- 1,082
- References
- 50
- FWCI
- 46.91
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.