From Physiological Signals to Emotions: Implementing and Comparing Selected Methods for Feature Extraction and Classification
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Little attention has been paid so far to physiological signals for emotion recognition compared to audio-visual emotion channels, such as facial expressions or speech. In this paper, we discuss the most important stages of a fully implemented emotion recognition system including data analysis and classification. For collecting physiological signals in different affective states, we used a music induction method which elicits natural emotional reactions from the subject. Four-channel biosensors are used to obtain electromyogram, electrocardiogram, skin conductivity and respiration changes. After calculating a sufficient amount of features from the raw signals, several feature selection/reduction methods are tested to extract a new feature set consisting of the most significant features for improving classification performance. Three well-known classifiers, linear discriminant function, k-nearest neighbour and multilayer perceptron, are then used to perform supervised classification
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An argument for basic emotions
Ekman, P. (1992) · Cognition and Emotion · doi:10.1080/02699939208411068 · Cited by 9,646
The emotion probe: Studies of motivation and attention.
Lang, P. J. (1995) · American Psychologist · doi:10.1037//0003-066x.50.5.372 · Cited by 2,746
Emotion recognition in human-computer interaction
Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kollias, S., Fellenz, W., & Taylor, J. G. (2001) · IEEE Signal Processing Magazine · doi:10.1109/79.911197 · Cited by 2,603
Toward machine emotional intelligence: analysis of affective physiological state
Picard, R. W., Vyzas, E., & Healey, J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.954607 · Cited by 2,334 · cited 1×
“Although many efforts have been taken recently to recognize emotions using facial expressions, speech and physiological signals [1, 2, 3, 4, 5], current recognition systems are not yet advanced enough to be used in realistic applications.”
BackgroundEmotion Recognition Using Bio-sensors: First Steps towards an Automatic System
Haag, A., Goronzy, S., Schaich, P., & Williams, J. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24842-2_4 · Cited by 451 · cited 3×
“Although many efforts have been taken recently to recognize emotions using facial expressions, speech and physiological signals [1, 2, 3, 4 , 5], current recognition systems are not yet advanced enough to be used in realistic applications.”
BackgroundMethodResultInfluentialEmotion recognition from physiological signals using wireless sensors for presence technologies
Nasoz, F., Alvarez, K., Lisetti, C. L., & Finkelstein, N. (2004) · Cognition, Technology & Work · doi:10.1007/s10111-003-0143-x · Cited by 367
Sentics: The touch of emotions
Clynes, M. (1977) · Medical Entomology and Zoology · Cited by 339
Wearable and automotive systems for affect recognition from physiology
Healey, J., & Picard, R. W. (2000) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 301
A Cultural-Psychological Analysis of Emotions
Ratner, C. (2000) · Culture & Psychology · doi:10.1177/1354067x0061001 · Cited by 196
Cited by
Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications
Calvo, R. A., & D'Mello, S. (2010) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2010.1 · Cited by 1,893
Katsigiannis, S., & Ramzan, N. (2018) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2017.2688239 · Cited by 1,135
“signals as baseline signals have been proven to allow the removal of daily dependencies when recording physiological data [12], [26].”
BackgroundEmotional speech recognition: Resources, features, and methods
Ververidis, D., & Kotropoulos, C. (2006) · Speech Communication · doi:10.1016/j.specom.2006.04.003 · Cited by 925
Emotion recognition using multi-modal data and machine learning techniques: A tutorial and review
Zhang, J., Yin, Z., Chen, P., & Nichele, S. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.01.011 · Cited by 806
Schuller, B., Batliner, A., Steidl, S., & Seppi, D. (2011) · Speech Communication · doi:10.1016/j.specom.2011.01.011 · Cited by 758
Emotional state classification from EEG data using machine learning approach
Wang, X.-W., Nie, D., & Lu, B.-L. (2014) · Neurocomputing · doi:10.1016/j.neucom.2013.06.046 · Cited by 755
“…EEGデータセットの実験結果から,我々はパ ワースペクトルの特徴は他の 2種類より優れていることを示す.また,線形動的システムに基づく特徴平滑化方 法は感情分類精度を大きく向上させることを示し,感情変化の軌跡はマニホールド学習の学習対象に依存しない 特徴量を低下させることで,可視化を可能とした. 5 キーワード Emotion classification, Electroencephalograph, Brain?computer interface, Feature reduction, Support vector machine, Manifold learning 6 参考文献”
Human Emotion Recognition: Review of Sensors and Methods
Dzedzickis, A., Kaklauskas, A., & Bucinskas, V. (2020) · Sensors · doi:10.3390/s20030592 · Cited by 582
Nicolaou, M. A., Gunes, H., & Pantic, M. (2011) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.9 · Cited by 450
“For instance, Wagner et al. [62] analyzes four emotions, each belonging to one quadrant of the V-A emotion space: high arousal positive valence (joy), high arousal negative valence (anger), low arousal positive valence (relief), and low arousal negative valence (sadness).”
BackgroundFeatures and classifiers for emotion recognition from speech: a survey from 2000 to 2011
Anagnostopoulos, C.-N., Iliou, T., & Giannoukos, I. (2015) · Artificial Intelligence Review · doi:10.1007/s10462-012-9368-5 · Cited by 428
“15 %, 6 emotions (unknown dataset) Wang et al. (2008) ∼63 % in a corpus that includes deceptive and non-deceptive speech Graciarena et al.”
BackgroundMethodAutomatic, Dimensional and Continuous Emotion Recognition
Gunes, H., & Pantic, M. (2010) · International Journal of Synthetic Emotions · doi:10.4018/jse.2010101605 · Cited by 426
Short-term emotion assessment in a recall paradigm
Chanel, G., Kierkels, J. J. M., Soleymani, M., & Pun, T. (2009) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2009.03.005 · Cited by 367
Bota, P. J., Wang, C., Fred, A. L. N., & Placido Da Silva, H. (2019) · IEEE Access · doi:10.1109/access.2019.2944001 · Cited by 322
Learning deep physiological models of affect
Martinez, H. P., Bengio, Y., & Yannakakis, G. N. (2013) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2013.2247823 · Cited by 287
EEG-based emotion recognition using simple recurrent units network and ensemble learning
Wei, C., Chen, L.-L., Song, Z.-Z., Lou, X.-G., & Li, D.-D. (2020) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2019.101756 · Cited by 192
(2015) · doi:10.5555/2818754.2818838 · Cited by 111
Emotion Recognition through Physiological Signals for Human-Machine Communication
Maaoui, C., & Pruski, A. (2010) · Cutting Edge Robotics 2010 · doi:10.5772/10312 · Cited by 109
Kätsyri, J., Kinnunen, T., Kusumoto, K., Oittinen, P., & Ravaja, N. (2016) · PLOS ONE · doi:10.1371/journal.pone.0153712 · Cited by 67
“R-peaks were detected from ECG signal using AuBT toolbox [45].”
MethodMonitoring the impact of stress on the sleep patterns of pilgrims using wearable sensors
Muaremi, A., Bexheti, A., Gravenhorst, F., Arnrich, B., & Troster, G. (2014) · IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI) · doi:10.1109/bhi.2014.6864335 · Cited by 60
Human-Centered Adaptive Assistance Systems for the Shop Floor
Oestreich, H., Heinz-Jakobs, M., Sehr, P., & Wrede, S. (2023) · Human-Technology Interaction · doi:10.1007/978-3-030-99235-4_4 · Cited by 12
Metadata
- Authors
- Wagner, J., Kim, J., & Andre, E.
- Venue
- 2005 IEEE International Conference on Multimedia and Expo
- Publisher
- IEEE
- Published
- 2005-10-24
- Pages
- 940-943
- OpenAlex
- W2153771043
- Cited by
- 511
- References
- 9
- FWCI
- 18.46
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.