The DOI matches its Crossref record; 80 of the 80 references it cites were found in a registry or an index.
Emotion Recognition from Physiological Signal Analysis: A Review
Open accessAbstract
Human computer interaction is increasingly utilized in smart home, industry 4.0 and personal health. Communication between human and computer can benefit by a flawless exchange of emotions. As emotions have substantial influence on cognitive processes of the human brain such as learning, memory, perception and problem solving, emotional interactions benefit different applications. It can further be relevant in modern health care especially in interaction with patients suffering from stress or depression. Additionally rehabilitation applications, guiding patients through their rehabilitation training while adapting to the patients emotional state, would be highly motivating and might lead to a faster recovery. Depending on the application area, different systems for emotion recognition suit different purposes. The aim of this work is to give an overview of methods to recognize emotions and to compare their applicability based on existing studies. This review paper should enable practitioners, researchers and engineers to find a system most suitable for certain applications. An entirely contact-less method is to analyze facial features with the help of a video camera. This is useful when computers, smart-phones or tablets with integrated cameras are included in the task. Smart wearables provide contact with the skin and physiological parameters such as electro-dermal activity and heart related signals can be recorded unobtrusively also during dynamical tasks. Next to unimodal solutions, multimodal affective computing systems are analyzed since they promise higher classification accuracy. Accuracy varies based on the amount of detected emotions, extracted features, classification method and the quality of the database. Electroencephalography achieves 88.86 % accuracy for four emotions, multimodal measurements (Electrocardiography, Electromyography and bio-signals) 79.3 % for four emotive states, facial recognition 89 % for seven states and speech recognition 80.46 % for happiness and sadness. Looking forward, heart-related parameters might be an option to measure emotions accurately and unobtrusive with the help of smart wearables. This can be used in dynamic or outdoor tasks. Facial recognition on the other hand is a useful contact-less tool when it comes to emotion recognition during computer interaction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ANFIS: adaptive-network-based fuzzy inference system
Jang, J.-S. R. (1993) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/21.256541 · Cited by 16,254
The expression of the emotions in man and animals.
Darwin, C. (1872) · J. Murray eBooks · doi:10.1037/10001-000 · Cited by 11,657
Measuring emotion: The self-assessment manikin and the semantic differential
Bradley, M. M., & Lang, P. J. (1994) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(94)90063-9 · Cited by 9,538
Constants across cultures in the face and emotion.
Ekman, P., & Friesen, W. V. (1971) · Journal of Personality and Social Psychology · doi:10.1037/h0030377 · Cited by 5,509
(2005) · CTIT technical reports series · Cited by 5,307
(1997) · Choice Reviews Online · doi:10.5860/choice.34-3702 · Cited by 4,887
Ekman, P., & Friesen, W. V. (1975) · Cited by 4,604
JAMES, W. (1884) · Mind · doi:10.1093/mind/os-ix.34.188 · Cited by 3,446
Emotion recognition in human-computer interaction
Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kollias, S., Fellenz, W., & Taylor, J. G. (2001) · IEEE Signal Processing Magazine · doi:10.1109/79.911197 · Cited by 2,603
POSNER, J., RUSSELL, J. A., & PETERSON, B. S. (2005) · Development and Psychopathology · doi:10.1017/s0954579405050340 · Cited by 2,602
Cited by
A systematic review on affective computing: emotion models, databases, and recent advances
Wang, Y., Song, W., Tao, W., Liotta, A., Yang, D., Li, X., Gao, S., Sun, Y., Ge, W., Zhang, W., et al. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.03.009 · Cited by 615
The Importance of Respiratory Rate Monitoring: From Healthcare to Sport and Exercise
Nicolò, A., Massaroni, C., Schena, E., & Sacchetti, M. (2020) · Sensors · doi:10.3390/s20216396 · Cited by 440
ECG Monitoring Systems: Review, Architecture, Processes, and Key Challenges
Serhani, M. A., T. El Kassabi, H., Ismail, H., & Nujum Navaz, A. (2020) · Sensors · doi:10.3390/s20061796 · Cited by 357
Emotion recognition in EEG signals using deep learning methods: A review
Jafari, M., Shoeibi, A., Khodatars, M., Bagherzadeh, S., Shalbaf, A., García, D. L., Gorriz, J. M., & Acharya, U. R. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107450 · Cited by 240
Molenaar, I., Mooij, S. D., Azevedo, R., Bannert, M., Järvelä, S., & Gašević, D. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107540 · Cited by 217
Pan, B., Hirota, K., Jia, Z., & Dai, Y. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126866 · Cited by 142
Do Deepfakes Feel Emotions? A Semantic Approach to Detecting Deepfakes Via Emotional Inconsistencies
Hosler, B., Salvi, D., Murray, A., Antonacci, F., Bestagini, P., Tubaro, S., & Stamm, M. C. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00112 · Cited by 78
“Previous works identify a subject’s emotion by using their expression, which is measured by the location, distance, and motion of specific keypoints on the subject’s face [43, 20].”
BackgroundSaffaryazdi, N., Wasim, S. T., Dileep, K., Nia, A. F., Nanayakkara, S., Broadbent, E., & Billinghurst, M. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.864047 · Cited by 69
Younis, H. A., Ruhaiyem, N. I. R., Badr, A. A., Abdul-Hassan, A. K., Alfadli, I. M., Binjumah, W. M., Altuwaijri, E. A., & Nasser, M. (2023) · Processes · doi:10.3390/pr11051488 · Cited by 21
Human Digital Twin-based interactive dashboards for informal caregivers of stroke patients
Lauer-Schmaltz, M. W., Kerim, I., Hansen, J. P., Gulyás, G. M., & Andersen, H. B. (2023) · Proceedings of the 16th International Conference on PErvasive Technologies Related to Assistive Environments · doi:10.1145/3594806.3594824 · Cited by 18
“For instance, inertial measurement units (IMUs) can track the patient’s movements [19], whereas Surface Electromyography (sEMG) sensors can provide information about the patient’s muscular fatigue when attached to the upper-limb [23] or detect the patient’s emotions when attached to the corresponding facial areas [4].”
Background
Metadata
- Authors
- Egger, M., Ley, M., & Hanke, S.
- Venue
- Electronic Notes in Theoretical Computer Science
- Publisher
- Elsevier BV
- Published
- 2019-05
- Volume
- 343
- Pages
- 35-55
- ISSN
- 1571-0661 (ISSN-L)
- OpenAlex
- W2946526173
- Cited by
- 561
- References
- 80
- FWCI
- 50.36
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.