The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Electrocardiogram-Based Emotion Recognition Systems and Their Applications in Healthcare—A Review
Open accessAbstract
Affective computing is a field of study that integrates human affects and emotions with artificial intelligence into systems or devices. A system or device with affective computing is beneficial for the mental health and wellbeing of individuals that are stressed, anguished, or depressed. Emotion recognition systems are an important technology that enables affective computing. Currently, there are a lot of ways to build an emotion recognition system using various techniques and algorithms. This review paper focuses on emotion recognition research that adopted electrocardiograms (ECGs) as a unimodal approach as well as part of a multimodal approach for emotion recognition systems. Critical observations of data collection, pre-processing, feature extraction, feature selection and dimensionality reduction, classification, and validation are conducted. This paper also highlights the architectures with accuracy of above 90%. The available ECG-inclusive affective databases are also reviewed, and a popularity analysis is presented. Additionally, the benefit of emotion recognition systems towards healthcare systems is also reviewed here. Based on the literature reviewed, a thorough discussion on the subject matter and future works is suggested and concluded. The findings presented here are beneficial for prospective researchers to look into the summary of previous works conducted in the field of ECG-based emotion recognition systems, and for identifying gaps in the area, as well as in developing and designing future applications of emotion recognition systems, especially in improving healthcare.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Russell, J. A. (1980) · Journal of Personality and Social Psychology · doi:10.1037/h0077714 · Cited by 16,334 · cited 1×
“The ADM was developed by Russell [43] and has been adopted widely by researchers from different backgrounds.”
MethodHeart rate variability: Standards of measurement, physiological interpretation, and clinical use
Malik, M., Bigger, J. T., Camm, A. J., Kleiger, R. E., Malliani, A., Moss, A. J., & Schwartz, P. J. (1996) · European Heart Journal · doi:10.1093/oxfordjournals.eurheartj.a014868 · Cited by 15,289
An argument for basic emotions
Ekman, P. (1992) · Cognition and Emotion · doi:10.1080/02699939208411068 · Cited by 9,646 · cited 1×
“This emotional model is standardized and shared across lan ‐ guages and cultures [32].”
BackgroundMeasuring emotion: The self-assessment manikin and the semantic differential
Bradley, M. M., & Lang, P. J. (1994) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(94)90063-9 · Cited by 9,538 · cited 1×
“In this way, the subject personally labels their emotions on a Self ‐ Assessment Man ‐ ikin (SAM) [65].”
BackgroundA Real-Time QRS Detection Algorithm
Pan, J., & Tompkins, W. J. (1985) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.1985.325532 · Cited by 7,855 · cited 1×
“The Pan–Tompkins QRS detection algorithm [81] is considered as the most common technique to find the R peak location [58,67,69].”
MethodPicard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
An overview of heart rate variability metrics and norms
Shaffer, F., & Ginsberg, J. P. (2017) · Frontiers in Public Health · doi:10.3389/fpubh.2017.00258 · Cited by 7,185
DEAP: A Database for Emotion Analysis ;Using Physiological Signals
Koelstra, S., Muhl, C., Soleymani, M., Lee, J.-S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., & Patras, I. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.15 · Cited by 5,093
Detecting Stress During Real-World Driving Tasks Using Physiological Sensors
Healey, J. A., & Picard, R. W. (2005) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2005.848368 · Cited by 2,207
Ekman, P. (1999) · Handbook of Cognition and Emotion · doi:10.1002/0470013494.ch3 · Cited by 2,125
A Multimodal Database for Affect Recognition and Implicit Tagging
Soleymani, M., Lichtenauer, J., Pun, T., & Pantic, M. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.25 · Cited by 1,664
Umetani, K., Singer, D. H., McCraty, R., & Atkinson, M. (1998) · Journal of the American College of Cardiology · doi:10.1016/s0735-1097(97)00554-8 · Cited by 1,145
Katsigiannis, S., & Ramzan, N. (2018) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2017.2688239 · Cited by 1,135
Basic Emotions, Natural Kinds, Emotion Schemas, and a New Paradigm
Izard, C. E. (2007) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2007.00044.x · Cited by 1,110
Analysis of emotion recognition using facial expressions, speech and multimodal information
Busso, C., Deng, Z., Yildirim, S., Bulut, M., Lee, C. M., Kazemzadeh, A., Lee, S., Neumann, U., & Narayanan, S. (2004) · Proceedings of the 6th international conference on Multimodal interfaces · doi:10.1145/1027933.1027968 · Cited by 840
The Effects of Psychological Stress on Depression
Yang, L., Zhao, Y., Wang, Y., Liu, L., Zhang, X., Li, B., & Cui, R. (2015) · Current Neuropharmacology · doi:10.2174/1570159x1304150831150507 · Cited by 589
Ecg pattern analysis for emotion detection
Agrafioti, F., Hatzinakos, D., & Anderson, A. K. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.28 · Cited by 476
Emotion Recognition Using Bio-sensors: First Steps towards an Automatic System
Haag, A., Goronzy, S., Schaich, P., & Williams, J. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24842-2_4 · Cited by 451
A wireless wearable ECG sensor for long-term applications
Nemati, E., Deen, M., & Mondal, T. (2012) · IEEE Communications Magazine · doi:10.1109/mcom.2012.6122530 · Cited by 418
Ultra short term analysis of heart rate variability for monitoring mental stress in mobile settings.
Salahuddin, L., Cho, J., Jeong, M. G., & Kim, D. (2007) · 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society · doi:10.1109/iembs.2007.4353378 · Cited by 374 · cited 1×
“This feature is represented in the unit of milliseconds (ms) for a standard short-term recording of 5 min [93], and 60 to 240 s for ultra-short term recordings [94,95].”
BackgroundSantamaria-Granados, L., Munoz-Organero, M., Ramirez-Gonzalez, G., Abdulhay, E., & Arunkumar, N. (2019) · IEEE Access · doi:10.1109/access.2018.2883213 · Cited by 289 · cited 2×
“[113] AMIGOS ECG, GSR Pan–Tompkins QRS detection.”
MethodOn the importance of both dimensional and discrete models of emotion
Harmon-Jones, E., Harmon-Jones, C., & Summerell, E. (2017) · Behavioral Sciences · doi:10.3390/bs7040066 · Cited by 201
Emotion Recognition Based on Weighted Fusion Strategy of Multichannel Physiological Signals
Wei, W., Jia, Q., Feng, Y., & Chen, G. (2018) · Computational Intelligence and Neuroscience · doi:10.1155/2018/5296523 · Cited by 82
Kukolja, D., Popović, S., Horvat, M., Kovač, B., & Ćosić, K. (2014) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2014.05.006 · Cited by 66 · cited 2×
“Other common techniques are sequential forward selection (SFS) and sequential backward selection (SBS), which have been applied in [86,87,110].”
Method
Cited by
Khare, S. K., Blanes-Vidal, V., Nadimi, E. S., & Acharya, U. R. (2024) · Information Fusion · doi:10.1016/j.inffus.2023.102019 · Cited by 469
Multimodal emotion recognition: A comprehensive review, trends, and challenges
Ramaswamy, M. P. A., & Palaniswamy, S. (2024) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1563 · Cited by 70
Thota, A., Sri, N. D., Dinesh, K., & Prasannatha, A. (2026) · 2026 9th International Conference on Trends in Electronics and Informatics (ICOEI) · doi:10.1109/icoei68323.2026.11542103
Metadata
- Authors
- Hasnul, M. A., Aziz, N. A. A., Alelyani, S., Mohana, M., & Aziz, A. A.
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2021-07-23
- Volume
- 21
- Issue
- 15
- Pages
- 5015
- ISSN
- 1424-8220 (ISSN-L)
- OpenAlex
- W3184236853
- Cited by
- 212
- References
- 24
- FWCI
- 30.42
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.