The DOI matches its Crossref record; 182 of the 182 references it cites were found in a registry or an index.
A Review, Current Challenges, and Future Possibilities on Emotion Recognition Using Machine Learning and Physiological Signals
Open accessAbstract
The seminal work on Affective Computing in 1995 by Picard set the base for computing that relates to, arises from, or influences emotions. Affective computing is a multidisciplinary field of research spanning the areas of computer science, psychology, and cognitive science. Potential applications include automated driver assistance, healthcare, human-computer interaction, entertainment, marketing, teaching and many others. Thus, quickly, the field acquired high interest, with an enormous growth of the number of papers published on the topic since its inception. This paper aims to (1) Present an introduction to the field of affective computing though the description of key theoretical concepts; (2) Describe the current state-of-the-art of emotion recognition, tracing the developments that helped foster the growth of the field; and lastly, (3) point the literature take-home messages and conclusions, evidencing the main challenges and future opportunities that lie ahead, in particular for the development of novel machine learning (ML) algorithms in the context of emotion recognition using physiological signals.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
The Pittsburgh Sleep Quality Index: a new instrument for psychiatric practice and research
Buysse, D. J., Reynolds, C. F., Monk, T. H., Berman, S. R., & Kupfer, D. J. (1989) · Psychiatry Research · doi:10.1016/0165-1781(89)90047-4 · Cited by 35,234
A Global Measure of Perceived Stress
Cohen, S., Kamarck, T., & Mermelstein, R. (1983) · Journal of Health and Social Behavior · doi:10.2307/2136404 · Cited by 32,807
Development and validation of brief measures of positive and negative affect: The PANAS scales.
Watson, D., Clark, L. A., & Tellegen, A. (1988) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.54.6.1063 · Cited by 32,433
Heart rate variability: Standards of measurement, physiological interpretation, and clinical use
Malik, M., Bigger, J. T., Camm, A. J., Kleiger, R. E., Malliani, A., Moss, A. J., & Schwartz, P. J. (1996) · European Heart Journal · doi:10.1093/oxfordjournals.eurheartj.a014868 · Cited by 15,289
(1994) · DigitalGeorgetown (Georgetown University Library) · Cited by 10,542
An argument for basic emotions
Ekman, P. (1992) · Cognition and Emotion · doi:10.1080/02699939208411068 · Cited by 9,646 · cited 1×
“Ekman [7] continued his work and argued that emotions are shared between cultures, thus, able to be universally recognised.”
BackgroundMeasuring emotion: The self-assessment manikin and the semantic differential
Bradley, M. M., & Lang, P. J. (1994) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(94)90063-9 · Cited by 9,538
A Real-Time QRS Detection Algorithm
Pan, J., & Tompkins, W. J. (1985) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.1985.325532 · Cited by 7,855
Picard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
Kirschbaum, C., Pirke, K.-M., & Hellhammer, D. H. (2008) · Neuropsychobiology · doi:10.1159/000119004 · Cited by 6,093
Supervised Machine Learning: A Review of Classification Techniques
Kotsiantis, S. B. (2007) · Informatica · Cited by 6,008
UCLA loneliness scale (version 3): reliability, validity, and factor structure
Russell, D. W. (1996) · Journal of Personality Assessment · doi:10.1207/s15327752jpa6601_2 · Cited by 5,800
(2005) · CTIT technical reports series · Cited by 5,307
DEAP: A Database for Emotion Analysis ;Using Physiological Signals
Koelstra, S., Muhl, C., Soleymani, M., Lee, J.-S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., & Patras, I. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.15 · Cited by 5,093
New well-being measures: Short scales to assess flourishing and positive and negative feelings
Diener, E., Wirtz, D., Tov, W., Kim-Prieto, C., Choi, D.-W., Oishi, S., & Biswas-Diener, R. (2010) · Social Indicators Research · doi:10.1007/s11205-009-9493-y · Cited by 4,980
Semi-Supervised Learning Literature Survey
Zhu, X. (2005) · Minds at UW (University of Wisconsin) · Cited by 3,844
Looking at pictures: Affective, facial, visceral, and behavioral reactions
LANG, P. J., GREENWALD, M. K., BRADLEY, M. M., & HAMM, A. O. (1993) · Psychophysiology · doi:10.1111/j.1469-8986.1993.tb03352.x · Cited by 3,190
Autonomic nervous system activity in emotion: a review
Kreibig, S. D. (2010) · Biological Psychology · doi:10.1016/j.biopsycho.2010.03.010 · Cited by 3,188 · cited 1×
“According to [113], emotional physiological responses are generally averaged over 60- or 30-s intervals, 1/2- or 10- seconds intervals and 120-, 180-, or 300- seconds intervals.”
BackgroundThe emotion probe: Studies of motivation and attention.
Lang, P. J. (1995) · American Psychologist · doi:10.1037//0003-066x.50.5.372 · Cited by 2,746
Kubios HRV–heart rate variability analysis software.
Tarvainen, M. P., Niskanen, J.-P., Lipponen, J. A., Ranta-aho, P. O., & Karjalainen, P. A. (2014) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2013.07.024 · Cited by 2,720 · cited 1×
“From the ECG histogram, additional geometric metrics can be extracted, namely, the triangular interpolation index (TINN) providing the baseline width of the RR interval histogram, HRV triangular index, consisting of the integral of the RR interval histogram divided by the height of the histogram, log and differential…”
MethodSpielberger, C. D. (2010) · The Corsini Encyclopedia of Psychology · doi:10.1002/9780470479216.corpsy0943 · Cited by 2,535
The Hospital Anxiety And Depression Scale.
(2003) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-1-29 · Cited by 2,391
Toward machine emotional intelligence: analysis of affective physiological state
Picard, R. W., Vyzas, E., & Healey, J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.954607 · Cited by 2,334
Detecting Stress During Real-World Driving Tasks Using Physiological Sensors
Healey, J. A., & Picard, R. W. (2005) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2005.848368 · Cited by 2,207
A Multimodal Database for Affect Recognition and Implicit Tagging
Soleymani, M., Lichtenauer, J., Pun, T., & Pantic, M. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.25 · Cited by 1,664
The stroop color and word test
Scarpina, F., & Tagini, S. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00557 · Cited by 1,661
EEG Emotion Recognition Using Dynamical Graph Convolutional Neural Networks
Song, T., Zheng, W., Song, P., & Cui, Z. (2020) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2817622 · Cited by 1,597
A Survey on Deep Learning: Algorithms, Techniques, and Applications
Pouyanfar, S., Sadiq, S., Yan, Y., Tian, H., Tao, Y., Reyes, M. P., Shyu, M.-L., Chen, S.-C., & Iyengar, S. S. (2019) · ACM Computing Surveys · doi:10.1145/3234150 · Cited by 1,403
Introducing WESAD, a Multimodal Dataset for Wearable Stress and Affect Detection
Schmidt, P., Reiss, A., Duerichen, R., Marberger, C., & Van Laerhoven, K. (2018) · Proceedings of the 20th ACM International Conference on Multimodal Interaction · doi:10.1145/3242969.3242985 · Cited by 1,277
On the Analysis of Fingertip Photoplethysmogram Signals
Elgendi, M. (2012) · Current Cardiology Reviews · doi:10.2174/157340312801215782 · Cited by 1,206
Deep multimodal learning: a survey on recent advances and trends
Ramachandram, D., & Taylor, G. W. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2738401 · Cited by 1,139 · cited 1×
“For further information on DL, the authors refer the reader to [159], [160].”
BackgroundWang, R., Chen, F., Chen, Z., Li, T., Harari, G., Tignor, S., Zhou, X., Ben-Zeev, D., & Campbell, A. T. (2014) · Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2632048.2632054 · Cited by 1,116
Basic Emotions, Natural Kinds, Emotion Schemas, and a New Paradigm
Izard, C. E. (2007) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2007.00044.x · Cited by 1,110
Emotion Theory and Research: Highlights, Unanswered Questions, and Emerging Issues
Izard, C. E. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.60.110707.163539 · Cited by 1,088
Emotion recognition based on physiological changes in music listening
Kim, J., & Andre, E. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.26 · Cited by 1,082
EEG-Based Emotion Recognition in Music Listening
Lin, Y.-P., Wang, C.-H., Jung, T.-P., Wu, T.-L., Jeng, S.-K., Duann, J.-R., & Chen, J.-H. (2010) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2010.2048568 · Cited by 1,021
Self-citationMulticenter Collaborative Panic Disorder Severity Scale
Shear, M. K., Brown, T. A., Barlow, D. H., Money, R., Sholomskas, D. E., Woods, S. W., Gorman, J. M., & Papp, L. A. (1997) · American Journal of Psychiatry · doi:10.1176/ajp.154.11.1571 · Cited by 1,001
Identifying Stable Patterns over Time for Emotion Recognition from EEG
Zheng, W.-L., Zhu, J.-Y., & Lu, B.-L. (2019) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2712143 · Cited by 990
Emotion recognition system using short-term monitoring of physiological signals
Kim, K. H., Bang, S. W., & Kim, S. R. (2004) · Medical & Biological Engineering & Computing · doi:10.1007/bf02344719 · Cited by 944
A review of emotion recognition using physiological signals
Shu, L., Xie, J., Yang, M., Li, Z., Li, Z., Liao, D., Xu, X., & Yang, X. (2018) · Sensors · doi:10.3390/s18072074 · Cited by 923 · cited 2×
“identified, towards the development of a framework for emotion recognition which must be addressed [4], [8]:”
BackgroundSchaefer, A., Nils, F., Sanchez, X., & Philippot, P. (2010) · Cognition & Emotion · doi:10.1080/02699930903274322 · Cited by 875
Affective image classification using features inspired by psychology and art theory
Machajdik, J., & Hanbury, A. (2010) · Proceedings of the 18th ACM international conference on Multimedia · doi:10.1145/1873951.1873965 · Cited by 852
Feature selection for classification: A review
Tang, J., Alelyani, S., & Liu, H. (2014) · doi:10.1201/b17320-7 · Cited by 757
Dan-Glauser, E. S., & Scherer, K. R. (2011) · Behavior Research Methods · doi:10.3758/s13428-011-0064-1 · Cited by 736
AMIGOS: A Dataset for Affect, Personality and Mood Research on Individuals and Groups
Miranda-Correa, J. A., Abadi, M. K., Sebe, N., & Patras, I. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2884461 · Cited by 709
Emotion Recognition based on EEG using LSTM Recurrent Neural Network
Alhagry, S., Aly, A., & A., R. (2017) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2017.081046 · Cited by 645
The Expression of the Emotions in Man and Animals
Darwin, C. (2009) · Cambridge University Press eBooks · doi:10.1017/cbo9780511694110 · Cited by 565
ASCERTAIN: Emotion and Personality Recognition Using Commercial Sensors
Subramanian, R., Wache, J., Abadi, M. K., Vieriu, R. L., Winkler, S., & Sebe, N. (2018) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2016.2625250 · Cited by 535
Stress Recognition Using Wearable Sensors and Mobile Phones
Sano, A., & Picard, R. W. (2013) · 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction · doi:10.1109/acii.2013.117 · Cited by 523
Wagner, J., Kim, J., & Andre, E. (2005) · 2005 IEEE International Conference on Multimedia and Expo · doi:10.1109/icme.2005.1521579 · Cited by 511
A psychoevolutionary theory of emotions
Plutchik, R. (1982) · Social Science Information · doi:10.1177/053901882021004003 · Cited by 495
Derogatis, L. R., & Unger, R. (2010) · The Corsini Encyclopedia of Psychology · doi:10.1002/9780470479216.corpsy0970 · Cited by 488
Ecg pattern analysis for emotion detection
Agrafioti, F., Hatzinakos, D., & Anderson, A. K. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.28 · Cited by 476
Real time electrocardiogram QRS detection using combined adaptive threshold
Christov, I. I. (2004) · BioMedical Engineering OnLine · doi:10.1186/1475-925x-3-28 · Cited by 464
Mental health and work : impact, issues, and good practices
Harnois, G. P., Gabriel, P., & Knowledge, S. I. P. O. (2000) · eCommons (Cornell University) · Cited by 462
Emotion Recognition Using Bio-sensors: First Steps towards an Automatic System
Haag, A., Goronzy, S., Schaich, P., & Williams, J. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24842-2_4 · Cited by 451
MoodScope: building a mood sensor from smartphone usage patterns
LiKamWa, R., Liu, Y., Lane, N. D., & Zhong, L. (2013) · Proceeding of the 11th annual international conference on Mobile systems, applications, and services · doi:10.1145/2462456.2464449 · Cited by 444
Using Noninvasive Wearable Computers to Recognize Human Emotions from Physiological Signals
Lisetti, C. L., & Nasoz, F. (2004) · EURASIP Journal on Advances in Signal Processing · doi:10.1155/s1110865704406192 · Cited by 432
The Autonomic Nervous System and Emotion
Levenson, R. W. (2014) · Emotion Review · doi:10.1177/1754073913512003 · Cited by 425
Pleasure, Arousal, Dominance: Mehrabian and Russell revisited
Bakker, I., van der Voordt, T., Vink, P., & de Boon, J. (2014) · Current Psychology · doi:10.1007/s12144-014-9219-4 · Cited by 415
Hamilton, P. (2003) · Computers in Cardiology · doi:10.1109/cic.2002.1166717 · Cited by 380
EEG-based emotion classification using deep belief networks
Zheng, W.-L., Zhu, J.-Y., Peng, Y., & Lu, B.-L. (2014) · 2014 IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2014.6890166 · Cited by 367
Short-term emotion assessment in a recall paradigm
Chanel, G., Kierkels, J. J. M., Soleymani, M., & Pun, T. (2009) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2009.03.005 · Cited by 367
DECAF: MEG-Based Multimodal Database for Decoding Affective Physiological Responses
Abadi, M. K., Subramanian, R., Kia, S. M., Avesani, P., Patras, I., & Sebe, N. (2015) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2015.2392932 · Cited by 365
Verma, G. K., & Tiwary, U. S. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.11.007 · Cited by 354
Monitoring stress with a wrist device using context
Gjoreski, M., Luštrek, M., Gams, M., & Gjoreski, H. (2017) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.08.006 · Cited by 352
Methods of evaluation of autonomic nervous system function
Zygmunt, A., & Stanczyk, J. (2010) · Archives of Medical Science · doi:10.5114/aoms.2010.13500 · Cited by 346 · cited 1×
“These entitle per example: the Deep breathing test, Isometric handgrip test, Cold pressor test, Active standing (orthostatic test) and Head-up tilt test [64].”
MethodcStress: towards a gold standard for continuous stress assessment in the mobile environment
Hovsepian, K., al'Absi, M., Ertin, E., Kamarck, T., Nakajima, M., & Kumar, S. (2015) · Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2750858.2807526 · Cited by 339
Toward Emotion Recognition in Car-Racing Drivers: A Biosignal Processing Approach
Katsis, C. D., Katertsidis, N., Ganiatsas, G., & Fotiadis, D. I. (2008) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/tsmca.2008.918624 · Cited by 336
Emotion Recognition from Multi-Channel EEG through Parallel Convolutional Recurrent Neural Network
Yang, Y., Wu, Q., Qiu, M., Wang, Y., & Chen, X. (2018) · 2018 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489331 · Cited by 325
Douglas-Cowie, E., Cowie, R., Sneddon, I., Cox, C., Lowry, O., McRorie, M., Martin, J.-C., Devillers, L., Abrilian, S., Batliner, A., et al. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74889-2_43 · Cited by 321
An open-source algorithm to detect onset of arterial blood pressure pulses
Zong, W., Heldt, T., Moody, G. B., & Mark, R. G. (2003) · Computers in Cardiology, 2003 · doi:10.1109/cic.2003.1291140 · Cited by 320
The Revised NEO Personality Inventory
Piedmont, R. L. (1998) · DIAL (Catholic University of Leuven) · doi:10.1007/978-1-4899-3588-5 · Cited by 318
An empirical study of machine learning techniques for affect recognition in human–robot interaction
Rani, P., Liu, C., Sarkar, N., & Vanman, E. (2006) · Pattern Analysis and Applications · doi:10.1007/s10044-006-0025-y · Cited by 313
A survey of dimensionality reduction techniques
Sorzano, C. Ó. S., Vargas, J., & Pascual-Montano, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1403.2877 · Cited by 305
Towards Measuring Stress with Smartphones and Wearable Devices During Workday and Sleep
Muaremi, A., Arnrich, B., & Tröster, G. (2013) · BioNanoScience · doi:10.1007/s12668-013-0089-2 · Cited by 302
Wearable and automotive systems for affect recognition from physiology
Healey, J., & Picard, R. W. (2000) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 301
Santamaria-Granados, L., Munoz-Organero, M., Ramirez-Gonzalez, G., Abdulhay, E., & Arunkumar, N. (2019) · IEEE Access · doi:10.1109/access.2018.2883213 · Cited by 289
Learning deep physiological models of affect
Martinez, H. P., Bengio, Y., & Yannakakis, G. N. (2013) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2013.2247823 · Cited by 287
Emotion recognition from multi-channel EEG data through Convolutional Recurrent Neural Network
Li, X., Song, D., Zhang, P., Yu, G., Hou, Y., & Hu, B. (2016) · 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm.2016.7822545 · Cited by 283
Petrantonakis, P. C., & Hadjileontiadis, L. J. (2010) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2010.7 · Cited by 260
Emotion Recognition through Multiple Modalities: Face, Body Gesture, Speech
Castellano, G., Kessous, L., & Caridakis, G. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-85099-1_8 · Cited by 259
The Role of Nonlinear Dynamics in Affective Valence and Arousal Recognition
Valenza, G., Lanata, A., & Scilingo, E. P. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.30 · Cited by 252
A mixed bag of emotions: Model, predict, and transfer emotion distributions
Peng, K.-C., Chen, T., Sadovnik, A., & Gallagher, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298687 · Cited by 250
Plarre, K., Raij, A. B., Hossain, S. M., Ali, A. A., Nakajima, M., Al’Absi, M., Ertin, E., Kamarck, T. W., Kumar, S., Scott, M. S., et al. (2011) · ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN) · Cited by 244
Revealing Real-Time Emotional Responses: a Personalized Assessment based on Heartbeat Dynamics
Valenza, G., Citi, L., Lanatá, A., Scilingo, E. P., & Barbieri, R. (2014) · Scientific Reports · doi:10.1038/srep04998 · Cited by 229
The Emotional Movie Database (EMDB): A Self-Report and Psychophysiological Study
Carvalho, S., Leite, J., Galdo-Álvarez, S., & Gonçalves, Ó. F. (2012) · Applied Psychophysiology and Biofeedback · doi:10.1007/s10484-012-9201-6 · Cited by 224
Real-time EEG-based emotion monitoring using stable features
Lan, Z., Sourina, O., Wang, L., & Liu, Y. (2016) · The Visual Computer · doi:10.1007/s00371-015-1183-y · Cited by 222
Development and Evaluation of an Ambulatory Stress Monitor Based on Wearable Sensors
Choi, J., Ahmed, B., & Gutierrez-Osuna, R. (2012) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2011.2169804 · Cited by 221 · cited 2×
“Further techniques can be found in [2], [106].”
BackgroundMethodCall Center Stress Recognition with Person-Specific Models
Hernandez, J., Morris, R. R., & Picard, R. W. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-24600-5_16 · Cited by 210
Stress Detection Using Wearable Physiological and Sociometric Sensors
Mozos, O. M., Sandulescu, V., Andrews, S., Ellis, D., Bellotto, N., Dobrescu, R., & Ferrandez, J. M. (2017) · International Journal of Neural Systems · doi:10.1142/s0129065716500416 · Cited by 208
Li, B. J., Bailenson, J. N., Pines, A., Greenleaf, W. J., & Williams, L. M. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.02116 · Cited by 198
Video Affective Content Analysis: A Survey of State-of-the-Art Methods
Wang, S., & Ji, Q. (2015) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2015.2432791 · Cited by 195
Multimodal Emotion Recognition Using Deep Neural Networks
Tang, H., Liu, W., Zheng, W.-L., & Lu, B.-L. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-70093-9_86 · Cited by 194
Mehrabian, A. (1997) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/bf02229025 · Cited by 194
PAM: a photographic affect meter for frequent, in situ measurement of affect
Pollak, J. P., Adams, P., & Gay, G. K. (2011) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979047 · Cited by 177
ReliefF-Based EEG Sensor Selection Methods for Emotion Recognition
Zhang, J., Chen, M., Zhao, S., Hu, S., Shi, Z., & Cao, Y. (2016) · Sensors · doi:10.3390/s16101558 · Cited by 176
Predicting Personalized Image Emotion Perceptions in Social Networks
Zhao, S., Yao, H., Gao, Y., Ding, G., & Chua, T.-S. (2018) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2016.2628787 · Cited by 174
Emotion Recognition Based on Multi-Variant Correlation of Physiological Signals
Wen, W., Liu, G., Cheng, N., Wei, J., Shangguan, P., & Huang, W. (2014) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2014.2327617 · Cited by 173
Analysis of physiological signals for recognition of boredom, pain, and surprise emotions
Jang, E.-H., Park, B.-J., Park, M.-S., Kim, S.-H., & Sohn, J.-H. (2015) · Journal of Physiological Anthropology · doi:10.1186/s40101-015-0063-5 · Cited by 159
Development of the Stress Response Inventory and Its Application in Clinical Practice
Koh, K. B., Park, J. K., Kim, C. H., & Cho, S. (2001) · Psychosomatic Medicine · doi:10.1097/00006842-200107000-00020 · Cited by 157
HealthyOffice: Mood recognition at work using smartphones and wearable sensors
Zenonos, A., Khan, A., Kalogridis, G., Vatsikas, S., Lewis, T., & Sooriyabandara, M. (2016) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomw.2016.7457166 · Cited by 148
Khalili, Z., & Moradi, M. H. (2009) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2009.5178854 · Cited by 147
A user-independent real-time emotion recognition system for software agents in domestic environments
Leon, E., Clarke, G., Callaghan, V., & Sepulveda, F. (2006) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2006.06.001 · Cited by 143
Kolodyazhniy, V., Kreibig, S. D., Gross, J. J., Roth, W. T., & Wilhelm, F. H. (2011) · Psychophysiology · doi:10.1111/j.1469-8986.2010.01170.x · Cited by 139
A data set of real world driving to assess driver workload
Schneegass, S., Pfleging, B., Broy, N., Heinrich, F., & Schmidt, A. (2013) · Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications · doi:10.1145/2516540.2516561 · Cited by 135
Adams, P., Rabbi, M., Rahman, T., Matthews, M. L., Voida, A., Gay, G. K., Choudhury, T., & Voida, S. (2014) · International Conference on Pervasive Computing Technologies for Healthcare · doi:10.4108/icst.pervasivehealth.2014.254959 · Cited by 134
Emotion Recognition from Surface EMG Signal Using Wavelet Transform and Neural Network
Cheng, B., & Liu, G. (2008) · International Conference on Bioinformatics and Biomedical Engineering · doi:10.1109/icbbe.2008.670 · Cited by 134
Gilman, T. L., Shaheen, R., Nylocks, K. M., Halachoff, D. J., Chapman, J., Flynn, J. J., Matt, L. M., & Coifman, K. G. (2017) · Behavior Research Methods · doi:10.3758/s13428-016-0842-x · Cited by 132
Guo, H.-W., Huang, Y.-S., Lin, C., Chien, J.-C., Haraikawa, K., & Shieh, J.-S. (2016) · IEEE International Conference on Bioinformatics and Bioengineering (BIBE) · doi:10.1109/bibe.2016.40 · Cited by 129
Towards affective camera control in games
Yannakakis, G. N., Martínez, H. P., & Jhala, A. H. (2010) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-010-9078-0 · Cited by 128
Hilbert-Huang transform based physiological signals analysis for emotion recognition
Zong, C., & Chétouani, M. (2009) · IEEE International Symposium on Signal Processing and Information Technology (ISSPIT) · doi:10.1109/isspit.2009.5407547 · Cited by 126
Reliability and validity of Izard's differential emotions scale
Boyle, G. J. (1984) · Personality and Individual Differences · doi:10.1016/0191-8869(84)90124-7 · Cited by 117
A Survey on Unsupervised Machine Learning Algorithms for Automation, Classification and Maintenance
Khanum, M., Mahboob, T., Imtiaz, W., Ghafoor, H. A., & Sehar, R. (2015) · International Journal of Computer Applications · doi:10.5120/21131-4058 · Cited by 112
A Global Assessment of Recent Stress (GARS) Scale
Linn, M. W. (1986) · The International Journal of Psychiatry in Medicine · doi:10.2190/xp8n-rp1w-ye2b-9q7v · Cited by 107
Out of the Lab and into the Fray: Towards Modeling Emotion in Everyday Life
Healey, J., Nachman, L., Subramanian, S., Shahabdeen, J., & Morris, M. E. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-12654-3_10 · Cited by 103
A Novel Semi-Supervised Deep Learning Framework for Affective State Recognition on EEG Signals
Jia, X., Li, K., Li, X., & Zhang, A. (2014) · IEEE International Conference on Bioinformatics and Bioengineering (BIBE) · doi:10.1109/bibe.2014.26 · Cited by 100
A physiological signal-based method for early mental-stress detection
Xia, L., Malik, A. S., & Subhani, A. R. (2018) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2018.06.004 · Cited by 99
How Do Your Friends on Social Media Disclose Your Emotions?
Yang, Y., Jia, J., Zhang, S., Wu, B., Chen, Q., Li, J., Xing, C., & Tang, J. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v28i1.8740 · Cited by 97
MoodScope: Building a Mood Sensor from Smartphone Usage Patterns
LiKamWa, R., Liu, Y., Lane, N. D., & Zhong, L. (2012) · Rice Research Repository (Rice University) · Cited by 97
Stress detection in computer users through non-invasive monitoring of physiological signals.
Zhai, J., & Barreto, A. B. (2006) · PubMed · Cited by 89
Emotion detection from EEG recordings
Liu, J., Meng, H., Nandi, A. K., & Li, M. (2016) · International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD) · doi:10.1109/fskd.2016.7603437 · Cited by 89
Emotion Recognition Based on Weighted Fusion Strategy of Multichannel Physiological Signals
Wei, W., Jia, Q., Feng, Y., & Chen, G. (2018) · Computational Intelligence and Neuroscience · doi:10.1155/2018/5296523 · Cited by 82
Towards Efficient Multi-Modal Emotion Recognition
Dobrišek, S., Gajšek, R., Mihelič, F., Pavešić, N., & Štruc, V. (2013) · International Journal of Advanced Robotic Systems · doi:10.5772/54002 · Cited by 81
Feature-level fusion of multimodal physiological signals for emotion recognition
Chen, J., Hu, B., Li-xin, X., Moore, P. T., & Su, Y. (2015) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm.2015.7359713 · Cited by 77
Affective Image Content Analysis: A Comprehensive Survey
Zhao, S., Ding, G., Huang, Q., Chua, T., Schuller, B. W., & Keutzer, K. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/780 · Cited by 77
PNN for EEG-based Emotion Recognition
Zhang, J., Chen, M., Hu, S., Cao, Y., & Kozma, R. (2016) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2016.7844584 · Cited by 74
Lin, W., Li, C., & Sun, S. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-71589-6_33 · Cited by 72
Hao, C., Zhi, H., Dong, L., & Liu, Y. (2018) · Computational Intelligence and Neuroscience · doi:10.1155/2018/9750904 · Cited by 70
REAL TIME ELECTROCARDIOGRAM SEGMENTATION FOR FINGER BASED ECG BIOMETRICS
Lourenço, A., Silva, H., Leite, P., Lourenço, R., & Fred, A. L. N. (2012) · International Conference on Bio-inspired Systems and Signal Processing · doi:10.5220/0003777300490054 · Cited by 66
Self-citationA Large Video Database for Computational Models of Induced Emotion
Baveye, Y., Bettinelli, J.-N., Dellandréa, E., Chen, L., & Chamaret, C. (2013) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2013.9 · Cited by 64
Physiological signal based work stress detection using unobtrusive sensors
Anusha, A. S., Jose, J., Preejith, S. P., Joseph, J., & Sivaprakasam, M. (2018) · Biomedical Physics & Engineering Express · doi:10.1088/2057-1976/aadbd4 · Cited by 64
Calvo, R. A., Brown, I., & Scheding, S. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-10439-8_7 · Cited by 63
SVM-based feature selection methods for emotion recognition from multimodal data
Torres-Valencia, C. A., Álvarez, M. A., & Orozco, A. A. (2016) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-016-0222-y · Cited by 60
An Emotion Recognition System Based on Physiological Signals Obtained by Wearable Sensors
He, C., Yao, Y., & Ye, X. (2016) · Lecture notes in electrical engineering · doi:10.1007/978-981-10-2404-7_2 · Cited by 57
Shin, D., Shin, D., & Shin, D. (2016) · Multimedia Tools and Applications · doi:10.1007/s11042-016-4203-7 · Cited by 56
Physiological-Based Emotion Detection and Recognition in a Video Game Context
Yang, W., Rifqi, M., Marsala, C., & Pinna, A. (2018) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489125 · Cited by 56
Emotion recognition based on physiological signals using valence-arousal model
Basu, S., Jana, N., Bag, A., Mahadevappa, M., Mukherjee, J., Kumar, S., & Guha, R. (2015) · International Conference on Image Information Processing (ICIIP) · doi:10.1109/iciip.2015.7414739 · Cited by 54
Personality-Aware Personalized Emotion Recognition from Physiological Signals
Zhao, S., Ding, G., Han, J., & Gao, Y. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/230 · Cited by 54
Kim, D., Seo, Y., Cho, J., & Cho, C.-H. (2008) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/iembs.2008.4649244 · Cited by 53
A Globally Generalized Emotion Recognition System Involving Different Physiological Signals
Ali, M., Machot, F. A., Mosa, A. H., Jdeed, M., Machot, E. A., & Kyamakya, K. (2018) · Sensors · doi:10.3390/s18061905 · Cited by 52
Sartori, A., Yanulevskaya, V., Salah, A. A. A., Uijlings, J., Bruni, E., & Sebe, N. (2015) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/2768209 · Cited by 51
The platformer experience dataset
Karpouzis, K. C., Yannakakis, G. N., Shaker, N., & Asteriadis, S. (2015) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2015.7344647 · Cited by 51
Multimodal Emotion Recognition Using Multimodal Deep LearningPreprint
Liu, W., Zheng, W., & Lu, B. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.08225 · Cited by 49
Murugappan, M., Murugappan, S., & Zheng, B. S. (2013) · Journal of Physical Therapy Science · doi:10.1589/jpts.25.753 · Cited by 47
Emotion recognition based on the multiple physiological signals
Gong, P., Ma, H. T., & Wang, Y. (2016) · IEEE International Conference on Real-time Computing and Robotics (RCAR) · doi:10.1109/rcar.2016.7784015 · Cited by 47
Wu, C.-K., Chung, P., & Wang, C.-J. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2012.14 · Cited by 46
Self-citationDeep belief network based affect recognition from physiological signals
Kawde, P., & Verma, G. K. (2017) · IEEE Uttar Pradesh Section International Conference on Electrical, Electronics and Computer Engineering (UPCON) · doi:10.1109/upcon.2017.8251115 · Cited by 45
Feature Extraction for Emotion Recognition and Modelling Using Neurophysiological Data
Samara, A., Menezes, M. L. R., & Galway, L. (2016) · International Conference on Ubiquitous Computing and Communications (IUCC) · doi:10.1109/iucc-css.2016.027 · Cited by 43
A novel deep-learning based framework for multi-subject emotion recognition
Qiao, R., Qing, C., Zhang, T., Xing, X., & Xu, X. (2017) · International Conference on Information, Cybernetics, and Computational Social Systems (ICCSS) · doi:10.1109/iccss.2017.8091408 · Cited by 42
Zhang, X., Xu, C., Xue, W., Hu, J., He, Y., & Gao, M. (2018) · Sensors · doi:10.3390/s18113886 · Cited by 41
Schmidt, M., Schumann, A., Müller, J., Bär, K., & Rose, G. (2017) · Physiological Measurement · doi:10.1088/1361-6579/aa5feb · Cited by 40
Predicting Latent Narrative Mood Using Audio and Physiologic Data
Alhanai, T., & Ghassemi, M. M. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10625 · Cited by 39
Emotion recognition from physiological signals using fusion of wavelet based features
Guendil, Z., Lachiri, Z., Maaoui, C., & Pruski, A. (2015) · International Conference on Modelling, Identification and Control · doi:10.1109/icmic.2015.7409485 · Cited by 37
MULTI-MODAL BEHAVIORAL BIOMETRICS BASED ON HCI AND ELECTROPHYSIOLOGY
Lisboa, E. D. (2008) · Cited by 36
VSD2014: A dataset for violent scenes detection in hollywood movies and web videos
Schedi, M., Sjöberg, M., Mironică, I., Ionescu, B. E., Quang, V. L., Jiang, Y., & Demarty, C.-H. (2015) · International Workshop on Content-Based Multimedia Indexing (CBMI) · doi:10.1109/cbmi.2015.7153604 · Cited by 35
Gaussian process dynamical models for multimodal affect recognition
García, H. F., Álvarez, M. A., & Orozco, A. A. (2016) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2016.7590834 · Cited by 34
Monajati, M., Abbasi, S. H., Shabaninia, F., & Shamekhi, S. (2012) · International Journal of Intelligence Science · doi:10.4236/ijis.2012.224022 · Cited by 31
Multi-modal Emotion Recognition with Temporal-Band Attention Based on LSTM-RNN
Liu, J., Su, Y., & Liu, Y. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-77380-3_19 · Cited by 31
Wearable affect and stress recognition: A reviewPreprint
Schmidt, P., Reiss, A., Duerichen, R., & Laerhoven, K. V. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.08854 · Cited by 31
Naturalistic Recognition of Activities and Mood Using Wearable Electronics
Zhu, Z. Z., Satizábal, H. F., Blanke, U., Pérez-Uribe, A., & Tröster, G. (2015) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2015.2491927 · Cited by 28
Using cardio-respiratory signals to recognize emotions elicited by watching music video clips
Mirmohamadsadeghi, L., Yazdani, A., & Vésin, J.-M. (2016) · IEEE International Workshop on Multimedia Signal Processing (MMSP) · doi:10.1109/mmsp.2016.7813349 · Cited by 28
Inducing and measuring emotion through a multiplayer first-person shooter computer game
Merkx, P. A. B., Truong, K. P., & Neerincx, M. A. (2007) · TNO Repository · Cited by 25
Affect detection in the real world: Recording and processing physiological signals
Healey, J. (2009) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2009.5349496 · Cited by 25
Affect-expressive movement generation with factored conditional Restricted Boltzmann Machines
Alemi, O., Li, W. H. C., & Pasquier, P. (2015) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2015.7344608 · Cited by 25
Emotion classification using deep neural networks and emotional patches
Huang, J., Xu, X., & Zhang, T. (2017) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm.2017.8217786 · Cited by 25
Lee, J., & Yoo, S. K. (2018) · Sensors · doi:10.3390/s18124253 · Cited by 23
Mutual Information-Based Emotion Recognition
Cui, Y. J., Luo, S., Tian, Q., Zhang, S. S., Peng, Y., Jiang, L., & Jin, J. S. (2012) · Springer eBooks · doi:10.1007/978-1-4614-3501-3_39 · Cited by 22
PSO optimization of synergetic neural classifier for multichannel emotion recognition
Wong, W. M., Tan, A. W. C., Loo, C. K., & Liew, W. S. (2010) · World Congress on Nature and Biologically Inspired Computing (NaBIC) · doi:10.1109/nabic.2010.5716292 · Cited by 21
Three class emotions recognition based on deep learning using staked autoencoder
Yang, B., Han, X., & Tang, J. (2017) · International Congress on Image and Signal Processing (CISP) · doi:10.1109/cisp-bmei.2017.8302098 · Cited by 20
Quan, C., Wan, D., Zhang, B., & Ren, F. (2013) · IEEE/SICE International Symposium on System Integration (SII) · doi:10.1109/sii.2013.6776653 · Cited by 19
Facial Expression Recognition based on EOG toward Emotion Detection for Human-Robot Interaction
Cruz, A., Garcia, D., Pires, G., & Nunes, U. (2015) · International Conference on Bio-inspired Systems and Signal Processing · doi:10.5220/0005187200310037 · Cited by 18
Robust emotion classification using neural network models
Salari, S., Ansarian, A., & Atrianfar, H. (2018) · Iranian Joint Congress on Fuzzy and Intelligent Systems · doi:10.1109/cfis.2018.8336626 · Cited by 16
WT Feature Based Emotion Recognition from Multi-channel Physiological Signals with Decision Fusion
Xie, J., Xu, X., & Shu, L. (2018) · Asian Conference on Affective Computing and Intelligent Interaction (ACII Asia) · doi:10.1109/aciiasia.2018.8470381 · Cited by 16
A Transductive Model-based Stress Recognition Method Using Peripheral Physiological Signals
Li, M., Xie, L., & Wang, Z. (2019) · Sensors · doi:10.3390/s19020429 · Cited by 16
HiMotion: a new research resource for the study of behavior, cognition, and emotion
Gamboa, H. F. S., Silva, H., & Fred, A. L. N. (2013) · Multimedia Tools and Applications · doi:10.1007/s11042-013-1602-x · Cited by 14
Self-citationTime, Frequency & Complexity Analysis for Recognizing Panic States from Physiologic Time-Series
Rubin, J., Abreu, R., Ahern, S., Eldardiry, H., & Bobrow, D. G. (2016) · International Conference on Pervasive Computing Technologies for Healthcare · doi:10.4108/eai.16-5-2016.2263292 · Cited by 14
Yin, Z., Wang, Y., Zhang, W., Liu, L., Zhang, J., Han, F., & Jin, W. (2017) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2017.08.1220 · Cited by 11
Wang, C., & Cesar, P. S. (2017) · ACM SIGCHI Conference on Creativity and Cognition (C&C) · doi:10.1145/3059454.3059465 · Cited by 10
Self-citationHuynh, S., Lee, Y., Park, T., & Balan, R. K. (2016) · doi:10.1145/2934646.2934648 · Cited by 9
Wang, C., Wong, J., Zhu, X., Röggla, T., Jansen, J., & Cesar, P. S. (2016) · International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2016.7498951 · Cited by 6
Self-citation
Cited by
A systematic review on affective computing: emotion models, databases, and recent advances
Wang, Y., Song, W., Tao, W., Liotta, A., Yang, D., Li, X., Gao, S., Sun, Y., Ge, W., Zhang, W., et al. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.03.009 · Cited by 615
Khare, S. K., Blanes-Vidal, V., Nadimi, E. S., & Acharya, U. R. (2024) · Information Fusion · doi:10.1016/j.inffus.2023.102019 · Cited by 469
Emotion recognition in EEG signals using deep learning methods: A review
Jafari, M., Shoeibi, A., Khodatars, M., Bagherzadeh, S., Shalbaf, A., García, D. L., Gorriz, J. M., & Acharya, U. R. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107450 · Cited by 240
Emotion assessment using Machine Learning and low-cost wearable devices
Laureanti, R., Bilucaglia, M., Zito, M., Circi, R., Fici, A., Rivetti, F., Valesi, R., Oldrini, C., Mainardi, L. T., & Russo, V. (2020) · 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC) · doi:10.1109/embc44109.2020.9175221 · Cited by 33
Moussaoui, K., & Farah, M. (2024) · 2024 IEEE 7th International Conference on Advanced Technologies, Signal and Image Processing (ATSIP) · doi:10.1109/atsip62566.2024.10638977 · Cited by 2
Metadata
- Authors
- Bota, P. J., Wang, C., Fred, A. L. N., & Placido Da Silva, H.
- Venue
- IEEE Access
- Published
- 2019
- Volume
- 7
- Pages
- 140990-141020
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W2975003464
- Cited by
- 322
- References
- 182
- FWCI
- 24.06
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.