Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 218

The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.

Wearable-Based Affect Recognition—A Review

Open access
Schmidt, Philip, Reiss, Attila, Dürichen, Robert, Laerhoven, Kristof Van · 2019 · Sensors

Abstract

Affect recognition is an interdisciplinary research field bringing together researchers from natural and social sciences. Affect recognition research aims to detect the affective state of a person based on observables, with the goal to, for example, provide reasoning for the person’s decision making or to support mental wellbeing (e.g., stress monitoring). Recently, beside of approaches based on audio, visual or text information, solutions relying on wearable sensors as observables, recording mainly physiological and inertial parameters, have received increasing attention. Wearable systems enable an ideal platform for long-term affect recognition applications due to their rich functionality and form factor, while providing valuable insights during everyday life through integrated sensors. However, existing literature surveys lack a comprehensive overview of state-of-the-art research in wearable-based affect recognition. Therefore, the aim of this paper is to provide a broad overview and in-depth understanding of the theoretical background, methods and best practices of wearable affect and stress recognition. Following a summary of different psychological models, we detail the influence of affective states on the human physiology and the sensors commonly employed to measure physiological changes. Then, we outline lab protocols eliciting affective states and provide guidelines for ground truth generation in field studies. We also describe the standard data processing chain and review common approaches related to the preprocessing, feature extraction and classification steps. By providing a comprehensive summary of the state-of-the-art and guidelines to various aspects, we would like to enable other researchers in the field to conduct and evaluate user studies and develop wearable systems.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/s19194079

Cites

53 of 53 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 53 references

Research works printed but not linked: 129

  1. Kory, 2015, A Review and Meta-Analysis of Multimodal Affect Detection Systems, ACM Comput. Surv., 47, 43:1
  2. McEwen, 1993, Stress and the individual: Mechanisms leading to disease, Arch. Intern. Med., 153, 2093, 10.1001/archinte.1993.00410180039004 · DOI · Paper page
  3. Rosmond, 1998, Endocrine and metabolic aberrations in men with abdominal obesity in relation to anxio-depressive infirmity, Metabolism, 47, 1187, 10.1016/S0026-0495(98)90321-3 · DOI
  4. Gangemi, 2014, Frame-Based Detection of Opinion Holders and Topics: A Model and a Tool, IEEE Comput. Intell. Mag., 9, 20, 10.1109/MCI.2013.2291688 · DOI
  5. Gravina, 2019, Emotion-relevant activity recognition based on smart cushion using multi-sensor fusion, Inf. Fusion, 48, 1, 10.1016/j.inffus.2018.08.001 · DOI
  6. Picard, 2001, Toward machine emotional intelligence: Analysis of affective physiological state, IEEE Trans. Pattern Anal. Mach. Intell., 23, 1175, 10.1109/34.954607 · DOI · Paper page
  7. Gjoreski, 2017, Monitoring stress with a wrist device using context, J. Biomed. Inform., 73, 159, 10.1016/j.jbi.2017.08.006 · DOI · Paper page
  8. Costa, 2019, Emotions detection on an ambient intelligent system using wearable devices, Future Gener. Comput. Syst., 92, 479, 10.1016/j.future.2018.03.038 · DOI
  9. Miller, 2012, The Smartphone Psychology Manifesto, Perspect. Psychol. Sci., 7, 221, 10.1177/1745691612441215 · DOI · Paper page
  10. Rastafoo, 2018, A Critical Review of Proactive Detection of Driver Stress Levels Based on Multimodal Measurements, ACM Comput. Surv., 51, 88
  11. Kim, 2013, A review on the computational methods for emotional state estimation from the human EEG, Comput. Math. Methods Med., 2013, 573734, 10.1155/2013/573734 · DOI · Paper page
  12. Liu, B. (2017). Many Facets of Sentiment Analysis. A Practical Guide to Sentiment Analysis, Springer. · DOI
  13. Cicero, M. (2002). Cicero on the Emotions: Tusculan Disputations 3 and 4, University of Chicago Press. · doi:10.7208/chicago/9780226305196.001.0001
  14. Darwin, C. (1999). The Expression of the Emotions in Man and Animals, HarperCollins Publishers. [3rd ed.]. First published in 1872. · DOI · Paper page
  15. Ekman, 1976, Measuring facial movement, Environ. Psychol. Nonverbal Behav., 1, 56, 10.1007/BF01115465 · DOI · Paper page
  16. Zenonos, A., Khan, A., and Sooriyabandara, M. (2016, January 14–18). HealthyOffice: Mood recognition at work using smartphones and wearable sensors. Proceedings of the PerCom Workshops, Sydney, Australia. · DOI
  17. Soleymani, 2012, A Multimodal Database for Affect Recognition and Implicit Tagging, IEEE Trans. Affect. Comput., 3, 42, 10.1109/T-AFFC.2011.25 · DOI · Paper page
  18. Becker-Asano, C. (2008). WASABI: Affect Simulation for Agents with Believable Interactivity, IOS Press.
  19. Kim, 2008, Emotion recognition based on physiological changes in music listening, IEEE Trans. Pattern Anal. Mach. Intell., 30, 2067, 10.1109/TPAMI.2008.26 · DOI · Paper page
  20. Koelstra, 2012, Deap: A database for emotion analysis; using physiological signals, IEEE Trans. Affect. Comput., 3, 18, 10.1109/T-AFFC.2011.15 · DOI · Paper page
  21. Valenza, 2014, Revealing real-time emotional responses: A personalized assessment based on heartbeat dynamics, Sci. Rep., 4, 4998, 10.1038/srep04998 · DOI · Paper page
  22. Abadi, 2015, DECAF: MEG-based multimodal database for decoding affective physiological responses, IEEE Trans. Affect. Comput., 6, 209, 10.1109/TAFFC.2015.2392932 · DOI · Paper page
  23. Morris, 1995, Observations: SAM: The Self-Assessment Manikin; an efficient cross-cultural measurement of emotional response, J. Advert. Res., 35, 63
  24. Subramanian, 2017, ASCERTAIN: Emotion and Personality Recognition using Commercial Sensors, IEEE Trans. Affect. Comput., 9, 147, 10.1109/TAFFC.2016.2625250 · DOI · Paper page
  25. Jirayucharoensak, 2014, EEG-based emotion recognition using deep learning network with principal component based covariate shift adaptation, Sci. World J., 2014, 627892, 10.1155/2014/627892 · DOI · Paper page
  26. Cannon, W. (1929). Bodily Changes in Pain, Hunger, Fear and Rage, D Appleton & Company. · DOI · Paper page
  27. Selye, H. (1974). Stress without distress. Psychopathology of Human Adaptation, Springer.
  28. Goldstein, 2007, Evolution of concepts of stress, Stress, 10, 109, 10.1080/10253890701288935 · DOI · Paper page
  29. Lu, H., Frauendorfer, D., and Choudhury, T. (2012, January 5–8). StressSense: Detecting stress in unconstrained acoustic environments using smartphones. Proceedings of the 2012 ACM Conference on Ubiquitous Computing, Pittsburgh, PA, USA. · DOI · Paper page
  30. Mozos, 2017, Stress detection using wearable physiological and sociometric sensors, Int. J. Neural Syst., 27, 1650041, 10.1142/S0129065716500416 · DOI · Paper page
  31. Plarre, K., Raij, A., and Scott, M. (2011, January 12–14). Continuous inference of psychological stress from sensory measurements collected in the natural environment. Proceedings of the 10th International Conference on Information Processing in Sensor Networks (IPSN), Chicago, IL, USA.
  32. Schmidt, P., Reiss, A., Dürichen, R., Marberger, C., and Van Laerhoven, K. (2018, January 16–20). Introducing WESAD, a Multimodal Dataset for Wearable Stress and Affect Detection. Proceedings of the 20th ACM International Conference on Multimodal Interaction, Boulder, CO, USA. · DOI · Paper page
  33. Sanches, P., Höök, K., Vaara, E., Weymann, C., Bylund, M., Ferreira, P., Peira, N., and Sjölinder, M. (2010, January 16–20). Mind the Body!: Designing a Mobile Stress Management Application Encouraging Personal Reflection. Proceedings of the 8th ACM Conference on Designing Interactive Systems, Aarhus, Denmark. · DOI
  34. Thayer, R. (1990). The Biopsychology of Mood and Arousal, Oxford University Press. · DOI · Paper page
  35. Schimmack, 2002, Experiencing activation: Energetic arousal and tense arousal are not mixtures of valence and activation, Emotion, 2, 412, 10.1037/1528-3542.2.4.412 · DOI
  36. Mehrotra, 2017, MyTraces: Investigating correlation and causation between users’ emotional states and mobile phone interaction, PACM Interact. Mob. Wearable Ubiquitous Technol., 1, 83
  37. Friedman, 2010, Feelings and the body: The Jamesian perspective on autonomic specificity of emotion, Biol. Psychol., 84, 383, 10.1016/j.biopsycho.2009.10.006 · DOI · Paper page
  38. McCorry, 2007, Physiology of the autonomic nervous system, Am. J. Pharm. Educ., 71, 78, 10.5688/aj710478 · DOI · Paper page
  39. Dawson, M., Schell, A., and Filion, D. (2000). The electrodermal system. Handbook of Psychophysiology, Cambridge University Press. [2nd ed.].
  40. Broek, E., Lisy, V., Janssen, J., Westerink, J., Schut, M., Tuinenbreijer, K., Fred, A., Filipe, J., and Gamboa, H. (2009). Affective Man-machine Interface: Unveiling Human Emotions through Biosignals. International Joint Conference on Biomedical Engineering Systems and Technologies, Springer.
  41. Mahdiani, S., Jeyhani, V., Peltokangas, M., and Vehkaoja, A. (2015, January 25–29). Is 50 Hz high enough ECG sampling frequency for accurate HRV analysis?. Proceedings of the 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Milan, Italy. · DOI
  42. Lin, W., Wu, D., Li, C., Zhang, H., and Zhang, Y. (2014). Comparison of Heart Rate Variability from PPG with That from ECG, Springer. · DOI
  43. Schmidt, P., Reiss, A., Dürichen, R., and Van Laerhoven, K. (2018, January 8–12). Labelling Affective States “in the Wild”: Practical Guidelines and Lessons Learned. Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers, Singapore. · DOI
  44. Lykken, 1971, Direct measurement of skin conductance: A proposal for standardization, Psychophysiology, 8, 656, 10.1111/j.1469-8986.1971.tb00501.x · DOI · Paper page
  45. Di Lascio, E., Gashi, S., and Santini, S. (2019, January 20–23). Laughter Recognition Using Non-invasive Wearable Devices. Proceedings of the 13th EAI International Conference on Pervasive Computing Technologies for Healthcare, Trento, Italy. · DOI
  46. Heinisch, J.S., Anderson, C., and David, K. (2019, January 11–15). Angry or Climbing Stairs? Towards Physiological Emotion Recognition in the Wild. Proceedings of the 2019 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops), Kyoto, Japan. · DOI
  47. 2001, Optimal signal bandwidth for the recording of surface EMG activity of facial, jaw, oral, and neck muscles, Psychophysiology, 38, 22, 10.1111/1469-8986.3810022 · doi:10.1111/1469-8986.3810022 · Paper page
  48. Wijsman, J., Grundlehner, B., and Hermens, H. (2010, January 5–7). Trapezius muscle EMG as predictor of mental stress. Proceedings of the Wireless Health 2010, San Diego, CA, USA. · DOI
  49. Lisetti, 2004, Using Noninvasive Wearable Computers to Recognize Human Emotions from Physiological Signals, EURASIP J. Appl. Signal Process., 2004, 1672
  50. Soleymani, 2012, Multimodal emotion recognition in response to videos, IEEE Trans. Affect. Comput., 3, 211, 10.1109/T-AFFC.2011.37 · DOI · Paper page
  51. Ramos, J., Hong, J., and Dey, A. (2014, January 7–9). Stress recognition: A step outside the lab. Proceedings of the International Conference on Physiological Computing Systems, Lisbon, Portugal.
  52. Birjandtalab, J., Cogan, D., Pouyan, M.B., and Nourani, M. (2016, January 26–28). A Non-EEG Biosignals Dataset for Assessment and Visualization of Neurological Status. Proceedings of the 2016 IEEE International Workshop on Signal Processing Systems (SiPS), Dallas, TX, USA. · doi:10.1109/sips.2016.27
  53. Haag, A., Goronzy, S., Schaich, P., and Williams, J. (2004). Emotion recognition using bio-sensors: First steps towards an automatic system. Tutorial and Research Workshop on Affective Dialogue Systems, Springer. · DOI · Paper page
  54. Liu, C., Rani, P., and Sarkar, N. (2005, January 2–6). An empirical study of machine learning techniques for affect recognition in human-robot interaction. Proceedings of the 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems, Edmonton, AB, Canada.
  55. Wagner, J., Kim, J., and André, E. (2005, January 6). From physiological signals to emotions: Implementing and comparing selected methods for feature extraction and classification. Proceedings of the IEEE International Conference on Multimedia and Expo (ICME), Amsterdam, The Netherlands.
  56. Leon, 2007, A user-independent real-time emotion recognition system for software agents in domestic environments, Eng. Appl. Artif. Intell., 20, 337, 10.1016/j.engappai.2006.06.001 · DOI
  57. Zhai, 2006, Stress detection in computer users through non-invasive monitoring of physiological signals, Biomed. Sci. Instrum., 42, 495
  58. Kim, D., Seo, Y., Cho, J., and Cho, C. (2008, January 20–25). Detection of subjects with higher self-reporting stress scores using heart rate variability patterns during the day. Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Vancouver, BC, Canada. · DOI
  59. Katsis, 2008, Toward Emotion Recognition in Car-Racing Drivers: A Biosignal Processing Approach, IEEE Trans. Syst. Man, Cybern., 38, 502, 10.1109/TSMCA.2008.918624 · DOI · Paper page
  60. Calvo, R., Brown, I., and Scheding, S. (2009). Effect of Experimental Factors on the Recognition of Affective Mental States through Physiological Measures. AI 2009: Advances in Artificial Intelligenc, Springer. · DOI
  61. Chanel, 2009, Short-term emotion assessment in a recall paradigm, Int. J. Hum. Comput. Stud., 67, 607, 10.1016/j.ijhcs.2009.03.005 · DOI · Paper page
  62. Khalili, Z., and Moradi, M. (2009, January 14–19). Emotion recognition system using brain and peripheral signals: Using correlation dimension to improve the results of EEG. Proceedings of the 2009 International Joint Conference on Neural Networks, Atlanta, GA, USA. · DOI
  63. Healey, J., Nachman, L., Subramanian, S., Shahabdeen, J., and Morris, M. (2010). Out of the Lab and into the Fray: Towards Modeling Emotion in Everyday Life. Pervasive Computing, Springer. · DOI
  64. Valenza, 2012, The Role of Nonlinear Dynamics in Affective Valence and Arousal Recognition, IEEE Trans. Affect. Comput., 3, 237, 10.1109/T-AFFC.2011.30 · DOI · Paper page
  65. Hamdi, H., Richard, P., and Allain, P. (2012, January 10–15). Emotion assessment for affective computing based on physiological responses. Proceedings of the 2012 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE), Brisbane, Australia. · DOI
  66. Agrafioti, 2012, ECG Pattern Analysis for Emotion Detection, IEEE Trans. Affect. Comput., 3, 102, 10.1109/T-AFFC.2011.28 · DOI · Paper page
  67. Sano, A., and Picard, R. (2013, January 2–5). Stress Recognition Using Wearable Sensors and Mobile Phones. Proceedings of the Humaine Association Conference on Affective Computing and Intelligent Interaction (ACII), Geneva, Switzerland. · DOI · Paper page
  68. Adams, P., Rabbi, M., Rahman, T., Matthews, M., Voida, A., Gay, G., Choudhury, T., and Voida, S. (2014, January 20–23). Towards personal stress informatics: Comparing minimally invasive techniques for measuring daily stress in the wild. Proceedings of the 8th International Conference on Pervasive Computing Technologies for Healthcare, Oldenburg, Germany. · DOI
  69. Hovsepian, K., al’Absi, M., and Kumar, S. (2015, January 7–11). cStress: Towards a gold standard for continuous stress assessment in the mobile environment. Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Osaka, Japan. · DOI · Paper page
  70. Rubin, J., Abreu, R., and Ahern, S. (2016, January 16–19). Time, Frequency & Complexity Analysis for Recognizing Panic States from Physiologic Time-Series. Proceedings of the 10th EAI International Conference on Pervasive Computing Technologies for Healthcare, Cancun, Mexico. · DOI
  71. Jaques, N., Taylor, S., Nosakhare, E., Sano, A., and Picard, R. (2016, January 5–10). Multi-task Learning for Predicting Health, Stress, and Happiness. Proceedings of the NIPS Workshop on Machine Learning for Healthcare, Barcelona, Spain.
  72. Rathod, P., George, K., and Shinde, N. (2016, January 14–17). Bio-signal based emotion detection device. Proceedings of the 2016 IEEE 13th International Conference on Wearable and Implantable Body Sensor Networks (BSN), San Francisco, CA, USA. · DOI
  73. Zhu, 2016, Naturalistic Recognition of Activities and Mood Using Wearable Electronics, IEEE Trans. Affect. Comput., 7, 272, 10.1109/TAFFC.2015.2491927 · DOI
  74. Girardi, D., Lanubile, F., and Novielli, N. (2017, January 23–26). Emotion detection using noninvasive low cost sensors. Proceedings of the Seventh International Conference on Affective Computing and Intelligent Interaction, San Antonio, TX, USA. · DOI
  75. Zhao, B., Wang, Z., Yu, Z., and Guo, B. (2018, January 8–12). EmotionSense: Emotion Recognition Based on Wearable Wristband. Proceedings of the 2018 IEEE SmartWorld, Ubiquitous Intelligence Computing, Advanced Trusted Computing, Scalable Computing Communications, Cloud Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI), Guangzhou, China. · DOI
  76. Greco, 2018, Affective computing in virtual reality: Emotion recognition from brain and heartbeat dynamics using wearable sensors, Sci. Rep., 8, 13657, 10.1038/s41598-018-32063-4 · DOI · Paper page
  77. Hassan, 2019, Human emotion recognition using deep belief network architecture, Inf. Fusion, 51, 10, 10.1016/j.inffus.2018.10.009 · DOI · Paper page
  78. Mikels, 2005, Emotional category data on images from the International Affective Picture System, Behav. Res. Methods, 37, 626, 10.3758/BF03192732 · DOI · Paper page
  79. Hanai, T., and Ghassemi, M. (2017, January 4–10). Predicting Latent Narrative Mood Using Audio and Physiologic Data. Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.
  80. Peter, C., and Beale, R. (2008). Emotion Recognition through Multiple Modalities: Face, Body Gesture, Speech. Affect and Emotion in Human-Computer Interaction: From Theory to Applications, Springer.
  81. Dobriek, 2013, Towards Efficient Multi-Modal Emotion Recognition, Int. J. Adv. Robot. Syst., 10, 53, 10.5772/54002 · DOI
  82. Taylor, B., Dey, A., Siewiorek, D., and Smailagic, A. (2015, January 7–11). Using Physiological Sensors to Detect Levels of User Frustration Induced by System Delays. Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Osaka, Japan. · DOI
  83. Mason, 1968, A review of psychoendocrine research on the sympathetic-adrenal medullary system, Psychosom. Med., 30, 631, 10.1097/00006842-196809000-00022 · DOI · Paper page
  84. Lupien, 2007, The effects of stress and stress hormones on human cognition: Implications for the field of brain and cognition, Brain Cogn., 65, 209, 10.1016/j.bandc.2007.02.007 · DOI · Paper page
  85. Gjoreski, M., Gjoreski, H., and Gams, M. (2016, January 12–16). Continuous stress detection using a wrist device: In laboratory and real life. Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct, Heidelberg, Germany. · DOI · Paper page
  86. Wijsman, J., Grundlehner, B., Liu, H., and Hermens, H. (2013, January 2–5). Wearable Physiological Sensors Reflect Mental Stress State in Office-Like Situations. Proceedings of the 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction, Geneva, Switzerland. · DOI
  87. Rubin, J., Eldardiry, H., Abreu, R., Ahern, S., Du, H., Pattekar, A., and Bobrow, D. (2015, January 7–11). Towards a mobile and wearable system for predicting panic attacks. Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Osaka, Japan. · DOI
  88. Sano, A., Yu, A., McHill, A., Phillips, A., and Picard, R. (2015, January 25–29). Prediction of Happy-Sad mood from daily behaviors and previous sleep history. Proceedings of the 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Milan, Italy. · DOI
  89. Koh, 2001, Development of the Stress Response Inventory and its application in clinical practice, Psychosom. Med., 63, 668, 10.1097/00006842-200107000-00020 · DOI
  90. John, O., and Srivastava, S. (1999). The Big Five trait taxonomy: History, measurement, and theoretical perspectives. Handbook of Personality: Theory and Research, Guilford Press.
  91. Morris, 2009, Mobile Heart Health: Project Highlight, IEEE Pervasive Comput., 8, 57, 10.1109/MPRV.2009.31 · DOI
  92. Pollak, J.P., Adams, P., and Gay, G. (2011, January 7–12). PAM: A Photographic Affect Meter for Frequent, in Situ Measurement of Affect. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Vancouver, BC, Canada.
  93. Horne, 1976, A self-assessment questionnaire to determine morningness-eveningness in human circadian rhythms, Int. J. Chronobiol., 4, 97
  94. Bulling, 2014, A tutorial on human activity recognition using body-worn inertial sensors, ACM Comput. Surv., 46, 33, 10.1145/2499621 · DOI · Paper page
  95. 2010, Pattern classification with missing data: A review, Neural Comput. Appl., 19, 263, 10.1007/s00521-009-0295-6 · DOI · Paper page
  96. Behar, 2013, ECG Signal Quality During Arrhythmia and Its Application to False Alarm Reduction, IEEE Trans. Biomed. Eng., 60, 1660, 10.1109/TBME.2013.2240452 · DOI · Paper page
  97. Biswas, 2019, Heart Rate Estimation From Wrist-Worn Photoplethysmography: A Review, IEEE Sens. J., 19, 6560, 10.1109/JSEN.2019.2914166 · DOI · Paper page
  98. Lee, 2010, Improved elimination of motion artifacts from a photoplethysmographic signal using a Kalman smoother with simultaneous accelerometry, Physiol. Meas., 31, 1585, 10.1088/0967-3334/31/12/003 · DOI
  99. Ram, 2012, A Novel Approach for Motion Artifact Reduction in PPG Signals Based on AS-LMS Adaptive Filter, IEEE Trans. Instrum. Meas., 61, 1445, 10.1109/TIM.2011.2175832 · DOI · Paper page
  100. Reiss, A., Indlekofer, I., Schmidt, P., and Van Laerhoven, K. (2019). Deep PPG: Large-Scale Heart Rate Estimation with Convolutional Neural Networks. Sensors, 19. · DOI · Paper page
  101. Salehizadeh, S.M.A., Dao, D., Bolkhovsky, J., Cho, C., Mendelson, Y., and Chon, K.H. (2016). A Novel Time-Varying Spectral Filtering Algorithm for Reconstruction of Motion Artifact Corrupted Heart Rate Signals During Intense Physical Activities Using a Wearable Photoplethysmogram Sensor. Sensors, 16. · DOI · Paper page
  102. Greco, 2016, cvxEDA: A Convex Optimization Approach to Electrodermal Activity Processing, IEEE Trans. Biomed. Eng., 63, 797
  103. Benedek, 2010, Decomposition of skin conductance data by means of nonnegative deconvolution, Psychophysiology, 47, 647
  104. Willigenburg, 2012, Removing ECG contamination from EMG recordings: A comparison of ICA-based and other filtering procedures, J. Electromyogr. Kinesiol., 22, 485, 10.1016/j.jelekin.2012.01.001 · DOI · Paper page
  105. Huynh, T., and Schiele, B. (2005, January 12–14). Analyzing Features for Activity Recognition. Proceedings of the 2005 Joint Conference on Smart Objects and Ambient Intelligence: Innovative Context-aware Services: Usages and Technologies, Grenoble, France. · DOI · Paper page
  106. Parkka, J., Ermes, M., Antila, K., van Gils, M., Manttari, A., and Nieminen, H. (2007, January 22–26). Estimating Intensity of Physical Activity: A Comparison of Wearable Accelerometer and Gyro Sensors and 3 Sensor Locations. Proceedings of the 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Lyon, France. · DOI
  107. Lim, 1997, Decomposing skin conductance into tonic and phasic components, Int. J. Psychophysiol., 25, 97, 10.1016/S0167-8760(96)00713-1 · DOI · Paper page
  108. Rainville, 2006, Basic emotions are associated with distinct patterns of cardiorespiratory activity, Int. J. Psychophysiol., 61, 5, 10.1016/j.ijpsycho.2005.10.024 · DOI · Paper page
  109. Kollia, V. (2016). Personalization Effect on Emotion Recognition from Physiological Data: An Investigation of Performance on Different Setups and Classifiers. ArXiv.
  110. Cernadas, 2014, Do We Need Hundreds of Classifiers to Solve Real World Classification Problems?, J. Mach. Learn. Res., 15, 3133
  111. Breiman, 2001, Random Forests, Mach. Learn., 45, 5, 10.1023/A:1010933404324 · DOI · Paper page
  112. Freund, 1999, A Short Introduction to Boosting Yoav, J. Jpn. Soc. Artif. Intell., 14, 1612
  113. Münzner, S., Schmidt, P., Reiss, A., Hanselmann, M., Stiefelhagen, R., and Dürichen, R. (2017, January 11–15). CNN-based Sensor Fusion Techniques for Multimodal Human Activity Recognition. Proceedings of the 2017 ACM International Symposium on Wearable Computers, Maui, HI, USA. · DOI · Paper page
  114. Guyon, 2003, An Introduction to Variable and Feature Selection, J. Mach. Learn. Res., 3, 1157
  115. Ertin, E., Stohs, N., Kumar, S., Raij, A., al’Absi, M., and Shah, S. (2011, January 1–4). AutoSense: Unobtrusively wearable sensor suite for inferring the onset, causality, and consequences of stress in the field. Proceedings of the 9th ACM Conference on Embedded Networked Sensor Systems, Seattle, WA, USA. · DOI · Paper page
  116. Sadri, 2018, Wearable and Implantable Epidermal Paper-Based Electronics, ACS Appl. Mater. Interfaces, 10, 31061, 10.1021/acsami.8b11020 · DOI
  117. Ameri, S.K., Ho, R., Jang, H., Wang, Y., Schnyer, D.M., Akinwande, D., and Lu, N. (2016, January 3–7). Thinnest transparent epidermal sensor system based on graphene. Proceedings of the 2016 IEEE International Electron Devices Meeting (IEDM), San Francisco, CA, USA. · DOI
  118. Reiss, A., and Amft, O. (2015). Design challenges of real wearable computers. Fundamentals of Wearable Computers and Augmented Reality, CRC Press.
  119. Lonini, L., Shawen, N., Ghaffari, R., Rogers, J., and Jayarman, A. (2017, January 11–15). Automatic Detection of Spasticity from Flexible Wearable Sensors. Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers, Maui, HI, USA. · DOI
  120. Vrijkotte, 2000, Effects of Work Stress on Ambulatory Blood Pressure, Heart Rate, and Heart Rate Variability, Hypertension, 35, 880, 10.1161/01.HYP.35.4.880 · DOI · Paper page
  121. Gesche, 2012, Continuous blood pressure measurement by using the pulse transit time: Comparison to a cuff-based method, Eur. J. Appl. Physiol., 112, 309, 10.1007/s00421-011-1983-3 · DOI · Paper page
  122. Pandia, K., Ravindran, S., Cole, R., Kovacs, G., and Giovangrandi, L. (2010, January 14–19). Motion artifact cancellation to obtain heart sounds from a single chest-worn accelerometer. Proceedings of the 2010 IEEE International Conference on Acoustics, Speech and Signal Processing, Dallas, TX, USA. · DOI
  123. Popoola, G.A., Graves, C.A., and Ford-Booker, P. (2018, January 6–8). Using Unsupervised Anomaly Detection to Analyze Physiological Signals for Emotion Recognition. Proceedings of the 2018 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT), Louisville, KY, USA. · DOI
  124. Yang, J., Nguyen, M., San, P., Li, X., and Krishnaswamy, S. (2015, January 6–8). Deep Convolutional Neural Networks on Multichannel Time Series for Human Activity Recognition. Proceedings of the 24th International Conference on Artificial Intelligence, Louisville, KY, USA.
  125. Enke, 2005, The use of data mining and neural networks for forecasting stock market returns, Expert Syst. Appl., 29, 927, 10.1016/j.eswa.2005.06.024 · DOI · Paper page
  126. Vincent, 2010, Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion, J. Mach. Learn. Res., 11, 3371
  127. Bhattacharya, S., and Lane, N.D. (2016, January 14–18). From smart to deep: Robust activity recognition on smartwatches using deep learning. Proceedings of the 2016 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops), Sydney, Australia. · DOI · Paper page
  128. Budner, P., Eirich, J., and Gloor, P. (2017). “Making you happy makes me happy”—Measuring Individual Mood with Smartwatches. arXiv.
  129. Kanjo, 2015, Emotions in context: Examining pervasive affective sensing systems, applications, and analyses, Pers. Ubiquitous Comput., 19, 1197, 10.1007/s00779-015-0842-3 · DOI

Cited by

See all 218

Metadata

Authors
Schmidt, P., Reiss, A., Dürichen, R., & Laerhoven, K. V.
Venue
Sensors
Publisher
MDPI AG
Published
2019-09-20
Volume
19
Issue
19
Pages
4079
ISSN
1424-8220 (ISSN-L)
OpenAlex
W2974457857
Cited by
218
References
53
FWCI
24.06
Type
journal article
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Wearable-Based Affect Recognition—A Review. https://app.cochat.ai/papers/10.3390/s19194079
The paper
Schmidt, P., Reiss, A., Dürichen, R., & Laerhoven, K. V. (2019). Wearable-Based Affect Recognition—A Review. Sensors. https://doi.org/10.3390/s19194079

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.