The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Introducing WESAD, a Multimodal Dataset for Wearable Stress and Affect Detection
Abstract
Affect recognition aims to detect a person's affective state based on observables, with the goal to e.g. improve human-computer interaction. Long-term stress is known to have severe implications on wellbeing, which call for continuous and automated stress monitoring systems. However, the affective computing community lacks commonly used standard datasets for wearable stress detection which a) provide multimodal high-quality data, and b) include multiple affective states. Therefore, we introduce WESAD, a new publicly available dataset for wearable stress and affect detection. This multimodal dataset features physiological and motion data, recorded from both a wrist- and a chest-worn device, of 15 subjects during a lab study. The following sensor modalities are included: blood volume pulse, electrocardiogram, electrodermal activity, electromyogram, respiration, body temperature, and three-axis acceleration. Moreover, the dataset bridges the gap between previous lab studies on stress and emotions, by containing three different affective states (neutral, stress, amusement). In addition, self-reports of the subjects, which were obtained using several established questionnaires, are contained in the dataset. Furthermore, a benchmark is created on the dataset, using well-known features and standard machine learning methods. Considering the three-class classification problem ( baseline vs. stress vs. amusement ), we achieved classification accuracies of up to 80%,. In the binary case ( stress vs. non-stress ), accuracies of up to 93%, were reached. Finally, we provide a detailed analysis and comparison of the two device locations ( chest vs. wrist ) as well as the different sensor modalities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Development and validation of brief measures of positive and negative affect: The PANAS scales.
Watson, D., Clark, L. A., & Tellegen, A. (1988) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.54.6.1063 · Cited by 32,433
Heart rate variability: Standards of measurement, physiological interpretation, and clinical use
Malik, M., Bigger, J. T., Camm, A. J., Kleiger, R. E., Malliani, A., Moss, A. J., & Schwartz, P. J. (1996) · European Heart Journal · doi:10.1093/oxfordjournals.eurheartj.a014868 · Cited by 15,289
Kirschbaum, C., Pirke, K.-M., & Hellhammer, D. H. (2008) · Neuropsychobiology · doi:10.1159/000119004 · Cited by 6,093
DEAP: A Database for Emotion Analysis ;Using Physiological Signals
Koelstra, S., Muhl, C., Soleymani, M., Lee, J.-S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., & Patras, I. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.15 · Cited by 5,093
Autonomic nervous system activity in emotion: a review
Kreibig, S. D. (2010) · Biological Psychology · doi:10.1016/j.biopsycho.2010.03.010 · Cited by 3,188 · cited 2×
“This window size was chosen following Kreibig et al. [13].”
MethodThe Concepts of Stress and Stress System Disorders: Overview of Physical and Behavioral Homeostasis
Chrousos, G. P. (1992) · JAMA · doi:10.1001/jama.1992.03480090092034 · Cited by 2,689
Toward machine emotional intelligence: analysis of affective physiological state
Picard, R. W., Vyzas, E., & Healey, J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.954607 · Cited by 2,334
Detecting Stress During Real-World Driving Tasks Using Physiological Sensors
Healey, J. A., & Picard, R. W. (2005) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2005.848368 · Cited by 2,207
Introducing a New Benchmarked Dataset for Activity Monitoring
Reiss, A., & Stricker, D. (2012) · 2012 16th International Symposium on Wearable Computers · doi:10.1109/iswc.2012.13 · Cited by 1,456 · cited 1×
“The ACC-features were computed with a window size of five seconds, as similar window lengths are broadly applied for acceleration-based context recognition (e.g. Reiss et al. [21]).”
MethodSelf-citationEmotion recognition based on physiological changes in music listening
Kim, J., & Andre, E. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.26 · Cited by 1,082
Russell, J. A. (1979) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.37.3.345 · Cited by 857 · cited 1×
“A psychological model well suited for capturing affective states is Russel’s circumplex model [23].”
MethodAutomatic speech emotion recognition using recurrent neural networks with local attention
Mirsamadi, S., Barsoum, E., & Zhang, C. (2017) · 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2017.7952552 · Cited by 770
End-to-End Multimodal Emotion Recognition using Deep Neural Networks
Tzirakis, P., Trigeorgis, G., Nicolaou, M. A., Schuller, B., & Zafeiriou, S. (2017) · arXiv · doi:10.48550/arxiv.1704.08619 · Cited by 752
Discriminating Stress From Cognitive Load Using a Wearable EDA Device
Setz, C., Arnrich, B., Schumm, J., La Marca, R., Troster, G., & Ehlert, U. (2010) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2009.2036164 · Cited by 742
StressSense: detecting stress in unconstrained acoustic environments using smartphones
Lu, H., Frauendorfer, D., Rabbi, M., Mast, M. S., Chittaranjan, G. T., Campbell, A. T., Gatica-Perez, D., & Choudhury, T. (2012) · Proceedings of the 2012 ACM Conference on Ubiquitous Computing · doi:10.1145/2370216.2370270 · Cited by 511
Taylor, N. A., & Machado-Moreira, C. A. (2013) · Extreme Physiology & Medicine · doi:10.1186/2046-7648-2-4 · Cited by 490
Selye, H. (1976) · Psychopathology of Human Adaptation · doi:10.1007/978-1-4684-2238-2_9 · Cited by 424
cStress: towards a gold standard for continuous stress assessment in the mobile environment
Hovsepian, K., al'Absi, M., Ertin, E., Kamarck, T., Nakajima, M., & Kumar, S. (2015) · Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2750858.2807526 · Cited by 339
Plarre, K., Raij, A. B., Hossain, S. M., Ali, A. A., Nakajima, M., Al’Absi, M., Ertin, E., Kamarck, T. W., Kumar, S., Scott, M. S., et al. (2011) · ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN) · Cited by 337
Towards Measuring Stress with Smartphones and Wearable Devices During Workday and Sleep
Muaremi, A., Arnrich, B., & Tröster, G. (2013) · BioNanoScience · doi:10.1007/s12668-013-0089-2 · Cited by 302
Activity-Aware Mental Stress Detection Using Physiological Sensors
Sun, F.-T., Kuo, C., Cheng, H.-T., Buthpitiya, S., Collins, P., & Griss, M. (2012) · Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-642-29336-8_12 · Cited by 292
Short Stress State Questionnaire: Factor Structure and State Change Assessment
Helton, W. S., & Näswall, K. (2014) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000200 · Cited by 279
End-to-End Speech Emotion Recognition Using Deep Neural Networks
Tzirakis, P., Zhang, J., & Schuller, B. W. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8462677 · Cited by 277
Continuous stress detection using a wrist device: in laboratory and real life
Gjoreski, M., Gjoreski, H., Luštrek, M., & Gams, M. (2016) · Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct · doi:10.1145/2968219.2968306 · Cited by 230
Development and Evaluation of an Ambulatory Stress Monitor Based on Wearable Sensors
Choi, J., Ahmed, B., & Gutierrez-Osuna, R. (2012) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2011.2169804 · Cited by 221 · cited 2×
“In order to separate these two components, the method proposed by Choi et al. [3] was applied.”
BackgroundMethod2008 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)
(2007) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2007.899663 · Cited by 215
Eliciting positive, negative and mixed emotional states: A film library for affective scientists
Samson, A. C., Kreibig, S. D., Soderstrom, B., Wade, A. A., & Gross, J. J. (2016) · Cognition and Emotion · doi:10.1080/02699931.2015.1031089 · Cited by 155
HealthyOffice: Mood recognition at work using smartphones and wearable sensors
Zenonos, A., Khan, A., Kalogridis, G., Vatsikas, S., Lewis, T., & Sooriyabandara, M. (2016) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomw.2016.7457166 · Cited by 148
Stress and the Individual: Mechanisms Leading to Disease
McEwen, B. S. (1993) · Archives of Internal Medicine · doi:10.1001/archinte.1993.00410180039004 · Cited by 103
Rosmond, R., & Björntorp, P. A. (1998) · Metabolism · doi:10.1016/s0026-0495(98)90321-3 · Cited by 87
Selye, H. (1977) · School Guidance Worker · Cited by 59
Trapezius muscle EMG as predictor of mental stress
Wijsman, J., Grundlehner, B., Penders, J., & Hermens, H. J. (2010) · Wireless Health · doi:10.1145/1921081.1921100 · Cited by 53
Johnson, A. K., & Anderson, E. A. (1990) · Cited by 39
Factor analysis of the items of the state-trait anxiety inventory
Barker, B. M., Barker, H. R., & Wadsworth, A. P. (1977) · Journal of Clinical Psychology · doi:10.1002/1097-4679(197704)33:2<450::aid-jclp2270330225>3.0.co;2-m · Cited by 32
Cited by
A Review on Mental Stress Detection Using Wearable Sensors and Machine Learning Techniques
Gedam, S., & Paul, S. (2021) · IEEE Access · doi:10.1109/access.2021.3085502 · Cited by 467
Self-Supervised ECG Representation Learning for Emotion Recognition
Sarkar, P., & Etemad, A. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.3014842 · Cited by 383
Deep PPG: Large-Scale Heart Rate Estimation with Convolutional Neural Networks
Reiss, A., Indlekofer, I., Schmidt, P., & Van Laerhoven, K. (2019) · Sensors · doi:10.3390/s19143079 · Cited by 377
Self-citationBota, P. J., Wang, C., Fred, A. L. N., & Placido Da Silva, H. (2019) · IEEE Access · doi:10.1109/access.2019.2944001 · Cited by 322
Stress Detection with Machine Learning and Deep Learning using Multimodal Physiological Data
Bobade, P., & Vani, M. (2020) · 2020 Second International Conference on Inventive Research in Computing Applications (ICIRCA) · doi:10.1109/icirca48905.2020.9183244 · Cited by 301
Metadata
- Authors
- Schmidt, P., Reiss, A., Duerichen, R., Marberger, C., & Van Laerhoven, K.
- Venue
- Proceedings of the 20th ACM International Conference on Multimodal Interaction
- Publisher
- ACM
- Published
- 2018-10-02
- Pages
- 400-408
- OpenAlex
- W2894771803
- Cited by
- 1,277
- References
- 34
- FWCI
- 61.30
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.