The DOI matches its Crossref record; 70 of the 73 references it cites were found in a registry or an index.
On Being Told How We Feel: How Algorithmic Sensor Feedback Influences Emotion Perception
Abstract
Algorithms and sensors are increasingly deployed for highly personal aspects of our everyday lives. Recent work suggests people have imperfect understanding of system outputs, often assuming sophisticated capabilities and deferring to feedback. We explore how people construe algorithmic interpretations of emotional data in personal informatics systems. A survey (n=188) showed strong interest in automatic stress and emotion tracking, but many respondents expected these systems to provide objective measurements for their emotional experiences. A second study examined how algorithmic sensor feedback influences emotional self-judgments, by comparing three system framings of physiological ElectroDermal Activity data (EDA): Positive ("alert and engaged"), Negative ("stressed"), and Control (no frame) in a mixed-methods study with 64 participants. Despite users reporting strategies to test system outputs, users still deferred to feedback and their perceived emotions were significantly influenced by feedback frames. Some users overrode personal judgments, believing the system had access to privileged information about their emotions. Based on these findings, we explore design implications for personal informatics including risks of users trusting systems that seemingly "unlock" hidden aspects of the self. We propose design approaches that provide opportunities for future emotion-monitoring systems to exploit these framing effects, and for users to more actively construe emotional states.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Emotional analytics is perceived as a key application by many users [16,17,18,39,90].”
From Progressive Disclosure: When, Why, and How Do Users Want Algorithmic Transparency Information? (2020) · cites this paper as [39]
In the citing paper
“Other work has shown that users will modify high stakes personal health behaviors based on false inferences about an algorithm's high accuracy [39,70].”
From Progressive Disclosure: When, Why, and How Do Users Want Algorithmic Transparency Information? (2020) · cites this paper as [39]
In the citing paper
“Emotional analytics is perceived as a key application by many users [38].”
From Progressive disclosure (2019) · cites this paper as [38]
Citations
Cites
Development and validation of brief measures of positive and negative affect: The PANAS scales.
Watson, D., Clark, L. A., & Tellegen, A. (1988) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.54.6.1063 · Cited by 32,433
A General Inductive Approach for Analyzing Qualitative Evaluation Data
Thomas, D. R. (2006) · American Journal of Evaluation · doi:10.1177/1098214005283748 · Cited by 10,858
An argument for basic emotions
Ekman, P. (1992) · Cognition and Emotion · doi:10.1080/02699939208411068 · Cited by 9,646 · cited 1×
“Classical theories of emotions argue for a set of basic, discrete emotional states (‘fear’, ‘anger’, ‘surprise’, ‘happiness’, ‘disgust’, ‘sadness’) that can be detected through physiological fingerprints such as heart rate, electrodermal activity (EDA), facial expression and so forth [19, 34].”
Background(1999) · Cited by 5,934
State-Trait Anxiety Inventory for Adults
Spielberger, C. D. (2012) · PsycTESTS Dataset · doi:10.1037/t06496-000 · Cited by 3,479 · cited 1×
“State-Trait Anxiety Inventory (STAI) Survey: The STAI for Adults short-form [69] is a 20-item scale to assess mental and physical symptoms of anxiety.”
(2007) · Cited by 3,233
Fredrickson, B. L., Tugade, M. M., Waugh, C. E., & Larkin, G. R. (2003) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.84.2.365 · Cited by 2,797
Boucsein, W. (2012) · doi:10.1007/978-1-4614-1126-0 · Cited by 2,526
(2017) · Cited by 2,433
Appraisal Processes in Emotion: Theory, Methods, Research
(2001) · doi:10.1093/oso/9780195130072.001.0001 · Cited by 2,384
Manual for the state-trait anxiety inventory (form Y) : "self-evaluation questionnaire"
Spielberger, C. D., Gorsuch, R. L., & Lushene, R. E. (1970) · Consulting Psychologists Press eBooks · Cited by 2,352
Annotating Expressions of Opinions and Emotions in Language
Wiebe, J., Wilson, T., & Cardie, C. (2005) · Language Resources and Evaluation · doi:10.1007/s10579-005-7880-9 · Cited by 1,755
Solving the Emotion Paradox: Categorization and the Experience of Emotion
Barrett, L. F. (2006) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr1001_2 · Cited by 1,669
A stage-based model of personal informatics systems
Li, I., Dey, A., & Forlizzi, J. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753409 · Cited by 1,100
Modeling Public Mood and Emotion: Twitter Sentiment and Socio-Economic Phenomena
Bollen, J., Mao, H., & Pepe, A. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v5i1.14171 · Cited by 936
Understanding quantified-selfers' practices in collecting and exploring personal data
Choe, E. K., Lee, N. B., Lee, B., Pratt, W., & Kientz, J. A. (2014) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557372 · Cited by 766
Personal tracking as lived informatics
Rooksby, J., Rost, M., Morrison, A., & Chalmers, M. (2014) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557039 · Cited by 655
Eslami, M., Rickman, A., Vaccaro, K., Aleyasen, A., Vuong, A., Karahalios, K., Hamilton, K., & Sandvig, C. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702556 · Cited by 627
Jakicic, J. M., Davis, K. K., Rogers, R. J., King, W. C., Marcus, M. D., Helsel, D., Rickman, A. D., Wahed, A. S., & Belle, S. H. (2016) · JAMA · doi:10.1001/jama.2016.12858 · Cited by 621 · cited 1×
“[35] showed that reflective self-monitoring with a fitness tracker actually decreased weight loss.”
BackgroundFilho, S. L., & Kane, B. T. (2016) · National Conference on Artificial Intelligence · Cited by 576
Why and why not explanations improve the intelligibility of context-aware intelligent systems
Lim, B. Y., Dey, A. K., & Avrahami, D. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1519023 · Cited by 552 · cited 1×
“One proposed remediation strategy is to provide explanations into how algorithms operate [4], although the benefits of these explanations are highly context-sensitive [43, 47], and do not guarantee increased user understanding.”
BackgroundIntelligibility and Accountability: Human Considerations in Context-Aware Systems
Bellotti, V., & Edwards, K. (2001) · Human–Computer Interaction · doi:10.1207/s15327051hci16234_05 · Cited by 471
How emotion is made and measured
Boehner, K., DePaula, R., Dourish, P., & Sengers, P. (2007) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2006.11.016 · Cited by 444
Making sense of sensing systems: five questions for designers and researchers
Bellotti, V., Back, M., Edwards, W. K., Grinter, R. E., Henderson, A., & Lopes, C. (2002) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/503376.503450 · Cited by 405
Turning the knots in your stomach into bows: reappraising arousal improves performance on the GRE
Jamieson, J. P., Mendes, W. B., Blackstock, E., & Schmader, T. (2010) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2009.08.015 · Cited by 376 · cited 3×
“Expected appraisals were collected as these are potentially influenced by primes alone [36, 37, 51, 52].”
BackgroundVisualized and Interacted Life: Personal Analytics and Engagements with Data Doubles
Ruckenstein, M. (2014) · Societies · doi:10.3390/soc4010068 · Cited by 375
First I "like" it, then I hide it: Folk Theories of Social Feeds
Eslami, M., Karahalios, K., Sandvig, C., Vaccaro, K., Rickman, A., Hamilton, K., & Kirlik, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858494 · Cited by 375
Modeling public mood and emotion: Twitter sentiment and socio-economic phenomena
Bollen, J., Pepe, A., & Mao, H. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0911.1583 · Cited by 316
Improving Acute Stress Responses: The Power of Reappraisal
Jamieson, J. P., Mendes, W. B., & Nock, M. K. (2013) · Current Directions in Psychological Science · doi:10.1177/0963721412461500 · Cited by 273
Rabbi, M., Aung, M. H., Zhang, M., & Choudhury, T. (2015) · Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2750858.2805840 · Cited by 265
Echoes from the past: how technology mediated reflection improves well-being
Isaacs, E., Konrad, A., Walendowski, A., Lennig, T., Hollis, V., & Whittaker, S. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2466137 · Cited by 251
Self-citationAssessing demand for intelligibility in context-aware applications
Lim, B. Y., & Dey, A. K. (2009) · Proceedings of the 11th international conference on Ubiquitous computing · doi:10.1145/1620545.1620576 · Cited by 246
DeVito, M. A., Birnholtz, J., Hancock, J. T., French, M., & Liu, S. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173694 · Cited by 244 · cited 2×
“Algorithms and sensors are now widely deployed in many aspects of our lives and recent research has begun to examine how people interpret and trust algorithmic output [16, 22, 26, 46, 70, 74, 77].”
BackgroundAffectAura: an intelligent system for emotional memory
McDuff, D., Karlson, A., Kapoor, A., Roseway, A., & Czerwinski, M. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208525 · Cited by 242
Bentley, F., Tollmar, K., Stephenson, P., Levy, L., Jones, B., Robertson, S., Price, E., Catrambone, R., & Wilson, J. (2013) · ACM Transactions on Computer-Human Interaction · doi:10.1145/2503823 · Cited by 235
Tell me more?: the effects of mental model soundness on personalizing an intelligent agent
Kulesza, T., Stumpf, S., Burnett, M., & Kwan, I. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2207678 · Cited by 225
Putting appraisal in context: Toward a relational model of appraisal and emotion
Smith, C. A., & Kirby, L. D. (2009) · Cognition and Emotion · doi:10.1080/02699930902860386 · Cited by 220
Kruijshaar, M. E., Barendregt, J., Vos, T., de Graaf, R., Spijker, J., & Andrews, G. (2005) · European Journal of Epidemiology · doi:10.1007/s10654-004-1009-0 · Cited by 217
Kashdan, T. B., Ferssizidis, P., Collins, R. L., & Muraven, M. (2010) · Psychological Science · doi:10.1177/0956797610379863 · Cited by 199
Smartphone Applications Utilizing Biofeedback Can Aid Stress Reduction
Dillon, A. C., Kelly, M., Robertson, I. H., & Robertson, D. A. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.00832 · Cited by 185
On introspection and self-perception: Does self-focused attention enable accurate self-knowledge?
Silvia, P. J., & Gendolla, G. H. E. (2001) · Review of General Psychology · doi:10.1037//1089-2680.5.3.241 · Cited by 182
Berry Mendes, W., Gray, H. M., Mendoza-Denton, R., Major, B., & Epel, E. S. (2007) · Psychological Science · doi:10.1111/j.1467-9280.2007.02014.x · Cited by 181
MoodWings: a wearable biofeedback device for real-time stress intervention
Maclean, D. L., Roseway, A., & Czerwinski, M. P. (2013) · International Conference on PErvasive Technologies Related to Assistive Environments (PETRA) · doi:10.1145/2504335.2504406 · Cited by 180
Personal Informatics, Self-Insight, and Behavior Change: A Critical Review of Current Literature
Kersten-van Dijk, E. T., Westerink, J. H. D. M., Beute, F., & IJsselsteijn, W. A. (2017) · Human–Computer Interaction · doi:10.1080/07370024.2016.1276456 · Cited by 171
EmotionCheck: leveraging bodily signals and false feedback to regulate our emotions
Costa, J., Adams, A. T., Jung, M. F., Guimbretière, F., & Choudhury, T. (2016) · Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2971648.2971752 · Cited by 168
Challenge and threat responses during downward and upward social comparisons
Mendes, W. B., Blascovich, J., Major, B., & Seery, M. (2001) · European Journal of Social Psychology · doi:10.1002/ejsp.80 · Cited by 164
MoodLight: Exploring Personal and Social Implications of Ambient Display of Biosensor Data
Snyder, J., Matthews, M. L., Chien, J. T., Chang, P. F., Sun, E., Abdullah, S., & Gay, G. K. (2015) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2675133.2675191 · Cited by 144
Using electrodermal activity to recognize ease of engagement in children during social interactions
Hernandez, J., Riobo, I., Rozga, A., Abowd, G. D., & Picard, R. W. (2014) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2632048.2636065 · Cited by 144
Depression, self-focused attention, and the negative memory bias.
Pyszczynski, T., Hamilton, J. C., Herring, F. H., & Greenberg, J. (1989) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.57.2.351 · Cited by 142
Yang, R., Shin, E., Newman, M., & Ackerman, M. S. (2015) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2750858.2804269 · Cited by 141
Love, hate, arousal and engagement: exploring audience responses to performing arts
Latulipe, C., Carroll, E. A., & Lottridge, D. (2011) · International Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979210 · Cited by 136
Adams, P., Rabbi, M., Rahman, T., Matthews, M. L., Voida, A., Gay, G. K., Choudhury, T., & Voida, S. (2014) · International Conference on Pervasive Computing Technologies for Healthcare · doi:10.4108/icst.pervasivehealth.2014.254959 · Cited by 134
Hollis, V., Konrad, A., Springer, A., Antoun, M., Antoun, C., Martin, R., & Whittaker, S. (2017) · Human–Computer Interaction · doi:10.1080/07370024.2016.1277724 · Cited by 103
Self-citationBenevolent deception in human computer interaction
Adar, E., Tan, D. S., & Teevan, J. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2466246 · Cited by 93 · cited 1×
“However, such design decisions have clear ethical considerations [3].”
BackgroundMeasuring the engagement level of TV viewers
Hernandez, J., Liu, Z., Hulten, G., DeBarr, D., Krum, K., & Zhang, Z. (2013) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2013.6553742 · Cited by 88
Warshaw, J., Matthews, T. L., Whittaker, S., Kau, C., Bengualid, M., & Smith, B. A. (2015) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702274 · Cited by 67
Self-citationThe Illusion of Control: Placebo Effects of Control Settings
Vaccaro, K., Huang, D., Eslami, M., Sandvig, C., Hamilton, K., & Karahalios, K. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173590 · Cited by 65
Food and Mood: Just-in-Time Support for Emotional Eating
Carroll, E. A., Czerwinski, M., Roseway, A., Kapoor, A., Johns, P., Rowan, K., & Schraefel, M. C. (2013) · 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction · doi:10.1109/acii.2013.48 · Cited by 64 · cited 1×
“Many commercial systems [ 23, 53] and research systems are described as automatically tracking emotional states [13, 48, 50, 63].”
BackgroundPredictive Analytics : The Power to Predict Who Will Click, Buy, Lie, or Die, Revised and Updated
(2015) · Wiley eBooks · doi:10.1002/9781119172536 · Cited by 61
Dealing With Information Overload in Multifaceted Personal Informatics Systems
Jones, S. L., & Kelly, R. (2017) · Human-Computer Interaction · doi:10.1080/07370024.2017.1302334 · Cited by 60
There's no such thing as gaining a pound
Kay, M., Morris, D., schraefel, M. C., & Kientz, J. A. (2013) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2493432.2493456 · Cited by 54
Assessing your mood online: acceptability and use of Moodscope
Drake, G., Csipke, E., & Wykes, T. (2012) · Psychological Medicine · doi:10.1017/s0033291712002280 · Cited by 45
Alan, A., Shann, M., Costanza, E., Ramchurn, S. D., & Seuken, S. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858222 · Cited by 43
Real-Time Representation Versus Response Elicitation in Biosensor Data
Matthews, M. L., Snyder, J., Reynolds, L., Chien, J. T., Shih, A., Lee, J. W., & Gay, G. K. (2015) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702485 · Cited by 30
Dice in the Black Box: User Experiences with an Inscrutable Algorithm
Springer, A., Hollis, V., & Whittaker, S. (2018) · arXiv · doi:10.48550/arxiv.1812.03219 · Cited by 29
Self-citationGross, S., Bardzell, J., Bardzell, S., & Stallings, M. D. (2017) · Human-Computer Interaction · doi:10.1080/07370024.2017.1287570 · Cited by 25
Seeing (Movement) is Believing: The Effect of Motion on Perception of Automatic Systems Performance
García García, P., Costanza, E., Verame, J., Nowacka, D., & Ramchurn, S. D. (2021) · Human–Computer Interaction · doi:10.1080/07370024.2018.1453815 · Cited by 17
Learning Lexico-Functional Patterns for First-Person Affect
Reed, L., Wu, J., Oraby, S., Anand, P., & Walker, M. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p17-2022 · Cited by 15
Comparison of Different Algorithms for Sentiment Analysis: Psychological Stress Notes
Yoon, S., Parsons, F., Kevin, S., Julian, J., Schwartz, J. E., Burg, M. M., Davidson, K. W., & Diaz, K. M. (2017) · Studies in health technology and informatics · doi:10.3233/978-1-61499-830-3-1292 · Cited by 13
Affective Health – designing for empowerment rather than stress diagnosis
Sanches, P., Vaara, E. K., Sjölinder, M., Weymann, C., & Höök, K. (2010) · Cited by 7
Research works printed but not linked: 3
- Pennebaker James W, 2001, Linguistic inquiry and word count: LIWC 2001. Mahway, Lawrence Erlbaum Associates, 71, 2001
- Rosch Paul J, 2001, The quandary of job stress compensation, Health and Stress, 3, 1
- 10.1037/1089-2680.5.3.241 · doi:10.1037/1089-2680.5.3.241 · Paper page
Cited by
Human trust in artificial intelligence: Review of empirical research
Glikson, E., & Woolley, A. W. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0057 · Cited by 2,921
Haque, M. D. R., & Rubya, S. (2023) · JMIR mHealth and uHealth · doi:10.2196/44838 · Cited by 404
Mapping and Taking Stock of the Personal Informatics Literature
Epstein, D. A., Caldeira, C., Figueiredo, M. C., Lu, X., Silva, L. M., Williams, L., Lee, J. H., Li, Q., Ahuja, S., Chen, Q., et al. (2020) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3432231 · Cited by 218
“and appraisal theory [252] to make sense of how algorithmic framing in an interface might influence a person’s reaction to seeing emotion data [113].”
BackgroundDesigning for Emotion Regulation Interventions: An Agenda for HCI Theory and Research
Slovak, P., Antle, A., Theofanopoulou, N., Daudén Roquet, C., Gross, J., & Isbister, K. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3569898 · Cited by 142
The Placebo Effect of Artificial Intelligence in Human–Computer Interaction
Kosch, T., Welsch, R., Chuang, L., & Schmidt, A. (2022) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3529225 · Cited by 137
Metadata
- Authors
- Hollis, V., Pekurovsky, A., Wu, E., & Whittaker, S.
- Affiliations
- University of California, Santa Cruz (US)
- Venue
- Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Published
- 2018-09-18
- Volume
- 2
- Issue
- 3
- Pages
- 1-31
- ISSN
- 2474-9567 (ISSN-L)
- OpenAlex
- W2889612522
- Cited by
- 52
- References
- 73
- Citations by year
- 2026: 3 · 2025: 11 · 2024: 7 · 2023: 7 · 2022: 11 · 2021: 3 · 2020: 6 · 2019: 2 · 2018: 2
- FWCI
- 3.24
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Keywords
- emotion monitoring, stress monitoring, personal informatics, algorithmic feedback, electrodermal activity, physiological sensors, framing effects, system trust
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.