Data Subjects' Conceptualizations of and Attitudes Toward Automatic Emotion Recognition-Enabled Wellbeing Interventions on Social Media
Open accessThe DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
Automatic emotion recognition (ER)-enabled wellbeing interventions use ER algorithms to infer the emotions of a data subject (i.e., a person about whom data is collected or processed to enable ER) based on data generated from their online interactions, such as social media activity, and intervene accordingly. The potential commercial applications of this technology are widely acknowledged, particularly in the context of social media. Yet, little is known about data subjects' conceptualizations of and attitudes toward automatic ER-enabled wellbeing interventions. To address this gap, we interviewed 13 US adult social media data subjects regarding social media-based automatic ER-enabled wellbeing interventions. We found that participants' attitudes toward automatic ER-enabled wellbeing interventions were predominantly negative. Negative attitudes were largely shaped by how participants compared their conceptualizations of Artificial Intelligence (AI) to the humans that traditionally deliver wellbeing support. Comparisons between AI and human wellbeing interventions were based upon human attributes participants doubted AI could hold: 1) helpfulness and authentic care; 2) personal and professional expertise; 3) morality; and 4) benevolence through shared humanity. In some cases, participants' attitudes toward automatic ER-enabled wellbeing interventions shifted when participants conceptualized automatic ER-enabled wellbeing interventions' impact on others, rather than themselves. Though with reluctance, a minority of participants held more positive attitudes toward their conceptualizations of automatic ER-enabled wellbeing interventions, citing their potential to benefit others: 1) by supporting academic research; 2) by increasing access to wellbeing support; and 3) through egregious harm prevention. However, most participants anticipated harms associated with their conceptualizations of automatic ER-enabled wellbeing interventions for others, such as re-traumatization, the spread of inaccurate health information, inappropriate surveillance, and interventions informed by inaccurate predictions. Lastly, while participants had qualms about automatic ER-enabled wellbeing interventions, we identified three development and delivery qualities of automatic ER-enabled wellbeing interventions upon which their attitudes toward them depended: 1) accuracy; 2) contextual sensitivity; and 3) positive outcome. Our study is not motivated to make normative statements about whether or how automatic ER-enabled wellbeing interventions should exist, but to center voices of the data subjects affected by this technology. We argue for the inclusion of data subjects in the development of requirements for ethical and trustworthy ER applications. To that end, we discuss ethical, social, and policy implications of our findings, suggesting that automatic ER-enabled wellbeing interventions imagined by participants are incompatible with aims to promote trustworthy, socially aware, and responsible AI technologies in the current practical and regulatory landscape in the US.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Basics of Qualitative Research (3rd ed.): Techniques and Procedures for Developing Grounded Theory
Corbin, J., & Strauss, A. (2008) · SAGE · doi:10.4135/9781452230153 · Cited by 12,136
Experimental evidence of massive-scale emotional contagion through social networks
Kramer, A. D. I., Guillory, J. E., & Hancock, J. T. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1320040111 · Cited by 3,687
The effect of emotion on cue utilization and the organization of behavior
Easterbrook, J. A. (1959) · Psychological Review · doi:10.1037/h0047707 · Cited by 3,090 · cited 1×
“Human emotion holds powerful influence over how we engage with the world around us [68].”
BackgroundLerner, J. S., Li, Y., Valdesolo, P., & Kassam, K. S. (2015) · Annual Review of Psychology · doi:10.1146/annurev-psych-010213-115043 · Cited by 2,913
Datafication, dataism and dataveillance: Big Data between scientific paradigm and ideology
Van Dijck, J. (2014) · Surveillance & Society · doi:10.24908/ss.v12i2.4776 · Cited by 2,203
Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications
Calvo, R. A., & D'Mello, S. (2010) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2010.1 · Cited by 1,893
Fairness and Abstraction in Sociotechnical Systems
Selbst, A. D., Boyd, D., Friedler, S. A., Venkatasubramanian, S., & Vertesi, J. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287598 · Cited by 1,631
Eysenbach, G. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1157 · Cited by 1,351
The Costs of Connection: How Data Is Colonizing Human Life and Appropriating It for Capitalism
Couldry, N., & Mejias, U. A. (2020) · doi:10.1515/9781503609754 · Cited by 1,246
Gillespie, T. (2014) · Media Technologies · doi:10.7551/mitpress/9042.003.0013 · Cited by 1,016
Torous, J., Kiang, M. V., Lorme, J., & Onnela, J.-P. (2016) · JMIR Mental Health · doi:10.2196/mental.5165 · Cited by 758
Bor, J., Venkataramani, A. S., Williams, D. R., & Tsai, A. C. (2018) · The Lancet · doi:10.1016/s0140-6736(18)31130-9 · Cited by 746
Instagram photos reveal predictive markers of depression
Reece, A. G., & Danforth, C. M. (2017) · EPJ Data Science · doi:10.1140/epjds/s13688-017-0110-z · Cited by 519
Andalibi, N., Haimson, O. L., De Choudhury, M., & Forte, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858096 · Cited by 378 · cited 1×
“Marginalized communities in particular depend on online information and social networks to seek support and community (e.g., [20, 23, 26, 28, 93]).”
BackgroundSelf-citationFrischmann, B., & Selinger, E. (2018) · doi:10.1017/9781316544846 · Cited by 330
Measuring post traumatic stress disorder in Twitter
Coppersmith, G., Harman, C., & Dredze, M. (2014) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v8i1.14574 · Cited by 316
Social media, big data, and mental health: current advances and ethical implications
Conway, M., & O’Connor, D. (2016) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2016.01.004 · Cited by 231 · cited 3×
“Echoing past work that has shown predominantly negative data subjects’ attitudes toward ER broadly, finding that people perceive algorithmic inferences of emotion as invasive and intrusive [22, 85], scholars from many disciplines including law, computing, philosophy, and psychiatry have sounded the alarm on the potent…”
BackgroundResultSocial sensing for epidemiological behavior change
Madan, A., Cebrian, M., Lazer, D., & Pentland, A. (2010) · Proceedings of the 12th ACM international conference on Ubiquitous computing · doi:10.1145/1864349.1864394 · Cited by 219 · cited 1×
“There has been increasing enthusiasm for population scale research and monitoring, particularly in the medical and computational social science fields [16, 54, 122, 158, 163].”
BackgroundEthical research protocols for social media health research
Benton, A., Coppersmith, G., & Dredze, M. (2017) · Proceedings of the First ACL Workshop on Ethics in Natural Language Processing · doi:10.18653/v1/w17-1612 · Cited by 219
A Taxonomy of Ethical Tensions in Inferring Mental Health States from Social Media
Chancellor, S., Birnbaum, M. L., Caine, E. D., Silenzio, V. M. B., & De Choudhury, M. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287587 · Cited by 214 · cited 5×
“Echoing past work that has shown predominantly negative data subjects’ attitudes toward ER broadly, finding that people perceive algorithmic inferences of emotion as invasive and intrusive [22, 85], scholars from many disciplines including law, computing, philosophy, and psychiatry have sounded the alarm on the potent…”
BackgroundResultInfluentialDarwin's contributions to our understanding of emotional expressions
Ekman, P. (2009) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2009.0189 · Cited by 203
Social Support, Reciprocity, and Anonymity in Responses to Sexual Abuse Disclosures on Social Media
Andalibi, N., Haimson, O. L., Choudhury, M. D., & Forte, A. (2018) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3234942 · Cited by 200
Self-citationJakesch, M., French, M., Ma, X., Hancock, J. T., & Naaman, M. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300469 · Cited by 190
Quantifying the Language of Schizophrenia in Social Media
Mitchell, M., Hollingshead, K., & Coppersmith, G. (2015) · Proceedings of the 2nd Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality · doi:10.3115/v1/w15-1202 · Cited by 172 · cited 1×
“Social media in particular has shown promise as platforms from which to harvest emotion-intensive data [15, 48, 62, 65, 114, 124, 148], and infer mental health conditions such as schizophrenia [37, 134], depression [54, 64, 148, 164], post-partum depression [63], or post-traumatic stress disorder [55].”
BackgroundBirnbaum, M. L., Ernala, S. K., Rizvi, A. F., De Choudhury, M., & Kane, J. M. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7956 · Cited by 168
Compulsion and “coercion” in mental health care
Szmukler, G. (2015) · World Psychiatry · doi:10.1002/wps.20264 · Cited by 147
Modeling and Understanding Visual Attributes of Mental Health Disclosures in Social Media
Manikonda, L., & De Choudhury, M. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025932 · Cited by 116 · cited 1×
“Social media in particular has shown promise as platforms from which to harvest emotion-intensive data [15, 48, 62, 65, 114, 124, 148], and infer mental health conditions such as schizophrenia [37, 134], depression [54, 64, 148, 164], post-partum depression [63], or post-traumatic stress disorder [55].”
BackgroundProtecting Whiteness: White Phenotypic Racial Stereotypicality Reduces Police Use of Force
Kahn, K. B., Goff, P. A., Lee, J. K., & Motamed, D. (2016) · Social Psychological and Personality Science · doi:10.1177/1948550616633505 · Cited by 98
How UX Practitioners Produce Findings in Usability Testing
Reeves, S. (2019) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3299096 · Cited by 34
Cited by
From promise to practice: towards the realisation of AI-informed mental health care
Koutsouleris, N., Hauser, T. U., Skvortsova, V., & De Choudhury, M. (2022) · The Lancet Digital Health · doi:10.1016/s2589-7500(22)00153-4 · Cited by 251
What is Human-Centered about Human-Centered AI? A Map of the Research Landscape
Capel, T., & Brereton, M. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580959 · Cited by 228
“Work in this area argues for the inclusion of humans in building AI as a potential means of mitigating ethical issues [168, 234].”
BackgroundFrom Treatment to Healing:Envisioning a Decolonial Digital Mental Health
Pendse, S. R., Nkemelu, D., Bidwell, N. J., Jadhav, S., Pathare, S., De Choudhury, M., & Kumar, N. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501982 · Cited by 115
Brewer, R. N. (2022) · CHI Conference on Human Factors in Computing Systems Extended Abstracts · doi:10.1145/3491101.3519642 · Cited by 43
Akter, T., Ahmed, T., Kapadia, A., & Swaminathan, M. (2022) · ACM Transactions on Accessible Computing · doi:10.1145/3506857 · Cited by 29
Metadata
- Authors
- Roemmich, K., & Andalibi, N.
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2021-10-13
- Volume
- 5
- Issue
- CSCW2
- Pages
- 1-34
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W3205314427
- Cited by
- 47
- References
- 29
- FWCI
- 9.27
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.