The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
The Ethics of Emotion in Artificial Intelligence Systems
Open accessAbstract
In this paper, we develop a taxonomy of conceptual models and proxy data used for digital analysis of human emotional expression and outline how the combinations and permutations of these models and data impact their incorporation into artificial intelligence (AI) systems. We argue we should not take computer scientists at their word that the paradigms for human emotions they have developed internally and adapted from other disciplines can produce ground truth about human emotions; instead, we ask how different conceptualizations of what emotions are, and how they can be sensed, measured and transformed into data, shape the ethical and social implications of these AI systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Picard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
The global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0088-2 · Cited by 6,220 · cited 1×
“envisioning documents [38, 43, 59], the EAI guidelines present a high-level thematic checklist for anyone engaged with “data about”
BackgroundCore affect and the psychological construction of emotion.
Russell, J. A. (2003) · Psychological Review · doi:10.1037/0033-295x.110.1.145 · Cited by 6,113 · cited 2×
“Both James Russell [102, 103] and Lisa Feldman Barrett [9, 10] have vigorously critiqued Basic Emotion Theory, arguing that while core affect is an important component of emotional experiences, emotion itself emerges out of human evaluative and experiential assessments of affective states in particular social contexts…”
BackgroundConstants across cultures in the face and emotion.
Ekman, P., & Friesen, W. V. (1971) · Journal of Personality and Social Psychology · doi:10.1037/h0030377 · Cited by 5,509
The Black Box Society: The Secret Algorithms That Control Money and Information
Pasquale, F. (2015) · doi:10.4159/harvard.9780674736061 · Cited by 3,796
Experimental evidence of massive-scale emotional contagion through social networks
Kramer, A. D. I., Guillory, J. E., & Hancock, J. T. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1320040111 · Cited by 3,687
JAMES, W. (1884) · Mind · doi:10.1093/mind/os-ix.34.188 · Cited by 3,446
How the machine “thinks”: Understanding opacity in machine learning algorithms
Burrell, J. (2016) · Big Data & Society · doi:10.1177/2053951715622512 · Cited by 3,196 · cited 1×
“A number of scholars have examined the ways individuals perceive, understand, and interpret the workings of algorithmic systems [22, 23].”
BackgroundBarocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048
POSNER, J., RUSSELL, J. A., & PETERSON, B. S. (2005) · Development and Psychopathology · doi:10.1017/s0954579405050340 · Cited by 2,602 · cited 1×
“assessments of affective states in particular social contexts [95].”
Background
Research works printed but not linked: 96
- Abu-Lughod L. and Lutz C.A. 1990. Introduction: emotion discourse and the politics of everyday life. Language and the Politics of Emotion. C.A. Lutz and L. Abu-Lughod eds. Cambridge University Press. 1--23.
- 10.1109/ASONAM.2016.7752329 · DOI
- Andalibi, N. and Buss, J. 2020. The Human in Emotion Recognition on Social Media: Attitudes, Outcomes, Risks. CHI '20: ACM Conference on Human Factors in Computing Systems (New York, NY, USA, Apr. 2020), 1--16.
- 10.1080/09502386.2011.600551 · DOI · Paper page
- Arnold M. 1960. Emotion and Personality. Columbia University Press.
- Bakir, V. and McStay, A. 2017. Fake News and The Economy of Emotions. Digital Journalism. 6, 2 (Jun. 2017), 154--175.
- 10.1207/s15327957pspr1001_2 · DOI · Paper page
- 10.1177/1529100619832930 · DOI · Paper page
- Ben Williamson 2019. Psychodata: disassembling the psychological, economic, and statistical infrastructure of "social- emotional learning." Journal of Education Policy (Oct. 2019), 1--26.
- Benjamin, R. 2019. Race after Technology: Abolitionist Tools for the New Jim Code. John Wiley & Sons.
- Birhane A. and Guest O. 2020. Towards decolonizing computational sciences. arXiv. · DOI
- 10.1145/1094562.1094570 · DOI · Paper page
- Boehner, K., DePaula, R., Dourish, P. and Sengers, P. 2007. How Emotion is Made and Measured. International Journal of Human-Computer Studies. 65, (2007), 275--291.
- 10.1145/1453152.1453155 · DOI
- 10.1080/1369118X.2010.530673 · DOI
- Brandt, M. and Stark, L. 2018. Exploring Digital Interventions in Mental Health: A Roadmap. Interventions. A. Shaw and D.T. Scott, eds. Peter Lang. 167--182.
- Brodny G. Kolakowska A. Landowska A. Szwoch M. Szwoch W. and Wróbel M.R. 2016. Comparison of selected off-the-shelf solutions for emotion recognition based on facial expressions. HSI. (2016) 397--404. · DOI
- Bucher, T. 2016. The algorithmic imaginary: exploring the ordinary affects of Facebook algorithms. Information, Communication & Society 20, 1 (Feb. 2016), 30--44.
- 10.11648/j.ijla.20200803.12 · doi:10.11648/j.ijla.20200803.12
- Clynes, M. 1989. Sentics: The Touch of the Emotions. Prism Press Ltd.
- Crawford, K. et al. 2019. AI Now 2019 Report. AI Now Institute.
- 10.1080/17530350.2016.1258000 · DOI
- de Giustino, D. 2016. Conquest of Mind: Phrenology and Victorian Social Thought. Routledge.
- Desmet P.M.A. and Roeser S. 2015. Emotions in Design for Values. Handbook of Ethics Values and Technological Design. J. van den Hoven P.E. Vermaas and I. van de Poel eds. Springer. 203--219. · DOI
- 10.1086/652024 · doi:10.1086/652024
- Dror, O.E. 2001. Counting the Affects: Discoursing in Numbers. Social Research. 68, 2 (Jul. 2001), 357--378.
- 10.1086/384322 · DOI
- Eubanks, V. 2018. Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor. St. Martin's Press.
- Fernandez L. and Matt S.J. 2019. Bored Lonely Angry Stupid. Harvard University Press. · doi:10.4159/9780674239364
- Fiesler, C. and Proferes, N. 2018. "Participant" Perceptions of Twitter Research Ethics. Social Media + Society. 4, 1 (Mar. 2018), 205630511876336--14.
- Fridlund, A.J. 1994. Human Facial Expression: An Evolutionary View. Academic Press.
- Gates, K. 2011. Our Biometric Future: Facial Recognition Technology and the Culture of Surveillance. New York University Press.
- Ghassemi M. Celi L.A. and Stone D.J. 2015. State of the art review: the data revolution in critical care. Critical care (London England). 19 1 (Mar. 2015) 118--9. · DOI
- Gould D. 2010. On Affect and Protest. Political Emotions. J. Staiger A. Cvetkovich and A. Reynolds eds. Routledge. 18--44.
- Greene, D., Hoffmann, A.L. and Stark, L. 2019. Better, Nicer, Clearer, Fairer. HICSS 2019 (Jan. 2019), 2122--2131.
- Hard Feelings --- Inside Out, Silicon Valley, and Why Technologizing Emotion and Memory Is a Dangerous Idea: 2015. https://lareviewofbooks.org/essay/hard-feelings-inside-out-silicon-valley-and-why-technologizing-emotion-and-memory-is-a-dangerous-idea. Accessed: 2015-09-30.
- Hardt, M. 1999. Affective Labor. boundary 2. 26, 2 (1999), 89--100.
- Hassan, M.M., Alam, M.G.R., Uddin, M.Z., Huda, S., Almogren, A. and Fortino, G. 2019. Human emotion recognition using deep belief network architecture. Information Fusion. 51, (Nov. 2019), 10--18.
- Heise, D.R. 2007. Expressive Order. Springer.
- Hochschild, A.R. 2003. The Managed Heart: Commercialization of Human Feeling. University of California Press.
- Höök K. Isbister K. Westerman S. Gardner P. Sutherland E. Vasalou A. Sundström P. Kaye J. and Laaksolahti J. 2010. Evaluation of Affective Interactive Applications. Emotion-Oriented Systems. Springer Berlin Heidelberg. 687--703. · DOI
- 10.1016/j.ijhcs.2006.11.017 · DOI
- Izard, C.E. 1972. Patterns of Emotions: A New Analysis of Anxiety and Depression. Academic Press.
- 10.5749/j.ctv65sz27 · DOI
- Kerr, I. and McGill, J. 2007. Emanations, Snoop Dogs and Reasonable Expectations of Privacy. Criminal Law Quarterly. 52, 3 (2007), 392--431.
- Kim, D., Frank, M.G. and Kim, S.T. 2014. Emotional display behavior in different forms of Computer Mediated Communication. Computers in Human Behavior. 30, (Jan. 2014), 222--229.
- Lazarus, R.S. 1991. Emotion and Adaptation. Oxford University Press.
- Leahu, L., Schwenk, S. and Sengers, P. 2008. Subjective Objectivity: Negotiating Emotional Meaning. DIS '08. (February 25-27 2008), 425--434.
- Leys, R. 2017. The Ascent of Affect. University of Chicago Press.
- Littlefield M. and Johnson J. 2012. The Neuroscientific Turn: Transdisciplinarity in the Age of the Brain. University of Michigan Press. · DOI
- 10.1086/381915 · DOI
- MacKenzie, D.A. 2016. An Engine, Not a Camera. The MIT Press.
- 10.18574/nyu/9780814762790.001.0001 · doi:10.18574/nyu/9780814762790.001.0001
- Martin E. 2007. Bipolar Expeditions. Princeton University Press. · DOI · Paper page
- 10.4135/9781526451293 · DOI · Paper page
- 10.1177/2053951716666868 · DOI
- McStay A. and Urquhart L. 2019. "This time with feeling?" Assessing EU data governance implications of out of home appraisal based emotional AI. First Monday. (2019). · DOI
- Nagel, T. 1979. The Fragmentation of Value. Mortal Questions. Cambridge University Press. 128--141.
- 10.1145/2566966 · DOI
- Ngai, S. 2002. "A Foul Lump Started Making Promises in My Voice": Race, Affect, and the Animated Subject. American Literature. 74, 3 (2002), 571--602.
- 10.1093/acprof:oso/9780199999736.001.0001 · DOI · Paper page
- Parisi, D. 2018. Archaeologies of Touch: Interfacing with Haptics from Electricity to Computing. University of Minnesota Press.
- Pasquale F. 2015. Privacy Autonomy and Internet Platforms. Privacy in the Modern Age The Search for Solutions. M. Rotenberg J. Horwitz and J. Scott eds. 165--173. · doi:10.2307/jj.26193122.22
- Pasquale, F. 2015. The Black Box Society. Harvard University Press.
- 10.1093/oxfordjournals.aje.a114892 · DOI · Paper page
- 10.5555/265013 · doi:10.5555/265013
- 10.1023/A:1018643815520 · DOI
- Picard, R.W. and Klein, J. 2002. Computers that recognise and respond to user emotion: theoretical and practical implications. Interacting with Computers. 14, (2002), 141--169.
- Picard, R.W. and Scheirer, J. 2001. The Galvactivator: A Glove that Senses and Communicates Skin Conductivity. Proceedings from the 9th International Conference on Human-Computer Interaction (New Orleans, LA, 2001), 1--6.
- Prinz, J.J. 2004. Introduction: Piecing Passions Apart. Gut Reactions: A Perceptual Theory of Emotion. Oxford University Press. 1--11.
- 10.1177/1754073909103589 · DOI
- 10.1016/j.visinf.2019.10.003 · DOI
- 10.2139/ssrn.3281765 · DOI · Paper page
- 10.1080/02699930902809375 · DOI · Paper page
- Scarantino, A. and de Sousa, R. 2018. Emotion. The Stanford Encyclopedia of Philosophy. E.N. Zalta, ed.
- Scheuerman, M.K., Paul, J.M. and Brubaker, J.R. 2019. How Computers See Gender. Proceedings of the ACM on Human-Computer Interaction. 3, CSCW (Nov. 2019), 1--33.
- Schlag P. 1997. Law and Phrenology. Harvard Law Review. 110 (1997) 877--921. · doi:10.2307/1342231
- 10.1007/BF03392404 · DOI
- 10.1177/0003122416650963 · DOI
- Schuller, K. 2018. The Biopolitics of Feeling. Duke University Press.
- Shank, D.B. 2014. Technology and Emotions. Handbook of the Sociology of Emotions: Volume II. Springer Netherlands. 511--528.
- Solomon, R.C. 2003. What Is an Emotion?: Classic and Contemporary Readings. Oxford University Press.
- Stark L. 2019. Affect and Emotion in digitalSTS. digitalSTS: A Field Guide for Science Technology Studies. J. Vertesi and D. Ribes eds. 117--135. · doi:10.2307/j.ctvc77mp9.13
- 10.1177/0306312718772094 · DOI · Paper page
- Stark, L. 2019. Facial recognition is the plutonium of AI. XRDS: Crossroads, The ACM Magazine for Students. 25, 3 (Apr. 2019), 50--55.
- Stark, L. 2018. Facial recognition, emotion and race in animated social media. First Monday. 23, 9 (Sep. 2018).
- 10.1080/01972243.2015.1107167 · DOI
- Stromfelt H. Zhang Y. and Schuller B.W. 2017. Emotion-augmented machine learning: Overview of an emerging domain. ACII. (2017) 305--312. · DOI
- Terry, N.P. 2014. Big Data Proxies and Health Privacy Exceptionalism. 24 Health Matrix 65 (2014), 1--45.
- Tomkins S. and Izard C.E. 1965. Affect Cognition and Personality: Empirical Studies. Springer.
- Williamson, B. 2017. Moulding student emotions through computational psychology: affective learning technologies and algorithmic governance. Educational Media International. 10, 1 (Nov. 2017), 1--22.
- Wilson, E.A. 2010. Affect and Artificial Intelligence. University of Washington Press.
- Wilson E.A. 2015. Gut Feminism. Duke University Press. · doi:10.2307/j.ctv11hpr18
- 10.1145/3057270 · DOI · Paper page
- 2018. The overly Social Network: Why the real villain in the Cambridge Analytica story might be Facebook | CBC Radio. (2018).
- 2007. What is Emotion? Jerome Kagan Ed. Yale University Press.
Cited by
Physiognomic Artificial Intelligence
Stark, L., & Hutson, J. (2021) · doi:10.2139/ssrn.3927300 · Cited by 139
Self-citationRegulating AI in Mental Health: Ethics of Care Perspective
Tavory, T. (2024) · JMIR Mental Health · doi:10.2196/58493 · Cited by 108
Demystifying the Draft EU Artificial Intelligence Act
Veale, M., & Zuiderveen Borgesius, F. (2021) · doi:10.31235/osf.io/38p5f · Cited by 91
Perrotta, C., Selwyn, N., & Ewin, C. (2024) · New Media & Society · doi:10.1177/14614448221075296 · Cited by 59
Zheng, W., Yu, J., Xia, R., & Wang, S. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.861 · Cited by 51
Metadata
- Authors
- Stark, L., & Hoey, J.
- Venue
- Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency
- Publisher
- ACM
- Published
- 2021-03
- Pages
- 782-793
- OpenAlex
- W3133752603
- Cited by
- 179
- References
- 28
- FWCI
- 24.83
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Ethics of Emotion in Artificial Intelligence Systems. https://app.cochat.ai/papers/10.1145/3442188.3445939
- The paper
- Stark, L., & Hoey, J. (2021). The Ethics of Emotion in Artificial Intelligence Systems. Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency. https://doi.org/10.1145/3442188.3445939
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.