Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 179

The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.

The Ethics of Emotion in Artificial Intelligence Systems

Open access
Stark, Luke, Hoey, Jesse · 2021 · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency

Abstract

In this paper, we develop a taxonomy of conceptual models and proxy data used for digital analysis of human emotional expression and outline how the combinations and permutations of these models and data impact their incorporation into artificial intelligence (AI) systems. We argue we should not take computer scientists at their word that the paradigms for human emotions they have developed internally and adapted from other disciplines can produce ground truth about human emotions; instead, we ask how different conceptualizations of what emotions are, and how they can be sensed, measured and transformed into data, shape the ethical and social implications of these AI systems.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3442188.3445939

Cites

28 of 28 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 28 references

Research works printed but not linked: 96

  1. Abu-Lughod L. and Lutz C.A. 1990. Introduction: emotion discourse and the politics of everyday life. Language and the Politics of Emotion. C.A. Lutz and L. Abu-Lughod eds. Cambridge University Press. 1--23.
  2. 10.1109/ASONAM.2016.7752329 · DOI
  3. Andalibi, N. and Buss, J. 2020. The Human in Emotion Recognition on Social Media: Attitudes, Outcomes, Risks. CHI '20: ACM Conference on Human Factors in Computing Systems (New York, NY, USA, Apr. 2020), 1--16.
  4. 10.1080/09502386.2011.600551 · DOI · Paper page
  5. Arnold M. 1960. Emotion and Personality. Columbia University Press.
  6. Bakir, V. and McStay, A. 2017. Fake News and The Economy of Emotions. Digital Journalism. 6, 2 (Jun. 2017), 154--175.
  7. 10.1207/s15327957pspr1001_2 · DOI · Paper page
  8. 10.1177/1529100619832930 · DOI · Paper page
  9. Ben Williamson 2019. Psychodata: disassembling the psychological, economic, and statistical infrastructure of "social- emotional learning." Journal of Education Policy (Oct. 2019), 1--26.
  10. Benjamin, R. 2019. Race after Technology: Abolitionist Tools for the New Jim Code. John Wiley & Sons.
  11. Birhane A. and Guest O. 2020. Towards decolonizing computational sciences. arXiv. · DOI
  12. 10.1145/1094562.1094570 · DOI · Paper page
  13. Boehner, K., DePaula, R., Dourish, P. and Sengers, P. 2007. How Emotion is Made and Measured. International Journal of Human-Computer Studies. 65, (2007), 275--291.
  14. 10.1145/1453152.1453155 · DOI
  15. 10.1080/1369118X.2010.530673 · DOI
  16. Brandt, M. and Stark, L. 2018. Exploring Digital Interventions in Mental Health: A Roadmap. Interventions. A. Shaw and D.T. Scott, eds. Peter Lang. 167--182.
  17. Brodny G. Kolakowska A. Landowska A. Szwoch M. Szwoch W. and Wróbel M.R. 2016. Comparison of selected off-the-shelf solutions for emotion recognition based on facial expressions. HSI. (2016) 397--404. · DOI
  18. Bucher, T. 2016. The algorithmic imaginary: exploring the ordinary affects of Facebook algorithms. Information, Communication & Society 20, 1 (Feb. 2016), 30--44.
  19. 10.11648/j.ijla.20200803.12 · doi:10.11648/j.ijla.20200803.12
  20. Clynes, M. 1989. Sentics: The Touch of the Emotions. Prism Press Ltd.
  21. Crawford, K. et al. 2019. AI Now 2019 Report. AI Now Institute.
  22. 10.1080/17530350.2016.1258000 · DOI
  23. de Giustino, D. 2016. Conquest of Mind: Phrenology and Victorian Social Thought. Routledge.
  24. Desmet P.M.A. and Roeser S. 2015. Emotions in Design for Values. Handbook of Ethics Values and Technological Design. J. van den Hoven P.E. Vermaas and I. van de Poel eds. Springer. 203--219. · DOI
  25. 10.1086/652024 · doi:10.1086/652024
  26. Dror, O.E. 2001. Counting the Affects: Discoursing in Numbers. Social Research. 68, 2 (Jul. 2001), 357--378.
  27. 10.1086/384322 · DOI
  28. Eubanks, V. 2018. Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor. St. Martin's Press.
  29. Fernandez L. and Matt S.J. 2019. Bored Lonely Angry Stupid. Harvard University Press. · doi:10.4159/9780674239364
  30. Fiesler, C. and Proferes, N. 2018. "Participant" Perceptions of Twitter Research Ethics. Social Media + Society. 4, 1 (Mar. 2018), 205630511876336--14.
  31. Fridlund, A.J. 1994. Human Facial Expression: An Evolutionary View. Academic Press.
  32. Gates, K. 2011. Our Biometric Future: Facial Recognition Technology and the Culture of Surveillance. New York University Press.
  33. Ghassemi M. Celi L.A. and Stone D.J. 2015. State of the art review: the data revolution in critical care. Critical care (London England). 19 1 (Mar. 2015) 118--9. · DOI
  34. Gould D. 2010. On Affect and Protest. Political Emotions. J. Staiger A. Cvetkovich and A. Reynolds eds. Routledge. 18--44.
  35. Greene, D., Hoffmann, A.L. and Stark, L. 2019. Better, Nicer, Clearer, Fairer. HICSS 2019 (Jan. 2019), 2122--2131.
  36. Hard Feelings --- Inside Out, Silicon Valley, and Why Technologizing Emotion and Memory Is a Dangerous Idea: 2015. https://lareviewofbooks.org/essay/hard-feelings-inside-out-silicon-valley-and-why-technologizing-emotion-and-memory-is-a-dangerous-idea. Accessed: 2015-09-30.
  37. Hardt, M. 1999. Affective Labor. boundary 2. 26, 2 (1999), 89--100.
  38. Hassan, M.M., Alam, M.G.R., Uddin, M.Z., Huda, S., Almogren, A. and Fortino, G. 2019. Human emotion recognition using deep belief network architecture. Information Fusion. 51, (Nov. 2019), 10--18.
  39. Heise, D.R. 2007. Expressive Order. Springer.
  40. Hochschild, A.R. 2003. The Managed Heart: Commercialization of Human Feeling. University of California Press.
  41. Höök K. Isbister K. Westerman S. Gardner P. Sutherland E. Vasalou A. Sundström P. Kaye J. and Laaksolahti J. 2010. Evaluation of Affective Interactive Applications. Emotion-Oriented Systems. Springer Berlin Heidelberg. 687--703. · DOI
  42. 10.1016/j.ijhcs.2006.11.017 · DOI
  43. Izard, C.E. 1972. Patterns of Emotions: A New Analysis of Anxiety and Depression. Academic Press.
  44. 10.5749/j.ctv65sz27 · DOI
  45. Kerr, I. and McGill, J. 2007. Emanations, Snoop Dogs and Reasonable Expectations of Privacy. Criminal Law Quarterly. 52, 3 (2007), 392--431.
  46. Kim, D., Frank, M.G. and Kim, S.T. 2014. Emotional display behavior in different forms of Computer Mediated Communication. Computers in Human Behavior. 30, (Jan. 2014), 222--229.
  47. Lazarus, R.S. 1991. Emotion and Adaptation. Oxford University Press.
  48. Leahu, L., Schwenk, S. and Sengers, P. 2008. Subjective Objectivity: Negotiating Emotional Meaning. DIS '08. (February 25-27 2008), 425--434.
  49. Leys, R. 2017. The Ascent of Affect. University of Chicago Press.
  50. Littlefield M. and Johnson J. 2012. The Neuroscientific Turn: Transdisciplinarity in the Age of the Brain. University of Michigan Press. · DOI
  51. 10.1086/381915 · DOI
  52. MacKenzie, D.A. 2016. An Engine, Not a Camera. The MIT Press.
  53. 10.18574/nyu/9780814762790.001.0001 · doi:10.18574/nyu/9780814762790.001.0001
  54. Martin E. 2007. Bipolar Expeditions. Princeton University Press. · DOI · Paper page
  55. 10.4135/9781526451293 · DOI · Paper page
  56. 10.1177/2053951716666868 · DOI
  57. McStay A. and Urquhart L. 2019. "This time with feeling?" Assessing EU data governance implications of out of home appraisal based emotional AI. First Monday. (2019). · DOI
  58. Nagel, T. 1979. The Fragmentation of Value. Mortal Questions. Cambridge University Press. 128--141.
  59. 10.1145/2566966 · DOI
  60. Ngai, S. 2002. "A Foul Lump Started Making Promises in My Voice": Race, Affect, and the Animated Subject. American Literature. 74, 3 (2002), 571--602.
  61. 10.1093/acprof:oso/9780199999736.001.0001 · DOI · Paper page
  62. Parisi, D. 2018. Archaeologies of Touch: Interfacing with Haptics from Electricity to Computing. University of Minnesota Press.
  63. Pasquale F. 2015. Privacy Autonomy and Internet Platforms. Privacy in the Modern Age The Search for Solutions. M. Rotenberg J. Horwitz and J. Scott eds. 165--173. · doi:10.2307/jj.26193122.22
  64. Pasquale, F. 2015. The Black Box Society. Harvard University Press.
  65. 10.1093/oxfordjournals.aje.a114892 · DOI · Paper page
  66. 10.5555/265013 · doi:10.5555/265013
  67. 10.1023/A:1018643815520 · DOI
  68. Picard, R.W. and Klein, J. 2002. Computers that recognise and respond to user emotion: theoretical and practical implications. Interacting with Computers. 14, (2002), 141--169.
  69. Picard, R.W. and Scheirer, J. 2001. The Galvactivator: A Glove that Senses and Communicates Skin Conductivity. Proceedings from the 9th International Conference on Human-Computer Interaction (New Orleans, LA, 2001), 1--6.
  70. Prinz, J.J. 2004. Introduction: Piecing Passions Apart. Gut Reactions: A Perceptual Theory of Emotion. Oxford University Press. 1--11.
  71. 10.1177/1754073909103589 · DOI
  72. 10.1016/j.visinf.2019.10.003 · DOI
  73. 10.2139/ssrn.3281765 · DOI · Paper page
  74. 10.1080/02699930902809375 · DOI · Paper page
  75. Scarantino, A. and de Sousa, R. 2018. Emotion. The Stanford Encyclopedia of Philosophy. E.N. Zalta, ed.
  76. Scheuerman, M.K., Paul, J.M. and Brubaker, J.R. 2019. How Computers See Gender. Proceedings of the ACM on Human-Computer Interaction. 3, CSCW (Nov. 2019), 1--33.
  77. Schlag P. 1997. Law and Phrenology. Harvard Law Review. 110 (1997) 877--921. · doi:10.2307/1342231
  78. 10.1007/BF03392404 · DOI
  79. 10.1177/0003122416650963 · DOI
  80. Schuller, K. 2018. The Biopolitics of Feeling. Duke University Press.
  81. Shank, D.B. 2014. Technology and Emotions. Handbook of the Sociology of Emotions: Volume II. Springer Netherlands. 511--528.
  82. Solomon, R.C. 2003. What Is an Emotion?: Classic and Contemporary Readings. Oxford University Press.
  83. Stark L. 2019. Affect and Emotion in digitalSTS. digitalSTS: A Field Guide for Science Technology Studies. J. Vertesi and D. Ribes eds. 117--135. · doi:10.2307/j.ctvc77mp9.13
  84. 10.1177/0306312718772094 · DOI · Paper page
  85. Stark, L. 2019. Facial recognition is the plutonium of AI. XRDS: Crossroads, The ACM Magazine for Students. 25, 3 (Apr. 2019), 50--55.
  86. Stark, L. 2018. Facial recognition, emotion and race in animated social media. First Monday. 23, 9 (Sep. 2018).
  87. 10.1080/01972243.2015.1107167 · DOI
  88. Stromfelt H. Zhang Y. and Schuller B.W. 2017. Emotion-augmented machine learning: Overview of an emerging domain. ACII. (2017) 305--312. · DOI
  89. Terry, N.P. 2014. Big Data Proxies and Health Privacy Exceptionalism. 24 Health Matrix 65 (2014), 1--45.
  90. Tomkins S. and Izard C.E. 1965. Affect Cognition and Personality: Empirical Studies. Springer.
  91. Williamson, B. 2017. Moulding student emotions through computational psychology: affective learning technologies and algorithmic governance. Educational Media International. 10, 1 (Nov. 2017), 1--22.
  92. Wilson, E.A. 2010. Affect and Artificial Intelligence. University of Washington Press.
  93. Wilson E.A. 2015. Gut Feminism. Duke University Press. · doi:10.2307/j.ctv11hpr18
  94. 10.1145/3057270 · DOI · Paper page
  95. 2018. The overly Social Network: Why the real villain in the Cambridge Analytica story might be Facebook | CBC Radio. (2018).
  96. 2007. What is Emotion? Jerome Kagan Ed. Yale University Press.

Cited by

See all 179

Metadata

Authors
Stark, L., & Hoey, J.
Venue
Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency
Publisher
ACM
Published
2021-03
Pages
782-793
OpenAlex
W3133752603
Cited by
179
References
28
FWCI
24.83
Type
conference paper
Language
en
Open access
hybrid

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The Ethics of Emotion in Artificial Intelligence Systems. https://app.cochat.ai/papers/10.1145/3442188.3445939
The paper
Stark, L., & Hoey, J. (2021). The Ethics of Emotion in Artificial Intelligence Systems. Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency. https://doi.org/10.1145/3442188.3445939

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.