Ethics Sheet for Automatic Emotion Recognition and Sentiment Analysis
Open accessThe DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
The importance and pervasiveness of emotions in our lives makes affective computing a tremendously important and vibrant line of work. Systems for automatic emotion recognition (AER) and sentiment analysis can be facilitators of enormous progress (e.g., in improving public health and commerce) but also enablers of great harm (e.g., for suppressing dissidents and manipulating voters). Thus, it is imperative that the affective computing community actively engage with the ethical ramifications of their creations. In this article, I have synthesized and organized information from AI Ethics and Emotion Recognition literature to present fifty ethical considerations relevant to AER. Notably, this ethics sheet fleshes out assumptions hidden in how AER is commonly framed, and in the choices often made regarding the data, method, and evaluation. Special attention is paid to the implications of AER on privacy and social groups. Along the way, key recommendations are made for responsible AER. The objective of the ethics sheet is to facilitate and encourage more thoughtfulness on why to automate, how to automate, and how to judge success well before the building of AER systems. Additionally, the ethics sheet acts as a useful introductory document on emotion recognition (complementing survey articles).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Picard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
Thumbs up?: sentiment classification using machine learning techniques
Pang, B., Lee, L., & Vaithyanathan, S. (2002) · Proceedings of the ACL-02 conference on Empirical methods in natural language processing - EMNLP '02 · doi:10.3115/1118693.1118704 · Cited by 7,024
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988 · cited 1×
“See Bender et al. (2021) for ethical considerations in the use of large language models, including: • Labeled Training and Testing Data: AER systems often make use of a relatively small number of example instances that are manually labeled (annotated) for emotions.”
BackgroundCore affect and the psychological construction of emotion.
Russell, J. A. (2003) · Psychological Review · doi:10.1037/0033-295x.110.1.145 · Cited by 6,113 · cited 1×
“…dimensions of affect and connotative meaning are valence (positiveness–negativeness / pleasure–displeasure), arousal (active–sluggish), and dominance (dominant-–submissive / in control–out of control) (Osgood, Suci, and Tannenbaum 1957; Russell 1980; Russell and Mehrabian 1977; Russell 2003).”
BackgroundThe Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods
Tausczik, Y. R., & Pennebaker, J. W. (2010) · Journal of Language and Social Psychology · doi:10.1177/0261927x09351676 · Cited by 5,774 · cited 1×
“…expressions and one’s internal emotional state, there is a substantial amount of work on the idea that language is a window into one’s mind (Chomsky 1975; Lakoff 2008; Pinker 2007)—which of course also includes emotions (Bamberg 1997; Wiebe, Wilson, and Cardie 2005; Tausczik and Pennebaker 2010).”
BackgroundBagby, R. M., Parker, J. D. A., & Taylor, G. J. (1994) · Journal of Psychosomatic Research · doi:10.1016/0022-3999(94)90005-1 · Cited by 5,293
Harris, Z. S. (1954) · WORD · doi:10.1080/00437956.1954.11659520 · Cited by 4,807
Progress on a cognitive-motivational-relational theory of emotion
Lazarus, R. S. (1991) · American Psychologist · doi:10.1037/0003-066x.46.8.819 · Cited by 3,272
Artificial intelligence in healthcare
Yu, K.-H., Beam, A. L., & Kohane, I. S. (2018) · Nature Biomedical Engineering · doi:10.1038/s41551-018-0305-z · Cited by 2,817
Model Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681
Evidence for a three-factor theory of emotions
Russell, J. A., & Mehrabian, A. (1977) · Journal of Research in Personality · doi:10.1016/0092-6566(77)90037-x · Cited by 1,940 · cited 1×
“…dimensions of affect and connotative meaning are valence (positiveness–negativeness / pleasure–displeasure), arousal (active–sluggish), and dominance (dominant-–submissive / in control–out of control) (Osgood, Suci, and Tannenbaum 1957; Russell 1980; Russell and Mehrabian 1977; Russell 2003).”
BackgroundEmotional expressions reconsidered: Challenges to inferring emotion from human facial movements
Barrett, L. F., Adolphs, R., Marsella, S., Martinez, A. M., & Pollak, S. D. (2019) · Psychological Science in the Public Interest · doi:10.1177/1529100619832930 · Cited by 1,748
Schwartz, R., Dodge, J., Smith, N. A., & Etzioni, O. (2020) · Communications of the ACM · doi:10.1145/3381831 · Cited by 1,647
The theory of constructed emotion: an active inference account of interoception and categorization
Barrett, L. F. (2016) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsw154 · Cited by 1,426
Climbing towards NLU: On Meaning, Form, and Understanding in the Age of Data
Bender, E. M., & Koller, A. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.463 · Cited by 1,082 · cited 1×
“…of an utterance is not only a property of language, but it is grounded in human activity, social interactions, beliefs, culture, and other extra-linguistic events, perceptions, and knowledge (Harris 1954; Chomsky 2014; Ervin-Tripp 1973; Bisk et al. 2020; Bender and Koller 2020; Hovy and Yang 2021).”
BackgroundThe theory of constructed emotion: an active inference account of interoception and categorization
Barrett, L. F. (2017) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsx060 · Cited by 1,009 · cited 2×
“This mapping of signals to emotions is highly variable, and different people can have different signals associated with different emotions (Barrett 2017b); therefore, different people have different concept–emotion associations.”
BackgroundAnnotation Artifacts in Natural Language Inference Data
Gururangan, S., Swayamdipta, S., Levy, O., Schwartz, R., Bowman, S., & Smith, N. A. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers) · doi:10.18653/v1/n18-2017 · Cited by 907
Turkopticon: interrupting worker invisibility in amazon mechanical turk
Irani, L. C., & Silberman, M. S. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2470742 · Cited by 798 · cited 1×
“See Dolmaya (2011); Fort, Adda, and Cohen (2011); Standing and Standing (2018); Irani and Silberman (2013); Shmueli et al. (2021).”
BackgroundMaking the future together: Shaping autism research through meaningful participation
Fletcher-Watson, S., Adams, J., Brook, K., Charman, T., Crane, L., Cusack, J., Leekam, S., Milton, D., Parr, J. R., & Pellicano, E. (2019) · Autism · doi:10.1177/1362361318786721 · Cited by 776 · cited 1×
“…different domains, including research pertaining to disability (Stone and Priestley 1996; Seale et al. 2015), indigenous communities (Hall 2014), autism spectrum (Fletcher-Watson et al. 2019; Bertilsdotter Rosqvist et al. 2019), and neurodiversity (Brosnan et al. 2017; Motti and Evmenova 2020).”
BackgroundEnergy and Policy Considerations for Modern Deep Learning Research
Strubell, E., Ganesh, A., & McCallum, A. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i09.7123 · Cited by 774 · cited 1×
“Recent papers showing the increasing carbon footprint of AI systems and approaches to address them (Strubell, Ganesh, and McCallum 2020; Schwartz et al. 2020).”
BackgroundSemEval-2018 Task 1: Affect in Tweets
Mohammad, S., Bravo-Marquez, F., Salameh, M., & Kiritchenko, S. (2018) · Proceedings of The 12th International Workshop on Semantic Evaluation · doi:10.18653/v1/s18-1001 · Cited by 746
Self-citationBauer, G. R., Braimoh, J., Scheim, A. I., & Dharma, C. (2017) · PLOS ONE · doi:10.1371/journal.pone.0178043 · Cited by 452 · cited 1×
“Challenges persist in terms of how to design effective and inclusive questionnaires (Bauer et al. 2017).”
BackgroundStance and Sentiment in Tweets
Mohammad, S. M., Sobhani, P., & Kiritchenko, S. (2017) · ACM Transactions on Internet Technology · doi:10.1145/3003433 · Cited by 449
Self-citationExamining Gender and Race Bias in Two Hundred Sentiment Analysis Systems
Kiritchenko, S., & Mohammad, S. (2018) · Proceedings of the Seventh Joint Conference on Lexical and Computational Semantics · doi:10.18653/v1/s18-2005 · Cited by 384
Self-citationWinkler, J. K., Fink, C., Toberer, F., Enk, A., Deinlein, T., Hofmann-Wellenhof, R., Thomas, L., Lallas, A., Blum, A., Stolz, W., et al. (2019) · JAMA Dermatology · doi:10.1001/jamadermatol.2019.1735 · Cited by 365 · cited 1×
“Winkler et al. (2019) and Bissoto, Valle, and Avila (2020) show spurious correlations in melanoma and skin lesion detection systems.”
BackgroundLysaght, T., Lim, H. Y., Xafis, V., & Ngiam, K. Y. (2019) · Asian Bioethics Review · doi:10.1007/s41649-019-00096-0 · Cited by 332
Analyzing the Behavior of Visual Question Answering Models
Agrawal, A., Batra, D., & Parikh, D. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1203 · Cited by 297 · cited 1×
“For example, Agrawal, Batra, and Parikh (2016) show that when asked what is the ground covered with, visual QA systems tend to always say snow , because in the training set, this question was only asked for when the ground was covered with snow.”
BackgroundMcStay, A. (2020) · Big Data & Society · doi:10.1177/2053951720904386 · Cited by 217 · cited 1×
“See McStay (2020) for further discussions on the implications of AER on group privacy and how companies are using AER to determine group preferences, even though a large number of people disfavour such profiling.”
BackgroundA Taxonomy of Ethical Tensions in Inferring Mental Health States from Social Media
Chancellor, S., Birnbaum, M. L., Caine, E. D., Silenzio, V. M. B., & De Choudhury, M. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287587 · Cited by 214 · cited 1×
“See Chancellor et al. (2019) for ethical considerations on inferring mental health states from one’s utterances.”
BackgroundDon’t ask if artificial intelligence is good or fair, ask how it shifts power
Kalluri, P. (2020) · Nature · doi:10.1038/d41586-020-02003-2 · Cited by 213
Considerations for AI fairness for people with disabilities
Trewin, S., Basson, S., Muller, M., Branham, S., Treviranus, J., Gruen, D., Hebert, D., Lyckowski, N., & Manser, E. (2019) · AI Matters · doi:10.1145/3362077.3362086 · Cited by 143
Bringing the People Back In: Contesting Benchmark Machine Learning Datasets
Denton, R., Hanna, A., Amironesei, R., Smart, A., Nicole, H., & Scheuerman, M. K. (2020) · arXiv · doi:10.48550/arxiv.2007.07399 · Cited by 100 · cited 1×
“See Denton et al. (2020) for ideas on on participatory dataset creation and management.”
BackgroundGallagher, R. J., Frank, M. R., Mitchell, L., Schwartz, A. J., Reagan, A. J., Danforth, C. M., & Dodds, P. S. (2021) · EPJ Data Science · doi:10.1140/epjds/s13688-021-00260-3 · Cited by 70
Cao, Y. T., & Daumé, H. (2021) · Computational Linguistics · doi:10.1162/coli_a_00413 · Cited by 47 · cited 1×
“See Cao and Daumé (2021) for a useful discussion on linguistic vs. social gender and also for a great example to create more inclusive data for research.”
BackgroundMulligan, D. K., Kluttz, D., & Kohli, N. (2019) · doi:10.2139/ssrn.3311894 · Cited by 32 · cited 2×
“Warnings and Recourse: Annotating highly emotional, offensive, or suicidal utterances can adversely impact the well-being of the annotators.”
Background
Cited by
Using natural language processing to analyse text data in behavioural science
Feuerriegel, S., Maarouf, A., Bär, D., Geissler, D., Schweisthal, J., Pröllochs, N., Robertson, C. E., Rathje, S., Hartmann, J., Mohammad, S. M., et al. (2025) · Nature Reviews Psychology · doi:10.1038/s44159-024-00392-z · Cited by 140
Self-citationEthical considerations in the early detection of Alzheimer's disease using speech and AI
Petti, U., Nyrup, R., Skopek, J. M., & Korhonen, A. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594063 · Cited by 16
State-of-the-art Multimodal Emotion Recognition: A comprehensive survey and taxonomy
Yazici, A., Kucukyilmaz, T., Dokeroglu, T., Sharipbay, A., Lee, M.-H., & Tyler, B. (2026) · Intelligent Systems with Applications · doi:10.1016/j.iswa.2026.200642 · Cited by 11
Metadata
- Authors
- Mohammad, S. M.
- Venue
- Computational Linguistics
- Publisher
- MIT Press
- Published
- 2022
- Volume
- 48
- Issue
- 2
- Pages
- 239-278
- ISSN
- 0891-2017 (ISSN-L)
- 1530-9312
- OpenAlex
- W3201284223
- Cited by
- 107
- References
- 35
- FWCI
- 24.16
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.