Cited by 33Ethics and Social Impacts of AIExplainable Artificial Intelligence (XAI)Discrimination and Equality Law

Taxonomizing and Measuring Representational Harms: A Look at Image Tagging

Open access
Katzman, Jared, Wang, Angelina, Scheuerman, Morgan, Blodgett, Su Lin, Laird, Kristen, Wallach, Hanna, Barocas, Solon·2023·Proceedings of the AAAI Conference on Artificial Intelligence

Abstract

In this paper, we examine computational approaches for measuring the "fairness" of image tagging systems, finding that they cluster into five distinct categories, each with its own analytic foundation. We also identify a range of normative concerns that are often collapsed under the terms "unfairness," "bias," or even "discrimination" when discussing problematic cases of image tagging. Specifically, we identify four types of representational harms that can be caused by image tagging systems, providing concrete examples of each. We then consider how different computational measurement approaches map to each of these types, demonstrating that there is not a one-to-one mapping. Our findings emphasize that no single measurement approach will be definitive and that it is not possible to infer from the use of a particular measurement approach which type of harm was intended to be measured. Lastly, equipped with this more granular understanding of the types of representational harms that can be caused by image tagging systems, we show that attempts to mitigate some of these types of harms may be in tension with one another.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1609/aaai.v37i12.26670

Cites

56 of 56 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Existing research predominantly focuses on understanding, defining or evaluating representational 'harms' and often uses poor AI-generated images to elicit feedback from marginalized communities.

    “Our approach to defining and evaluating 'good' representation differs from existing research that predominantly focuses on understanding, defining or evaluating representational 'harms' [24, 28, 38, 44, 67, 77, 91, 116] and often uses poor AI-generated images to elicit feedback from marginalized communities (e.g., [65, 77, 79]).”

    From Engaging Communities Meaningfully in Defining Disability Representation for AI Image Generation (2026) · cites this paper as [67]

    The Introduction (page unavailable) says the paper identifies types of representational harm and evaluates approaches to measuring them, supporting the first part of the claim. The Computational Measurement Approaches section (page unavailable) mentions GAN-generated faces used to test image-tagging systems, but does not describe using poor AI-generated images to elicit feedback from marginalized communities. (LLM, conf=0.88)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

2 of the 58 references couldn’t be matched to a known paper.

Research works printed but not linked: 15

  1. Algorithmic Justice League. 2021. Drag Vs AI Workshop.
  2. Baker, D.; Hanna, A.; and Denton, E. 2020. Algorithmi- cally Encoded Identities: Reframing Human Classification. In Proceedings of the 2020 Conference on Fairness, Ac- countability, and Transparency, FAT* '20, 681. New York, NY, USA: Association for Computing Machinery. ISBN 9781450369367.
  3. Barlas, P.; Kyriakou, K.; Guest, O.; Kleanthous, S.; and Ot- terbacher, J. 2021. To "See" is to Stereotype: Image Tag- ging Algorithms, Gender Recognition, and the Accuracy- Fairness Trade-off. Proceedings of the ACM on Human- Computer Interaction, 4(CSCW3): 1-31.
  4. Barlas, P.; Kyriakou, K.; Kleanthous, S.; and Otterbacher, J. 2019b. What Makes an Image Tagger Fair? Proprietary Auto-tagging and Interpretations on People Images. In Pro- ceedings of the 27th ACM Conference On User Modelling, Adaptation And Personalization (UMAP).
  5. Barocas, S.; Crawford, K.; Shapiro, A.; and Wallach, H. 2017. The Problem With Bias: Allocative Versus Repre- sentational Harms in Machine Learning. In Proceedings of SIGCIS. Philadelphia, PA.
  6. Buolamwini, J.; and Gebru, T. 2018. Gender shades: In- tersectional accuracy disparities in commercial gender clas- sification. In Proceedings of the Conference on Fairness, Accountability, and Transparency. New York City, NY.
  7. Crawford, K. 2017. The Trouble with Bias. Conference on Neural Information Processing Systems Keynote.
  8. Jacobs, A. Z.; and Wallach, H. 2021. Measurement and fair- ness. In Proceedings of the 2021 ACM conference on fair- ness, accountability, and transparency, 375-385.
  9. Kay, M.; Matuszek, C.; and Munson, S. A. 2015b. Unequal Representation and Gender Stereotypes in Image Search Re- sults for Occupations. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, 3819-3828.
  10. Keyes, O. 2018. The misgendering machines: Trans/HCI implications of automatic gender recognition. Proceedings of the ACM on human-computer interaction, 2(CSCW): 1- 22.
  11. Roberts, C. V. 2018. Quantifying the Extent to which Pop- ular Pre-Trained Convolutional Neural Networks Implicitly Learn High-Level Protected Attributes. In Princeton Mas- ters Thesis.
  12. Scheuerman, M. K.; Paul, J. M.; and Brubaker, J. R. 2019. How Computers See Gender: An Evaluation of Gender Clas- sification in Commercial Facial Analysis Services. Proc. ACM Hum.-Comput. Interact., 3(CSCW).
  13. Shankar, S.; Halpern, Y.; Breck, E.; Atwood, J.; Wilson, J.; and Sculley, D. 2017b. No classification without representa- tion: Assessing geodiversity issues in open data sets for the developing world. In Proceedings of the NIPS 2017 Work- shop on Machine Learning for the Developing World.
  14. Wu, S.; Wieland, J.; Farivar, O.; and Schiller, J. 2017. Auto- matic Alt-text: Computer-generated Image Descriptions for Blind Users on a Social Network Service. ACM Confer- ence on Computer-Supported Cooperative Work And Social Computing (CSCW).
  15. Yang, K.; Qinami, K.; Fei-Fei, L.; Deng, J.; and Rus- sakovsky, O. 2020. Towards fairer datasets. Proceedings of the 2020 Conference on Fairness, Accountability, and Trans- parency.

Cited by

Sorted by citations

Authors
Katzman, J., Wang, A., Scheuerman, M., Blodgett, S. L., Laird, K., Wallach, H., & Barocas, S.
Affiliations
  • University of Michigan (US)
  • Princeton University (US)
  • University of Colorado Boulder (US)
  • Microsoft (United States) (US)
Venue
Proceedings of the AAAI Conference on Artificial Intelligence
Published
2023-06-26
Volume
37
Issue
12
Pages
14277-14285
ISSN
  • 2159-5399 (ISSN-L)
  • 2374-3468
OpenAlex
W4382469269
Cited by
32
References
58
Citations by year
2026: 8 · 2025: 12 · 2024: 10 · 2023: 2
FWCI
8.02
Type
conference paper
Language
en
Open access
Locations
  • Proceedings of the AAAI Conference on Artificial Intelligence (publishedVersion)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) (submittedVersion)
  • arXiv (Cornell University) (cc-by)
Topics
  • Social Sciences › Safety Research › Ethics and Social Impacts of AI
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Social Sciences › Law › Discrimination and Equality Law
Keywords
image tagging, representational harm, algorithmic fairness, fairness measurement, bias, discrimination, normative concerns

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review