Cited by 2Ethics and Social Impacts of AIAI and HR TechnologiesExplainable Artificial Intelligence (XAI)

Confusing the Map for the Territory

Open access
Qadri, Rida, Madaio, Michael, Gray, Mary L.·2025·Communications of the ACM

Abstract

The limits of datasets for culturally inclusive AI.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3731655

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The identity and views of human annotators become embedded in the data, influencing subsequent system behavior.

    “In expressing 'their' perspective through data annotations, it important to recognize how the identity and views of human annotators become embedded in the data, influencing subsequent system behavior [51, 52, 90].”
  • Recent works argue against treatments of representation as a static concept that can be evaluated objectively.

    “This echoes recent works [10, 68, 89, 90] that argue against treatments of representation as a static concept that can be evaluated objectively.”
  • Researchers have previously problematized anonymous crowdsourced data annotation approaches as being unspecific about who's worldviews and beliefs become manifest in the data.

    “Researchers have previously problematized anonymous crowdsourced data annotation approaches [31, 53, 65] as being unspecific about who's worldviews and beliefs become manifest in the data [11, 17, 51, 78, 90, 91].”
  • Rather than treating PwD as a singular or universal identity, the authors acknowledge the distinct social identities and intersectionalities within each community.

    “Rather than treating PwD as a singular or universal identity -often reinforced by homogenizing labels such as 'dwarfism -we acknowledge the distinct social identities and intersectionalities within each community (cf. [53, 90]).”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 11

  1. Agre, P. Computation and Human Experience. Cambridge University Press. (1997).
  2. Andrews, J. et al. Ethical considerations for responsible data curation. Advances in Neural Information 2. Processing Systems 36 (2023).
  3. Bergman, S. et al. STELA: A community-centred approach to norm elicitation for AI alignment. Scientific 3. Reports 14, 1 (2024).
  4. Diaz, M. et al. Crowdworksheets: Accounting for individual and collective identities underlying crowdsourced 4. dataset annotation. In Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency. (2022).
  5. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency. (2020).
  6. Kapania, S., Taylor, A.S., and Wang, D. A hunt for the snark: Annotator diversity in data practices. In 6. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. (2023).
  7. Naggita, K., LaChance, J., and Xiang, A. Flickr Africa: Examining geo-diversity in large-scale, human-centric 7. visual data. In Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society. (2023).
  8. Qadri, R. et al. AI's regimes of representation: A community-centered study of text-to-image models in South 8. Asia. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency. (2023).
  9. Selbst, A.D. et al. Fairness and abstraction in sociotechnical systems. In Proceedings of the Conference on 10. Fairness, Accountability, and Transparency. (2019).
  10. Mary L. Gray (mlg@microsoft.com) is a senior principal researcher at Microsoft Research, Cambridge, MA, USA. 2025 ACM Copyright held by the owner/author(s).
  11. COMMUNICATIONS OF THE ACM

Cited by

Sorted by citations

  • Engaging Communities Meaningfully in Defining Disability Representation for AI Image Generation

    Thieme, A., Faia Marques, R., Grayson, M., Balachandar, S., Tyler Cassidy, C., Choksi, M. Z., Longden, C., Huda, R. S., Ileve Kalovwe, N., Mallon, C., et al. (2026) · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790768 · Cited by 1 · see citing works

    “In line with arguments by [68, 89, 90], such approaches should recognize the inherently subjective meanings and perspectives that shape social concepts like representation, thereby moving beyond singular or objective standards towards embracing the richness of community-specific interpretations .”
    Influential

Authors
Qadri, R., Madaio, M., & Gray, M. L.
Affiliations
  • Google (United States) (US)
  • Microsoft Research New England (United States) (US)
Venue
Communications of the ACM
Published
2025-09-25
Volume
68
Issue
10
Pages
32-34
ISSN
  • 0001-0782 (ISSN-L)
  • 1557-7317
OpenAlex
W4413926646
Cited by
2
References
1
Citations by year
2026: 2
FWCI
2.09
Type
journal article
Language
en
Open access
Locations
Communications of the ACM (publishedVersion)
Topics
  • Social Sciences › Safety Research › Ethics and Social Impacts of AI
  • Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › AI and HR Technologies
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
Keywords
cultural data, data limitations, cultural diversity, algorithmic bias

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review