CoChat

The Values Encoded in Machine Learning Research

Open access
Birhane, Abeba, Kalluri, Pratyusha, Card, Dallas, Agnew, William, Dotan, Ravit, Bao, Michelle · 2022 · 2022 ACM Conference on Fairness Accountability and Transparency

The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.

Abstract

Machine learning currently exerts an outsized influence on the world, increasingly affecting institutional practices and impacted communities. It is therefore critical that we question vague conceptions of the field as value-neutral or universally beneficial, and investigate what specific values the field is advancing. In this paper, we first introduce a method and annotation scheme for studying the values encoded in documents such as research papers. Applying the scheme, we analyze 100 highly cited machine learning papers published at premier machine learning conferences, ICML and NeurIPS. We annotate key features of papers which reveal their values: their justification for their choice of project, which attributes of their project they uplift, their consideration of potential negative consequences, and their institutional affiliations and funding sources. We find that few of the papers justify how their project connects to a societal need (15%) and far fewer discuss negative potential (1%). Through line-by-line content analysis, we identify 59 values that are uplifted in ML research, and, of these, we find that the papers most frequently justify and assess themselves based on Performance, Generalization, Quantitative evidence, Efficiency, Building on past work, and Novelty. We present extensive textual evidence and identify key themes in the definitions and operationalization of these values. Notably, we find systematic textual evidence that these top values are being defined and applied with assumptions and implications generally supporting the centralization of power. Finally, we find increasingly close ties between these highly cited papers and tech companies and elite universities.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3531146.3533083

Cites

71 of 71 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

2 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 71 references

Research works printed but not linked: 10

  1. Samy Bengio and Deborah Raji. 2021. A Retrospective on the NeurIPS 2021 Ethics Review Process. https://blog.neurips.cc/2021/12/03/a-retrospective-on-the-neurips-2021-ethics-review-process/
  2. Bruce L. Berg and Howard Lune. 2017. Qualitative research methods for the social sciences (ninth edition ed.). Pearson.
  3. Kate Crawford. 2017. The Trouble with Bias. (2017). NeurIPS Keynote.
  4. Catherine D’Ignazio and Lauren F Klein. 2020. Data Feminism. MIT Press.
  5. Barney G. Glaser and Anselm L. Strauss. 1999. The discovery of grounded theory: strategies for grounded research. Aldine de Gruyter.
  6. Ben Green. 2019. ‘Good’ isn’t Good Enough. In NeurIPS Joint Workshop on AI for Social Good.
  7. Maurice G Kendall and B Babington Smith. 1939. The problem of m rankings. The annals of mathematical statistics 10, 3 (1939), 275–287.
  8. Yvonna S. Lincoln and Egon G. Guba. 2006. Naturalistic inquiry. Sage Publ.
  9. Frank Pasquale. 2015. The black box society. Harvard University Press.
  10. Anna Rogers. 2019. Peer review in NLP: reject-if-not-SOTA. Hacking Semantics blog(2019). https://hackingsemantics.xyz/2020/reviewing-models/#everything-wrong-with-reject-if-not-sota

Cited by

See all 621

Metadata

Authors
Birhane, A., Kalluri, P., Card, D., Agnew, W., Dotan, R., & Bao, M.
Affiliations
  • University College Dublin (IE)
  • Stanford University (US)
  • University of Michigan (US)
  • University of Washington (US)
  • University of Pittsburgh (US)
Venue
2022 ACM Conference on Fairness Accountability and Transparency
Publisher
ACM
Published
2022-06-20
Pages
173-184
OpenAlex
W3174220540
Cited by
317
References
69
Citations by year
2026: 72 · 2025: 66 · 2024: 63 · 2023: 70 · 2022: 36
FWCI
58.38
Type
conference paper
Language
en
Open access
Locations
  • ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion, cc-by-nc-sa)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • Science Foundation Ireland (13/RC/2094-2)
  • National Defense Science and Engineering Graduate
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Social Sciences › General Social Sciences › Computational and Text Analysis Methods
  • Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
Keywords
value neutrality, research ethics, research funding sources, institutional affiliation, societal impact of AI, novelty, centralization of power, NeurIPS

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The Values Encoded in Machine Learning Research. https://app.cochat.ai/papers/10.1145/3531146.3533083
The paper
Birhane, A., Kalluri, P., Card, D., Agnew, W., Dotan, R., & Bao, M. (2022). The Values Encoded in Machine Learning Research. 2022 ACM Conference on Fairness Accountability and Transparency. https://doi.org/10.1145/3531146.3533083

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.