Cited by 601Ethics and Social Impacts of AIExplainable Artificial Intelligence (XAI)Imbalanced Data Classification Techniques

A comparative study of fairness-enhancing interventions in machine learning

Open access
Friedler, Sorelle A., Scheidegger, Carlos, Venkatasubramanian, Suresh, Choudhary, Sonam, Hamilton, Evan P., Roth, Derek·2019·Proceedings of the Conference on Fairness, Accountability, and Transparency

Abstract

Computers are increasingly used to make decisions that have significant impact on people's lives. Often, these predictions can affect different population subgroups disproportionately. As a result, the issue of fairness has received much recent interest, and a number of fairness-enhanced classifiers have appeared in the literature. This paper seeks to study the following questions: how do these different techniques fundamentally compare to one another, and what accounts for the differences? Specifically, we seek to bring attention to many under-appreciated aspects of such fairness-enhancing interventions that require investigation for these algorithms to receive broad adoption.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3287560.3287589

Cites

23 of 23 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • There is a rich and rapidly evolving body of work in computer science for devising algorithmic remedies to bias and creating equitable ML models, which in turn offers a promising path for more equitable health care.

    “Moreover, there is a rich and rapidly evolving body of work113–116 in computer science for devising algorithmic remedies to bias and creating equitable ML models, which in turn offers a promising path for more equitable health care.”
  • By not recognising the broader functions of automation in shaping power dynamics when considering bias mitigation, we run the risk of neutralising challenges in a way that actively facilitates discrimination and inequality under a banner of fairness.

    “Of course, asking providers of AHSs to attend to the dynamics of power in labour relations and society more broadly might seem unnecessarily burdensome, but by not recognising the broader functions of automation in shaping those dynamics when considering forms of bias mitigation, we run the risk of neutralising challenges in a way that actively facilitates discrimination and inequality under a b”
  • Often approaches for fair ML are not stable, i.e., subtle changes in the training data significantly affect performance.

    “[109,145] note that often approaches for fair ML are not stable, i.e., subtle changes in the training data signiicantly afect performance (comparatively high standard deviation).”

    From Fairness in machine learning: A survey (2024) · cites this paper as [109]

  • [79,120,221] summarizes additional constraint types as precision or budget constraints, quantification or coverage constraints, churn constraints, and stability constraints.

    “[79,120,221] summarizes a number of additional constraint types as precision or budget constraints to address the accuracy-fairness trade-of (often expressed as utility or risk functions e.g.[77,135]); quantiication or coverage constraints to capture disparities in class or population frequencies; churn constraints capturing online learning scenarios and enforcing that classiiers do not difer sign”

    From Fairness in machine learning: A survey (2024) · cites this paper as [109]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 9

  1. Flavio Calmon, Dennis Wei, Bhanukiran Vinzamuri, Karthikeyan Nate- san Ramamurthy, and Kush R Varshney. 2017. Optimized Pre- Processing for Discrimination Prevention. In Advances in Neural In- formation Processing Systems 30, I.
  2. Guyon, U. V. Luxburg, S. Ben- gio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett (Eds.). Curran Associates, Inc., 3995-4004. http://papers.nips.cc/paper/ 6988-optimized-pre-processing-for-discrimination-prevention.pdf
  3. Alexandra Chouldechova. 2017. Fair prediction with disparate impact: A study of bias in recidivism prediction instruments. Big data 5, 2 (2017), 153-163.
  4. Shahin Jabbari, Matthew Joseph, Michael Kearns, Jamie Morgenstern, and Aaron Roth. 2017. Fairness in Reinforcement Learning. In PMLR. 1617-1626. http://proceedings.mlr.press/v70/jabbari17a.html
  5. Matthew Joseph, Michael Kearns, Jamie H Morgenstern, and Aaron Roth. 2016a. Fairness in Learning: Classic and Contextual Ban- dits. In Advances in Neural Information Processing Systems 29, D. D. Lee, M. Sugiyama, U. V. Luxburg, I. Guyon, and R. Garnett (Eds.). Curran Associates, Inc., 325-333. http://papers.nips.cc/paper/ 6355-fairness-in-learning-classic-and-contextual-bandits.pdf
  6. David Lehr and Paul Ohm. 2017. Playing with the Data: What Legal Scholars Should Learn About Machine Learning. UC Davis Law Review 51, 2 (2017), 653-718.
  7. Weiwen Miao. 2011. Did the Results of Promotion Exams Have a Disparate Impact on Minorities? Using Statistical Evidence in Ricci v. DeStefano. J. of Stat. Ed. 19, 1 (2011).
  8. Arvind Narayanan. 2018. 21 Fairness Definitions and Their Politics. (Feb. 23 2018). Tutorial presented at the Conference on Fairness, Accountability, and Transparency.
  9. Rich Zemel, Yu Wu, Kevin Swersky, Toni Pitassi, and Cynthia Dwork. 2013. Learning Fair Representations. In Proc. of Intl. Conf. on Machine Learning. 325-333.

Cited by

Sorted by citations

Authors
Friedler, S. A., Scheidegger, C., Venkatasubramanian, S., Choudhary, S., Hamilton, E. P., & Roth, D.
Affiliations
  • Haverford College (US)
  • University of Arizona (US)
  • University of Utah (US)
Venue
Proceedings of the Conference on Fairness, Accountability, and Transparency
Publisher
ACM
Published
2019-01-29
Pages
329-338
OpenAlex
W2786122898
Cited by
601
References
23
Citations by year
2026: 39 · 2025: 65 · 2024: 97 · 2023: 75 · 2022: 90 · 2021: 100 · 2020: 77 · 2019: 49 · 2018: 8 · 2013: 1
FWCI
82.94
Type
conference paper
Language
en
Open access
Locations
  • ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion)
  • arXiv (Cornell University) (submittedVersion, cc-by-nc-sa)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
National Science Foundation (1513651, 1633724, 1633387)
Topics
  • Social Sciences › Safety Research › Ethics and Social Impacts of AI
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Physical Sciences › Computer Science › Artificial Intelligence › Imbalanced Data Classification Techniques
Keywords
algorithmic fairness, algorithmic decision-making, algorithmic discrimination, subpopulations

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review