CoChat

How Do Fairness Definitions Fare?: Examining Public Attitudes Towards Algorithmic Definitions of Fairness

Saxena, Nripsuta Ani, Huang, Karen, DeFilippis, Evan, Radanovic, Goran, Parkes, David C., Liu, Yang · 2019 · Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society
Cited by 155

The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.

Abstract

What is the best way to define algorithmic fairness? While many definitions of fairness have been proposed in the computer science literature, there is no clear agreement over a particular definition. In this work, we investigate ordinary people's perceptions of three of these fairness definitions. Across two online experiments, we test which definitions people perceive to be the fairest in the context of loan decisions, and whether fairness perceptions change with the addition of sensitive information (i.e., race of the loan applicants). Overall, one definition (calibrated fairness) tends to be more pre- ferred than the others, and the results also provide support for the principle of affirmative action.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3306618.3314248

Cites

13 of 13 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 13 references

Research works printed but not linked: 14

  1. J Angwin , J Larson , S Mattu , and L Kirchner . 2016. Machine bias risk assessments in criminal sentencing. https://www.propublica.org/article/machine-bias-risk-assessments-in-criminal-sentencing. ProPublica https://www. propublica. org ( 2016 ). Accessed : 2018-03--27. J Angwin, J Larson, S Mattu, and L Kirchner. 2016. Machine bias risk assessments in criminal sentencing. https://www.propublica.org/article/machine-bias-risk-assessments-in-criminal-sentencing. ProPublica https://www. propublica. org (2016). Accessed: 2018-03--27.
  2. Edmond Awad , Sohan Dsouza , Richard Kim , Jonathan Schulz , Joseph Henrich , Azim Shariff , Jean-Francc ois Bonnefon, and Iyad Rahwan . 2018 . The moral machine experiment. Nature , Vol. 563 , 7729 (2018), 59. Edmond Awad, Sohan Dsouza, Richard Kim, Jonathan Schulz, Joseph Henrich, Azim Shariff, Jean-Francc ois Bonnefon, and Iyad Rahwan. 2018. The moral machine experiment. Nature, Vol. 563, 7729 (2018), 59.
  3. 10.1111/1467-8721.ep10770996 · DOI
  4. Jean-Francc ois Bonnefon , Azim Shariff , and Iyad Rahwan . 2016 . The social dilemma of autonomous vehicles . Science , Vol. 352 , 6293 (2016), 1573--1576. Jean-Francc ois Bonnefon, Azim Shariff, and Iyad Rahwan. 2016. The social dilemma of autonomous vehicles. Science, Vol. 352, 6293 (2016), 1573--1576.
  5. Evelyn Ellis and Philippa Watson . 2012. EU anti-discrimination law . Oxford University Press . Evelyn Ellis and Philippa Watson. 2012. EU anti-discrimination law .Oxford University Press.
  6. Pratik Gajane and Mykola Pechenizkiy . 2017. On formalizing fairness in prediction with machine learning. arXiv preprint arXiv:1710.03184 ( 2017 ). Pratik Gajane and Mykola Pechenizkiy. 2017. On formalizing fairness in prediction with machine learning. arXiv preprint arXiv:1710.03184 (2017). · arXiv
  7. Joshua David Greene . 2014. Moral tribes: Emotion, reason, and the gap between us and them . Penguin . Joshua David Greene. 2014. Moral tribes: Emotion, reason, and the gap between us and them .Penguin.
  8. Nina Grgić-Hlavc a, Muhammad Bilal Zafar , Krishna P Gummadi , and Adrian Weller . 2018 b. Beyond distributive fairness in algorithmic decision making: Feature selection for procedurally fair learning . In Thirty-Second AAAI Conference on Artificial Intelligence . Nina Grgić-Hlavc a, Muhammad Bilal Zafar, Krishna P Gummadi, and Adrian Weller. 2018b. Beyond distributive fairness in algorithmic decision making: Feature selection for procedurally fair learning. In Thirty-Second AAAI Conference on Artificial Intelligence .
  9. Karen Huang , Joshua David Greene, and M Bazerman . 2019 . Veil-of-ignorance reasoning favors the greater good. (2019). Working paper. Karen Huang, Joshua David Greene, and M Bazerman. 2019. Veil-of-ignorance reasoning favors the greater good. (2019). Working paper.
  10. 10.1145/3025453.3025884 · DOI · Paper page
  11. Yang Liu , Goran Radanovic , Christos Dimitrakakis , Debmalya Mandal , and David C Parkes . 2017. Calibrated fairness in bandits. arXiv preprint arXiv:1707.01875 ( 2017 ). Yang Liu, Goran Radanovic, Christos Dimitrakakis, Debmalya Mandal, and David C Parkes. 2017. Calibrated fairness in bandits. arXiv preprint arXiv:1707.01875 (2017). · arXiv
  12. Emma Pierson . 2017. Gender differences in beliefs about algorithmic fairness. arXiv preprint arXiv:1712.09124 ( 2017 ). Emma Pierson. 2017. Gender differences in beliefs about algorithmic fairness. arXiv preprint arXiv:1712.09124 (2017). · arXiv
  13. Angelisa C Plane Elissa M Redmiles Michelle L Mazurek and Michael Carl Tschantz. 2017. Exploring user perceptions of discrimination in online targeted advertising. In USENIX Security . Angelisa C Plane Elissa M Redmiles Michelle L Mazurek and Michael Carl Tschantz. 2017. Exploring user perceptions of discrimination in online targeted advertising. In USENIX Security .
  14. Menahem E Yaari and Maya Bar-Hillel . 1984. On dividing justly. Social choice and welfare , Vol. 1 , 1 ( 1984 ), 1--24. Menahem E Yaari and Maya Bar-Hillel. 1984. On dividing justly. Social choice and welfare, Vol. 1, 1 (1984), 1--24.

Cited by

See all 155

Metadata

Authors
Saxena, N. A., Huang, K., DeFilippis, E., Radanovic, G., Parkes, D. C., & Liu, Y.
Venue
Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society
Publisher
ACM
Published
2019-01-27
Pages
99-106
ISSN
3065-8365 (ISSN-L)
OpenAlex
W2963588812
Cited by
155
References
13
FWCI
22.10
Type
conference paper
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: How Do Fairness Definitions Fare?: Examining Public Attitudes Towards Algorithmic Definitions of Fairness. https://app.cochat.ai/papers/10.1145/3306618.3314248
The paper
Saxena, N. A., Huang, K., DeFilippis, E., Radanovic, G., Parkes, D. C., & Liu, Y. (2019). How Do Fairness Definitions Fare?: Examining Public Attitudes Towards Algorithmic Definitions of Fairness. Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society. https://doi.org/10.1145/3306618.3314248

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.