Cited by 211Ethics and Social Impacts of AIExplainable Artificial Intelligence (XAI)AI and HR Technologies

The DOI matches its Crossref record; 57 of the 58 references it cites were found in a registry or an index.

Factors Influencing Perceived Fairness in Algorithmic Decision-Making: Algorithm Outcomes, Development Procedures, and Individual Differences

Wang, Ruotong, Harper, F. Maxwell, Zhu, Haiyi·2020·Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

Abstract

Algorithmic decision-making systems are increasingly used throughout the public and private sectors to make important decisions or assist humans in making these decisions with real social consequences. While there has been substantial research in recent years to build fair decision-making algorithms, there has been less research seeking to understand the factors that affect people's perceptions of fairness in these systems, which we argue is also important for their broader acceptance. In this research, we conduct an online experiment to better understand perceptions of fairness, focusing on three sets of factors: algorithm outcomes, algorithm development and deployment procedures, and individual differences. We find that people rate the algorithm as more fair when the algorithm predicts in their favor, even surpassing the negative effects of describing algorithms that are very biased against particular demographic groups. We find that this effect is moderated by several variables, including participants' education level, gender, and several aspects of the development procedure. Our findings suggest that systems that evaluate algorithmic fairness through users' feedback must consider the possibility of "outcome favorability" bias.

Overview

Integrity signals

Registry

Crossref · 10.1145/3313831.3376813

Cites

57 of 57 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Flagged first, then by citations

Show all 58 references

1 of the 58 references couldn’t be matched to a known paper.

Research works printed but not linked: 21

  1. Alekh Agarwal, Alina Beygelzimer, Miroslav Dudík, John Langford, and Hanna Wallach. 2018. A reductions approach to fair classification. arXiv preprint arXiv:1803.02453 (2018). · arXiv
  2. Julia Angwin, Jeff Larson, Surya Mattu, and Lauren Kirchner. 2016. Machine Bias. (May 2016). https://www.propublica.org/article/ machine-bias-risk-assessments-in-criminal-sentencing
  3. 10.1177/0049124118782533 · DOI · Paper page
  4. Joy Buolamwini and Timnit Gebru. 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification. In Conference on Fairness, Accountability and Transparency. 77--91.
  5. Pew Research Center. 2016a. Mechanical Turk: Research in the Crowdsourcing Age. (July 2016). https://www.pewinternet.org/2016/07/11/ research-in-the-crowdsourcing-age-a-case-study/
  6. Pew Research Center. 2016b. On Views of Race and Inequality, Blacks and Whites Are Worlds Apart. (June 2016). https://www.pewsocialtrends.org/2016/06/27/onviews-of-race-and-inequality-blacks-and-whites-areworlds-apart/.
  7. Alexandra Chouldechova and Aaron Roth. 2018. The frontiers of fairness in machine learning. arXiv preprint arXiv:1810.08810 (2018). · arXiv
  8. Bo Cowgill. 2018. Bias and Productivity in Humans and Algorithms: Theory and Evidence from Resume Screening. Columbia Business School, Columbia University 29 (2018).
  9. Cynthia Dwork, Nicole Immorlica, Adam Tauman Kalai, and Max Leiserson. 2018. Decoupled classifiers for group-fair and efficient machine learning. In Conference on Fairness, Accountability and Transparency. 119--133.
  10. Nikolaus Franke, Peter Keinz, and Katharina Klausberger. 2013. ?Does this sound like a fair deal?": Antecedents and consequences of fairness expectations in the individual's decision to participate in firm innovation. Organization science 24, 5 (2013), 1495--1516.
  11. Megan French and Jeff Hancock. 2017. What's the folk theory? Reasoning about cyber-social systems. Available at SSRN (2017). https://papers.ssrn.com/abstract=2910571
  12. Jon Kleinberg, Sendhil Mullainathan, and Manish Raghavan. 2016. Inherent trade-offs in the fair determination of risk scores. arXiv preprint arXiv:1609.05807 (2016). · arXiv
  13. 10.5555/3305381.3305576 · DOI
  14. Louise Matsakis. 2016. The Unknown, Poorly Paid Labor Force Powering Academic Research. (Feb. 2016). https://motherboard.vice.com/en_us/article/8q8ggb/ the-unknown-poorly-paid-labor-force-powering-academic-research
  15. Aditya Krishna Menon and Robert C Williamson. 2018. The cost of fairness in binary classification. In Conference on Fairness, Accountability and Transparency. 107--118.
  16. Diana C Mutz and Jeffery J Mondak. 1997. Dimensions of sociotropic behavior: Group-based judgements of fairness and well-being. American Journal of Political Science (1997), 284--308.
  17. Emma Pierson. 2017. Demographics and discussion influence views on algorithmic fairness. arXiv preprint arXiv:1712.09124 (2017). · arXiv
  18. Carrie Pomeroy. 2019. How community members in Ramsey County stopped a big-data plan from flagging students as at-risk. (Feb. 2019). https://www.tcdailyplanet.net/how-communitymembers-in-ramsey-county-stopped-a-big-data-planfrom-flagging-students-as-at-risk/.
  19. Forough Poursabzi-Sangdeh, Daniel G Goldstein, Jake M Hofman, Jennifer Wortman Vaughan, and Hanna Wallach. 2018. Manipulating and measuring model interpretability. arXiv preprint arXiv:1802.07810 (2018). · arXiv
  20. Daniel B Shank. 2012. Perceived Justice and Reactions to Coercive Computers. In Sociological Forum, Vol. 27. Wiley Online Library, 372--391.
  21. Megha Srivastava, Hoda Heidari, and Andreas Krause. 2019. Mathematical Notions vs. Human Perception of Fairness: A Descriptive Approach to Fairness for Machine Learning. arXiv preprint arXiv:1902.04783 (2019). · arXiv

Cited by

Sorted by citations

Items 101–200 of 211

Metadata

Authors
Wang, R., Harper, F. M., & Zhu, H.
Affiliations
  • Carnegie Mellon University (US)
  • Amazon (United States) (US)
Venue
Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
Publisher
ACM
Published
2020-04-21
Pages
1-14
OpenAlex
W3029022080
Cited by
211
References
58
Citations by year
2026: 30 · 2025: 37 · 2024: 37 · 2023: 34 · 2022: 36 · 2021: 34 · 2020: 3
FWCI
27.75
Type
conference paper
Language
en
Open access
closed
Locations
CHI Conference on Human Factors in Computing Systems (publishedVersion)
Funders
National Science Foundation (IIS-2001851, IIS-2000782, IIS-1939606)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › AI and HR Technologies
Keywords
perceived fairness, algorithmic decision-making, algorithmic fairness, algorithmic bias, individual differences, user feedback, educational attainment, gender differences

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review