Discrimination In The Age Of Algorithms
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
The law forbids discrimination.But the ambiguity of human decision-making often makes it extraordinarily hard for the legal system to know whether anyone has actually discriminated.To understand how algorithms affect discrimination, we must therefore also understand how they affect the problem of detecting discrimination.By one measure, algorithms are fundamentally opaque, not just cognitively but even mathematically.Yet for the task of proving discrimination, processes involving algorithms can provide crucial forms of transparency that are otherwise unavailable.These benefits do not happen automatically.But with appropriate requirements in place, the use of algorithms will make it possible to more easily examine and interrogate the entire decision process, thereby making it far easier to know whether discrimination has occurred.By forcing a new level of specificity, the use of algorithms also highlights, and makes transparent, central tradeoffs among competing values.Algorithms are not only a threat to be regulated; with the right safeguards in place, they have the potential to be a positive force for equity.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bertrand, M., & Mullainathan, S. (2004) · American Economic Review · doi:10.1257/0002828042002561 · Cited by 4,504
Self-citationDiscrimination and racial disparities in health: evidence and needed research
Williams, D. R., & Mohammed, S. A. (2009) · Journal of Behavioral Medicine · doi:10.1007/s10865-008-9185-0 · Cited by 3,371
Barocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048
Pager, D. (2003) · American Journal of Sociology · doi:10.1086/374403 · Cited by 2,840
The Effect of Race and Sex on Physicians' Recommendations for Cardiac Catheterization
Schulman, K. A., Berlin, J. A., Harless, W., Kerner, J. F., Sistrunk, S., Gersh, B. J., Dubé, R., Taleghani, C. K., Burke, J. E., Williams, S., et al. (1999) · New England Journal of Medicine · doi:10.1056/nejm199902253400806 · Cited by 1,934
Human Decisions and Machine Predictions
Kleinberg, J., Lakkaraju, H., Leskovec, J., Ludwig, J., & Mullainathan, S. (2018) · The Quarterly Journal of Economics · doi:10.1093/qje/qjx032 · Cited by 1,040
Self-citationTeachers, race, and student achievement in a randomized experiment
Dee, T. S. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023750 · Cited by 965
Lessons from the Netflix prize challenge
Bell, R. M., & Koren, Y. (2007) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1345448.1345465 · Cited by 727
Langer, E. J., Blank, A., & Chanowitz, B. (1978) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.36.6.635 · Cited by 694
Kleinberg, J., Ludwig, J., Mullainathan, S., & Obermeyer, Z. (2015) · American Economic Review · doi:10.1257/aer.p20151023 · Cited by 584
Self-citation
Cited by
Mitigating bias in algorithmic hiring: evaluating claims and practices
Raghavan, M., Barocas, S., Kleinberg, J., & Levy, K. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372828 · Cited by 845
Self-citationGovernance of artificial intelligence
Taeihagh, A. (2021) · Policy and Society · doi:10.1080/14494035.2021.1928377 · Cited by 562
Aung, Y. Y. M., Wong, D. C. S., & Ting, D. S. W. (2021) · British Medical Bulletin · doi:10.1093/bmb/ldab016 · Cited by 511
Algorithmic management in a work context
Jarrahi, M. H., Newlands, G., Lee, M. K., Wolf, C. T., Kinder, E., & Sutherland, W. (2021) · Big Data & Society · doi:10.1177/20539517211020332 · Cited by 532
Coeckelbergh, M. (2020) · Science and Engineering Ethics · doi:10.1007/s11948-019-00146-8 · Cited by 475
Leveraging Artificial Intelligence in Marketing for Social Good—An Ethical Perspective
Hermann, E. (2022) · Journal of Business Ethics · doi:10.1007/s10551-021-04843-y · Cited by 403
Integrating explanation and prediction in computational social science
Hofman, J. M., Watts, D. J., Athey, S., Garip, F., Griffiths, T. L., Kleinberg, J., Margetts, H., Mullainathan, S., Salganik, M. J., Vazire, S., et al. (2021) · Nature · doi:10.1038/s41586-021-03659-0 · Cited by 371
Self-citationLarge Legal Fictions: Profiling Legal Hallucinations in Large Language Models
Dahl, M., Magesh, V., Suzgun, M., & Ho, D. E. (2024) · Journal of Legal Analysis · doi:10.1093/jla/laae003 · Cited by 559
Predictive biases in natural language processing models: A conceptual framework and overview
Shah, D. S., Schwartz, H. A., & Hovy, D. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.468 · Cited by 241
Woods, S. A., Ahmed, S., Nikolaou, I., Costa, A. C., & Anderson, N. R. (2020) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2019.1681401 · Cited by 218
Mitigating Bias in Algorithmic Hiring: Evaluating Claims and Practices
Raghavan, M., Barocas, S., Kleinberg, J., & Levy, K. (2019) · arXiv · Cited by 176
Self-citationAlgorithmic realism: expanding the boundaries of algorithmic thought
Green, B., & Viljoen, S. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372840 · Cited by 161
The Rhetoric and Reality of Anthropomorphism in Artificial Intelligence
Watson, D. (2019) · Minds and Machines · doi:10.1007/s11023-019-09506-6 · Cited by 148
The false promise of risk assessments: epistemic reform and the limits of fairness
Green, B. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372869 · Cited by 80
Governing by Algorithm? No Noise and (Potentially) Less Bias
Sunstein, C. R. (2021) · doi:10.2139/ssrn.3925240 · Cited by 52
Self-citationMitigating Bias in Algorithmic Employment Screening: Evaluating Claims and Practices
Raghavan, M., Barocas, S., Kleinberg, J., & Levy, K. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3408010 · Cited by 51
Self-citationAlgorithmic Risk Assessment in the Hands of Humans
Stevenson, M., & Doleac, J. L. (2020) · doi:10.2139/ssrn.3513695 · Cited by 42
(2017) · doi:10.4230/lipics.forc.2020.6 · Cited by 27
Blind Justice: Algorithmically Masking Race in Charging Decisions
Chohlas-Wood, A., Nudell, J., Yao, K., Lin, Z. (., Nyarko, J., & Goel, S. (2021) · Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3461702.3462524 · Cited by 22
Pretrained AI Models: Performativity, Mobility, and Change
Varshney, L. R., Keskar, N. S., & Socher, R. (2019) · arXiv · doi:10.48550/arxiv.1909.03290 · Cited by 20
Public’s views of risk assessment algorithms and pretrial decision making
Scurich, N., & Krauss, D. A. (2020) · Psychology, Public Policy, and Law · doi:10.1037/law0000219 · Cited by 17
Metadata
- Authors
- Kleinberg, J., Ludwig, J., Mullainathan, S., & Sunstein, C.
- Venue
- National Bureau of Economic Research
- Publisher
- National Bureau of Economic Research
- Published
- 2019-02
- OpenAlex
- W3123169803
- Cited by
- 105
- References
- 10
- Type
- report
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.