Discrimination in the Age of Algorithms
Open accessThe DOI matches its Crossref record; 88 of the 88 references it cites were found in a registry or an index.
Abstract
The law forbids discrimination. But the ambiguity of human decision-making often makes it hard for the legal system to know whether anyone has discriminated. To understand how algorithms affect discrimination, we must understand how they affect the detection of discrimination. With the appropriate requirements in place, algorithms create the potential for new forms of transparency and hence opportunities to detect discrimination that are otherwise unavailable. The specificity of algorithms also makes transparent tradeoffs among competing values. This implies algorithms are not only a threat to be regulated; with the right safeguards, they can be a potential positive force for equity.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Minoritized populations often face increased exposure to harmful content, such as racist comments or discriminatory practices, which could significantly impact mental health177 and further exacerbate mental health issues among minoritized populations.178”
From Digital Ecosystems, Children, and Adolescents: Technical Report (2026) · cites this paper as [178]
In the citing paper
“The emphasis on substantive equality enables a reform approach that avoids the seemingly intractable bind presented by the impossibility of fairness and the false choice between implementing risk assessments and doing nothing [11,90,108].”
From The false promise of risk assessments: epistemic reform and the limits of fairness (2020) · cites this paper as [90]
In the citing paper
“Additionally, it may be difficult to determine which types of fairness are most appropriate for a given context and how to balance them appropriately [4][5][6].”
From Fairness and Bias in Artificial Intelligence: A Brief Survey of Sources, Impacts, and Mitigation Strategies (2023) · cites this paper as [5]
Citations
Cites
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
Telling more than we can know: Verbal reports on mental processes.
Nisbett, R. E., & Wilson, T. D. (1977) · Psychological Review · doi:10.1037/0033-295x.84.3.231 · Cited by 11,317
Pattern Recognition and Machine Learning
(2006) · doi:10.1007/978-0-387-45528-0 · Cited by 9,824
Mostly Harmless Econometrics: An Empiricist's Companion
Angrist, J. D., & Pischke, J.-S. (2009) · doi:10.1515/9781400829828 · Cited by 9,467
Measuring individual differences in implicit cognition: the implicit association test
Greenwald, A. G., McGhee, D. E., & Schwartz, J. L. K. (1998) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.74.6.1464 · Cited by 9,210
Mostly Harmless Econometrics: An Empiricist's Companion
Angrist, J. D., & Pischke, J.-S. (2008) · doi:10.2307/j.ctvcm4j72 · Cited by 5,051
Bertrand, M., & Mullainathan, S. (2004) · American Economic Review · doi:10.1257/0002828042002561 · Cited by 4,504
Self-citationThe Statistical Theory of Racism and Sexism.
Phelps, E. S. (1972) · American Economic Review · Cited by 3,412
Discrimination and racial disparities in health: evidence and needed research
Williams, D. R., & Mohammed, S. A. (2009) · Journal of Behavioral Medicine · doi:10.1007/s10865-008-9185-0 · Cited by 3,371
Barocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048
Pager, D. (2003) · American Journal of Sociology · doi:10.1086/374403 · Cited by 2,840
Intergroup Conflict And Cooperation: The Robbers Cave Experiment
Sherif, M. (2013) · Medical Entomology and Zoology · Cited by 2,344
The Effect of Race and Sex on Physicians' Recommendations for Cardiac Catheterization
Schulman, K. A., Berlin, J. A., Harless, W., Kerner, J. F., Sistrunk, S., Gersh, B. J., Dubé, R., Taleghani, C. K., Burke, J. E., Williams, S., et al. (1999) · New England Journal of Medicine · doi:10.1056/nejm199902253400806 · Cited by 1,934
The Economics of Discrimination
Becker, G. S. (1971) · doi:10.7208/chicago/9780226041049.001.0001 · Cited by 1,794
Party Over Policy: The Dominating Impact of Group Influence on Political Beliefs.
Cohen, G. L. (2003) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.85.5.808 · Cited by 1,400
Human Decisions and Machine Predictions
Kleinberg, J., Lakkaraju, H., Leskovec, J., Ludwig, J., & Mullainathan, S. (2018) · The Quarterly Journal of Economics · doi:10.1093/qje/qjx032 · Cited by 1,040
Self-citationBlindspot: hidden biases of good people
(2014) · Choice Reviews Online · doi:10.5860/choice.51-5867 · Cited by 1,033
Teachers, race, and student achievement in a randomized experiment
Dee, T. S. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023750 · Cited by 965
A Dual-Self Model of Impulse Control
Fudenberg, D., & Levine, D. K. (2006) · American Economic Review · doi:10.1257/aer.96.5.1449 · Cited by 927
The nonverbal mediation of self-fulfilling prophecies in interracial interaction
Word, C. O., Zanna, M. P., & Cooper, J. (1974) · Journal of Experimental Social Psychology · doi:10.1016/0022-1031(74)90059-6 · Cited by 902
Lessons from the Netflix prize challenge
Bell, R. M., & Koren, Y. (2007) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1345448.1345465 · Cited by 727
Langer, E. J., Blank, A., & Chanowitz, B. (1978) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.36.6.635 · Cited by 694
Kleinberg, J., Ludwig, J., Mullainathan, S., & Obermeyer, Z. (2015) · American Economic Review · doi:10.1257/aer.p20151023 · Cited by 584
Self-citationDiscrimination in Labor Markets.
Stoikov, V., Ashenfelter, O., & Rees, A. (1975) · Industrial and Labor Relations Review · doi:10.2307/2521858 · Cited by 548
Human Decisions and Machine Predictions
Kleinberg, J., Lakkaraju, H., Leskovec, J., Ludwig, J., & Mullainathan, S. (2017) · doi:10.3386/w23180 · Cited by 545
Self-citationBan the Box, Criminal Records, and Racial Discrimination: A Field Experiment*
Agan, A., & Starr, S. (2018) · The Quarterly Journal of Economics · doi:10.1093/qje/qjx028 · Cited by 545
Introduction to the Theory of Computation
Ina, I., Rachel, & Aarón (2013) · Cited by 523
The Id, the Ego, and Equal Protection: Reckoning with Unconscious Racism
III, C. R. L. (1987) · Stanford Law Review · doi:10.2307/1228797 · Cited by 496
Prejudice and Wages: An Empirical Assessment of Becker’s The Economics of Discrimination
Charles, K. K., & Guryan, J. (2008) · Journal of Political Economy · doi:10.1086/593073 · Cited by 419
Arkes, H. R., & Tetlock, P. E. (2004) · Psychological Inquiry · doi:10.1207/s15327965pli1504_01 · Cited by 396
Taste‐Based or Statistical Discrimination: The Economics of Discrimination Returns to its Roots
Guryan, J., & Charles, K. K. (2013) · The Economic Journal · doi:10.1111/ecoj.12080 · Cited by 366
Cosmides, L., Tooby, J., & Kurzban, R. (2003) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(03)00057-3 · Cited by 358
Groups and the equal protection clause
Fiss, O. M. (1976) · Philosophy & Public Affairs · Cited by 313
(2018) · Harvard journal of law & technology · Cited by 295
Kleinberg, J., Ludwig, J., Mullainathan, S., & Rambachan, A. (2018) · AEA Papers and Proceedings · doi:10.1257/pandp.20181018 · Cited by 278
Self-citationCar ownership, employment, and earnings
Raphael, S., & Rice, L. (2002) · Journal of Urban Economics · doi:10.1016/s0094-1190(02)00017-7 · Cited by 254
Hehman, E., Flake, J. K., & Calanchini, J. (2018) · Social Psychological and Personality Science · doi:10.1177/1948550617711229 · Cited by 235
Implicit Bias and Accountability Systems: What Must Organizations Do to Prevent Discrimination?
Tetlock, P. E., & Mitchell, G. (2009) · Research in Organizational Behavior · doi:10.1016/j.riob.2009.10.002 · Cited by 215
Discrimination as a Self-Fulfilling Prophecy: Evidence from French Grocery Stores*
Glover, D., Pallais, A., & Pariente, W. (2017) · The Quarterly Journal of Economics · doi:10.1093/qje/qjx006 · Cited by 208
Strangers to Ourselves: Discovering the Adaptive Unconscious
Wilson, T. D. (2004) · Harvard University Press eBooks · doi:10.4159/9780674045217 · Cited by 204
Strangers to Ourselves: Discovering the Adaptive Unconscious
Wilson, T. D. (2004) · doi:10.2307/j.ctvjghvsk · Cited by 201
Productivity and Selection of Human Capital with Machine Learning
Chalfin, A., Danieli, O., Hillis, A., Jelveh, Z., Luca, M., Ludwig, J., & Mullainathan, S. (2016) · American Economic Review · doi:10.1257/aer.p20161029 · Cited by 190
Self-citationAn Empirical Study Analyzing Job Productivity in Toxic Workplace Environments
Anjum, A., Ming, X., Siddiqi, A. F., & Rasool, S. F. (2018) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph15051035 · Cited by 183
Jolls, C., & Sunstein, C. R. (2006) · California Law Review · doi:10.2307/20439057 · Cited by 177
Self-citationUsing implicit bias training to improve attitudes toward women in STEM
Jackson, S. M., Hillard, A. L., & Schneider, T. R. (2014) · Social Psychology of Education · doi:10.1007/s11218-014-9259-5 · Cited by 172
County-level racial prejudice and the black-white gap in infant health outcomes
Orchard, J., & Price, J. (2017) · Social Science & Medicine · doi:10.1016/j.socscimed.2017.03.036 · Cited by 162
Free at Last? Judicial Discretion and Racial Disparities in Federal Sentencing
Yang, C. S. (2015) · The Journal of Legal Studies · doi:10.1086/680989 · Cited by 157
Gender and Job Performance: Evidence from Wall Street
Jegadeesh, N., Green, T. C., & Tang, Y. (2009) · Financial Analysts Journal · doi:10.2469/faj.v65.n6.1 · Cited by 131
New Evidence on Teacher Labor Supply
Engel, M., Jacob, B. A., & Curran, F. C. (2014) · American Educational Research Journal · doi:10.3102/0002831213503031 · Cited by 115
Controlling Crime: Strategies and Tradeoffs
Cook, P. J., Ludwig, J., & McCrary, J. (2011) · RePEc: Research Papers in Economics · Cited by 109
Self-citationGase, L. N., Glenn, B. A., Gomez, L. M., Kuo, T., Inkelas, M., & Ponce, N. A. (2016) · Race and Social Problems · doi:10.1007/s12552-016-9183-8 · Cited by 95
Danger Ahead: Risk Assessment and the Future of Bail ReformPreprint
Koepke, J. L., & Robinson, D. G. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3041622 · Cited by 91
(2017) · SSRN Electronic Journal · Cited by 85
Statistical significance of the Netflix challengePreprint
Feuerverger, A., He, Y. H., & Khatri, S. (2016) · Cited by 77
Statistical proof of discrimination
Baldus, D. C., & Cole, J. W. L. (1980) · Medical Entomology and Zoology · Cited by 73
The Structural Turn and the Limits of Antidiscrimination Law
Bagenstos, S. R. (2006) · California Law Review · doi:10.2307/20439026 · Cited by 69
Sunstein, C. R. (1994) · Michigan Law Review · doi:10.2307/1289999 · Cited by 67
Self-citationThe Judicial Reception of Multiple Regression Studies in Race and Sex Discrimination Cases
Finkelstein, M. O. (1980) · Columbia Law Review · doi:10.2307/1122138 · Cited by 63
Discriminatory Intent and the Taming of Brown
Strauss, D. A. (1989) · The University of Chicago Law Review · doi:10.2307/1599760 · Cited by 62
Why Markets Don't Stop Discrimination
Sunstein, C. R. (1991) · Social Philosophy and Policy · doi:10.1017/s0265052500001114 · Cited by 61
Self-citationStatistical Significance of the Netflix Challenge
Feuerverger, A., He, Y., & Khatri, S. (2012) · Statistical Science · doi:10.1214/11-sts368 · Cited by 57
Antidiscrimination and Accommodation
Jolls, C. (2001) · Harvard Law Review · doi:10.2307/1342674 · Cited by 52
Reconciling Results on Racial Differences in Police Shootings
Fryer, R. G. (2018) · AEA Papers and Proceedings · doi:10.1257/pandp.20181004 · Cited by 51
Equal Protection and Disparate Impact: Round Three
Primus, R. A. (2003) · Harvard Law Review · doi:10.2307/3651947 · Cited by 46
The Constitutionality of Reverse Racial Discrimination
Ely, J. H. (1974) · The University of Chicago Law Review · doi:10.2307/1599097 · Cited by 42
Two Faces of Disparate Impact Discrimination
Perry, P. L. (1991) · FLASH - Fordham Law Archive of Scholarship & History (Fordham University) · Cited by 39
Two Views of the River: A Critique of the Liberal Defense of Affirmative Action
Lawrence, C. R. (2001) · Columbia Law Review · doi:10.2307/1123688 · Cited by 37
Brest, P. (1976) · Harvard Law Review · doi:10.2307/1340306 · Cited by 36
Anti-Subordination Above All: Sex, Race, and Equal Protection
Colker, R. (1986) · The Knowledge Bank (The Ohio State University) · Cited by 36
Machine Learning, Automated Suspicion Algorithms, and the Fourth Amendment
Rich, M. (2015) · Penn Carey Law Legal Scholarship Repository (University of Pennsylvania) · Cited by 34
The Q-Word as Red Herring: Why Disparate Impact Liability Does Not Induce Hiring Quotas
Ayres, I., & Siegelman, P. (1996) · bepress Legal Repository · Cited by 28
Application of Title VII to Jobs in High Places
Bartholet, E. (1982) · Harvard Law Review · doi:10.2307/1340570 · Cited by 27
The Law and Economics of Racial Discrimination in Employment: The Case for Numerical Standards
Strauss, D. A. (1991) · bepress Legal Repository · Cited by 24
A New Look at the History of Title VII Disparate Impact Doctrine
Carle, S. D. (2011) · bepress Legal Repository · Cited by 24
Disparate Impact, Discrimination, and the Essentially Contested Concept of Equality
Rutherglen, G. A. (2006) · FLASH - Fordham Law Archive of Scholarship & History (Fordham University) · Cited by 24
Causal Inference in Civil Rights Litigation
Greiner, D. J. (2008) · Digital Access to Scholarship at Harvard (DASH) (Harvard University) · Cited by 19
Gold, M. E. (1985) · eCommons (Cornell University) · doi:10.15779/z38x05d · Cited by 17
Was the Disparate Impact Theory a Mistake
Selmi, M. L. (2006) · Scholarly Commons - George Washington University Law School (George Washington University) · Cited by 16
An exploratory model for outsourcing-purchasing activities based on a comparative study
Chraibi, S., Sauvage, T., Sbihi, A., & Cragg, T. (2017) · Supply Chain Forum an International Journal · doi:10.1080/16258312.2017.1355721 · Cited by 8
Green, T. K. (1999) · California Law Review · doi:10.2307/3481022 · Cited by 8
Statistical proof of discrimination
Zabell, S. L. (1989) · Cited by 7
Presumptions of Discriminatory Motive in Title VII Disparate Treatment Cases
Méndez, M. Á. T. (1980) · Stanford Law Review · doi:10.2307/1228551 · Cited by 7
Norris, B. A. (1986) · Law and Contemporary Problems · doi:10.2307/1191650 · Cited by 7
Inventing the 'Traditional Concept' of Sex Discrimination
Franklin, C. (2012) · eScholarship (California Digital Library) · Cited by 5
Lye, L. (1998) · bepress Legal Repository · doi:10.15779/z38ns76 · Cited by 4
Wax, A. L. (2011) · Cited by 4
Reconsidering Disparate Impact Under Title VII: Business Necessity as Risk Management
Struebing, J. E. (2016) · bepress Legal Repository · Cited by 3
Tobia, K. (2017) · PhilPapers (PhilPapers Foundation) · Cited by 2
Research works printed but not linked: 11
- Balkin, 2003, The American Civil Rights Tradition, Univ. Miami Law Rev., 58, 9
- Mardsen, 1972, Social Trends in American Life: Finds from the General Social Survey since 1972, 38
- Conway, 1986, Statistics and the Law, 107.
- Kahneman, 2011, Thinking Fast and Slow
- Kahneman, 1973, Attention and Effort
- Latané, 1969, Bystander Apathy, Am. Sci., 57, 244
- Lee, 2005, Unconscious Bias Theory in Employment Discrimination Litigation, Harvard Civil Rights-Civil Liberties Law Rev., 40, 481
- Lehr, 2017, Playing with the Data: What Legal Scholars Should Learn about Machine Learning, Univ. Calif. Davis Law Rev., 51, 653
- Mayson, 2019, Bias in, Bias out, Yale Law J. (forthcoming)., 128
- Sullivan, 1986, Sins of Discrimination, Harvard Law Rev., 100, 78
- 2019, WVS Wave, 6
Cited by
Ferrara, E. (2023) · Sci · doi:10.3390/sci6010003 · Cited by 875
Governance of artificial intelligence
Taeihagh, A. (2021) · Policy and Society · doi:10.1080/14494035.2021.1928377 · Cited by 562
Large Legal Fictions: Profiling Legal Hallucinations in Large Language Models
Dahl, M., Magesh, V., Suzgun, M., & Ho, D. E. (2024) · Journal of Legal Analysis · doi:10.1093/jla/laae003 · Cited by 559
Algorithmic management in a work context
Jarrahi, M. H., Newlands, G., Lee, M. K., Wolf, C. T., Kinder, E., & Sutherland, W. (2021) · Big Data & Society · doi:10.1177/20539517211020332 · Cited by 532
Aung, Y. Y. M., Wong, D. C. S., & Ting, D. S. W. (2021) · British Medical Bulletin · doi:10.1093/bmb/ldab016 · Cited by 511
Metadata
- Authors
- Kleinberg, J., Ludwig, J., Mullainathan, S., & Sunstein, C. R.
- Affiliations
- Cornell University (US)
- University of Chicago (US)
- Harvard University (US)
- Corresponding author
- Sunstein, Cass R
- Venue
- Journal of Legal Analysis
- Publisher
- Oxford University Press (OUP)
- Published
- 2018
- Volume
- 10
- Pages
- 113-174
- ISSN
- 1946-5319 (ISSN-L)
- OpenAlex
- W2950068534
- Cited by
- 401
- References
- 88
- Citations by year
- 2026: 47 · 2025: 92 · 2024: 55 · 2023: 75 · 2022: 53 · 2021: 48 · 2020: 20 · 2019: 9 · 2018: 1
- FWCI
- 38.75
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- The Journal of Legal Analysis (publishedVersion, cc-by-nc)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Law › Discrimination and Equality Law
- Social Sciences › Law › Artificial Intelligence in Law
- Keywords
- algorithmic discrimination, algorithmic transparency, discrimination detection, algorithmic regulation, algorithmic fairness, legal regulation of algorithms, equity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.