The Dangers of Counterfactual Causal Thinking about Detecting Racial Discrimination
Open accessThe DOI matches its Crossref record.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Because systems are designed to achieve particular ends, we cannot disentangle the environmental contributions to a particular behaviour from the designed mechanism [31]-the mechanism must, after all, compensate for its environment if it correctly embodies its goals.”
From The fallacy of inscrutability (2018) · cites this paper as [31]
Citations
Cites
Still being checked.
Cited by
Fairness and Abstraction in Sociotechnical Systems
Selbst, A. D., Boyd, D., Friedler, S. A., Venkatasubramanian, S., & Vertesi, J. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287598 · Cited by 1,631
Algorithmic Fairness: Choices, Assumptions, and Definitions
Mitchell, S., Potash, E., Barocas, S., D'Amour, A., & Lum, K. (2021) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-042720-125902 · Cited by 687
“We define random variables V ( a ), D ( a ) as values randomly drawn from the population (Kohler-Hausmann 2018).”
MethodWhat Is Your Estimand? Defining the Target Quantity Connects Statistical Evidence to Theory
Lundberg, I., Johnson, R., & Stewart, B. M. (2021) · American Sociological Review · doi:10.1177/00031224211004187 · Cited by 364
Towards a critical race methodology in algorithmic fairness
Hanna, A., Denton, R., Smart, A., & Smith-Loud, J. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372826 · Cited by 295
“mselves contribute to the essentialization of race [10, 42, 43, 51]. There has also been significant debate about the appropriate use of racial variables in studies aimed at identifying causal effects [46, 54, 55, 58, 67]. Objections to the use of race as a causal variable are often couched in terms of manipulability,…”
Algorithmic recourse: From counterfactual explanations to interventions
Karimi, A.-H., Schölkopf, B., & Valera, I. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445899 · Cited by 274
Fairness in Information Access Systems
Ekstrand, M. D., Das, A., Burke, R., & Diaz, F. (2022) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000079 · Cited by 133
Counterfactual Fairness in Text Classification through Robustness
Garg, S., Perot, V., Limtiaco, N., Taly, A., Chi, E. H., & Beutel, A. (2019) · Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3306618.3317950 · Cited by 198
Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyond
Feder, A., Keith, K. A., Manzoor, E., Pryzant, R., Sridhar, D., Wood-Doughty, Z., Eisenstein, J., Grimmer, J., Reichart, R., Roberts, M. E., et al. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00511 · Cited by 220
Racial Discrimination in Housing: How Landlords Use Algorithms and Home Visits to Screen Tenants
Rosen, E., Garboden, P. M. E., & Cossyleon, J. E. (2021) · American Sociological Review · doi:10.1177/00031224211029618 · Cited by 174
Policy advice and best practices on bias and fairness in AI
Álvarez, J. M., Colmenarejo, A. B., Elobaid, A., Fabbrizzi, S., Fahimi, M., Ferrara, A., Ghodsi, S., Mougan, C., Papageorgiou, I. T., Lobo, P. R., et al. (2024) · Ethics and Information Technology · doi:10.1007/s10676-024-09746-w · Cited by 160
Li, J., Bzdok, D., Chen, J., Tam, A., Ooi, L. Q. R., Holmes, A. J., Ge, T., Patil, K. R., Jabbi, M., Eickhoff, S. B., et al. (2022) · Science Advances · doi:10.1126/sciadv.abj1812 · Cited by 133
Kroll, J. A. (2018) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2018.0084 · Cited by 132
Wang, A., Ramaswamy, V. V., & Russakovsky, O. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533101 · Cited by 87
A Hierarchy of Limitations in Machine Learning
Malik, M. M. (2020) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.2002.05193 · Cited by 51
This Thing Called Fairness: Disciplinary Confusion Realizing a Value in Technology
Mulligan, D. K., Kroll, J. A., Kohli, N., & Wong, R. Y. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359221 · Cited by 111
The Causal Fairness Field Guide: Perspectives From Social and Formal Sciences
Carey, A. N., & Wu, X. (2022) · AI and Ethics · doi:10.3389/fdata.2022.892837 · Cited by 135
Mass Probation from Micro to Macro: Tracing the Expansion and Consequences of Community Supervision
Phelps, M. S. (2019) · Annual Review of Criminology · doi:10.1146/annurev-criminol-011419-041352 · Cited by 113
Image Counterfactual Sensitivity Analysis for Detecting Unintended Bias
Denton, E., Hutchinson, B., Mitchell, M., Gebru, T., & Zaldivar, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.06439 · Cited by 31
The Use and Misuse of Counterfactuals in Ethical Machine Learning
Kasirzadeh, A., & Smart, A. (2021) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3442188.3445886 · Cited by 134
Confronting Power and Corporate Capture at the FAccT Conference
Young, M., Katell, M., & Krafft, P. M. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533194 · Cited by 63
Methodological Challenges and Opportunities in Testing for Racial Discrimination in Policing
Neil, R., & Winship, C. (2018) · Annual Review of Criminology · doi:10.1146/annurev-criminol-011518-024731 · Cited by 87
Algorithmic Recourse: from Counterfactual Explanations to Interventions
Karimi, A.-H., Schölkopf, B., & Valera, I. (2020) · arXiv · doi:10.48550/arxiv.2002.06278 · Cited by 76
Conceptualising fairness: three pillars for medical algorithms and health equity
Sikstrom, L., Maslej, M. M., Hui, K., Findlay, Z., Buchman, D. Z., & Hill, S. L. (2022) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2021-100459 · Cited by 76
What's sex got to do with machine learning?
Hu, L., & Kohler-Hausmann, I. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3375674 · Cited by 74
Self-citationLundberg, I. (2022) · Sociological Methods & Research · doi:10.1177/00491241211055769 · Cited by 85
Historical Redlining and Contemporary Racial Disparities in Neighborhood Life Expectancy
Graetz, N., & Esposito, M. H. (2022) · Social Forces · doi:10.1093/sf/soac114 · Cited by 65
Detecting Bias with Generative Counterfactual Face Attribute AugmentationPreprint
Denton, E., Hutchinson, B., Mitchell, M., & Gebru, T. (2019) · arXiv (Cornell University) · Cited by 75
What is Your Estimand? Defining the Target Quantity Connects Statistical Evidence to TheoryPreprint
Lundberg, I., Johnson, R., & Stewart, B. (2020) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/ba67n · Cited by 61
Inferential challenges when assessing racial/ethnic health disparities in environmental research
Benmarhnia, T., Hajat, A., & Kaufman, J. S. (2021) · Environmental Health · doi:10.1186/s12940-020-00689-5 · Cited by 50
DiRago, N. V., Li, M., Tom, T., Schupmann, W. D., Carrillo, Y., Carey, C., & Gaddis, S. M. (2021) · Journal of Urban Health · doi:10.1007/s11524-021-00589-0 · Cited by 48
Reimagining the machine learning life cycle to improve educational outcomes of students
Liu, L. T., Wang, S., Britton, T., & Abebe, R. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2204781120 · Cited by 70
Abend, G. (2020) · Sociological Methods & Research · doi:10.1177/0049124120926204 · Cited by 50
Martin, D., Prabhakaran, V., Kuhlberg, J., Smart, A., & Isaac, W. S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.09663 · Cited by 13
Enfranchisement and Incarceration after the 1965 Voting Rights Act
Eubank, N., & Fresh, A. (2022) · American Political Science Review · doi:10.1017/s0003055421001337 · Cited by 48
Systemic Discrimination: Theory and Measurement
Bohren, J. A., Hull, P., & Imas, A. (2025) · The Quarterly Journal of Economics · doi:10.1093/qje/qjaf022 · Cited by 64
Adomavičius, G., & Yang, M. (2019) · ACM Transactions on Management Information Systems · doi:10.1145/3519420 · Cited by 37
Subverting machines, fluctuating identities: Re-learning human categorization
Lu, C., Kay, J., & McKee, K. R. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533161 · Cited by 40
Causal inference for social discrimination reasoning
Qureshi, B., Kamiran, F., Karim, A., Ruggieri, S., & Pedreschi, D. (2019) · Journal of Intelligent Information Systems · doi:10.1007/s10844-019-00580-x · Cited by 30
An Empirical Analysis of Racial Categories in the Algorithmic Fairness Literature
Abdu, A. A., Pasquetto, I. V., & Jacobs, A. Z. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594083 · Cited by 34
Zilka, M., Fogliato, R., Hron, J., Butcher, B., Ashurst, C., & Weller, A. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594099 · Cited by 33
Kumar, I. E., Hines, K. E., & Dickerson, J. P. (2022) · Proceedings of the 2022 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3514094.3534154 · Cited by 24
Neck‐restraint bans, law enforcement officer unions, and police killings
Beck, B., Antonelli, J., & LaScala‐Gruenewald, A. (2024) · Criminology & Public Policy · doi:10.1111/1745-9133.12658 · Cited by 23
Next-Generation Policing Research: Three Propositions
Bell, M. C. (2021) · The Journal of Economic Perspectives · doi:10.1257/jep.35.4.29 · Cited by 28
Two Kinds of Discrimination in AI-Based Penal Decision-Making
Hübner, D. (2021) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3468507.3468510 · Cited by 25
Explainable AI as evidence of fair decisions
Leben, D. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1069426 · Cited by 26
The Target Study: A Conceptual Model and Framework for Measuring Disparity
Jackson, J. W., Hsu, Y., Greer, R. C., Boonyasai, R. T., & Howe, C. J. (2025) · Sociological Methods & Research · doi:10.1177/00491241251314037 · Cited by 21
Goodman, P. (2020) · Law & Social Inquiry · doi:10.1017/lsi.2020.9 · Cited by 21
Gender Economics: Dead-Ends and New Opportunities
Lundberg, S. (2022) · Emerald Group Publishing Limited eBooks · doi:10.1108/s0147-912120230000050006 · Cited by 24
Why Fair Labels Can Yield Unfair Predictions: Graphical Conditions for Introduced Unfairness
Ashurst, C., Carey, R., Chiappa, S., & Everitt, T. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i9.21182 · Cited by 26
Unlawful Proxy Discrimination: A Framework for Challenging Inherently Discriminatory Algorithms
Weerts, H., Kelly‐Lyth, A., Binns, R., & Adams‐Prassl, J. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3659010 · Cited by 22
Counterfactual Situation Testing: Uncovering Discrimination under Fairness given the Difference
Ruggieri, S., & Álvarez, J. M. (2023) · ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO) · doi:10.1145/3617694.3623222 · Cited by 21
Signal Manipulation and the Causal Analysis of Racial Discrimination
Weinberger, N. (2023) · Ergo an Open Access Journal of Philosophy · doi:10.3998/ergo.2915 · Cited by 16
The only thing that can stop bad causal inference is good causal inference
Rohrer, J. M., Schmukle, S. C., & McElreath, R. L. (2022) · Behavioral and Brain Sciences · doi:10.1017/s0140525x21000789 · Cited by 13
Identifying causal effects in maximally oriented partially directed acyclic graphsPreprint
Perković, E. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.02997 · Cited by 13
A Genealogical Approach to Algorithmic Bias
Ziosi, M., Watson, D., & Floridi, L. (2024) · Minds and Machines · doi:10.1007/s11023-024-09672-2 · Cited by 16
Causal Agnosticism About Race: Variable Selection Problems in Causal Inference
Tolbert, A. W. (2024) · Philosophy of Science · doi:10.1017/psa.2023.166 · Cited by 14
Counting racism: quantitative methods and the challenges of structural analysis in Germany
Karakayalı, S. (2025) · Ethnic and Racial Studies · doi:10.1080/01419870.2024.2446486 · Cited by 13
Ruggieri, S., Álvarez, J. M., Pugnana, A., State, L., & Turini, F. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i13.26798 · Cited by 44
von Struensee, S. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3880779 · Cited by 11
Hu, L. J., & Kohler‐Hausmann, I. (2024) · Law & Society Review · doi:10.1017/lsr.2024.36 · Cited by 14
Self-citationLa discriminación en una sociedad automatizada: Contribuciones desde América Latina
Gutiérrez, C. M. (2021) · Revista Chilena de Derecho y Tecnología · doi:10.5354/0719-2584.2021.58793 · Cited by 18
Systemic Discrimination: Theory and MeasurementPreprint
Bohren, J. A., Hull, P., & Imas, A. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4051254 · Cited by 24
Fish, B., & Stark, L. (2022) · Conference on Equity and Access in Algorithms, Mechanisms, and Optimization · doi:10.1145/3551624.3555296 · Cited by 9
Dimick, M. (2023) · Historical Materialism · doi:10.1163/1569206x-bja10016 · Cited by 7
Keith, K. A., Rice, D. R., & O’Connor, B. (2021) · doi:10.18653/v1/2021.cinlp-1.2 · Cited by 13
The causal impact of segregation on a disparity: A gap-closing approachPreprint
Lundberg, I. (2021) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/x9evk · Cited by 5
Counterfactual Situation Testing: From Single to Multidimensional Discrimination
Álvarez, J. M., & Ruggieri, S. (2025) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.17935 · Cited by 8
Kim, T. J. (2025) · Frontiers in Sociology · doi:10.3389/fsoc.2025.1562478 · Cited by 3
Explainability's Gain is Optimality's Loss? How Explanations Bias Decision-making
Wan, C., Belo, R., & Zejnilović, L. (2022) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3514094.3534156 · Cited by 5
Edwards, F. (2025) · Journal of Policy Analysis and Management · doi:10.1002/pam.70001 · Cited by 2
Elia, M. (2023) · Journal of Religious Ethics · doi:10.1111/jore.12464 · Cited by 3
Abuhamad, G. (2019) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 3
Lowder, E. M., Lawson, S. G., Ruhland, E. L., Rodriguez, A., Frye, P., & McPherson, M. (2025) · Justice Quarterly · doi:10.1080/07418825.2025.2466012 · Cited by 1
Methodological Challenges for Research on Racial Bias in Police Shootings
Murphy, J. P., Neil, R., & Paige, J. W. (2024) · RAND Corporation eBooks · doi:10.7249/rra243-8 · Cited by 3
Explaining Social Disparities by Emulating Interventions at Different Life Course StagesPreprint
Kratz, F. (2024) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/dg78h · Cited by 1
The Insufficiency of Statistics for Detecting Racial Discrimination by Police
Weinberger, N. (2023) · Philosophy of Science · doi:10.1017/psa.2023.134 · Cited by 1
Incorporating a more expansive theory of racism into child and family policy systems
Edwards, F. (2025) · Journal of Policy Analysis and Management · doi:10.1002/pam.70000
The Causal Impact of Segregation on a Disparity: A Gap-Closing Approach
Lundberg, I. (2025) · Sociological Science · doi:10.15195/v12.a35 · Cited by 1
Chalson, S. (2025) · ANU Open Research (Australian National University) · doi:10.25911/9g9f-y472
Bohmert, M. N., Lowder, E. M., Ying, M., & Thai, M. L. (2026) · Criminal Justice Review · doi:10.1177/07340168261434586
On interpreting the causal effects of race
Malinsky, D., & Bright, L. K. (2026) · Journal of Causal Inference · doi:10.1515/jci-2025-0062
Metadata
- Authors
- Kohler-Hausmann, I.
- Venue
- SSRN Electronic Journal
- Publisher
- Elsevier BV
- Published
- 2017
- ISSN
- 1556-5068 (ISSN-L)
- OpenAlex
- W2766921623
- Cited by
- 9
- References
- 0
- Citations by year
- 2026: 1 · 2022: 4 · 2021: 1 · 2020: 2 · 2018: 1
- Type
- posted content
- Language
- en
- Open access
- green
- doi.org
- Locations
- SSRN Electronic Journal (publishedVersion)
- Topics
- Social Sciences › Law › Discrimination and Equality Law
- Social Sciences › Sociology and Political Science › Names, Identity, and Discrimination Research
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- racial discrimination, audit studies, correspondence education, racial profiling, police stops, fairness and justice
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.