The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
The hidden assumptions behind counterfactual explanations and principal reasons
Open accessAbstract
Counterfactual explanations are gaining prominence within technical, legal, and business circles as a way to explain the decisions of a machine learning model. These explanations share a trait with the long-established "principal reason" explanations required by U.S. credit laws: they both explain a decision by highlighting a set of features deemed most relevant---and withholding others.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Rudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561
Tyler, T. R. (2006) · doi:10.1515/9781400828609 · Cited by 5,156
Privacy in Context: Technology, Policy, and the Integrity of Social Life
Nissenbaum, H. (2009) · doi:10.1515/9780804772891 · Cited by 2,129 · cited 1×
“integrity [30].”
Fairness and Abstraction in Sociotechnical Systems
Selbst, A. D., Boyd, D., Friedler, S. A., Venkatasubramanian, S., & Vertesi, J. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287598 · Cited by 1,631
Self-citationSolove, D. J. (2006) · University of Pennsylvania Law Review · doi:10.2307/40041279 · Cited by 1,388
Wachter, S., Mittelstadt, B., & Floridi, L. (2017) · International Data Privacy Law · doi:10.1093/idpl/ipx005 · Cited by 1,308
Explaining machine learning classifiers through diverse counterfactual explanations
Mothilal, R. K., Sharma, A., & Tan, C. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372850 · Cited by 1,233 · cited 6×
“differently from the point currently in question [20, 29, 36, 44, 47].”
BackgroundInfluentialIntelligible models for classification and regression
Lou, Y., Caruana, R., & Gehrke, J. (2012) · Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2339530.2339556 · Cited by 547
Edwards, L., & Veale, M. (2017) · doi:10.31228/osf.io/97upg · Cited by 524
Research works printed but not linked: 26
- Balkin Jack M, 2015, Information fiduciaries and the first amendment, UC Davis Law Review, 49, 1183
- Bambauer Jane, 2018, The algorithm game, Notre Dame L. Rev., 94, 1
- Brkan Maja, 2019, International journal of law and information technology 27, 2
- Citron Danielle Keats, 2014, The scored society: Due process for automated predictions, Washington Law Review, 89, 1
- Cohen Julie E, Configuring the networked self: Law, code, and the play of everyday practice
- Cohen Julie E, 2012, What privacy is for, Harvard Law Review, 126, 1904
- Amit Dhurandhar Pin-Yu Chen Ronny Luss Chun-Chen Tu Paishun Ting Karthikeyan Shanmugam and Payel Das. 2018. Explanations based on the missing: Towards contrastive explanations with pertinent negatives. In Advances in Neural Information Processing Systems. 592--603. Amit Dhurandhar Pin-Yu Chen Ronny Luss Chun-Chen Tu Paishun Ting Karthikeyan Shanmugam and Payel Das. 2018. Explanations based on the missing: Towards contrastive explanations with pertinent negatives. In Advances in Neural Information Processing Systems. 592--603.
- Eubanks Virginia, Automating inequality: How high-tech tools profile, police, and punish the poor
- Grath Rory Mc, 2018, Paul Sweeney, Farbod Kamiab, Zhao Shen, and Freddy Lecue.
- Hendricks Lisa Anne, 2018, Generating counterfactual explanations with natural language. arXiv preprint arXiv:1806.09809 · arXiv
- 10.1007/s11623-006-0140-3 · DOI
- Karimi Amir-Hossein, 2019, Model-Agnostic Counterfactual Explanations for Consequential Decisions. arXiv preprint arXiv:1905.11190 · arXiv
- Khan Lina, 2019, A Skeptical View of Information Fiduciaries. Harvard Law Review 133
- 10.1145/3328526.3329584 · DOI
- Lipton Zachary, 2017, NYU Algorithms and Explanations Conference.
- Liu Lydia T., 2018, Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsmässan
- 10.1093/idpl/ipx019 · DOI · Paper page
- Mendoza Isak, EU Internet Law
- Packin Nizan Geslevich, 2016, On social credit and the right to be unnetworked. Columbia Business Law Review
- Reiman Jeffrey H, 1976, intimacy, and personhood. Philosophy & Public Affairs
- Selbst Andrew D., 2018, The intuitive appeal of explainable machines, Fordham Law Review, 87, 1085
- 10.1093/idpl/ipx022 · DOI · Paper page
- Senate Report No. 94-589 1976. Senate Report No. 94-589 1976. · DOI
- Tramèr Florian, 25th {USENIX} Security Symposium ({USENIX} Security 16). 601--618.
- 10.1145/3287560.3287566 · DOI · Paper page
- Wachter Sandra, 2017, Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GPDR, Journal of Law & Technology, 31, 841
Cited by
Lebovitz, S., Lifshitz-Assaf, H., & Levina, N. (2022) · Organization Science · doi:10.1287/orsc.2021.1549 · Cited by 632
Interpretable Machine Learning: Moving from mythos to diagnostics
Chen, V., Li, J., Kim, J. S., Plumb, G., & Talwalkar, A. (2021) · Queue · doi:10.1145/3511299 · Cited by 516
Inherent Tradeoffs in the Fair Determination of Risk Scores
(2023) · The Societal Impacts of Algorithmic Decision-Making · doi:10.1145/3603195.3603197 · Cited by 310
A Survey of Algorithmic Recourse: Contrastive Explanations and Consequential Recommendations
Karimi, A.-H., Barthe, G., Schölkopf, B., & Valera, I. (2023) · ACM Computing Surveys · doi:10.1145/3527848 · Cited by 301
Chou, Y.-L., Moreira, C., Bruza, P., Ouyang, C., & Jorge, J. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.11.003 · Cited by 302
Algorithmic recourse: From counterfactual explanations to interventions
Karimi, A.-H., Schölkopf, B., & Valera, I. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445899 · Cited by 274
Counterfactual Explanations and Algorithmic Recourses for Machine Learning: A Review
Verma, S., Boonsanong, V., Hoang, M., Hines, K. E., Dickerson, J. P., & Shah, C. (2020) · arXiv · doi:10.48550/arxiv.2010.10596 · Cited by 267
“switches to a higher-paying job may find themselves in a worse position than earlier. Thus by failing to disclose what must not change, an explanation may lead the applicant to an unsuccessful state [16]. This corroborates RC3, whereby an applicant might be able to interact with an interactive platform to see the effe…”
BackgroundCounterfactual Explanations and Algorithmic Recourses for Machine Learning: A Review
Verma, S., Boonsanong, V., Hoang, M., Hines, K., Dickerson, J., & Shah, C. (2024) · ACM Computing Surveys · doi:10.1145/3677119 · Cited by 255
The Fallacy of AI Functionality
Raji, I. D., Kumar, I. E., Horowitz, A., & Selbst, A. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533158 · Cited by 251
Self-citationProblems with Shapley-value-based explanations as feature importance measures
Kumar, I. E., Venkatasubramanian, S., Scheidegger, C., & Friedler, S. (2020) · arXiv · doi:10.48550/arxiv.2002.11097 · Cited by 228
“ight be able to alter their own situation to approximate q. This setup has been formalized as the “counterfactual explanation” problem byWachter et al.(2017) (with an analysis of hidden assumptions byBarocas et al. (2020)).Ustun et al.(2019) further specify a way to model this problem by searching for changes within c…”
Ethical machines: The human-centric use of artificial intelligence
Lepri, B., Oliver, N., & Pentland, A. (2021) · iScience · doi:10.1016/j.isci.2021.102249 · Cited by 149
EXplainable Artificial Intelligence (XAI)—From Theory to Methods and Applications
Ortigossa, E. S., Gonçalves, T., & Nonato, L. G. (2024) · IEEE Access · doi:10.1109/access.2024.3409843 · Cited by 124
The philosophical basis of algorithmic recourse
Venkatasubramanian, S., & Alfano, M. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372876 · Cited by 114
“Barocas, Selbst and Raghavan[4] provide a more focused critique of counterfactual explanations.”
BackgroundModel Multiplicity: Opportunities, Concerns, and Solutions
Black, E., Raghavan, M., & Barocas, S. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533149 · Cited by 85
“Both laws compel lenders to provide so-called “adverse action notices” that state the “principle reasons” for adverse decisions, on the belief that doing so may help consumers more effectively navigate the process of obtaining credit in the future [6, 54].”
BackgroundSelf-citationTransparency as design publicity: explaining and justifying inscrutable algorithms
Loi, M., Ferrario, A., & Viganò, E. (2021) · Ethics and Information Technology · doi:10.1007/s10676-020-09564-w · Cited by 79
Algorithmic Recourse: from Counterfactual Explanations to Interventions
Karimi, A.-H., Schölkopf, B., & Valera, I. (2020) · arXiv · doi:10.48550/arxiv.2002.06278 · Cited by 76
Explainable machine learning for public policy: Use cases, gaps, and research directions
Amarasinghe, K., Rodolfa, K. T., Lamba, H., & Ghani, R. (2023) · Data & Policy · doi:10.1017/dap.2023.2 · Cited by 73
“[2020a], Belle and Papantonis [2021], Hong et al. [2020]. These efforts have primarily focused on identifying how the ML community is using existing interpretability methods.”
BackgroundInfluentialOn the Fairness of Causal Algorithmic Recourse
Kügelgen, J. V., Karimi, A.-H., Bhatt, U., Valera, I., Weller, A., & Schölkopf, B. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i9.21192 · Cited by 58
Bell, A., Nov, O., & Stoyanovich, J. (2023) · Data & Policy · doi:10.1017/dap.2023.8 · Cited by 44
Düsing, C., Cimiano, P., Rehberg, S., Scherer, C., Kaup, O., Köster, C., Hellmich, S., Herrmann, D., Meier, K. L., Claßen, S., et al. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102982 · Cited by 26
From Bias to Repair: Error as a Site of Collaboration and Negotiation in Applied Data Science Work
Lin, C. K., & Jackson, S. J. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579607 · Cited by 22
System Safety and Artificial Intelligence
Dobbe, R. I. J. (2022) · The Oxford Handbook of AI Governance · doi:10.1093/oxfordhb/9780197579329.013.67 · Cited by 12
Towards causal algorithmic recourse
Karimi, A.-H., von Kügelgen, J., Schölkopf, B., & Valera, I. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-04083-2_8 · Cited by 11
Algorithmic monoculture and social welfare
(2023) · The Societal Impacts of Algorithmic Decision-Making · doi:10.1145/3603195.3603202
Self-citation
Metadata
- Authors
- Barocas, S., Selbst, A. D., & Raghavan, M.
- Venue
- Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency
- Publisher
- ACM
- Published
- 2020-01-27
- Pages
- 80-89
- OpenAlex
- W2995528912
- Cited by
- 216
- References
- 16
- FWCI
- 15.52
- Type
- conference paper
- Language
- en
- Open access
- gold
- Funders
- National Science Foundation (IIS-1633400)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.