Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 96 of the 100 references it cites were found in a registry or an index; none of the 58 sources its claims cite is checked for support yet.

Explaining Explanations in AI

Open access
Mittelstadt, Brent, Russell, Chris, Wachter, Sandra · 2019 · Proceedings of the Conference on Fairness, Accountability, and Transparency

Abstract

Recent work on interpretability in machine learning and AI has focused on the building of simplified models that approximate the true criteria used to make decisions. These models are a useful pedagogical device for teaching trained professionals how to predict what decisions will be made by the complex system, and most importantly how the system might break. However, when considering any such model it's important to remember Box's maxim that "All models are wrong but some are useful." We focus on the distinction between these models and explanations in philosophy and sociology. These models can be understood as a "do it yourself kit" for explanations, allowing a practitioner to directly answer "what if questions" or generate contrastive explanations without external assistance. Although a valuable ability, giving these models as explanations appears more difficult than necessary, and other forms of explanation may not have the same trade-offs. We contrast the different schools of thought on what makes an explanation, and suggest that machine learning might benefit from viewing the problem more broadly.

Overview

CoChat Summary

TL;DR

The paper argues that most explainable AI (xAI) methods produce simplified approximations of black-box models, which function more like scientific models than explanations as studied in philosophy, cognitive science, and social science. It calls for contrastive, selective, and socially interactive explanations that support contestability and accountability.

Key findings

  • xAI’s dominant approach retro-fits local or global simplified models—linear/gradient-based approximations or decision-tree methods—over complex algorithms; these are useful for experts and debugging but can be misleading to non-experts when their domain and limitations are undocumented.
  • Work in the “explanation sciences” indicates that everyday explanations are contrastive, selective, and social: people ask why P rather than Q, select one or two causes from many, and explanations involve interactive dialogue and argumentation.
  • Contrastive explanation methods (e.g., Martens and Provost 2013; Wachter et al. 2018) directly return alternative data points and avoid some approximation/domain problems, but raise relevance concerns if the counterfactual does not correspond to a user’s interests.
  • The paper argues xAI should develop interactive post-hoc methods that make algorithmic decisions contestable and facilitate dialogue among users, developers, systems, and stakeholders; it states the field largely fails this task at present.

Methods

  • Conceptual/position paper; no empirical study, dataset, or quantitative analysis is reported.
  • Reviews xAI interpretability approaches—transparency versus post-hoc interpretation, local/global approximations, and linear/gradient versus tree-based methods—and contrasts them with philosophical, cognitive science, and social science literature on explanation.
  • Uses argumentation and synthesis, with illustrative examples such as Newtonian physics, a bee/spider example, and image binarization choices.

Limitations

  • Stated: a complete overview of the philosophy of explanation is unfeasible; the paper focuses solely on ways of providing explanations; contrastive theories remain debated; and choosing relevant contrast cases is not straightforward.
  • Evident: no empirical validation, user study, or comparative evaluation of explanation methods is presented; claims about misleading non-experts and the need for interactive methods are argued rather than tested.
  • Evident: the analysis relies on secondary literature and selected examples, with no new data or formal metrics.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1145/3287560.3287574

Cites

96 of 96 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

0 Valid · 8 Not valid · 42 Not checked · 64 Own results and interpretations

50 more claims

Create a free account to see all 114 claims and to verify the 58 references still open.

See all claims — free account
  • Probably not a substantial claim. 42
  • It may state two separate claims as one. 28

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

3 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Citations

Cites

Show all 100 references

Research works printed but not linked: 16

  1. Biran Or, 2014, Proceedings of the AutoML workshop at ICML, 2014
  2. Craven Mark, 1996, Shavlik
  3. Ruth, 2017, Fong and Andrea Vedaldi
  4. Habermas J., The Theory of Communicative Action: Volume 1: Reason and the Rationalization of Society
  5. Hilton Denis J., 1986, Slugoski
  6. Kim Been, 2014, Shah
  7. Kroll Joshua A., 2016, Accountable algorithms, U. Pa. L. Rev., 165, 633
  8. Lepri Bruno, 2017, The Premise, the Proposed Solutions, and the Open Challenges. Philosophy & Technology (15 8
  9. David Lewis. 1973. Counterfactuals. Blackwell Oxford. David Lewis. 1973. Counterfactuals. Blackwell Oxford.
  10. Lipton Zachary C., 2016, The Mythos of Model Interpretability. arXiv:1606.03490 {cs, stat} (10 6 · arXiv
  11. Lisboa Paulo JG, 2015, Fuzzy Logic and Applications
  12. Martens David, 2007, Tony Van Gestel, and Jan Vanthienen
  13. McClure John L., 2003, Hilton
  14. Sandvig Christian, 2014, Auditing algorithms: Research methods for detecting discrimination on internet platforms. Data and discrimination: converting critical concerns into productive inquiry
  15. Andrew, 2018, Selbst and Solon Barocas
  16. Wachter Sandra, 2018, Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPR. Harvard Journal of Law & Technology forthcoming

Cited by

See all 916

Metadata

Authors
Mittelstadt, B., Russell, C., & Wachter, S.
Affiliations
  • University of Oxford (GB)
  • University of Surrey (GB)
Venue
Proceedings of the Conference on Fairness, Accountability, and Transparency
Publisher
ACM
Published
2019-01-29
Pages
279-288
OpenAlex
W2898694742
Cited by
794
References
100
Citations by year
2026: 79 · 2025: 99 · 2024: 110 · 2023: 117 · 2022: 115 · 2021: 125 · 2020: 107 · 2019: 40
FWCI
37.01
Type
conference paper
Language
en
Open access
Locations
  • ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • Surrey Research Insight Open Access (The University of Surrey) (submittedVersion)
  • SSRN Electronic Journal (submittedVersion)
  • PhilPapers (PhilPapers Foundation) (submittedVersion)
  • arXiv (Cornell University)
Funders
Engineering and Physical Sciences Research Council (EP/N510129/1)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Social Sciences › Arts and Humanities › History and Philosophy of Science › Philosophy of Biology and Scientific Explanation
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
Keywords
explainable AI, interpretability, philosophy of explanation, contrastive explanations, what-if questions, teaching model

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Explaining Explanations in AI. https://app.cochat.ai/papers/10.1145/3287560.3287574
The paper
Mittelstadt, B., Russell, C., & Wachter, S. (2019). Explaining Explanations in AI. Proceedings of the Conference on Fairness, Accountability, and Transparency. https://doi.org/10.1145/3287560.3287574

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.