CoChat

TED: Teaching AI to Explain its Decisions

Hind, Michael, Wei, Dennis, Campbell, Murray, Codella, Noel C. F., Dhurandhar, Amit, Mojsilović, Aleksandra, Natesan Ramamurthy, Karthikeyan, Varshney, Kush R. · 2019 · Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society
Cited by 92

The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.

Abstract

Artificial intelligence systems are being increasingly deployed due to their potential to increase the efficiency, scale, consistency, fairness, and accuracy of decisions. However, as many of these systems are opaque in their operation, there is a growing demand for such systems to provide explanations for their decisions. Conventional approaches to this problem attempt to expose or discover the inner workings of a machine learning model with the hope that the resulting explanations will be meaningful to the consumer. In contrast, this paper suggests a new approach to this problem. It introduces a simple, practical framework, called Teaching Explanations for Decisions (TED), that provides meaningful explanations that match the mental model of the consumer. We illustrate the generality and effectiveness of this approach with two different examples, resulting in highly accurate explanations with no loss of prediction accuracy for these two examples.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3306618.3314273

Cites

13 of 13 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 13 references

Research works printed but not linked: 24

  1. Yessenalina Ainur , Yejin Choi , and Claire Cardie . 2010 . Automatically Generating Annotator Rationales to Improve Sentiment Classification . In Proceedings of the ACL 2010 Conference Short Papers. 336--341 . Yessenalina Ainur, Yejin Choi, and Claire Cardie. 2010. Automatically Generating Annotator Rationales to Improve Sentiment Classification. In Proceedings of the ACL 2010 Conference Short Papers. 336--341.
  2. Osbert Bastani , Carolyn Kim , and Hamsa Bastani . 2018. Interpreting Blackbox Models via Model Extraction. arXiv preprint arXiv:1705.08504 ( 2018 ). Osbert Bastani, Carolyn Kim, and Hamsa Bastani. 2018. Interpreting Blackbox Models via Model Extraction. arXiv preprint arXiv:1705.08504 (2018). · arXiv
  3. Or Biran and Courtenay Cotton . 2017 . Explanation and Justification in Machine Learning: A Survey. In IJCAI-17 Workshop on Explainable AI (XAI). Or Biran and Courtenay Cotton. 2017. Explanation and Justification in Machine Learning: A Survey. In IJCAI-17 Workshop on Explainable AI (XAI).
  4. Alex Campolo , Madelyn Sanfilippo Meredith Whittaker, and Kate Crawford . 2017 . 2017 Annual Report. Technical Report. AI NOW. Alex Campolo, Madelyn Sanfilippo Meredith Whittaker, and Kate Crawford. 2017. 2017 Annual Report. Technical Report. AI NOW.
  5. Sanjeeb Dash Oktay Gunluk and Dennis Wei. 2018. Boolean Decision Rules via Column Generation. In Advances in Neural Information Processing Systems. Sanjeeb Dash Oktay Gunluk and Dennis Wei. 2018. Boolean Decision Rules via Column Generation. In Advances in Neural Information Processing Systems.
  6. Amit Dhurandhar , Vijay Iyengar , Ronny Luss , and Karthikeyan Shanmugam . 2017 . A Formal Framework to Characterize Interpretability of Procedures . In Proc. ICML Workshop Human Interp. Mach. Learn . Sydney, Australia, 1--7. Amit Dhurandhar, Vijay Iyengar, Ronny Luss, and Karthikeyan Shanmugam. 2017. A Formal Framework to Characterize Interpretability of Procedures. In Proc. ICML Workshop Human Interp. Mach. Learn. Sydney, Australia, 1--7.
  7. 10.1109/ICCV.2011.6126394 · DOI
  8. Finale Doshi-Velez , Mason Kortz , Ryan Budish , Chris Bavitz , Sam Gershman , David O'Brien , Stuart Schieber , James Waldo , David Weinberger , and Alexandra Wood . 2017. Accountability of AI Under the Law: The Role of Explanation. CoRR , Vol. abs/ 1711 .01134 ( 2017 ). arxiv: 1711.01134 http://arxiv.org/abs/1711.01134 Finale Doshi-Velez, Mason Kortz, Ryan Budish, Chris Bavitz, Sam Gershman, David O'Brien, Stuart Schieber, James Waldo, David Weinberger, and Alexandra Wood. 2017. Accountability of AI Under the Law: The Role of Explanation. CoRR, Vol. abs/1711.01134 (2017). arxiv: 1711.01134 http://arxiv.org/abs/1711.01134 · arXiv
  9. Kun Duan Devi Parikh David Crandall and Kristen Grauman. 2012. Discovering Localized Attributes for Fine-grained Recognition. In CVPR. Kun Duan Devi Parikh David Crandall and Kristen Grauman. 2012. Discovering Localized Attributes for Fine-grained Recognition. In CVPR. · DOI · Paper page
  10. Ian Goodfellow , Yoshua Bengio , and Aaron Courville . 2016. Deep Learning . MIT Press . http://www.deeplearningbook.org. Ian Goodfellow, Yoshua Bengio, and Aaron Courville. 2016. Deep Learning .MIT Press. http://www.deeplearningbook.org.
  11. Bryce Goodman and Seth Flaxman . 2016 . EU Regulations on Algorithmic Decision-Making and a `Right to Explanation '. In Proc. ICML Workshop Human Interp. Mach. Learn . New York, NY, 26--30. Bryce Goodman and Seth Flaxman. 2016. EU Regulations on Algorithmic Decision-Making and a `Right to Explanation'. In Proc. ICML Workshop Human Interp. Mach. Learn. New York, NY, 26--30.
  12. Been Kim , Dmitry M. Malioutov , Kush R. Varshney , and Adrian Weller ( Eds .). 2017 . 2017 ICML Workshop on Human Interpretability in Machine Learning. https://arxiv.org/abs/1708 .02666v1 Been Kim, Dmitry M. Malioutov, Kush R. Varshney, and Adrian Weller (Eds.). 2017. 2017 ICML Workshop on Human Interpretability in Machine Learning. https://arxiv.org/abs/1708.02666v1 · arXiv
  13. Been Kim Kush R. Varshney and Adrian Weller (Eds.). 2018. 2018 Workshop on Human Interpretability in Machine Learning. https://sites.google.com/view/whi2018/home Been Kim Kush R. Varshney and Adrian Weller (Eds.). 2018. 2018 Workshop on Human Interpretability in Machine Learning. https://sites.google.com/view/whi2018/home
  14. Zachary C Lipton . 2016 . The mythos of model interpretability . In ICML Workshop on Human Interpretability of Machine Learning. Zachary C Lipton. 2016. The mythos of model interpretability. In ICML Workshop on Human Interpretability of Machine Learning.
  15. 10.1016/j.cogpsych.2006.09.006 · DOI · Paper page
  16. T. McDonnell , M. Lease , M. Kutlu , and T. Elsayed . 2016. Why Is That Relevant? Collecting Annotator Rationales for Relevance Judgments . In Proc. AAAI Conf. Human Comput. Crowdsourc. T. McDonnell, M. Lease, M. Kutlu, and T. Elsayed. 2016. Why Is That Relevant? Collecting Annotator Rationales for Relevance Judgments. In Proc. AAAI Conf. Human Comput. Crowdsourc.
  17. Tim Miller . 2017. Explanation in Artificial Intelligence: Insights from the Social Sciences. arXiv preprint arXiv:1706.07269 (June 2017 ). Tim Miller. 2017. Explanation in Artificial Intelligence: Insights from the Social Sciences. arXiv preprint arXiv:1706.07269 (June 2017). · arXiv
  18. P. Peng Y. Tian T. Xiang Y. Wang and T. Huang . 2016 . Joint Learning of Semantic and Latent Attributes. In ECCV 2016 Lecture Notes in Computer Science Vol. 9908 . P. Peng Y. Tian T. Xiang Y. Wang and T. Huang. 2016. Joint Learning of Semantic and Latent Attributes. In ECCV 2016 Lecture Notes in Computer Science Vol. 9908. · DOI
  19. 10.1145/2939672.2939778 · DOI · Paper page
  20. 10.1093/idpl/ipx022 · DOI · Paper page
  21. 10.1145/1102351.1102460 · DOI
  22. Kush R. Varshney . 2016 . Engineering Safety in Machine Learning. In Information Theory and Applications Workshop. Kush R. Varshney. 2016. Engineering Safety in Machine Learning. In Information Theory and Applications Workshop.
  23. Omar F. Zaidan and Jason Eisner . 2007 . Using 'annotator rationales' to improve machine learning for text categorization. In In NAACL-HLT. 260--267. Omar F. Zaidan and Jason Eisner. 2007. Using 'annotator rationales' to improve machine learning for text categorization. In In NAACL-HLT. 260--267.
  24. Omar F. Zaidan and Jason Eisner. 2008. Modeling Annotators: A Generative Approach to Learning from Annotator Rationales . In Proceedings of EMNLP 2008 . 31--40. Omar F. Zaidan and Jason Eisner. 2008. Modeling Annotators: A Generative Approach to Learning from Annotator Rationales. In Proceedings of EMNLP 2008. 31--40.

Cited by

See all 92

Metadata

Authors
Hind, M., Wei, D., Campbell, M., Codella, N. C. F., Dhurandhar, A., Mojsilović, A., Natesan Ramamurthy, K., & Varshney, K. R.
Venue
Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society
Publisher
ACM
Published
2019-01-27
Pages
123-129
ISSN
3065-8365 (ISSN-L)
OpenAlex
W2960259221
Cited by
92
References
13
FWCI
5.31
Type
conference paper
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: TED: Teaching AI to Explain its Decisions. https://app.cochat.ai/papers/10.1145/3306618.3314273
The paper
Hind, M., Wei, D., Campbell, M., Codella, N. C. F., Dhurandhar, A., Mojsilović, A., Natesan Ramamurthy, K., & Varshney, K. R. (2019). TED: Teaching AI to Explain its Decisions. Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society. https://doi.org/10.1145/3306618.3314273

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.