TED: Teaching AI to Explain its Decisions
The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
Artificial intelligence systems are being increasingly deployed due to their potential to increase the efficiency, scale, consistency, fairness, and accuracy of decisions. However, as many of these systems are opaque in their operation, there is a growing demand for such systems to provide explanations for their decisions. Conventional approaches to this problem attempt to expose or discover the inner workings of a machine learning model with the hope that the resulting explanations will be meaningful to the consumer. In contrast, this paper suggests a new approach to this problem. It introduces a simple, practical framework, called Teaching Explanations for Decisions (TED), that provides meaningful explanations that match the mental model of the consumer. We illustrate the generality and effectiveness of this approach with two different examples, resulting in highly accurate explanations with no loss of prediction accuracy for these two examples.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707
Lipton, Z. C. (2018) · Queue · doi:10.1145/3236386.3241340 · Cited by 5,427
Towards A Rigorous Science of Interpretable Machine Learning
Doshi-Velez, F., & Kim, B. (2017) · arXiv · doi:10.48550/arxiv.1702.08608 · Cited by 3,121
Methods for interpreting and understanding deep neural networks
Montavon, G., Samek, W., & Müller, K.-R. (2018) · Digital Signal Processing · doi:10.1016/j.dsp.2017.10.011 · Cited by 2,665
Intelligible Models for HealthCare: Predicting Pneumonia Risk and Hospital 30-day Readmission
Caruana, R., Lou, Y., Gehrke, J., Koch, P., Sturm, M., & Elhadad, N. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2788613 · Cited by 1,685
Wachter, S., Mittelstadt, B., & Floridi, L. (2017) · International Data Privacy Law · doi:10.1093/idpl/ipx005 · Cited by 1,308
Rationalizing Neural Predictions
Lei, T., Barzilay, R., & Jaakkola, T. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1011 · Cited by 777 · cited 2×
“Work in the natural language processing and computer vision domains that generate rationales/explanations derived from input text (e.g., (Lei, Barzilay, and Jaakkola 2016; Ainur, Choi, and Cardie 2010; Hendricks et al. 2016)).”
BackgroundGenerating Visual Explanations
Hendricks, L. A., Akata, Z., Rohrbach, M., Donahue, J., Schiele, B., & Darrell, T. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_1 · Cited by 534
Transparent, explainable, and accountable AI for robotics
Wachter, S., Mittelstadt, B., & Floridi, L. (2017) · Science Robotics · doi:10.1126/scirobotics.aan6080 · Cited by 413 · cited 2×
“The demand for explanation has manifested itself in new regulations that call for automated decision making systems to provide “meaningful information” on the logic used to reach conclusions (Goodman and Flaxman 2016; Wachter, Mittelstadt, and Floridi 2017b; Selbst and Powles 2017).”
BackgroundToo much, too little, or just right? Ways explanations impact end users' mental models
Kulesza, T., Stumpf, S., Burnett, M., Yang, S., Kwan, I., & Wong, W.-K. (2013) · 2013 IEEE Symposium on Visual Languages and Human Centric Computing · doi:10.1109/vlhcc.2013.6645235 · Cited by 388
Research works printed but not linked: 24
- Yessenalina Ainur , Yejin Choi , and Claire Cardie . 2010 . Automatically Generating Annotator Rationales to Improve Sentiment Classification . In Proceedings of the ACL 2010 Conference Short Papers. 336--341 . Yessenalina Ainur, Yejin Choi, and Claire Cardie. 2010. Automatically Generating Annotator Rationales to Improve Sentiment Classification. In Proceedings of the ACL 2010 Conference Short Papers. 336--341.
- Osbert Bastani , Carolyn Kim , and Hamsa Bastani . 2018. Interpreting Blackbox Models via Model Extraction. arXiv preprint arXiv:1705.08504 ( 2018 ). Osbert Bastani, Carolyn Kim, and Hamsa Bastani. 2018. Interpreting Blackbox Models via Model Extraction. arXiv preprint arXiv:1705.08504 (2018). · arXiv
- Or Biran and Courtenay Cotton . 2017 . Explanation and Justification in Machine Learning: A Survey. In IJCAI-17 Workshop on Explainable AI (XAI). Or Biran and Courtenay Cotton. 2017. Explanation and Justification in Machine Learning: A Survey. In IJCAI-17 Workshop on Explainable AI (XAI).
- Alex Campolo , Madelyn Sanfilippo Meredith Whittaker, and Kate Crawford . 2017 . 2017 Annual Report. Technical Report. AI NOW. Alex Campolo, Madelyn Sanfilippo Meredith Whittaker, and Kate Crawford. 2017. 2017 Annual Report. Technical Report. AI NOW.
- Sanjeeb Dash Oktay Gunluk and Dennis Wei. 2018. Boolean Decision Rules via Column Generation. In Advances in Neural Information Processing Systems. Sanjeeb Dash Oktay Gunluk and Dennis Wei. 2018. Boolean Decision Rules via Column Generation. In Advances in Neural Information Processing Systems.
- Amit Dhurandhar , Vijay Iyengar , Ronny Luss , and Karthikeyan Shanmugam . 2017 . A Formal Framework to Characterize Interpretability of Procedures . In Proc. ICML Workshop Human Interp. Mach. Learn . Sydney, Australia, 1--7. Amit Dhurandhar, Vijay Iyengar, Ronny Luss, and Karthikeyan Shanmugam. 2017. A Formal Framework to Characterize Interpretability of Procedures. In Proc. ICML Workshop Human Interp. Mach. Learn. Sydney, Australia, 1--7.
- 10.1109/ICCV.2011.6126394 · DOI
- Finale Doshi-Velez , Mason Kortz , Ryan Budish , Chris Bavitz , Sam Gershman , David O'Brien , Stuart Schieber , James Waldo , David Weinberger , and Alexandra Wood . 2017. Accountability of AI Under the Law: The Role of Explanation. CoRR , Vol. abs/ 1711 .01134 ( 2017 ). arxiv: 1711.01134 http://arxiv.org/abs/1711.01134 Finale Doshi-Velez, Mason Kortz, Ryan Budish, Chris Bavitz, Sam Gershman, David O'Brien, Stuart Schieber, James Waldo, David Weinberger, and Alexandra Wood. 2017. Accountability of AI Under the Law: The Role of Explanation. CoRR, Vol. abs/1711.01134 (2017). arxiv: 1711.01134 http://arxiv.org/abs/1711.01134 · arXiv
- Kun Duan Devi Parikh David Crandall and Kristen Grauman. 2012. Discovering Localized Attributes for Fine-grained Recognition. In CVPR. Kun Duan Devi Parikh David Crandall and Kristen Grauman. 2012. Discovering Localized Attributes for Fine-grained Recognition. In CVPR. · DOI · Paper page
- Ian Goodfellow , Yoshua Bengio , and Aaron Courville . 2016. Deep Learning . MIT Press . http://www.deeplearningbook.org. Ian Goodfellow, Yoshua Bengio, and Aaron Courville. 2016. Deep Learning .MIT Press. http://www.deeplearningbook.org.
- Bryce Goodman and Seth Flaxman . 2016 . EU Regulations on Algorithmic Decision-Making and a `Right to Explanation '. In Proc. ICML Workshop Human Interp. Mach. Learn . New York, NY, 26--30. Bryce Goodman and Seth Flaxman. 2016. EU Regulations on Algorithmic Decision-Making and a `Right to Explanation'. In Proc. ICML Workshop Human Interp. Mach. Learn. New York, NY, 26--30.
- Been Kim , Dmitry M. Malioutov , Kush R. Varshney , and Adrian Weller ( Eds .). 2017 . 2017 ICML Workshop on Human Interpretability in Machine Learning. https://arxiv.org/abs/1708 .02666v1 Been Kim, Dmitry M. Malioutov, Kush R. Varshney, and Adrian Weller (Eds.). 2017. 2017 ICML Workshop on Human Interpretability in Machine Learning. https://arxiv.org/abs/1708.02666v1 · arXiv
- Been Kim Kush R. Varshney and Adrian Weller (Eds.). 2018. 2018 Workshop on Human Interpretability in Machine Learning. https://sites.google.com/view/whi2018/home Been Kim Kush R. Varshney and Adrian Weller (Eds.). 2018. 2018 Workshop on Human Interpretability in Machine Learning. https://sites.google.com/view/whi2018/home
- Zachary C Lipton . 2016 . The mythos of model interpretability . In ICML Workshop on Human Interpretability of Machine Learning. Zachary C Lipton. 2016. The mythos of model interpretability. In ICML Workshop on Human Interpretability of Machine Learning.
- 10.1016/j.cogpsych.2006.09.006 · DOI · Paper page
- T. McDonnell , M. Lease , M. Kutlu , and T. Elsayed . 2016. Why Is That Relevant? Collecting Annotator Rationales for Relevance Judgments . In Proc. AAAI Conf. Human Comput. Crowdsourc. T. McDonnell, M. Lease, M. Kutlu, and T. Elsayed. 2016. Why Is That Relevant? Collecting Annotator Rationales for Relevance Judgments. In Proc. AAAI Conf. Human Comput. Crowdsourc.
- Tim Miller . 2017. Explanation in Artificial Intelligence: Insights from the Social Sciences. arXiv preprint arXiv:1706.07269 (June 2017 ). Tim Miller. 2017. Explanation in Artificial Intelligence: Insights from the Social Sciences. arXiv preprint arXiv:1706.07269 (June 2017). · arXiv
- P. Peng Y. Tian T. Xiang Y. Wang and T. Huang . 2016 . Joint Learning of Semantic and Latent Attributes. In ECCV 2016 Lecture Notes in Computer Science Vol. 9908 . P. Peng Y. Tian T. Xiang Y. Wang and T. Huang. 2016. Joint Learning of Semantic and Latent Attributes. In ECCV 2016 Lecture Notes in Computer Science Vol. 9908. · DOI
- 10.1145/2939672.2939778 · DOI · Paper page
- 10.1093/idpl/ipx022 · DOI · Paper page
- 10.1145/1102351.1102460 · DOI
- Kush R. Varshney . 2016 . Engineering Safety in Machine Learning. In Information Theory and Applications Workshop. Kush R. Varshney. 2016. Engineering Safety in Machine Learning. In Information Theory and Applications Workshop.
- Omar F. Zaidan and Jason Eisner . 2007 . Using 'annotator rationales' to improve machine learning for text categorization. In In NAACL-HLT. 260--267. Omar F. Zaidan and Jason Eisner. 2007. Using 'annotator rationales' to improve machine learning for text categorization. In In NAACL-HLT. 260--267.
- Omar F. Zaidan and Jason Eisner. 2008. Modeling Annotators: A Generative Approach to Learning from Annotator Rationales . In Proceedings of EMNLP 2008 . 31--40. Omar F. Zaidan and Jason Eisner. 2008. Modeling Annotators: A Generative Approach to Learning from Annotator Rationales. In Proceedings of EMNLP 2008. 31--40.
Cited by
Explainable AI: a review of machine learning interpretability methods
Linardatos, P., Papastefanopoulos, V., & Kotsiantis, S. (2020) · Entropy · doi:10.3390/e23010018 · Cited by 2,922
“Hind et al. [71] introduced TED, a framework for producing local explanations that satisfy the complexity mental model of a domain.”
Ali, S., Abuhmed, T., El-Sappagh, S., Muhammad, K., Alonso-Moral, J. M., Confalonieri, R., Guidotti, R., Del Ser, J., Díaz-Rodríguez, N., & Herrera, F. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101805 · Cited by 1,762
Explainable artificial intelligence: a comprehensive review
Minh, D., Wang, H. X., Li, Y. F., & Nguyen, T. N. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10088-y · Cited by 983
Markus, A. F., Kors, J. A., & Rijnbeek, P. R. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103655 · Cited by 811
Langer, M., Oster, D., Speith, T., Hermanns, H., Kästner, L., Schmidt, E., Sesing, A., & Baum, K. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103473 · Cited by 652
“Among others, users take into account recommendations of artificial systems to make decisions [24].”
Background
Metadata
- Authors
- Hind, M., Wei, D., Campbell, M., Codella, N. C. F., Dhurandhar, A., Mojsilović, A., Natesan Ramamurthy, K., & Varshney, K. R.
- Venue
- Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society
- Publisher
- ACM
- Published
- 2019-01-27
- Pages
- 123-129
- ISSN
- 3065-8365 (ISSN-L)
- OpenAlex
- W2960259221
- Cited by
- 92
- References
- 13
- FWCI
- 5.31
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: TED: Teaching AI to Explain its Decisions. https://app.cochat.ai/papers/10.1145/3306618.3314273
- The paper
- Hind, M., Wei, D., Campbell, M., Codella, N. C. F., Dhurandhar, A., Mojsilović, A., Natesan Ramamurthy, K., & Varshney, K. R. (2019). TED: Teaching AI to Explain its Decisions. Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society. https://doi.org/10.1145/3306618.3314273
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.