Explanation Perspectives from the Cognitive Sciences---A Survey
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
With growing adoption of AI across fields such as healthcare, finance, and the justice system, explaining an AI decision has become more important than ever before. Development of human-centric explainable AI (XAI) systems necessitates an understanding of the requirements of the human-in-the-loop seeking the explanation. This includes the cognitive behavioral purpose that the explanation serves for its recipients, and the structure that the explanation uses to reach those ends. An understanding of the psychological foundations of explanations is thus vital for the development of effective human-centric XAI systems. Towards this end, we survey papers from the cognitive science literature that address the following broad questions: (1) what is an explanation, (2) what are explanations for, and 3) what are the characteristics of good and bad explanations. We organize the insights gained therein by means of highlighting the advantages and shortcomings of various explanation structures and theories, discuss their applicability across different domains, and analyze their utility to various types of humans-in-the-loop. We summarize the key takeaways for human-centric design of XAI systems, and recommend strategies to bridge the existing gap between XAI research and practical needs. We hope this work will spark the development of novel human-centric XAI systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Explanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
Studies in the Logic of Explanation
Hempel, C. G., & Oppenheim, P. (1948) · Philosophy of Science · doi:10.1086/286983 · Cited by 3,174 · cited 1×
“Where such Methods are Best Suited Deductive proof-like explanations are useful in applications where there are well defined laws governing the phenomena of interest [Hempel and Oppenheim, 1948].”
BackgroundThe “false consensus effect”: An egocentric bias in social perception and attribution processes
Ross, L., Greene, D., & House, P. (1977) · Journal of Experimental Social Psychology · doi:10.1016/0022-1031(77)90049-x · Cited by 3,139
Towards A Rigorous Science of Interpretable Machine Learning
Doshi-Velez, F., & Kim, B. (2017) · arXiv · doi:10.48550/arxiv.1702.08608 · Cited by 3,121
Understanding Black-box Predictions via Influence Functions
Koh, P. W., & Liang, P. (2017) · arXiv · doi:10.48550/arxiv.1703.04730 · Cited by 1,514 · cited 1×
“These include regulatory reforms [GDPR, 2017], government endeavours [Gunning, 2017], industry initiatives [PWC, 2018; Kyndi, 2018] and academic papers such as [Koh and Liang, 2017; Park et al. , 2018; Floyd and Aha, 2017; Vigano and Maga-zzeni, 2018].”
BackgroundStructure-mapping: A theoretical framework for analogy
GENTNER, D. (1983) · Cognitive Science · doi:10.1016/s0364-0213(83)80009-3 · Cited by 816 · cited 2×
“Typically, when explanations are being provided to people with reasonable knowledge within an area, close analogies are used; but when explanations are to be provided to a larger section of lay people, analogies between more distant domains may become more common [Gentner, 1983]”
BackgroundExplanation Methods in Deep Learning: Users, Values, Concerns and Challenges
Ras, G., van Gerven, M., & Haselager, P. (2018) · The Springer Series on Challenges in Machine Learning · doi:10.1007/978-3-319-98131-4_2 · Cited by 255
Narayanan, M., Chen, E., He, J., Kim, B., Gershman, S., & Doshi-Velez, F. (2018) · arXiv · doi:10.48550/arxiv.1802.00682 · Cited by 153
An Evaluation of the Human-Interpretability of Explanation
Lage, I., Chen, E., He, J., Narayanan, M., Kim, B., Gershman, S., & Doshi-Velez, F. (2019) · arXiv · doi:10.48550/arxiv.1902.00006 · Cited by 125 · cited 1×
“A survey of some such techniques may be found in [Lage et al. , 2019].”
Method
Cited by
Explainable Artificial Intelligence in education
Khosravi, H., Shum, S. B., Chen, G., Conati, C., Tsai, Y.-S., Kay, J., Knight, S., Martinez-Maldonado, R., Sadiq, S., & Gašević, D. (2022) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100074 · Cited by 863
Nauta, M., Trienes, J., Pathak, S., Nguyen, E., Peters, M., Schmitt, Y., Schlötterer, J., van Keulen, M., & Seifert, C. (2023) · ACM Computing Surveys · doi:10.1145/3583558 · Cited by 590
“Continuity also adds to generalizability beyond a particular input [163, 233] or generalizability to new contexts [234].”
BackgroundInfluentialExploring students' perspectives on generative AI-assisted academic writing
Kim, J., Yu, S., Detrick, R., & Li, N. (2025) · Education and Information Technologies · doi:10.1007/s10639-024-12878-7 · Cited by 438
“…as an end-product, but as a process that requires diverse cognitive and social interactions including troubleshooting, justification, communication, trust, and so on, and a knowledge transfer process from an explainer (AI system) to an explained (student) (Miller, 2019; Srinivasan & Chander, 2021).”
Help Me Help the AI": Understanding How Explainability Can Support Human-AI Interaction
Kim, S. S. Y., Watkins, E. A., Russakovsky, O., Fong, R., & Monroy-Hernández, A. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581001 · Cited by 233
A Review on Explainability in Multimodal Deep Neural Nets
Joshi, G., Walambe, R., & Kotecha, K. (2021) · IEEE Access · doi:10.1109/access.2021.3070212 · Cited by 204
“The system's explanation should be human interpretable and understandable, mapping the human mental model to build trust, transparency, reliability for success and failure, robust, fair, and unbiased applications underlying ethical machine learning principles [139], [140].”
Background
Metadata
- Authors
- Srinivasan, R., & Chander, A.
- Venue
- Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence
- Published
- 2020-07
- Pages
- 4812-4818
- OpenAlex
- W3042143383
- Cited by
- 32
- References
- 9
- FWCI
- 2.12
- Type
- conference paper
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Explanation Perspectives from the Cognitive Sciences---A Survey. https://app.cochat.ai/papers/10.24963/ijcai.2020/670
- The paper
- Srinivasan, R., & Chander, A. (2020). Explanation Perspectives from the Cognitive Sciences---A Survey. Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence. https://doi.org/10.24963/ijcai.2020/670
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.