CoChat

Explanations From Intelligent Systems: Theoretical Foundations and Implications for Practice1

Gregor, Shirley, Benbasat, Izak · 1999 · MIS Quarterly

The DOI matches its Crossref record; 120 of the 122 references it cites were found in a registry or an index.

Abstract

Information systems with an "intelligent" or "knowledge" component are now prevalent and include knowledge-based systems, decision support systems, intelligent agents, and knowledge management systems. These systems are in principle capable of explaining their reasoning or justifying their behavior. There appears to be a lack of understanding, however, of the benefits that can flow from explanation use, and how an explanation function should be constructed. Work with newer types of intelligent systems and help functions for everyday systems, such as word-processors, appears in many cases to neglect lessons learned in the past. This paper attempts to rectify this situation by drawing together the considerable body of work on the nature and use of explanations. Empirical studies, mainly with knowledge-based systems, are reviewed and linked to a sound theoretical base. The theoretical base combines a cognitive effort perspective, cognitive learning theory, and Toulmin's model of argumentation. Conclusions drawn from the review have both practical and theoretical significance. Explanations are important to users in a number of circumstances— when the user perceives an anomaly, when they want to learn, or when they need a specific piece of knowledge to participate properly in problem solving. Explanations, when suitably designed, have been shown to improve performance and learning and result in more positive user perceptions of a system. The design is important, however, because it appears that explanations will not be used if the user has to exert "too much" effort to get them. Explanations should be provided automatically if this can be done relatively unobtrusively, or by hypertext links, and should be context-specific rather than generic. Explanations that conform to Toulmin's model of argumentation, in that they provide adequate justification for the knowledge offered, should be more persuasive and lead to greater trust, agreement, satisfaction, and acceptance—of the explanation and possibly also of the system as a whole.

Overview

Integrity signals

Registry

Crossref · 10.2307/249487

Cites

120 of 120 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 120 references

Research works printed but not linked: 26

  1. Anderson, 1985, Cognitive Psychology and Its Implications
  2. Ausubel, 1985, Learning as Constructing Meaning, 71
  3. Best, 1989, Cognitive Psychology
  4. Bruner, 1956, A Study of Thinking
  5. Brunswik, 1952, The Conceptual Foundation of Psychology
  6. Buchanan, 1984, Expert Systems
  7. Eining, 1991, The Impact of Expert System Usage on Experiential Learning in an Auditing Setting, Journal of Information Systems, 5, 1
  8. 1995, Expert Systems with Applications, 8
  9. Fitts, 1976, Human Performance
  10. Flowler, 1985, The Relationship Between Cognitive Style and Dialogue Style
  11. Gregor, S. D. Explanations from Knowledgebased Systems for Human Learning and Problem Solving, unpublished doctoral dissertation, University of Queensland, Brisbane, Australia, 1996a.
  12. Gregor, 1997, Explanations from Knowledgebased Systems and the Learning versus Working Argument
  13. Gregor, 1997, Knowledge-based Systems in Prescriptive versus Supportive Roles and the Use of Explanations
  14. Kidd, 1985, The Consultative Role of an Expert System, 228
  15. Koonce, 1992, Explanation and Counterexplanation During Audit Analytical Review, The Accounting Review, 67, 59
  16. Lerch, 1993, Measuring Trust in Machine Advice
  17. 1981, The Macquarie Dictionary
  18. Mao, 1996, The Effects of Hypertext-based Explanations in Knowledgebased Systems on Explanation Use and Knowledge Transfer
  19. Mao, 1996, Exploring the Use of Explanations in Knowledge-based Systems: A Process Tracing Analysis
  20. Murphy, 1990, Expert System Use and the Development of Expertise in Auditing: A Preliminary Investigation, Journal of Information Systems, 18
  21. Oltman, 1971, Group Embedded Figures Test
  22. Schank, 1986, Explanation: A First Pass, 139
  23. Schroder, 1967, Human Information Processing
  24. Seligman, 1990, Learned Optimism
  25. Wognum, P. M. Explanation of Automated Reasoning: How and Why?unpublished doctoral dissertation, University of Twente, Enschede, The Netherlands, 1990.
  26. Yourdon, 1989, Modern Structure Analysis

Cited by

Items 301–400 of 582

Metadata

Authors
Gregor, S., & Benbasat, I.
Affiliations
  • Central Queensland University (AU)
  • University of British Columbia (CA)
Venue
MIS Quarterly
Publisher
MIS Quarterly
Published
1999-12-01
Volume
23
Issue
4
Pages
497-530
ISSN
  • 0276-7783 (ISSN-L)
  • 2162-9730
OpenAlex
W1576620340
Cited by
535
References
122
Citations by year
2026: 28 · 2025: 31 · 2024: 20 · 2023: 47 · 2022: 22 · 2021: 43 · 2020: 32 · 2019: 30 · 2018: 21 · 2017: 21 · 2016: 13 · 2015: 11 · 2014: 17 · 2013: 6 · 2012: 22
FWCI
7.04
Type
journal article
Language
en
Open access
closed
Locations
  • MIS Quarterly (publishedVersion)
  • Journal of the Association for Information Systems (submittedVersion)
Funders
Natural Sciences and Engineering Research Council of Canada
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
  • Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
Keywords
explanation generation, intelligent systems, expert systems, decision support system, intelligent agents, knowledge management systems, Toulmin model, cognitive effort, cognitive learning theory, explanation design, user trust, user satisfaction, system acceptance, word processing software

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.