Explanations From Intelligent Systems: Theoretical Foundations and Implications for Practice1
The DOI matches its Crossref record; 120 of the 122 references it cites were found in a registry or an index.
Abstract
Information systems with an "intelligent" or "knowledge" component are now prevalent and include knowledge-based systems, decision support systems, intelligent agents, and knowledge management systems. These systems are in principle capable of explaining their reasoning or justifying their behavior. There appears to be a lack of understanding, however, of the benefits that can flow from explanation use, and how an explanation function should be constructed. Work with newer types of intelligent systems and help functions for everyday systems, such as word-processors, appears in many cases to neglect lessons learned in the past. This paper attempts to rectify this situation by drawing together the considerable body of work on the nature and use of explanations. Empirical studies, mainly with knowledge-based systems, are reviewed and linked to a sound theoretical base. The theoretical base combines a cognitive effort perspective, cognitive learning theory, and Toulmin's model of argumentation. Conclusions drawn from the review have both practical and theoretical significance. Explanations are important to users in a number of circumstances— when the user perceives an anomaly, when they want to learn, or when they need a specific piece of knowledge to participate properly in problem solving. Explanations, when suitably designed, have been shown to improve performance and learning and result in more positive user perceptions of a system. The design is important, however, because it appears that explanations will not be used if the user has to exert "too much" effort to get them. Explanations should be provided automatically if this can be done relatively unobtrusively, or by hypertext links, and should be context-specific rather than generic. Explanations that conform to Toulmin's model of argumentation, in that they provide adequate justification for the knowledge offered, should be more persuasive and lead to greater trust, agreement, satisfaction, and acceptance—of the explanation and possibly also of the system as a whole.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“While knowledge-based systems can provide clear explanations of the reasoning behind their outputs (Wick & Slagle, 1989; Gregor & Benbasat, 1999), models trained by machine learning algorithms may not (Lipton, 2015).”
From Algorithmic Accountability and Public Reason (2018) · cites this paper as Gregor & Benbasat, 1999
In the citing paper
“Receivers may require explanations about how the AI software came to a decision, especially when they must take action based on that decision (Gregor and Benbasat 1999; Watson et al. 2019).”
From How to Design AI for Social Good: Seven Essential Factors (2020) · cites this paper as Gregor and Benbasat 1999
In the citing paper
“Empirical studies (Gregor and Benbasat 1999) suggest that the suitability of an explanation differs among receivers according to their expertise.”
From How to Design AI for Social Good: Seven Essential Factors (2020) · cites this paper as Gregor and Benbasat 1999
Citations
Cites
Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483
User Acceptance of Computer Technology: A Comparison of Two Theoretical Models
Davis, F. D., Bagozzi, R. P., & Warshaw, P. R. (1989) · Management Science · doi:10.1287/mnsc.35.8.982 · Cited by 25,709
A BEHAVIORAL MODEL OF RATIONAL CHOICE
Simon, H. A. (1955) · The Quarterly Journal of Economics · doi:10.2307/1884852 · Cited by 15,877
Moore, G. C., & Benbasat, I. (1991) · Information Systems Research · doi:10.1287/isre.2.3.192 · Cited by 9,150
Self-citationHuman agency in social cognitive theory.
Bandura, A. (1989) · American Psychologist · doi:10.1037/0003-066x.44.9.1175 · Cited by 8,263
Toulmin, S. E. (2003) · doi:10.1017/cbo9780511840005 · Cited by 7,101
Axten, N., Newell, A., & Simon, H. A. (1973) · Contemporary Sociology · doi:10.2307/2063712 · Cited by 6,834
Anderson, J. R. (2013) · doi:10.4324/9781315799438 · Cited by 6,761
Newell, A. (1972) · Cited by 6,222
Rational choice and the structure of the environment.
Simon, H. A. (1956) · Psychological Review · doi:10.1037/h0042769 · Cited by 5,919
Research works printed but not linked: 26
- Anderson, 1985, Cognitive Psychology and Its Implications
- Ausubel, 1985, Learning as Constructing Meaning, 71
- Best, 1989, Cognitive Psychology
- Bruner, 1956, A Study of Thinking
- Brunswik, 1952, The Conceptual Foundation of Psychology
- Buchanan, 1984, Expert Systems
- Eining, 1991, The Impact of Expert System Usage on Experiential Learning in an Auditing Setting, Journal of Information Systems, 5, 1
- 1995, Expert Systems with Applications, 8
- Fitts, 1976, Human Performance
- Flowler, 1985, The Relationship Between Cognitive Style and Dialogue Style
- Gregor, S. D. Explanations from Knowledgebased Systems for Human Learning and Problem Solving, unpublished doctoral dissertation, University of Queensland, Brisbane, Australia, 1996a.
- Gregor, 1997, Explanations from Knowledgebased Systems and the Learning versus Working Argument
- Gregor, 1997, Knowledge-based Systems in Prescriptive versus Supportive Roles and the Use of Explanations
- Kidd, 1985, The Consultative Role of an Expert System, 228
- Koonce, 1992, Explanation and Counterexplanation During Audit Analytical Review, The Accounting Review, 67, 59
- Lerch, 1993, Measuring Trust in Machine Advice
- 1981, The Macquarie Dictionary
- Mao, 1996, The Effects of Hypertext-based Explanations in Knowledgebased Systems on Explanation Use and Knowledge Transfer
- Mao, 1996, Exploring the Use of Explanations in Knowledge-based Systems: A Process Tracing Analysis
- Murphy, 1990, Expert System Use and the Development of Expertise in Auditing: A Preliminary Investigation, Journal of Information Systems, 18
- Oltman, 1971, Group Embedded Figures Test
- Schank, 1986, Explanation: A First Pass, 139
- Schroder, 1967, Human Information Processing
- Seligman, 1990, Learned Optimism
- Wognum, P. M. Explanation of Automated Reasoning: How and Why?unpublished doctoral dissertation, University of Twente, Enschede, The Netherlands, 1990.
- Yourdon, 1989, Modern Structure Analysis
Cited by
Items 201–300 of 582
The Role of Power Distance and Explanation Facility in Online Bargaining Utilizing Software Agents
Lim, J. (2004) · Journal of Global Information Management · doi:10.4018/jgim.2004040102 · Cited by 24
“Use of explanations improves the performance achieved with a KBS as an aid (Gregor and Benbasat, 1999).”
BackgroundMethodInfluentialA Methodology for Developing Self-explaining Agents for Virtual Training
Harbers, M., den Bosch, K. V., & Meyer, J. C. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-13338-1_10 · Cited by 23
“Already at an early stage in expert systems research it was recognized that advices or diagnoses from decision support systems should be accompanied by explanations [17], [4].”
BackgroundKnowing (Not) to Know: Explainable Artificial Intelligence and Human Metacognition
von Zahn, M., Liebich, L., Jussupow, E., Hinz, O. F., & Bauer, K. (2025) · Information Systems Research · doi:10.1287/isre.2024.1431 · Cited by 38
Effects of decision space information on MAUT-based systems that support purchase decision processes
Scholz, M., Franz, M., & Hinz, O. F. (2017) · Decision Support Systems · doi:10.1016/j.dss.2017.03.004 · Cited by 26
Koskimies, E., Kuoppakangas, P., & Stenvall, J. (2025) · Information Systems Frontiers · doi:10.1007/s10796-025-10599-x · Cited by 26
A Scaling Perspective on AI Startups
Schulte‐Althoff, M., Fürstenau, D., & Lee, G. M. (2021) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2021.784 · Cited by 29
Bigras, É., Léger, P., & Sénécal, S. (2019) · Applied Sciences · doi:10.3390/app9204244 · Cited by 23
“Due to the cognitive effort needed by the assortment planners to access and understand the explanations of a transparent RA, the accuracy of their decisions could be diminished [9].”
BackgroundAbdel-Karim, B. M., Pfeuffer, N., Rohde, G. G. U., & Hinz, O. F. (2020) · Künstliche Intell. · doi:10.1007/s13218-020-00638-x · Cited by 25
Smedley, G., & Sutton, S. G. (2007) · Journal of Information Systems · doi:10.2308/jis.2007.21.1.27 · Cited by 21
The impact of internalization and familiarity on trust and adoption of recommendation agents
Komiak, S. (2009) · cIRcle (University of British Columbia) · doi:10.14288/1.0091325 · Cited by 29
“…research on intelligent agents (e.g., KBS/ES/RA) focuses on how to design an RA to technically do its job, such as filtering products (Maes, Guttman et al. 1999; Ansari, Essegaier et al. 2000) and how to allow a customer to understand the agent (Gregor and Benbasat 1999; Mao and Benbasat 2000).”
BackgroundInfluentialLeveraging the synergies between design science and behavioral science research methods
Sutton, S. G., Arnold, V., Collier, P. A., & Leech, S. A. (2021) · International Journal of Accounting Information Systems · doi:10.1016/j.accinf.2021.100536 · Cited by 20
Online government advisory service innovation through Intelligent Support Systems
Li, M. (2010) · Information & Management · doi:10.1016/j.im.2010.12.002 · Cited by 25
Kwon, O., Yoo, K., & Suh, E. (2006) · Electronic Commerce Research and Applications · doi:10.1016/j.elerap.2005.10.011 · Cited by 20
A review of research: an investigation of the impact of data quality on decision performance
Jung, W. (2004) · doi:10.5555/1071509.1071542 · Cited by 20
Javaid, M., & Estivill‐Castro, V. (2021) · Robotics · doi:10.3390/robotics10010051 · Cited by 22
“, neural networks, case-based reasoning systems, heuristic expert systems) [8] and knowledge-based systems [28].”
BackgroundExplanation in Human-Agent Teamwork
Harbers, M., Bradshaw, J. M., Johnson, M., Feltovich, P. J., den Bosch, K. V., & Meyer, J. C. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-35545-5_2 · Cited by 19
Human versus automated facilitation in the GSS context
Limayem, M. (2006) · ACM SIGMIS Database the DATABASE for Advances in Information Systems · doi:10.1145/1161345.1161363 · Cited by 19
Designing for Explanation in Health Care Applications of Expert Systems
Darlington, K. (2011) · SAGE Open · doi:10.1177/2158244011408618 · Cited by 19
“Furthermore, explanation facilities can lead to greater adherence to the recommendations of the expert system (Darlington, 2008; Gregor & Benbasat, 1999).”
BackgroundMethodInfluentialWulf, D., & Bertsch, V. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.04.041 · Cited by 20
“In this way, the user can efficiently explore a decision situation and gain a more detailed understanding, which leads to more accurate judgement and increases the effectiveness of decision-making (Hayes and Reddy, 1983; Gregor and Benbasat, 1999; Parikh et al., 2001; Tintarev and Masthoff, 2007).”
InfluentialKnowledge-Based Bundling of Smart Products on a Mobile Recomendation Agent
Kowatsch, T., Maaß, W., Filler, A., & Janzen, S. (2008) · International Conference on Mobile Business · doi:10.1109/icmb.2008.34 · Cited by 23
“Several studies showed that recommendation agents (RA) provide value-added services that help to reduce customer's information overload in shopping situations and reduce search complexity [25, 26], improve decision quality [27], and trust in decisions [28, 29].”
BackgroundThe Formulation of Design Theories for Information Systems
Gregor, S. D., & Jones, D. J. (2004) · Springer eBooks · doi:10.1007/978-1-4757-4852-9_4 · Cited by 31
“A specific example is taken from a review of explanations from knowledge-based systems ( Gregor and Benbasat, 1999 ), which is used as an illustration throughout the next section.”
BackgroundMethodInfluentialSelf-citationSchemmer, M., Kühl, N., & Satzger, G. (2022) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2022.185 · Cited by 21
Exploring Interaction with Remote Autonomous Systems using Conversational Agents
Robb, D. A., Lopes, J., Padilla, S., Laskov, A., Garcia, F. J. C., Liu, X., Willners, J. S., Valeyrie, N., Lohan, K. S., Lane, D. M., et al. (2019) · Designing Interactive Systems Conference · doi:10.1145/3322276.3322318 · Cited by 18
“Successful explanation generation depends on the user, their knowledge and the context, as users will only take the time to process the explanation if the benefits are perceived to be worth it [16].”
BackgroundCriação de conhecimento nas redes de cooperação interorganizacional
Balestrin, A., Vargas, L. M., & Fayard, P.-M. (2005) · Americanae (AECID Library) · Cited by 18
Xu, M., Ong, V., Duan, Y., & Mathews, B. (2010) · Information Processing & Management · doi:10.1016/j.ipm.2010.07.001 · Cited by 25
Kwon, O., Yoo, K., & Suh, E. (2005) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2005.645 · Cited by 18
“To meet this end, ESs should gather users’ contextual data so these users do not have to specify required information in advance (Gregor and Benbasat, 1999; Workman, 2004).”
BackgroundUser-centric evaluation of explainability of AI with and for humans: A comprehensive empirical study
Bobek, S., Korycińska, P., Krakowska, M., Mozolewski, M., Rak, D., Zych, M., Wójcik, M., & Nalepa, G. J. (2025) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2025.103625 · Cited by 27
Burstein, F. V., McKemmish, S. M., Fisher, J., Manaszewicz, R., & Malhotra, P. (2007) · Springer eBooks · doi:10.1007/1-84628-231-4_19 · Cited by 17
“Since the advent of advice-giving intelligent computer systems, explanation facilities have been one of their important and valued features ( Gregor and Benbasat 1999 ).”
BackgroundThe Impact of Sentiment Analysis Output on Decision Outcomes: An Empirical Evaluation
Lak, P., & Turetken, O. (2017) · AIS Transactions on Human-Computer Interaction · doi:10.17705/1thci.00086 · Cited by 19
“The results of studies in the domain of intelligent systems are consistent with this notion of “effort minimization” (Gregor & Benbasat, 1999).”
Beware of “Explanations” of AI
Martens, D., Shmueli, G., Evgeniou, T., Bauer, K., Janiesch, C., Feuerriegel, S., Gabel, S., Goethals, S., Greene, T., Klein, N., et al. (2026) · Business & Information Systems Engineering · doi:10.1007/s12599-026-01015-y · Cited by 16
“…allowing it to be corrected; (4) improving AI models and improving the machine learning that produces them (e.g., by adding guardrails to a model or by improving training data); (5) improving long-term learning (Gregor and Benbasat 1999) by all stakeholders (learning about the world, the…”
InfluentialSproule, S., Archer, N., & Michael G. DeGroote School of Business McMaster University (2000) · MacSphere (McMaster University) · doi:10.71548/708 · Cited by 18
Managing context in business process management systems
Ramesh, B., Jain, R., Nissen, M. E., & Xu, P. (2005) · Requirements Engineering · doi:10.1007/s00766-005-0005-6 · Cited by 16
“Gregor and Benbasat [27] argue that explanations on how past decisions were made can facilitate decision-making by providing task specific knowledge that users need to achieve greater trust, agreement, satisfaction, and acceptance of decisions.”
BackgroundDeceptive XAI: Typology, Creation and Detection
Schneider, J., Meske, C., & Vlachos, M. (2023) · SN Computer Science · doi:10.1007/s42979-023-02401-z · Cited by 16
“[19] provides the perceptions triggered by explanations.”
BackgroundInfluentialSomeh, I., Wixom, B. H., & Zutavern, A. (2020) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2020.712 · Cited by 18
“This can be achieved if AI experts design traceable algorithms and/or if domain experts can provide justification based on deep domain knowledge [27] or triangulation of methods [25]; otherwise, humans cannot guarantee that decisions are non-discriminatory or meaningful in real world contexts.”
BackgroundHastie, H., Garcia, F. J. C., Robb, D. A., Laskov, A., & Patrón, P. (2018) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3242969.3266297 · Cited by 15
“Namely, we produce why explanations to provide a trace or reasoning and why not to explain how it works, elaborating on the system’s control method or autonomy strategy [3].”
BackgroundLippert, M. (2013) · DiVA (Digitala Vetenskapliga Arkivet) · Cited by 33
A Multi-level Explainability Framework for Engineering and Understanding BDI Agents
Yan, E., Burattini, S., Hübner, J. F., & Ricci, A. (2025) · Adaptive Agents and Multi-Agents Systems · doi:10.1007/s10458-025-09689-6 · Cited by 16
“This is the underlying idea of our multi-level explainability framework , a framework that builds explanations of BDI agents at multiple levels of abstraction.”
From Usable to Incentive-Building Energy Management Systems
Alyafi, A. A., Nguyen, V. B., Laurillau, Y., Reignier, P., Ploix, S., Calvary, G., Coutaz, J., Pal, M., & Guilbaud, J. P. (2018) · Modélisation et utilisation du contexte · doi:10.21494/iste.op.2018.0302 · Cited by 14
“And beyond the decision-making aspect, the question of the generation of corresponding explanations was quickly raised and became an important field of study (see [25]–[27] for instance).”
BackgroundSmartEx: A Framework for Generating User-Centric Explanations in Smart Environments
Sadeghi, M., Herbold, L., Unterbusch, M., & Vogelsang, A. (2024) · IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom59722.2024.10494449 · Cited by 20
“Paes [35] discusses that explanations need to convey both a pragmatic and naturalistic account of understanding, and Gregor and Benbasat [36] reason that explanations for end-users must be context-based.”
BackgroundDesigning a Process Guidance System to Support User’s Business Process Compliance
Morana, S., Schacht, S., Scherp, A., & Maedche, A. (2014) · Stirling Online Research Repository (University of Stirling) · Cited by 14
Supporting societal decision making: a process perspective
Papamichail, K. N., & Robertson, I. (2003) · Journal of Multi-Criteria Decision Analysis · doi:10.1002/mcda.357 · Cited by 14
“Well-designed explanation tools can facilitate learning, improve performance and result in more positive user attitudes ( Gregor and Benbasat, 1999 ).”
BackgroundMaaß, W., & Kowatsch, T. (2008) · Alexandria (UniSG) (University of St.Gallen) · Cited by 18
Exploring the Explanatory Capabilities of Intelligent System Technologies
Gregor, S. D., & Yu, X. (2002) · Studies in fuzziness and soft computing · doi:10.1007/978-3-7908-1806-2_21 · Cited by 14
“…model of argumentation (Toulmin, 1958) (in that they provide adequate justification for the knowledge offered) should be more persuasive and lead to greater trust, agreement, satisfaction, and acceptance – of the explanation and possibly also of the system as a whole (Gregor and Benbasat, 1999).”
BackgroundMethodInfluentialSelf-citationA MODEL OF ORGANIZATIONAL COMPETENCIES FOR BUSINESS INTELLIGENCE SUCCESS
Chasalow, L. C. (2009) · VCU Scholars Compass (Virginia Commonwealth University) · doi:10.25772/hqmz-y627 · Cited by 14
Nguyen, C. T., Nguyen, T. T., Cai, L., Yuen, K. F., & Wang, X. (2025) · The International Journal of Logistics Management · doi:10.1108/ijlm-03-2023-0088 · Cited by 15
Vorm, E. S., & Miller, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-50439-7_31 · Cited by 13
Budde, L., Liao, S., Hänggi, R., & Friedli, T. K. (2022) · Production & Manufacturing Research · doi:10.1080/21693277.2022.2092564 · Cited by 18
“Therefore, we selected four different guidance mechanisms that are relevant for managerial decision support: the form (Arnold et al., 2004), the mode (Parikh et al., 2007), the intention (Arnold et al., 2004), and the format of decisionguidance (Gregor & Benbasat, 1999; Morana et al., 2017).”
MethodThe influence of directive explanations on users’ business process compliance performance
Hadasch, F., Maedche, A., & Gregor, S. D. (2016) · Business Process Management Journal · doi:10.1108/bpmj-05-2015-0067 · Cited by 14
“…d by U ni ve rs ity o f W ol lo ng on g A t 0 6: 17 0 3 M ay 2 01 6 (P T ) The Influence of Directive Explanations on Users’ Business Process Compliance Performance to explanations that are provided intelligently or that contain a multimedia component (Gönül et al., 2006; Gregor & Benbasat, 1999).”
BackgroundMethodSelf-citationIntelligent Systems Design for Malware Classification Under Adversarial ConditionsPreprint
Devine, S. M., & Bastian, N. D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.03149 · Cited by 13
“In defining the unique qualities of intelligent systems, Gregor and Benbasat (1999) layout the distinguishing factor of these systems as the presence of a “knowledge component” or a computer representation of “human tacit and explicit knowledge” [1].”
BackgroundExpl(Ai)Ned: The Impact of Explainable Artificial Intelligence on Cognitive ProcessesPreprint
Bauer, K., von Zahn, M., & Hinz, O. F. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3872711 · Cited by 18
Schemmer, M., Kühl, N., & Satzger, G. (2021) · Repository KITopen (Karlsruhe Institute of Technology) · doi:10.48550/arxiv.2109.13827 · Cited by 14
“Explainability is a concept with a long tradition in IS [24].”
BackgroundToward Semantic Event-Handling for Building Explainable Cyber-Physical Systems
Steindl, G., Schwarzinger, T., Schreiberhuber, K., & Ekaputra, F. J. (2024) · IEEE Open Journal of the Industrial Electronics Society · doi:10.1109/ojies.2024.3447001 · Cited by 12
“This means that the original system behaviour is not understandable, desirable, or expected by a user as defined by Gregor and Benbasat [7].”
BackgroundMore Than Accuracy: Towards Trustworthy Machine Learning Interfaces for Object Recognition
Heuer, H., & Breiter, A. (2020) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3340631.3394873 · Cited by 12
“ld be an alternative to explanations of the decisions of machine learning systems. This connects to Gregor et al., who argue that explanations are needed when unexpected behavior like anomalies occur [13]. Anomalies, by definition, are hard to anticipate or to understand. Trust is aimed at situations where a complete…”
BackgroundRebholz, T. R., Koop, A., & Hütter, M. (2024) · Technology Mind and Behavior · doi:10.1037/tmb0000136 · Cited by 15
The Antecedents of Customer Self-Disclosure to Online Virtual Advisors
Al‐Natour, S., Benbasat, I., & Cenfetelli, R. T. (2009) · AIS Electronic Library (AISeL) · Cited by 13
Self-citationEvaluating KMS Effectiveness for Decision Support: Preliminary Results
Handžić, M. (2009) · Annals of information systems · doi:10.1007/978-1-4419-0011-1_15 · Cited by 12
“Gregor and Benbasat (1999) found that suitably designed system explanations that conformed to Toulmin’s model of argumentation and provided to users in an unobtrusive way resulted in improved performance, learning and positive perceptions of a system.”
BackgroundWiebe, M., Geiskkovitch, D. Y., & Bunt, A. (2016) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/2856767.2856814 · Cited by 15
Automatically Generated Explanations for Markov Decision Processes
Khan, O. Z., Poupart, P., & Black, J. P. (2011) · IGI Global eBooks · doi:10.4018/978-1-60960-165-2.ch007 · Cited by 12
Nakatsu, R. T., & Benbasat, I. (2006) · International Journal of Human-Computer Interaction · doi:10.1080/10447310609526171 · Cited by 12
Self-citationA Framework for Organizing Justifications for Strategic Use in Adaptive Interaction Contexts
Yetim, F. (2008) · Journal of the Association for Information Systems · Cited by 12
Cabitza, F., Famiglini, L., Fregosi, C., Pe, S., Parimbelli, E., La Maida, G. A., & Gallazzi, E. (2025) · Proceedings of the 30th International Conference on Intelligent User Interfaces · doi:10.1145/3708359.3712157 · Cited by 11
“This behavior is exacerbated by well-documented cognitive tendencies, such as cognitive miserli-ness [47, 54] and the principle of least effort [23], where individuals prefer to minimize cognitive load by relying on automated systems.”
Fact or Fiction? Exploring Explanations to Identify Factual Confabulations in RAG-Based LLM Systems
Reinhard, P., Li, M. M., Fina, M., & Leimeister, J. M. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3720249 · Cited by 13
“Factual reasoning is demonstrated through explanations that clarify why a decision was made [17, 24].”
Ortbach, K., Gaß, O., Köffer, S., Schacht, S., Walter, N., Maedche, A., & Niehaves, B. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-06701-8_4 · Cited by 12
“The detection of the overall context is necessary to provide knowledge that is adapted to user needs [39].”
BackgroundAI models and the future of genomic research and medicine: True sons of knowledge?
König, H., Frank, D., Baumann, M., & Heil, R. (2021) · BioEssays · doi:10.1002/bies.202100025 · Cited by 11
Deep Learning on Big, Sparse, Behavioral Data
Cnudde, S. D., Ramon, Y., Martens, D., & Provost, F. J. (2019) · Big Data · doi:10.1089/big.2019.0095 · Cited by 14
Explanatory Power of Intelligent Systems
Nakatsu, R. T. (2007) · Springer eBooks · doi:10.1007/1-84628-231-4_7 · Cited by 12
“explanations are automatically provided as determined by the system (Gregor and Benbasat, 1999).”
Transparency in Advice-Giving Systems: A Framework and a Research Model for Transparency Provision.
Zhao, R., Benbasat, I., & Cavusoglu, H. (2019) · IUI Workshops · Cited by 15
Self-citationKnowledge management in mobile environment
Li, X., & Wang, T. W. (2007) · International Journal of Networking and Virtual Organisations · doi:10.1504/ijnvo.2007.015162 · Cited by 11
Greenyer, J., Lochau, M., & Vogel, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.11851 · Cited by 11
Collaborating with Technology-Based Autonomous Agents: Issues and Research OpportunitiesPreprint
Seeber, I., Waizenegger, L., Seidel, S., Morana, S., Benbasat, I., & Lowry, P. B. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3504587 · Cited by 11
Self-citationXiao, L., Stromer‐Galley, J., & Sándor, Á. (2016) · Group Decision and Negotiation · doi:10.1007/s10726-016-9516-4 · Cited by 10
“Explanations have been studied in knowledge-based systems (KBS) where researchers examine when, why, and how explanations are used (Mao and Benbasat 2000; Gregor and Benbasat 1999; Giboney et al. 2015), and the effects of explanation use (Ye and Johnson 1995; Bunt et al. 2012).”
BackgroundBreast cancer knowledge on line portal: an Intelligent decision support system perspective
Malhotra, P., Burstein, F. V., Fisher, J., McKemmish, S. M., Anderson, J. M., & Manaszewicz, R. (2016) · Figshare · doi:10.4225/03/57db5d8c99e4f · Cited by 10
“The reasons for including explanations in intelligent systems are that they have been clearly shown when suitably designed, to improve performance, learning and result in more positive user perceptions of a system (Gregor and Benbasat, 1999).”
BackgroundNakatsu, R. T., & Benbasat, I. (2003) · IEEE Transactions on Systems Man and Cybernetics - Part A Systems and Humans · doi:10.1109/tsmca.2003.817052 · Cited by 11
“For a review of these research studies, refer to [ 5 ].”
BackgroundSelf-citationThe need of diagrams based on Toulmin schema application: an aeronautical case study
Polacsek, T., Sharma, S., Cuiller, C., & Tuloup, V. (2018) · EURO Journal on Decision Processes · doi:10.1007/s40070-018-0086-3 · Cited by 10
“In addition to the type of the explanation, the meta-study performed by Gregor [19] showed that the design of the explanation is also an important factor.”
BackgroundAn Integrated Approach to Context-Sensitive Moral Cognition in Robot Cognitive Architectures
Jackson, R. B., Li, S., Banisetty, S. B., Siva, S., Zhang, H., Dantam, N. T., & Williams, T. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636434 · Cited by 20
“…significant body of research towards enabling transparent and explainable robot systems, including approaches for explaining plans [11], [12], [13], [14], [15], [16], [17], rationalizing actions [18], transparently representing intent [19], preemptive explanation [20], and intention projection [21].”
BackgroundExplanations and case-based reasoning in ambient intelligent systems
Cassens, J., & Kofod‐Petersen, A. (2007) · Cited by 10
A Unified Framework of Ethical Principles for AI
Floridi, L. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780198883098.003.0004 · Cited by 10
Jenkin, T. A., Kelley, S., Ovchinnikov, A. S., & Ying, C. (2024) · Decision Sciences · doi:10.1111/deci.12658 · Cited by 10
Reinhard, P., Li, M. M., Peters, C., & Leimeister, J. M. (2026) · Information Systems Frontiers · doi:10.1007/s10796-026-10716-4 · Cited by 13
“Concepts from the literature on knowledge-based systems (Gregor & Benbasat, 1999), such as trace or line of reasoning, justification, control, and terminology, have been explored to enhance human decision-making (Matt & Schlusche, 2022; Aslan et al., 2022).”
Towards a Criteria‐Based Approach to Selecting Human‐AI Interaction Mode
Irons, J. L., Cooper, P., McGrath, M. J., Tariq, S., & Duenser, A. (2025) · Human Factors and Ergonomics in Manufacturing & Service Industries · doi:10.1002/hfm.70022 · Cited by 11
Exploring the impact of transparency on the interaction with an in-car digital AI assistant
Neuhaus, R., Laschke, M., Theofanou-Fülbier, D., Hassenzahl, M., & Sadeghian, S. (2019) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3349263.3351325 · Cited by 12
“Providing explanations can improve performance and learning [7], transparency can have a mitigating effect in the event of trust violation [10], and increased transparency can lead to improved performance without adding workload or increasing response times [11].”
BackgroundBuilding an Integrated Comment Moderation System – Towards a Semi-automatic Moderation Tool
Riehle, D. M., Niemann, M., Brunk, J., Assenmacher, D., Trautmann, H., & Becker, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-49576-3_6 · Cited by 11
Validation of a biases model in strategic security decision making
Workman, M. (2012) · Information Management & Computer Security · doi:10.1108/09685221211235599 · Cited by 10
Case-Based Reasoning for Explaining Probabilistic Machine Learning
Olsson, T., Gillblad, D., Funk, P. J., & Xiong, N. (2014) · International Journal of Computer Science and Information Technology · doi:10.5121/ijcsit.2014.6206 · Cited by 9
The Role of Middle Managers in Knowledge Transfer
Carty, R., & Walsh, S. (2007) · Journal of Information & Knowledge Management · doi:10.1142/s021964920700186x · Cited by 9
Chiou, A., & Yu, X. (2007) · Annual Conference of the IEEE Industrial Electronics Society (IECON) · doi:10.1109/iecon.2007.4460407 · Cited by 9
“The theoretical base for explanation function in conventional expert systems and its construction is explained by [13].”
BackgroundTrust and TAM for Online Recommendation Agents
Wang, W., & Benbasat, I. (2004) · AIS Electronic Library (AISeL) · Cited by 12
Self-citationChiou, A., Yu, X., & Lowry, J. H. (2002) · Studies in fuzziness and soft computing · doi:10.1007/978-3-7908-1806-2_23 · Cited by 9
Bringing understanding in societal decision making: explaining and communicating analyses?
Niculae, C., & French, S. (2003) · Journal of Multi-Criteria Decision Analysis · doi:10.1002/mcda.356 · Cited by 9
Investigating Personal Intelligent Agents in Everyday Life through a Behavioral Lens
Moussawi, S. (2016) · CUNY Academic Works (City University of New York) · Cited by 14
Zierau, N., Engel, C., Söllner, M., & Leimeister, J. M. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3920577 · Cited by 9
Arnold, V., Clark, N., Collier, P. A., Leech, S. A., & Sutton, S. G. (2005) · Journal of Emerging Technologies in Accounting · doi:10.2308/jeta.2005.2.1.33 · Cited by 8
IoT End User Programming Models
Reiss, S. P. (2019) · doi:10.1109/serp4iot.2019.00008 · Cited by 8
“Explanations of the behavior of rule-based systems are common [4,13,14].”
BackgroundExplanation Approaches for the Daphne Virtual Assistant
Martin, A. V., & Selva, D. (2020) · AIAA SciTech Forum · doi:10.2514/6.2020-2254 · Cited by 8
Exploring the Website Features that can Support Online Collaborative Shopping
Goswami, S., Tan, C., & Teo, H. (2007) · Cited by 8
On the Role of Users’ Cognitive-Affective States for User Assistance Invocation
Friemel, C., Morana, S., Pfeiffer, J., & Maedche, A. (2017) · Lecture notes in information systems and organisation · doi:10.1007/978-3-319-67431-5_5 · Cited by 14
Balestrin, A., Alegre, P., & de, J. (2005) · Cited by 8
Explaining Probabilistic Fault Diagnosis and Classification Using Case-Based Reasoning
Olsson, T., Gillblad, D., Funk, P. J., & Xiong, N. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-11209-1_26 · Cited by 8
“Several papers from the last decades identify an intelligent system’s ability to explain its predictions as a key factor for user acceptance [1–5].”
BackgroundJin, W., Fan, J., Gromala, D., Pasquier, P., & Hamarneh, G. (2021) · arXiv (Cornell University) · Cited by 13
Füßl, A., & Nissen, V. (2025) · Requirements Engineering · doi:10.1007/s00766-025-00437-6 · Cited by 8
Metadata
- Authors
- Gregor, S., & Benbasat, I.
- Affiliations
- Central Queensland University (AU)
- University of British Columbia (CA)
- Venue
- MIS Quarterly
- Publisher
- MIS Quarterly
- Published
- 1999-12-01
- Volume
- 23
- Issue
- 4
- Pages
- 497-530
- ISSN
- 0276-7783 (ISSN-L)
- 2162-9730
- OpenAlex
- W1576620340
- Cited by
- 535
- References
- 122
- Citations by year
- 2026: 28 · 2025: 31 · 2024: 20 · 2023: 47 · 2022: 22 · 2021: 43 · 2020: 32 · 2019: 30 · 2018: 21 · 2017: 21 · 2016: 13 · 2015: 11 · 2014: 17 · 2013: 6 · 2012: 22
- FWCI
- 7.04
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- MIS Quarterly (publishedVersion)
- Journal of the Association for Information Systems (submittedVersion)
- Funders
- Natural Sciences and Engineering Research Council of Canada
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
- Keywords
- explanation generation, intelligent systems, expert systems, decision support system, intelligent agents, knowledge management systems, Toulmin model, cognitive effort, cognitive learning theory, explanation design, user trust, user satisfaction, system acceptance, word processing software
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.