Explanations From Intelligent Systems: Theoretical Foundations and Implications for Practice1
The DOI matches its Crossref record; 120 of the 122 references it cites were found in a registry or an index.
Abstract
Information systems with an "intelligent" or "knowledge" component are now prevalent and include knowledge-based systems, decision support systems, intelligent agents, and knowledge management systems. These systems are in principle capable of explaining their reasoning or justifying their behavior. There appears to be a lack of understanding, however, of the benefits that can flow from explanation use, and how an explanation function should be constructed. Work with newer types of intelligent systems and help functions for everyday systems, such as word-processors, appears in many cases to neglect lessons learned in the past. This paper attempts to rectify this situation by drawing together the considerable body of work on the nature and use of explanations. Empirical studies, mainly with knowledge-based systems, are reviewed and linked to a sound theoretical base. The theoretical base combines a cognitive effort perspective, cognitive learning theory, and Toulmin's model of argumentation. Conclusions drawn from the review have both practical and theoretical significance. Explanations are important to users in a number of circumstances— when the user perceives an anomaly, when they want to learn, or when they need a specific piece of knowledge to participate properly in problem solving. Explanations, when suitably designed, have been shown to improve performance and learning and result in more positive user perceptions of a system. The design is important, however, because it appears that explanations will not be used if the user has to exert "too much" effort to get them. Explanations should be provided automatically if this can be done relatively unobtrusively, or by hypertext links, and should be context-specific rather than generic. Explanations that conform to Toulmin's model of argumentation, in that they provide adequate justification for the knowledge offered, should be more persuasive and lead to greater trust, agreement, satisfaction, and acceptance—of the explanation and possibly also of the system as a whole.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“While knowledge-based systems can provide clear explanations of the reasoning behind their outputs (Wick & Slagle, 1989; Gregor & Benbasat, 1999), models trained by machine learning algorithms may not (Lipton, 2015).”
From Algorithmic Accountability and Public Reason (2018) · cites this paper as Gregor & Benbasat, 1999
In the citing paper
“Receivers may require explanations about how the AI software came to a decision, especially when they must take action based on that decision (Gregor and Benbasat 1999; Watson et al. 2019).”
From How to Design AI for Social Good: Seven Essential Factors (2020) · cites this paper as Gregor and Benbasat 1999
In the citing paper
“Empirical studies (Gregor and Benbasat 1999) suggest that the suitability of an explanation differs among receivers according to their expertise.”
From How to Design AI for Social Good: Seven Essential Factors (2020) · cites this paper as Gregor and Benbasat 1999
Citations
Cites
Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483
User Acceptance of Computer Technology: A Comparison of Two Theoretical Models
Davis, F. D., Bagozzi, R. P., & Warshaw, P. R. (1989) · Management Science · doi:10.1287/mnsc.35.8.982 · Cited by 25,709
A BEHAVIORAL MODEL OF RATIONAL CHOICE
Simon, H. A. (1955) · The Quarterly Journal of Economics · doi:10.2307/1884852 · Cited by 15,877
Moore, G. C., & Benbasat, I. (1991) · Information Systems Research · doi:10.1287/isre.2.3.192 · Cited by 9,150
Self-citationHuman agency in social cognitive theory.
Bandura, A. (1989) · American Psychologist · doi:10.1037/0003-066x.44.9.1175 · Cited by 8,263
Toulmin, S. E. (2003) · doi:10.1017/cbo9780511840005 · Cited by 7,101
Axten, N., Newell, A., & Simon, H. A. (1973) · Contemporary Sociology · doi:10.2307/2063712 · Cited by 6,834
Anderson, J. R. (2013) · doi:10.4324/9781315799438 · Cited by 6,761
Newell, A. (1972) · Cited by 6,222
Rational choice and the structure of the environment.
Simon, H. A. (1956) · Psychological Review · doi:10.1037/h0042769 · Cited by 5,919
Research works printed but not linked: 26
- Anderson, 1985, Cognitive Psychology and Its Implications
- Ausubel, 1985, Learning as Constructing Meaning, 71
- Best, 1989, Cognitive Psychology
- Bruner, 1956, A Study of Thinking
- Brunswik, 1952, The Conceptual Foundation of Psychology
- Buchanan, 1984, Expert Systems
- Eining, 1991, The Impact of Expert System Usage on Experiential Learning in an Auditing Setting, Journal of Information Systems, 5, 1
- 1995, Expert Systems with Applications, 8
- Fitts, 1976, Human Performance
- Flowler, 1985, The Relationship Between Cognitive Style and Dialogue Style
- Gregor, S. D. Explanations from Knowledgebased Systems for Human Learning and Problem Solving, unpublished doctoral dissertation, University of Queensland, Brisbane, Australia, 1996a.
- Gregor, 1997, Explanations from Knowledgebased Systems and the Learning versus Working Argument
- Gregor, 1997, Knowledge-based Systems in Prescriptive versus Supportive Roles and the Use of Explanations
- Kidd, 1985, The Consultative Role of an Expert System, 228
- Koonce, 1992, Explanation and Counterexplanation During Audit Analytical Review, The Accounting Review, 67, 59
- Lerch, 1993, Measuring Trust in Machine Advice
- 1981, The Macquarie Dictionary
- Mao, 1996, The Effects of Hypertext-based Explanations in Knowledgebased Systems on Explanation Use and Knowledge Transfer
- Mao, 1996, Exploring the Use of Explanations in Knowledge-based Systems: A Process Tracing Analysis
- Murphy, 1990, Expert System Use and the Development of Expertise in Auditing: A Preliminary Investigation, Journal of Information Systems, 18
- Oltman, 1971, Group Embedded Figures Test
- Schank, 1986, Explanation: A First Pass, 139
- Schroder, 1967, Human Information Processing
- Seligman, 1990, Learned Optimism
- Wognum, P. M. Explanation of Automated Reasoning: How and Why?unpublished doctoral dissertation, University of Twente, Enschede, The Netherlands, 1990.
- Yourdon, 1989, Modern Structure Analysis
Cited by
Items 101–200 of 582
Exploring accounting and AI using topic modelling
Murphy, B., Feeney, O., Rosati, P., & Lynn, T. (2024) · International Journal of Accounting Information Systems · doi:10.1016/j.accinf.2024.100709 · Cited by 88
The Effects of Process and Outcome Similarity on Users' Evaluations of Decision Aids*
Al‐Natour, S., Benbasat, I., & Cenfetelli, R. T. (2008) · Decision Sciences · doi:10.1111/j.1540-5915.2008.00189.x · Cited by 88
“…makers to explain their choices, such explanation facilities make the system’s inner workings more transparent to its users by providing them with information regarding why the system asked certain questions and how it processed information to reach its conclusions (Gregor & Benbasat, 1999).”
BackgroundSelf-citationPersonalized explanation in machine learning: A conceptualizationPreprint
Schneider, J., & Handali, J. P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.00770 · Cited by 87
“Gregor and Benbasat (1999) proposed the following explanation types: i) trace or line of reasoning , ii) justification or support , iii) control or strategic , and iv) terminological .”
BackgroundUser acceptance of knowledge-based system recommendations: Explanations, arguments, and fit
Giboney, J. S., Brown, S. A., Lowry, P. B., & Nunamaker, J. F. (2015) · Decision Support Systems · doi:10.1016/j.dss.2015.02.005 · Cited by 73
“This is often measured as the accuracy of the user [19].”
A development framework for decision support systems in high-performance sport
Schelling, X., & Robertson, S. J. (2020) · Int. J. Comput. Sci. Sport · doi:10.2478/ijcss-2020-0001 · Cited by 73
“…2014) based on the DSS’: target (M. Silver, 2006), directivity (M. Silver, 2006), mode (M. S. Silver, 1991), invocation (M. Silver, 2006), timing (M. Silver, 2006), format (Gregor & Benbasat, 1999), intention (Gönül, Önkal, & Lawrence, 2006), and audience (Gregor & Benbasat, 1999) (Table 2).”
Tell me a story! Narrative-driven XAI with Large Language Models
Martens, D., Hinns, J., Dams, C., Vergouwen, M., & Evgeniou, T. (2025) · Decision Support Systems · doi:10.1016/j.dss.2025.114402 · Cited by 91
Designs for explaining intelligent agents
Haynes, S. R., Cohen, M. A., & Ritter, F. E. (2008) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2008.09.008 · Cited by 81
“They can: (a) give justifications for a given design (Chandrasekaran and Swartout, 1991; Carenini and Moore, 1993; Gregor and Benbasat, 1999); (b) increase trust in system behavior and results (Ye and Johnson, 1995; Herlocker et al., 2000; McGuinness and da Silva, 2004); (c) aid comprehension and…”
BackgroundA Survey of Evaluation Methods and Measures for Interpretable Machine LearningPreprint
Mohseni, S., Zarei, N., & Ragan, E. D. (2018) · arXiv (Cornell University) · Cited by 80
Wang, P., & Ding, H. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2024.103732 · Cited by 68
Dissonance Between Human and Machine Understanding
Zhang, Z., Singh, J., Gadiraju, U., & Anand, A. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359158 · Cited by 50
“Prior works have focused on various attributes of explanations; cognitive fit [18], content type [19], data sources [43], and modality [40].”
BackgroundKaptein, F., Broekens, J., Hindriks, K., & Neerincx, M. (2017) · 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) · doi:10.1109/roman.2017.8172376 · Cited by 53
“Previous work on XAI took user knowledge into account [22, 23].”
BRKAN, M., & BONNET, G. (2020) · European Journal of Risk Regulation · doi:10.1017/err.2020.10 · Cited by 63
Adam, M., Diebel, C., Goutier, M., & Benlian, A. (2024) · Decision Support Systems · doi:10.1016/j.dss.2024.114193 · Cited by 62
Ridley, M. (2024) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24889 · Cited by 74
“…of the century, a cognitive science approach to explanation was recommended including recognition of cognitive effort, the role of learning theory, and the expectations that “ social, ethical, or organizational theories ” could contribute to better explanations (Gregor & Benbasat, 1999, p. 516).”
On the Relation of Trust and Explainability: Why to Engineer for Trustworthiness
Kastner, L., Langer, M., Lazar, V., Schomacker, A., Speith, T., & Sterz, S. (2021) · 2021 IEEE 29th International Requirements Engineering Conference Workshops (REW) · doi:10.1109/rew53955.2021.00031 · Cited by 61
Proceedings of the Tenth International Conference on Management Science and Engineering Management
Xu, J., Hajiyev, А. M., Nickel, S., & Gen, M. (2016) · Advances in intelligent systems and computing · doi:10.1007/978-981-10-1837-4 · Cited by 60
An extension of the theory of technology dominance: Capturing the underlying causal complexity
Sutton, S. G., Arnold, V., & Holt, M. (2023) · International Journal of Accounting Information Systems · doi:10.1016/j.accinf.2023.100626 · Cited by 46
EUCA: the End-User-Centered Explainable AI FrameworkPreprint
Jin, W., Fan, J., Gromala, D., Pasquier, P., & Hamarneh, G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.02437 · Cited by 63
“• Expected prediction: AI’s prediction aligns with users’ expectations [40].”
BackgroundInfluentialShare and Share Alike: The Social and Technological Influences on Knowledge Sharing Behavior
Hansen, S., & Avital, M. (2008) · Cited by 56
A review of the nature and effects of guidance design features
Morana, S., Schacht, S., Scherp, A., & Maedche, A. (2017) · Decision Support Systems · doi:10.1016/j.dss.2017.03.003 · Cited by 62
“After the analysis, we conducted a forward search with the initial set of articles [5,15,18] to discover work that we had not yet found in the databases.”
BackgroundMethodInfluentialExplainable software systems: from requirements analysis to system evaluation
Chazette, L., Brunotte, W., & Speith, T. (2022) · Requirements Engineering · doi:10.1007/s00766-022-00393-5 · Cited by 61
“The latter format, which is especially helpful for those trying to debug systems, was primarily employed in the 1980s when it came to expert system explanations [133].”
BackgroundA knowledge management perspective to evaluation of enterprise information portals
Kim, Y. J., Chaudhury, A., & Rao, H. R. (2002) · Knowledge and Process Management · doi:10.1002/kpm.137 · Cited by 63
He, X., Hong, Y., Zheng, X., & Zhang, Y. (2023) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2022.2095093 · Cited by 43
“…employs a problem-driven form that has been used by many AI works to explore the space of user needs for explanation (Chandrasekaran et al., 1989; Gregor & Benbasat, 1999; Lim & Dey, 2010; Swartout & Smoliar, 1987), which is more user-friendly and actionable for stake-holders of varying…”
BackgroundDeterminants of reliance: An empirical test of the theory of technology dominance
Hampton, C. (2005) · International Journal of Accounting Information Systems · doi:10.1016/j.accinf.2005.10.001 · Cited by 58
“Nonetheless, organizations generally still believe IDAs can enhance organizational and individual effectiveness (Gill, 1995; Gregor and Benbasat, 1999) and recent research indicates the accounting profession is still developing and using IDAs in such decision domains as insolvency prediction…”
BackgroundTan, W., Tan, C., & Teo, H. (2012) · Decision Support Systems · doi:10.1016/j.dss.2011.12.010 · Cited by 60
Literature Reviews in IS Research: What Can Be Learnt from the Past and Other Fields?
Schryen, G., Benlian, A., Rowe, F., Gregor, S. D., & Larsen, K. R. (2017) · Communications of the Association for Information Systems · doi:10.17705/1cais.04130 · Cited by 43
“As one example, we see research results that echo what researchers previously discovered for knowledge-based systems (e.g., Gregor & Benbasat, 1999) without any acknowledgement of this fact.”
Self-citationPapamichail, K. N. (2002) · Expert Systems with Applications · doi:10.1016/s0957-4174(02)00081-7 · Cited by 51
Fehrenbacher, D. D., & Djamasbi, S. (2017) · Decision Support Systems · doi:10.1016/j.dss.2017.02.007 · Cited by 58
Wang, W., & Wang, M. D. (2019) · Information Systems Research · doi:10.1287/isre.2018.0811 · Cited by 50
To trust or not to trust smart consumer products: a literature review of trust-building factors
Michler, O., Decker, R., & Stummer, C. (2019) · Management Review Quarterly · doi:10.1007/s11301-019-00171-8 · Cited by 65
Leichtmann, B., Hinterreiter, A., Humer, C., Streit, M., & Mara, M. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2221605 · Cited by 58
“…sciences about explanations (for an overview see Miller, 2019) and important prior work on human-centered XAI (e.g., Dhaliwal & Benbasat, 1996; Gregor & Benbasat, 1999), many empirical user studies on XAI have been conducted only recently (e.g., Buc¸inca et al., 2020; Cai et al., 2019; Kenny…”
On the influence of explainable AI on automation bias
Schemmer, M., Kühl, N., Benz, C., & Satzger, G. (2022) · arXiv · doi:10.48550/arxiv.2204.08859
“Explainability is a concept with a long tradition in Information Systems (IS) (Gregor and Benbasat 1999; Khasawneh and Kornreich 2014).”
BackgroundWhy should I trust you? Influence of explanation design on consumer behavior in AI-based services
Nizette, F., Hammedi, W., van Riel, A. C. R., & Steils, N. (2024) · Journal of service management · doi:10.1108/josm-05-2024-0223 · Cited by 55
Eisbach, S., Langer, M., & Hertel, G. (2023) · Computers in Human Behavior: Artificial Humans · doi:10.1016/j.chbah.2023.100015 · Cited by 46
Outcomes of effective explanations: Empowering citizens through online advice
Li, M., & Gregor, S. D. (2011) · Decision Support Systems · doi:10.1016/j.dss.2011.06.001 · Cited by 47
“When appropriately provided, explanations can improve user performance and learning outcomes and result in more positive perceptions of a system [28].”
BackgroundMethodInfluentialSelf-citationA Study of Automatic Metrics for the Evaluation of Natural Language Explanations
Clinciu, M., Eshghi, A., & Hastie, H. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.202 · Cited by 84
ROLEX: A Novel Method for Interpretable Machine Learning Using Robust Local Explanations
Kim, B., Srinivasan, K. K., Kong, S. H., Kim, J. H., Shin, C. S., & Ram, S. (2023) · MIS Quarterly · doi:10.25300/misq/2022/17141 · Cited by 56
Pacauskas, D., & Rajala, R. (2017) · Information Technology and People · doi:10.1108/itp-04-2015-0090 · Cited by 48
Towards a Theory of Explanations for Human–Robot Collaboration
Sridharan, M., & Meadows, B. (2019) · KI - Künstliche Intelligenz · doi:10.1007/s13218-019-00616-y · Cited by 39
The fitness of product information: Evidence from online recommendations
Tsao, W.-Y. (2012) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2012.04.003 · Cited by 47
Explanation provision and use in an intelligent decision aid
Arnold, V., Clark, N., Collier, P. A., Leech, S. A., & Sutton, S. G. (2004) · Intelligent systems in accounting, finance and management/Intelligent systems in accounting, finance & management · doi:10.1002/isaf.222 · Cited by 43
Personalising Explainable Recommendations: Literature and Conceptualisation
Naiseh, M., Jiang, N., Ma, J., & Ali, R. (2020) · Advances in Intelligent Systems and Computing · doi:10.1007/978-3-030-45691-7_49 · Cited by 42
“Goals such as curiosity, verify the output, learn from the system and improve future interaction require adaptive and per-sonalise explainable systems to meet these motivations [7, 21].”
BackgroundGetting the Message?: A Study of Explanation Interfaces for Microblog Data Analysis
Schaffer, J., Giridhar, P., Jones, D., Höllerer, T., Abdelzaher, T., & O'Donovan, J. (2015) · Proceedings of the 20th International Conference on Intelligent User Interfaces · doi:10.1145/2678025.2701406 · Cited by 39
“[12] provide an excellent summary of the theory of crafting explanations for intelligent systems.”
Explaining the News Feed Algorithm: An Analysis of the "News Feed FYI" Blog
Cotter, K., Cho, J., & Rader, E. (2017) · Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/3027063.3053114 · Cited by 34
“Providing an explanation—information about an intelligent system’s process and objectives—results in better user understanding [4, 9, 11] and more positive perceptions of a system [7, 10, 16], as well as enhanced user performance when using a system [7, 10, 12, 15, 16].”
BackgroundCapitalizing on Knowledge: A Novel Approach to Crucial-Knowledge Determination
Tseng, T.-L., & Huang, C. (2005) · IEEE Transactions on Systems Man and Cybernetics - Part A Systems and Humans · doi:10.1109/tsmca.2005.851294 · Cited by 43
Explanation in Information Systems
Hovorka, D. S., Germonprez, M., & Larsen, K. R. T. (2008) · Information Systems Journal · doi:10.1111/j.1365-2575.2007.00271.x · Cited by 54
Roles of knowledge management in online procurement systems
Hsieh, C., Yang, H., & Lin, B. (2002) · Industrial Management & Data Systems · doi:10.1108/02635570210439454 · Cited by 41
Explanations from knowledge-based systems and cooperative problem solving: an empirical study
Gregor, S. D. (2001) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.2000.0432 · Cited by 44
Self-citationPumplun, L., Peters, F., Gawlitza, J. F., & Buxmann, P. (2023) · Journal of the Association for Information Systems · doi:10.17705/1jais.00820 · Cited by 59
Templeton, G. F., & Byrd, T. A. (2003) · Information Technology and Management · doi:10.1023/a:1025186302598 · Cited by 50
Taking advice from intelligent systems: the double-edged sword of explanations
Ehrlich, K., Kirk, S. E., Patterson, J., Rasmussen, J. C., Ross, S. I., & Gruen, D. M. (2011) · Proceedings of the 16th international conference on Intelligent user interfaces · doi:10.1145/1943403.1943424 · Cited by 35
“It is well established that user interaction with intelligent systems can be facilitated by explaining system reasoning in a way that users find intelligible [4, 9, 13].”
Impact of Knowledge Support on the Performance of Software Process Tailoring
Xu, P., & Ramesh, B. (2008) · Journal of Management Information Systems · doi:10.2753/mis0742-1222250308 · Cited by 45
Tapping as a measure of cognitive load and website usability
Albers, M. J. (2011) · ACM International Conference on Design of Communication (SIGDOC) · doi:10.1145/2038476.2038481 · Cited by 40
Mapping Goals and Kinds of Explanations to the Knowledge Containers of Case-Based Reasoning Systems
Roth–Berghofer, T., & Cassens, J. (2005) · Lecture notes in computer science · doi:10.1007/11536406_35 · Cited by 39
“At the turn of the century, we find the issue discussed again in the context of knowledge-based systems [10,11].”
BackgroundPfeuffer, N., Baum, L., Stammer, W., Abdel-Karim, B. M., Schramowski, P., Bucher, A. M., Hügel, C., Rohde, G. G. U., Kersting, K., & Hinz, O. F. (2023) · Business & Information Systems Engineering · doi:10.1007/s12599-023-00806-x · Cited by 41
Determinants of Consumers' Perceived Trust in IT-Ecosystems
Wiedmann, K., Hennigs, N., Varelmann, D., & Reeh, M.-O. (2010) · Journal of theoretical and applied electronic commerce research · doi:10.4067/s0718-18762010000200009 · Cited by 47
“A distinguishing feature of intelligent or smart systems is that they contain a knowledge component comparable to a computerized version of human knowledge [43].”
BackgroundInfluentialExplaining agent behavior in virtual training
Harbers, M. (2011) · TNO Repository · Cited by 70
Schuetz, S. W., & Venkatesh, V. (2020) · SSRN Electronic Journal · Cited by 53
Responsible Artificial Intelligence and Journal Publishing
Gregor, S. D. (2024) · Journal of the Association for Information Systems · doi:10.17705/1jais.00863 · Cited by 48
Self-citationSustainable Investments in the Blue Economy: Leveraging Fintech and Adoption Theories
Sharma, V., Rupeika-Apoga, R., Singh, T. P., & Gupta, M. (2025) · Journal of risk and financial management · doi:10.3390/jrfm18070368 · Cited by 41
Glaser, F., Iliewa, Z., Jung, D., & Weber, M. (2018) · Lecture notes in information systems and organisation · doi:10.1007/978-3-030-01087-4_16 · Cited by 43
Effect of Transparency and Trust on Acceptance of Automatic Online Comment Moderation Systems
Brunk, J., Mattern, J., & Riehle, D. M. (2019) · IEEE Conference on Business Informatics · doi:10.1109/cbi.2019.00056 · Cited by 51
“Trust is regularly found to be a major factor in the acceptance of intelligent systems [14], [33]–[35].”
BackgroundMugurusi, G., & Nagitta, O. P. (2021) · IFIP advances in information and communication technology · doi:10.1007/978-3-030-85910-7_4 · Cited by 37
Mascha, M. F., & Smedley, G. (2007) · International Journal of Accounting Information Systems · doi:10.1016/j.accinf.2007.03.001 · Cited by 47
Explainable Autonomy: A Study of Explanation Styles for Building Clear Mental Models
Garcia, F. J. C., Robb, D. A., Liu, X., Laskov, A., Patrón, P., & Hastie, H. W. (2018) · International Conference on Natural Language Generation · doi:10.18653/v1/w18-6511 · Cited by 45
“As mentioned above, types of explanations investigated here include why (to provide a trace or reasoning) and why not (to elaborate on the system’s control method or autonomy strategy), a subset of those described in (Gregor and Benbasat, 1999).”
BackgroundInfluentialCause vs. effect in context-sensitive prediction of business process instances
Brunk, J., Stierle, M., Papke, L., Revoredo, K. C., Matzner, M., & Becker, J. (2020) · Information Systems · doi:10.1016/j.is.2020.101635 · Cited by 37
Explanation Goals in Case-Based Reasoning
Sørmo, F., & Cassens, J. (2004) · Cited by 33
So, Talk to Me: The Effect of Explicit Goals on the Comprehension of Business Process Narratives1
Kuechler, W., & Vaishnavi, V. (2006) · MIS Quarterly · doi:10.2307/25148761 · Cited by 41
“IS research on system generated explanations for expert system conclusions has proposed that different form and content for textual explanations significantly influences the understanding of and acceptance of system conclusions (Gregor and Benbasat 1999; Mao and Benbasat 2000).”
BackgroundThirty Years of IS Research: Core Artifacts and Academic Identity
Nevo, S., Nevo, D., & Ein-Dor, P. (2009) · Communications of the Association for Information Systems · doi:10.17705/1cais.02524 · Cited by 40
25 Years of MCDA in nuclear emergency management
Papamichail, K. N., & French, S. (2012) · IMA Journal of Management Mathematics · doi:10.1093/imaman/dps028 · Cited by 32
“Explanation facilities can improve the performance of both professionals and novices (Gregor and Benbasat, 1999; Mao and Benbasat, 2000).”
BackgroundKucklick, J.-P., & Müller, O. (2022) · ACM Transactions on Management Information Systems · doi:10.1145/3567430 · Cited by 34
“Already in 1999, Gregor and Benbasat [15] stated that comprehensibility is, beside predictive accuracy, an important feature of any intelligent system, as it increases the trust users put in the outputs of the system and, thereby, drives user acceptance of the system itself.”
BackgroundInterpretability and Transparency in Artificial Intelligence
Mittelstadt, B. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198857815.013.20 · Cited by 41
Wells, J. D., & Hess, T. J. (2002) · Information Resources Management Journal · doi:10.4018/irmj.2002100102 · Cited by 36
Exploring the role of experience and compatibility in using mobile technologies
Schwarz, A., Junglas, I. A., Krotov, V., & Chin, W. W. (2004) · Information Systems and e-Business Management · doi:10.1007/s10257-004-0046-2 · Cited by 37
“Karahanna et al. 1999 Two types of experience with IT are discussed: indirect and past experience.”
BackgroundThe effects of generative AI’s human-like competencies on clinical decision-making
Spatscheck, N., Schaschek, M., & Winkelmann, A. (2024) · Journal of Decision System · doi:10.1080/12460125.2024.2430731 · Cited by 36
The Development of AudEx: An Audit Data Assessment System
Lombardi, D. R., & Dull, R. B. (2016) · Journal of Emerging Technologies in Accounting · doi:10.2308/jeta-51445 · Cited by 30
Hindriks, K. V. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-32729-2_3 · Cited by 30
Saup, T.-O., Asghar, J., Kanbach, D. K., & Kraus, S. (2026) · Journal of Decision System · doi:10.1080/12460125.2025.2597835 · Cited by 36
Aspects of Intelligent Systems Explanation
Darlington, K. (2013) · Universal Journal of Control and Automation · doi:10.13189/ujca.2013.010204 · Cited by 29
“A great deal of empirical research followed that was encapsulated by the work of [14] who provided detailed research describing the factors affecting explanation usage linked to the theoretical foundations.”
BackgroundInfluentialThe effects of contextualized access to knowledge on judgement
Mao, J., & Benbasat, I. (2001) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.2001.0507 · Cited by 28
Self-citationDesigning Process Guidance Systems
Morana, S., Kroenung, J., Maedche, A., & Schacht, S. (2019) · Journal of the Association for Information Systems · doi:10.17705/1jais.00542 · Cited by 41
“In particular, novice users with a limited understanding of existing process specifications are expected to benefit from guidance (Dhaliwal & Benbasat, 1996; Gregor & Benbasat, 1999).”
BackgroundMethodInfluentialMoussawi, S. (2018) · ACM SIGCPR Conference on Computer Personnel Research (SIGCPR) · doi:10.1145/3209626.3209709 · Cited by 37
“A multitude of similar artifacts are eventually incorporated into IT applications, and hence become subject for behavioral style research [20, 7].”
BackgroundA social evaluation of the perceived goodness of explainability in machine learning
Wanner, J., Herm, L.-V., Heinrich, K., & Janiesch, C. (2021) · Journal of Business Analytics · doi:10.1080/2573234x.2021.1952913 · Cited by 27
“Our final selection of influencing factors on the perceived goodness of explainability is an intersection of the metrics used in several preliminaries (e.g., Gregor & Benbasat, 1999; Hoffman et al., 2018; Mueller et al., 2019).”
BackgroundMethodExplaining Autonomous Decisions in Swarms of Human-on-the-Loop Small Unmanned Aerial Systems
Agrawal, A., & Cleland‐Huang, J. (2021) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v9i1.18936 · Cited by 33
Mapping Design Contributions in Information Systems Research: The Design Research Activity Framework
Maedche, A., Gregor, S. D., & Parsons, J. (2021) · Communications of the Association for Information Systems · doi:10.17705/1cais.04914 · Cited by 35
Self-citationLi, M., Jiang, Z. J., Fan, Z., & Hou, J. (2017) · Information & Management · doi:10.1016/j.im.2017.01.002 · Cited by 30
“transparency of an ERMS, for example through reducing a user’s cognitive load in the system design via methods such as hierarchical decomposition or reasoning [136], is an effective way to boost the value of such a system.”
MethodKnowledge Support in Software Process Tailoring
Xu, P. (2005) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2005.380 · Cited by 27
“Studies [16, 33-36] show that in order to facilitate more accurate decision making, KBS needs to provide not only suggestions/recommendations but also explanations on how the suggestions are made and what knowledge is used.”
BackgroundInfluentialUncertainty handling in multi-attribute decision support for industrial risk management
Bertsch, V. (2008) · Repository KITopen (Karlsruhe Institute of Technology) · doi:10.5445/ksp/1000007378 · Cited by 27
“Explanation facilities contribute to positive user attitudes and improve user performance [Gregor and Benbasat, 1999].”
BackgroundDecision support and strategies for the electrification of commercial fleets
Schmidt, M., Staudt, P., & Weinhardt, C. (2021) · Transportation Research Part D Transport and Environment · doi:10.1016/j.trd.2021.102894 · Cited by 27
Dealing with Malnutrition : A Meal Planning System for Elderly
Åberg, J. (2006) · Cited by 26
Triki, A., & Weisner, M. (2014) · Journal of Emerging Technologies in Accounting · doi:10.2308/jeta-51078 · Cited by 26
Explain Yourself: A Natural Language Interface for Scrutable Autonomous RobotsPreprint
Garcia, F. J. C., Robb, D. A., Liu, X., Laskov, A., Patrón, P., & Hastie, H. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.02088 · Cited by 26
“Types of explanations include why to provide a trace or reasoning and why not to elaborate on the system’s control method or strategy [4].”
BackgroundAssessing Demand for Transparency in Intelligent Systems Using Machine Learning
Vorm, E. S. (2018) · 2018 Innovations in Intelligent Systems and Applications (INISTA) · doi:10.1109/inista.2018.8466328 · Cited by 25
“Research from other intelligent system domains such as context-aware systems [15], knowledge-based systems [16], and adaptive agents [17] are also approaches that”
BackgroundFadel, K. J., & Durcikova, A. (2014) · Information & Management · doi:10.1016/j.im.2014.03.008 · Cited by 25
“Finally, we incorporate gender, expertise, and knowledge sourcing from the KR as control variables in our model, as prior research indicates that perceptions of KR knowledge and willingness to contribute to it vary by one’s gender [72], expertise [70,38] and whether one uses the KR as a knowledge source [76].”
MethodMehdiyev, N., Houy, C., Gutermuth, O., Mayer, L., & Fettke, P. (2021) · Lecture notes in information systems and organisation · doi:10.1007/978-3-030-86790-4_28 · Cited by 35
Smedley, G., & Sutton, S. G. (2004) · Journal of Emerging Technologies in Accounting · doi:10.2308/jeta.2004.1.1.41 · Cited by 25
Can knowledge based systems be designed to counteract deskilling effects?
Arnold, V., Collier, P. A., Leech, S. A., Rose, J. M., & Sutton, S. G. (2023) · International Journal of Accounting Information Systems · doi:10.1016/j.accinf.2023.100638 · Cited by 26
Stout, N., Dennis, A. R., & Wells, T. (2014) · AIS Transactions on Human-Computer Interaction · doi:10.17705/1thci.00058 · Cited by 29
“Compared with traditional applications, the extended range of functionality, including adaptability, may lead to increases in efficiency and effectiveness for SAs (Gregor and Benbasat, 1999; Jennings, 1999; Maes, 1995; Nwana et al., 1996; Wang and Benbasat, 2007; Wooldridge, 1997).”
Cases for Explainable Software Systems: Characteristics and Examples
Sadeghi, M., Klös, V., & Vogelsang, A. (2021) · IEEE International Requirements Engineering Conference Workshops (REW) · doi:10.1109/rew53955.2021.00033 · Cited by 37
Metadata
- Authors
- Gregor, S., & Benbasat, I.
- Affiliations
- Central Queensland University (AU)
- University of British Columbia (CA)
- Venue
- MIS Quarterly
- Publisher
- MIS Quarterly
- Published
- 1999-12-01
- Volume
- 23
- Issue
- 4
- Pages
- 497-530
- ISSN
- 0276-7783 (ISSN-L)
- 2162-9730
- OpenAlex
- W1576620340
- Cited by
- 535
- References
- 122
- Citations by year
- 2026: 28 · 2025: 31 · 2024: 20 · 2023: 47 · 2022: 22 · 2021: 43 · 2020: 32 · 2019: 30 · 2018: 21 · 2017: 21 · 2016: 13 · 2015: 11 · 2014: 17 · 2013: 6 · 2012: 22
- FWCI
- 7.04
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- MIS Quarterly (publishedVersion)
- Journal of the Association for Information Systems (submittedVersion)
- Funders
- Natural Sciences and Engineering Research Council of Canada
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
- Keywords
- explanation generation, intelligent systems, expert systems, decision support system, intelligent agents, knowledge management systems, Toulmin model, cognitive effort, cognitive learning theory, explanation design, user trust, user satisfaction, system acceptance, word processing software
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.