The DOI matches its Crossref record; 134 of the 139 references it cites were found in a registry or an index.
Measures for explainable AI: Explanation goodness, user satisfaction, mental models, curiosity, trust, and human-AI performance
Open accessAbstract
If a user is presented an AI system that portends to explain how it works, how do we know whether the explanation works and the user has achieved a pragmatic understanding of the AI? This question entails some key concepts of measurement such as explanation goodness and trust. We present methods for enabling developers and researchers to: (1) Assess the a priori goodness of explanations, (2) Assess users' satisfaction with explanations, (3) Reveal user's mental model of an AI system, (4) Assess user's curiosity or need for explanations, (5) Assess whether the user's trust and reliance on the AI are appropriate, and finally, (6) Assess how the human-XAI work system performs. The methods we present derive from our integration of extensive research literatures and our own psychometric evaluations. We point to the previous research that led to the measurement scales which we aggregated and tailored specifically for the XAI context. Scales are presented in sufficient detail to enable their use by XAI researchers. For Mental Model assessment and Work System Performance, XAI researchers have choices. We point to a number of methods, expressed in terms of methods' strengths and weaknesses, and pertinent measurement issues.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Arrieta, A. B., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., García, S., Gil-López, S., Molina, D., Benjamins, R., et al. (2019) · arXiv · doi:10.48550/arxiv.1910.10045 · Cited by 11,321
Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 2×
“Trust in computers is typically understood in terms of the metaphor of “calibration” (Lee and See, 2004).”
BackgroundConflict, arousal, and curiosity.
Berlyne, D. E. (1960) · McGraw-Hill Book Company · doi:10.1037/11164-000 · Cited by 5,995 · cited 1×
“Epistemic curiosity is the general desire for knowledge, a motive to learn new ideas, resolve knowledge gaps, and solve problems, even though this may entail effortful cognitive activity (Berlyne, 1960, 1978; Loewenstein, 1994; Litman and Lunsford, 2010).”
BackgroundCognitive Reflection and Decision Making
Frederick, S. (2005) · Journal of Economic Perspectives · doi:10.1257/089533005775196732 · Cited by 5,256
Categorization and Representation of Physics Problems by Experts and Novices*
Chi, M. T. H., Feltovich, P. J., & Glaser, R. (1981) · Cognitive Science · doi:10.1207/s15516709cog0502_2 · Cited by 5,248 · cited 1×
“The review article by van der Veer and Melguzio (2003) highlights this method (see also Chi et al., 1981; Evans et al., 2001; St-Cyr and Burns, 2002; van der Veer and Melguzio, 2003).”
Novak, J. D., Gowin, D. B., & Kahle, J. B. (1984) · doi:10.1017/cbo9781139173469 · Cited by 5,199
Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness
Ford, M., & Johnson-Laird, P. N. (1985) · Language · doi:10.2307/414498 · Cited by 4,419 · cited 2×
“There is a consensus that mental models can be inferred from empirical evidence (Johnson-Laird, 1983; Zhang and Wickens, 1987; Glenberg and Langston, 1992; Qin and Simon, 1992; Bogacz and Trafton, 2004; Clement, 2004; Heiser and Tversky, 2006; Klein and Hoffman, 2008).”
BackgroundThe Efficient Assessment of Need for Cognition
Cacioppo, J. T., Petty, R. E., & Feng Kao, C. (1984) · Journal of Personality Assessment · doi:10.1207/s15327752jpa4803_13 · Cited by 2,913 · cited 1×
“, 2004), Cacioppo’s Need for Cognition scale (Cacioppo et al., 1984), and the I-Type/D-Type Curiosity Scales (Litman and Jimerson, 2004) consider curiosity to be a pervasive style or personality trait.”
BackgroundTrust in Automation: Integrating Empirical Evidence on Factors That Influence Trust
Hoff, K. A., & Bashir, M. (2015) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720814547570 · Cited by 2,817 · cited 2×
“satisfaction: understandability, feeling of satisfaction, sufficiency of detail, completeness, usefulness, accuracy, and trustworthiness (Muir and Moray, 1996).”
BackgroundMethod
Research works printed but not linked: 20
- Adams, 2003, Trust in automated systems
- Biran, 2017, “Explanation and Justification in Machine Learning: A Survey,”, IJCAI-17 Workshop on Explainable Artificial Intelligence (XAI)
- Cañas, 2003, A summary of literature pertaining to the use of concept mapping techniques and technologies for education and performance support
- Carroll, 1984, Minimalist training, Datamation, 1, 125
- Doyle, 2002, “Mental models of dynamic systems,”, System Dynamics and Integrated Modeling, Encyclopedia of Life Support Systems
- Ford, 1993, “Participatory explanation,”, Presented at the FLAIRS 93: Sixth Florida Artificial Intelligence Research Symposium (FLAIRS), 111
- Gentner, 1983, “Flowing waters or teem crowds: Mental models of electricity,”, Mental models, 99
- Gentner, 1983, Mental Models
- Goodstein, 1988, Tasks, errors and mental models.
- Harris, 1984, “Machine intelligence in real systems: Some ergonomic issues,”, Human-Computer Interaction, 267
- Hilton, 1996, Mental models and causal explanation: Judgements of probable cause and explanatory relevance, Thinking Reason., 2, 273, 10.1080/135467896394447 · DOI
- Hoffman, 1989, “Whom (or what) do you trust: Historical reflections on the psychology and sociology of information technology,”, Proceedings of the Fourth Annual Symposium on Human Interaction with Complex Systems, 28
- Hoffman, 2018, Literature Review and Integration of Key Ideas for Explainable AI
- Kucala, 2013, The truthiness of trustworthiness., 57
- MillerT. Explanation in artificial intelligence: insights from the social sciences. ArXiv:1706.07269 [Cs]2017 · arXiv
- Ritter, 1988, “Teaching real-time tactical thinking,”, Intelligent Tutoring Systems: Lessons Learned, 285
- Samurcay, 1996, Causal versus topographical support for diagnosis in a dynamic situation, Le Travail Humain, 59, 45
- Sarter, 1997, “Automation surprises,”, Handbook of Human Factors/Ergonomics, 1926
- Taylor, 1988, “Using cognitive models to make plants safer: Experimental and practical approaches,”, Tasks, errors and mental models, 233
- van der Veer, 2003, “Mental models,”, The human-computer interaction handbook, 52
Cited by
Human-centered evaluation of explainable AI applications: a systematic review
Kim, J., Maathuis, H., & Sent, D. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1456486 · Cited by 130
Hur, S., Lee, Y., Park, J., Jeon, Y. J., Cho, J. H., Cho, D., Lim, D., Hwang, W., Cha, W. C., & Yoo, J. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01958-8 · Cited by 118
Measuring trust in artificial intelligence: validation of an established scale and its short form
McGrath, M. J., Lack, O., Tisch, J., & Duenser, A. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1582880 · Cited by 135
Explainable AI framework for reliable and transparent automated energy management in buildings
Teixeira, B., Carvalhais, L., Pinto, T. D. O., & Vale, Z. (2025) · Energy and Buildings · doi:10.1016/j.enbuild.2025.116246 · Cited by 92
Ethical implications of AI in the Metaverse
Zhuk, A. (2024) · AI and Ethics · doi:10.1007/s43681-024-00450-5 · Cited by 78
“AI algorithms should be designed to provide clear and understandable explanations for their decisions and recommendations [41].”
Naveed, S., Stevens, G., & Robin-Kern, D. (2024) · Applied Sciences · doi:10.3390/app142311288 · Cited by 86
A survey of explainable knowledge tracing
Bai, Y., Zhao, J., Wei, T., Cai, Q., & He, L. (2024) · Applied Intelligence · doi:10.1007/s10489-024-05509-8 · Cited by 75
Use of Digital Technology in Improving Quality Education
Sharma, R. B., & Singh, A. (2023) · Advances in logistics, operations, and management science book series · doi:10.4018/979-8-3693-2065-5.ch002 · Cited by 40
Perrig, S. A. C., Scharowski, N., & Brühlmann, F. (2023) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3544549.3585808 · Cited by 67
“983 TXAI [13]: one factor, item 6 removed 32.”
BackgroundInfluentialHow well can a large language model explain business processes as perceived by users?
Fahland, D., Fournier, F., Limonad, L., Skarbovsky, I., & Swevels, A. (2025) · Data & Knowledge Engineering · doi:10.1016/j.datak.2025.102416 · Cited by 61
Tell me a story! Narrative-driven XAI with Large Language Models
Martens, D., Hinns, J., Dams, C., Vergouwen, M., & Evgeniou, T. (2025) · Decision Support Systems · doi:10.1016/j.dss.2025.114402 · Cited by 91
Hao, X., Demir, E., & Eyers, D. (2025) · Sustainable Futures · doi:10.1016/j.sftr.2025.101152 · Cited by 33
“However, participants reported that these outputs often lacked semantic specificity or causal rationale unless contextualized through human reasoning [71].”
Explainable AI: roles and stakeholders, desirements and challenges
Hoffman, R. R., Mueller, S. T., Klein, G. A., Jalaeian, M., & Tate, C. (2023) · Frontiers in Computer Science · doi:10.3389/fcomp.2023.1117848 · Cited by 55
Self-citationUnveiling the Impact of AI Technological Anxiety on the Marketers' Intention to Adopt Generative AI
Meng, T., Li, X., Alam, F., Yan, Y., & Chau, T. (2025) · Journal of Global Information Management · doi:10.4018/jgim.372177 · Cited by 34
“We integrated and adapted existing scales based on the research context and used a three-item scale to measure it (Hoffman et al., 2023; Jian et al., 2000).”
The need for more informative defect prediction: A systematic literature review
Grattan, N., da Costa, D. A., & Stanger, N. (2024) · Information and Software Technology · doi:10.1016/j.infsof.2024.107456 · Cited by 39
Increasing the Value of XAI for Users: A Psychological Perspective
Hoffman, R. R., Miller, T., Klein, G. A., Mueller, S. T., & Clancey, W. J. (2023) · Künstliche Intell. · doi:10.1007/s13218-023-00806-9 · Cited by 35
Self-citationAm I Still Creative? The Effect of Artificial Intelligence on Creative Self‐Beliefs
Faiella, A., Zielińska, A., Karwowski, M., & Corazza, G. E. (2025) · The Journal of Creative Behavior · doi:10.1002/jocb.70011 · Cited by 32
Bergomi, L., Nicora, G., Orlowska, M. A., Podrecca, C., Bellazzi, R., Fregosi, C., Salinaro, F., Bonzano, M., Crescenzi, G., Speciale, F., et al. (2025) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-025-03045-0 · Cited by 30
“In particular, we focus on understandability and actionability as two relevant dimensions to evaluate the goodness of explanations, adapted from [22].”
Explainable AI for all - A roadmap for inclusive XAI for people with cognitive disabilities
Tielman, M. L., Suárez-Figueroa, M. C., Jönsson, A., Neerincx, M. A., & Siebert, L. C. (2024) · Technology in Society · doi:10.1016/j.techsoc.2024.102685 · Cited by 26
Yu, R., Xu, X., & Peng, S. (2025) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2025.103745 · Cited by 22
Kang, S., Potinteu, A. E., & Said, N. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3720222 · Cited by 31
“Participants’ trust in AI was assessed with 8 items from the Trust Scale for Explainable AI (TXAI) [13].”
Reza, M., Anastasopoulos, I., Bhandari, S., & Pardos, Z. A. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714051 · Cited by 42
To Trust or Distrust AI: A Questionnaire Validation Study
Scharowski, N., Perrig, S. A. C., von Felten, N., Aeschbach, L. F., Opwis, K., Wintersberger, P., & Brühlmann, F. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732025 · Cited by 36
“Trust in AI is measured in various ways [31, 95] by both objective and subjective means [66].”
Designing and Evaluating User Experience of an AI-Based Defense System
Park, S., Kim, H. K., Park, J., & Lee, Y. (2023) · IEEE Access · doi:10.1109/access.2023.3329257 · Cited by 25
“Hoffman et al. [66] have synthesized key concepts for measuring the quality and reliability of AI explanations.”
Backgroundالدور الوسيط للذكاء الاصطناعي القابل للتفسير في العلاقة بين حوكمة البيانات والأداء المؤسسي
الجداوي, م. ن. (2024) · المجلة العربية للعلوم الإدارية. · doi:10.34120/ajas.v30i1.213 · Cited by 22
Xu, Z., Song, T., & Lee, Y.-C. (2025) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2025.103455 · Cited by 18
Fresz, B., Dubovitskaya, E., Brajovic, D., Huber, M. F., & Horz, C. (2024) · Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1609/aies.v7i1.31648 · Cited by 17
“Compactness denotes the overall size of an explanation, as too large explanations often overwhelm users, whereas too small explanations provide less information about a decision or the model behavior (Hoffman et al. 2023).”
Enhancing Brain Disease Diagnosis with XAI: A Review of Recent Studies
Bibi, N., Courtney, J., & McGuinness, K. (2025) · ACM Transactions on Computing for Healthcare · doi:10.1145/3709152 · Cited by 31
“In the diagnosis of brain diseases, the specific measures presented by Hoffman et al. [39] can be used for evaluation purposes.”
Jung, J., Kang, S., Choi, J., El-Kareh, R. E., Lee, H., & Kim, H. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.105943 · Cited by 23
What Guides Our Choices? Modeling Developers' Trust and Behavioral Intentions Towards Genai
Choudhuri, R., Trinkenreich, B., Pandita, R., Kalliamvakou, E., Steinmacher, I., Gerosa, M., Sanchez, C., & Sarma, A. (2025) · 2025 IEEE/ACM 47th International Conference on Software Engineering (ICSE) · doi:10.1109/icse55347.2025.00087 · Cited by 17
“In this paper, we measure developers’ trust in genAI tools using the validated Trust in eXplainable AI (TXAI) instrument [39, 69].”
Building Trust in Artificial Intelligence: A Systematic Review through the Lens of Trust Theory
Regona, M., Yiğitcanlar, T., Hon, C. K. H., & Teo, M. M. (2026) · ACM Computing Surveys · doi:10.1145/3789256 · Cited by 32
Explainable Deep Learning: A Visual Analytics Approach with Transition Matrices
Radiuk, P., Barmak, O., Manziuk, E., & Krak, I. V. (2024) · Mathematics · doi:10.3390/math12071024 · Cited by 26
Explainable Machine Learning in Risk Management: Balancing Accuracy and Interpretability
Wang, M., Zhang, X., Yang, Y., & Wang, J. (2025) · Journal of Financial Risk Management · doi:10.4236/jfrm.2025.143011 · Cited by 22
Calibrating workers’ trust in intelligent automated systems
Lucas, G., Becerik-Gerber, B., & Roll, S. C. (2024) · Patterns · doi:10.1016/j.patter.2024.101045 · Cited by 35
Do You Trust Me? Measuring People’s Perception of Being Trusted by AI in a Human–Agent Team
Xie, Y., Zhou, R., Chan, A. H. S., & Xiong, D. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2468783 · Cited by 18
“Jian et al. (2000) developed the automation trust scale (AT scale) for measuring trust between people and automation, which has been highly cited in many studies (Hoff & Bashir, 2015; Hoffman et al., 2023; Xie et al., 2023).”
Akinwale, O. E., Kuye, O. L., & Doddanavar, I. (2024) · Journal of Systems and Information Technology · doi:10.1108/jsit-08-2024-0297 · Cited by 29
Huang, J., Gu, R., Feng, Y., & Luo, W. (2025) · Psychology and Marketing · doi:10.1002/mar.22186 · Cited by 20
Evaluating machine-generated explanations: a “Scorecard” method for XAI measurement science
Hoffman, R. R., Jalaeian, M., Tate, C., Klein, G. A., & Mueller, S. T. (2023) · Frontiers in Computer Science · doi:10.3389/fcomp.2023.1114806 · Cited by 22
“This model was created in order to inform system developers of the kinds of things that need to be measured at steps 2, 3, and 4: explanation goodness, user satisfaction, user mental model, performance, and reliance (Hoffman et al., 2023).”
BackgroundMethodSelf-citationValdez, A. S. C., Heine, M., Franke, T., Jochems, N., Jetter, H.-C., & Schrills, T. (2024) · i-com · doi:10.1515/icom-2024-0014 · Cited by 21
SIFT: Sifting file types—application of explainable artificial intelligence in cyber forensics
Alam, S., & Demir, A. K. (2024) · Cybersecurity · doi:10.1186/s42400-024-00241-9 · Cited by 16
dos Reis, M. Í., Gonçalves, J. N. C., Cortez, P. C., Carvalho, M. S., & Fernandes, J. M. (2024) · Computers in Industry · doi:10.1016/j.compind.2024.104233 · Cited by 23
Pareek, S., Schömbs, S., Velloso, E., & Gonçalves, J. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713468 · Cited by 27
“To measure this, we employed the TXAI scale [25], which has been validated specifically for use in Human-AI contexts by Perrig et al. [54].”
Towards Balancing Preference and Performance through Adaptive Personalized Explainability
Silva, A., Tambwekar, P., Schrum, M., & Gombolay, M. (2024) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3610977.3635000 · Cited by 24
Weber, R. O., Johs, A. J., Goel, P., & Marques-Silva, J. P. (2024) · AI Magazine · doi:10.1002/aaai.12184 · Cited by 45
What Needs Attention? Prioritizing Drivers of Developers' Trust and Adoption of Generative AI
Choudhuri, R., Trinkenreich, B., Pandita, R., Kalliamvakou, E., Steinmacher, I., Gerosa, M., Sanchez, C., & Sarma, A. (2025) · arXiv · doi:10.48550/arxiv.2505.17418 · Cited by 14
“In this paper, we measure developers’ trust in genAI using the validated Trust in eXplainable AI (TXAI) instrument [55, 91].”
Chen, C.-J., & Cheng, J. (2026) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2025.104699 · Cited by 15
To Solicit or Not to Solicit? Impact of AI Assistance Delivery Mechanisms on Decision-Making
Nair, P., Gressel, G., Anand, M. N., & Achuthan, K. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2536617 · Cited by 15
“This limitation is acknowledged by Hoffman et al. who noted that short-term studies often miss the long-term effects of explainable AI on user satisfaction and trust (Hoffman et al., 2023).”
Li, Y., Shan, Z., Raković, M., Guan, Q., Gašević, D., & Chen, G. (2025) · Education and Information Technologies · doi:10.1007/s10639-025-13741-z · Cited by 16
“Specifically, inspired by previous research (Schlippe et al., 2022; Hoffman et al., 2023; Xiao et al., 2024), we gathered their Fig.”
Adjusting Amount of AI Explanation for Visual Tasks
Maehigashi, A., Fukuchi, Y., & Yamada, S. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3650802 · Cited by 13
“Onthebasisoftheevaluationresults,themeaninterpretability scoreofeachheatmapwascalculated.”
The Influence of Interdependence on Trust Calibration in Human-Machine Teams
Verhagen, R., Marcu, A., Neerincx, M. A., & Tielman, M. L. (2024) · Frontiers in artificial intelligence and applications · doi:10.3233/faia240203 · Cited by 14
Lim, B. Y., Cahaly, J. P., Sng, C. Y. F., & Chew, A. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714058 · Cited by 25
“Nevertheless, future work can combine diagrams and knowledge-guided rationalization for multimodal explanations.”
Breckner, K., Neumayr, T., Mara, M., Streit, M., & Augstein, M. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2482742 · Cited by 16
Explanatory Capabilities of Large Language Models in Prescriptive Process Monitoring
Kubrak, K., Botchorishvili, L., Milani, F., Nolte, A., & Dumas, M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-70396-6_23 · Cited by 11
“In [28], the authors develop visualizations to display an expected KPI when following or ignoring a recommendation.”
Alt, B., Zahn, J., Kienle, C., Dvorak, J., May, M. C., Katić, D., Jäkel, R., Kopp, T., Beetz, M., & Lanza, G. (2024) · Procedia CIRP · doi:10.1016/j.procir.2024.10.134 · Cited by 9
Development and validation of the trust in AI scale (TAIS)
Wischnewski, M., Doebler, P., & Krämer, N. C. (2026) · Journal of Psychology and AI · doi:10.1080/29974100.2026.2715475 · Cited by 19
Cognitive Impacts of Explainable AI in Cybersecurity Incident Response: Challenges and Propositions
Zhong, C., & Yayla, A. (2025) · Information Systems Frontiers · doi:10.1007/s10796-025-10609-y · Cited by 14
“While the extant body of XAI literature emphasizes the importance of explainability in terms of trust (Hoffman et al., 2023; Hsiao et al., 2021), transparency (Adadi & Ber-rada, 2018; Biswas et al., 2024), human-AI performance (Bauer et al., 2023; Holder & Wang, 2021), and regulations (Merhi, 2023;…”
Towards a Unified Multidimensional Explainability Metric: Evaluating Trustworthiness in AI Models
Makridis, G., Fatouros, G., Kiourtis, A., Kotios, D., Koukos, V., Kyriazis, D., & Soldatos, J. (2023) · International Conference on Distributed Computing in Smart Systems and the Internet of Things (DCOSS-IoT) · doi:10.1109/dcoss-iot58021.2023.00084 · Cited by 15
“For instance, [21] introduces metrics that are more user-centered.”
BackgroundLee, J.-C., Gao, Z., & Xiong, L. (2024) · Information Development · doi:10.1177/02666669241269666 · Cited by 15
“This intelligent interaction process can stimulate users ’ curiosity (Hoffman et al., 2023).”
Co-designing Explainable Robots: A Participatory Design Approach for HRI
Gebellí, F., Ros, R., Lemaignan, S., & Garrell, A. (2024) · IEEE RO-MAN · doi:10.1109/ro-man60168.2024.10731212 · Cited by 9
“It can be based on available XAI metrics for user satisfaction, mental models, curiosity or trust [10], and should be adapted to each particular use case objective.”
BackgroundA Comprehensive User-Centric Method for Evaluating and Comparing XAI Explanations
Brdnik, S., Karakatič, S., & Šumak, B. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2470278 · Cited by 10
“They include understanding the AI’s (or agent’s) actions, tasks, goals and the current situation (Hoffman et al., 2023).”
de Jong, S., Bos, M. W., van Berkel, N., & Lamers, M. H. (2025) · Behaviour and Information Technology · doi:10.1080/0144929x.2025.2535732 · Cited by 20
iSee: A case-based reasoning platform for the design of explanation experiences
Caro-Martínez, M., Recio-García, J. A., Díaz-Agudo, B., Darias, J. M., Wiratunga, N., Martin, K., Wijekoon, A., Nkisi-Orji, I., Corsar, D., Pradeep, P., et al. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112305 · Cited by 16
“Interactions here are a proxy for a user’s explanation experience, context, needs, and satisfaction, providing us with insights into their mental models [32].”
BackgroundMethodTalaei-Khoei, J., Yang, A., Takishova, T., & Masialeti, M. (2024) · Journal of Global Information Management · doi:10.4018/jgim.354062 · Cited by 12
Exploring the Impact of Explainability in Large Language Model (LLM) Applications on User Experience
Wang, Y., Fang, X., Xu, Z., Li, J., & Wang, L. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3719941 · Cited by 9
Peintner, J. B., Manger, C., Berger, M., & Riener, A. (2025) · Transportation Research Interdisciplinary Perspectives · doi:10.1016/j.trip.2025.101742 · Cited by 7
Gyevnár, B., Droop, S., Quillien, T., Cohen, S. B., Bramley, N. R., Lucas, C. G., & Albrecht, S. V. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713509 · Cited by 17
VirtualXAI: A User-Centric Framework for Explainability Assessment Leveraging GPT-Generated Personas
Makridis, G., Koukos, V., Fatouros, G., Kotios, D., Separdani, M. M., Kyriazis, D., & Soldatos, J. K. (2025) · International Conference on Distributed Computing in Smart Systems and the Internet of Things (DCOSS-IoT) · doi:10.1109/dcoss-iot65416.2025.00156 · Cited by 6
“Alongside these efforts, [28] introduces user-centered metrics—including user satisfaction, mental models, curiosity, trust, and the performance of human-AI collaborations—to present a more comprehensive picture of explainability.”
A Validation of the Human-Generative Artificial Intelligence Trust Scale
Wang, P., Yin, K., Tian, M., Zheng, Y., Wu, H., Zhou, C. Q., Zhang, M., Ma, J., & Yuan, X. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2542881 · Cited by 11
Schäfer, U., Sipos, L., & Müller-Birn, C. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757451 · Cited by 13
Kuhl, U., & Bush, A. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-08333-3_12 · Cited by 12
“Items 1-10 show the adapted version of the rust scale adapted from [12].”
InfluentialZhang, J., Jia, Q., Li, S., Zhang, S., & Chen, G. (2025) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2025.103851 · Cited by 8
Würfel, J., Papenfuß, A., & Wies, M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-60606-9_17 · Cited by 10
Why Did the AI Suggest That? Designing an Explainable Educational Counseling System
Fan, Z., Chen, P., & Lu, Y. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-98459-4_23 · Cited by 7
Alarcon, G. M., & Capiola, A. (2025) · Frontiers in Computer Science · doi:10.3389/fcomp.2025.1662185 · Cited by 13
When Recommendations are Explainable: an Eye-Tracking Study Comparing How and What to Explain
Wang, C., Kroon, A. C., Möller, J. E., de Vreese, C. H., & Boerman, S. C. (2025) · Information Systems Frontiers · doi:10.1007/s10796-025-10670-7 · Cited by 5
“…enhanced understanding can be conceptualized along two dimensions: perceived understanding , referring to users’ subjective sense of comprehension, and objective understanding , which reflects accurate knowledge of system processes (Heringer, 1983; Hoffman et al., 2023; Buschmeier et al., 2023).”
Fan, S., Wang, X., Zhang, B., & Sun, X. (2026) · Telematics and Informatics · doi:10.1016/j.tele.2026.102434 · Cited by 5
Tambwekar, P., & Gombolay, M. (2024) · Frontiers in Robotics and AI · doi:10.3389/frobt.2024.1375490 · Cited by 10
Human Factors Considerations in Artificial Intelligence Applications for Nuclear Power Plants
Mortenson, T., Kovesdi, C., & Mohon, J. (2024) · Nuclear Technology · doi:10.1080/00295450.2024.2411153 · Cited by 7
“Explainability is a key solution to this; though, Hoffman and colleagues [41] emphasize that the property of being explainable is an interaction based on what the user needs, what knowledge the user already has, and the user’s goal.”
Explainability and Interpretability Concepts for Edge AI Systems
Vermesan, O., Piuri, V., Scotti, F., Genovese, A., Labati, R. D., & Coscia, P. (2024) · River Publishers eBooks · doi:10.1201/9781003478713-9 · Cited by 12
Curiosity-driven learning in artificial intelligence and its applications
Sun, C. (2023) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/172831 · Cited by 10
Impact of Agent-Generated Rationales on Online Social Conformity
de Jong, S., Jacobsen, R. M., Wester, J., Wijenayake, S., Gonçalves, J., & van Berkel, N. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732217 · Cited by 13
“Finally, participants fill out a questionnaire to collect additional measures, the Big Five personality traits [69], and the Trust Scale for Explainable AI [37] as well as qualitative data on their experiences through open-ended questions.”
Navigating Decisions in the Cockpit: The Intelligent Pilot Advisory System
Djartov, B., & Würfel, J. (2025) · Progress in IS · doi:10.1007/978-3-031-83512-4_18 · Cited by 6
Alqarafi, A., & Almogadwy, B. S. (2025) · Applied Soft Computing · doi:10.1016/j.asoc.2025.114224 · Cited by 4
How AI Alleviates Woes: The Impact of Chatbot Relational Cues on Emotional Interaction Experiences
Xiang, Y., Gu, R., Chen, Z., Gan, T., & Zheng, Y. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2601286 · Cited by 6
“The revised Artificial Intelligence Trust Scale by Hoffman et al. (2023) was used to measure participants’ trust in the chatbot.”
Kares, F., Speith, T., Zhang, H., & Langer, M. (2026) · Computers in Human Behavior · doi:10.1016/j.chb.2026.109163 · Cited by 20
“When it comes to user studies that use subjective measures to evaluate different XAI approaches, trust and explanation satisfaction are important user reactions [14, 36, 37].”
Predicting and Presenting Task Difficulty for Crowdsourcing Food Rescue Platforms
Shi, Z. R., Zhi, J., Zeng, S., Zhang, Z., Kapoor, A., Hudson, S., Shen, H., & Fang, F. (2024) · International World Wide Web Conference (WWW) · doi:10.1145/3589334.3648155 · Cited by 5
Exploring Tangible Explainable AI (TangXAI): A User Study of Two XAI Approaches
Colley, A., Kalving, M., Häkkilä, J., & Väänänen, K. (2023) · Australian Conference on Computer-Human Interaction (OzCHI) · doi:10.1145/3638380.3638426 · Cited by 4
“Noting also that the trust may be context-dependent, with positive trust for specific tasks and distrust for other tasks [11].”
BackgroundFrom human explanations to explainable AI: Insights from constrained optimization
Ibs, I., Ott, C., Jäkel, F., & Rothkopf, C. A. (2024) · Cognitive Systems Research · doi:10.1016/j.cogsys.2024.101297 · Cited by 6
“One step that many advocate for is to validate the features used in explainable AI methods with user studies (Hoffman et al., 2023; Rong et al., 2023; Wells & Bednarz, 2021).”
Methodde Heuvel, J., Müller, S., Wessels, M., Akhtar, A., Bauckhage, C., & Bennewitz, M. (2025) · IEEE RO-MAN · doi:10.1109/ro-man63969.2025.11217609 · Cited by 7
“Item Q7 assesses participants’ trust calibration towards the robot and was derived from the Explanations Satisfaction Scale (ESS) [27].”
RIXA - Explaining Artificial Intelligence in Natural Language
Becker, M., Vishwesh, V., Birnstill, P., Schwall, F., Wu, S., & Beyerer, J. (2023) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw60847.2023.00118 · Cited by 5
“The subjective experience would measure how users perceive the explanation systems using for example the explanation satisfaction scale [54].”
BackgroundVanbelleghem, S., Regge, M. D., Nieuwenhove, Y. V., & Gemmel, P. (2025) · Nursing Inquiry · doi:10.1111/nin.70025 · Cited by 4
“However, nurses frequently resort to “ short ‐ term fix ” solutions that are applied “ on the fly ” to fulfill some more or less immediate goal (Hoffman et al. 2023), rather than long ‐ term, evidence ‐ based strategies (Patel and Singhal 2023).”
Trusted Simulation: Considering Model Quality in the Context of User Trust
Naugle, A., Manickam, I., Steinmetz, S., Schutte, P., Sweitzer, M., & Washburne, A. (2025) · System Dynamics Review · doi:10.1002/sdr.70011 · Cited by 3
Wang, S., Wei, Y., Ma, H., Lovitt, M., Deng, K., Meng, Y., Xu, Z., Zhang, J., Xiao, Y., Ding, Y., et al. (2025) · Communications Medicine · doi:10.1038/s43856-025-01114-z · Cited by 7
How explanatory features of AI and time frame reshape adolescents’ decision-making
Shen, Z., Chen, Y., Zhang, J., & Chen, H. (2026) · Computers & Education · doi:10.1016/j.compedu.2026.105563 · Cited by 4
Predicting student dropout in Saudi Universities using machine learning and explainable AI
Albugami, S., Wali, A. M., & Almagrabi, H. (2026) · PeerJ Computer Science · doi:10.7717/peerj-cs.3490 · Cited by 6
Who Gets More Trust—AI or Humans, and Why? A Cross-Cultural Analysis of AI and Interpersonal Trust
Zhang, H., Jing, Y., & Gu, R. (2026) · Behavioral Sciences · doi:10.3390/bs16030320 · Cited by 4
“To further examine the relative position of AI trust within the broader trust landscape across cultural contexts, we additionally measured overall AI trust using the AI Trust Scale (Hoffman et al., 2023), which has demonstrated strong reliability and validity (Perrig et al., 2023).”
InfluentialErlei, A., Cau, F. M., Georgiev, R., Kumar, S. C., Bizer, K., & Gadiraju, U. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791420 · Cited by 7
AI-assistance to decision-makers: evaluating usability, induced cognitive load, and trust's impact
Souchet, A. D., Amokrane, K., & Burkhardt, J. (2024) · European Conference on Cognitive Ergonomics · doi:10.1145/3673805.3673845 · Cited by 4
Human Centered Approaches and Taxonomies for Explainable Artificial Intelligence
Sheridan, H., Murphy, E., & O’Sullivan, D. M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-76827-9_9 · Cited by 3
A personalized value-based justification in food swaps to stimulate healthy online food choices
Jansen, L. Z. H., van Kleef, E., & Loo, E. J. V. (2025) · Electronic Commerce Research · doi:10.1007/s10660-025-09961-7 · Cited by 3
“…to user acceptance of suggestions [112–114], specifically because an increased understanding of the rationale behind suggestions might heighten consumers’ confidence in and value of the suggestions provided [115–117], particularly when the suggestions match individual preferences [118, 119].”
Metadata
- Authors
- Hoffman, R. R., Mueller, S. T., Klein, G., & Litman, J.
- Affiliations
- Florida Institute for Human and Machine Cognition (US)
- Michigan Technological University (US)
- University of Maine at Machias (US)
- Corresponding author
- Hoffman, Robert R.
- Venue
- Frontiers in Computer Science
- Publisher
- Frontiers Media SA
- Published
- 2023-02-06
- Volume
- 5
- ISSN
- 2624-9898 (ISSN-L)
- OpenAlex
- W4319321305
- Cited by
- 272
- References
- 139
- Citations by year
- 2026: 117 · 2025: 97 · 2024: 46 · 2023: 12
- FWCI
- 25.64
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Computer Science (publishedVersion, cc-by)
- Digital Commons - Michigan Tech (Michigan Technological University) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Defense Advanced Research Projects Agency
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- explainable AI, user satisfaction, mental models, curiosity, trust in AI, measurement scales, psychometric assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.