Explainable Recommendations and Calibrated Trust: Two Systematic User Errors
The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
The increased adoption of collaborative human-artificial intelligence decision-making tools triggered a need to explain recommendations for safe and effective collaboration. We explore how users interact with explanations and why trust-calibration errors occur, taking clinical decision-support systems as a case study.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Such failure of XAI systems in enhancing trust calibration has been linked to factors such as humans’ cognitive biases, e.g., people are selective of what they read and rely on [57].”
From Explainable recommendation: when design meets trust calibration (2021) · cites this paper as [57]
In the citing paper
“These errors encompass factors such as a lack of curiosity during decision-making, absence of context, confirmatory search, misinterpretation of explanations, or the formation of habitual responses [47].”
From AI Trust: Can Explainable AI Enhance Warranted Trust? (2023) · cites this paper as [47]
Citations
Cites
Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605
Explanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
Dual-Processing Accounts of Reasoning, Judgment, and Social Cognition
Evans, J. S. B. T. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.103006.093629 · Cited by 5,137
Customer engagement behavior: Theoretical foundations and research directions
van Doorn, J., Lemon, K. N., Mittal, V., Nass, S., Pick, D., Pirner, P., & Verhoef, P. C. (2010) · Journal of Service Research · doi:10.1177/1094670510375599 · Cited by 3,536
Persuasive Systems Design: Key Issues, Process Model, and System Features
Oinas-Kukkonen, H., & Harjumaa, M. (2009) · Communications of the Association for Information Systems · doi:10.17705/1cais.02428 · Cited by 1,663
Wood, W., & Rünger, D. (2016) · Annual Review of Psychology · doi:10.1146/annurev-psych-122414-033417 · Cited by 1,445
Keil, F. C. (2006) · Annual Review of Psychology · doi:10.1146/annurev.psych.57.102904.190100 · Cited by 1,350
Zhang, Y., Liao, Q. V., & Bellamy, R. K. E. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372852 · Cited by 895
Help Seeking and Help Design in Interactive Learning Environments
Aleven, V., Stahl, E., Schworm, S., Fischer, F., & Wallace, R. (2003) · Review of Educational Research · doi:10.3102/00346543073003277 · Cited by 609
Research works printed but not linked: 3
- apter, 1997, Reversal theory: What is it?, PSYCHOLOGIST-LEICESTER-, 10, 217
- 10.1518/hfes.46.1.50.30392 · doi:10.1518/hfes.46.1.50.30392 · Paper page
- naiseh, 2021, Explainable recommendations and calibrated trust – Research protocol
Cited by
Naiseh, M., Al-Thani, D., Jiang, N., & Ali, R. (2023) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2022.102941 · Cited by 170
Self-citationHow Cognitive Biases Affect XAI-assisted Decision-making: A Systematic Review
Bertrand, A., Belloum, R., Eagan, J. R., & Maxwell, W. (2022) · Proceedings of the 2022 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3514094.3534164 · Cited by 129
“[8]–[10], [12], [17], [33], [35], [41]– [43], [48], [52], [54], [56], [59], [60], [69] Caused, triggered, or enhanced by XAI leading to under reliance Escalation of commitment, Illusion of validity, Negativity bias, Familiarity bias, Perceived goal impediment, Redundancy aversion, Weak evidence…”
BackgroundMethodInfluentialExplainable recommendation: when design meets trust calibration
Naiseh, M., Al-Thani, D., Jiang, N., & Ali, R. (2021) · World Wide Web · doi:10.1007/s11280-021-00916-0 · Cited by 68
“Such failure of XAI systems in enhancing trust calibration has been linked to factors such as humans’ cognitive biases, e.g., people are selective of what they read and rely on [57].”
BackgroundSelf-citationTrust in artificial intelligence: Literature review and main path analysis
Henrique, B. M., & Santos, E. (2024) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2024.100043 · Cited by 103
AI Trust: Can Explainable AI Enhance Warranted Trust?
de Brito Duarte, R., Correia, F., Arriaga, P., & Paiva, A. (2023) · Human Behavior and Emerging Technologies · doi:10.1155/2023/4637678 · Cited by 52
C-XAI: A conceptual framework for designing XAI tools that support trust calibration
Naiseh, M., Simkute, A., Zieni, B., Jiang, N., & Ali, R. (2024) · Journal of Responsible Technology · doi:10.1016/j.jrt.2024.100076 · Cited by 57
“Several studies have highlighted that humans ’ requirements for XAI in a human-AI task differ based on the specific task and the target audience (Naiseh et al., 2023; Naiseh et al., 2021, 2021).”
BackgroundMethodInfluentialSelf-citationHou, T.-Y., Tseng, Y.-C., & Yuan, C. W. (2024) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2024.102775 · Cited by 60
Nudging through Friction: An Approach for Calibrating Trust in Explainable AI
Naiseh, M., Al-Mansoori, R. S., Al‐Thani, D., Jiang, N., & Ali, R. (2021) · International Conference on Behavioral, Economic, and Socio-Cultural Computing · doi:10.1109/besc53957.2021.9635271 · Cited by 61
Self-citationChang, W.-C., & Hasanzadeh, S. (2024) · Journal of Computing in Civil Engineering · doi:10.1061/jccee5.cpeng-5656 · Cited by 42
Yu, X., Hoggenmüeller, M., & Tomitsch, M. (2023) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3568162.3576992 · Cited by 38
“As such interfaces require a longer and more focused attention span, they are less suited for public spaces, in which people are likely to be in a rush and encounter robots as casual bystanders in an unplanned manner [48].”
BackgroundTrustworthy Autonomous Systems (TAS): Engaging TAS experts in curriculum design
Naiseh, M., Bentley, C., & Ramchurn, S. D. (2022) · IEEE Global Engineering Education Conference (EDUCON) · doi:10.1109/educon52537.2022.9766663 · Cited by 15
Self-citationOutlining the Design Space of eXplainable Swarm (xSwarm): Experts’ Perspective
Naiseh, M., Soorati, M. D., & Ramchurn, S. D. (2024) · Springer proceedings in advanced robotics · doi:10.1007/978-3-031-51497-5_3 · Cited by 13
Self-citationYu, S. (2023) · International Academic Mindtrek Conference (Mindtrek) · doi:10.1145/3616961.3616965 · Cited by 17
“Although some studies have provided some evidence about how explanations can help improve trust in AI systems [41, 58, 87, 90], and other studies show that explanations will, in turn, promote users’ over-reliance on AI [15, 41, 59], it is unclear how the explanations support trust calibration [60].”
ResultAdjusting Amount of AI Explanation for Visual Tasks
Maehigashi, A., Fukuchi, Y., & Yamada, S. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3650802 · Cited by 13
“In other words, the negative impact of overloading users with explanations was observed as shown in the previous studies [15, 18, 29].”
Explainable Persuasion in Interactive Design
Cemiloglu, D., Catania, M., & Ali, R. (2021) · IEEE International Requirements Engineering Conference Workshops (REW) · doi:10.1109/rew53955.2021.00066 · Cited by 14
Self-citationAI-CDSS Design Guidelines and Practice Verification
He, X., Xi, Z., Ding, H., Liu, Y., & Zhu, H. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2235882 · Cited by 14
“…Chua et al., 2021; Hwang et al., 2022; Jo et al., 2022; Kueper et al., 2022; Lederman et al., 2022; Matthiesen et al., 2021; M € uller et al., 2020; Naiseh et al., 2021; Romero-Brufau et al., 2020; Rundo et al., 2020; Schwartz et al., 2021; Stagg et al., 2021; Wang et al., 2021; Yang et al.,…”
InfluentialTowards Responsible AI: Developing Explanations to Increase Human-AI Collaboration
Duarte, R. D. B. (2023) · Frontiers in artificial intelligence and applications · doi:10.3233/faia230126 · Cited by 12
Rosenbacke, R. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4773350 · Cited by 9
Exploration of Explainable AI for Trust Development on Human-AI Interaction
Bernardo, E. L., & Seva, R. R. (2023) · Artificial Intelligence and Cloud Computing Conference (AICCC) · doi:10.1145/3639592.3639625 · Cited by 9
The Effect of Data Visualisation Quality and Task Density on Human-Swarm Interaction
Abioye, A. O., Naiseh, M., Hunt, W., Clark, J. R., Ramchurn, S. D., & Soorati, M. D. (2023) · IEEE RO-MAN · doi:10.1109/ro-man57019.2023.10309454 · Cited by 6
Self-citationSocial eXplainable AI (Social XAI): Towards Expanding the Social Benefits of XAI
Naiseh, M. (2024) · Studies in neuroscience, psychology and behavioral economics · doi:10.1007/978-3-031-70355-3_13 · Cited by 8
Self-citationEffects of Presenting Multiple Types of AI Explanations for Visual Task
Maehigashi, A., Fukuchi, Y., & Yamada, S. (2024) · International Conference on Human-Agent Interaction (HAI) · doi:10.1145/3687272.3688328 · Cited by 3
“Another issue is that the way of presenting AI explanations could lead to cognitive bias in users, which leads to miscalibration of trust and degrades task performance [4, 21, 27].”
How Different Explanations Impact Trust Calibration: The Case of Clinical Decision Support SystemsPreprint
Naiseh, M., Al‐Thani, D., Jiang, N., & Ali, R. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4098528 · Cited by 2
Self-citationDojcinovic, S., Strecker, J., Mayer, S., & Bektaş, K. (2026) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3742413.3789129 · Cited by 1
“With growing system complexity and reliance of users on recommendations, the need for transparency increases as well [48].”
Naiseh, M., Zieni, B., Natali, C., & Bouchachia, H. (2026) · IEEE Conference on Artificial Intelligence (CAI) · doi:10.1109/cai68641.2026.11536442 · Cited by 1
“This asymmetric effect is consistent with established findings in cognitive psychology and human factors, where explanations, especially those delivered in natural, fluent language, can elevate perceived system credibility independently of underlying model performance [9, 27, 28].”
Self-citationMaehigashi, A., Fukuchi, Y., & Yamada, S. (2024) · IEEE RO-MAN · doi:10.1109/ro-man60168.2024.10731272 · Cited by 2
“During the task, they could not verify AI performance. when the information in XAI explanations is presented in line with the user’s thoughts, people tend to trust XAI [35].”
BackgroundDesigning for Effective Human-XAI Interaction: User Experience Research Plays and Cards
Naiseh, M., Doğan, H., Giff, S., Malhi, A. K., & Jiang, N. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-01399-6_13
Self-citationBertrand, A. (2024) · theses.fr (ABES) · doi:10.70675/216d3647z78bcz4c68z9ba9z2d0a029cf1b4 · Cited by 8
Frey, N., Agha-Mir-Salim, L., Renner, L., Haufe, S., Voge, L., & Balzer, F. (2026) · Research Square · doi:10.21203/rs.3.rs-10892043/v1 · Cited by 2
Palmer-Cooper, E. C., Gentry, E., Nichele, E., Azim, T., Naiseh, M., Dowthwaite, L., Armouch, M. S., Greenway, F. T., Weal, M. J., & Hughes, A. (2026) · Behavioral Sciences · doi:10.3390/bs16111969
Self-citation
Metadata
- Authors
- Naiseh, M., Cemiloglu, D., Al Thani, D., Jiang, N., & Ali, R.
- Affiliations
- Bournemouth University (GB)
- College of Science and Engineering, Hamad Bin Khalifa University, Doha, Doha, Qatar
- Hamad bin Khalifa University (QA)
- Venue
- Computer
- Published
- 2021-10
- Volume
- 54
- Issue
- 10
- Pages
- 28-37
- ISSN
- 0018-9162 (ISSN-L)
- 1558-0814
- OpenAlex
- W3175040535
- Cited by
- 30
- References
- 25
- Citations by year
- 2026: 4 · 2025: 1 · 2024: 11 · 2023: 7 · 2022: 4 · 2021: 3
- FWCI
- 2.21
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- Computer (publishedVersion)
- ePrints Soton (University of Southampton) (acceptedVersion)
- Funders
- Bournemouth University
- IQHealth Tech
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Keywords
- explainable recommendation, trust calibration, user errors, human-AI collaboration, clinical decision support systems, trust in AI
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.