Explainable recommendation: when design meets trust calibration
Open accessThe DOI matches its Crossref record; 100 of the 109 references it cites were found in a registry or an index, and 2 are not checked yet; 24 of the 96 sources its claims cite were checked for support.
Abstract
Human-AI collaborative decision-making tools are being increasingly applied in critical domains such as healthcare. However, these tools are often seen as closed and intransparent for human decision-makers. An essential requirement for their success is the ability to provide explanations about themselves that are understandable and meaningful to the users. While explanations generally have positive connotations, studies showed that the assumption behind users interacting and engaging with these explanations could introduce trust calibration errors such as facilitating irrational or less thoughtful agreement or disagreement with the AI recommendation. In this paper, we explore how to help trust calibration through explanation interaction design. Our research method included two main phases. We first conducted a think-aloud study with 16 participants aiming to reveal main trust calibration errors concerning explainability in AI-Human collaborative decision-making tools. Then, we conducted two co-design sessions with eight participants to identify design principles and techniques for explanations that help trust calibration. As a conclusion of our research, we provide five design principles: Design for engagement, challenging habitual actions, attention guidance, friction and support training and learning. Our findings are meant to pave the way towards a more integrated framework for designing explanations with trust calibration as a primary goal.
Verified 2026-11-22 · 2 references not checked yet
Overview
CoChat Summary
## TL;DR
This qualitative study examines how explanation interface design can support trust calibration in Human-AI collaborative decision-making, using a screening-prescription mock-up with medical experts. From a think-aloud phase and two co-design sessions, the authors derive five design principles for XAI: engagement, challenging habitual actions, attention guidance, friction, and training/learning.
## Key findings
- In the exploration phase, many participants made trust calibration errors by skipping or misapplying explanations; skipping was grouped into five categories: lack of curiosity, perceived goal impediment, redundant information, perceived complexity, and lack of context.
- The study recruited 24 participants total: 16 in the exploration phase and 8 in the co-design phase.
- In the design phase, participants proposed four main Human-Explanation interaction themes: abstraction, cues, control, and adaptation.
- The final contribution is five design principles for calibrated-trust XAI: design for engagement, challenging habitual actions, attention guidance, friction, and support training and learning.
## Methods
- Two-phase qualitative design: (1) a think-aloud exploration phase and (2) two co-design sessions to derive interface principles and techniques.
- Sample and setting: medical experts from oncology departments in three UK organisations; the use case was an AI-supported screening prescription task in a web-based mock-up.
- Analysis: audio transcriptions, observations, notes, and sketches were analyzed using content analysis with iterative coding and verification by the coauthors.
## Limitations
- The paper states that the results are qualitative and that future controlled experiments are needed to map trust calibration errors to explanation types and to test whether the proposed design techniques have the intended effects.
- The paper notes it was unable to pair configurations of the XAI model with the type of bias and error; this limits how specific the design guidance can be.
- Evident from the text: the study used a mock-up and a single domain-specific scenario (screening prescriptions), so generalization beyond this context is not established in the paper.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures







Verification
Claims the paper makes
19 Valid · 0 Not valid · 55 Not checked · 129 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“They found that communicating explanations, on average, is not improving trust calibration, i.e., users still end-up in situations where they over-trust or under-trust AI-based recommendation.”
- Also stated in: § Theoretical background and related work · plain
“Recent studies showed that even though explanations were communicated to people, trust calibration is not improved [16, 96].”
- Also stated in: § Theoretical background and related work · plain
“Overall, users of XAI systems fail, on average, to calibrate their trust, i.e., human decision-maker working collaboratively with an AI can still be notably following incorrect recommendations or rejecting correct ones.”
§ Explainable recommendation: when design meets trust calibration > Introduction
What the sources say
- Supportedcites [7] Bansal, G., Wu, T., Zhu, J., Fok, R., Nushi, B., Kamar, E., Ribeiro, M.T., Weld, D.S.: Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance. arXiv preprint arXiv:2006.14779 (2020) source
The Introduction (p. 2) reports no significant overall improvement from explanations over showing AI confidence alone, despite gains when the AI was correct and losses when it erred. Section 6.2 (p. 12) says explanations increased blind trust rather than appropriate reliance, supporting the claim that explanations did not reliably calibrate users’ trust. (LLM, conf=0.87)
- Partly supportedcites [16] Bussone, A., Stumpf, S. & O'sullivan, D.: The role of explanations on trust and reliance in clinical decision support systems, pp. 160–169. IEEE (2015) sourceExperimental — accuracy not yet measured
The Conclusion (p. 11) reports that comprehensive explanations promoted over-reliance, while selective explanations promoted self-reliance, supporting the claim that users can still over- or under-rely on recommendations. It does not report an average effect showing that communicating explanations fails to improve trust calibration; the Discussion (p. 11) instead says explanations can help users assess suggestions and that their effects require further study. (LLM, conf=0.86)
- Partly supportedcites [96] Zhang, Y., Liao, Q.V., Bellamy, R.K.E.: Effect of confidence and explanation on accuracy and trust calibration in AI-assisted decision making. Proceedings of the 2020 conference on fairness, accountability, and transparency. Association for Computing Machinery, Barcelona (2020) sourceExperimental — accuracy not yet measured
The Results (§4.2) report that local explanations did not improve trust calibration, and §2 describes calibration as distinguishing when to trust or distrust AI. The claim broadens this finding from the particular local explanations tested to communicating explanations generally; the paper (§5.3) allows that other explanation methods may be more effective. (LLM, conf=0.85)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Theoretical background and related work · plain
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Another research [49] showed that current explainable models are designed to be used by ML engineers for debugging purposes where end-users are not the main target of these explanations.”
§ Explainable recommendation: when design meets trust calibration > Introduction
What the sources say
- Partly supportedcites [49] Miller, T., Howe, P., Sonenberg, L.: Explainable AI: beware of inmates running the asylum or: how I learnt to stop worrying and love the social and behavioural sciences. arXiv preprint arXiv:1712.00547 (2017) sourceExperimental — accuracy not yet measured
The Abstract (p. 1) argues that most AI researchers are building explanatory agents for themselves rather than their intended users, supporting the point that end-users are often not the main target. The paper does not say that current explainable models are designed for ML engineers to use for debugging; 'explanatory debugging' appears only in the title of a paper listed in the appendix (p. 6). (LLM, conf=0.88)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“However, this introduces a lack of transparency which can weaken the users’ ability to calibrate trust in the Human-AI collaborative decision-making environments.”
- Also stated in: § Introduction · plain
“This means the human decision-maker is less able to judge when to follow a system output or reject it [33].”
§ Explainable recommendation: when design meets trust calibration > Introduction
What the sources say
- Partly supportedcites [33] Gui C Chan V Machine learning in medicine Unive. West. Ont. Med. J. 2017 86 76 78 10.5206/uwomj.v86i2.2060 sourceExperimental — accuracy not yet measured
The 'challenges to translation' section says that black-box ML models can make the medical community uncomfortable because their mechanisms are unknown. This supports a concern about transparency and trust, but it does not address users’ ability to calibrate trust in human–AI collaborative decision-making environments. Page information is unavailable in our copy. (LLM, conf=0.82)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Introduction · plain
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Although, many studies showed that explanation could indeed improve trust calibration [80].”
§ Explainable recommendation: when design meets trust calibration > Theoretical background and related work
What the sources say
- Partly supportedcites [80] Tomsett R Preece A Braines D Cerutti F Chakraborty S Srivastava M Pearson G Kaplan L Rapid trust calibration through interpretable and uncertainty-aware AI Patterns 2020 1 100049 10.1016/j.patter.2020.100049 33205113 PMC7660448 sourceExperimental — accuracy not yet measured
The Results section proposes that explanations, alongside uncertainty estimates, could help people calibrate trust in AI. But the Discussion section says research on explanations’ effects remains to be done and notes that explanations can sometimes make users overly trusting. The paper does not report that many studies have shown explanations improve trust calibration. (LLM, conf=0.87)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Recently, trust calibration became an essential metric for evaluating collaborative Human-AI decision-making tools [7, 16, 96].”
§ Explainable recommendation: when design meets trust calibration > Introduction
What the sources say
- Partly supportedcites [7] Bansal, G., Wu, T., Zhu, J., Fok, R., Nushi, B., Kamar, E., Ribeiro, M.T., Weld, D.S.: Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance. arXiv preprint arXiv:2006.14779 (2020) sourceExperimental — accuracy not yet measured
Section 6.2 (p. 12) treats appropriate reliance rather than blind trust as important to human–AI collaboration. But Section 2 (p. 3) says the paper evaluates these tools using end-to-end team accuracy; it does not establish trust calibration as an essential evaluation metric. (LLM, conf=0.82)
- Partly supportedcites [16] Bussone, A., Stumpf, S. & O'sullivan, D.: The role of explanations on trust and reliance in clinical decision support systems, pp. 160–169. IEEE (2015) sourceExperimental — accuracy not yet measured
The paper treats appropriately balanced trust and reliance as important in clinical decision support (Assessing System Reliability and Trust, p. 4; Discussion, p. 11), and measures participants’ trust and reliance in its study (Data Collection and Analysis, p. 6). It does not establish trust calibration as an essential evaluation metric for collaborative human–AI tools generally. (LLM, conf=0.86)
- Supportedcites [96] Zhang, Y., Liao, Q.V., Bellamy, R.K.E.: Effect of confidence and explanation on accuracy and trust calibration in AI-assisted decision making. Proceedings of the 2020 conference on fairness, accountability, and transparency. Association for Computing Machinery, Barcelona (2020) source
The Introduction (page unavailable) calls prediction-specific trust calibration especially important to the success of AI-assisted decision-making. Section 5.3 (page unavailable) says its effect should be evaluated with users in the loop and presents the study as an example of that evaluation, supporting its role as an important evaluation measure. (LLM, conf=0.88)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
89 more claims · 4 with their cited sources checked
Create a free account to see all 203 claims and every source verdict.
- Probably not a substantial claim. 82
- It may state two separate claims as one. 49
- The quote only partly states this claim. 1
Citations
Cites
(2011) · Cited by 14,317
(1999) · Cited by 7,995
An introduction to cybernetics
Ashby, W. R. (1956) · doi:10.5962/bhl.title.5851 · Cited by 7,578
Affect and Cognition Based Trust as Foundations for Interpersonal Cooperation in Organizations
McAllister, D. J. (1995) · Academy of Management Journal · doi:10.2307/256727 · Cited by 7,346 · cited 1×
“1 3 scenarios, it is highly likely that cognition-based trust components are more significant for trust calibration [41, 44].”
Background“Why Should I Trust You?”: Explaining the Predictions of Any Classifier
Ribeiro, M., Singh, S., & Guestrin, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations · doi:10.18653/v1/n16-3020 · Cited by 6,682
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 4×
“Previous research [40, 88] identified five primary contexts where trust calibration errors in automation occur, their reasons of occurrences and potential design solutions.”
BackgroundResultInfluentialA Simple Model of Herd Behavior
Banerjee, A. V. (1992) · The Quarterly Journal of Economics · doi:10.2307/2118364 · Cited by 6,556
Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
Adadi, A., & Berrada, M. (2018) · IEEE Access · doi:10.1109/access.2018.2870052 · Cited by 6,294
Designing the user interface: Strategies for effective human-computer interaction
(1993) · Applied Ergonomics · doi:10.1016/0003-6870(93)90471-k · Cited by 5,587
Explanation in Artificial Intelligence: Insights from the Social Sciences
Miller, T. (2017) · arXiv · doi:10.48550/arxiv.1706.07269 · Cited by 5,338
Research works printed but not linked: 3
- Biran, O., Cotton, C: Explanation and justification in machine learning: a survey, pp. 8–13 (2017)
- Bradley S Design Fundamentals: Elements, Attributes, & Principles 2013 Colorado Vanseo design
- Naiseh, M.: Explainable recommendation: When design meets trust calibration – Research protocol. Technical Report, Bournemouth University, 339579, https://staffprofiles.bournemouth.ac.uk/display/report/339579 (2021) PMC8327305 34366701
Cited by
Rosenbacke, R., Melhus, Å., McKee, M., & Stuckler, D. (2024) · JMIR AI · doi:10.2196/53207 · Cited by 305
“Naiseh et al [28,29] noted that explanations affected both cognitive and affect-based trust and could result in either overtrust or undertrust.”
BackgroundMethodInfluentialNaiseh, M., Al-Thani, D., Jiang, N., & Ali, R. (2023) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2022.102941 · Cited by 170
Self-citationMehrotra, S., Degachi, C., Vereschak, O., Jonker, C. M., & Tielman, M. L. (2024) · ACM Journal on Responsible Computing · doi:10.1145/3696449 · Cited by 144
“The most common is agreement percentage , that is the percentage of trials in Another measure of appropriate trust is related to switch percentage [178], A final method is to measure ideal trusting behavior during the task beforehand and compare to which extent the”
InfluentialBeyond AI-powered context-aware services: the role of human–AI collaboration
Jiang, N., Liu, X., Liu, H., Lim, E. T. K., Tan, C., & Gu, J. (2022) · Industrial Management & Data Systems · doi:10.1108/imds-03-2022-0152 · Cited by 158
Self-citationRezaeian, O., Bayrak, A. E., & Asan, O. (2026) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2025.2539458 · Cited by 39
“Explainable Artificial Intelligence (XAI) has become essential in fields like medicine[42, 31], finance, and autonomous systems, where understanding AI decisions is critical.”
Rezaeian, O., Bayrak, A. E., & Asan, O. (2025) · arXiv · doi:10.48550/arxiv.2501.16693 · Cited by 39
C-XAI: A conceptual framework for designing XAI tools that support trust calibration
Naiseh, M., Simkute, A., Zieni, B., Jiang, N., & Ali, R. (2024) · Journal of Responsible Technology · doi:10.1016/j.jrt.2024.100076 · Cited by 57
Self-citationWali, S. U., Usman, A. A., Usman, A., Abdullahi, U., Mohammed, I. U., & Hayatu, J. M. (2024) · International Journal of Hydrology · doi:10.15406/ijh.2024.08.00390 · Cited by 33
AI and XAI second opinion: the danger of false confirmation in human–AI collaboration
Rosenbacke, R., Melhus, Å., McKee, M., & Stückler, D. (2024) · Journal of Medical Ethics · doi:10.1136/jme-2024-110074 · Cited by 33
“8 14 15 Hence, current research on these errors seeks to calibrate trust in AI, so as to better balance true and false conflict errors.”
How Can We Develop Explainable Systems? Insights from a Literature Review and an Interview Study
Chazette, L., Klünder, J., Balci, M., & Schneider, K. A. (2022) · doi:10.1145/3529320.3529321 · Cited by 34
“Focus Groups/Workshops [46],[72] Interviews [8],[11],[16],[17],[20],[23],[24], [27],[43],[54],[62],[72] Personas [2],[5],[12],[14],[30],[50], [57],[71] Questionnaires [20],[43],[44],[50],[61] Scenarios [2],[4],[16],[19],[18], [36],[44],[46],[49],[51], [52],[57],[68],[71]”
BackgroundArtificial intelligence in corporate governance
Ustahaliloğlu, M. K. (2025) · Corporate Law & Governance Review · doi:10.22495/clgrv7i1p11 · Cited by 43
Habiba, U.-E., Bogner, J., & Wagner, S. (2022) · IEEE International Requirements Engineering Conference Workshops (REW) · doi:10.1109/rew56159.2022.00038 · Cited by 35
Rosenbacke, R., Melhus, Å., & Stückler, D. (2024) · Nature Communications · doi:10.1038/s41467-024-50952-3 · Cited by 20
Investigating Trust in Human-AI Collaboration for a Speech-Based Data Analytics Task
Tutul, A. A., Nirjhar, E. H., & Chaspari, T. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2328910 · Cited by 28
“Leveraging XAI with appropriate interface design in collaborative human-AI decision-making tasks can potentially contribute to trust calibration (Naiseh et al., 2021, 2023).”
Human Centricity in the Relationship Between Explainability and Trust in AI
Atf, Z., & Lewis, P. R. (2023) · IEEE Technology and Society Magazine · doi:10.1109/mts.2023.3340238 · Cited by 26
Lesley, U., & Kuratomi, A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-66535-6_32 · Cited by 20
Khac, L. T. D., & Leyer, M. (2025) · Technology in Society · doi:10.1016/j.techsoc.2025.103064 · Cited by 25
Kim, G., Hwang, S., Seong, M., Yeo, D., Rus, D. L., & Kim, S. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3678544 · Cited by 20
Knowledge-reinforced explainable next basket recommendation
Huang, L., Zou, H., Huang, X., et al. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106675 · Cited by 11
Trust dampening and trust promoting: A dual-pathway of trust calibration in human-robot interaction
HUANG, X., & Li, Y. (2024) · Advances in Psychological Science · doi:10.3724/sp.j.1042.2024.00527 · Cited by 16
ContractMind: Trust-calibration interaction design for AI contract review tools
Zeng, J., Chen, K., Wang, R., Li, Y., Fan, M., Wu, K., Qi, X., & Wang, L. (2024) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2024.103411 · Cited by 21
Explainability, Robustness, and Fairness in User-Centric Intelligent Systems: A Systematic Review
Zahid, I. A., Garfan, S., Chyad, M. A., Albahri, A. S., Albahri, O. S., Alamoodi, A. H., Deveci, M., Homod, R. Z., & Alzubaidi, L. (2025) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2025.3567604 · Cited by 22
“Theliteraturehasfocused ondesigningsolutionsforenhancingtheroleofexplanations intrustcalibration[25].”
InfluentialAI-CDSS Design Guidelines and Practice Verification
He, X., Xi, Z., Ding, H., Liu, Y., & Zhu, H. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2235882 · Cited by 14
“…Chua et al., 2021; Hwang et al., 2022; Jo et al., 2022; Kueper et al., 2022; Lederman et al., 2022; Matthiesen et al., 2021; M € uller et al., 2020; Naiseh et al., 2021; Romero-Brufau et al., 2020; Rundo et al., 2020; Schwartz et al., 2021; Stagg et al., 2021; Wang et al., 2021; Yang et al.,…”
InfluentialMotivated by Design: A Codesign Study to Promote Challenging Misinformation on Social Media
Gurgun, S., Arden-Close, E. J., Phalp, K. T., & Ali, R. (2024) · Human Behavior and Emerging Technologies · doi:10.1155/2024/5595339 · Cited by 11
Self-citationFröhlich, P., Mirnig, A. G., Falcioni, D., Schrammel, J., Diamond, L. M., Fischer, I., & Tscheligi, M. (2022) · Quality and User Experience · doi:10.1007/s41233-022-00053-0 · Cited by 10
“Recently, there have been approaches to design for explainability of advanced machine learning to non-expert users [15, 27, 75].”
BackgroundDynamic calibration of trust and trustworthiness in AI-enabled systems
Liebherr, M., Enkel, E., Law, E. L., Mousavi, M. R., Sammartino, M., & Sieberg, P. M. (2026) · International Journal on Software Tools for Technology Transfer · doi:10.1007/s10009-026-00840-6 · Cited by 17
Explanation-by-Example Based on Item Response Theory
Cardoso, L. F. F., Ribeiro, J., Santos, V. C. A., Silva, R. L., Mota, M. P., Prudêncio, R. B. C., & Alves, R. C. D. O. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-21686-2_20 · Cited by 13
Cattabriga, A., & Joler, V. (2023) · DIID · doi:10.30682/diid8023a · Cited by 7
Atf, Z., & Lewis, P. R. (2025) · Disability and Rehabilitation Assistive Technology · doi:10.1080/17483107.2025.2507684 · Cited by 6
“…accessible to non-technical stakeholders [78]. integrating Fate principles – Fairness, accountability, transparency and explainability – into system design further shapes positive user perceptions, as systems perceived to uphold these values are more likely to engender trust and satisfaction [86].”
A User Study Evaluation of Predictive Formal Modelling at Runtime in Human-Swarm Interaction
Abioye, A. O., Hunt, W., Gu, Y., Schneiders, E., Naiseh, M., Archibald, B., Sevegnani, M., Ramchurn, S. D., Fischer, J. E., & Soorati, M. D. (2025) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3727989 · Cited by 4
“These results call for designing human-swarm interfaces with a calibrated trust goal in mind [41].”
Self-citationMapping Human–AI Relationships: Intellectual Structure and Conceptual Insights
Gómez-Cruz, N. A., Castro, D. Y. R., Rey-Sarmiento, C. F., Torres, R. A. Z., & Niño, Á. M. (2026) · Technologies · doi:10.3390/technologies14020083 · Cited by 5
“Second, transparency and explainability are essential: AI systems must produce interpretable outputs that align with user expectations and foster trust [45,46,48].”
Social eXplainable AI (Social XAI): Towards Expanding the Social Benefits of XAI
Naiseh, M. (2024) · Studies in neuroscience, psychology and behavioral economics · doi:10.1007/978-3-031-70355-3_13 · Cited by 8
Self-citationTrust‐Affording Action: Citizens’ Everyday Relations With Algorithmized Public Services
Rannisto, A., & Vainionpää, F. (2025) · Social Inclusion · doi:10.17645/si.10001 · Cited by 4
“…on trust requirements in AI adoption and how to promote trust in AI (Bangui & Buhnova, 2024; Bedué & Fritzsche, 2022; Ezer et al., 2019; Hasija & Esper, 2022; Knowles & Richards, 2021; Naiseh et al., 2021; Okamura & Yamada, 2020; Rebensky et al., 2021; Weitz et al., 2019; Zierau et al., 2020).”
Schmude, T., Koesten, L. M., Möller, T. B., & Tschiatschek, S. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2650562 · Cited by 4
Generative AI for Revolutionizing Personal Style
Bhoyar, K., & Patil, S. N. (2025) · International Conference on AIML-Applications for Engineering & Technology (ICAET) · doi:10.1109/icaet63349.2025.10932201 · Cited by 2
Un-trusting the Chat: Designing for Calibrated Trust in Retrieval-Augmented Conversations
von Reeken, T., Salous, M., & Abdenebaoui, L. (2025) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3719160.3737620 · Cited by 5
“Recent work further emphasizes that transparency should also reveal system limitations and uncertainties, enabling users to recognize when not to trust outputs [20, 21, 25].”
Design Principles for Human-Centred Explainable AI: A Scoping Review
Hughes, N. G. J., Jia, Y., Sujan, M. A., Lawton, T., Habli, I., & McDermid, J. A. (2026) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3771720 · Cited by 6
“However, many papers present principles derived from empirical studies (e.g., [16, 20, 23, 36, 41]), and discuss them in isolation, without comparison with existing principles in the literature.”
InfluentialPersuasive explanations for recommender systems: how explanations can influence users’ choices?
Rahman, S. M. T., Siemon, D., & Ruotsalo, T. (2025) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2025.103720 · Cited by 6
Explaining Federated Learning-Based Movie Recommendations
Soyarar, E., Aydoğan, R., Buzcu, B., & Calvaresi, D. (2025) · IEEE International Conference on Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE) · doi:10.1109/metroxraine66377.2025.11340199 · Cited by 3
“The second major challenge in modern AI systems, particularly in recommender systems, is the lack of transparency, often referred to as the “black-box” problem [16].”
How Different Explanations Impact Trust Calibration: The Case of Clinical Decision Support SystemsPreprint
Naiseh, M., Al‐Thani, D., Jiang, N., & Ali, R. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4098528 · Cited by 2
Self-citationEnhancing Explainability in Medical AI: Developing Human-Centered Participatory Design Cards
Zhang, T., & He, X. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-76827-9_10 · Cited by 4
Empowering Trust: The Role of Adaptable Design in AI Systems
Staab, V., Hein, I., Ramrath, M., Schlüter, L., Stuckstätte, A., Hohn, M., Sieberg, P. M., & Liebherr, M. (2025) · IEEE Conference on Cognitive and Computational Aspects of Situation Management (CogSIMA) · doi:10.1109/cogsima64436.2025.11079500 · Cited by 2
“Further research is needed to explore the effects of adaptability on overtrust, its implications, and to refine system design while clarifying the boundaries of these effects [64].”
Domain Experience and Expertise in Explainable AI Applications: A Bearing Fault Diagnosis Case Study
Zhao, Z., Castelle, M., & Turkay, Ç. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757583 · Cited by 3
“Naiseh et al. [100] attempted to reduce trust calibration errors by encouraging participants to sketch AI explanations during co-design.”
Designing a human-centered AI solution with radiologists to improve prostate cancer diagnosis
Saßmannshausen, S. M., Ontika, N. N., Tran, K., Ukleja, K., de Carvalho, A. F. P., & Rohde, M. (2025) · i-com · doi:10.1515/icom-2025-0043 · Cited by 1
“69 Procter et al., also highlighted that AI systems in healthcare often lack an understanding of the organizational context, limiting practitioner trust in their recommendations.”
Explainable AI and Robots for Children: Why Transparency Alone is Not Enough
Yadollahi, E. (2026) · ACM International Conference on Interaction Design and Children (IDC) · doi:10.1145/3773077.3812171 · Cited by 1
“However, most existing approaches assume users who can critically assess explanations and integrate them into stable understandings of the system [15, 22].”
Kim, S. H., Kim, E. H., Yang, H., Lee, J., & Lim, H. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791908 · Cited by 1
“Trust calibration—aligning users’ trust with the actual capabilities and limitations of systems—has emerged as a central objective in XAI research [54, 61, 70].”
Zokaei, Z., Shahrokhzadeh, B., Farahani, M., & Hosseinalizdeh, S. (2024) · doi:10.1109/qicar61538.2024.10496631
Leveraging Explainable AI (XAI) for Talent Management and Employer Branding in the Digital Era
Sangavi, V., Sowmya, G., & Lim, B. C. Y. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-3897-2.ch013 · Cited by 1
Designing for Effective Human-XAI Interaction: User Experience Research Plays and Cards
Naiseh, M., Doğan, H., Giff, S., Malhi, A. K., & Jiang, N. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-01399-6_13
Self-citationLiebherr, M., Babiker, A., Alshakhsi, S. A. A., Al‐Thani, D., Montag, C., & Ali, R. (2025) · Advances in Human-Computer Interaction · doi:10.1155/ahci/5590506
“Te class of explanation in XAI, e.g., example-based and counterfactual, and XAI design in general have an impact on how individuals calibrate their trust in the AI system errors [18] and in potentially making errors [19].”
Self-citationApplication of XAI recommendation systems and XAI scoring systems
Ticku, A., & Singh, N. (2025) · AIP conference proceedings · doi:10.1063/5.0292483
Angara, D., & Yellapu, J. (2025) · Journal of Information & Knowledge Management · doi:10.1142/s0219649225501163 · Cited by 1
Sundari, V. S., & Saranya, N. N. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6026607
Clinician perspectives on trust and adoption of AI in breast cancer diagnosis
Rezaeian, O., Ghorbanichemazkati, E., Bayrak, A. E., & Asan, O. (2026) · IISE Transactions on Healthcare Systems Engineering · doi:10.1080/24725579.2025.2611435 · Cited by 2
“Among these factors, explainability has emerged as a central concern (Amann et al., 2022; Bernardo & Seva, 2023; Cecil et al., 2024; Leichtmann et al., 2024; Naiseh et al., 2021; Shin, 2021; Tucci et al., 2022).”
A mini-approach for retail banking with transparent recommendation system enabled by explainable AI
Bairagi, P., & Arora, S. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-025-00817-5 · Cited by 1
“It promotes transparency and trust through explainable AI [10, 51], enhancing customer confidence in automated financial decisions.”
Lackner, M. F., & Pöchträger, S. (2026) · Journal of theoretical and applied electronic commerce research · doi:10.3390/jtaer21060174 · Cited by 1
“…help users to interpret suggestions as comprehensible and context-appropriate, supporting trust calibration and acceptance rather than blind reliance [34], and experimental evidence shows that explanation scope/modality can shift understanding, trust, and attitudes toward recommender systems [35].”
InfluentialNaiseh, M., Zieni, B., Natali, C., & Bouchachia, H. (2026) · IEEE Conference on Artificial Intelligence (CAI) · doi:10.1109/cai68641.2026.11536442 · Cited by 1
“While prior research has highlighted the promise of textual explanations in improving interpretability and user satisfaction [25, 26], our results suggest that their actual impact on user reasoning and decision quality could depend on model correctness.”
Self-citationISMAILOV, А., Aarthi, S., Rustamovich, A. S., Khusan, J., Mardonovich, N. A., & Ravikumar, R. N. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-2600-2541-3.ch005
Reliance-Aware Design of Interactive Explainable User Interfaces
Filho, J. C. D. S., Belloum, R., Monteiro, I. T., & de Oliveira, K. M. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812231 · Cited by 2
“The authors proposed a set of recommendations structured around five core design principles [48]: design for engagement, challenge habitual actions, guide attention, introduce friction, and support training and learning.”
InfluentialOne Prediction, Two Stories: A Role-Based XAI Framework for Smart Energy Management
Zabot, B., Silva, C., Rocha, T., Barroso, J., Oliveira, M., & Pinto, T. D. O. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29653-5_27
Designing Trustworthy Human–AI Teams: Adaptive Explanations and Collaborative Decision-Making
Sailaja, K., Mithili, N., Vijaya, B., Bharathi, P. R., V.MuthuLakshmi, N., & Rohitha, M. (2026) · International Conference on Innovations in Emerging Technologies for Sustainable Development (ICIETSD) · doi:10.1109/icietsd68684.2026.11584758
Explainable artificial intelligence as AI literacy scaffolding
Lund, B. D., Teel, Z. A., Porter, B., Chandrasekaran, A., & Patole, S. R. (2026) · Journal of Documentation · doi:10.1108/jd-02-2026-0088 · Cited by 1
Yu, J., Chen, J., Ren, A., Duan, H., Meng, H., & Gao, Z. (2026) · Journal of Medical Internet Research · doi:10.2196/94140 · Cited by 1
“Prior studies have found that added explanations or complex provenance panels can reduce usability scores among older users or those with limited digital literacy [4,16].”
Conceptual Models of Trust in Materials AI — Frameworks, Dimensions, and Open Questions
Santos, V., Costa, R., & Teixeira, B. (2024) · Journal of Artificial Intelligence for Materials Science · doi:10.68159/h711608257
Exploring Trust Factors in Designing AI-Supported Performance Appraisal System
Harnindito, A., & Sawarni, A. (2026) · European Conference on Cognitive Ergonomics · doi:10.1145/3822301.3822342
An Adaptive Intent-Centric AI Framework for Content Personalization on Intelligent Digital Platforms
Priya, C., Sheeladevi, S., Mangala, N., et al. (2026) · doi:10.1109/iccvbic71195.2026.11689617
Constraint-Based Learning for Trustworthy Student Performance Prediction
Zieni, B., Naiseh, M., Femi-Philips, T., Malhi, A. K., & Abdelwahab, M. M. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-39783-6_5
Self-citationPerceived Subjectivity as an Interactional Effect in Affective Conversational Systems
Leucas, D., Iasulaitis, S., & Caseli, H. D. M. (2026) · International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW) · doi:10.1109/aciiw71585.2026.11712075
“In this understanding, safeguards function as internal constraints on the relational architecture itself, and thus part of how user autonomy and calibrated trust are preserved in high-salience interactions [34] .”
Metadata
- Authors
- Naiseh, M., Al-Thani, D., Jiang, N., & Ali, R.
- Affiliations
- Bournemouth University (GB)
- Hamad bin Khalifa University (QA)
- Corresponding author
- Naiseh, Mohammad
- Jiang, Nan
- Ali, Raian
- Venue
- World Wide Web
- Published
- 2021-08-02
- Volume
- 24
- Issue
- 5
- Pages
- 1857-1884
- ISSN
- 1386-145X (ISSN-L)
- 1573-1413
- PMC
- PMC8327305
- OpenAlex
- W3191257699
- Semantic Scholar
- e632f1191b3c261cdae48698c97eb2e9a5a45c78
- Cited by
- 68
- References
- 109
- Citations by year
- 2026: 20 · 2025: 20 · 2024: 17 · 2023: 3 · 2022: 7 · 2021: 1
- FWCI
- 2.46
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- World Wide Web (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Bournemouth University Research Online (Bournemouth University) (acceptedVersion)
- ePrints Soton (University of Southampton) (submittedVersion, cc-by)
- Aberdeen University Research Archive (Aberdeen University) (submittedVersion)
- Figshare (submittedVersion, cc-by)
- Funders
- iQ HealthTech (01101)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Keywords
- explainable recommendation, trust calibration, AI transparency, attention guidance, clinical decision support, think-aloud study, co-design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-30, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-30 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.