The DOI matches its Crossref record; 55 of the 59 references it cites were found in a registry or an index; 7 of the 11 sources its claims cite were checked for support.
AI Trust: Can Explainable AI Enhance Warranted Trust?
Open accessAbstract
Explainable artificial intelligence (XAI), known to produce explanations so that predictions from AI models can be understood, is commonly used to mitigate possible AI mistrust. The underlying premise is that the explanations of the XAI models enhance AI trust. However, such an increase may depend on many factors. This article examined how trust in an AI recommendation system is affected by the presence of explanations, the performance of the system, and the level of risk. Our experimental study, conducted with 215 participants, has shown that the presence of explanations increases AI trust, but only in certain conditions. AI trust was higher when explanations with feature importance were provided than with counterfactual explanations. Moreover, when the system performance is not guaranteed, the use of explanations seems to lead to an overreliance on the system. Lastly, system performance had a stronger impact on trust, compared to the effects of other factors (explanation and risk).
Overview
CoChat Summary
## TL;DR
This experiment tested whether explainable AI increases trust in an AI recommender system, using a mushroom-judgment game with 215 participants. Explanations helped trust in some cases—especially feature-importance explanations (LIME)—but AI performance had a stronger effect than explanations or risk.
## Key findings
- In the main sample, 211 participants remained after attention checks; the study used a 3 × 2 × 2 design with XAI type, risk level, and model performance.
- High AI performance increased all five measured outcomes: MDMT (5.34 vs 4.05), direct subjective trust (4.84 vs 3.46), behavioral trust (0.87 vs 0.80), AI understandability (4.53 vs 3.92), and XAI quality (4.85 vs 4.11); all were significant at p < 0.001.
- Feature-importance explanations (LIME) outperformed counterfactual explanations (DICE) and control on self-reported trust and understanding: MDMT (4.98 vs 4.60 and 4.50), AI understandability (4.70 vs 3.99 and 4.00), and XAI quality (5.01 vs 4.40 and 4.04).
- Behavioral trust depended on an XAI × performance interaction (F2,205 = 25.40, p < 0.001, η²p = 0.20): with high performance, LIME had the highest adherence to recommendations (0.93 ± 0.02), but with low performance LIME had the lowest adherence (0.75 ± 0.02) versus DICE (0.81 ± 0.02) and control (0.84 ± 0.02).
- Risk mattered mainly when performance was low: in that case, trust and related ratings were lower in the high-risk condition than the low-risk condition; the paper reports delegation was more pronounced in low risk when performance was low (χ²1 = 9.52, p = 0.002).
## Methods
- Experimental user study built around a web-based mushroom game in which participants made 12 eat/avoid decisions per round with advice from an AI recommender system.
- Participants were recruited from Prolific; 215 were recruited, 211 remained after attention checks, and they were non-experts presumed to be lay users. The sample included 114 women, 94 men, and 3 nonbinary participants; mean age was 27 years.
- XAI type was between-subjects (LIME feature importance, DICE counterfactuals, or no explanation), risk was between-subjects (high vs low), and AI performance was within-subjects (high vs low, counterbalanced). Analysis used mixed-design ANOVA in SPSS 26 plus a chi-squared test for delegation, with Bonferroni correction.
## Limitations
- The paper states it only examined two XAI categories: counterfactual explanations and feature-importance explanations.
- The authors note the study used online participants assumed to be lay users, so findings may not extend directly to expert–AI collaboration. They also say the trustworthiness meaning of the 60% “low performance” condition is debatable and may not generalize to even lower-performance systems.
- Evident from the text: the study used a game-based mushroom task, so external validity to other real-world decision contexts is limited.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
5 Valid · 1 Not valid · 4 Not checked · 71 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, in cases where performance was lower, participants in the LIME condition (0 75 ± 0 02) displayed significantly reduced behavioural trust compared to the other two conditions (0 81 ± 0 02 in DICE and 0 84 ± 0 02 in the control condition).”
§ AI Trust: Can Explainable AI Enhance Warranted Trust? > 5.2. Behavioural Trust and Delegation.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Furthermore, the XAI factor exhibits a significant main effect on MDMT, AI understandability, and XAI quality.”
§ AI Trust: Can Explainable AI Enhance Warranted Trust? > 5.1. Self-Reported Measures.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“An intriguing discovery from the research was that explanations can increase trust in AI even when the AI model itself is not reliable.”
§ AI Trust: Can Explainable AI Enhance Warranted Trust? > 8. Conclusion
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Participants' compliance with recommendations did not differ based on risk, even when the model's performance was low.”
§ AI Trust: Can Explainable AI Enhance Warranted Trust? > 5.2. Behavioural Trust and Delegation.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In terms of subjective trust measures, it becomes evident that when the AI model's performance is reduced, reported trust diminishes in comparison to instances where the system performs better.”
§ AI Trust: Can Explainable AI Enhance Warranted Trust? > Dependent variable
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
41 more claims
Create a free account to see all 81 claims and every source verdict.
- Probably not a substantial claim. 16
- It may state two separate claims as one. 21
- The quote only partly states this claim. 1
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ AI Trust: Can Explainable AI Enhance Warranted Trust? > 4.5. Outcomes.
“To evaluate subjective trust in the AI system, we employed two measures: (1) The multidimensional measure of trust (MDMT) [40], which gauges indirect subjective trust through participants' assessments of eight-related traits associated with the AI system”
§ AI Trust: Can Explainable AI Enhance Warranted Trust? > References
“40. D. Dua and C. Graff, UCI Machine Learning Repository, 2017.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ AI Trust: Can Explainable AI Enhance Warranted Trust? > 4.2. AI Model Development.
“This dataset contains 8124 entries, encompassing 22 categorical variables and a binary target variable indicating the mushroom's edibility.”
§ AI Trust: Can Explainable AI Enhance Warranted Trust? > References
“39. R. C. Mayer, J. H. Davis, and F. D. Schoorman, "An integrative model of organizational trust," Academy of Management Review, vol. 20, no. 3, pp. 709-734, 1995.”
Citations
Cites
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Advances in Neural Information Processing Systems 29
Teymur, O., Zygalakis, K., & Calderhead, B. (2016) · Cited by 13,887
Arrieta, A. B., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., García, S., Gil-López, S., Molina, D., Benjamins, R., et al. (2019) · arXiv · doi:10.48550/arxiv.1910.10045 · Cited by 11,321
An integrative model of organizational trust
Mayer, R. C., Davis, J. H., & Schoorman, F. D. (1995) · The Academy of Management Review · doi:10.2307/258792 · Cited by 10,736
Rudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561
Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423
“Why Should I Trust You?”: Explaining the Predictions of Any Classifier
Ribeiro, M., Singh, S., & Guestrin, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations · doi:10.18653/v1/n16-3020 · Cited by 6,682
Explanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
Shin, D. (2021) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2020.102551 · Cited by 1,548
Cited by
Shifa, N., Saleh, M., Akbari, Y., & Al Maadeed, S. (2025) · Clinical Imaging · doi:10.1016/j.clinimag.2025.110492 · Cited by 45
Silalahi, A. D. K. (2025) · Technology in Society · doi:10.1016/j.techsoc.2025.102995 · Cited by 52
Choudhury, A., Shahsavar, Y., & Shamszare, H. (2025) · JMIR Human Factors · doi:10.2196/72867 · Cited by 46
“For example, prior research has shown that while user engagement may be generated through conversational style and interactive query handling, these features fall short in fostering enduring user reliance without a foundational trust in the response quality [34,35] or robust data governance.”
Aquilino, L., Dio, C. D., Manzi, F., Massaro, D., Bisconti, P., & Marchetti, A. (2025) · Informatics · doi:10.3390/informatics12030070 · Cited by 43
“Nine papers studied trust in decision-making assistants [47,50,60,71,76,80,83,85,88].”
InfluentialBetween transparency and trust: identifying key factors in AI system perception
Cetinkaya, N. E., & Krämer, N. (2025) · Behaviour and Information Technology · doi:10.1080/0144929x.2025.2533358 · Cited by 44
“Each attribute contributes to overall trust in a distinct manner (Angerschmid et al. 2022; De Brito Duarte et al. 2023; Dorton and Harper 2022; Shin 2021; Wischnewski, Krämer, and Müller 2023).”
Metadata
- Authors
- de Brito Duarte, R., Correia, F., Arriaga, P., & Paiva, A.
- Affiliations
- INESC-ID, Instituto Superior Técnico, Universidade de Lisboa, Portugal
- University of Lisbon (PT)
- ISCTE-Instituto Universitário de Lisboa (IUL), CIS-IUL, Lisboa, Portugal
- Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento (PT)
- Venue
- Human Behavior and Emerging Technologies
- Publisher
- Wiley
- Published
- 2023-10-31
- Volume
- 2023
- Pages
- 1-12
- ISSN
- 2578-1863 (ISSN-L)
- OpenAlex
- W4388040162
- Cited by
- 52
- References
- 59
- Citations by year
- 2026: 26 · 2025: 22 · 2024: 4
- FWCI
- 4.89
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- Human Behavior and Emerging Technologies (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Repositório do ISCTE-IUL (submittedVersion, other-oa)
- Funders
- LARSyS (UIDP/50009/2020, LA/P/0083/2020, UIDB/50021/2020, C628696807-00454142, H2020-ICT-48-2020/952215, H2020-ICT-48-2020/952026)
- INESC-ID (UIDP/50009/2020, LA/P/0083/2020, UIDB/50021/2020, C628696807-00454142, H2020-ICT-48-2020/952215, H2020-ICT-48-2020/952026)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Keywords
- explainable AI, trust in AI, AI recommendation systems, counterfactual explanations, system performance, risk perception, overreliance on AI
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: AI Trust: Can Explainable AI Enhance Warranted Trust? https://app.cochat.ai/papers/10.1155/2023/4637678
- The paper
- de Brito Duarte, R., Correia, F., Arriaga, P., & Paiva, A. (2023). AI Trust: Can Explainable AI Enhance Warranted Trust? Human Behavior and Emerging Technologies. https://doi.org/10.1155/2023/4637678
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.