Exploring the effects of human-centered AI explanations on trust and reliance
Open accessThe DOI matches its Crossref record; 99 of the 99 references it cites were found in a registry or an index; 23 of the 59 sources its claims cite were checked for support.
Abstract
Transparency is widely regarded as crucial for the responsible real-world deployment of artificial intelligence (AI) and is considered an essential prerequisite to establishing trust in AI. There are several approaches to enabling transparency, with one promising attempt being human-centered explanations. However, there is little research into the effectiveness of human-centered explanations on end-users' trust. What complicates the comparison of existing empirical work is that trust is measured in different ways. Some researchers measure subjective trust using questionnaires, while others measure objective trust-related behavior such as reliance. To bridge these gaps, we investigated the effects of two promising human-centered post-hoc explanations, feature importance and counterfactuals , on trust and reliance. We compared these two explanations with a control condition in a decision-making experiment ( N = 380). Results showed that human-centered explanations can significantly increase reliance but the type of decision-making (increasing a price vs. decreasing a price) had an even greater influence. This challenges the presumed importance of transparency over other factors in human decision-making involving AI, such as potential heuristics and biases. We conclude that trust does not necessarily equate to reliance and emphasize the importance of appropriate, validated, and agreed-upon metrics to design and evaluate human-centered AI.
Overview
CoChat Summary
TL;DR
This online experiment (N = 380) tested feature importance and counterfactual explanations against a control for effects on trust and reliance in an apartment-pricing task. Counterfactual explanations increased reliance only when the AI recommended decreasing the price, while explanations did not affect trust and recommendation direction had a larger effect on reliance.
Key findings
- Human-centered explanations did not significantly affect trust: TPA overall H(2) = 1.54, p = 0.46; trust H(2) = 5.06, p = 0.08; distrust H(2) = 2.03, p = 0.36. H4–H6 were rejected.
- Reliance was significantly higher for counterfactual explanations vs. control only when the AI recommended decreasing the initial price: β = 0.04, 95% CI [0.01, 0.08], t(378) = 2.31, p = 0.02, an approximately 4% increase in WOA. Feature importance increased WOA by 2% vs. control but was not significant (p = 0.27).
- Recommendation type had a larger effect than explanations: increase vs. decrease recommendations was highly significant for WOA, β = 0.05, 95% CI [0.03, 0.07], t(1,899) = 3.62, p < 0.001, and improved model fit, χ²(1) = 13.05, p < 0.001. Participants relied more on recommendations to decrease prices.
- Overall WOA was positive (M = 0.69, SD = 0.36), and TPA ratings were average overall (M = 5.01, SD = 0.86), with higher trust (M = 4.98, SD = 1.05) than distrust (M = 2.95, SD = 1.62).
Methods
- Online decision-making experiment on Amazon Mechanical Turk; 913 recruited, 798 completed, and 380 remained after exclusions. Sample was predominantly male (61%), mean age 37.03 years (SD = 10.15), and 68% had a higher-education degree.
- Participants estimated subleasing prices for six real Zillow apartments, received an alleged AI price recommendation (random 10–20% deviation from their initial estimate), and then gave a final price. The design was 3 (explanation: feature importance vs. counterfactual vs. control) × 2 (recommendation: increase vs. decrease price), with explanation between-subjects and recommendation within-subjects.
- Reliance was measured by Weight of Advice (WOA); trust was measured by the Trust between People and Automation Scale (TPA, 12 items, 7-point). WOA was analyzed with linear mixed-effects models; TPA was analyzed with Kruskal-Wallis tests after exploratory factor analysis indicated a two-factor trust/distrust structure.
Limitations
- The paper states the study was domain-specific to real estate, used low-stakes MTurk decisions, and did not test untrustworthy recommendations or larger deviations from initial estimates; future work should broaden domains and examine high-stakes or poorer-performing AI.
- The paper states the design could not distinguish dispositional, situational, and learned trust, and trust was measured after task completion, so trial-level effects of bias and heuristics on trust could not be examined.
- Evident from the text: the final sample was predominantly male and highly educated, which may limit generalizability; the task deliberately had no “true price,” and WOA captures reliance behavior rather than trust attitudes.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
21 Valid · 0 Not valid · 19 Not checked · 68 Own results and interpretations
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“However, research has shown that subjective trust can be a poor predictor of actual reliance (Dzindolet et al., 2003; Miller et al., 2016; Papenmeier et al., 2022).”
- Also stated in: § 1. Introduction · plain
“research has shown that subjective trust can be a poor predictor of actual reliance (Dzindolet et al., 2003; Miller et al., 2016; Papenmeier et al., 2022).”
What the sources say
- Not checked — no full text of the sourcecites Dzindolet et al., 2003 source
- Not checked — no full text of the sourcecites Miller et al., 2016 source
- Supportedcites Papenmeier et al., 2022 source
Section 4.4 reports a weak correlation between self-reported and behavioural trust (r = 0.2998) and concludes that neither is a good proxy for the other. The discussion characterizes the behavioural measure as a better proxy for reliance than for trust as a whole, supporting the claim that subjective trust can poorly predict actual reliance. (LLM, conf=0.91)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 1. Introduction · plain
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“To the best of our knowledge, there is little to no empirical research on the effectiveness of these two humancentered explanations derived from the literature (i.e., Adadi and Berrada, 2018) using Miller's criteria in fostering end-users' trust in AI.”
What the sources say
- Not checked — no full text of the sourcecites Adadi and Berrada, 2018 source
- Partly supportedcites Miller, 2019 sourceExperimental — accuracy not yet measured
Section 4.6.6 identifies criteria for evaluating explanations—simplicity, generality, and coherence—and discusses their potential role in generating trust. It does not establish the claimed lack of empirical research on feature-importance and counterfactual explanations evaluated using those criteria for end-users’ trust. (LLM, conf=0.84)
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Every source the paper cites for this claim was checked and supports it.
In the paper
“This deliberate choice by the participants to either rely on the AI recommendation or not makes our experiment an actual decision-making task rather than a proxy task (Buçinca et al., 2020).”
What the sources say
- Supportedcites Buçinca et al., 2020 source
The Discussion (p. 9) distinguishes the proxy task from the actual decision-making task: in the latter, users aim to make accurate nutritional decisions and choose whether and how deeply to engage with AI recommendations. It also reports that participants sometimes ignored incorrect recommendations, supporting the cited distinction. (LLM, conf=0.91)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Even if an AI system is trusted, reliance must not necessarily follow (Kirlik, 1993; Körber, 2018)”
What the sources say
- Not checked — no full text of the sourcecites Kirlik, 1993 source
- Supportedcites Körber, 2018 source
In the theoretical discussion of trust and reliance, the paper states that even when trust is high and an automated system is perceived as capable, reliance does not necessarily follow. This directly supports the citing sentence’s paraphrase. (LLM, conf=0.95)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Every source the paper cites for this claim was checked and supports it.
In the paper
“Whether trust translates into reliance is more nuanced than often assumed and depends on an interaction between the operator, the automation, and the situation (Körber, 2018).”
What the sources say
- Supportedcites Körber, 2018 source
Körber's theoretical section states the claim almost verbatim: 'Whether trust translates into reliance behavior depends on a dynamic interaction of operator, automation, situational factors, and interface (Lee & See, 2004)', and surrounds it with the nuance the citing sentence asserts — trust and reliance are 'closely related' yet 'distinct constructs', attitude/intention/behaviour stand in a 'probabilistic' rather than deterministic relationship (Ajzen & Fishbein, 1980), and 'even if trust is at a high level ... reliance does not necessarily follow' (Kirlik, 1993), with environmental and cognitive constraints determining whether intention becomes actual reliance. Körber adopts and relies on this point to build his own model and justify a self-report questionnaire, so citing him for it is appropriate even though the four-factor formulation is credited onward to Lee & See (2004); the citing paraphrase drops 'interface' from the list of interacting factors but asserts nothing the source contradicts. (LLM, conf=0.82)
plainstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
53 more claims · 1 with their cited sources checked
Create a free account to see all 108 claims and every source verdict.
- Probably not a substantial claim. 29
- It may state two separate claims as one. 26
- The quote only partly states this claim. 1
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Consistentt(378) = 0.64reported p = .53 · recomputed p = .523
“t (378) = 0.64, p = .53”
- Consistentt(378) = 1.33reported p = .19 · recomputed p = .184
“t (378) = 1.33, p = .19”
- Consistentt(378) = 0.63reported p = .53 · recomputed p = .529
“t (378) = 0.63, p = .53”
- Consistentt(378) = 2.31reported p = .02 · recomputed p = .021
“t (378) = 2.31, p = .02”
- Consistentt(378) = 1.1reported p = .27 · recomputed p = .272
“t (378) = 1.10, p = .27”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 6. Discussion
“A WOA of 0.70 signifies that participants adopted 70% of the AI recommendations when updating their prior beliefs to form their final estimate.”
§ 4.1. Measures
“WOA is equal to 1 if the participant's final prediction matches the AI recommendation and equal to 0.5 if they average their initial prediction with the AI recommendation.”
Citations
Cites
Fitting Linear Mixed-Effects Models Using lme4
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810
(1980) · Medical Entomology and Zoology · Cited by 25,810
The Framing of Decisions and the Psychology of Choice
Tversky, A., & Kahneman, D. (1981) · Science · doi:10.1126/science.7455683 · Cited by 18,497
Use of Ranks in One-Criterion Variance Analysis
Kruskal, W. H., & Wallis, W. A. (1952) · Journal of the American Statistical Association · doi:10.1080/01621459.1952.10483441 · Cited by 13,912
Arrieta, A. B., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., García, S., Gil-López, S., Molina, D., Benjamins, R., et al. (2019) · arXiv · doi:10.48550/arxiv.1910.10045 · Cited by 11,321
An integrative model of organizational trust
Mayer, R. C., Davis, J. H., & Schoorman, F. D. (1995) · The Academy of Management Review · doi:10.2307/258792 · Cited by 10,736
Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423
Not So Different After All: A Cross-Discipline View Of Trust
Rousseau, D. M., Sitkin, S. B., Burt, R. S., & Camerer, C. (1998) · Academy of Management Review · doi:10.5465/amr.1998.926617 · Cited by 10,274
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605
Loss aversion in riskless choice: A reference-dependent model.
Tversky, A., & Kahneman, D. (1991) · The Quarterly Journal of Economics · doi:10.2307/2937956 · Cited by 6,432
Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
Adadi, A., & Berrada, M. (2018) · IEEE Access · doi:10.1109/access.2018.2870052 · Cited by 6,294
Lipton, Z. C. (2018) · Queue · doi:10.1145/3236386.3241340 · Cited by 5,427
The Mythos of Model Interpretability
Lipton, Z. C. (2016) · arXiv · doi:10.48550/arxiv.1606.03490 · Cited by 5,422
Explanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
Humans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554
Algorithm aversion: People erroneously avoid algorithms after seeing them err.
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000033 · Cited by 3,232
Trust in Automation: Integrating Empirical Evidence on Factors That Influence Trust
Hoff, K. A., & Bashir, M. (2015) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720814547570 · Cited by 2,817
Shmueli, G. (2010) · Statistical Science · doi:10.1214/10-sts330 · Cited by 2,517
On the Failure to Eliminate Hypotheses in a Conceptual Task
Wason, P. C. (1960) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470216008416717 · Cited by 2,098
Algorithm appreciation: People prefer algorithmic to human judgment
Logg, J. M., Minson, J. A., & Moore, D. A. (2019) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2018.12.005 · Cited by 2,061
IBM SPSS Statistics 26 Step by Step: A Simple Guide and Reference
George, D., & Mallery, P. (2019) · doi:10.4324/9780429056765 · Cited by 1,883
Cacioppo, J. T., & Berntson, G. G. (1994) · Psychological Bulletin · doi:10.1037//0033-2909.115.3.401 · Cited by 1,882
Foundations for an Empirically Determined Scale of Trust in Automated Systems
Jian, J.-Y., Bisantz, A. M., & Drury, C. G. (2000) · International Journal of Cognitive Ergonomics · doi:10.1207/s15327566ijce0401_04 · Cited by 1,799
Complacency and Bias in Human Use of Automation: An Attentional Integration
Parasuraman, R., & Manzey, D. H. (2010) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720810376055 · Cited by 1,710
Proceedings of the Human Factors and Ergonomics Society 2019 Annual Meeting
(2019) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181319631171 · Cited by 1,432
Robustness of linear mixed-effects models to violations of distributional assumptions
Schielzeth, H., Dingemanse, N. J., Nakagawa, S., Westneat, D. F., Allegue, H., Teplitsky, C., Réale, D., Dochtermann, N. A., Garamszegi, L. Z., & Araya‐Ajoy, Y. G. (2020) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.13434 · Cited by 1,393
Explainable AI: Interpreting, Explaining and Visualizing Deep Learning
(2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-28954-6 · Cited by 1,377
The role of trust in automation reliance
Dzindolet, M. T., Peterson, S. A., Pomranky, R. A., Pierce, L. G., & Beck, H. P. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00038-7 · Cited by 1,276
Techniques for interpretable machine learning
Du, M., Liu, N., & Hu, X. (2019) · Communications of the ACM · doi:10.1145/3359786 · Cited by 1,268
Techniques for Interpretable Machine Learning
Du, M., Liu, N., & Hu, X. (2018) · arXiv · doi:10.48550/arxiv.1808.00033 · Cited by 1,261
Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
(2021) · doi:10.1145/3411764 · Cited by 1,240
Explaining machine learning classifiers through diverse counterfactual explanations
Mothilal, R. K., Sharma, A., & Tan, C. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372850 · Cited by 1,233
Proceedings of the ACM on Human-Computer Interaction
Karahalios, K. G., Monroy‐Hernández, A., Lampinen, A., & Fitzpatrick, G. (2018) · Cited by 1,074
Counterfactual explanations without opening the black box: automated decisions and the GDPR
Wachter, S., Mittelstadt, B., & Russell, C. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3063289 · Cited by 1,061
Questioning the AI: Informing Design Practices for Explainable AI User Experiences
Liao, Q. V., Gruen, D., & Miller, S. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376590 · Cited by 925
Designing Theory-Driven User-Centric Explainable AI
Wang, D., Yang, Q., Abdul, A., & Lim, B. Y. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300831 · Cited by 906
Zhang, Y., Liao, Q. V., & Bellamy, R. K. E. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372852 · Cited by 895
Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems
(2019) · doi:10.1145/3290605 · Cited by 841
Priester, J. R., & Petty, R. E. (1996) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.71.3.431 · Cited by 817
Mittelstadt, B., Russell, C., & Wachter, S. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287574 · Cited by 794
A Multidisciplinary Survey and Framework for Design and Evaluation of Explainable AI Systems
Mohseni, S., Zarei, N., & Ragan, E. D. (2021) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3387166 · Cited by 785
A Multidisciplinary Survey and Framework for Design and Evaluation of Explainable AI Systems
Mohseni, S., Zarei, N., & Ragan, E. D. (2018) · arXiv · doi:10.48550/arxiv.1811.11839 · Cited by 783
Abdul, A., Vermeulen, J., Wang, D., Lim, B. Y., & Kankanhalli, M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174156 · Cited by 743
Manipulating and Measuring Model Interpretability
Poursabzi-Sangdeh, F., Goldstein, D. G., Hofman, J. M., Wortman Vaughan, J. W., & Wallach, H. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445315 · Cited by 728
Manipulating and Measuring Model Interpretability
Poursabzi-Sangdeh, F., Goldstein, D. G., Hofman, J. M., Vaughan, J. W., & Wallach, H. (2018) · arXiv · doi:10.48550/arxiv.1802.07810 · Cited by 711
Langer, M., Oster, D., Speith, T., Hermanns, H., Kästner, L., Schmidt, E., Sesing, A., & Baum, K. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103473 · Cited by 652
How Much Information?: Effects of Transparency on Trust in an Algorithmic Interface
Kizilcec, R. F. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858402 · Cited by 615
Taking Advice: Accepting Help, Improving Judgment, and Sharing Responsibility
Harvey, N., & Fischer, I. (1997) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1997.2697 · Cited by 588
Principles of Explanatory Debugging to Personalize Interactive Machine Learning
Kulesza, T., Burnett, M., Wong, W.-K., & Stumpf, S. (2015) · Proceedings of the 20th International Conference on Intelligent User Interfaces · doi:10.1145/2678025.2701399 · Cited by 576
Formalizing Trust in Artificial Intelligence: Prerequisites, Causes and Goals of Human Trust in AI
Jacovi, A., Marasović, A., Miller, T., & Goldberg, Y. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445923 · Cited by 545
Expanding Explainability: Towards Social Transparency in AI systems
Ehsan, U., Liao, Q. V., Muller, M., Riedl, M. O., & Weisz, J. D. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445188 · Cited by 538
Understanding the Effect of Accuracy on Trust in Machine Learning Models
Yin, M., Wortman Vaughan, J., & Wallach, H. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300509 · Cited by 527
Stephanidis, C., Salvendy, G., Antona, M., Chen, J. Y. C., Dong, J., Duffy, V. G., Fang, X., Fidopiastis, C., Fragomeni, G., Fu, L. P., et al. (2019) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2019.1619259 · Cited by 524
Metrics for explainable AI: challenges and prospects
Hoffman, R. R., Mueller, S. T., Klein, G., & Litman, J. (2018) · arXiv · doi:10.48550/arxiv.1812.04608 · Cited by 518
Conversational processes and causal explanation.
Hilton, D. J. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.107.1.65 · Cited by 456
The effects of transparency on trust in and acceptance of a content-based art recommender
Cramer, H., Evers, V., Ramlal, S., van Someren, M., Rutledge, L., Stash, N., Aroyo, L., & Wielinga, B. (2008) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-008-9051-3 · Cited by 448
Interacting with Predictions: Visual Inspection of Black-box Machine Learning Models
Krause, J., Perer, A., & Ng, K. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858529 · Cited by 390
Lai, V., & Tan, C. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287590 · Cited by 377
Economic games on the internet: the effect of $1 stakes
Amir, O., Rand, D. G., & Gal, Y. K. (2012) · PLoS ONE · doi:10.1371/journal.pone.0031461 · Cited by 364
Theoretical Considerations and Development of a Questionnaire to Measure Trust in Automation
Körber, M. (2019) · Advances in Intelligent Systems and Computing · doi:10.1007/978-3-319-96074-6_2 · Cited by 317
Proxy tasks and subjective measures can be misleading in evaluating explainable AI systems
Buçinca, Z., Lin, P., Gajos, K. Z., & Glassman, E. L. (2020) · Proceedings of the 25th International Conference on Intelligent User Interfaces · doi:10.1145/3377325.3377498 · Cited by 307
Explaining Decision-Making Algorithms through UI: Strategies to Help Non-Expert Stakeholders
Cheng, H.-F., Wang, R., Zhang, Z., O'Connell, F., Gray, T., Harper, F. M., & Zhu, H. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300789 · Cited by 292
Kocielnik, R., Amershi, S., & Bennett, P. N. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300641 · Cited by 277
Human-Centered Explainable AI: Towards a Reflective Sociotechnical Approach
Ehsan, U., & Riedl, M. O. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-60117-1_33 · Cited by 274
Effects of task difficulty on use of advice
Gino, F., & Moore, D. A. (2007) · Journal of Behavioral Decision Making · doi:10.1002/bdm.539 · Cited by 272
Affective Processes in Human–Automation Interactions
Merritt, S. M. (2011) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720811411912 · Cited by 260
How to Evaluate Trust in AI-Assisted Decision Making? A Survey of Empirical Methodologies
Vereschak, O., Bailly, G., & Caramiaux, B. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3476068 · Cited by 229
Proceedings of the 35th Annual Hawaii International Conference on System Sciences HICSS-35
(2002) · Proceedings of the 35th Annual Hawaii International Conference on System Sciences HICSS-02 · doi:10.1109/hicss.2002.993840 · Cited by 222
Human factors in model interpretability: Industry practices, challenges, and needs
Hong, S. R., Hullman, J., & Bertini, E. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3392878 · Cited by 219
Automated rationale generation: a technique for explainable AI and its effects on human perceptions
Ehsan, U., Tambwekar, P., Chan, L., Harrison, B., & Riedl, M. O. (2019) · Proceedings of the 24th International Conference on Intelligent User Interfaces · doi:10.1145/3301275.3302316 · Cited by 210
Trust in electronic environments
Chopra, K., & Wallace, W. A. (2003) · 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the · doi:10.1109/hicss.2003.1174902 · Cited by 187
Modeling Strategic Behavior in Human-Automation Interaction: Why an "Aid" Can (and Should) Go Unused
Kirlik, A. (1993) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872089303500203 · Cited by 177
Sanneman, L., & Shah, J. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2081282 · Cited by 160
Wischnewski, M., Krämer, N., & Müller, E. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581197 · Cited by 146
It's complicated: the relationship between user trust, model accuracy and explanations in AI
Papenmeier, A., Kern, D., Englebienne, G., & Seifert, C. (2022) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3495013 · Cited by 144
Kliegr, T., Bahník, Š., & Fürnkranz, J. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103458 · Cited by 139
Visual, textual or hybrid: the effect of user expertise on different explanations
Szymanski, M., Millecamp, M., & Verbert, K. (2021) · 26th International Conference on Intelligent User Interfaces · doi:10.1145/3397481.3450662 · Cited by 131
Human Reliance on Machine Learning Models When Performance Feedback is Limited: Heuristics and Risks
Lu, Z., & Yin, M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445562 · Cited by 131
Suresh, H., Gomez, S. R., Nam, K. K., & Satyanarayan, A. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445088 · Cited by 117
Suresh, H., Gomez, S. R., Nam, K. K., & Satyanarayan, A. (2021) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 103
Operationalizing Human-Centered Perspectives in Explainable AI
Ehsan, U., Wintersberger, P., Liao, Q. V., Mara, M., Streit, M., Wachter, S., Riener, A., & Riedl, M. O. (2021) · Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411763.3441342 · Cited by 97
User Trust Dynamics: An Investigation Driven by Differences in System Performance
Yu, K., Berkovsky, S., Taib, R., Conway, D., Zhou, J., & Chen, F. (2017) · Proceedings of the 22nd International Conference on Intelligent User Interfaces · doi:10.1145/3025171.3025219 · Cited by 90
Theoretical considerations and development of a questionnaire to measure trust in automation
Körber, M. (2018) · doi:10.31234/osf.io/nfc45 · Cited by 71
Behavioral Measurement of Trust in Automation: The Trust Fall
Miller, D., Johns, M., Mok, B., Gowda, N., Sirkin, D., Lee, K., & Ju, W. (2016) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931213601422 · Cited by 71
What Are People Doing About XAI User Experience? A Survey on AI Explainability Research and Practice
Ferreira, J. J., & Monteiro, M. S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-49760-6_4 · Cited by 68
Gutzwiller, R. S., Chiou, E. K., Craig, S. D., Lewis, C. M., Lematta, G. J., & Hsiung, C.-P. (2019) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181319631201 · Cited by 54
Towards an empirically developed scale for system trust: Take two
Spain, R. D., Bustamante, E. A., & Bliss, J. P. (2008) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120805201907 · Cited by 47
Automated Rationale Generation: A Technique for Explainable AI and its Effects on Human Perceptions
Ehsan, U., Tambwekar, P., Chan, L., Harrison, B., & Riedl, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.03729 · Cited by 42
“Interfaces for explanations in human-AI interaction: proposing a design evaluation approach,”
Mucha, H., Robert, S., Breitschwerdt, R., & Fellmann, M. (2021) · Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411763.3451759 · Cited by 30
Banks, V., Shaw, E., & Large, D. R. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-96074-6 · Cited by 26
People's Judgments of Human and Robot Behaviors: A Robust Set of Behaviors and Some Discrepancies
de Graaf, M. M. A., & Malle, B. F. (2018) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3173386.3177051 · Cited by 24
“The impact of explanation dialogues on human-computer trust,”
Nothdurft, F., Heinroth, T., & Minker, W. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-39265-8_7 · Cited by 22
Trust and Reliance in XAI -- Distinguishing Between Attitudinal and Behavioral Measures
Scharowski, N., Perrig, S. A. C., von Felten, N., & Brühlmann, F. (2022) · arXiv · doi:10.48550/arxiv.2203.12318 · Cited by 18
Self-citationTowards an empirically developed scale for system trust: Take two: (578262012-007)
Spain, R. D., Bustamante, E. A., & Bliss, J. P. (2008) · PsycEXTRA Dataset · doi:10.1037/e578262012-007
Research works printed but not linked: 5
- 2022, “ACM conference on fairness, accountability, and transparency 2022 (ACM FAccT 2022) call for papers,”
- Biran, 2017, “Explanation and justification in machine learning: a survey,”, 8
- 2016, Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the Protection of Natural Persons With Regard to the Processing of Personal Data and on the Free Movement of Such Data, and Repealing Directive 95/46/EC (General Data Protection Regulation)
- Hartmann, 2020, Vertrauen - Die unsichtbare Macht
- Solso, 2005, Cognitive Psychology
Cited by
Patient Consent and The Right to Notice and Explanation of AI Systems Used in Health Care
Hurley, M. E., Lang, B. H., Kostick-Quenet, K. M., Smith, J. N., & Blumenthal-Barby, J. (2025) · The American Journal of Bioethics · doi:10.1080/15265161.2024.2399828 · Cited by 63
“Patient trust in an AI system may also differ due to its particular application and context, regardless of the quality of the explanation given (Scharowski et al. 2023).”
AIdeation: Designing a Human-AI Collaborative Ideation System for Concept Designers
Wang, W.-F., Lu, C.-T., Ponsa i Campanyà, N., Chen, B.-Y., & Chen, M. Y. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714148 · Cited by 50
“Through effective communication, iterative feedback, and user control, these systems create dynamic collaborations to enhance workflows [45, 91, 105].”
Baron, S. (2025) · Philosophy & Technology · doi:10.1007/s13347-024-00837-6 · Cited by 29
“As in the more general case of reliance, explainability can promote reliance on AI (see, e.g., Scharowski et al., 2023; Schemmer et al., 2023; Schoeffer et al., 2024).”
Torkamaan, H., Steinert, S., Pera, M. S., Kudina, O., Freire, S. K., Verma, H., Kelly, S., Sekwenz, M.-T., Yang, J., van Nunen, K., et al. (2024) · Behaviour and Information Technology · doi:10.1080/0144929x.2024.2431068 · Cited by 42
Eckhardt, S., Kühl, N., Dolata, M., & Schwabe, G. (2025) · ACM Computing Surveys · doi:10.1145/3776528 · Cited by 44
Metadata
- Authors
- Scharowski, N., Perrig, S. A. C., Svab, M., Opwis, K., & Brühlmann, F.
- Affiliations
- University of Basel (CH)
- Corresponding author
- Scharowski, Nicolas
- Venue
- Frontiers in Computer Science
- Publisher
- Frontiers Media SA
- Published
- 2023-07-17
- Volume
- 5
- ISSN
- 2624-9898 (ISSN-L)
- OpenAlex
- W4384524844
- Cited by
- 57
- References
- 97
- Citations by year
- 2026: 32 · 2025: 19 · 2024: 6
- FWCI
- 5.04
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Computer Science (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- OSF Preprints (OSF Preprints) (submittedVersion)
- Funders
- Universität Basel
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Keywords
- trust in AI, AI reliance, AI transparency, post-hoc explanation, feature importance, counterfactual explanations, subjective trust, heuristics and biases, trust metrics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-30, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-30 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.