Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 90 of the 90 references it cites were found in a registry or an index; none of the 83 sources its claims cite is checked for support yet.

Are numerical or verbal explanations of AI the key to appropriate user reliance and error detection?

Open access
Papenkordt, Jörg, Ngonga Ngomo, Axel-Cyrille, Thommes, Kirsten · 2026 · Behaviour & Information Technology

Abstract

Advances in AI and our limited human capabilities have made AI decision-making opaque to humans. One prerequisite for enhancing the transparency of AI recommendations is improving AI explainability as humans need to be enabled to take responsibility for their actions even with AI support. Our study aims to tackle this issue by investigating two basic approaches to explainability: We evaluate numerical explanations, such as certainty measures, against verbal explanations, such as those provided by LLM as explanatory agents. Specifically, we examine whether verbal or numerical (or both) explanations in tasks of high uncertainty lure users into false beliefs or, on the contrary, promote appropriate reliance. Drawing on an experiment with 441 participants, we explore the dynamics of non-expert users' interactions with AI under varying explanatory conditions. Results show that explanations significantly improve reliance and decision accuracy. Numerical explanations aid in identifying uncertainties and errors, but the users' reliance on the advice falls far behind the given numerical certainty. Verbal explanations foster higher reliance while increasing the risk of over-reliance. Combining both explanation types enhances reliance but further amplifies blind trust in AI.

Overview

CoChat Summary

TL;DR

In an online experiment with 441 participants, the authors compared numerical certainty values, verbal (LLM-style) explanations, both, or neither as explanations for AI recommendations on ten classification tasks. Explanations increased reliance and accuracy overall, but only numerical explanations helped users detect an AI error, while verbal and combined explanations fostered over-reliance.

Key findings

  • AI support improved accuracy: participants solved 47.69% of tasks correctly without AI, and every explanation condition significantly improved correct classifications; tasks where the AI reported 100% certainty were answered correctly 70.21% of the time even without AI, versus 36.28% (66% tasks) and 39.24% (83% tasks).
  • Reliance did not track stated certainty: 64.49% followed a 66%-certainty recommendation and 67.61% followed an 83% one (difference not significant, Fisher's exact p > .100), rising to 82.65% at 100% certainty (p = .000); about 20% of 100%-certainty tasks were answered without relying on the AI.
  • All explanation types increased reliance relative to the no-explanation control, but only the numerical and combined groups showed a significant positive effect on correct classifications; the AI's error (task 4) was repeated significantly less often in the numerical-only group than in the combined group (Fisher's exact p < .005).
  • 4.66% of participants (15) relied on every recommendation (8 in combined, 5 verbal, 2 numerical), and 0.31% (1 participant) rejected every recommendation; the AI's error had no lasting effect on reliance in any group.

Methods

  • Online between-subjects experiment: 441 participants (119 baseline with no AI, 322 in the AI experiment), randomly assigned in a 2×2 design varying numerical certainty (yes/no) and verbal explanation (yes/no), plus a control receiving advice without explanation. Participants completed ten timed (30-second) classification tasks with monetary incentives (0.4 € per correct answer, max 4 €); one AI recommendation (task 4) was intentionally wrong.
  • The AI was a white-box class expression learner (Drill) applied to DBpedia using description logic, producing a prediction-accuracy score used as the numerical explanation (66%, 83%, or 100%) and manually written factual verbal explanations (Wizard-of-Oz).
  • Analysis used Fisher exact tests for group comparisons, ordered probit models for between-subject variation, and probit models for within-subject (task-level) variation, with 3,105 decisions analysed (115 timeouts treated as missing).

Limitations

  • Stated by the authors: a convenience-based, self-selected online sample means external validity cannot be assumed; findings may be artifact-specific; only local explanations were studied, leaving global explanations unobserved; verbal explanations were created manually rather than by a real LLM; and the built-in error in the fourth of ten tasks is artificial in procedure and timing.
  • Evident from the text: the AI was correct in 90% of recommendations, so verbal explanations' association with more correct classifications is partly a function of that high base accuracy; the authors also note that "forced reliance" (users having no better option on difficult tasks) may be mistaken for trust, which their design cannot fully disentangle.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1080/0144929x.2025.2568928

Cites

90 of 90 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

0 Valid · 0 Not valid · 55 Not checked · 106 Own results and interpretations

65 more claims

Create a free account to see all 161 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 60
  • It may state two separate claims as one. 50
  • The quote only partly states this claim. 1

Create a free account to see these claims.

Citations

Cites

Show all 82 references

Research works printed but not linked: 6

  1. 10.1002/for.v1:3 · doi:10.1002/for.v1:3
  2. De Graaf M. M. and B. F. Malle. 2017. “How People Explain Action (and Autonomous Intelligent Systems Should Too).” In 2017 AAAI Fall Symposium Series. Arlington Virginia USA: AI Access Foundation.
  3. 10.1111/risk.2005.25.issue-3 · doi:10.1111/risk.2005.25.issue-3
  4. 10.1146/statistics.2013.1.issue-1 · doi:10.1146/statistics.2013.1.issue-1
  5. Jussupow E. I. Benbasat and A. Heinzl. 2020. “Why Are We Averse towards Algorithms? A Comprehensive Literature Review on Algorithm Aversion.” In Proceedings of the 28th European Conference on Information Systems (ECIS) 1–16. Marrakech Morocco: AISeL.
  6. van Harmelen F. V. Lifschitz and B. W. Porter eds. 2008. Handbook of Knowledge Representation Vol. 3 of Foundations of Artificial Intelligence. San Diego Californien USA: Elsevier.

Cited by

See all 2

Metadata

Authors
Papenkordt, J., Ngonga Ngomo, A.-C., & Thommes, K.
Affiliations
  • Paderborn University (DE)
  • Paderborn University, Paderborn
Corresponding author
Papenkordt, Jörg
Venue
Behaviour & Information Technology
Published
2025-10-13
Volume
45
Issue
10
Pages
2094-2115
ISSN
  • 0144-929X (ISSN-L)
  • 1362-3001
OpenAlex
W4415102320
Cited by
2
References
82
Citations by year
2026: 2
FWCI
0.80
Type
journal article
Language
en
Open access
Locations
Behaviour and Information Technology (publishedVersion, cc-by)
Funders
  • German Federal Ministry of Research, Technology and Space (02L19C115)
  • German Research Foundation (438445824)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
Keywords
explainable AI, verbal explanation, large language models, error detection, trust in AI, non-expert users, decision accuracy, AI transparency

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-10-27, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-27 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Are numerical or verbal explanations of AI the key to appropriate user reliance and error detection? https://app.cochat.ai/papers/10.1080/0144929x.2025.2568928
The paper
Papenkordt, J., Ngonga Ngomo, A.-C., & Thommes, K. (2026). Are numerical or verbal explanations of AI the key to appropriate user reliance and error detection? Behaviour & Information Technology. https://doi.org/10.1080/0144929x.2025.2568928

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.