The DOI matches its Crossref record; 89 of the 89 references it cites were found in a registry or an index; 29 of the 53 sources its claims cite were checked for support.
Investigating appropriate reliance on AI-Based decision support systems: the role of expertise, trust, and self-confidence
Open accessAbstract
Achieving appropriate reliance on AI-based decision support systems (DSS) is a central challenge in human-AI decision-making. Both over-reliance and under-reliance can impair decision quality, underscoring the need to understand the psychological factors guiding reliance behaviour. This study examines how expertise, trust, and self-confidence relate to appropriate reliance within an AI-based DSS. Using structural equation modelling with data from 529 chess players with varying expertise-levels, we analysed direct, mediated, and moderated relationships among these factors. Results revealed no over-reliance, reflecting participants’ preference for self-reliance. Expertise was positively related to self-confidence and negatively related to trust, corresponding with a more critical stance toward AI advice. Trust was associated with reliance on accurate AI recommendations, whereas self-confidence was related to reliance on one’s own correct decisions. These findings support a relational framework linking user characteristics to behavioural reliance and inform the design of adaptive, explainable DSS that promote calibrated trust and effective decision-making.
Overview
CoChat Summary
TL;DR
This study models how expertise, trust, and self-confidence relate to appropriate reliance on an AI-based decision support system in chess. Using SEM with 529 chess players, it finds expertise is linked to lower trust and higher self-confidence, with trust mainly supporting reliance on correct AI advice and self-confidence supporting reliance on one’s own correct decisions.
Key findings
- No over-reliance was observed: negative AI-reliance was rare (0.77% of cases), while negative self-reliance occurred frequently (13.22%), reflecting a preference for self-reliance.
- Expertise positively predicted self-confidence (β = 0.663, p < .001) and negatively predicted trust (β = -0.524, p < .001); expertise also positively predicted RSR (β = 0.544, p < .001) but not RAIR (β = 0.039, p = .532).
- Trust positively predicted RAIR (β = 0.233, p < .001) and negatively predicted RSR (β = -0.087, p = .023); self-confidence positively predicted RSR (β = 0.110, p = .010) but did not significantly predict RAIR (β = -0.066, p = .245).
- Trust fully mediated the expertise–RAIR relationship (indirect β = -0.122, p < .001) and partially mediated expertise–RSR (indirect β = 0.046, p = .026); self-confidence partially mediated expertise–RSR (indirect β = 0.073, p = .011). The model explained 45.4% of RSR variance, 5.8% of RAIR variance, 31.2% of trust variance, and 44% of self-confidence variance.
Methods
- Online mixed within-between-subjects experiment conducted via SoSciSurvey between 26 September and 15 October 2024; final analytic sample N = 529 chess players after exclusions, recruited via Prolific and chess clubs/forums/newsletters.
- Expertise was measured continuously via 10 chess puzzles; reliance behaviour was assessed across 12 additional puzzles with GambitAI advice, where 4 of 12 recommendations were deliberately incorrect, yielding 67% system accuracy.
- Structural equation modelling in R (lavaan) tested direct, mediated, and moderated relationships among expertise, trust, self-confidence, RAIR, and RSR, with z-standardised variables, bootstrapping (1,000 resamples), and five-fold cross-validation.
Limitations
- The paper states the online design limited control over participants’ environments, and participants saw the same puzzles twice, potentially introducing learning effects or delayed insights.
- The paper notes the one-minute puzzle time limit may have added unmeasured time pressure, and the AI’s low 67% accuracy likely encouraged cautious engagement and limits generalisability to higher-reliability settings.
- The paper states age and years of chess experience were not included in the model, SEM relationships are correlational, and the low-stakes chess paradigm may limit generalisability to high-stakes or collaborative domains.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures









Verification
Claims the paper makes
24 Valid · 2 Not valid · 22 Not checked · 115 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Micocci et al. (2021) found that inexperienced general practitioners accepted incorrect AI advice more often than their experienced counterparts.”
§ Investigating appropriate reliance on AI-Based decision support systems: the role of expertise, trust, and self-confidence > Expertise
What the sources say
- Partly supportedcites Micocci et al., 2021 sourceExperimental — accuracy not yet measured
In Results §3.3 (page unavailable), GPs who regularly used a dermatoscope or were more confident in dermatology were better at rejecting erroneous AI advice. The Discussion suggests that lack of task-specific experience or domain knowledge may contribute to adherence, but the paper does not establish that GPs with fewer years of general practice accepted incorrect advice more often than more experienced GPs. (LLM, conf=0.86)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“On the practitioner side (Harada et al., 2021), observed that clinicians erred more often due to under-reliance than over-reliance when utilising AI decision support.”
§ Investigating appropriate reliance on AI-Based decision support systems: the role of expertise, trust, and self-confidence > Appropriate reliance
What the sources say
- Supportedcites Harada et al., 2021 source
The Results (§3.3; page unavailable) define the relevant comparison as the prevalence of omission versus commission errors. Omission errors—rejecting a correct AI suggestion—had a slightly higher rate than commission errors—accepting an incorrect suggestion (15.9% versus 14.8%). These are rates with different denominators, not a comparison of raw error counts. (LLM, conf=0.84)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Nourani et al. (2020) showed that novices were prone to over-reliance due to limited error- detection skills.”
§ Investigating appropriate reliance on AI-Based decision support systems: the role of expertise, trust, and self-confidence > Expertise
What the sources say
- Supportedcites Nourani et al., 2020 source
The Abstract states that novice users suffered from over-reliance because they lacked the knowledge to detect errors. Section 5.1 likewise reports that novices over-trusted the low-accuracy system and were prone to trusting it because they could not detect errors. (LLM, conf=0.94)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Regarding reliance, Choung et al. (2023) demonstrated that trust significantly influences reliance intentions and Kahr et al. (2024) found that trust and reliance on AI advice were significantly higher when the AI model was highly accurate and that trust increased over repeated interactions.”
§ Investigating appropriate reliance on AI-Based decision support systems: the role of expertise, trust, and self-confidence > Trust
What the sources say
- Partly supportedcites Choung et al., 2023 sourceExperimental — accuracy not yet measured
The results near Table 4 report a statistically significant total effect of trust perception on intention to use AI technologies. The paper measures usage intention, not specifically intention to rely on AI advice, and its Limitations section says the correlational models cannot establish a causal effect. (LLM, conf=0.85)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Although no dedicated attention checks were included, inattentive responses were improbable given the precision required for entering valid chess moves and the targeted recruitment of chess-interested individuals (Ward & Meade, 2023).”
§ Investigating appropriate reliance on AI-Based decision support systems: the role of expertise, trust, and self-confidence > Procedure
What the sources say
- Partly supportedcites Ward & Meade, 2023 sourceExperimental — accuracy not yet measured
The sections “When Careless Responding Is Likely to Be a Problem” and “Context” identify lack of interest as a risk factor for careless responding, which lends some support to the rationale for recruiting chess-interested participants. They do not address chess moves or establish that inattentive responses were improbable in this study. “Minimal Screening” also recommends screening for careless responses; page numbers are unavailable in our copy. (LLM, conf=0.85)
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
76 more claims · 3 with their cited sources checked
Create a free account to see all 163 claims and every source verdict.
- It may state two separate claims as one. 59
- Probably not a substantial claim. 32
- The quote only partly states this claim. 1
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Consistentr(529) = 0.884reported p < .001 · recomputed p < .001
“r (529) = .884,p < .001”
- Consistentr(529) = 0.737reported p < .001 · recomputed p < .001
“r (529) = .737,p < .001”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Investigating appropriate reliance on AI-Based decision support systems: the role of expertise, trust, and self-confidence > Mediation and moderation effects
“The interaction between expertise and propensity to trust technology significantly moderated the effect of expertise on trust (β = -0.126,p < .001).”
§ Investigating appropriate reliance on AI-Based decision support systems: the role of expertise, trust, and self-confidence > Mediation and moderation effects
“This suggests that individuals with a higher propensity to trust technology exhibit a weaker negative relationship between expertise and trust.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Investigating appropriate reliance on AI-Based decision support systems: the role of expertise, trust, and self-confidence > Participants
“Participants were recruited via the online platform Prolific (n = 476) and through chess clubs, forums, and newsletters (n = 274).”
§ Investigating appropriate reliance on AI-Based decision support systems: the role of expertise, trust, and self-confidence > Participants
“After exclusions for incomplete responses (n = 16), zero performance on the expertise task (n = 180), or extreme completion times exceeding one standard deviation from the median (n = 24), the final analytic sample comprised N = 529 (300 from Prolific, 229 from other sources).”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Investigating appropriate reliance on AI-Based decision support systems: the role of expertise, trust, and self-confidence > Self-confidence
“To obtain an overall self-confidence score, the mean was calculated across all responses (M = 4.40, SD = 2.80).”
§ Investigating appropriate reliance on AI-Based decision support systems: the role of expertise, trust, and self-confidence > Self-confidence
“These statements were rated on a 5-point Likert scale from strongly disagree (1) to strongly agree (5).”
Citations
Cites
An integrative model of organizational trust
Mayer, R. C., Davis, J. H., & Schoorman, F. D. (1995) · The Academy of Management Review · doi:10.2307/258792 · Cited by 10,736
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 7×
“When perceived system competence falls below a critical threshold, users generally adjust by relying more on their own judgement (Lee & See, 2004), which aligns with the present findings.”
InfluentialHumans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554 · cited 12×
“Regarding individual differences, Parasuraman and Riley (1997) identified user expertise, self-confidence and trust in the system as critical determinants of reliance on automated decision support.”
InfluentialWolf, E. J., Harrington, K. M., Clark, S. L., & Miller, M. W. (2013) · Educational and Psychological Measurement · doi:10.1177/0013164413495237 · Cited by 3,931 · cited 1×
“As noted by Wolf et al. (2013), model complexity and indicator count influence SEM sample adequacy, and models with multiple indicators per construct, such as in this study, provide sufficient parameter estimation efficiency at slightly lower sample sizes.”
The trouble with overconfidence.
Moore, D. A., & Healy, P. J. (2008) · Psychological Review · doi:10.1037/0033-295x.115.2.502 · Cited by 2,358
Algorithm appreciation: People prefer algorithmic to human judgment
Logg, J. M., Minson, J. A., & Moore, D. A. (2019) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2018.12.005 · Cited by 2,061 · cited 3×
“…research has identified expertise, trust, and self-confidence as key determinants of human interaction with automation (Chong et al., 2022; Choung et al., 2023; Logg et al., 2019), these factors have typically been examined in isolation rather than as part of an integrated decision-making process.”
Trust, control strategies and allocation of function in human-machine systems
LEE, J., & MORAY, N. (1992) · Ergonomics · doi:10.1080/00140139208967392 · Cited by 1,459 · cited 1×
“Conversely, reliable systems may be underutilised if deemed untrustworthy (Lee & Moray, 1992; Muir, 1987).”
The role of trust in automation reliance
Dzindolet, M. T., Peterson, S. A., Pomranky, R. A., Pierce, L. G., & Beck, H. P. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00038-7 · Cited by 1,276 · cited 2×
“…even when advice is incorrect, while under-reliance describes relying on automated advice too little, ignoring advice even when it’s correct, both of which can lead to diminished task performance (Bussone et al., 2015; Dzindolet et al., 2003; Parasuraman et al., 1993; Skitka et al., 2000).”
Automation bias: a systematic review of frequency, effect mediators, and mitigators
Goddard, K., Roudsari, A., & Wyatt, J. C. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000089 · Cited by 1,162 · cited 17×
“In the conclusion of their systematic review, Goddard et al. (2012) propose that expertise may act on primary drivers to influence reliance on DSS, with those primary drivers being trust and confidence, again emphasising that expertise likely plays an indirect role on reliance behaviour.”
InfluentialBuçinca, Z., Malaya, M. B., & Gajos, K. Z. (2021) · arXiv · doi:10.48550/arxiv.2102.09692 · Cited by 1,124 · cited 3×
“…trust is central to understanding reliance on AI, it is prudent to also account for the propensity to trust technology, which can be crucial for trust-development (Lee & See, 2004; Schaefer et al., 2014) and is closely linked to trust-related behaviour (Buçinca et al., 2021; Küper & Krämer, 2024).”
Cited by
Luong, A., Kumar, N., & Lang, K. R. (2026) · Information & Management · doi:10.1016/j.im.2026.104384 · Cited by 7
Matschak, T., Nastjuk, I., Trang, S. T.-N., & Benitez, J. (2026) · Decision Support Systems · doi:10.1016/j.dss.2026.114721 · Cited by 2
“Instead, we contribute to the emerging body of literature that examines decision contexts with fallible AI and emphasizes calibrated reliance [2,19].”
Prompting strategies with generative AI during learning from multiple sources
Kim, S., & McCrudden, M. T. (2026) · Learning and Instruction · doi:10.1016/j.learninstruc.2026.102435 · Cited by 3
Trust Over Creepiness: AI Chatbot Perceptions in Balkan Countries
Galjak, M., & Budić, M. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2638548
“The question of AI adoption is not only whether users trust the system, but whether that trust is resilient enough to withstand errors and whether it leads to appropriate reliance rather than blind dependence (Dogru & Krämer, 2025).”
Claude, A. (2026) · Lecture notes in business information processing · doi:10.1007/978-3-032-27997-2_25
Metadata
- Authors
- Dogru, E. Ö., & Krämer, N. C.
- Affiliations
- University of Duisburg-Essen (DE)
- Corresponding author
- Dogru, Enis Ömer
- Venue
- Journal of Decision Systems
- Publisher
- Informa UK Limited
- Published
- 2025-01-02
- Volume
- 34
- Issue
- 1
- ISSN
- 1246-0125 (ISSN-L)
- 2116-7052
- OpenAlex
- W4416774727
- Cited by
- 15
- References
- 87
- Citations by year
- 2026: 15
- FWCI
- 16.62
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of Decision System (publishedVersion, cc-by-nc-nd)
- Universitätsbibliographie, Universität Duisburg-Essen (submittedVersion)
- Funders
- DFG Research Training Group
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Social Sciences › Decision Sciences › Information Systems and Management › Technology Adoption and User Behaviour
- Keywords
- AI-based decision support systems, AI reliance, expertise, trust in AI, self-confidence, human-AI decision-making, chess players, explainable AI, adaptive decision support, trust calibration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-02, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-02 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Investigating appropriate reliance on AI-Based decision support systems: the role of expertise, trust, and self-confidence. https://app.cochat.ai/papers/10.1080/12460125.2025.2593251
- The paper
- Dogru, E. Ö., & Krämer, N. C. (2025). Investigating appropriate reliance on AI-Based decision support systems: the role of expertise, trust, and self-confidence. Journal of Decision Systems. https://doi.org/10.1080/12460125.2025.2593251
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.