Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.

Calibrating Reliance on Automated Advice: Transparency and Trust Calibration Feedback

Open access
Tatasciore, Monica, Loft, Shayne · 2025 · International Journal of Human–Computer Interaction

Abstract

Inappropriate reliance on automated advice can result in humans accepting incorrect or rejecting correct advice. Increased automation transparency and trust calibration feedback are principles purported to promote accurate automation use. We examined the effects of automation transparency, trust calibration feedback, and their potential interacting effect on automation use accuracy and other outcomes. Participants completed uninhabited vehicle management missions by agreeing/disagreeing with automated advice. Transparency was manipulated within-subjects (low, high) and trust calibration feedback between-subjects (absent, present). If trust was inappropriate, trust calibration feedback instructed participants to take their time and carefully check display information. Higher transparency benefited automation use accuracy, decision time, perceived workload, trust, and usability. Trust calibration feedback had no benefit on automation use accuracy and subsequently did not amplify the benefits of increased transparency. These findings have potential implications to inform the design of automated decision aids to support human understanding of, and calibration to, automation capabilities.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1080/10447318.2025.2487861

Cites

61 of 61 references verified0 citation errors · 0 not checkable

Statistics

Figures

Image 1
CC-BY-NC-ND · From the PDF
Image 2
CC-BY-NC-ND · From the PDF
Image 3
CC-BY-NC-ND · From the PDF
Image 4
CC-BY-NC-ND · From the PDF
Figure 2 Example feedback screen when trust calibration feedback was absent. Note: In this example, the automated advice (recommendation) and human decision were correct and represented by the green ticks. When the automated advice or human decision were incorrect a red cross was instead presented. Feedback presentation was identical regardless of whether low or high trans­ parency was provided.
Figure 2 Example feedback screen when trust calibration feedback was absent. Note: In this example, the automated advice (recommendation) and human decision were correct and represented by the green ticks. When the automated advice or human decision were incorrect a red cross was instead presented. Feedback presentation was identical regardless of whether low or high trans­ parency was provided.CC-BY-NC-ND · From the PDF
Image 6
CC-BY-NC-ND · From the PDF
Image 7
CC-BY-NC-ND · From the PDF
(b) Trust appropriate, correctly disagreed
(b) Trust appropriate, correctly disagreedCC-BY-NC-ND · From the PDF
(d) Trust inappropriate, incorrectly disagreed
(d) Trust inappropriate, incorrectly disagreedCC-BY-NC-ND · From the PDF

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 59 references

Research works printed but not linked: 4

  1. 10.1037/0033-2909.98.1.185 · doi:10.1037/0033-2909.98.1.185 · Paper page
  2. Riley, V. (1996). Operator reliance on automation: Theory and data. In R. Parasuraman & M. Mouloua (Eds.), Automation and human performance: Theory and applications (pp. 19–35). Lawrence Erlbaum Associates, Inc.
  3. Stein, E. S. (1985). Air traffic controller workload: An examination of workload probe (No. DOT/FAA/CT-TN84/24). Department of Transportation, Federal Aviation Administration, William J. Hughes Technical Center.
  4. 10.1177/1555343424124055 · doi:10.1177/1555343424124055

Cited by

See all 20

Metadata

Authors
Tatasciore, M., & Loft, S.
Affiliations
School of Psychological Science, The University of Western
Corresponding author
  • Tatasciore, Monica
  • Loft, Shayne
Venue
International Journal of Human–Computer Interaction
Published
2025-04-16
Volume
41
Issue
23
Pages
14723-14733
ISSN
  • 1044-7318 (ISSN-L)
  • 1532-7590
OpenAlex
W4409511947
Cited by
20
References
59
Citations by year
2026: 16 · 2025: 4
FWCI
22.16
Type
journal article
Language
en
Open access
Locations
  • International Journal of Human-Computer Interaction (publishedVersion, cc-by-nc-nd)
  • UWA Profiles and Research Repository (UWA) (publishedVersion, cc-by-nc-nd)
Funders
Australian Research Council Future Fellowship (2)
Topics
  • Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
  • Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
Keywords
automation transparency, automated decision aids, trust in automation, decision time, perceived workload, usability, human-automation interaction

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Calibrating Reliance on Automated Advice: Transparency and Trust Calibration Feedback. https://app.cochat.ai/papers/10.1080/10447318.2025.2487861
The paper
Tatasciore, M., & Loft, S. (2025). Calibrating Reliance on Automated Advice: Transparency and Trust Calibration Feedback. International Journal of Human–Computer Interaction. https://doi.org/10.1080/10447318.2025.2487861

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.