Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index; 11 of the 25 sources its claims cite were checked for support.

Enhancing Clinician Trust in AI Diagnostics: A Dynamic Framework for Confidence Calibration and Transparency

Open access

Abstract

Background: Artificial Intelligence (AI)-driven Decision Support Systems (DSSs) promise improvements in diagnostic accuracy and clinical workflow efficiency, but their adoption is hindered by inadequate confidence calibration, limited transparency, and poor alignment with real-world decision processes, which limit clinician trust and lead to high override rates. Methods: We developed and validated a dynamic scoring framework to enhance trust in AI-generated diagnoses by integrating AI confidence scores, semantic similarity measures, and transparency weighting into the override decision process using 6689 cardiovascular cases from the MIMIC-III dataset. Override thresholds were calibrated and validated across varying transparency and confidence levels, with override rate as the primary acceptance measure. Results: The implementation of this framework reduced the override rate to 33.29%, with high-confidence predictions (90–99%) overridden at a rate of only 1.7%, and low-confidence predictions (70–79%) at a rate of 99.3%. Minimal transparency diagnoses had a 73.9% override rate compared to 49.3% for moderate transparency. Statistical analyses confirmed significant associations between confidence, transparency, and override rates (p < 0.001). Conclusions: These findings suggest that enhanced transparency and confidence calibration can substantially reduce override rates and promote clinician acceptance of AI diagnostics. Future work should focus on clinical validation to optimize patient safety, diagnostic accuracy, and efficiency.

Overview

CoChat Summary

TL;DR

The paper proposes a dynamic scoring framework combining LLM confidence, semantic similarity, transparency, and diagnosis length to calibrate when clinicians should accept or override AI-generated cardiovascular diagnoses. In 6,689 MIMIC-III cases, it reduced override rates from 87.64% to 33.29%, with high-confidence and higher-transparency outputs overridden far less often.

Key findings

  • Overall override rate was 33.29% (2,227/6,689), a reduction from an initial 87.64% before systematic parameter adjustments.
  • Confidence was strongly graded: 70–79% confidence had a 99.3% override rate (147/148), 80–89% had 48.1% (2,040/4,243), and 90–99% had 1.7% (390/2,298).
  • Transparency was inversely related to overrides: minimal transparency 73.9% (99/157), moderate transparency 49.3% (1,631/3,307), and high confidence 14.9% (495/3,325); χ² = 991.01, p < 0.0001, Cramér’s V = 0.40.
  • Interaction analysis showed confidence was dominant; at moderate confidence, overrides fell with transparency from 55.4% (minimal) to 49.9% (moderate) to 42.3% (high explainability with high confidence), and high explainability plus 90–99% confidence produced the lowest override rates.

Methods

  • Retrospective cohort from MIMIC-III: 6,689 adult cardiovascular disease cases (≥18 years) with at least one discharge summary, identified by ICD-9 codes for ischemic heart disease, heart failure, arrhythmias, cardiomyopathies, valvular heart disease, and hypertensive heart disease.
  • AI diagnoses were generated by off-the-shelf Qwen 2.5 (temperature 0.1, top-p 0.9, max 256 tokens) and compared with true diagnoses using exact string matching and Universal Sentence Encoder semantic similarity; confidence was model-reported from 70–99%, transparency was self-rated as low/moderate/high, and length scored 1.0 for 30–100 characters or 0.7 otherwise.
  • The composite score was Sfinal = wc×Sconf + ws×Ssim + wl×Slen, with transparency-specific weights and thresholds; override occurred if Sfinal fell below threshold. Analysis used override rates, chi-square tests, Tukey HSD pairwise comparisons, and Cramér’s V.

Limitations

  • Stated by the paper: transparency relied on AI self-ratings rather than human expert evaluations; the retrospective MIMIC-III design limits generalizability; the scoring system’s complexity may challenge real-time implementation and increase latency; cardiovascular-specific MIMIC-III data may introduce domain bias; and the work was a proof-of-concept without real-time adaptive calibration.
  • Evident from the text: there was no prospective clinical validation, no external multi-institutional validation, no human transparency ratings, and no measurement of response timing or latency.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.3390/diagnostics15172204

Cites

35 of 35 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Schematic diagram illustrating the process of computing AI-generated diagnoses (AIDx) and comparing them with human physician diagnoses (hDx). The diagram depicts the end-to-end workflow, including data retrieval, filtering and preprocessing, AI diagnosis generation, and the evaluation of alignment with clinician-verified diagnoses (Dx). The evidence-based scoring system combines confidence (wconf), similarity (Ssim), and length (Slen) to generate the final compound confidence scores to determine whether AIDx is trustworthy or not.
Figure 1 Schematic diagram illustrating the process of computing AI-generated diagnoses (AIDx) and comparing them with human physician diagnoses (hDx). The diagram depicts the end-to-end workflow, including data retrieval, filtering and preprocessing, AI diagnosis generation, and the evaluation of alignment with clinician-verified diagnoses (Dx). The evidence-based scoring system combines confidence (wconf), similarity (Ssim), and length (Slen) to generate the final compound confidence scores to determine whether AIDx is trustworthy or not.CC BY · PubMed Central
Figure 2 Bar plot showing Override Rate (%) by Confidence Range.
Figure 2 Bar plot showing Override Rate (%) by Confidence Range.CC BY · PubMed Central

Verification

Claims the paper makes

6 Valid · 3 Not valid · 10 Not checked · 57 Own results and interpretations

40 more claims

Create a free account to see all 76 claims and to verify the 1 reference still open.

See all claims — free account
  • Probably not a substantial claim. 14
  • It may state two separate claims as one. 22
  • The quote only partly states this claim. 3

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

3 of 3

Citations

Cites

Show all 32 references

Research works printed but not linked: 1

  1. Guo, C., Pleiss, G., Sun, Y., and Weinberger, K.Q. (2017, January 6–11). On calibration of modern neural networks. Proceedings of the International Conference on Machine Learning, Sydney, Australia.

Cited by

See all 32

Metadata

Authors
Yu, Y., Gomez-Cabello, C. A., Haider, S. A., Genovese, A., Prabha, S., Trabilsy, M., Collaco, B. G., Wood, N. G., Bagaria, S., Tao, C., & Forte, A. J.
Affiliations
  • Zyter|TruCare, Rockville, MD 20852, USA
  • Mayo Clinic in Florida (US)
  • Division of Plastic Surgery, Mayo Clinic, Jacksonville, FL 32224, USA
  • Mayo Clinic (US)
Corresponding author
Forte, Antonio J.
Venue
Diagnostics
Publisher
MDPI AG
Published
2025-08-30
Volume
15
Issue
17
Pages
2204
ISSN
2075-4418 (ISSN-L)
OpenAlex
W4413880252
Cited by
32
References
32
Citations by year
2026: 30 · 2025: 2
FWCI
7.70
Type
journal article
Language
en
Open access
Locations
  • Diagnostics (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • PubMed Central (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
Keywords
AI diagnostics, clinician trust, confidence calibration, decision support system, semantic similarity, MIMIC-III

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Enhancing Clinician Trust in AI Diagnostics: A Dynamic Framework for Confidence Calibration and Transparency. https://app.cochat.ai/papers/10.3390/diagnostics15172204
The paper
Yu, Y., Gomez-Cabello, C. A., Haider, S. A., Genovese, A., Prabha, S., Trabilsy, M., Collaco, B. G., Wood, N. G., Bagaria, S., Tao, C., & Forte, A. J. (2025). Enhancing Clinician Trust in AI Diagnostics: A Dynamic Framework for Confidence Calibration and Transparency. Diagnostics. https://doi.org/10.3390/diagnostics15172204

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.