CoChat

The Diagnostic Performance Feedback “Calibration Gap”: Why Clinical Experience Alone Is Not Enough to Prevent Serious Diagnostic Errors

Open access
Omron, Rodney, Kotwal, Susrutha, Garibaldi, Brian T., Newman‐Toker, David E. · 2018 · AEM Education and Training
Cited by 43

The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.

Abstract

Medical diagnostic errors can be thought of as the bottom of the iceberg of patient safety—a hidden yet vast source of morbidity and mortality. According to the U.S. National Academy of Medicine, diagnostic errors represent a major public health problem likely to affect each of us in our lifetime. Diagnostic errors contribute to approximately 10% of deaths and 6% to 17% of hospital adverse events and are the leading cause of medical malpractice claims. Although typically multifactorial, the majority of diagnostic errors can be traced back to failures in bedside examination skills and clinical reasoning; knowledge and skill gaps appear to play important roles that have been underestimated in the context of an overemphasis on cognitive bias as a cause. A critical unanswered question for educational strategies to improve diagnosis is how diagnostic errors could remain so common, even with clinical presentations seen daily in clinical practice. In theory, accumulated clinical experience gained over time should be an “antidote” that gradually eliminates misdiagnosis, but experimental studies suggest that more years of experience does not necessarily confer greater diagnostic accuracy. Part of the problem is that feedback is essential for improved diagnostic performance, but is often lacking. For example, it has been shown that some short-term deaths after discharge from the emergency department (ED) likely reflect missed diagnoses of life-threatening illnesses. Unfortunately, such feedback rarely returns to individual ED clinicians, which prevents “recalibration” (i.e., adjusting one’s own mental models for diagnosis based on real-world accuracy in prior similar cases) that would otherwise improve diagnostic performance. In this article we argue that, absent systematic feedback, even years of sustained clinical practice may not produce the necessary experiential learning to prevent critical diagnostic errors, particularly for high-risk, low-frequency conditions. As a representative case, take the known public health problem of missed stroke in patients presenting with acute dizziness to the ED, where 45,000 to 75,000 strokes are missed at first contact each year and an estimated 10,000 to 25,000 serious preventable harms result from missed opportunities for early treatment. Dizziness and vertigo are common problems, accounting for approximately 3% of all ED

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1002/aet2.10119

Cites

5 of 5 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 5 references

Cited by

Metadata

Authors
Omron, R., Kotwal, S., Garibaldi, B. T., & Newman‐Toker, D. E.
Venue
AEM Education and Training
Publisher
Wiley
Published
2018-09-17
Volume
2
Issue
4
Pages
339-342
ISSN
2472-5390 (ISSN-L)
OpenAlex
W2885214400
Cited by
43
References
5
FWCI
3.72
Type
journal article
Language
en
Open access
green

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.