The DOI matches its Crossref record; 34 of the 36 references it cites were found in a registry or an index.
Do physicians know when their diagnoses are correct?: Implications for decision support and error reduction
Open accessAbstract
Objective This study explores the alignment between physicians' confidence in their diagnoses and the "correctness" of these diagnoses, as a function of clinical experience, and whether subjects were prone to over-or underconfidence.Design Prospective, counterbalanced experimental design.Setting Laboratory study conducted under controlled conditions at three academic medical centers.Participants Seventy-two senior medical students, 72 senior medical residents, and 72 faculty internists.Intervention We created highly detailed, 2-to 4-page synopses of 36 diagnostically challenging medical cases, each with a definitive correct diagnosis. Subjects generated a differential diagnosis for each of 9 assigned cases, and indicated their level of confidence in each diagnosis.Measurements and main results A differential was considered "correct" if the clinically true diagnosis was listed in that subject's hypothesis list. To assess confidence, subjects rated the likelihood that they would, at the time they generated the differential, seek assistance in reaching a diagnosis. Subjects' confidence and correctness were "mildly" aligned (kappa=.314 for all subjects, .285 for faculty, .227 for residents, and .349 for students). Residents were overconfident in 41% of cases where their confidence and correctness were not aligned, whereas faculty were overconfident in 36% of such cases and students in 25%.Conclusions Even experienced clinicians may be unaware of the correctness of their diagnoses at the time they make them. Medical decision support systems, and other interventions designed to reduce medical errors, cannot rely exclusively on clinicians' perceptions of their needs for such support.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“underconfident clinicians are likely to seek external information to validate and ensure their diagnostic accuracy [106,107], resulting in over testing and delays in decision making [108].”
From Toward Safer Diagnoses: A SEIPS-Based Narrative Review of Diagnostic Errors (2026) · cites this paper as [106]
In the citing paper
“and diagnostic difficulties persist despite practitioner experience and advances in diagnostic tests.23,24”
From Reducing Diagnostic Errors through Effective Communication: Harnessing the Power of Information Technology (2008) · cites this paper as [24]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810
Judgment under Uncertainty: Heuristics and Biases
Tversky, A., & Kahneman, D. (1975) · Utility, Probability, and Human Decision Making · doi:10.1007/978-94-010-1834-0_8 · Cited by 22,650
(2005) · Springer eBooks · doi:10.1007/0-387-27255-0_9 · Cited by 20,333
Longitudinal data analysis using generalized linear models
LIANG, K.-Y., & ZEGER, S. L. (1986) · Biometrika · doi:10.1093/biomet/73.1.13 · Cited by 18,550
Institute of Medicine (2000) · National Academies Press eBooks · doi:10.17226/9728 · Cited by 14,390
To Err is Human: Building a Safer Health System
Hendee, W. R. (2001) · Journal of Vascular and Interventional Radiology · doi:10.1016/s1051-0443(01)70072-3 · Cited by 10,129
Wall, A. (2000) · British Journal of Healthcare Management · doi:10.12968/bjhc.2000.6.9.19311 · Cited by 5,912
Applied Linear Regression Models
(1997) · Technometrics · doi:10.1080/00401706.1997.10485142 · Cited by 4,640
To Err Is Human : Building A Safer Health System
Kohn, L. T., Corrigan, J. M., & Donaldson, M. S. (2000) · Cited by 2,830
Research works printed but not linked: 1
- SAS Institute Inc. SAS/STAT User’s Guide, Version 8. Cary, NC: SAS Institute Inc.; 1999.
Cited by
Sorted by citations
Items 101–187 of 187
Clayton, D. A., Eguchi, M., Kerr, K. F., Miyoshi, K., Brunyé, T. T., Drew, T. W., Weaver, D. L., & Elmore, J. G. (2022) · Medical Decision Making · doi:10.1177/0272989x221126528 · Cited by 13
Yang, H., Thompson, C. A., & Bland, M. (2012) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2012.08.005 · Cited by 12
Ellervall, E., Brehmer, B., & Knutsson, K. (2008) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-8-57 · Cited by 11
Thoma‐Lürken, T., Lexis, M. A. S., Bleijlevens, M. H. C., & Hamers, J. P. H. (2018) · Journal of Clinical Nursing · doi:10.1111/jocn.14647 · Cited by 11
Versteeg, M., Wijnen‐Meijer, M., & Paul Steendijk, A. (2018) · AJP Advances in Physiology Education · doi:10.1152/advan.00130.2018 · Cited by 11
Defining and tracking medical student self-monitoring using multiple-choice question item certainty
Tweed, M., Purdie, G., & WILKINSON, T. J. (2020) · BMC Medical Education · doi:10.1186/s12909-020-02250-x · Cited by 10
Let patients help with diagnosis
Graedon, T., & Graedon, J. (2014) · Diagnosis · doi:10.1515/dx-2013-0006 · Cited by 11
Newman‐Toker, D. E. (2008) · ProQuest Demo Repository · Cited by 11
The Gaps in Specialists’ Diagnoses
Scott, I. A., & Campbell, D. A. (2018) · Medical Journal of Australia · doi:10.5694/mja17.00905 · Cited by 12
What can be done to increase the use of diagnostic decision support systems?
Berner, E. S. (2014) · Diagnosis · doi:10.1515/dx-2013-0014 · Cited by 10
Poitras, E., Doleck, T., & Lajoie, S. P. (2017) · Educational Technology Research and Development · doi:10.1007/s11423-017-9555-9 · Cited by 10
False certainty in the acquisition of anatomical and physiotherapeutic knowledge
von Hoyer, J. F., Bientzle, M., Creß, U., Großer, J., Kimmerle, J., & Holtz, P. (2022) · BMC Medical Education · doi:10.1186/s12909-022-03820-x · Cited by 10
Anchoring Errors in Emergency Medicine Residents and Faculties
Dargahi, H., Monajemi, A., Soltani, A., Nedaie, H. H. N., & Labaf, A. (2022) · Medical Journal of the Islamic Republic of Iran · doi:10.47176/mjiri.36.124 · Cited by 10
Scott‐Jones, J., & Lucas, S. J. (2013) · Journal of Primary Health Care · doi:10.1071/hc13243 · Cited by 9
Confidence and competence in communication
Kawamura, K. (2014) · Theory and Decision · doi:10.1007/s11238-014-9416-5 · Cited by 9
A Follow-Up Report Card on Computer-Assisted Diagnosis—the Grade: C+
Umscheid, C. A., & Hanson, C. W. (2011) · Journal of General Internal Medicine · doi:10.1007/s11606-011-1944-x · Cited by 10
‘PICO-D Management’; a decision-aid for evidence-based chiropractic education and clinical practice
Amorin-Woods, L., & Losco, B. E. (2016) · Chiropractic & Manual Therapies · doi:10.1186/s12998-016-0130-y · Cited by 8
EFFECT OF A METACOGNITIVE INTERVENTION ON COGNITIVE HEURISTIC USE DURING DIAGNOSTIC REASONING
Payne, V. L. (2011) · D-Scholarship@Pitt (University of Pittsburgh) · Cited by 7
Does a decision aid help physicians to detect chronic obstructive pulmonary disease?
Broekhuizen, B. D., Sachs, A. P. E., Janssen, K. J. M., Geersing, G., Moons, K. G. M., Hoes, A. W., & Verheij, T. J. (2011) · British Journal of General Practice · doi:10.3399/bjgp11x601398 · Cited by 7
Toward Safer Diagnoses: A SEIPS-Based Narrative Review of Diagnostic Errors
Yen, C., Epling, J. W., Rockwell, M., & Vaughn-Cooke, M. (2026) · Diagnostics · doi:10.3390/diagnostics16020347 · Cited by 6
Blaser, S. B., Schaye, V. E., Hwang, J., Cocks, P. M., & Kudlowitz, D. (2021) · Diagnosis · doi:10.1515/dx-2020-0149 · Cited by 6
Ben‐Shabat, N., Sloma, A., Weizman, T., Kiderman, D., & Amital, H. (2021) · JMIR Medical Informatics · doi:10.2196/32507 · Cited by 7
Aggregate Features in Multisample Classification Problems
Varga, R., Matheson, S. M., & Hamilton-Wright, A. (2014) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2014.2314856 · Cited by 6
Seguridad clínica en atención primaria. El enfoque sistémico (I)
Carrió, F. B. (2011) · Atención Primaria · doi:10.1016/j.aprim.2011.07.014 · Cited by 6
Laboratory test result interpretation for primary care doctors in South Africa
Vanker, N., & Faull, N. (2017) · African Journal of Laboratory Medicine · doi:10.4102/ajlm.v6i1.453 · Cited by 6
Corfield, L., Williams, R. A., Lavelle, C., Latcham, N., Talash, K., & Machin, L. (2020) · Journal of Medical Ethics · doi:10.1136/medethics-2019-105961 · Cited by 7
Tweed, M., Willink, R., & WILKINSON, T. J. (2023) · Medical Education · doi:10.1111/medu.15253 · Cited by 5
Heck, A. J. (2014) · Medical Science Educator · doi:10.1007/s40670-014-0050-1 · Cited by 5
The importance of appropriate matching of confidence and competence in radiology training and beyond
Schweitzer, A. D. (2020) · Clinical Imaging · doi:10.1016/j.clinimag.2020.04.031 · Cited by 5
Miller, C. S., & Hamm, L. L. (2012) · The American Journal of the Medical Sciences · doi:10.1097/maj.0b013e3182684aab · Cited by 5
Foster, N. L., Jagust, W. J., & Fox, N. C. (2013) · Alzheimer Disease & Associated Disorders · doi:10.1097/wad.0b013e31828ab5d8 · Cited by 5
van Sassen, C., Mamede, S., Bos, M., van den Broek, W. W., Bindels, P., & Zwaan, L. (2023) · BMC Medical Education · doi:10.1186/s12909-023-04448-1 · Cited by 4
Identifying misconceptions about oral radiology and medicine among dental students
Bezerra, H. K. F., Passos, K. K. M., Leonel, A. C. L. D. S., Carvalho, E. J. D. A., Nascimento, E. H. L., Ramos‐Perez, F. M. D. M., & Pérez, D. E. D. C. (2021) · Journal of Dental Education · doi:10.1002/jdd.12789 · Cited by 4
Dewan, T., Avinashi, V., Beaudry, P., Doré‐Bergeron, M., Gaucher, N. O., & Nelson, K. (2024) · Hospital Pediatrics · doi:10.1542/hpeds.2023-007643 · Cited by 4
van Sassen, C., Mamede, S., Hooftman, J., van den Broek, W. W., Bindels, P., & Zwaan, L. (2025) · Advances in Health Sciences Education · doi:10.1007/s10459-025-10412-z · Cited by 4
Cifra, C. L., Tigges, C. R., Miller, S. L., Herwaldt, L. A., & Singh, H. (2019) · Diagnosis · doi:10.1515/dx-2019-0048 · Cited by 4
Resident Perceptions of a Publicly Disclosed Daily Productivity Dashboard
Goldflam, K., Tsyrulnik, A., Flood, C. T., Bod, J., Coughlin, R. F., & Della‐Giustina, D. (2022) · Western Journal of Emergency Medicine · doi:10.5811/westjem.2021.10.53874 · Cited by 4
Confidence and Competence in Expertise
Kawamura, K. (2007) · Cited by 4
Surgeon Confidence in an Outpatient Setting
Hageman, M. G. J. S., Bossen, J. K. J., King, J. D., & Ring, D. (2013) · Hand · doi:10.1007/s11552-013-9533-6 · Cited by 4
Consistency in diagnostic suggestions does not influence the tendency to accept them
van den Berge, K., Mamede, S., van Gog, T., van Saase, J., & Rikers, R. M. J. P. (2012) · Canadian Medical Education Journal · doi:10.36834/cmej.36594 · Cited by 4
Bullard, J., Alm, C. O., Yu, Q., Shi, P., & Haake, A. R. (2014) · Cited by 4
Community nurses' judgement and decision making for the management of venous leg ulceration
Adderley, U. J. (2013) · White Rose eTheses Online (University of Leeds, The University of Sheffield, University of York) · Cited by 4
From diagnostic errors to diagnostic excellence in emergency care: Time to flip the script
Mahajan, P. (2024) · Academic Emergency Medicine · doi:10.1111/acem.15033 · Cited by 3
Hidden biases in clinical decision-making: potential solutions, challenges, and perspectives
Vitacca, M., Giardini, A., Gazzi, L., & Vitacca, M. (2022) · Monaldi Archives for Chest Disease · doi:10.4081/monaldi.2022.2339 · Cited by 2
Fridsma, D. B., & McKibbon, K. A. (2005) · Cited by 3
“Preflight Checklists” for diagnosis: a personal experience
Ely, J. (2014) · Diagnosis · doi:10.1515/dx-2013-0008 · Cited by 3
Academic Etiquette for the Nephrologist
Watnick, S. G. (2008) · Clinical Journal of the American Society of Nephrology · doi:10.2215/cjn.01750408 · Cited by 3
Kojima, J., Uehara, T., Ohira, Y., Tsukamoto, T., Shikino, K., Yokokawa, D., Li, Y., Yanagita, Y., Sato, R., & Ikusaka, M. (2025) · BMC Medical Education · doi:10.1186/s12909-025-06869-6 · Cited by 2
The psychology of being a beginner
Sanchez, C. J. (2022) · Social and Personality Psychology Compass · doi:10.1111/spc3.12659 · Cited by 2
Fei, C., Santiago, S., Southworth, E., Stephenson‐Famy, A., Fay, E., Wang, E. Y., & Burns, R. N. (2023) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-22-00693.1 · Cited by 2
Evaluating Acute Stroke Diagnosis Using Simulation Scenarios
Liberman, A. L., Apley, D. W., Zhu, J., Romo, E., Holl, J. L., Khorzad, R., Maas, M. B., Mendelson, S., Richards, C. T., Song, S. Y., et al. (2025) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2025.03.004 · Cited by 2
Rein, C. (2025) · Advances in Medical Education and Practice · doi:10.2147/amep.s496784 · Cited by 1
Diagnostic Error in Surgery and Surgical Services
Graber, M. L., Sánchez, J. A., & Barach, P. R. (2017) · Springer eBooks · doi:10.1007/978-3-319-44010-1_25 · Cited by 2
Chockalingam, L., Keniston, A., McBeth, L. J., & Mutter, M. (2024) · Diagnosis · doi:10.1515/dx-2023-0135 · Cited by 1
Cognitive biases in cardiology practice from the perspective of evolutionary explanation
Александрович, Ч. Г., & Таратухин, Е. О. (2025) · CARDIOVASCULAR THERAPY AND PREVENTION · doi:10.15829/1728-8800-2024-4311 · Cited by 1
Characterizing Personal Clinical Cognitive Uncertainty and Its Association With Clinical Judgment
Simard‐Sauriol, P., Wassef, A., Peters, E., Costa, J.-P., Fernández, N., & Nguyên, Q. D. (2025) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.70124 · Cited by 1
The effect of centrality bias on triage nurses in the emergency department
Shlenger, D., Cohen, A., Hochman, G., Pachys, G., & Trotzky, D. (2025) · SAGE Open Medicine · doi:10.1177/20503121251364742 · Cited by 1
Sloane, J., Matin, R., Shahid, U., Meyer, A. N. D., Singh, H., Zwaan, L., & Giardina, T. D. (2026) · Diagnosis · doi:10.1515/dx-2025-0092 · Cited by 1
Awareness of Heuristics in Clinical Decision Making
Richardson, L. G. (2014) · Journal of Doctoral Nursing Practice · doi:10.1891/1939-2095.7.1.16 · Cited by 1
Surgeon Perception of Risk and Benefit in the Decision to Operate Under Uncertainty
Angeles, L. (2016) · Cited by 1
Aslanova, R., Payant, L., Liu, R., Pacheco, K., Fortier, J. H., & Garber, G. E. (2024) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2024.06.026 · Cited by 4
Walters, G. (2013) · European Journal for Person Centered Healthcare · doi:10.5750/ejpch.v1i1.641 · Cited by 1
An analysis of the meaning of confidence in midwives undertaking intrapartum care
Bedwell, C. (2012) · Research Explorer (The University of Manchester)
Daniel, G. W. (2008) · UA Campus Repository (The University of Arizona)
Improving Diagnostic Safety in Hospital Medicine: Can Clinical Care Conundrums Help?
Etchells, E. E., Shojania, K. G., & Redelmeier, D. A. (2013) · Wiley eBooks · doi:10.1002/9781118483206.ch2
Hüttig, M. (2009) · Universitätsbibliothek der FU Berlin Hochschulschriftenstelle u. Dokumentenserver · doi:10.17169/refubium-10696
Understanding Diagnostic Error
Penney, F. T., & Dalal, A. K. (2012) · Hospital Medicine Clinics · doi:10.1016/j.ehmc.2012.11.003
Roberts, D. E., & Ali, T. (2013) · InnovAiT Education and inspiration for general practice · doi:10.1177/1755738013489671
Why "What do you mean by 'dizzy'?" Should Not Be the First Question You Ask
Newman‐Toker, D. E. (2007)
Die Angst vor der Ethik: Teach the Teacher ein Tagungsbericht
Rinofner-Kreidl, S., & Werner‐Felmayer, G. (2010)
emergency medicine: a multi-centre study Validation of a diagnostic reminder system in
Moss, P., Hassan, T. B., Hamer, W., Britto, J. F., Ramnarayan, P., Cronje, N., Brown, R., & Negus, R. P. M. (2007)
The Perception Approach: Level of Observer Variability Rating and Fusion Diagnoses
Martin, B., & Märkl, B. (2019) · Medical Hypotheses · doi:10.1016/j.mehy.2019.01.002
Marcotte-Beaumier, G., Ricard, N. C., & Dugas, M. J. (2019) · Journal de Thérapie Comportementale et Cognitive · doi:10.1016/j.jtcc.2018.12.002
Chrysikopoulos, H. (2019) · Springer eBooks · doi:10.1007/978-3-030-21103-5_6
Warner, E., Wang, N. C., Lee, J., & Rao, A. U. K. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-821259-2.00017-x
After the History and Examination, What Next?
(2010) · Elsevier eBooks · doi:10.1016/b978-0-7295-3935-7.10006-9
Bansal, M. (2022) · Indian Journal of Otolaryngology and Head & Neck Surgery · doi:10.1007/s12070-022-03092-3
Hammerberg, E. M. (2014) · Springer eBooks · doi:10.1007/978-1-4471-4369-7_4
Decision Making by Emergency Room Physicians and Residents
Hine, M. J., Farion, K. J., Michalowski, W. J., & Szymon Wilk, A. (2011) · IGI Global eBooks · doi:10.4018/978-1-60960-780-7.ch008
Thammasitboon, S., Thammasitboon, S., & Singhal, G. (2013) · Springer eBooks · doi:10.1007/978-1-4614-7419-7_15
Lakhlifi, C., Lejeune, F., Rouault, M., Khamassi, M., & Rohaut, B. (2024) · Figshare · doi:10.6084/m9.figshare.26583951
van Sassen, C., Mamede, S., Bos, M., van den Broek, W., Bindels, P., & Zwaan, L. (2024) · Figshare · doi:10.6084/m9.figshare.26600050
Additional file 1 of Influences of early diagnostic suggestions on clinical reasoning
Kourtidis, P., Nurek, M., Delaney, B. C., & Kostopoulou, O. (2024) · Figshare · doi:10.6084/m9.figshare.26554733
Recker, F., Michel, S., Lehmann, M., Mathis, G., & Osterwalder, J. J. (2026) · BMC Medical Education · doi:10.1186/s12909-026-09336-y
From uncertainty to understanding: The focus on follow-up initiative
Corines, M. J., Taya, M. D., Sinha, V., Jaspan, O., Brady, E. J., Hayes, C. D., Pitman, J., Lo, G. C., Schweitzer, A. D., & Agress, H. (2026) · Clinical Imaging · doi:10.1016/j.clinimag.2026.110843
Physicians’ metacognition in medical decision-making
Lakhlifi, C., Kouzy, R., Lejeune, F., Beuzon, N., Mawet, J., Roos, C., Khamassi, M., Rohaut, B., & Rouault, M. (2026) · Neuroscience of Consciousness · doi:10.1093/nc/niag064
Monteiro, S. (2013) · MacSphere (McMaster University) · doi:10.71548/25071
Metadata
- Authors
- Friedman, C. P., Gatti, G. G., Franz, T. M., Murphy, G. C., Wolf, F. M., Heckerling, P. S., Fine, P. L., Miller, T. M., & Elstein, A. S.
- Affiliations
- University of Pittsburgh (US)
- St. John Fisher University (US)
- Duke University (US)
- University of Washington (US)
- University of Illinois Chicago (US)
- University of Michigan (US)
- University of North Carolina at Chapel Hill (US)
- Corresponding author
- Friedman, Charles P.
- Venue
- Journal of General Internal Medicine
- Published
- 2005-04
- Volume
- 20
- Issue
- 4
- Pages
- 334-339
- ISSN
- 0884-8734 (ISSN-L)
- 1525-1497
- PMC
- PMC1490097
- OpenAlex
- W2044202249
- Cited by
- 187
- References
- 36
- Citations by year
- 2026: 5 · 2025: 8 · 2024: 8 · 2023: 7 · 2022: 11 · 2021: 7 · 2020: 6 · 2019: 10 · 2018: 14 · 2017: 13 · 2016: 8 · 2015: 4 · 2014: 15 · 2013: 18 · 2012: 9
- FWCI
- 5.90
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Locations
- Journal of General Internal Medicine (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Deep Blue (University of Michigan) (submittedVersion)
- Funders
- National Institutes of Health (5r01lm005630-06)
- U.S. National Library of Medicine (R01-LM-05630)
- Topics
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Patient Safety and Medication Errors
- Social Sciences › Education › Innovations in Medical Education
- Keywords
- diagnostic confidence, overconfidence, diagnostic accuracy, differential diagnosis, clinical experience, medical students, medical residents, faculty physicians, clinical decision support, medical errors, physician self-assessment
- MeSH terms
- Clinical Competence, Decision Support Techniques, Humans, Internal Medicine, Internship and Residency, Judgment, Prospective Studies, Students, Medical, Linear Models, Medical Errors, Decision Support Systems, Clinical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review