The incidence of diagnostic error in medicine
Open accessAbstract
A wide variety of research studies suggest that breakdowns in the diagnostic process result in a staggering toll of harm and patient deaths. These include autopsy studies, case reviews, surveys of patient and physicians, voluntary reporting systems, using standardised patients, second reviews, diagnostic testing audits and closed claims reviews. Although these different approaches provide important information and unique insights regarding diagnostic errors, each has limitations and none is well suited to establishing the incidence of diagnostic error in actual practice, or the aggregate rate of error and harm. We argue that being able to measure the incidence of diagnostic error is essential to enable research studies on diagnostic error, and to initiate quality improvement projects aimed at reducing the risk of error and harm. Three approaches appear most promising in this regard: (1) using ‘trigger tools’ to identify from electronic health records cases at high risk for diagnostic error; (2) using standardised patients (secret shoppers) to study the rate of error in practice; (3) encouraging both patients and physicians to voluntarily report errors they encounter, and facilitating this process.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Diagnostic errors are as high as 10-15%, impacting patient health and system costs.
“Estimates evaluate diagnostic errors as high as 10-15%, impacting patient health and system costs [1][2][3] .”
From Enhancing human-AI collaboration: The case of colonoscopy (2024) · cites this paper as [1]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Missed and delayed diagnoses in the ambulatory setting: a study of closed malpractice claims
Gandhi, T. K., Kachalia, A., Thomas, E. J., Puopolo, A. L., Yoon, C., Brennan, T. A., & Studdert, D. M. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-145-7-200610030-00006 · Cited by 662 · see citing works
Hogan, H., Healey, F., Neale, G., Thomson, R., Vincent, C., & Black, N. (2012) · BMJ Quality & Safety · doi:10.1136/bmjqs-2011-001159 · Cited by 358 · see citing works
Singh, H., Thomas, E. J., Mani, S., Sittig, D., Arora, H., Espadas, D., Khan, M. M., & Petersen, L. A. (2009) · Archives of Internal Medicine · doi:10.1001/archinternmed.2009.263 · Cited by 212 · see citing works
Communication outcomes of critical imaging results in a computerized notification system
Singh, H., Arora, H. S., Vij, M. S., Rao, R., Khan, M. M., & Petersen, L. A. (2007) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2280 · Cited by 140 · see citing works
Electronic Health Record-Based Surveillance of Diagnostic Errors in Primary Care
Singh, H., Giardina, T. D., Forjuoh, S. N., Reis, M. D., Kosmach, S., Khan, M. M., & Thomas, E. J. (2012) · BMJ Quality & Safety · doi:10.1136/bmjqs-2011-000304 · Cited by 131 · see citing works
Missed hypothyroidism diagnosis uncovered by linking laboratory and pharmacy data
Schiff, G. D. (2005) · Archives of Internal Medicine · doi:10.1001/archinte.165.5.574 · Cited by 47 · see citing works
Flagged first, then by citations
Research works printed but not linked: 54
- [1]Hastie T Tibshirani R Friedman J The elements of statistical learning. 2nd edn, Springer, 2009
- [2]Graber M Wachter R Cassel C Bringing diagnosis into the quality and safety equations. JAMA 2012; 308: 1211– 12 23011708
- [3]Graber ML Diagnostic error in medicine: a case of neglect. Jt Comm J Qual Patient Saf 2004; 31: 112– 19 15791770
- [4]Wachter R Why diagnostic errors don't get any respect—and what can be done about them. Health Affairs 2010; 29: 1605– 10 20820015
- [5]Pronovost PJ Colantuoni E Measuring preventable harm. JAMA 2009; 301: 1273– 75 19318654
- [6]Berner E Graber M Overconfidence as a cause of diagnostic error in medicine. Am J Med 2008; 121(5 Suppl Diagnostic Error in Medicine): S2– 23 18440350
- [7]Elstein A Clinical reasoning in medicine. In: Higgs J, ed. Clinical reasoning in the health professions. Oxford, England: Butterworth-Heinemann Ltd, 1995; 49– 59
- [9]Sonderegger-Iseli K Burger S Muntwyler J Diagnostic errors in three medical eras: a necropsy study. Lancet 2000; 355: 2027– 31 10885353
- [10]Blendon RJ DesRoches CM Brodie M Views of practicing physicians and the public on medical errors. N Engl J Med 2002; 347: 1933– 40 12477944
- [11]Singh H Thomas E Wilson L Errors of diagnosis in pediatric practice: a multisite survey. Pediatrics 2010; 126: 70– 9 20566604 PMC2921702
- [12]Peabody JW Luck J Jain S Assessing the accuracy of administrative data in health information systems. Med Care 2004; 42: 1066– 72 15586833
- [13]Beam CA Layde PM Sullivan DC Variability in the interpretation of screening mammograms by US radiologists. Findings from a national sample. Arch Intern Med 1996; 156: 209– 13 8546556
- [14]Raab SS Variability of practice in anatomic pathology and its effect on patient outcomes. Semin Diagn Pathol 2005; 22: 177– 85 16639996
- [15]Schiff GD Hasan O Kim S Diagnostic error in medicine—analysis of 583 physician-reported errors. Arch Int Med 2009; 169: 1881– 87 19901140
- [17]Charlton I Jones K Bain J Delay in diagnosis of childhood asthma and its influence on respiratory consultation rates. Arch Dis Child 1991; 66: 633– 35 2039256 PMC1792928
- [18]Kowalski R Claasen J Kreiter K Initial misdiagnosis and outcome after subarrachnoid hemorrhage. JAMA 2004; 291: 866– 69 14970066
- [20]Sevdalis N Jacklin R Arora S Diagnostic error in a national incident reporting system in the UK. J Eval Clin Pract 2010; 16: 1276– 78 20727061
- [24]Gehring K Schwappach D Battaglila M Frequency and harm associated with primary care safety incidents. Am J Manag Care 2012; 18: e323– e37 23009331
- [25]Weiner S Schwartz A Weaver F Contextual errors and failures in indivdualizing patient care. Ann Int Med 2010; 153: 69– 75 20643988
- [26]Schwartz A Weiner S Weaver F Uncharted territory: measuring costs of diagnostic errors outside the medical record. BMJ Qual Saf 2012 22773889
- [27]Kostopoulou O Oudhoff J Nath R Predictors of diagnostic accuracy and safe management in difficult diagnostic problems in family medicine. Med Decis Making 2008; 28: 668– 80 18556634
- [28]Fitzgerald R Error in radiology. Clin Radiol 2001; 56: 938– 46 11795921
- [29]Foucar E Error in anatomic pathology. Am J Clin Pathol 2001; 116(Suppl Diagnostic Error in Medicine): S34– 46 11993701
- [30]Westra WH Kronz JD Eisele DW The impact of second opinion surgical pathology on the practice of head and neck surgery: a decade experience at a large referral hospital. Head Neck 2002; 24: 684– 93 12112543
- [31]Raab SS GD Quality in Cancer Diagnosis. CA Cancer J Clin 2010; 60: 27
- [35]Tehrani A Lee H Mathews S 25-year summary of US malpractice claims for diagnostic errors 1986–2010; An analysis from the National Practitioner Data Bank. BMJ Qual Saf 2013 23610443
- [36]Newman-Toker D Robinson K Edlow J Frontline misdiagnosis of cerebrovascular events in the era of modern neuro-imaging: a systematic review. Ann Neurol 2008; 64(Suppl 12 Diagnostic Error in Medicine): S17– 18
- [37]Kostopoulou O Delaney BC Munro CW Diagnostic difficulty and error in primary care—a systematic review. Fam Pract 2008; 25: 400– 13 18842618
- [38]Singh H Daci K Petersen LA Missed opportunities to initiate endoscopic evaluation for colorectal cancer diagnosis. Am J Gastroenterol 2009; 104: 2543– 54 19550418 PMC2758321
- [39]Singh H Hirani K Kadiyala H Characteristics and predictors of missed opportunities in lung cancer diagnosis. J Clinical Oncology 2010; 28: 3307– 15 PMC2903328 20530272
- [40]Kostopoulou O Delaney B Confidential reporting of patient safety events in primary care: results from a multilevel classification of cognitive and system factors. Qual Saf Health Care 2007; 16: 95– 100 17403753 PMC2653163
- [41]Graber ML Taking steps towards a safer future: measures to promote timely and accurate medical diagnosis. Am J Med 2008; 121(Suppl 5 Diagnostic Error in Medicine): S43– 6 18440355
- [42]Tsang C Majeed A Avlin P Routinely recorded patient safety events in primary care: a literature review. Fam Pract 2012; 29: 8– 15 21878467
- [44]Resar RK Rozich JD Classen D Methodology and rationale for the measurement of harm with trigger tools. Qual Saf Health Care 2003; 12(Suppl 2 Diagnostic Error in Medicine): ii39– 45 14645894 PMC1765771
- [45]Classen D Resar R Griffin F Global Trigger Tool shows that adverse events in hospitals may be ten times greater than previously measured. Health Affairs 2011; 30: 581– 89 21471476
- [46]Schildmeijer K Nilsson L Arestedt K Assessment of adverse events in medical care: lack of consistency between experienced teams using the global trigger tool. BMJ Qual Saf 2012; 31: 307– 14 22362917
- [47]Singh H Thomas EJ Khan MM Identifying diagnostic errors in primary care using an electronic screening algorithm. Arch Intern Med 2007; 167: 302– 8 17296888
- [49]Singh H Traber D Meyer A Types and origins of diagnostic errors in primary care settings. JAMA Internal Med 2013 PMC3690001 23440149
- [52]Schiff G Finding and fixing diagnosis errors: can triggers help? BMJ Qual Saf 2012; 21: 89– 92 22129932
- [53]Burroughs TE Waterman AD Gallagher TH Patient concerns about medical errors in emergency departments. Acad Emerg Med 2005; 23: 57– 64 15635139
- [54]Schiff GD Minimizing diagnostic error: the importance of follow-up and feedback. Am J Med 2008; 121(5 Suppl Diagnostic Error in Medicine): S38– 42 18440354
- [55]Graber ML Reducing diagnostic error in medicine—there's a job for everyone. NPSF Focus Patient Saf 2009; 12: 6– 7
- [56]Shrier I Green S Solin J Knowledge of and attitude toward patient confidentiality within three family medicine teaching units. Acad Med 1998; 73: 710– 12 9653413
- [57]Weingart S Pagovich O DZ S What can hospitalized patients tell us about adverse events? Learning from patient-reported incidents. J Gen Intern Med 2005; 20: 7 16117751 PMC1490203
- [59]Hasegawa T Fujita S Seto K Patient identification and reporting of unsafe events at six hospitals in Japan. Jt Comm J Qual Patient Saf 2011; 37: 502– 08 22132662
- [60]Ohrn A Elfstrom J Liedgren C Reporting of sentinel events in Swedish hospitals: a comparison of severe adverse events reported by patients and providers. Jt Comm J Qual Patient Saf 2011; 37: 495– 501 22132661
- [61]Tierney WM Adverse outpatient drug events – a problem and an opportunity. N Engl J Med 2003; 348: 1587– 89 12700379
- [62]Phillips RL Jr. Bartholomew LA Dovey SM Learning from malpractice claims about negligent, adverse events in primary care in the United States. Qual Saf Health Care 2004; 13: 121– 26 15069219 PMC1743812
- [63]Trowbridge R Salvador O Addressing diagnostic errors: an institutional approach. Focus Patient Saf Newsletter National Patient Saf Found 2010; 13: 1– 5
- [64]Leape L Berwick D Bates D Counting deaths from medical errors. JAMA 2002; 288: 240512435249
- [65]Winters B Custer J Galvagno S Diagnostic errors in the intensive care unit: a systematic review of autopsy studies. BMJ Qual Saf 2012; 21: 894– 902 22822241
- [66]Shojania K Deaths due to medical error: jumbo jets or just small propeller planes? BMJ Qual Saf 2012; 21: 709– 12 22831904
- [67]Zwaan L de Bruijne M Wagner C Patient record review of the incidence, consequences, and causes of diagnostic adverse events. Arch Intern Med 2010; 170: 1015– 21 20585065
- [68]Lorincz C Drazen E Sokol P Research in ambulatory patient safety 2000–2010: a 10-year review. Chicago, IL: American Medical Association, 2011
Cited by
Sorted by citations
Cognitive biases associated with medical decisions: a systematic review
Saposnik, G., Redelmeier, D., Ruff, C. C., & Tobler, P. N. (2016) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-016-0377-1 · Cited by 1,001 · see citing works
Singh, H., Meyer, A. N. D., & Thomas, E. J. (2014) · BMJ Quality & Safety · doi:10.1136/bmjqs-2013-002627 · Cited by 677 · see citing works
Improving the accuracy of medical diagnosis with causal machine learning
Richens, J. G., Lee, C. M., & Johri, S. (2020) · Nature Communications · doi:10.1038/s41467-020-17419-7 · Cited by 598 · see citing works
Evaluation of symptom checkers for self diagnosis and triage: audit study
Semigran, H. L., Linder, J. A., Gidengil, C., & Mehrotra, A. (2015) · BMJ · doi:10.1136/bmj.h3480 · Cited by 489 · see citing works
The Global Burden of Diagnostic Errors in Primary Care
Singh, H., Schiff, G. D., Graber, M. L., Onakpoya, I., & Thompson, M. J. (2017) · BMJ Quality & Safety · doi:10.1136/bmjqs-2016-005401 · Cited by 395 · see citing works
Self-citationDual-process cognitive interventions to enhance diagnostic reasoning: a systematic review
Lambe, K. A., O'Reilly, G., Kelly, B. D., & Curristan, S. (2016) · BMJ Quality & Safety · doi:10.1136/bmjqs-2015-004417 · Cited by 215 · see citing works
A generalist medical language model for disease diagnosis assistance
Liu, X., Liu, H., Yang, G., Jiang, Z., Cui, S., Zhang, Z., Wang, H., Tao, L., Sun, Y., Song, Z., et al. (2025) · Nature Medicine · doi:10.1038/s41591-024-03416-6 · Cited by 183 · see citing works
Berthet, V. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.802439 · Cited by 191 · see citing works
Barnett, M. L., Boddupalli, D., Nundy, S., & Bates, D. W. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.0096 · Cited by 154 · see citing works
Comparison of Physician and Computer Diagnostic Accuracy
Semigran, H. L., Levine, D. M., Nundy, S., & Mehrotra, A. (2016) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2016.6001 · Cited by 145 · see citing works
Bridging the “last mile” gap between AI implementation and operation: “data awareness” that matters
Cabitza, F., Campagner, A., & Balsano, C. (2020) · Annals of Translational Medicine · doi:10.21037/atm.2020.03.63 · Cited by 113 · see citing works
A Unified Conceptual Model for Diagnostic Errors: Underdiagnosis, Overdiagnosis, and Misdiagnosis
Newman-Toker, D. E. (2014) · Diagnosis · doi:10.1515/dx-2013-0027 · Cited by 97 · see citing works
Clinical Reasoning as a Core Competency
Connor, D. M., Durning, S. J., & Rencic, J. J. (2020) · Academic Medicine · doi:10.1097/acm.0000000000003027 · Cited by 96 · see citing works
Patient harm due to diagnostic error of neuro-ophthalmologic conditions.
Stunkel, L., Sharma, R. A., Mackay, D. D., Wilson, B., Van Stavern, G. P., Newman, N. J., & Biousse, V. (2021) · Ophthalmology · doi:10.1016/j.ophtha.2021.03.008 · Cited by 54 · see citing works
Developing Checklists to Prevent Diagnostic Error in Emergency Room Settings
Graber, M. L., Sorensen, A. V., Biswas, J., Modi, V., Wackett, A., Johnson, S., Lenfestey, N., Meyer, A. N. D., & Singh, H. (2014) · Diagnosis · doi:10.1515/dx-2014-0019 · Cited by 49 · see citing works
Self-citationData omission by physician trainees on ICU rounds.
Artis, K. A., Bordley, J., Mohan, V., & Gold, J. A. (2019) · Critical Care Medicine · doi:10.1097/ccm.0000000000003557 · Cited by 36 · see citing works
Checklists to Prevent Diagnostic Errors: A Pilot Randomized Controlled Trial
Ely, J. W., & Graber, M. A. (2015) · Diagnosis · doi:10.1515/dx-2015-0008 · Cited by 37 · see citing works
Self-citationEnhancing human-AI collaboration: The case of colonoscopy
Introzzi, L., Zonca, J., Cabitza, F., Cherubini, P., & Reverberi, C. (2024) · Digestive and Liver Disease · doi:10.1016/j.dld.2023.10.018 · Cited by 28 · see citing works
The economics of diagnostic safety
Slawomirski, L., Kelly, D., de Bienassis, K., Kallas, K.-A., & Klazinga, N. (2025) · OECD Health Working Papers · doi:10.1787/fc61057a-en · Cited by 20 · see citing works
Emre, H. O., Ozturk, O. G., Coskun, A., Yucel, D., Yazici, C., Serteser, M., Senes, M., Deniz, L., Arslan, F. D., Cubukcu, H. C., et al. (2021) · Biochemia Medica · doi:10.11613/bm.2021.010705 · Cited by 17 · see citing works
Understanding Diagnostic Conversations in Clinical Practice: A Systematic Review
Huynh, K., Brito, J. P., Bylund, C. L., Prokop, L. J., & Ospina, N. S. (2023) · Patient Education and Counseling · doi:10.1016/j.pec.2023.107949 · Cited by 8 · see citing works
- Authors
- Graber, M. L.
- Affiliations
- RTI International (US)
- Corresponding author
- Graber, Mark L
- ORCID
- Graber, Mark L
- Venue
- BMJ Quality & Safety
- Publisher
- BMJ
- Published
- 2013-06-15
- Volume
- 22
- Issue
- Suppl 2
- Pages
- ii21-ii27
- ISSN
- 1475-3898 (ISSN-L)
- 2044-5415
- 2044-5423
- PMC
- PMC3786666
- OpenAlex
- W2132131059
- Cited by
- 626
- References
- 6
- Citations by year
- 2026: 35 · 2025: 37 · 2024: 49 · 2023: 67 · 2022: 52 · 2021: 59 · 2020: 88 · 2019: 58 · 2018: 59 · 2017: 38 · 2016: 26 · 2015: 34 · 2014: 16 · 2013: 8
- FWCI
- 22.22
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by-nc
- Locations
- BMJ Quality & Safety (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, other-oa)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- Topics
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Health Sciences › Health Professions › Emergency Medical Services › Patient Safety and Medication Errors
- Health Sciences › Health Professions › Pharmacy › Medical Malpractice and Liability Issues
- Keywords
- diagnostic errors, patient harm, trigger tool, standardized patients, autopsy studies, electronic health records, quality improvement
- MeSH terms
- Autopsy, Diagnostic Errors, Malpractice, Research Design, Patient Simulation, Clinical Laboratory Techniques, Disclosure, Clinical Audit, Patient Safety
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review