The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
The frequency of diagnostic errors in outpatient care: estimations from three large observational studies involving US adult populations
Open accessAbstract
Background: The frequency of outpatient diagnostic errors is challenging to determine due to varying error definitions and the need to review data across multiple providers and care settings over time. We estimated the frequency of diagnostic errors in the US adult population by synthesising data from three previous studies of clinic-based populations that used conceptually similar definitions of diagnostic error. Methods: Data sources included two previous studies that used electronic triggers, or algorithms, to detect unusual patterns of return visits after an initial primary care visit or lack of follow-up of abnormal clinical findings related to colorectal cancer, both suggestive of diagnostic errors. A third study examined consecutive cases of lung cancer. In all three studies, diagnostic errors were confirmed through chart review and defined as missed opportunities to make a timely or correct diagnosis based on available evidence. We extrapolated the frequency of diagnostic error obtained from our studies to the US adult population, using the primary care study to estimate rates of diagnostic error for acute conditions (and exacerbations of existing conditions) and the two cancer studies to conservatively estimate rates of missed diagnosis of colorectal and lung cancer (as proxies for other serious chronic conditions). Results: Combining estimates from the three studies yielded a rate of outpatient diagnostic errors of 5.08%, or approximately 12 million US adults every year. Based upon previous work, we estimate that about half of these errors could potentially be harmful. Conclusions: Our population-based estimate suggests that diagnostic errors affect at least 1 in 20 US adults. This foundational evidence should encourage policymakers, healthcare organisations and researchers to start measuring and reducing diagnostic errors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Approximately 5% of patients in U.S. outpatient settings suffer from diagnostic errors [8]”
From Toward Safer Diagnoses: A SEIPS-Based Narrative Review of Diagnostic Errors (2026) · cites this paper as [8]
Experimental — accuracy not yet measuredIn the citing paper
“The opportunity costs of not using our best available tools for disease detection and treatment are substantial-12 million people a year receive misdiagnoses in the United States, with about six million facing potential harm as a result. 17”
From Clinical applications of machine learning algorithms: beyond the black box (2019) · cites this paper as [17]
In the citing paper
“The opportunity costs of not using our best available tools for disease detection and treatment are substantial-12 million people a year receive misdiagnoses in the United States, with about six million facing potential harm as a result. 17”
From Clinical applications of machine learning algorithms: beyond the black box (2019) · cites this paper as [17]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Summary health statistics for U.S. adults: national health interview survey, 2012.
Blackwell, D. L., Lucas, J. W., & Clarke, T. C. (2014) · PubMed · Cited by 1,884
Incidence and Types of Adverse Events and Negligent Care in Utah and Colorado
Thomas, E. J., Studdert, D. M., Burstin, H. R., Orav, E. J., Zeena, T., Williams, E. J., Howard, K. M., Weiler, P. C., & Brennan, T. A. (2000) · Medical Care · doi:10.1097/00005650-200003000-00003 · Cited by 1,673
Self-citationClinical Reasoning in the Health Professions
Higgs, J., & Jones, M. A. (2000) · Cited by 920
Missed and delayed diagnoses in the ambulatory setting: a study of closed malpractice claims
Gandhi, T. K., Kachalia, A., Thomas, E. J., Puopolo, A. L., Yoon, C., Brennan, T. A., & Studdert, D. M. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-145-7-200610030-00006 · Cited by 662
Self-citationDiagnostic Error in Medicine: Analysis of 583 Physician-Reported Errors
Schiff, G. D. (2009) · Archives of Internal Medicine · doi:10.1001/archinternmed.2009.333 · Cited by 638
The incidence of diagnostic error in medicine
Graber, M. L. (2013) · BMJ Quality & Safety · doi:10.1136/bmjqs-2012-001615 · Cited by 626
Types and Origins of Diagnostic Errors in Primary Care Settings
Singh, H., Giardina, T. D., Meyer, A. N. D., Forjuoh, S. N., Reis, M. D., & Thomas, E. J. (2013) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2013.2777 · Cited by 559
Self-citationSummary health statistics for U.S. adults: National Health Interview Survey, 2010.
Schiller, J. S., Lucas, J. W., Ward, B. W., & Peregoy, J. A. (2012) · PubMed · Cited by 482
Measuring errors and adverse events in health care
Thomas, E. J., & Petersen, L. A. (2003) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2003.20147.x · Cited by 455
Self-citationThe Vanishing Nonforensic Autopsy
Shojania, K. G., & Burton, E. C. (2008) · New England Journal of Medicine · doi:10.1056/nejmp0707996 · Cited by 294
Cited by
High-performance medicine: the convergence of human and artificial intelligence
Topol, E. J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0300-7 · Cited by 10,450
An overview of clinical decision support systems: Benefits, risks, and strategies for success
Sutton, R. T., Pincock, D., Baumgart, D. C., Sadowski, D. C., Fedorak, R. N., & Kroeker, K. I. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0221-y · Cited by 3,019
“52 We are now seeing diagnostic systems being developed with non-knowledge-based techniques like machine learning, which may pave the way for more accurate diagnosis.”
Background(2017) · OECD Health Working Papers · doi:10.1787/5a9858cd-en · Cited by 616
Improving the accuracy of medical diagnosis with causal machine learning
Richens, J. G., Lee, C. M., & Johri, S. (2020) · Nature Communications · doi:10.1038/s41467-020-17419-7 · Cited by 598
Clinical applications of machine learning algorithms: beyond the black box
Watson, D. S., Krutzinna, J., Bruce, I. N., Griffiths, C. E., McInnes, I. B., Barnes, M. R., & Floridi, L. (2019) · BMJ · doi:10.1136/bmj.l886 · Cited by 450
Metadata
- Authors
- Singh, H., Meyer, A. N. D., & Thomas, E. J.
- Affiliations
- Michael E. DeBakey VA Medical Center (US)
- Memorial Hermann (US)
- Corresponding author
- Singh, Hardeep
- Venue
- BMJ Quality & Safety
- Publisher
- BMJ
- Published
- 2014-04-17
- Volume
- 23
- Issue
- 9
- Pages
- 727-731
- ISSN
- 1475-3898 (ISSN-L)
- 2044-5415
- 2044-5423
- PMC
- PMC4145460
- OpenAlex
- W2154651644
- Cited by
- 677
- References
- 28
- Citations by year
- 2026: 61 · 2025: 67 · 2024: 70 · 2023: 77 · 2022: 75 · 2021: 89 · 2020: 68 · 2019: 41 · 2018: 34 · 2017: 32 · 2016: 26 · 2015: 26 · 2014: 8
- FWCI
- 31.48
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by-nc
- Locations
- BMJ Quality & Safety (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- Funders
- National Institutes of Health (UL1TR000371, CIN13-413)
- Agency for Healthcare Research and Quality (R18HS017244, R18HS017820)
- Center for Innovations in Quality, Effectiveness and Safety (CIN 13–413, 13–413)
- National Cancer Institute (K23CA125585)
- National Center for Advancing Translational Sciences
- Topics
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Patient Safety and Medication Errors
- Health Sciences › Medicine › Family Practice › Primary Care and Health Outcomes
- Keywords
- diagnostic errors, outpatient care, missed diagnosis, primary care, return visits, colorectal cancer, lung cancer
- MeSH terms
- Adult, Ambulatory Care, Diagnostic Errors, Humans, Lung Neoplasms, United States, Colorectal Neoplasms
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The frequency of diagnostic errors in outpatient care: estimations from three large observational studies involving US adult populations. https://app.cochat.ai/papers/10.1136/bmjqs-2013-002627
- The paper
- Singh, H., Meyer, A. N. D., & Thomas, E. J. (2014). The frequency of diagnostic errors in outpatient care: estimations from three large observational studies involving US adult populations. BMJ Quality & Safety. https://doi.org/10.1136/bmjqs-2013-002627
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
