The DOI matches its Crossref record; 75 of the 75 references it cites were found in a registry or an index.
Interpretive Error in Radiology
Abstract
OBJECTIVE: Although imaging technology has advanced significantly since the work of Garland in 1949, interpretive error rates remain unchanged. In addition to patient harm, interpretive errors are a major cause of litigation and distress to radiologists. In this article, we discuss the mechanics involved in searching an image, categorize omission errors, and discuss factors influencing diagnostic accuracy. Potential individual- and system-based solutions to mitigate or eliminate errors are also discussed. CONCLUSION: Radiologists use visual detection, pattern recognition, memory, and cognitive reasoning to synthesize final interpretations of radiologic studies. This synthesis is performed in an environment in which there are numerous extrinsic distractors, increasing workloads and fatigue. Given the ultimately human task of perception, some degree of error is likely inevitable even with experienced observers. However, an understanding of the causes of interpretive errors can help in the development of tools to mitigate errors and improve patient safety.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
To Err Is Human: Building a Safer Health System
(2000) · National Academies Press eBooks · doi:10.17226/9728 · Cited by 14,044
To Err is Human: Building a Safer Health System
Hendee, W. R. (2001) · Journal of Vascular and Interventional Radiology · doi:10.1016/s1051-0443(01)70072-3 · Cited by 10,103
Medical error—the third leading cause of death in the US
Makary, M. A., & Daniel, M. (2016) · BMJ · doi:10.1136/bmj.i2139 · Cited by 3,264
What attributes guide the deployment of visual attention and how do they do it?
Wolfe, J. M., & Horowitz, T. S. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1411 · Cited by 1,766
Diagnostic Accuracy of Digital Screening Mammography With and Without Computer-Aided Detection
Lehman, C. D., Wellman, R. D., Buist, D. S. M., Kerlikowske, K., Tosteson, A. N. A., & Miglioretti, D. L. (2015) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2015.5231 · Cited by 678
Influence of Computer-Aided Detection on Performance of Screening Mammography
Fenton, J. J., Taplin, S. H., Carney, P. A., Abraham, L., Sickles, E. A., D'Orsi, C., Berns, E. A., Cutter, G., Hendrick, R. E., Barlow, W. E., et al. (2007) · New England Journal of Medicine · doi:10.1056/nejmoa066099 · Cited by 619
Bruno, M. A., Walker, E. A., & Abujudeh, H. H. (2015) · RadioGraphics · doi:10.1148/rg.2015150023 · Cited by 573
From Mindless to Mindful Practice — Cognitive Bias and Clinical Decision Making
Croskerry, P. (2013) · New England Journal of Medicine · doi:10.1056/nejmp1303712 · Cited by 571
The Invisible Gorilla Strikes Again: Sustained Inattentional Blindness in Expert Observers
Drew, T., Võ, M. L.-H., & Wolfe, J. M. (2013) · Psychological Science · doi:10.1177/0956797613479386 · Cited by 483
McDonald, R. J., Schwartz, K. M., Eckel, L. J., Diehn, F. E., Hunt, C. H., Bartholmai, B. J., Erickson, B. J., & Kallmes, D. F. (2015) · Academic Radiology · doi:10.1016/j.acra.2015.05.007 · Cited by 460
Cognitive and System Factors Contributing to Diagnostic Errors in Radiology
Lee, C. S., Nagy, P. G., Weaver, S. J., & Newman-Toker, D. E. (2013) · American Journal of Roentgenology · doi:10.2214/ajr.12.10375 · Cited by 415
Current perspectives in medical image perception
Krupinski, E. A. (2010) · Attention, Perception & Psychophysics · doi:10.3758/app.72.5.1205 · Cited by 343
Radiology's Achilles' heel: error and variation in the interpretation of the Röntgen image.
Robinson, P. J. (1997) · The British Journal of Radiology · doi:10.1259/bjr.70.839.9536897 · Cited by 320
Computer aided detection (CAD): an overview
Castellino, R. A. (2005) · Cancer Imaging · doi:10.1102/1470-7330.2005.0018 · Cited by 284
Long Radiology Workdays Reduce Detection and Accommodation Accuracy
Krupinski, E. A., Berbaum, K. S., Caldwell, R. T., Schartz, K. M., & Kim, J. (2010) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2010.03.004 · Cited by 272
Interruptions in healthcare: Theoretical views
Grundgeiger, T., & Sanderson, P. (2009) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2008.10.001 · Cited by 262
Fool Me Twice: Delayed Diagnoses in Radiology With Emphasis on Perpetuated Errors
Kim, Y. W., & Mansfield, L. T. (2014) · American Journal of Roentgenology · doi:10.2214/ajr.13.11493 · Cited by 259
Interpreting Chest Radiographs without Visual Search
Kundel, H. L., & Nodine, C. F. (1975) · Radiology · doi:10.1148/116.3.527 · Cited by 253
Performance Parameters for Screening and Diagnostic Mammography: Specialist and General Radiologists
Sickles, E. A., Wolverton, D. E., & Dee, K. E. (2002) · Radiology · doi:10.1148/radiol.2243011482 · Cited by 249
Garland, L. H. (1949) · Radiology · doi:10.1148/52.3.309 · Cited by 239
Evans, K. K., Birdwell, R. L., & Wolfe, J. M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0064366 · Cited by 236
Accuracy of Diagnostic Tests Read With and Without Clinical Information: A Systematic Review
Loy, C. T., & Irwig, L. (2004) · JAMA · doi:10.1001/jama.292.13.1602 · Cited by 213
Discrepancy and error in radiology: concepts, causes and consequences.
Brady, A. P., Laoide, R. Ó., McCarthy, P., & McDermott, R. (2012) · Europe PMC (PubMed Central) · Cited by 204
Using eye movements to study visual search and to improve tumor detection.
Nodine, C. F., & Kundel, H. L. (1987) · RadioGraphics · doi:10.1148/radiographics.7.6.3423330 · Cited by 193
Drew, T., Evans, K., Võ, M. L. H., Jacobson, F. L., & Wolfe, J. M. (2013) · RadioGraphics · doi:10.1148/rg.331125023 · Cited by 182
Visual perception and saccadic eye movements
Ibbotson, M., & Krekelberg, B. (2011) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2011.05.012 · Cited by 177
Interpretation of radiographs: effect of clinical history
Doubilet, P., & Herman, P. (1981) · American Journal of Roentgenology · doi:10.2214/ajr.137.5.1055 · Cited by 175
The influence of clinical information on the reporting of CT by radiologists.
Leslie, A., Jones, A. J., & Goddard, P. R. (2000) · The British Journal of Radiology · doi:10.1259/bjr.73.874.11271897 · Cited by 172
Litchfield, D., Ball, L. J., Donovan, T., Manning, D., & Crawford, T. J. (2010) · Journal of Experimental Psychology Applied · doi:10.1037/a0020082 · Cited by 166
Accuracy of Diagnostic Procedures: Has It Improved Over the Past Five Decades?
Berlin, L. (2007) · American Journal of Roentgenology · doi:10.2214/ajr.06.1270 · Cited by 165
Marcovici, P. A., & Taylor, G. A. (2014) · American Journal of Roentgenology · doi:10.2214/ajr.14.12636 · Cited by 155
Lesion conspicuity, structured noise, and film reader error
Kundel, H., & Révész, G. (1976) · American Journal of Roentgenology · doi:10.2214/ajr.126.6.1233 · Cited by 152
Kelly, B. S., Rainford, L. A., Darcy, S., Kavanagh, E. C., & Toomey, R. J. (2016) · Radiology · doi:10.1148/radiol.2016150409 · Cited by 145
The gist of the abnormal: Above-chance medical decision making in the blink of an eye
Evans, K. K., Georgian‐Smith, D., Tambouret, R., Birdwell, R. L., & Wolfe, J. M. (2013) · Psychonomic Bulletin & Review · doi:10.3758/s13423-013-0459-3 · Cited by 144
Zhao, Y., de Bock, G. H., Vliegenthart, R., van Klaveren, R. J., Wang, Y., Bogoni, L., de Jong, P. A., Mali, W. P. T. M., van Ooijen, P. M. A., & Oudkerk, M. (2012) · European Radiology · doi:10.1007/s00330-012-2437-y · Cited by 138
Kundel, H. L., Nodine, C. F., & Krupinski, E. A. (1989) · Investigative Radiology · doi:10.1097/00004424-198906000-00012 · Cited by 134
Do Telephone Call Interruptions Have an Impact on Radiology Resident Diagnostic Accuracy?
Balint, B., Steenburg, S. D., Lin, H., Shen, C., Steele, J. L., & Gunderman, R. B. (2014) · Academic Radiology · doi:10.1016/j.acra.2014.08.001 · Cited by 130
Generalized “satisfaction of search”: Adverse influences on dual-target search accuracy.
Fleck, M. S., Samei, E., & Mitroff, S. R. (2010) · Journal of Experimental Psychology Applied · doi:10.1037/a0018629 · Cited by 127
Kundel, H. L., Nodine, C. F., & Krupinski, E. A. (1989) · PubMed · Cited by 115
Wormanns, D., Ludwig, K., Beyer, F., Heindel, W. L., & Diederich, S. (2004) · European Radiology · doi:10.1007/s00330-004-2527-6 · Cited by 114
Highly Informative Natural Scene Regions Increase Microsaccade Production during Visual Scanning
McCamy, M. B., Otero‐Millan, J., Stasi, L. L. D., Macknik, S. L., & Martínez‐Conde, S. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.4448-13.2014 · Cited by 111
The Handbook of Medical Image Perception and Techniques
Samei, E., & Krupinski, E. A. (2009) · Cited by 110
Sokolovskaya, E., Shinde, T., Ruchman, R. B., Kwak, A. J., Lu, S., Shariff, Y. K., Wiggins, E. F., & Talangbayan, L. (2015) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2015.03.040 · Cited by 106
The role of specialist neuroradiology second opinion reporting: is there added value?
Briggs, G. M., Flynn, P., Worthington, M., Rennie, I. M., & McKinstry, C. S. (2008) · Clinical Radiology · doi:10.1016/j.crad.2007.12.002 · Cited by 104
Radiological error: analysis, standard setting, targeted instruction and teamworking
Fitzgerald, R. H. (2005) · European Radiology · doi:10.1007/s00330-005-2662-8 · Cited by 99
Do Long Radiology Workdays Affect Nodule Detection in Dynamic CT Interpretation?
Krupinski, E. A., Berbaum, K. S., Caldwell, R. T., Schartz, K. M., Madsen, M. T., & Kramer, D. J. (2012) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2011.11.013 · Cited by 98
Freedman, M. T., Lo, S.-C. B., Seibel, J. C., & Bromley, C. M. (2011) · Radiology · doi:10.1148/radiol.11100153 · Cited by 98
Computer-Displayed Eye Position as a Visual Aid to Pulmonary Nodule Interpretation
Kundel, H. L., Nodine, C. F., & Krupinski, E. A. (1990) · Investigative Radiology · doi:10.1097/00004424-199008000-00004 · Cited by 96
Investigating the link between radiologists' gaze, diagnostic decision, and image content
Tourassi, G. D., Voisin, S., Paquit, V., & Krupinski, E. A. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-001503 · Cited by 94
The Role of Perception in Imaging: Past and Future
Krupinski, E. A. (2011) · Seminars in Nuclear Medicine · doi:10.1053/j.semnuclmed.2011.05.002 · Cited by 86
The Effect of Abnormality-Prevalence Expectation on Expert Observer Performance and Visual Search
Reed, W. M., Ryan, J. T., McEntee, M. F., Evanoff, M. G., & Brennan, P. (2011) · Radiology · doi:10.1148/radiol.10101090 · Cited by 86
An Analysis of Perceptual and Cognitive Factors in Radiographic Interpretation
Carmody, D. P., Nodine, C. F., & Kundel, H. L. (1980) · Perception · doi:10.1068/p090339 · Cited by 85
Impact of clinical history on fracture detection with radiography.
Berbaum, K. S., el-Khoury, G. Y., Franken, E., et al. (1988) · Radiology · doi:10.1148/radiology.168.2.3393672 · Cited by 85
Prevalence of Eye Strain Among Radiologists: Influence of Viewing Variables on Symptoms
Vertinsky, T., & Forster, B. B. (2005) · American Journal of Roentgenology · doi:10.2214/ajr.184.2.01840681 · Cited by 84
Lung lesions: correlation between viewing time and detection.
Oestmann, J. W., Greene, R., Kushner, D. C., Bourgouin, P. M., Linetsky, L., & Llewellyn, H. J. (1988) · Radiology · doi:10.1148/radiology.166.2.3336720 · Cited by 84
Key Concepts of Patient Safety in Radiology
Larson, D. B., Kruskal, J. B., Krecke, K. N., & Donnelly, L. F. (2015) · Radiographics · doi:10.1148/rg.2015140277 · Cited by 81
HOW DO RADIOLOGISTS USE THE HUMAN SEARCH ENGINE?
Wolfe, J. M., Evans, K. K., Drew, T., Aizenman, A., & Josephs, E. (2015) · Radiation Protection Dosimetry · doi:10.1093/rpd/ncv501 · Cited by 74
Lung Nodule CAD Software as a Second Reader
WHITE, C. S., Pugatch, R. D., Koonce, T., Rust, S. W., & Dharaiya, E. (2008) · Academic Radiology · doi:10.1016/j.acra.2007.09.027 · Cited by 72
After-hours radiology: challenges and strategies for the radiologist
Rohatgi, S., Hanna, T. N., Sliker, C. W., Abbott, R. M., & Nicola, R. (2015) · American Journal of Roentgenology · doi:10.2214/ajr.15.14605 · Cited by 62
Measuring Observer Performance in Chest Radiology: Some Experiences
Potchen, E. J. (2006) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2006.02.020 · Cited by 61
Missed Lesions at Abdominal Oncologic CT: Lessons Learned from Quality Assurance
Siewert, B., Sosna, J., McNamara, A., et al. (2008) · Radiographics · doi:10.1148/rg.283075188 · Cited by 59
Sabih, D., Sabih, A., Sabih, Q., & Khan, A. N. (2010) · Insights into Imaging · doi:10.1007/s13244-010-0048-1 · Cited by 58
Berlin, L. (2000) · American Journal of Roentgenology · doi:10.2214/ajr.174.4.1740925 · Cited by 57
Does knowledge of the clinical history affect the accuracy of chest radiograph interpretation?
Good, B. C., Cooperstein, L. A., DeMarino, G. B., Miketic, L. M., Gennari, R. C., Rockette, H. E., & Gur, D. (1990) · American Journal of Roentgenology · doi:10.2214/ajr.154.4.2107662 · Cited by 55
Peer Review in Clinical Radiology Practice
Kaewlai, R., & Abujudeh, H. H. (2012) · American Journal of Roentgenology · doi:10.2214/ajr.11.8143 · Cited by 47
Satisfaction of Search in Chest Radiography 2015
Berbaum, K. S., Krupinski, E. A., Schartz, K. M., Caldwell, R. T., Madsen, M. T., Hur, S., Laroia, A. T., Thompson, B. H., Mullan, B. F., & Franken, E. A. (2015) · Academic Radiology · doi:10.1016/j.acra.2015.07.011 · Cited by 45
Satisfaction of Search from Detection of Pulmonary Nodules in Computed Tomography of the Chest
Berbaum, K. S., Schartz, K. M., Caldwell, R. T., Madsen, M. T., Thompson, B. H., Mullan, B. F., Ellingson, A. N., & Franken, E. A. (2012) · Academic Radiology · doi:10.1016/j.acra.2012.08.017 · Cited by 41
A Perceptually Based Method for Enhancing Pulmonary Nodule Recognition
Krupinski, E. A., Nodine, C. F., & Kundel, H. L. (1993) · Investigative Radiology · doi:10.1097/00004424-199304000-00004 · Cited by 38
Features of non-small cell lung carcinomas overlooked at digital chest radiography
Wu, M., Gotway, M. B., Lee, T. J., Chern, M. S., Cheng, H.-C., Ko, J. S.-C., Sheu, M., & Chang, C.-Y. (2008) · Clinical Radiology · doi:10.1016/j.crad.2007.09.011 · Cited by 35
Chest Radiography: New Technological Developments and Their Applications
van Ginneken, B., Karssemeijer, N., Schaefer-Prokop, C. M., et al. (2014) · Seminars in Respiratory and Critical Care Medicine · doi:10.1055/s-0033-1363447 · Cited by 25
Computer-Aided Nodule Detection System
Li, F., Engelmann, R. M., Armato, S. G., & MacMahon, H. (2015) · Academic Radiology · doi:10.1016/j.acra.2014.11.008 · Cited by 23
Bell, M. E., & Patel, M. D. (2014) · Abdominal Imaging · doi:10.1007/s00261-014-0139-4 · Cited by 21
Did I Miss That: Subtle and Commonly Missed Findings on Chest Radiographs
Ropp, A. M., Waite, S., Reede, D. L., & Patel, J. N. (2014) · Current Problems in Diagnostic Radiology · doi:10.1067/j.cpradiol.2014.09.003 · Cited by 18
Self-citationBone Suppression Increases the Visibility of Invasive Pulmonary Aspergillosis in Chest Radiographs
Schalekamp, S., van Ginneken, B., van den Berk, I. A. H., Hartmann, I. J. C., Snoeren, M. M., Odink, A. E., van Lankeren, W., Pegge, S., Schijf, L. J., Karssemeijer, N., et al. (2014) · PLoS ONE · doi:10.1371/journal.pone.0108551 · Cited by 14
Perceptual Factors in Reading Medical Images
Krupinski, E. A. (2018) · Cambridge University Press eBooks · doi:10.1017/9781108163781.008 · Cited by 8
Cited by
Langlotz, C. P., Allen, B., Erickson, B. J., Kalpathy-Cramer, J., Bigelow, K., Cook, T. S., Flanders, A. E., Lungren, M. P., Mendelson, D. S., Rudie, J. D., et al. (2019) · Radiology · doi:10.1148/radiol.2019190613 · Cited by 368
Bias in Radiology: The How and Why of Misses and Misinterpretations
Busby, L. P., Courtier, J. L., & Glastonbury, C. M. (2018) · RadioGraphics · doi:10.1148/rg.2018170107 · Cited by 277
Perceptual and interpretive error in diagnostic radiology—causes and potential solutions
Degnan, A. J., Ghobadi, E. H., Hardy, P., Krupinski, E., Scali, E. P., Stratchko, L., Ulano, A., Walker, E., Wasnik, A. P., & Auffermann, W. F. (2019) · Academic Radiology · doi:10.1016/j.acra.2018.11.006 · Cited by 121
Artificial Intelligence and Machine Learning Applied at the Point of Care
Angehrn, Z., Haldna, L., Zandvliet, A. S., Gil Berglund, E., Zeeuw, J., Amzal, B., Cheung, S. Y. A., Polasek, T. M., Pfister, M., Kerbusch, T., et al. (2020) · Frontiers in Pharmacology · doi:10.3389/fphar.2020.00759 · Cited by 93
“The volume of medical images requiring interpretation have been increasing systematically in the recent decades, reaching for example 1 billion radiographic examinations annually (Waite et al., 2017) and exerting a pressure on the healthcare systems to secure an increasing number of radiologists.”
MARCH: Multi-Agent Radiology Clinical Hierarchy for CT Report Generation
Lin, Y., Ding, Y., Wu, Y., & Peng, Y. (2026) · Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/2026.acl-short.24 · Cited by 5
Metadata
- Authors
- Waite, S., Scott, J., Gale, B., Fuchs, T., Kolla, S., & Reede, D.
- Venue
- American Journal of Roentgenology
- Publisher
- American Roentgen Ray Society
- Published
- 2017-04
- Volume
- 208
- Issue
- 4
- Pages
- 739-749
- ISSN
- 0002-9580 (ISSN-L)
- 0361-803X
- 1546-3141
- OpenAlex
- W2563780839
- Cited by
- 271
- References
- 75
- FWCI
- 13.67
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.