Added value of double reading in diagnostic radiology,a systematic review
Open accessThe DOI matches its Crossref record; 174 of the 174 references it cites were found in a registry or an index.
Abstract
OBJECTIVES: Double reading in diagnostic radiology can find discrepancies in the original report, but a systematic program of double reading is resource consuming. There are conflicting opinions on the value of double reading. The purpose of the current study was to perform a systematic review on the value of double reading. METHODS: A systematic review was performed to find studies calculating the rate of misses and overcalls with the aim of establishing the added value of double reading by human observers. RESULTS: The literature search resulted in 1610 hits. After abstract and full-text reading, 46 articles were selected for analysis. The rate of discrepancy varied from 0.4 to 22% depending on study setting. Double reading by a sub-specialist, in general, led to high rates of changed reports. CONCLUSIONS: The systematic review found rather low discrepancy rates. The benefit of double reading must be balanced by the considerable number of working hours a systematic double-reading scheme requires. A more profitable scheme might be to use systematic double reading for selected, high-risk examination types. A second conclusion is that there seems to be a value of sub-specialisation for increased report quality. A consequent implementation of this would have far-reaching organisational effects. KEY POINTS: • In double reading, two or more radiologists read the same images. • A systematic literature review was performed. • The discrepancy rates varied from 0.4 to 22% in various studies. • Double reading by sub-specialists found high discrepancy rates.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, in a clinical setting, physicians often receive advice from colleagues, or are asked to re-review cases from someone else to give a second opinion13,14.”
From Non-task expert physicians benefit from correct explainable AI advice when reviewing X-rays (2023) · cites this paper as [14]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Audit and feedback: effects on professional practice and healthcare outcomes
Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub3 · Cited by 5,485
Error and discrepancy in radiology: inevitable or avoidable?
Brady, A. P. (2017) · Insights into Imaging · doi:10.1007/s13244-016-0534-1 · Cited by 570
Johnson, C. D., Harmsen, W. S., Wilson, L. A., Maccarty, R. L., Welch, T. J., Ilstrup, D. M., & Ahlquist, D. A. (2003) · Gastroenterology · doi:10.1016/s0016-5085(03)00894-1 · Cited by 351
Rubin, G. D., Lyo, J. K., Paik, D. S., Sherbondy, A. J., Chow, L. C., Leung, A. N., Mindelzun, R., Schraedley-Desmond, P. K., Zinck, S. E., Naidich, D. P., et al. (2005) · Radiology · doi:10.1148/radiol.2341040589 · Cited by 259 · cited 1×
“& In chest CT for pulmonary nodules, double reading increased sensitivity [8, 22, 23], but computer-aided diagnosis (CAD) was even more beneficial [8, 22].”
BackgroundGarland, L. H. (1949) · Radiology · doi:10.1148/52.3.309 · Cited by 239 · cited 1×
“The concept of observer variation in radiology was introduced in the late 1940’s when tuberculosis screening with mass chest radiography was evaluated [3, 4].”
BackgroundRADPEER quality assurance program: a multifacility study of interpretive disagreement rates
Borgstede, J. P., Lewis, R. S., Bhargavan, M., & Sunshine, J. H. (2004) · Journal of the American College of Radiology · doi:10.1016/s1546-1440(03)00002-4 · Cited by 203
Variation between experienced observers in the interpretation of accident and emergency radiographs.
Robinson, P. J., Wilson, D., Coral, A., Murphy, A., & Verow, P. (1999) · The British Journal of Radiology · doi:10.1259/bjr.72.856.10474490 · Cited by 162 · cited 1×
“& Two articles quoted 3–9% disagreement between observers in general radiography [30, 31].”
BackgroundDetection of flat lesions in the colon with CT colonography
Fidler, J. L., Johnson, C. D., MacCarty, R. L., Welch, T. L., Hara, A. K., & Harmsen, W. S. (2002) · Abdominal Imaging · doi:10.1007/s00261-001-0171-z · Cited by 150
Birkelo, C. C., & CHAMBERLAIN, W. E. (1947) · JAMA · doi:10.1001/jama.1947.02880060001001 · Cited by 144 · cited 2×
“The concept of observer variation in radiology was introduced in the late 1940’s when tuberculosis screening with mass chest radiography was evaluated [3, 4].”
BackgroundAccuracy and Its Relationship to Experience in the Interpretation of Chest Radiographs
Herman, P. G., & Hessel, S. J. (1975) · Investigative Radiology · doi:10.1097/00004424-197501000-00008 · Cited by 139
Cited by
Wang, X., Shen, T., Yang, S., Lan, J., Xu, Y., Wang, M., Zhang, J., & Han, X. (2021) · NeuroImage: Clinical · doi:10.1016/j.nicl.2021.102785 · Cited by 192
“A more commonly adopted peer review process is the retrospective double reading of cases, as implemented by the American College of Radiology’s RadPeer program [22].”
MethodArtificial Intelligence in Radiology—Ethical Considerations
Brady, A. P., & Neri, E. (2020) · Diagnostics · doi:10.3390/diagnostics10040231 · Cited by 150
“Furthermore, not all radiologists will come to the same conclusion about an imaging study; ground truth labelling accuracy can be enhanced by combining interpretations by more than one radiologist [17].”
BackgroundMandating Limits on Workload, Duty, and Speed in Radiology
Alexander, R. G., Waite, S., Bruno, M. A., Krupinski, E. A., Berlin, L., Macknik, S. L., & Martínez‐Conde, S. (2022) · Radiology · doi:10.1148/radiol.212631 · Cited by 168
“In a systemic review of double reading, Geijer and Geijer (104) found that the rate of discrepancy ranged from insignificant to over 22% depending on the study setting.”
BackgroundGenerative Artificial Intelligence for Chest Radiograph Interpretation in the Emergency Department
Huang, J., Neill, L., Wittbrodt, M., Melnick, D., Klug, M., Thompson, M., Bailitz, J., Loftus, T., Malik, S., Phull, A., et al. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.36100 · Cited by 113
Non-task expert physicians benefit from correct explainable AI advice when reviewing X-rays
Gaube, S., Suresh, H., Raue, M., Lermer, E., Koch, T. K., Hudecek, M. F. C., Ackery, A. D., Grover, S. C., Coughlin, J. F., Frey, D., et al. (2023) · Scientific Reports · doi:10.1038/s41598-023-28633-w · Cited by 92
Metadata
- Authors
- Geijer, H., & Geijer, M.
- Affiliations
- Örebro University (SE)
- Lund University (SE)
- Corresponding author
- Geijer, Håkan
- Venue
- Insights into Imaging
- Published
- 2018-03-28
- Volume
- 9
- Issue
- 3
- Pages
- 287-301
- ISSN
- 1869-4101 (ISSN-L)
- PMC
- PMC5990995
- OpenAlex
- W2794467195
- Cited by
- 117
- References
- 174
- Citations by year
- 2026: 12 · 2025: 18 · 2024: 19 · 2023: 23 · 2022: 9 · 2021: 17 · 2020: 12 · 2019: 7
- FWCI
- 1.40
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- Locations
- Insights into Imaging (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Lund University Publications (Lund University) (submittedVersion)
- Funders
- Örebro Universitet
- Topics
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiology practices and education
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › General Health Professions › Healthcare cost, quality, practices
- Keywords
- double reading, diagnostic radiology, missed diagnosis, reporting quality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Added value of double reading in diagnostic radiology,a systematic review. https://app.cochat.ai/papers/10.1007/s13244-018-0599-0
- The paper
- Geijer, H., & Geijer, M. (2018). Added value of double reading in diagnostic radiology,a systematic review. Insights into Imaging. https://doi.org/10.1007/s13244-018-0599-0
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
