Added value of double reading in diagnostic radiology,a systematic review
Open accessThe DOI matches its Crossref record; 174 of the 174 references it cites were found in a registry or an index.
Abstract
OBJECTIVES: Double reading in diagnostic radiology can find discrepancies in the original report, but a systematic program of double reading is resource consuming. There are conflicting opinions on the value of double reading. The purpose of the current study was to perform a systematic review on the value of double reading. METHODS: A systematic review was performed to find studies calculating the rate of misses and overcalls with the aim of establishing the added value of double reading by human observers. RESULTS: The literature search resulted in 1610 hits. After abstract and full-text reading, 46 articles were selected for analysis. The rate of discrepancy varied from 0.4 to 22% depending on study setting. Double reading by a sub-specialist, in general, led to high rates of changed reports. CONCLUSIONS: The systematic review found rather low discrepancy rates. The benefit of double reading must be balanced by the considerable number of working hours a systematic double-reading scheme requires. A more profitable scheme might be to use systematic double reading for selected, high-risk examination types. A second conclusion is that there seems to be a value of sub-specialisation for increased report quality. A consequent implementation of this would have far-reaching organisational effects. KEY POINTS: • In double reading, two or more radiologists read the same images. • A systematic literature review was performed. • The discrepancy rates varied from 0.4 to 22% in various studies. • Double reading by sub-specialists found high discrepancy rates.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, in a clinical setting, physicians often receive advice from colleagues, or are asked to re-review cases from someone else to give a second opinion13,14.”
From Non-task expert physicians benefit from correct explainable AI advice when reviewing X-rays (2023) · cites this paper as [14]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Audit and feedback: effects on professional practice and healthcare outcomes
Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub3 · Cited by 5,485
Error and discrepancy in radiology: inevitable or avoidable?
Brady, A. P. (2017) · Insights into Imaging · doi:10.1007/s13244-016-0534-1 · Cited by 570
Johnson, C. D., Harmsen, W. S., Wilson, L. A., Maccarty, R. L., Welch, T. J., Ilstrup, D. M., & Ahlquist, D. A. (2003) · Gastroenterology · doi:10.1016/s0016-5085(03)00894-1 · Cited by 351
Rubin, G. D., Lyo, J. K., Paik, D. S., Sherbondy, A. J., Chow, L. C., Leung, A. N., Mindelzun, R., Schraedley-Desmond, P. K., Zinck, S. E., Naidich, D. P., et al. (2005) · Radiology · doi:10.1148/radiol.2341040589 · Cited by 259 · cited 1×
“& In chest CT for pulmonary nodules, double reading increased sensitivity [8, 22, 23], but computer-aided diagnosis (CAD) was even more beneficial [8, 22].”
BackgroundGarland, L. H. (1949) · Radiology · doi:10.1148/52.3.309 · Cited by 239 · cited 1×
“The concept of observer variation in radiology was introduced in the late 1940’s when tuberculosis screening with mass chest radiography was evaluated [3, 4].”
BackgroundRADPEER quality assurance program: a multifacility study of interpretive disagreement rates
Borgstede, J. P., Lewis, R. S., Bhargavan, M., & Sunshine, J. H. (2004) · Journal of the American College of Radiology · doi:10.1016/s1546-1440(03)00002-4 · Cited by 203
Variation between experienced observers in the interpretation of accident and emergency radiographs.
Robinson, P. J., Wilson, D., Coral, A., Murphy, A., & Verow, P. (1999) · The British Journal of Radiology · doi:10.1259/bjr.72.856.10474490 · Cited by 162 · cited 1×
“& Two articles quoted 3–9% disagreement between observers in general radiography [30, 31].”
BackgroundDetection of flat lesions in the colon with CT colonography
Fidler, J. L., Johnson, C. D., MacCarty, R. L., Welch, T. L., Hara, A. K., & Harmsen, W. S. (2002) · Abdominal Imaging · doi:10.1007/s00261-001-0171-z · Cited by 150
Birkelo, C. C., & CHAMBERLAIN, W. E. (1947) · JAMA · doi:10.1001/jama.1947.02880060001001 · Cited by 144 · cited 2×
“The concept of observer variation in radiology was introduced in the late 1940’s when tuberculosis screening with mass chest radiography was evaluated [3, 4].”
BackgroundAccuracy and Its Relationship to Experience in the Interpretation of Chest Radiographs
Herman, P. G., & Hessel, S. J. (1975) · Investigative Radiology · doi:10.1097/00004424-197501000-00008 · Cited by 139
Jackson, V. P., Cushing, T., Abujudeh, H. H., Borgstede, J. P., Chin, K. W., Grimes, C. K., Larson, D. B., Larson, P. A., Pyatt, R. S., & Thorwarth, W. T. (2008) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2008.06.011 · Cited by 139
Zhao, Y., de Bock, G. H., Vliegenthart, R., van Klaveren, R. J., Wang, Y., Bogoni, L., de Jong, P. A., Mali, W. P. T. M., van Ooijen, P. M. A., & Oudkerk, M. (2012) · European Radiology · doi:10.1007/s00330-012-2437-y · Cited by 138
Eakins, C., Ellis, W. D., Pruthi, S., Johnson, D. P., Hernanz‐Schulman, M., Yu, C. S., & Kan, J. H. (2012) · American Journal of Roentgenology · doi:10.2214/ajr.11.7662 · Cited by 120 · cited 1×
“[49] found a high rate of discrepancies in neuroimaging and body studies, while discrepancies were much rarer in extremity radiography [50].”
ResultLarson, D. B., Donnelly, L. F., Podberesky, D. J., Merrow, A. C., Sharpe, R. E., & Kruskal, J. B. (2016) · Radiology · doi:10.1148/radiol.2016161254 · Cited by 115
Wormanns, D., Ludwig, K., Beyer, F., Heindel, W. L., & Diederich, S. (2004) · European Radiology · doi:10.1007/s00330-004-2527-6 · Cited by 114 · cited 1×
“& In chest CT for pulmonary nodules, double reading increased sensitivity [8, 22, 23], but computer-aided diagnosis (CAD) was even more beneficial [8, 22].”
BackgroundRadiographic screening in the early detection of lung cancer.
Stitik, F. P., & Ms, T. (1978) · PubMed · Cited by 110
Scaranelo, A. M., Eiada, R., Jacks, L. M., Kulkarni, S. R., & Crystal, P. (2011) · Radiology · doi:10.1148/radiol.11110639 · Cited by 108
Warren, R. M. L., Pointon, L. J., Thompson, D. J., Hoff, R., Gilbert, F. J., Padhani, A. R., Easton, D. F., Lakhani, S. R., & Leach, M. O. (2005) · Radiology · doi:10.1148/radiol.2363040735 · Cited by 107 · cited 1×
“& In breast MRI, double reading increased sensitivity from 80 to 91%, while reducing specificity from 88 to 81% [34].”
Backgroundden Boon, S., Bateman, E. D., Enarson, D. A., Borgdorff, M. W., Verver, S., Lombard, C. J., Irusen, E. M., Beyers, N., & White, N. W. (2005) · PubMed · Cited by 105
Second-Opinion Consultations in Neuroradiology
Zan, E., Yousem, D. M., Carone, M., & Lewin, J. S. (2010) · Radiology · doi:10.1148/radiol.09090831 · Cited by 105 · cited 1×
“& In neuroradiology, two articles demonstrated the benefit from sub-specialist second opinion [46, 47], while two did not [45, 48].”
BackgroundThe role of specialist neuroradiology second opinion reporting: is there added value?
Briggs, G. M., Flynn, P., Worthington, M., Rennie, I. M., & McKinstry, C. S. (2008) · Clinical Radiology · doi:10.1016/j.crad.2007.12.002 · Cited by 104 · cited 1×
“& In neuroradiology, two articles demonstrated the benefit from sub-specialist second opinion [46, 47], while two did not [45, 48].”
BackgroundPleural Plaques and the Risk of Pleural Mesothelioma
Pairon, J.-C., Laurent, F., Rinaldo, M., Clin, B., Andujar, P., Ameille, J., Brochard, P., Chammings, S., Ferretti, G., Galateau-Sallé, F., et al. (2013) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djs513 · Cited by 100
Rates of disagreement in imaging interpretation in a group of community hospitals
Siegle, R. L., Baram, E. M., Reuter, S. R., Clarke, E. A., Lancaster, J. L., & McMahan, C. A. (1998) · Academic Radiology · doi:10.1016/s1076-6332(98)80277-8 · Cited by 94 · cited 1×
“[33] evaluated general radiology in six departments, and found a mean rate of disagreement of 4.”
BackgroundJohnson, C. D., MacCarty, R. L., Welch, T. J., Wilson, L. A., Harmsen, W. S., Ilstrup, D. M., & Ahlquist, D. A. (2004) · Clinical Gastroenterology and Hepatology · doi:10.1016/s1542-3565(04)00061-8 · Cited by 91
Loevner, L. A., Sonners, A. I., Schulman, B. J., Slawek, K., Weber, R. S., Rosenthal, D. I., Moonis, G., & Chalian, A. A. (2002) · PubMed Central · Cited by 90
Wibmer, A. G., Vargas, H. A., Donahue, T. F., Zheng, J., Moskowitz, C. S., Eastham, J. A., Sala, E., & Hricak, H. (2015) · American Journal of Roentgenology · doi:10.2214/ajr.14.13600 · Cited by 90 · cited 1×
“The discrepancy rates for these varied from about 12% up to 50% [5, 38, 39, 41, 42].”
BackgroundCT in Adults: Systematic Review and Meta-Analysis of Interpretation Discrepancy Rates
Wu, M. Z., McInnes, M. D. F., Macdonald, D. B., Kielar, A. Z., & Duigenan, S. (2013) · Radiology · doi:10.1148/radiol.13131114 · Cited by 84 · cited 1×
“Thoracic and abdominal CT were also associated with more discrepancies than head and spine CT [54].”
BackgroundSoffa, D. J., Lewis, R. S., Sunshine, J. H., & Bhargavan, M. (2004) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2003.12.017 · Cited by 84 · cited 1×
“& Two articles quoted 3–9% disagreement between observers in general radiography [30, 31].”
BackgroundInterpretation of Abdominal CT: Analysis of Errors and Their Causes
Bechtold, R. E., Chen, M. Y. M., Ott, D. J., Zagoria, R. J., Scharling, E. S., Wolfman, N. T., & Vining, D. J. (1997) · Journal of Computer Assisted Tomography · doi:10.1097/00004728-199709000-00001 · Cited by 79
Gollub, M. J., Panicek, D. M., Bach, A. M., Penalver, A., & Castellino, R. A. (1999) · Radiology · doi:10.1148/radiology.210.1.r99ja47109 · Cited by 79
Double-contrast barium enema studies: effect of multiple reading on perception error.
Markus, J. B., Somers, S., O'malley, B., & Stevenson, G. W. (1990) · Radiology · doi:10.1148/radiology.175.1.2315474 · Cited by 74
Saurin, J.-C., Pilleul, F., Soussan, E., Manière, T., D’Halluin, P., Gaudric, M., Cellier, C., Heresbach, D., & Gaudin, J.-L. (2010) · Endoscopy · doi:10.1055/s-0030-1255742 · Cited by 74
Assessing intra, inter and total agreement with replicated readings
Barnhart, H. X., Song, J., & Haber, M. (2004) · Statistics in Medicine · doi:10.1002/sim.2006 · Cited by 73
Asbestos Exposure, Pleural Plaques, and the Risk of Death from Lung Cancer
Pairon, J. ‐., Andujar, P., Rinaldo, M., Ameille, J., Brochard, P., Chamming’s, S., Clin, B., Ferretti, G., Gislard, A., Laurent, F., et al. (2014) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.201406-1074oc · Cited by 73
Interrater Agreement in the Evaluation of Discrepant Imaging Findings With the Radpeer System
Bender, L. C., Linnau, K. F., Meier, E. N., Anzai, Y., & Gunn, M. L. (2012) · American Journal of Roentgenology · doi:10.2214/ajr.12.8972 · Cited by 67
Reliability of chest radiography in the diagnosis of pulmonary lesions
Yerushalmy, J. (1955) · The American Journal of Surgery · doi:10.1016/0002-9610(55)90525-0 · Cited by 66
CT Virtual Bronchoscopy of the Central Airways in Patients With Wegener's Granulomatosis
Summers, R. M., Aggarwal, N. R., Sneller, M. C., Cowan, M. J., Wood, B. J., Langford, C. A., & Shelhamer, J. H. (2002) · CHEST Journal · doi:10.1378/chest.121.1.242 · Cited by 65
Computer-Aided Diagnosis as a Second Reader
Peldschus, K., Herzog, P., Wood, S. A., Cheema, J. I., Costello, P., & Schoepf, U. J. (2005) · CHEST Journal · doi:10.1378/chest.128.3.1517 · Cited by 64
Observations on the Results of Multiple Readings of Chest Films in Coal Miners' Pneumoconiosis
Felson, B., Morgan, W. K. C., Bristol, L. J., Pendergrass, E. P., Dessen, E. L., Linton, O., & Reger, R. B. (1973) · Radiology · doi:10.1148/109.1.19 · Cited by 64
Outside CT Imaging Among Emergency Department Transfer Patients
Sung, J. C., Sodickson, A. D., & Ledbetter, S. M. (2009) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2009.04.010 · Cited by 64
Survey of Faculty Perceptions Regarding a Peer Review System
Eisenberg, R. L., Cunningham, M. L., Siewert, B., & Kruskal, J. B. (2013) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2013.08.011 · Cited by 63
Yoon, L. S., Haims, A. H., Brink, J. A., Rabinovici, R., & Forman, H. P. (2002) · Radiology · doi:10.1148/radiol.2241011470 · Cited by 63
Quality assurance in radiology: peer review and peer feedback
Strickland, N. H. (2015) · Clinical Radiology · doi:10.1016/j.crad.2015.06.091 · Cited by 62
Johnson, C. D., Manduca, A., Fletcher, J. G., MacCarty, R. L., Carston, M. J., Harmsen, W. S., & Mandrekar, J. N. (2008) · American Journal of Roentgenology · doi:10.2214/ajr.07.2700 · Cited by 62
RADPEER Peer Review: Relevance, Use, Concerns, Challenges, and Direction Forward
Abujudeh, H. H., Pyatt, R. S., Bruno, M. A., Chetlen, A. L., Buck, D., Hobbs, S. K., Roth, C. J., Truwit, C. L., Agarwal, R., Kennedy, S., et al. (2014) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2014.02.004 · Cited by 61
Lauritzen, P. M., Andersen, J. G., Stokke, M. V., Tennstrand, A. L., Aamodt, R., Heggelund, T., Dahl, F. A., Sandbæk, G., Hurlen, P., & Gulbrandsen, P. (2016) · BMJ Quality & Safety · doi:10.1136/bmjqs-2015-004536 · Cited by 53
Radiology peer review as an opportunity to reduce errors and improve patient care
Halsted, M. J. (2004) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2004.06.005 · Cited by 51
Babiarz, L. S., & Yousem, D. M. (2011) · American Journal of Neuroradiology · doi:10.3174/ajnr.a2704 · Cited by 51 · cited 1×
“& Babiarz and Yousem [35] found 2% disagreement when 1,000 neuroradiology cases were double read by another neuroradiologist, all working in the same institution.”
BackgroundImproving Performance by Multiple Interpretations of Chest Radiographs: Effectiveness and Cost
Hessel, S. J., Herman, P. G., & Swensson, R. G. (1978) · Radiology · doi:10.1148/127.3.589 · Cited by 51 · cited 2×
“In contrast to the Btrue arbitration^ model, the third reader is not aware of the specific disagreement(s) [7].”
ResultWormanns, D., Beyer, F., Diederich, S., Ludwig, K., & Heindel, W. L. (2004) · RöFo - Fortschritte auf dem Gebiet der Röntgenstrahlen und der bildgebenden Verfahren · doi:10.1055/s-2004-813251 · Cited by 48
Brook, O. R., Kane, R. A., Tyagi, G., Siewert, B., & Kruskal, J. B. (2011) · American Journal of Roentgenology · doi:10.2214/ajr.10.5170 · Cited by 46
Eurin, M., Haddad, N., Zappa, M., Lenoir, T., Dauzac, C., Vilgrain, V., Mantz, J., & Paugam‐Burtz, C. (2011) · Injury · doi:10.1016/j.injury.2011.05.019 · Cited by 45 · cited 1×
“[16] reported a high rate of missed injuries initially, predominantly minor and musculoskeletal injuries.”
BackgroundAudit of the value of double reading magnetic resonance imaging films
Wakeley, C. J., Jones, A. M., Kabala, J. E., Prince, D., & Goddard, P. R. (1995) · British Journal of Radiology · doi:10.1259/0007-1285-68-808-358 · Cited by 43
Consensus-Oriented Group Peer Review: A New Process to Review Radiologist Work Output
Alkasab, T. K., Harvey, H. B., Gowda, V., Thrall, J. H., Rosenthal, D. I., & Gazelle, G. S. (2013) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2013.04.013 · Cited by 43
Gunn, A. J., Alabre, C. I., Bennett, S. E., Kautzky, M., Krakower, T. M., Palamara, K., & Choy, G. (2013) · American Journal of Roentgenology · doi:10.2214/ajr.12.10450 · Cited by 42
Kabadi, S. J., & Krishnaraj, A. (2016) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2016.08.033 · Cited by 41
Kopans, D. B. (2000) · Radiologic Clinics of North America · doi:10.1016/s0033-8389(05)70196-2 · Cited by 41
Nitowski, L., O’Connor, R. E., & Reese, C. L. (1996) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.1996.tb03515.x · Cited by 40
Detection of lung cancer on the chest radiograph
Quekel, L. G. B. A., Goei, R., Kessels, A. G. H., & van Engelshoven, J. M. A. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(01)00382-1 · Cited by 38 · cited 2×
“In dual reading, the two readers reach a consensus over the differing reports [6].”
BackgroundBrinjikji, W., Kallmes, D. F., White, J. B., Lanzino, G. S., Morris, J. M., & Cloft, H. J. (2010) · American Journal of Neuroradiology · doi:10.3174/ajnr.a1988 · Cited by 38
CT Colonography Using 360° Virtual Dissection: A Feasibility Study
Johnson, K. T., Johnson, C. D., Fletcher, J. G., MacCarty, R. L., & Summers, R. L. (2005) · American Journal of Roentgenology · doi:10.2214/ajr.04.1658 · Cited by 37
Law, R. L., Longstaff, A. J., & Slack, N. F. (1999) · Clinical Radiology · doi:10.1016/s0009-9260(99)91063-2 · Cited by 37
Sun, H., Xue, H., Wang, Y.-N., Qian, J.-M., Yu, J., Zhu, F., Zhu, H., Jin, Z., & Li, X.-G. (2012) · Clinical Radiology · doi:10.1016/j.crad.2012.06.106 · Cited by 36
Colonoscopically detected colorectal cancer missed on barium enema
Andersen, N., Cook, H. B., & Coates, R. (1991) · Abdominal Imaging · doi:10.1007/bf01887325 · Cited by 36
Intérêt de la double lecture du scanner corps entier dans la prise en charge des polytraumatisés
Agostini, C., Durieux, M., Milot, L. M., Kamaoui, I., Floccard, B., Allaouchiche, B., & Pilleul, F. (2008) · Journal de Radiologie · doi:10.1016/s0221-0363(08)93007-9 · Cited by 36
Interpretation Errors in CT Angiography of the Head and Neck and the Benefit of Double Reading
Lian, K., Bharatha, A., Aviv, R. I., & Symons, S. P. (2011) · American Journal of Neuroradiology · doi:10.3174/ajnr.a2678 · Cited by 36
RELIABILITY OF INTERPRETATION OF CRANIAL ULTRASOUND EXAMINATIONS OF VERY LOW‐BIRTHWEIGHT NEONATES
O’Shea, T. M., Volberg, F. M., & Dillard, R. G. (1993) · Developmental Medicine & Child Neurology · doi:10.1111/j.1469-8749.1993.tb11611.x · Cited by 35
Kalbhen, C. L., Yetter, E. M., Olson, M. C., Posniak, H. V., & Aranha, G. V. (1998) · American Journal of Roentgenology · doi:10.2214/ajr.171.6.9843290 · Cited by 34 · cited 1×
“The discrepancy rates for these varied from about 12% up to 50% [5, 38, 39, 41, 42].”
BackgroundSilk, C. I. (1941) · Diseases of the Chest · doi:10.1378/chest.7.7.241 · Cited by 34
Computer-aided Detection (CAD) in Lung Cancer Screening at Chest MDCT
Fraioli, F., Bertoletti, L., Napoli, A., Pediconi, F., Calabrese, F. A., Masciangelo, R., Catalano, C., & Passariello, R. (2007) · Journal of Thoracic Imaging · doi:10.1097/rti.0b013e318033aae8 · Cited by 34
Inter-observer agreement in the reporting of 99Tcm-DMSA renal studies
Gacinovic, S., Buscombe, J. R., Costa, D. C., Hilson, A. J. W., Bomanji, J. B., & Ell, P. J. (1996) · Nuclear Medicine Communications · doi:10.1097/00006231-199607000-00010 · Cited by 33
Leslie, A., & Virjee, J. (2002) · Clinical Radiology · doi:10.1053/crad.2001.0832 · Cited by 32
Inter-Observer Variation in Interpretation of Chest X-Rays
Shaw, N. J., Hendry, M., & Eden, O. B. (1990) · Scottish Medical Journal · doi:10.1177/003693309003500505 · Cited by 32
A comparison of radiographer and radiologist reports on radiographer conducted barium enemas
Murphy, M., Loughran, C. F., Birchenough, H., Savage, J., & Sutcliffe, C. (2002) · Radiography · doi:10.1053/radi.2002.0384 · Cited by 31
Jordan, M. J., Lightfoote, J. B., & Jordan, J. E. (2006) · PubMed · Cited by 30
Reduction of perception error by double reporting of minimal preparation CT colon
Murphy, R., Slater, A., Uberoi, R., Bungay, H. K., & Ferrett, C. G. (2010) · British Journal of Radiology · doi:10.1259/bjr/65634575 · Cited by 30 · cited 1×
“In CT of ovarian cancer and CT colonography, there was a non-significant trend towards higher sensitivity in double reading [18, 19], but double reading increased the false-positive rate [20].”
BackgroundRadiologist Peer Review by Group Consensus
Harvey, H. B., Alkasab, T. K., Prabhakar, A. M., Halpern, E. F., Rosenthal, D. I., Pandharipande, P. V., & Gazelle, G. S. (2016) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2015.11.013 · Cited by 30
Swanson, J. O., Thapa, M. M., Iyer, R. S., Otto, R. K., & Weinberger, E. (2012) · American Journal of Roentgenology · doi:10.2214/ajr.11.6724 · Cited by 29
Tilleman, E. H. B. M., Phoa, S. S. K. S., van Delden, O. M., Rauws, E. A., van Gulik, T. M., Laméris, J. S., & Gouma, D. J. (2003) · European Radiology · doi:10.1007/s00330-002-1579-8 · Cited by 29 · cited 1×
“The discrepancy rates for these varied from about 12% up to 50% [5, 38, 39, 41, 42].”
BackgroundTribl, B., Turetschek, K., Mostbeck, G., Schneider, B., Stain, C., Pötzi, R., Gangl, A., & Vogelsang, H. (1998) · Endoscopy · doi:10.1055/s-2007-1001279 · Cited by 28 · cited 1×
“& Two articles found negligible improvement by double reading in small-bowel and large-bowel barium studies, one study even reported increased false positives with double reading [27, 28].”
BackgroundWang, Y., van Klaveren, R. J., de Bock, G. H., Zhao, Y., Vernhout, R. M., Leusveld, A. L. M., Scholten, E. T., Verschakelen, J., Mali, W. P. T. M., de Koning, H. J., et al. (2011) · Radiology · doi:10.1148/radiol.11102289 · Cited by 28
Pow, R. E., Mello-Thoms, C. R., & Brennan, P. (2016) · Journal of Medical Imaging and Radiation Oncology · doi:10.1111/1754-9485.12450 · Cited by 28
Lindgren, E. A., Patel, M. D., Wu, Q., Melikian, J., & Hara, A. K. (2014) · Abdominal Imaging · doi:10.1007/s00261-014-0140-y · Cited by 27 · cited 3×
“The discrepancy rates for these varied from about 12% up to 50% [5, 38, 39, 41, 42].”
BackgroundProvenzale, J. M., & Kranz, P. G. (2011) · Emergency Radiology · doi:10.1007/s10140-011-0974-3 · Cited by 26
Connolly, D. J. A., Traill, Z. C., Reid, H. S., Copley, S. J., & Nolan, D. J. (2002) · Clinical Radiology · doi:10.1053/crad.2001.0724 · Cited by 26
Nellensteijn, D. R., ten Duis, H. J., Oldenziel, J. H., Polak, W. G., & Hulscher, J. B. F. (2009) · European Journal of Pediatric Surgery · doi:10.1055/s-0029-1241818 · Cited by 25
Ovarian Cancer: Comparison of Observer Performance for Four Methods of Interpreting CT Scans
Fultz, P. J., Jacobs, C. V., Hall, W. J., Gottlieb, R. H., Rubens, D. J., Totterman, S. M. S., Meyers, S. P., Angel, C., Priore, G. D., Warshal, D. P., et al. (1999) · Radiology · doi:10.1148/radiology.212.2.r99au19401 · Cited by 25 · cited 1×
“In CT of ovarian cancer and CT colonography, there was a non-significant trend towards higher sensitivity in double reading [18, 19], but double reading increased the false-positive rate [20].”
BackgroundFalse-negative MRI breast screening in high-risk women
Maxwell, A., Lim, Y. Y., Hurley, E., Evans, D. G., Howell, A., & Gadde, S. (2016) · Clinical Radiology · doi:10.1016/j.crad.2016.10.020 · Cited by 25
Marshall, J. K., Cawdron, R., Zealley, I. A., Riddell, R. H., Somers, S., & Irvine, E. J. (2004) · The American Journal of Gastroenterology · doi:10.1111/j.1572-0241.2004.30499.x · Cited by 24
Collin, D., Dunker, D., Göthlin, J., & Geijer, M. (2011) · Acta Radiologica · doi:10.1258/ar.2011.110032 · Cited by 24
Self-citationNeuroimaging in Patients Referred to a Neuro-ophthalmology Service
McClelland, C., Van Stavern, G. P., Shepherd, J. B., Gordon, M., & Huecker, J. (2012) · Ophthalmology · doi:10.1016/j.ophtha.2012.01.044 · Cited by 23
Rosskopf, A. B., Dietrich, T. J., Hirschmann, A. C., Buck, F. M., Sutter, R., & Pfirrmann, C. W. A. (2015) · American Journal of Roentgenology · doi:10.2214/ajr.14.13216 · Cited by 23
Intraobserver and interobserver reliability in assessment of neonatal cranial ultrasounds
Corbett, S., Rosenfeld, C. R., Laptook, A. R., Risser, R. C., Maravilla, A. M., Dowling, S., & Lasky, R. E. (1991) · Early Human Development · doi:10.1016/0378-3782(91)90023-v · Cited by 23
Assessing the impact of CAD on the sensitivity and specificity of film readers
Taylor, P. M., Given-Wilson, R., Champness, J., POTTS, H. W. W., & Johnston, K. (2004) · Clinical Radiology · doi:10.1016/j.crad.2004.04.017 · Cited by 22
Focused Peer Review: The End Game of Peer Review
Hussain, S., Hussain, J. S., Karam, A. R., & Vijayaraghavan, G. R. (2012) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2012.01.015 · Cited by 22
Iussich, G., Correale, L., Senore, C., Hassan, C., Segnan, N., Campanella, D., Bert, A., GALATOLA, G., Laudi, C., & Regge, D. (2014) · Investigative Radiology · doi:10.1097/rli.0000000000000009 · Cited by 22
The clinical usefulness of teleradiology of neonates: expanded services without expanded staff
Slovis, T. L., & Guzzardo-Dobson, P. R. (1991) · Pediatric Radiology · doi:10.1007/bf02011480 · Cited by 21
Evaluation of Competence in the Interpretation of Chest Radiographs
Cascade, P. N., Kazerooni, E. A., Gross, B. H., Quint, L. E., Silver, T. M., Bowerman, R. A., Pernicano, P. G., & Gebremariam, A. (2001) · Academic Radiology · doi:10.1016/s1076-6332(03)80500-7 · Cited by 21 · cited 1×
“& In chest radiography, a statistically significantly higher rate of seemingly obvious misdiagnoses was found for non-chest speciality radiologists [43], while a thoracic radiologist had higher sensitivity and reported fewer indeterminate nodules in chest CT for colorectal cancer [44].”
BackgroundBell, M. E., & Patel, M. D. (2014) · Abdominal Imaging · doi:10.1007/s00261-014-0139-4 · Cited by 21 · cited 1×
“& Bell and Patel [40] reported on 1,303 cases of body CT with the primary report from non-sub-specialised radiologists and found a higher frequency of clinically relevant discrepancies in the 742 cases that were double read by radiologists with a higher degree of sub-specialisation.”
BackgroundHopper, K. D., Rosetti, G. F., Edmiston, R. B., Madewell, J. E., Beam, L. M., Landis, J. R., MILLER, K. L., Ricci, J. A., & McCAUSLIN, M. A. (1991) · Radiology · doi:10.1148/radiology.180.2.2068327 · Cited by 21
Laurent, F., Paris, C., Ferretti, G., Beigelman‐Aubry, C., Montaudon, M., Latrabe, V., Jankowski, A., Badachi, Y., Clin, B., Gislard, A., et al. (2014) · Occupational and Environmental Medicine · doi:10.1136/oemed-2014-102336 · Cited by 21
Iussich, G., Correale, L., Senore, C., Segnan, N., Laghi, A., Iafrate, F., Campanella, D., Neri, E., Cerri, F., Hassan, C., et al. (2013) · Radiology · doi:10.1148/radiol.13121192 · Cited by 20
Geijer, M., Göthlin, G. G., & Jh, G. (2007) · Acta Radiologica · doi:10.1080/02841850701342146 · Cited by 20
Self-citationSheu, Y. R., Feder, E., Balsim, I., Levin, V. F., Bleicher, A. G., & Branstetter, B. F. (2010) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2010.02.001 · Cited by 20
Double reading of current chest CT examinations: Clinical importance of changes to radiology reports
Lauritzen, P. M., Stavem, K., Andersen, J. G., Stokke, M. V., Tennstrand, A. L., Bjerke, G., Hurlen, P., Sandbæk, G., Dahl, F. A., & Gulbrandsen, P. (2015) · European Journal of Radiology · doi:10.1016/j.ejrad.2015.11.012 · Cited by 20 · cited 1×
“Another article found clinically important changes in 9% of cases [24].”
BackgroundUtility of contemporaneous dual read in the setting of emergency teleradiology reporting
Agrawal, A., Koundinya, D. B., Raju, J. S., Agrawal, A., & Kalyanpur, A. (2016) · Emergency Radiology · doi:10.1007/s10140-016-1465-3 · Cited by 20
Quality Outcomes of Reinterpretation of Brain CT Studies by Subspecialty Experts in Stroke Imaging
Jordan, Y. J., Jordan, J. E., Lightfoote, J. B., & Ragland, K. D. (2012) · American Journal of Roentgenology · doi:10.2214/ajr.11.8358 · Cited by 19 · cited 1×
“& In neuroradiology, two articles demonstrated the benefit from sub-specialist second opinion [46, 47], while two did not [45, 48].”
BackgroundThe Next Level of Radiology Peer Review: Enterprise-wide Education and Improvement
Butler, G. J., & Forghani, R. (2013) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2012.12.014 · Cited by 19
Detection of portal venous gas on sonography, but not on CT
Hollerweger, A., & Rettenbacher, T. (2003) · European Radiology · doi:10.1007/s00330-003-1899-3 · Cited by 19
Indeterminate Pulmonary Nodules in Colorectal-Cancer: Do Radiologists Agree?
Nordholm‐Carstensen, A., Jørgensen, L. N., Wille-Jørgensen, P. A., Hansen, H., & Harling, H. (2014) · Annals of Surgical Oncology · doi:10.1245/s10434-014-4063-1 · Cited by 18 · cited 1×
“& In chest radiography, a statistically significantly higher rate of seemingly obvious misdiagnoses was found for non-chest speciality radiologists [43], while a thoracic radiologist had higher sensitivity and reported fewer indeterminate nodules in chest CT for colorectal cancer [44].”
BackgroundFilippi, M., Barkhof, F., Bressi, S., Yousry, T. A., & Miller, D. (1997) · Multiple Sclerosis Journal · doi:10.1177/135245859700300402 · Cited by 18
The value of official reinterpretation of trauma computed tomography scans from referring hospitals
Onwubiko, C., & Mooney, D. P. (2015) · Journal of Pediatric Surgery · doi:10.1016/j.jpedsurg.2015.08.006 · Cited by 17 · cited 1×
“In abdominal trauma CT, 12 new injuries were found in 98 patients [51].”
BackgroundIyer, R. S., Swanson, J. O., Otto, R. K., & Weinberger, E. (2012) · American Journal of Roentgenology · doi:10.2214/ajr.12.9580 · Cited by 17
A Reference Standard-Based Quality Assurance Program for Radiology
Liu, P. T., Johnson, C. D., Miranda, R., Patel, M. D., & Phillips, C. J. (2010) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2009.08.016 · Cited by 17
Diagnostic errors in interpretation of pediatric musculoskeletal radiographs at common injury sites
Bisset, G. S., & Crowe, J. E. (2014) · Pediatric Radiology · doi:10.1007/s00247-013-2869-9 · Cited by 17 · cited 1×
“[49] found a high rate of discrepancies in neuroimaging and body studies, while discrepancies were much rarer in extremity radiography [50].”
ResultKruskal, J. B., & Eisenberg, R. L. (2015) · Current Problems in Diagnostic Radiology · doi:10.1067/j.cpradiol.2015.08.006 · Cited by 17
Double Reading of Barium Enemas: Is It Necessary?
Canon, C. L., Smith, J. K., Morgan, D. E., Jones, B. C., Fell, S. C., Kenney, P. J., Ferrante, D., Lockhart, M. E., Westfall, A. O., & Koehler, R. E. (2003) · American Journal of Roentgenology · doi:10.2214/ajr.181.6.1811607 · Cited by 16 · cited 1×
“& Two articles found negligible improvement by double reading in small-bowel and large-bowel barium studies, one study even reported increased false positives with double reading [27, 28].”
BackgroundTeleradiology for remote diagnosis: A prospective multi-year evaluation
Gale, M. E., Vincent, M. E., & Robbins, A. H. (1997) · Journal of Imaging Informatics in Medicine · doi:10.1007/bf03168555 · Cited by 16
Rahman, W. T., Hussain, H. K., Parikh, N. D., & Davenport, M. S. (2016) · American Journal of Roentgenology · doi:10.2214/ajr.16.16209 · Cited by 15 · cited 1×
“The discrepancy rates for these varied from about 12% up to 50% [5, 38, 39, 41, 42].”
BackgroundRadiographs in the Office: Is a Second Reading Always Needed?
Smith, P. D., Temte, J. L., Beasley, J. W., & Mundt, M. P. (2004) · The Journal of the American Board of Family Medicine · doi:10.3122/jabfm.17.4.256 · Cited by 14
Baarslag, H. J., van Beek, E. J. R., Tijssen, J. G. P., van Delden, O. M., Bakker, A. J., & Reekers, J. A. (2003) · European Radiology · doi:10.1007/s00330-002-1469-0 · Cited by 14
Foinant, M., Lipiecka, E., Buc, E., Boire, J. Y., Schmidt, J., Garcier, J., Pezet, D., & Boyer, L. (2007) · Journal de Radiologie · doi:10.1016/s0221-0363(07)89855-6 · Cited by 14
Lauritzen, P. M., Hurlen, P., Sandbæk, G., & Gulbrandsen, P. (2014) · Acta Radiologica · doi:10.1177/0284185113519988 · Cited by 13 · cited 3×
“It might also be more cost-efficient considering the fact that in one study, double reading of one-third of all studies consumed an estimated 20–25% of all working hours in the institutions concerned [1].”
BackgroundResultInfluentialSasaki, Y., Abe, K., Tabei, M., Katsuragawa, S., Kurosaki, A., & Matsuoka, S. (2010) · Radiological Physics and Technology · doi:10.1007/s12194-010-0109-7 · Cited by 13
A workstation-integrated peer review quality assurance program: pilot study
O’Keeffe, M., Davis, T. M., & Siminoski, K. G. (2013) · BMC Medical Imaging · doi:10.1186/1471-2342-13-19 · Cited by 13
Inter- and intraobserver agreement in detection of testicular microlithiasis with ultrasonography
Pedersen, M. R. V., Graumann, O., Hørlyck, A., Duus, L. A., Jørgensen, M. M. B., Vagn-Hansen, C., Holst, R., & Rafaelsen, S. R. (2015) · Acta Radiologica · doi:10.1177/0284185115604516 · Cited by 13
Double reading of radiological examinations in Norway
Husby, J. A., Espeland, A., Kalyanpur, A., Brocker, C., & Haldorsen, I. S. (2011) · Acta Radiologica · doi:10.1258/ar.2011.100347 · Cited by 12
Peer Review in Radiology: A Resident and Fellow Perspective
Grenville, J., Doucette-Preville, D., Vlachou, P. A., Mnatzakanian, G. N., Raikhlin, A., & Colak, E. (2016) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2015.10.008 · Cited by 12
CT Screening for Lung Cancer: Value of Expert Review of Initial Baseline Screenings
Xu, D. M., Lee, I. J., Zhao, S., Rowena, Y., Farooqi, A. O., Cheung, E. H., Connery, C. P., Frumiento, C., Glassberg, R., Herzog, G., et al. (2014) · American Journal of Roentgenology · doi:10.2214/ajr.14.12526 · Cited by 11
Guerin, G., Jamali, S., Soto, C. A., Guilbert, F., & Raymond, J. (2014) · American Journal of Neuroradiology · doi:10.3174/ajnr.a4058 · Cited by 11
Chest radiography: a tool for the audit of report quality.
Haug, P. J., Clayton, P. D., Tocino, I. M., Morrison, J. W., Elliot, C., Collins, D. V., Harada, S. K., & Frederick, P. R. (1991) · Radiology · doi:10.1148/radiology.180.1.2052709 · Cited by 11
Garrett, K. G., Cecco, C. N. D., Schoepf, U. J., Silverman, J. R., Krazinski, A. W., Geyer, L. L., Lewis, A. J., Headden, G. F., Ravenel, J. G., Suranyi, P. S., et al. (2014) · Academic Radiology · doi:10.1016/j.acra.2014.04.017 · Cited by 10
Bradley, A., Rajashanker, B., Atkinson, S., Kennedy, J., & Purcell, R. S. (2005) · Clinical Radiology · doi:10.1016/j.crad.2004.11.020 · Cited by 10
d’Othée, B. J., & Haskal, Z. J. (2013) · Journal of Vascular and Interventional Radiology · doi:10.1016/j.jvir.2013.07.001 · Cited by 10
Manuscript peer review at the AJR: facts, figures, and quality assessment.
Friedman, D. P. (1995) · American Journal of Roentgenology · doi:10.2214/ajr.164.4.7726010 · Cited by 10
Rana, A., Turner, H., & Deans, K. (2013) · The Journal of the Royal College of Physicians of Edinburgh · doi:10.4997/jrcpe.2013.303 · Cited by 10
Evaluation of a radiographer‐provided barium enema service
Law, R. L., Titcomb, D., Carter, H., Longstaff, A. J., Slack, N. F., & Dixon, A. R. (2007) · Colorectal Disease · doi:10.1111/j.1463-1318.2007.01370.x · Cited by 9
An evaluation of a radiographer-led barium enema service in the diagnosis of colorectal cancer
Law, R. L., Slack, N. F., & Harvey, R. F. (2006) · Radiography · doi:10.1016/j.radi.2006.07.002 · Cited by 9
Use of reports of previous radiologic studies
Berbaum, K. S., & Smith, W. L. (1998) · Academic Radiology · doi:10.1016/s1076-6332(98)80131-1 · Cited by 8
Is There Value in Having Radiology Provide a Second Reading in Pediatric Orthopaedic Clinic?
Natarajan, V., Bosch, P. P., Dede, Ö., Deeney, V. F. X., Mendelson, S. A., Ward, T., Brooks, M. M., Kenkre, T. S., & Roach, J. (2016) · Journal of Pediatric Orthopaedics · doi:10.1097/bpo.0000000000000917 · Cited by 8
Reinterpretation of radiological findings in oesophago‐gastric multidisciplinary meetings
Lim, H., Stiven, P., & Aly, A. (2014) · ANZ Journal of Surgery · doi:10.1111/ans.12537 · Cited by 7
Jiang, Y., Nishikawa, R. M., Schmidt, R. A., Metz, C. E., & Doi, K. (2000) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.383101 · Cited by 7
Foinant, M., Lipiecka, E., Bue, E., Boire, J. Y., Schmidt, J., Garcier, J., Pezet, D., & Boyer, L. (2006) · Journal de Radiologie · doi:10.1016/s0221-0363(06)86806-x · Cited by 7
Collins, G. B., Tan, T. J., Gifford, J. N., & Tan, A. G. S. (2014) · Emergency Radiology · doi:10.1007/s10140-014-1243-z · Cited by 7
Peer Review in Cardiothoracic Radiology
Kanne, J. P. (2014) · Journal of Thoracic Imaging · doi:10.1097/rti.0000000000000101 · Cited by 7
Ornetti, P., Maillefert, J.-F., Paternotte, S., Dougados, M., & Gossec, L. (2010) · Joint Bone Spine · doi:10.1016/j.jbspin.2010.10.014 · Cited by 6
Iyer, R. S., Munsell, A., & Weinberger, E. (2014) · Current Problems in Diagnostic Radiology · doi:10.1067/j.cpradiol.2014.03.003 · Cited by 6
Capobianco, J., Jasinowodolinski, D., & Szarf, G. (2008) · Jornal Brasileiro de Pneumologia · doi:10.1590/s1806-37132008000100006 · Cited by 6
Chung, J. H., MacMahon, H., Montner, S. M., Liu, L., Paushter, D. M., Chang, P. J., & Katzman, G. L. (2016) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2016.04.012 · Cited by 6
Verma, N., Hippe, D. S., & Robinson, J. D. (2016) · American Journal of Roentgenology · doi:10.2214/ajr.16.16121 · Cited by 6
[The limited detection of lung cancer on chest X-rays].
Quekel, L. G. B. A., Goei, R., Kessels, A. G. H., & van Engelshoven, J. M. A. (2003) · PubMed · Cited by 5
Communication and documentation of preliminary and final radiology reports
Monico, E., & Schwartz, I. (2010) · Journal of Healthcare Risk Management · doi:10.1002/jhrm.20039 · Cited by 5
Booth, A. M., & Mannion, R. A. J. (2005) · Radiography · doi:10.1016/j.radi.2005.03.008 · Cited by 4
Järvenpää, R., Holli, K., & Hakama, M. (2004) · European Journal of Cancer · doi:10.1016/j.ejca.2004.03.004 · Cited by 4
The role of experience in the reading of photofluorograms
Griep, W. A. (1955) · Tubercle · doi:10.1016/s0041-3879(55)80117-1 · Cited by 4
Quality assurance: a system that integrates a digital dictation system with a computer data base.
Frank, M. S., Mann, F. A., & Gillespy, T. (1993) · American Journal of Roentgenology · doi:10.2214/ajr.161.5.8273618 · Cited by 4
O’Keeffe, M., Davis, T. M., & Siminoski, K. G. (2016) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzw017 · Cited by 4
Interobserver Variation in the Radiographic Diagnosis of Gastric Ulcer
Gjørup, T., Nielsen, H. V., Jensen, L. B., & Jensen, A. M. (1985) · Acta Radiologica Diagnosis · doi:10.1177/028418518502600311 · Cited by 4
Olthof, A. W., & van Ooijen, P. M. A. (2016) · Journal of Medical Systems · doi:10.1007/s10916-016-0555-9 · Cited by 4
The value of dual reading in mass radiography
Williams, R. (1958) · Tubercle · doi:10.1016/s0041-3879(58)80052-5 · Cited by 3
Järvenpää, R., Holli, K., & Hakama, M. (2005) · Acta Oncologica · doi:10.1080/02841860510007602 · Cited by 3
Donnelly, L. F., Merinbaum, D., Epelman, M. S., Grissom, L. E., Walters, K. E., Beasley, R. A., Gustafson, J. P., & Choudhary, A. K. (2014) · Pediatric Radiology · doi:10.1007/s00247-014-3222-7 · Cited by 3
Quality care and safety know no borders
Borgstede, J., & Pa, W. (2007) · Biomedical Imaging and Intervention Journal · doi:10.2349/biij.3.3.e34 · Cited by 3
Interobserver Variation in the Radiographic Diagnosis of Duodenal Ulcer Disease
Gjørup, T., Nielsen, H. V., Jensen, L. B., & Jensen, A. M. (1986) · Acta Radiologica Diagnosis · doi:10.1177/028418518602700108 · Cited by 3
DUAL READING as a routine procedure in mass radiography.
Index, D. T. (1955) · PubMed · Cited by 2
Matsumoto, T., Doi, K., Nakamura, H., & Nakanishi, T. (1992) · PubMed · Cited by 2
Second reading of coronary angiograms by radiologists
Birnbaum, L., Filion, K. B., Joyal, D., & Eisenberg, M. J. (2006) · Canadian Journal of Cardiology · doi:10.1016/s0828-282x(06)70962-x · Cited by 1
Screening by Chest Photofluorography in Los Angeles
Discher, D. P., Massey, F. J., & Wallace, R. R. (1971) · Archives of Environmental Health An International Journal · doi:10.1080/00039896.1971.10665819 · Cited by 1
[Lung cancer screening-its present situation, problems and perspectives].
Aoki, M. (1985) · PubMed · Cited by 1
[Observer error in interpretation of chest-radiophotographs (author's transl)].
Angerstein, W., Oehmke, G., & Steinbrück, P. (1975) · PubMed · Cited by 1
Improving accuracy of double reading in chest X-ray images by using eye-gaze metrics
Vural, U., Sarısoy, H. T., & Akansel, G. (2016) · doi:10.1109/siu.2016.7495963 · Cited by 1
Fukuhisa, K., Matsumoto, T., Iinuma, T. A., Tateno, Y., Moriyama, N., Kido, C., & Fukuda, M. (1989) · PubMed · Cited by 1
["Cirrhotic's lund". A new radiological entity? 182 CASES (AUTHOR'S TRANSL)].
Labrune, M., Dayras, M., Kalifa, G., & Jl, R. (1976) · PubMed · Cited by 1
Steinberger, S., Plodkowski, A. J., Latson, L., Levsky, J. M., Zalta, B. A., Godelman, A., Cohen, H. W., & Haramati, L. B. (2016) · Journal of Computer Assisted Tomography · doi:10.1097/rct.0000000000000481 · Cited by 1
Cited by
Wang, X., Shen, T., Yang, S., Lan, J., Xu, Y., Wang, M., Zhang, J., & Han, X. (2021) · NeuroImage: Clinical · doi:10.1016/j.nicl.2021.102785 · Cited by 192
“A more commonly adopted peer review process is the retrospective double reading of cases, as implemented by the American College of Radiology’s RadPeer program [22].”
MethodArtificial Intelligence in Radiology—Ethical Considerations
Brady, A. P., & Neri, E. (2020) · Diagnostics · doi:10.3390/diagnostics10040231 · Cited by 150
“Furthermore, not all radiologists will come to the same conclusion about an imaging study; ground truth labelling accuracy can be enhanced by combining interpretations by more than one radiologist [17].”
BackgroundMandating Limits on Workload, Duty, and Speed in Radiology
Alexander, R. G., Waite, S., Bruno, M. A., Krupinski, E. A., Berlin, L., Macknik, S. L., & Martínez‐Conde, S. (2022) · Radiology · doi:10.1148/radiol.212631 · Cited by 168
“In a systemic review of double reading, Geijer and Geijer (104) found that the rate of discrepancy ranged from insignificant to over 22% depending on the study setting.”
BackgroundGenerative Artificial Intelligence for Chest Radiograph Interpretation in the Emergency Department
Huang, J., Neill, L., Wittbrodt, M., Melnick, D., Klug, M., Thompson, M., Bailitz, J., Loftus, T., Malik, S., Phull, A., et al. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.36100 · Cited by 113
Non-task expert physicians benefit from correct explainable AI advice when reviewing X-rays
Gaube, S., Suresh, H., Raue, M., Lermer, E., Koch, T. K., Hudecek, M. F. C., Ackery, A. D., Grover, S. C., Coughlin, J. F., Frey, D., et al. (2023) · Scientific Reports · doi:10.1038/s41598-023-28633-w · Cited by 92
Metadata
- Authors
- Geijer, H., & Geijer, M.
- Affiliations
- Örebro University (SE)
- Lund University (SE)
- Corresponding author
- Geijer, Håkan
- Venue
- Insights into Imaging
- Published
- 2018-03-28
- Volume
- 9
- Issue
- 3
- Pages
- 287-301
- ISSN
- 1869-4101 (ISSN-L)
- PMC
- PMC5990995
- OpenAlex
- W2794467195
- Cited by
- 117
- References
- 174
- Citations by year
- 2026: 12 · 2025: 18 · 2024: 19 · 2023: 23 · 2022: 9 · 2021: 17 · 2020: 12 · 2019: 7
- FWCI
- 1.40
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- Locations
- Insights into Imaging (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Lund University Publications (Lund University) (submittedVersion)
- Funders
- Örebro Universitet
- Topics
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiology practices and education
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › General Health Professions › Healthcare cost, quality, practices
- Keywords
- double reading, diagnostic radiology, missed diagnosis, reporting quality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
