Deep Convolutional Neural Network–based Software Improves Radiologist Detection of Malignant Lung Nodules on Chest Radiographs
Open accessThe DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
Background Multicenter studies are required to validate the added benefit of using deep convolutional neural network (DCNN) software for detecting malignant pulmonary nodules on chest radiographs. Purpose To compare the performance of radiologists in detecting malignant pulmonary nodules on chest radiographs when assisted by deep learning–based DCNN software with that of radiologists or DCNN software alone in a multicenter setting. Materials and Methods Investigators at four medical centers retrospectively identified 600 lung cancer–containing chest radiographs and 200 normal chest radiographs. Each radiograph with a lung cancer had at least one malignant nodule confirmed by CT and pathologic examination. Twelve radiologists from the four centers independently analyzed the chest radiographs and marked regions of interest. Commercially available deep learning–based computer-aided detection software separately trained, tested, and validated with 19 330 radiographs was used to find suspicious nodules. The radiologists then reviewed the images with the assistance of DCNN software. The sensitivity and number of false-positive findings per image of DCNN software, radiologists alone, and radiologists with the use of DCNN software were analyzed by using logistic regression and Poisson regression. Results The average sensitivity of radiologists improved (from 65.1% [1375 of 2112; 95% confidence interval {CI}: 62.0%, 68.1%] to 70.3% [1484 of 2112; 95% CI: 67.2%, 73.1%], P < .001) and the number of false-positive findings per radiograph declined (from 0.2 [488 of 2400; 95% CI: 0.18, 0.22] to 0.18 [422 of 2400; 95% CI: 0.16, 0.2], P < .001) when the radiologists re-reviewed radiographs with the DCNN software. For the 12 radiologists in this study, 104 of 2400 radiographs were positively changed (from false-negative to true-positive or from false-positive to true-negative) using the DCNN, while 56 of 2400 radiographs were changed negatively. Conclusion Radiologists had better performance with deep convolutional network software for the detection of malignant pulmonary nodules on chest radiographs than without. © RSNA, 2019 Online supplemental material is available for this article. See also the editorial by Jacobson in this issue.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“13 (refs. 63–75) studies validated algorithms on external data”
From Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis (2021) · cites this paper as [72]
In the citing paper
“Twenty-one54,63–67,70,72,76–88 studies compared algorithm performance against healthcare professionals.”
From Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis (2021) · cites this paper as [72]
In the citing paper
“Only eight studies in ophthalmology imaging14,21,32,33,43,55,108,109, ten studies in respiratory imaging64,66,70,72,75,79,82,87,89,110 and six studies in breast imaging62,91,97,104,106,111 mentioned adherence to the STARD-2015 guidelines or had a STARD flow diagram in the manuscript.”
From Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis (2021) · cites this paper as [72]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Reduced Lung-Cancer Mortality with Low-Dose Computed Tomographic Screening
The National Lung Screening Trial Research Team (2011) · New England Journal of Medicine · doi:10.1056/nejmoa1102873 · Cited by 11,064
Lakhani, P., & Sundaram, B. (2017) · Radiology · doi:10.1148/radiol.2017162326 · Cited by 1,775
Park, S. H., & Han, K. (2018) · Radiology · doi:10.1148/radiol.2017171920 · Cited by 894
Self-citationNam, J. G., Park, S., Hwang, E. J., Lee, J. H., Jin, K.-N., Lim, K. Y., Vu, T. H., Sohn, J. H., Hwang, S., Goo, J. M., et al. (2019) · Radiology · doi:10.1148/radiol.2018180237 · Cited by 539
Austin, J. H., Romney, B. M., & Goldsmith, L. S. (1992) · Radiology · doi:10.1148/radiology.182.1.1727272 · Cited by 266
Shah, P. K., Austin, J. H. M., White, C. S., Patel, P., Haramati, L. B., Pearson, G. D. N., Shiau, M. C., & Berkmen, Y. M. (2003) · Radiology · doi:10.1148/radiol.2261011924 · Cited by 198
Missed lung cancer: when, where, and why?
Ciello, A. D., Franchi, P., Contegiacomo, A., Cicchetti, G., Bonomo, L., & Larici, A. R. (2017) · Diagnostic and Interventional Radiology · doi:10.5152/dir.2016.16187 · Cited by 187
Mechanism of satisfaction of search: eye position recordings in the reading of chest radiographs.
Samuel, S., Kundel, H. L., Nodine, C. F., & Toto, L. C. (1995) · Radiology · doi:10.1148/radiology.194.3.7862998 · Cited by 168
Kakeda, S., Moriya, J., Sato, H., Aoki, T., Watanabe, H., Nakata, H., Oda, N., Katsuragawa, S., Yamamoto, K., & Doi, K. (2004) · American Journal of Roentgenology · doi:10.2214/ajr.182.2.1820505 · Cited by 141
Research works printed but not linked: 1
- Hwang S, 2016, Proceedings of SPIE: medical imaging 2016—computer-aided diagnosis. Vol 9785, 97852W
Cited by
Rajpurkar, P., Chen, E., Banerjee, O., & Topol, E. J. (2022) · Nature Medicine · doi:10.1038/s41591-021-01614-0 · Cited by 3,212
“For example, Sim et al. found that AI-assisted clinical experts surpassed both humans and AI alone when detecting malignant nodules on chest radiographs 85 .”
BackgroundDiagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis
Aggarwal, R., Sounderajah, V., Martin, G., Ting, D. S. W., Karthikesalingam, A., King, D., Ashrafian, H., & Darzi, A. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00438-z · Cited by 946
Seyyed-Kalantari, L., Zhang, H., McDermott, M. B. A., Chen, I. Y., & Ghassemi, M. (2021) · Nature Medicine · doi:10.1038/s41591-021-01595-0 · Cited by 928
Deep learning for chest X-ray analysis: A survey
Çallı, E., Sogancioglu, E., van Ginneken, B., van Leeuwen, K. G., & Murphy, K. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102125 · Cited by 506
Fu, T., Dai, L.-J., Wu, S.-Y., Xiao, Y., Ma, D., Jiang, Y.-Z., & Shao, Z.-M. (2021) · Journal of Hematology & Oncology · doi:10.1186/s13045-021-01103-4 · Cited by 480
Role of Artificial Intelligence Applications in Real-Life Clinical Practice: Systematic Review
Yin, J., Ngiam, K. Y., & Teo, H. H. (2021) · Journal of Medical Internet Research · doi:10.2196/25759 · Cited by 419
“From our review, 16 studies demonstrated that AI applications could enhance clinical decision-making capacity [31-33,45-47,50,55,58,59,63,64,67,69,71,74,75].”
BackgroundInfluentialApplications of artificial intelligence and deep learning in molecular imaging and radiotherapy
Arabi, H., & Zaidi, H. (2020) · European Journal of Hybrid Imaging · doi:10.1186/s41824-020-00086-8 · Cited by 195
A Vertebral Segmentation Dataset with Fracture Grading
Löffler, M. T., Sekuboyina, A., Jacob, A., Grau, A.-L., Scharr, A., El Husseini, M., Kallweit, M., Zimmer, C., Baum, T., & Kirschke, J. S. (2020) · Radiology: Artificial Intelligence · doi:10.1148/ryai.2020190138 · Cited by 181
Shimazaki, A., Ueda, D., Choppin, A., Yamamoto, A., Honjo, T., Shimahara, Y., & Miki, Y. (2022) · Scientific Reports · doi:10.1038/s41598-021-04667-w · Cited by 160
Eche, T., Schwartz, L. H., Mokrane, F.-Z., & Dercle, L. (2021) · Radiology: Artificial Intelligence · doi:10.1148/ryai.2021210097 · Cited by 163
Combining Human Expertise with Artificial Intelligence: Experimental Evidence from Radiology
Agarwal, N., Moehring, A., Rajpurkar, P., & Salz, T. (2023) · doi:10.2139/ssrn.4505053 · Cited by 161
“An active literature studies whether AI assistance benefits radiologists, and which radiologists benefit the most (Rajpurkar et al., 2020; Seah et al., 2021; Ahn et al., 2022; Sim et al., 2020; Gaube et al., 2023).”
BackgroundCombining Human Expertise with Artificial Intelligence: Experimental Evidence from Radiology
Agarwal, N., Moehring, A., Rajpurkar, P., & Salz, T. (2023) · doi:10.3386/w31422 · Cited by 161
Novel research and future prospects of artificial intelligence in cancer diagnosis and treatment
Zhang, C., Xu, J., Tang, R., Yang, J., Wang, W., Yu, X., & Shi, S. (2023) · Journal of Hematology & Oncology · doi:10.1186/s13045-023-01514-5 · Cited by 148
Beckers, R., Kwade, Z., & Zanca, F. (2021) · Physica Medica · doi:10.1016/j.ejmp.2021.02.011 · Cited by 139
A comprehensive survey on deep active learning in medical image analysis
Wang, H., Jin, Q., Li, S., Liu, S., Wang, M., & Song, Z. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103201 · Cited by 210
Application of Artificial Intelligence in Lung Cancer
Chiu, H.-Y., Chao, H.-S., & Chen, Y.-M. (2022) · Cancers · doi:10.3390/cancers14061370 · Cited by 138
“Currently, several software programs have been approved by the FDA [17,20,21].”
MethodResultInfluentialStructural and functional radiomics for lung cancer
Wu, G., Jochems, A., Refaee, T., Ibrahim, A., Yan, C., Sanduleanu, S., Woodruff, H. C., & Lambin, P. (2021) · European Journal of Nuclear Medicine and Molecular Imaging · doi:10.1007/s00259-021-05242-1 · Cited by 153
Artificial intelligence in lung cancer: current applications and perspectives
Chassagnon, G., de Margerie‐Mellon, C., Vakalopoulou, M., Marini, R., Hoang-Thi, T.-N., Revel, M., & Soyer, P. A. (2022) · Japanese Journal of Radiology · doi:10.1007/s11604-022-01359-x · Cited by 143
“001) when radiologists had access to AI results [35].”
BackgroundYoo, H., Kim, K. H., Singh, R., Digumarthy, S. R., & Kalra, M. K. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.17135 · Cited by 122
A Review of Recent Advances in Deep Learning Models for Chest Disease Detection Using Radiography
Ait Nasser, A., & Akhloufi, M. A. (2023) · Diagnostics · doi:10.3390/diagnostics13010159 · Cited by 121
Liebl, H., Schinz, D., Sekuboyina, A., Malagutti, L., Löffler, M. T., Bayat, A., Husseini, M. E., Tetteh, G., Grau, K., Niederreiter, E., et al. (2021) · Scientific Data · doi:10.1038/s41597-021-01060-0 · Cited by 153
Using AI to Improve Radiologist Performance in Detection of Abnormalities on Chest Radiographs
Bennani, S., Regnard, N.-E., Ventre, J., Lassalle, L., Nguyen, T., Ducarouge, A., Dargent, L., Guillo, E., Gouhier, E., Zaimi, S.-H., et al. (2023) · Radiology · doi:10.1148/radiol.230860 · Cited by 120
Yoo, H., Lee, S. H., Arru, C. D., Khera, R. D., Singh, R., Siebert, S. M., Kim, D., Lee, Y., Park, J. H., Eom, H. J., et al. (2021) · European Radiology · doi:10.1007/s00330-021-08074-7 · Cited by 95
A deep learning system that generates quantitative CT reports for diagnosing pulmonary Tuberculosis
Li, X., Zhou, Y., Du, P. F., Lang, G., Xu, M. G., & Wu, W. (2020) · Applied Intelligence · doi:10.1007/s10489-020-02051-1 · Cited by 90
“The traditional CT image processing methods are mainly used in the preprocessing stage, and the image segmentation and classification process is based on deep learning algorithms [18 – 20].”
MethodEng, D. K., Khandwala, N. B., Long, J., Fefferman, N. R., Lala, S. V., Strubel, N. A., Milla, S. S., Filice, R. W., Sharp, S. E., Towbin, A. J., et al. (2021) · Radiology · doi:10.1148/radiol.2021204021 · Cited by 84
Lee, J. H., Sun, H. Y., Park, S., Kim, H., Hwang, E. J., Goo, J. M., & Park, C. M. (2020) · Radiology · doi:10.1148/radiol.2020201240 · Cited by 81
Self-citationChelala, L., Hossain, R., Kazerooni, E. A., Christensen, J. D., Dyer, D. S., & WHITE, C. S. (2021) · American Journal of Roentgenology · doi:10.2214/ajr.20.24807 · Cited by 98
Challenges and solutions for introducing artificial intelligence (AI) in daily clinical workflow
Kotter, E., & Ranschaert, E. (2021) · European Radiology · doi:10.1007/s00330-020-07148-2 · Cited by 79
“Studies evaluating these systems should concentrate on measuring and monitoring how the use of AI enhances the performance of radiologists [4].”
BackgroundSelf-citationAI-based radiodiagnosis using chest X-rays: A review
Akhter, Y., Singh, R., & Vatsa, M. (2023) · Frontiers in Big Data · doi:10.3389/fdata.2023.1120989 · Cited by 112
Yabu, A., Hoshino, M., Tabuchi, H., Takahashi, S., Masumoto, H., Akada, M., Morita, S., Maeno, T., Iwamae, M., Inose, H., et al. (2021) · The Spine Journal · doi:10.1016/j.spinee.2021.03.006 · Cited by 78
Hu, H., Wang, W., Chen, L., Ruan, S., Chen, S., Li, X., Lu, M., Xie, X., & Kuang, M. (2021) · Journal of Gastroenterology and Hepatology · doi:10.1111/jgh.15522 · Cited by 82
Jang, S., Song, H., Shin, Y. J., Kim, J., Kim, J., Lee, K. W., Lee, S. S., Lee, W., Lee, S., & Lee, K. H. (2020) · Radiology · doi:10.1148/radiol.2020200165 · Cited by 72
2D CNN versus 3D CNN for false-positive reduction in lung cancer screening
Yu, J., Yang, B., Wang, J., Leader, J. K., Wilson, D. O., & Pu, J. (2020) · Journal of medical imaging · doi:10.1117/1.jmi.7.5.051202 · Cited by 76
Deep Learning for Head and Neck CT Angiography: Stenosis and Plaque Classification
Fu, F., Shan, Y., Yang, G., Zheng, C., Zhang, M., Rong, D., Wang, X., & Lu, J. (2023) · Radiology · doi:10.1148/radiol.220996 · Cited by 82
“…with coronary CT angiography (11), automated detection of cerebral aneurysms with CT angiography (12), prioritization in radiologic workflow and reduction of time to diagnosis of intracranial hemorrhage with nonenhanced CT images (13), and detection of pulmonary nodules with chest CT images (14).”
MethodSung, J., Park, S., Lee, S. M., Bae, W., Park, B., Jung, E., Seo, J. B., & Jung, K.-H. (2021) · Radiology · doi:10.1148/radiol.2021202818 · Cited by 71
Current and emerging artificial intelligence applications in chest imaging: a pediatric perspective
Schalekamp, S., Klein, W. M., & van Leeuwen, K. G. (2021) · Pediatric Radiology · doi:10.1007/s00247-021-05146-0 · Cited by 77
Artificial intelligence for diagnostics in radiology practice: a rapid systematic scoping review
Lawrence, R., Dodsworth, E., Massou, E., Sherlaw-Johnson, C., Ramsay, A. I. G., Walton, H., O'Regan, T., Gleeson, F., Crellin, N., Herbert, K., et al. (2025) · eClinicalMedicine · doi:10.1016/j.eclinm.2025.103228 · Cited by 69
Automatic classification of canine thoracic radiographs using deep learning
Banzato, T., Wodziński, M., Burti, S., Osti, V. L., Rossoni, V., Atzori, M., & Zotti, A. (2021) · Scientific Reports · doi:10.1038/s41598-021-83515-3 · Cited by 87
Unlocking the Value: Quantifying the Return on Investment of Hospital Artificial Intelligence
Bharadwaj, P., Nicola, L. P., Breau-Brunel, M., Sensini, F., Tanova-Yotova, N., Atanasov, P. Y., Lobig, F., & Blankenburg, M. (2024) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2024.02.034 · Cited by 86
Labor Market Exposure to AI: Cross-country Differences and Distributional Implications
Pizzinelli, C., Panton, A., Mendes Tavares, M., Cazzaniga, M., & Li, L. (2023) · IMF Working Papers · doi:10.5089/9798400254802.001 · Cited by 66
Must-have Qualities of Clinical Research on Artificial Intelligence and Machine Learning
Koçak, B., Cuocolo, R., Santos, D. P. D., Stanzione, A., & Ugga, L. (2023) · Balkan Medical Journal · doi:10.4274/balkanmedj.galenos.2022.2022-11-51 · Cited by 64
Deep learning applied to automatic disease detection using chest X‐rays
Moses, D. A. (2021) · Journal of Medical Imaging and Radiation Oncology · doi:10.1111/1754-9485.13273 · Cited by 74
“Sim 31 showed, in a multicentre setting, after re-review with a DNN, average sensitivity of 12 radiologists improved from 65.1% to 70.3% while the number of FP declined from 0.2 to 0.18 per CXR, positive changes occurred in 4.3% and negative changes occur in 2.3%.”
InfluentialA few-shot U-Net deep learning model for lung cancer lesion segmentation via PET/CT imaging
Protonotarios, N. Ε., Katsamenis, I., Sykiotis, S., Δικαίος, Ν., Kastis, G. A., Chatziioannou, S. N., Metaxas, M. G., Doulamis, N. D., & Doulamis, A. D. (2022) · Biomedical Physics & Engineering Express · doi:10.1088/2057-1976/ac53bd · Cited by 66
Multi-Label Classification of Chest X-ray Abnormalities Using Transfer Learning Techniques
Kufel, J., Bielówka, M., Rojek, M., Mitręga, A., Lewandowski, P., Cebula, M., Krawczyk, D., Bielówka, M., Kondoł, D., Bargieł-Łączek, K., et al. (2023) · Journal of Personalized Medicine · doi:10.3390/jpm13101426 · Cited by 74
“They can also improve the diagnostic efficiency of radiologists, which directly increases the percentage of correctly diagnosed cases, especially in more complex incidents [10].”
BackgroundShin, H. J., Son, N., Kim, M. J., & Kim, E. (2022) · Scientific Reports · doi:10.1038/s41598-022-14519-w · Cited by 59
“Many studies have validated the diagnostic performances of AI-based software and its potential effects on the clinical process using commercially available AI-based solutions for the chest radiographs of adults 7,11–13 .”
MethodSelf-citationHu, X., Gong, J., Zhou, W., Li, H., Wang, S., Wei, M., Peng, W., & Gu, Y. (2021) · Physics in Medicine and Biology · doi:10.1088/1361-6560/abe735 · Cited by 55
Fan, W., Yang, Y., Qi, J., Zhang, Q., Liao, C., Li, W., Wang, S., Wang, G., Yu, X., Wu, Q., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-45599-z · Cited by 64
“A disease-speci fi c deep model was developed to detect certain chest diseases, such as nodules 5,6 , tuberculosis 7 , pneumothorax 8 or pneumonia 9 .”
MethodYang, T., Yuan, L., Li, P., & Liu, P. (2023) · Ultrasound in Medicine & Biology · doi:10.1016/j.ultrasmedbio.2023.03.013 · Cited by 47
CheXGAT: A disease correlation-aware network for thorax disease diagnosis from chest X-ray images
Lee, Y., Huang, S.-K., & Chang, R. (2022) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2022.102382 · Cited by 50
Hwang, E. J., Goo, J. M., Yoon, S. H., Beck, K. S., Seo, J. B., Choi, B. W., Chung, M. J., Park, C. M., Jin, K. N., & Lee, S. M. (2021) · Korean Journal of Radiology · doi:10.3348/kjr.2021.0544 · Cited by 43
“Based on studies reporting improved detection performance of radiologists with the assistance of AI-SaMD [5-8,19], it would be feasible to use currently available AISaMDs as an assistance tool for radiologists’ interpretation.”
MethodSelf-citationUeda, D., Yamamoto, A., Shimazaki, A., Walston, S. L., Matsumoto, T., Izumi, N., Tsukioka, T., Komatsu, H., Inoue, H., Kabata, D., et al. (2021) · BMC Cancer · doi:10.1186/s12885-021-08847-9 · Cited by 60
Bispo, M. S., Júnior, M. L. G. D. Q. P., Apolinário, A. L., dos Santos, J. N., Júnior, B. C., Neves, F. S., & Crusoé‐Rebello, I. (2021) · Dentomaxillofacial Radiology · doi:10.1259/dmfr.20210002 · Cited by 49
Tam, M. D. B. S., Dyer, T., Dissez, G., Morgan, T. N., Hughes, M., Illes, J., Rasalingham, R., & Rasalingham, S. (2021) · Clinical Radiology · doi:10.1016/j.crad.2021.03.021 · Cited by 43
Jones, C. M., Danaher, L., Milne, M. R., Tang, C., Seah, J., Oakden-Rayner, L., Johnson, A., Buchlak, Q. D., & Esmaili, N. (2021) · BMJ Open · doi:10.1136/bmjopen-2021-052902 · Cited by 45
Using Computer Vision Techniques to Automatically Detect Abnormalities in Chest X-rays
Mustafa, Z., & Nsour, H. (2023) · Diagnostics · doi:10.3390/diagnostics13182979 · Cited by 49
“A few modern imaging techniques that have increased the efficiency or accuracy of medical diagnosis include CT, magnetic resonance imaging (MRI), and ultrasonography [26].”
Lococo, F., Ghaly, G., Chiappetta, M., Flamini, S., Evangelista, J., Bria, E., Stefani, A., Vita, E., Martino, A., Boldrini, L., et al. (2024) · Cancers · doi:10.3390/cancers16101832 · Cited by 54
“Although studies have shown promising results in applying AI to lung cancer and some products have received FDA approval [51–56], real-world implementation in clinical workflows remains uncommon.”
ResultDeep learning for diagnosing osteonecrosis of the femoral head based on magnetic resonance imaging
Wang, P., Liu, X., Xu, J., Li, T., Sun, W., Li, Z., Gao, F., Shi, L., Li, Z., Wu, X., et al. (2021) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2021.106229 · Cited by 44
Collaborative human-computer fault diagnosis via calibrated confidence estimation
Shao, H., Xiao, Y., Leng, J., Zhao, X., & Liu, B. (2025) · Advanced Engineering Informatics · doi:10.1016/j.aei.2025.103349 · Cited by 43
AI-based detection of lung lesions in [18F]FDG PET-CT from lung cancer patients
Borrelli, P., Ly, J., Kaboteh, R., Ulén, J., Enqvist, O., Trägårdh, E., & Edenbrandt, L. (2021) · EJNMMI Physics · doi:10.1186/s40658-021-00376-5 · Cited by 41
Chest radiographs and machine learning – Past, present and future
Jones, C. M., Buchlak, Q. D., Oakden‐Rayner, L., Milne, M., Seah, J. C. Y., Esmaili, N., & Hachey, B. (2021) · Journal of Medical Imaging and Radiation Oncology · doi:10.1111/1754-9485.13274 · Cited by 58
Kim, D., Chung, J., Choi, J., Succi, M. D., Conklin, J., Longo, M. G. F., Ackman, J. B., Little, B. P., Petranovic, M., Kalra, M. K., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-29437-8 · Cited by 40
Self-citationTowards new frontiers of healthcare systems research using artificial intelligence and generative AI
Chatterjee, S., Fruhling, A., Kotiadis, K., & Gärtner, D. (2024) · Health Systems · doi:10.1080/20476965.2024.2402128 · Cited by 51
“Autoencoders and other unsupervised learning models can be trained to detect anomalies in medical images, such as MRIs, CT scans, and X-rays.”
InfluentialDiagnosis of normal chest radiographs using an autonomous deep-learning algorithm
Dyer, T., Dillard, L., Harrison, M., Morgan, T. N., Tappouni, R. F. R., Malik, Q., & Rasalingham, S. (2021) · Clinical Radiology · doi:10.1016/j.crad.2021.01.015 · Cited by 52
An AI-Based Algorithm for the Automatic Classification of Thoracic Radiographs in Cats
Banzato, T., Wodziński, M., Tauceri, F., Donà, C., Scavazza, F., Müller, H., & Zotti, A. (2021) · Frontiers in Veterinary Science · doi:10.3389/fvets.2021.731936 · Cited by 44
“The increasing availability of computers with a high computing power has driven the current research trend in the direction of the development of artificial intelligence (AI)-based CADs (4, 5).”
BackgroundJin, K. N., Kim, E. Y., Kim, Y. J., Lee, G. P., Kim, H., Oh, S., Kim, Y., Han, J., & Cho, Y. J. (2022) · European Radiology · doi:10.1007/s00330-021-08397-5 · Cited by 37
“In another study, the number of false-positive findings per radiograph declined from 0.2 to 0.18 with the aid of an AI solution [28].”
InfluentialSelf-citationImage synthesis with disentangled attributes for chest X-ray nodule augmentation and detection
Shen, Z., Ouyang, X., Xiao, B., Cheng, J., Shen, D. G., & Wang, Q. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102708 · Cited by 46
Li, D., Pehrson, L. M., Lauridsen, C. A., Tøttrup, L., Fraccaro, M., Elliott, D., Zając, H. D., Darkner, S., Carlsen, J. F., & Nielsen, M. B. (2021) · Diagnostics · doi:10.3390/diagnostics11122206 · Cited by 35
“[46] 2020 Biopsy, surgery, CT, and pathology Commercially available (ALND, version 1.”
BackgroundRamli, P. N. M., Aizuddin, A. N., Ahmad, N., Hamid, Z. A., & Ismail, K. I. (2025) · Diagnostics · doi:10.3390/diagnostics15030246 · Cited by 47
Designing AI-Based Work Processes: How the Timing of AI Advice Affects Diagnostic Decision Making
Yin, J., Ngiam, K. Y., Tan, S. S.-L., & Teo, H. (2025) · Management Science · doi:10.1287/mnsc.2022.01454 · Cited by 62
Improved image classification explainability with high-accuracy heatmaps
Preechakul, K., Sriswasdi, S., Kijsirikul, B., & Chuangsuwanich, E. (2022) · iScience · doi:10.1016/j.isci.2022.103933 · Cited by 39
“Deep learning models exhibited strong performances in general image classification (He et al., 2015; Russakovsky et al., 2015) and have becomewidely used inmedical imaging especially for automated diagnoses of chest radiographs (Rajpurkar et al., 2017; Irvin et al., 2019; Sim et al., 2020).”
Application of artificial intelligence technology in the field of orthopedics: a narrative review
Liu, P., Zhang, J., Liu, S., Huo, T., He, J., Xue, M., Fang, Y., Wang, H., Xie, Y., Xie, M., et al. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-023-10638-6 · Cited by 37
Cao, R., Zhong, X., Mirak, S. A., Felker, E. R., Suvannarerg, V., Tubtawee, T., Vangala, S., Scalzo, F., Raman, S. S., & Sung, K. (2021) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.27595 · Cited by 33
“However, the potential of deep learning detection systems as assistive tools to radiologists in the clinical workflow (24) was not fully explored in this study and left for future investigation.”
BackgroundLi, P., & Liu, J. (2022) · Translational Vision Science & Technology · doi:10.1167/tvst.11.5.17 · Cited by 35
Holm, S., Stanton, C., & Bartlett, B. (2021) · Health Care Analysis · doi:10.1007/s10728-021-00430-4 · Cited by 32
Wei, J., Song, X. Z., Wei, X., Yang, Z., Dai, L., Wang, M., Sun, Z., Jin, Y., Ma, C., Hu, C., et al. (2024) · Radiology · doi:10.1148/radiol.233197 · Cited by 42
Deep Learning for Detection of Pulmonary Metastasis on Chest Radiographs
Hwang, E. J., Lee, J. S., Lee, J. H., Lim, W. H., Kim, J. H., Choi, K. S., Choi, T. W., Kim, T., Goo, J. M., & Park, C. M. (2021) · Radiology · doi:10.1148/radiol.2021210578 · Cited by 34
Lee, S., Shin, H. J., Kim, S., & Kim, E.-K. (2022) · Korean Journal of Radiology · doi:10.3348/kjr.2022.0193 · Cited by 31
“Recently, several studies have reported excellent diagnostic performance of AI-CAD systems applied to chest radiography [2,11,17-20].”
BackgroundSiddiqui, E. A., Chaurasia, V., & Shandilya, M. (2023) · Journal of Cancer Research and Clinical Oncology · doi:10.1007/s00432-023-04992-9 · Cited by 36
Tang, D., Ni, M., Zheng, C., Ding, X., Zhang, N., Yang, T., Zhan, Q., Fu, Y., Liu, W., Zhuang, D., et al. (2022) · Surgical Endoscopy · doi:10.1007/s00464-022-09319-2 · Cited by 31
“While some studies showed that combined DCNN-human performance could be more strengthened than DCNN alone [24–26], other studies also showed that combined DCNN-human performance could not surpass the DCNN performance alone [27–29].”
ResultNg, C. K. C. (2023) · Children · doi:10.3390/children10081372 · Cited by 37
Iqbal, T., Masud, M., Amin, B., Feely, C., Faherty, M., Jones, T., Tierney, M. S., Shahzad, A., & Vazquez, P. (2024) · Health Sciences Review · doi:10.1016/j.hsr.2024.100150 · Cited by 38
Review on chest pathogies detection systems using deep learning techniques
Rehman, A., Khan, A., Fatima, G., Naz, S., & Razzak, I. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10457-9 · Cited by 31
Hwang, E. J., Goo, J. M., Nam, J. G., Park, C. M., Hong, K. J., & Kim, K. H. (2023) · Korean Journal of Radiology · doi:10.3348/kjr.2022.0651 · Cited by 28
ACR Appropriateness Criteria® Incidentally Detected Indeterminate Pulmonary Nodule
Martin, M. D., Henry, T. S., Berry, M. F., Johnson, G. B., Kelly, A. M., Ko, J. P., Kuzniewski, C. T., Lee, E., Maldonado, F., Morris, M. F., et al. (2023) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2023.08.024 · Cited by 26
Shin, H. J., Lee, S., Kim, S., Son, N., & Kim, E. (2023) · PLoS ONE · doi:10.1371/journal.pone.0282123 · Cited by 27
Plachouris, D., Tzolas, I., Gatos, I., Papadimitroulas, P., Spyridonidis, T., Apostolopoulos, D., Papathanasiou, N. D., Visvikis, D., Plachouri, K., Hazle, J. D., et al. (2021) · Medical Physics · doi:10.1002/mp.15270 · Cited by 25
Fang, W., Zhang, G., Yu, Y., Chen, H., & Liu, H. (2022) · Bioscience Reports · doi:10.1042/bsr20212416 · Cited by 25
Yoo, H., Kim, E. Y., Kim, H., Choi, Y. R., Kim, M. Y., Hwang, S. H., Kim, Y. J., Cho, Y. J., & Jin, K. N. (2022) · Korean Journal of Radiology · doi:10.3348/kjr.2022.0189 · Cited by 27
Self-citationArtificial Intelligence for Early Detection of Chest Nodules in X-ray Images
Chiu, H., Peng, R. H.-T., Lin, Y.-C., Wang, T., Yang, Y., Chen, Y., Wu, M., Shiao, T., Chao, H., Chen, Y., et al. (2022) · Biomedicines · doi:10.3390/biomedicines10112839 · Cited by 32
“Computer-aided diagnosis has assisted radiologists when reading CXRs for lung nodule detection [11].”
Yoon, A. P., Chung, W. T., Wang, C.-W., Kuo, C., Lin, C., & Chung, K. C. (2023) · Clinical Orthopaedics and Related Research · doi:10.1097/corr.0000000000002612 · Cited by 27
“A recent study has shown that AI-assisted clinical experts outperform humans and AI alone when detecting lung malignancies [21].”
BackgroundNodule Detection and Generation on Chest X-Rays: NODE21 Challenge
Sogancioglu, E., van Ginneken, B., Behrendt, F., Bengs, M., Schlaefer, A., Radu, M., Xu, D., Sheng, K., Scalzo, F., Marcus, E., et al. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3382042 · Cited by 36
“Several studies have described work including such datasets used for evaluation of either a commercial or research algorithm for nodule localization [24], [25], [26], [27].”
Clinical Artificial Intelligence Applications in Radiology
Lee, S., & Summers, R. M. (2021) · Radiologic Clinics of North America · doi:10.1016/j.rcl.2021.07.001 · Cited by 28
Kim, D. H., Seo, J., Lee, J.-H., Jeon, E., Jeong, D., Chae, H. D., Lee, E., Kang, J. H., Choi, Y., Kim, H. J., et al. (2024) · Korean Journal of Radiology · doi:10.3348/kjr.2023.0671 · Cited by 23
“Recently, increasing interest has been directed to deep learning and its ability to detect and segment medical imaging data [5-9].”
Self-citationArtificial intelligence: opportunities in lung cancer
Zhang, K., & Chen, K. (2021) · Current Opinion in Oncology · doi:10.1097/cco.0000000000000796 · Cited by 26
“Sim [49] 2020 Deep CNN software (Samsung Auto Lung Nodule Detection) Priv”
The Accuracy of ChatGPT-4o in Interpreting Chest and Abdominal X-Ray Images
Lacaita, P. G., Galijašević, M., Swoboda, M., Gruber, L. N., Scharll, Y., Barbieri, F., Widmann, G., & Feuchtner, G. M. (2025) · Journal of Personalized Medicine · doi:10.3390/jpm15050194 · Cited by 28
“For example, Castiglioni et al. [32] demonstrated that machine learning applied to CXRs significantly enhances diagnostic support for the diagnosis of COVID-19 by improving the diagnostic accuracy for COVID-19 compared to traditional visual read-outs by radiologists.”
Hwang, E. J., Park, J., Hong, W., Lee, H., Choi, H., Kim, H., Nam, J. G., Goo, J. M., Yoon, S. H., Lee, C. H., et al. (2022) · European Radiology · doi:10.1007/s00330-022-08593-x · Cited by 23
“…or abnormalities on chest radiographs have been developed and evaluated, investigations on the performance of AI systems have thus far focused on the performance of the AI systems alone [10 – 14], or enhancement of radiologists ’ performance with the assistance of AI systems [11 – 13, 15, 16].”
BackgroundSelf-citationIvanics, T., So, D., Claasen, M. P. A. W., Wallace, D., Patel, M. S., Gravely, A., Choi, W. J., Shwaartz, C. G., Walker, K., Erdman, L., et al. (2023) · American Journal of Transplantation · doi:10.1016/j.ajt.2022.12.002 · Cited by 24
Choi, D. H., Lim, M. H., Kim, K. H., Shin, S. D., Hong, K. J., & Kim, S. (2023) · Scientific Reports · doi:10.1038/s41598-023-40708-2 · Cited by 27
“However, a sequential reading design was also adopted in many previous studies, and it was necessary to evaluate the prediction changes of physicians according to their uncertainty 29,30 .”
MethodHow AI Can Help in the Diagnostic Dilemma of Pulmonary Nodules
Fahmy, D. M., Kandil, H., Khelifi, A., Yaghi, M., Ghazal, M. A., Sharafeldeen, A., Mahmoud, A. H., & El-Baz, A. S. (2022) · Cancers · doi:10.3390/cancers14071840 · Cited by 22
Kwak, S. H., Kim, E., Kim, M. H., Lee, E. H., & Shin, H. J. (2023) · PLoS ONE · doi:10.1371/journal.pone.0281690 · Cited by 24
“Even though several studies have focused on developing and validating their own algorithm or commercially approved software for detecting lung nodules, most of them were retrospective studies simulating clinical situations [27, 28, 30, 31].”
BackgroundSelf-citation
Metadata
- Authors
- Sim, Y., Chung, M. J., Kotter, E., Yune, S., Kim, M., Do, S., Han, K., Kim, H., Yang, S., Lee, D.-J., & Choi, B. W.
- Affiliations
- Yonsei University (KR)
- Harvard University (US)
- ORCID
- Venue
- Radiology
- Published
- 2020-01
- Volume
- 294
- Issue
- 1
- Pages
- 199-209
- ISSN
- 0033-8419 (ISSN-L)
- 1527-1315
- OpenAlex
- W2984645840
- Cited by
- 248
- References
- 26
- Citations by year
- 2026: 10 · 2025: 32 · 2024: 39 · 2023: 55 · 2022: 39 · 2021: 60 · 2020: 12
- FWCI
- 12.78
- Type
- journal article
- Language
- en
- Open access
- Licence
- cc-by-nc-nd
- Locations
- Radiology (publishedVersion)
- PubMed (publishedVersion)
- YUHSpace (Yonsei University Medical Library) (submittedVersion, cc-by-nc-nd)
- Funders
- Samsung Electronics
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Health Sciences › Medicine › Pulmonary and Respiratory Medicine › Lung Cancer Diagnosis and Treatment
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
- Keywords
- deep convolutional neural networks, computer-aided detection, lung cancer, chest radiograph, radiologist performance, false positives, nodule detection, diagnostic accuracy, multicenter validation
- MeSH terms
- Adult, Aged, Solitary Pulmonary Nodule, Female, Humans, Lung, Lung Neoplasms, Male, Middle Aged, Radiographic Image Interpretation, Computer-Assisted, Retrospective Studies, Sensitivity and Specificity, Radiography, Thoracic, Reproducibility of Results, Neural Networks, Computer, Multiple Pulmonary Nodules, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.