Development and Validation of Deep Learning–based Automatic Detection Algorithm for Malignant Pulmonary Nodules on Chest Radiographs
The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
Purpose To develop and validate a deep learning-based automatic detection algorithm (DLAD) for malignant pulmonary nodules on chest radiographs and to compare its performance with physicians including thoracic radiologists. Materials and Methods For this retrospective study, DLAD was developed by using 43 292 chest radiographs (normal radiograph-to-nodule radiograph ratio, 34 067:9225) in 34 676 patients (healthy-to-nodule ratio, 30 784:3892; 19 230 men [mean age, 52.8 years; age range, 18-99 years]; 15 446 women [mean age, 52.3 years; age range, 18-98 years]) obtained between 2010 and 2015, which were labeled and partially annotated by 13 board-certified radiologists, in a convolutional neural network. Radiograph classification and nodule detection performances of DLAD were validated by using one internal and four external data sets from three South Korean hospitals and one U.S. hospital. For internal and external validation, radiograph classification and nodule detection performances of DLAD were evaluated by using the area under the receiver operating characteristic curve (AUROC) and jackknife alternative free-response receiver-operating characteristic (JAFROC) figure of merit (FOM), respectively. An observer performance test involving 18 physicians, including nine board-certified radiologists, was conducted by using one of the four external validation data sets. Performances of DLAD, physicians, and physicians assisted with DLAD were evaluated and compared. Results According to one internal and four external validation data sets, radiograph classification and nodule detection performances of DLAD were a range of 0.92-0.99 (AUROC) and 0.831-0.924 (JAFROC FOM), respectively. DLAD showed a higher AUROC and JAFROC FOM at the observer performance test than 17 of 18 and 15 of 18 physicians, respectively (P < .05), and all physicians showed improved nodule detection performances with DLAD (mean JAFROC FOM improvement, 0.043; range, 0.006-0.190; P < .05). Conclusion This deep learning-based automatic detection algorithm outperformed physicians in radiograph classification and nodule detection performance for malignant pulmonary nodules on chest radiographs, and it enhanced physicians' performances when used as a second reader. © RSNA, 2018 Online supplemental material is available for this article.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“13 (refs. 63–75) studies validated algorithms on external data”
From Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis (2021) · cites this paper as [69]
In the citing paper
“Therefore, possibilities for developing computerized auxiliary diagnostic tools have become almost unlimited(39,40).”
From Artificial intelligence, machine learning, computer-aided diagnosis, and radiomics: advances in imaging towards to precision medicine (2019) · cites this paper as [39]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 2×
“3 (n = 11) 73 (8/11) [43, 91] 27 (9/33) [15, 44] 74 (49/66) [64, 83] 58 (32/55) [45, 70] 75 (33/44) [60, 86]”
DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988) · Biometrics · doi:10.2307/2531595 · Cited by 22,649
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Multiple significance tests: the Bonferroni method
Bland, J. M., & Altman, D. G. (1995) · BMJ · doi:10.1136/bmj.310.6973.170 · Cited by 3,341
Effective Doses in Radiology and Diagnostic Nuclear Medicine: A Catalog
Mettler, F. A., Huda, W., Yoshizumi, T. T., & Mahesh, M. (2008) · Radiology · doi:10.1148/radiol.2481071451 · Cited by 2,008
Benefits and Harms of CT Screening for Lung Cancer: A Systematic Review
Bach, P. B., Mirkin, J. N., Oliver, T. K., Azzoli, C. G., Berry, D. A., Brawley, O. W., Byers, T., Colditz, G. A., Gould, M. K., Jett, J. R., et al. (2012) · JAMA · doi:10.1001/jama.2012.5521 · Cited by 1,244
Lung Nodule Classification Using Deep Features in CT Images
Kumar, D., Wong, A., & Clausi, D. A. (2015) · 2015 12th Conference on Computer and Robot Vision · doi:10.1109/crv.2015.25 · Cited by 398
Cited by
Items 201–300 of 617
Kim, Y.-G., Lee, S. M., Lee, K. H., Jang, R., Seo, J. B., & Kim, N. (2020) · European Radiology · doi:10.1007/s00330-020-06892-9 · Cited by 27
Kim, E. Y., Kim, Y. J., Choi, W.-J., Lee, G. P., Choi, Y. R., Jin, K. N., & Cho, Y. J. (2021) · PLoS ONE · doi:10.1371/journal.pone.0246472 · Cited by 27
Self-citationYang, X., Wang, L.-T., Li, G.-D., Yu, Z.-K., Li, D., Guan, Q.-L., Zhang, Q., Guo, T., Wang, H., & Wang, Y. (2022) · European Journal of Anaesthesiology · doi:10.1097/eja.0000000000001720 · Cited by 27
Yoo, H., Kim, E. Y., Kim, H., Choi, Y. R., Kim, M. Y., Hwang, S. H., Kim, Y. J., Cho, Y. J., & Jin, K. N. (2022) · Korean Journal of Radiology · doi:10.3348/kjr.2022.0189 · Cited by 27
Self-citationChoi, D. H., Lim, M. H., Kim, K. H., Shin, S. D., Hong, K. J., & Kim, S. (2023) · Scientific Reports · doi:10.1038/s41598-023-40708-2 · Cited by 27
Zhou, Z., Qian, X., Hu, J., Chen, G., Zhang, C., Zhu, J., & Dai, Y. (2023) · Quantitative Imaging in Medicine and Surgery · doi:10.21037/qims-23-20 · Cited by 27
Ahluwalia, M., Abdalla, M., Sanayei, J., Seyyed-Kalantari, L., Hussain, M., Ali, A., & Fine, B. (2023) · Radiology: Artificial Intelligence · doi:10.1148/ryai.220270 · Cited by 26
Sassis, L., Kefala-Karli, P., Sassi, M., & Zervides, C. (2021) · Journal of Artificial Intelligence for Medical Sciences · doi:10.2991/jaims.d.210617.002 · Cited by 26
Zhou, Y., Mei, S., Wang, J., Xu, Q., Zhang, Z., Qin, S., Feng, J., Li, C., Xing, S., Wang, W., et al. (2024) · eClinicalMedicine · doi:10.1016/j.eclinm.2024.102772 · Cited by 26
“11 Though arti fi cial intelligence (AI) approaches have shown potential for early detection of ARDS, several challenges continue to exist.”
BackgroundLee, H. W., Jin, K. N., Oh, S., Kang, S., Lee, S. M., Jeong, I. B., Son, J. W., Han, J., Heo, E. Y., Lee, J. G., et al. (2023) · Annals of the American Thoracic Society · doi:10.1513/annalsats.202206-481oc · Cited by 27
Self-citationKvak, D., Chromcová, A., Biros, M., Hrubý, R., Kvaková, K., Pajdaković, M., & Ovesná, P. (2023) · BioMedInformatics · doi:10.3390/biomedinformatics3010006 · Cited by 27
A systematic approach to deep learning-based nodule detection in chest radiographs
Behrendt, F., Bengs, M., Bhattacharya, D., Krüger, J., Opfer, R., & Schlaefer, A. (2023) · Scientific Reports · doi:10.1038/s41598-023-37270-2 · Cited by 26
The Validity and Reliability of Automatic Tooth Segmentation Generated Using Artificial Intelligence
Al-Ubaydi, A. S., & Al-Groosh, D. H. (2023) · The Scientific World JOURNAL · doi:10.1155/2023/5933003 · Cited by 26
Lee, J. H., Hwang, E. J., Kim, H., & Park, C. M. (2022) · Translational Lung Cancer Research · doi:10.21037/tlcr-21-1012 · Cited by 25
Self-citationArtificial Intelligence in Lung Imaging
Choe, J., Lee, S. M., Hwang, H. J., Yun, J., Kim, N., & Seo, J. B. (2022) · Seminars in Respiratory and Critical Care Medicine · doi:10.1055/s-0042-1755571 · Cited by 26
BS-80K: The first large open-access dataset of bone scan images
Huang, Z., Pu, X., Tang, G., Ping, M., Jiang, G., Wang, M., Wei, X., & Ren, Y. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.106221 · Cited by 25
Fanni, S. C., Marcucci, A., Volpi, F., Valentino, S., Neri, E., & Romei, C. (2023) · Diagnostics · doi:10.3390/diagnostics13122020 · Cited by 25
Huang, K. T., Silva, M. A., See, A. P., Wu, K. C., Gallerani, T., Zaidi, H. A., Lu, Y., Chi, J. H., Groff, M. W., & Arnaout, O. M. (2019) · Journal of Neurosurgery Spine · doi:10.3171/2019.6.spine19463 · Cited by 25
Young, M. R., Abrams, N., Ghosh, S., Rinaudo, J. A., Márquez, G., & Srivastava, S. (2020) · Pancreas · doi:10.1097/mpa.0000000000001603 · Cited by 25
Liu, C., & Sun, J. (2021) · Annual Review of Analytical Chemistry · doi:10.1146/annurev-anchem-091520-091450 · Cited by 25
Understanding the Research Landscape of Deep Learning in Biomedical Science: Scientometric Analysis
Nam, S., Kim, D., Jung, W., & Zhu, Y. (2022) · Journal of Medical Internet Research · doi:10.2196/28114 · Cited by 24
Kwak, S. H., Kim, E., Kim, M. H., Lee, E. H., & Shin, H. J. (2023) · PLoS ONE · doi:10.1371/journal.pone.0281690 · Cited by 24
AI for Manufacturing and Healthcare: a chemistry and engineering perspectivePreprint
Chen, J., Yuan, Y., Ziabari, A., Xu, X., Zhang, H., Christakopoulos, P., Bonnesen, P. V., Ivanov, I. N., Ganesh, P., Chen, W., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2405.01520 · Cited by 24
Miró Catalina, Q., Vidal-Alaball, J., Fuster-Casanovas, A., Escalé-Besa, A., Ruiz Comellas, A., & Solé-Casals, J. (2024) · Scientific Reports · doi:10.1038/s41598-024-55792-1 · Cited by 23
Aslam, T. M., & Hoyle, D. C. (2021) · Ophthalmology and Therapy · doi:10.1007/s40123-021-00430-6 · Cited by 23
Lobo, M. D. (2023) · Advances in medical education, research, and ethics (AMERE) book series · doi:10.4018/978-1-6684-7164-7.ch004 · Cited by 23
Maiter, A., Hocking, K., Matthews, S., Taylor, J. C., Sharkey, M. J., Metherall, P., Alabed, S., Dwivedi, K., Shahin, Y., Anderson, E., et al. (2023) · BMJ Open · doi:10.1136/bmjopen-2023-077348 · Cited by 24
"It depends": Configuring AI to Improve Clinical Usefulness Across Contexts
Zając, H. D., Ribeiro, J., Ingala, S., Gentile, S., Wanjohi, R., Gitau, S. N., Carlsen, J. F., Nielsen, M. B., & Andersen, T. O. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3660707 · Cited by 25
The Bionic Radiologist: avoiding blurry pictures and providing greater insights
Dewey, M., & Wilkens, U. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0142-9 · Cited by 23
Jang, S. B., Lee, S. H., Lee, D. E., Park, S.-Y., Kim, J. K., Cho, J. W., Cho, J., Kim, K. B., Park, B., Park, J., et al. (2020) · PLoS ONE · doi:10.1371/journal.pone.0242759 · Cited by 23
Self-citationRajpurkar, P., Joshi, A., Pareek, A., Ng, A. Y., & Lungren, M. P. (2021) · ACM Conference on Health, Inference, and Learning (CHIL) · doi:10.1145/3450439.3451876 · Cited by 23
Peters, A. A., Decasper, A., Munz, J., Klaus, J. B., Loebelenz, L. I., Hoffner, M. K. M., Hourscht, C., Heverhagen, J. T., Christe, A., & Ebner, L. (2021) · Journal of Thoracic Disease · doi:10.21037/jtd-20-3522 · Cited by 23
Hwang, E. J., Park, J., Hong, W., Lee, H., Choi, H., Kim, H., Nam, J. G., Goo, J. M., Yoon, S. H., Lee, C. H., et al. (2022) · European Radiology · doi:10.1007/s00330-022-08593-x · Cited by 23
Self-citationDiagnostic Accuracy Studies in Radiology: How to Recognize and Address Potential Sources of Bias
Pavlou, A., Kurtz, R. M., & Song, J. W. (2021) · Radiology Research and Practice · doi:10.1155/2021/5801662 · Cited by 22
Transfer learning with NASNet-Mobile for Pneumonia X-ray classification
Naskinova, I. (2022) · Asian-European Journal of Mathematics · doi:10.1142/s1793557122502400 · Cited by 22
Artificial Intelligence in the Era of Precision Oncological Imaging
Cellina, M. I., Cè, M., Khenkina, N., Sinichich, P., Cervelli, M., Poggi, V., Boemi, S., Ierardi, A. M., & Carrafiello, G. (2022) · Technology in Cancer Research & Treatment · doi:10.1177/15330338221141793 · Cited by 23
A snapshot of artificial intelligence research 2019–2021: is it replacing or assisting physicians?
Elmahdy, M., & Sebro, R. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad094 · Cited by 22
X-ray Image Segmentation using Multi-task Learning
Park, S., Jeong, W., & Moon, Y. S. (2020) · KSII Transactions on Internet and Information Systems · doi:10.3837/tiis.2020.03.011 · Cited by 22
Self-citationLearning Visual Context by Comparison
Kim, M., Park, J., Na, S., Park, C. M., & Yoo, D. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58558-7_34 · Cited by 22
Self-citationImproving disease prevention, diagnosis, and treatment using novel bionic technologies
Manero, A. C., Crawford, K. E., Gibbs, H. P., Shah, N., Gandhi, D. A., & Coathup, M. J. (2022) · Bioengineering & Translational Medicine · doi:10.1002/btm2.10359 · Cited by 22
Catalina, Q. M., Fuster‐Casanovas, A., Solé‐Casals, J., & Vidal‐Alaball, J. (2022) · JMIR Research Protocols · doi:10.2196/39536 · Cited by 21
A narrative review of the clinical approach to subsolid pulmonary nodules
Kim, B., & Um, S. (2023) · Annals of Translational Medicine · doi:10.21037/atm-22-5246 · Cited by 21
Kim, N. J., Oh, J., Kim, S., Cha, J., Choi, J., Im, S. G., Choi, S., & Jang, B. C. (2024) · Advanced Functional Materials · doi:10.1002/adfm.202305136 · Cited by 21
Alcolea, J. L., Alfonso, A. F., Alonso, R. C., Vázquez, A. Á., Moreno, A. D., Castellanos, D. G., Greciano, L. S., Hayoun, C., Rodríguez, M. R., Vázquez, C. A., et al. (2024) · Diagnostics · doi:10.3390/diagnostics14222592 · Cited by 21
Chung, H., Kang, K. M., Al‐masni, M. A., Sohn, C., Nam, Y., Ryu, K., & Kim, D. (2020) · IEEE Access · doi:10.1109/access.2020.2977669 · Cited by 21
Chung, J. W., Kim, D., Choi, J., Yune, S., Song, K. D., Kim, S., Chua, M., Succi, M. D., Conklin, J., Longo, M. G. F., et al. (2022) · Scientific Reports · doi:10.1038/s41598-022-24721-5 · Cited by 21
Zhang, Y., Liu, M., Zhang, L., Wang, L., Zhao, K., Hu, S., Chen, X., & Xie, X. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.55113 · Cited by 20
Shao, J., Zhu, J., Jin, K., Guan, X., Jian, T., Xue, Y., Wang, C., Xu, X., Sun, F., Si, K., et al. (2023) · Journal of Personalized Medicine · doi:10.3390/jpm13020204 · Cited by 20
Self-citationSanchez, M., Alford, K., Krishna, V., Huynh, T. M., Nguyen, C. D. T., Lungren, M. P., Truong, S. Q. H., & Rajpurkar, P. (2023) · Cell Reports Medicine · doi:10.1016/j.xcrm.2023.101207 · Cited by 20
Yoon, J., Han, J., Ko, J., Choi, S., Park, J. I., Hwang, J. S., Han, J. M., & Hwang, D. D.-J. (2023) · Journal of Medical Internet Research · doi:10.2196/48142 · Cited by 20
Gill, S. S., Ponniah, H. S., Giersztein, S., Anantharaj, R. M., Namireddy, S. R., Killilea, J., Ramsay, D. S. C., Salih, A., Thavarajasingam, A., Scurtu, D., et al. (2025) · Brain and Spine · doi:10.1016/j.bas.2025.104208 · Cited by 20
Kim, S., Lee, C., Choi, Y., Baek, E. S., Choi, J. E., Lim, J. S., Kang, J., & Shin, S. J. (2021) · Frontiers in Oncology · doi:10.3389/fonc.2021.747250 · Cited by 20
Longitudinal Change Detection on Chest X-rays Using Geometric Correlation Maps
Oh, D. Y., Kim, J., & Lee, K. J. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-32226-7_83 · Cited by 20
Nojomi, M., Babaee, E., Rampisheh, Z., Benis, M. R., Soheyli, M., & Raz, N. R. (2025) · Medical Journal of the Islamic Republic of Iran · doi:10.47176/mjiri.39.81 · Cited by 19
An Imbalanced R-STDP Learning Rule in Spiking Neural Networks for Medical Image Classification
Zhou, Q., Ren, C., & Qi, S. (2020) · IEEE Access · doi:10.1109/access.2020.3044646 · Cited by 19
Unsupervised Detection of Lung Nodules in Chest Radiography Using Generative Adversarial Networks
Bhatt, N., Prados, D. R., Hodzic, N., Karanassios, C., & Tizhoosh, H. R. (2021) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc46164.2021.9630340 · Cited by 19
Artificial Intelligence in Biomedical Image Processing
Selvaraj, J., Prabha, T., Kumar, T. D. A., & Palaniappan, S. (2022) · Springer eBooks · doi:10.1007/978-981-16-5993-5_8 · Cited by 19
Droppelmann, G., Tello, M., García, N., Greene, C., Jorquera, C., & Feijoo, F. (2022) · Frontiers in Medicine · doi:10.3389/fmed.2022.945698 · Cited by 19
Navigating patient journey in early diagnosis of lung cancer in India
Biswas, B., Talwar, D., Meshram, P. L., Julka, P. K., Mehta, A., Somashekhar, S. P., Chilukuri, S. C., & Bansal, A. (2022) · Lung India · doi:10.4103/lungindia.lungindia_144_22 · Cited by 19
Santomartino, S. M., Hafezi‐Nejad, N., Parekh, V. S., & Yi, P. H. (2023) · Radiology Artificial Intelligence · doi:10.1148/ryai.220062 · Cited by 19
Slice-Fusion: Reducing False Positives in Liver Tumor Detection for Mask R-CNN
Tu, D.-Y., Lin, P., Chou, H., Shen, M., & Hsieh, S. (2023) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2023.3265394 · Cited by 19
Zhao, Y., Zheng, S., Cai, N., Zhang, Q., Zhong, H., Zhou, Y., Zhang, B., & Wang, G. (2023) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-023-00851-8 · Cited by 19
Kim, H., Park, C. M., & Goo, J. M. (2020) · European Radiology · doi:10.1007/s00330-019-06589-8 · Cited by 19
Self-citationLesion-aware convolutional neural network for chest radiograph classification
Li, F., Shi, J., Yan, L., Wang, Y.-G., Zhang, X.-D., Jiang, M., Wu, Z., & Zhou, K.-Q. (2020) · Clinical Radiology · doi:10.1016/j.crad.2020.08.027 · Cited by 19
Kim, H., Lee, K. H., Han, K., Lee, J. W., Kim, J. Y., Im, D. J., Hong, Y. J., Choi, B. W., & Hur, J. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.53820 · Cited by 18
Self-citationTakamatsu, A., Ueno, M., Yoshida, K., Kobayashi, T., Kobayashi, S., & Gabata, T. (2023) · Japanese Journal of Radiology · doi:10.1007/s11604-023-01503-1 · Cited by 18
Luo, X., Wang, H., Xu, J., Li, L., Zhao, Y., He, Y., Huang, H. L., Xiao, J., Song, T., Zhang, S., et al. (2024) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2024.11.064 · Cited by 18
Shin, H. J., Han, K., Son, N., Kim, E., Kim, M. J., Gatidis, S., & Vasanawala, S. S. (2024) · Scientific Reports · doi:10.1038/s41598-024-82775-z · Cited by 18
Cho, S. Y., Lee, J. H., Ryu, J. M., Lee, J. E., Cho, E. Y., Ahn, C. H., Paeng, K., Yoo, I., Ock, C., & Song, S. Y. (2021) · Scientific Reports · doi:10.1038/s41598-021-96855-x · Cited by 18
Self-citationXu, Y., Li, Y., Yin, H., Tang, W., & Fan, G. (2021) · Frontiers in Oncology · doi:10.3389/fonc.2021.725599 · Cited by 18
Kim, W., Lee, S. M., Kim, J. I., Ahn, Y., Park, S., Choe, J., & Seo, J. B. (2021) · American Journal of Roentgenology · doi:10.2214/ajr.21.26682 · Cited by 19
Self-citationComputer-Assisted Clinical Diagnosis and Treatment
Hamid, N., Portnoy, J. M., & Pandya, A. (2023) · Current Allergy and Asthma Reports · doi:10.1007/s11882-023-01097-8 · Cited by 18
Wang, X., Yang, T., Zhang, Y., Liu, X., Zhang, Y., Sun, L., Gu, X., Chen, Z., Guo, Y., Xue, C., et al. (2022) · Prenatal Diagnosis · doi:10.1002/pd.6220 · Cited by 17
Shin, H., Kim, T., Park, J.-H., Raj, H., Jabbar, M. S., Abebaw, Z. D., Lee, J., Văn, C. C., Kim, H., & Shin, D. (2023) · European Radiology Experimental · doi:10.1186/s41747-023-00386-1 · Cited by 17
Self-citationGong, D. A., Kras, A., & Miller, J. B. (2021) · Seminars in Ophthalmology · doi:10.1080/08820538.2021.1889617 · Cited by 17
Mander, G., & Munn, Z. (2021) · Journal of medical imaging and radiation sciences · doi:10.1016/j.jmir.2021.02.005 · Cited by 17
Azuma, M., Nakada, H., Takei, M., Nakamura, K., Katsuragawa, S., Shinkawa, N., Terada, T., Masuda, R., Hattori, Y., Ide, T., et al. (2021) · Emergency Radiology · doi:10.1007/s10140-021-02000-6 · Cited by 17
Koo, Y. H., Shin, K. E., Park, J. S., Lee, J. W., Byun, S., & Lee, H. (2020) · Journal of Medical Imaging and Radiation Oncology · doi:10.1111/1754-9485.13105 · Cited by 17
Self-citationBeck, K. S., Gil, B. M., Na, S. J., Hong, J. H., Chun, S. H., An, H. J., Kim, J. J., Hong, S. A., Lee, B., Shim, W. S., et al. (2021) · Frontiers in Oncology · doi:10.3389/fonc.2021.661244 · Cited by 17
Self-citationHost Microbiomes in Tumor Precision Medicine: How far are we?
D’Amico, F., Barone, M., Tavella, T., Rampelli, S., Brigidi, P., & Turroni, S. (2022) · Current Medicinal Chemistry · doi:10.2174/0929867329666220105121754 · Cited by 17
Li, S., Li, W., Ma, T., Fu, S., Gao, X., Qin, N., Wu, Y., Zhang, X., Wang, J., Pan, Y., et al. (2022) · Frontiers in Immunology · doi:10.3389/fimmu.2022.1024707 · Cited by 16
Cai, Z., Zhang, Q., Fu, Z., Fingerhut, A. L., Tan, J., Zang, L., Dong, F., Li, S., Wang, S., & Ma, J. (2023) · World Journal of Gastroenterology · doi:10.3748/wjg.v29.i3.536 · Cited by 16
Garg, A., Gupta, S., Vats, S., Handa, P., & Goel, N. (2024) · Expert Systems · doi:10.1111/exsy.13697 · Cited by 17
Lococo, F., Ghaly, G., Flamini, S., Campanella, A., Chiappetta, M., Bria, E., Vita, E., Tortora, G., Evangelista, J., Sassorossi, C., et al. (2024) · Journal of Thoracic Disease · doi:10.21037/jtd-24-244 · Cited by 16
de Camargo, T. F. O., Ribeiro, G., da Silva, M. C. B., da Silva, L. O., Torres, P. P. T. E. S., Silva, D. D., de Santos, M. O. N., Salibe-Filho, W., Rosa, M. E. E., Novaes, M. D. A., et al. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1512910 · Cited by 16
Rudolph, J., Fink, N., Dinkel, J., Koliogiannis, V., Schwarze, V., Goller, S. S., Erber, B. M., Geyer, T., Hoppe, B. F., Fischer, M., et al. (2021) · Diagnostics · doi:10.3390/diagnostics11101868 · Cited by 16
Supervised Contrastive Embedding for Medical Image Segmentation
Lee, S.-W., Lee, Y., Lee, G., & Hwang, S. (2021) · IEEE Access · doi:10.1109/access.2021.3118694 · Cited by 16
Self-citationNam, J. G., Kim, H. J., Lee, E. H., Hong, W., Park, J., Hwang, E. J., Park, C. M., & Goo, J. M. (2021) · European Radiology · doi:10.1007/s00330-021-08162-8 · Cited by 15
Self-citationEvolving and Novel Applications of Artificial Intelligence in Thoracic Imaging
Chang, J. Y., & Makary, M. S. (2024) · Diagnostics · doi:10.3390/diagnostics14131456 · Cited by 15
Hwang, E. J., Kim, H., Lee, J. H., Goo, J. M., & Park, C. M. (2020) · European Radiology · doi:10.1007/s00330-020-07062-7 · Cited by 15
Self-citationUrtnasan, E., Lee, J. H., Moon, B., Lee, H. Y., Lee, K.-H., & Youk, H. (2022) · JMIR Medical Informatics · doi:10.2196/34724 · Cited by 15
Self-citationLi, Y., Wu, W., Sun, Y., Yu, D., Zhang, Y., Wang, L., Wang, Y., Zhang, X., & Lu, Y. (2022) · Frontiers in Oncology · doi:10.3389/fonc.2022.945053 · Cited by 15
Huh, J. E., Lee, J. H., Hwang, E. J., & Park, C. M. (2023) · Korean Journal of Radiology · doi:10.3348/kjr.2022.0548 · Cited by 15
Self-citationMoving Artificial Intelligence from Feasible to Real: Time to Drill for Gas and Build Roads
Chang, P. J. (2019) · Radiology · doi:10.1148/radiol.2019192527 · Cited by 15
Deep convolutional network-based chest radiographs screening model for pneumoconiosis
Xiao, L., Xu, M., Yan, Z., Xia, F., Li, S., Zhang, Y., Xing, Z., & Guan, L. (2024) · Frontiers in Medicine · doi:10.3389/fmed.2024.1290729 · Cited by 14
Bettinger, H., Lenczner, G., Guigui, J., Rotenberg, L., Zerbib, E., Attia, A., Vidal, J., & Beaumel, P. (2024) · Diagnostics · doi:10.3390/diagnostics14111183 · Cited by 14
The effectiveness of using artificial intelligence in clinical medicine
Иванович, К. Д., & Lamotkin, A. I. (2025) · FARMAKOEKONOMIKA Modern Pharmacoeconomics and Pharmacoepidemiology · doi:10.17749/2070-4909/farmakoekonomika.2025.287 · Cited by 14
Towards Uncertainty Aware Task Delegation and Human-AI Collaborative Decision-Making
Lee, M. H., & Tok, M. Z. Y. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732155 · Cited by 14
Evaluating the Performance and Clinical Utility of AI-driven Diagnostic Tools in Radiology
Mercaldo, S., Hillis, J. M., & Blume, J. D. (2025) · Radiology · doi:10.1148/radiol.243935 · Cited by 14
Oh, J.-H., Kim, H., Lee, K. M., Ryu, C., Park, S., Jang, J. H., Choi, H. S., & Kim, E. J. (2021) · Yonsei Medical Journal · doi:10.3349/ymj.2021.62.12.1125 · Cited by 14
Self-citation
Metadata
- Authors
- Nam, J. G., Park, S., Hwang, E. J., Lee, J. H., Jin, K.-N., Lim, K. Y., Vu, T. H., Sohn, J. H., Hwang, S., Goo, J. M., & Park, C. M.
- Affiliations
- University of California, San Francisco (US)
- ORCID
- Venue
- Radiology
- Published
- 2019-01
- Volume
- 290
- Issue
- 1
- Pages
- 218-228
- ISSN
- 0033-8419 (ISSN-L)
- 1527-1315
- OpenAlex
- W2894319790
- Cited by
- 539
- References
- 28
- Citations by year
- 2026: 29 · 2025: 37 · 2024: 81 · 2023: 88 · 2022: 80 · 2021: 113 · 2020: 67 · 2019: 38
- FWCI
- 31.42
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Radiology (publishedVersion)
- PubMed (publishedVersion)
- Seoul National University Open Repository (Seoul National University) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Health Sciences › Medicine › Pulmonary and Respiratory Medicine › Lung Cancer Diagnosis and Treatment
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
- Keywords
- lung cancer, chest radiograph, convolutional neural networks, computer-aided detection, radiograph classification, observer performance, radiologist comparison, external validation, area under the receiver operating characteristic, lung nodule detection, thoracic radiology, lung cancer screening, lung cancer staging
- MeSH terms
- Deep Learning, Adolescent, Adult, Aged, Aged, 80 and over, Algorithms, Female, Humans, Lung Neoplasms, Male, Middle Aged, Radiographic Image Interpretation, Computer-Assisted, Retrospective Studies, Radiography, Thoracic, Reproducibility of Results, Multiple Pulmonary Nodules, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.