Development and Validation of Deep Learning–based Automatic Detection Algorithm for Malignant Pulmonary Nodules on Chest Radiographs
The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
Purpose To develop and validate a deep learning-based automatic detection algorithm (DLAD) for malignant pulmonary nodules on chest radiographs and to compare its performance with physicians including thoracic radiologists. Materials and Methods For this retrospective study, DLAD was developed by using 43 292 chest radiographs (normal radiograph-to-nodule radiograph ratio, 34 067:9225) in 34 676 patients (healthy-to-nodule ratio, 30 784:3892; 19 230 men [mean age, 52.8 years; age range, 18-99 years]; 15 446 women [mean age, 52.3 years; age range, 18-98 years]) obtained between 2010 and 2015, which were labeled and partially annotated by 13 board-certified radiologists, in a convolutional neural network. Radiograph classification and nodule detection performances of DLAD were validated by using one internal and four external data sets from three South Korean hospitals and one U.S. hospital. For internal and external validation, radiograph classification and nodule detection performances of DLAD were evaluated by using the area under the receiver operating characteristic curve (AUROC) and jackknife alternative free-response receiver-operating characteristic (JAFROC) figure of merit (FOM), respectively. An observer performance test involving 18 physicians, including nine board-certified radiologists, was conducted by using one of the four external validation data sets. Performances of DLAD, physicians, and physicians assisted with DLAD were evaluated and compared. Results According to one internal and four external validation data sets, radiograph classification and nodule detection performances of DLAD were a range of 0.92-0.99 (AUROC) and 0.831-0.924 (JAFROC FOM), respectively. DLAD showed a higher AUROC and JAFROC FOM at the observer performance test than 17 of 18 and 15 of 18 physicians, respectively (P < .05), and all physicians showed improved nodule detection performances with DLAD (mean JAFROC FOM improvement, 0.043; range, 0.006-0.190; P < .05). Conclusion This deep learning-based automatic detection algorithm outperformed physicians in radiograph classification and nodule detection performance for malignant pulmonary nodules on chest radiographs, and it enhanced physicians' performances when used as a second reader. © RSNA, 2018 Online supplemental material is available for this article.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“13 (refs. 63–75) studies validated algorithms on external data”
From Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis (2021) · cites this paper as [69]
In the citing paper
“Therefore, possibilities for developing computerized auxiliary diagnostic tools have become almost unlimited(39,40).”
From Artificial intelligence, machine learning, computer-aided diagnosis, and radiomics: advances in imaging towards to precision medicine (2019) · cites this paper as [39]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 2×
“3 (n = 11) 73 (8/11) [43, 91] 27 (9/33) [15, 44] 74 (49/66) [64, 83] 58 (32/55) [45, 70] 75 (33/44) [60, 86]”
DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988) · Biometrics · doi:10.2307/2531595 · Cited by 22,649
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Multiple significance tests: the Bonferroni method
Bland, J. M., & Altman, D. G. (1995) · BMJ · doi:10.1136/bmj.310.6973.170 · Cited by 3,341
Effective Doses in Radiology and Diagnostic Nuclear Medicine: A Catalog
Mettler, F. A., Huda, W., Yoshizumi, T. T., & Mahesh, M. (2008) · Radiology · doi:10.1148/radiol.2481071451 · Cited by 2,008
Benefits and Harms of CT Screening for Lung Cancer: A Systematic Review
Bach, P. B., Mirkin, J. N., Oliver, T. K., Azzoli, C. G., Berry, D. A., Brawley, O. W., Byers, T., Colditz, G. A., Gould, M. K., Jett, J. R., et al. (2012) · JAMA · doi:10.1001/jama.2012.5521 · Cited by 1,244
Lung Nodule Classification Using Deep Features in CT Images
Kumar, D., Wong, A., & Clausi, D. A. (2015) · 2015 12th Conference on Computer and Robot Vision · doi:10.1109/crv.2015.25 · Cited by 398
Cited by
Items 101–200 of 617
Nabulsi, Z., Sellergren, A., Jamshy, S., Lau, C. T., Santos, E. R. G., Kiraly, A. P., Ye, W., Yang, J., Pilgrim, R., Kazemzadeh, S., et al. (2021) · Scientific Reports · doi:10.1038/s41598-021-93967-2 · Cited by 74
Enhancing Kidney Transplant Care through the Integration of Chatbot
Valencia, O. A. G., Thongprayoon, C., Jadlowiec, C. C., Mao, S. A., Miao, J., & Cheungpasitporn, W. (2023) · Healthcare · doi:10.3390/healthcare11182518 · Cited by 74
Multi-Label Classification of Chest X-ray Abnormalities Using Transfer Learning Techniques
Kufel, J., Bielówka, M., Rojek, M., Mitręga, A., Lewandowski, P., Cebula, M., Krawczyk, D., Bielówka, M., Kondoł, D., Bargieł-Łączek, K., et al. (2023) · Journal of Personalized Medicine · doi:10.3390/jpm13101426 · Cited by 74
Ilan, Y. (2020) · Frontiers in Digital Health · doi:10.3389/fdgth.2020.569178 · Cited by 73
Controlling Safety of Artificial Intelligence-Based Systems in Healthcare
Davahli, M. R., Karwowski, W., Fiok, K., Wan, T. T. H., & Parsaei, H. R. (2021) · Symmetry · doi:10.3390/sym13010102 · Cited by 72
Artificial Intelligence Tools for Refining Lung Cancer Screening
Espinoza, J. L., & Dong, L. T. (2020) · Journal of Clinical Medicine · doi:10.3390/jcm9123860 · Cited by 70
Liang, C.-H., Liu, Y.-C., Wu, M.-T., Garcia-Castro, F., Alberich-Bayarri, A., & Wu, F.-Z. (2020) · Clinical Radiology · doi:10.1016/j.crad.2019.08.005 · Cited by 69
Farič, N., Hinder, S., Williams, R., Ramaesh, R., Bernabéu, M. O., van Beek, E. J. R., & Cresswell, K. M. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad191 · Cited by 70
CMM-Net: Contextual multi-scale multi-level network for efficient biomedical image segmentation
Al‐masni, M. A., & Kim, D. (2021) · Scientific Reports · doi:10.1038/s41598-021-89686-3 · Cited by 69
Zhang, L., Li, M., Zhou, Y., Lu, G., & Zhou, Q. (2020) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.27266 · Cited by 68
Machine Learning Augmented Interpretation of Chest X-rays: A Systematic Review
Ahmad, H. K., Milne, M., Buchlak, Q. D., Ektas, N., Sanderson, G., Chamtie, H., Karunasena, S., Chiang, J., Holt, X., Tang, C. H. M., et al. (2023) · Diagnostics · doi:10.3390/diagnostics13040743 · Cited by 67
Heart Coronary Artery Segmentation and Disease Risk Warning Based on a Deep Learning Algorithm
Xiao, C., Li, Y., & Jiang, Y. (2020) · IEEE Access · doi:10.1109/access.2020.3010800 · Cited by 65
Dual-stage attention-based LSTM for simulating performance of brackish water treatment plant
Yoon, N., Kim, J., Lim, J., Abbas, A., Jeong, K., & Cho, K. H. (2021) · Desalination · doi:10.1016/j.desal.2021.115107 · Cited by 64
Discriminative ensemble learning for few-shot chest x-ray diagnosis
Paul, A., Tang, Y., Shen, T. C., & Summers, R. M. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101911 · Cited by 62
Early Detection of Septic Shock Onset Using Interpretable Machine Learners
Misra, D., Avula, V., Wolk, D. M., Farag, H. A., Li, J., Mehta, Y. B., Sandhu, R., Karunakaran, B., Kethireddy, S., Zand, R., et al. (2021) · Journal of Clinical Medicine · doi:10.3390/jcm10020301 · Cited by 51
Pacurari, A. C., Bhattarai, S., Muhammad, A., Avram, C., Mederle, O. A., Roșca, O., Bratosin, F., Bogdan, I. G., Fericean, R. M., Biriş, M., et al. (2023) · Diagnostics · doi:10.3390/diagnostics13132145 · Cited by 61
Effect of Human-AI Interaction on Detection of Malignant Lung Nodules on Chest Radiographs
Lee, J. H., Hong, H., Nam, G., Hwang, E. J., & Park, C. M. (2023) · Radiology · doi:10.1148/radiol.222976 · Cited by 53
Self-citationArtificial intelligence in thoracic surgery: past, present, perspective and limits
Etienne, H., Hamdi, S., Le Roux, M., Camuset, J., Khalife-Hocquemiller, T., Giol, M., Debrosse, D., & Assouad, J. (2020) · European Respiratory Review · doi:10.1183/16000617.0010-2020 · Cited by 60
“[15] to detect malignant pulmonary nodules on chest radiographs.”
BackgroundUeda, D., Yamamoto, A., Shimazaki, A., Walston, S. L., Matsumoto, T., Izumi, N., Tsukioka, T., Komatsu, H., Inoue, H., Kabata, D., et al. (2021) · BMC Cancer · doi:10.1186/s12885-021-08847-9 · Cited by 60
Artificial Intelligence (AI) for Lung Nodules, From the AJR Special Series on AI Applications
Liu, J. A., Yang, I. Y., & Tsai, E. B. (2022) · American Journal of Roentgenology · doi:10.2214/ajr.22.27487 · Cited by 60
Alelyani, M., Alamri, S., Alqahtani, M. S., Musa, A., Almater, H., Alqahtani, N., Alshahrani, F., & Alelyani, S. (2021) · Healthcare · doi:10.3390/healthcare9070834 · Cited by 45
A deep learning-based algorithm for pulmonary tuberculosis detection in chest radiography
Chen, C.-F., Hsu, C.-H., Jiang, Y.-C., Lin, W.-R., Hong, W.-C., Chen, I.-Y., Lin, M.-H., Chu, K., Lee, C.-H., Lee, D. L., et al. (2024) · Scientific Reports · doi:10.1038/s41598-024-65703-z · Cited by 59
Jeong, Y., Kim, J. H., Chae, H.-D., Park, S., Bae, J. S., Joo, I., & Han, J. K. (2020) · Scientific Reports · doi:10.1038/s41598-020-64205-y · Cited by 58
Self-citationAI in the treatment of fertility: key considerations
Swain, J. E., VerMilyea, M. T., Meseguer, M., Ezcurra, D., Fertility AI Forum Group, Ezcurra, D., Letterie, G. S., Sánchez, P., Trew, G. H., Swain, J., et al. (2020) · Journal of Assisted Reproduction and Genetics · doi:10.1007/s10815-020-01950-z · Cited by 58
Hong, G.-S., Jang, M., Kyung, S., Cho, K., Jeong, J., Lee, G. Y., Shin, K., Kim, K., Ryu, S. M., Seo, J. B., et al. (2023) · Korean Journal of Radiology · doi:10.3348/kjr.2023.0393 · Cited by 57
An Overview of Deep Learning Approaches in Chest Radiograph
Anis, S., Lai, K. W., Chuah, J. H., Shoaib, M. A., Mohafez, H., Hadizadeh, M., Yan, D., & Ong, Z. C. (2020) · IEEE Access · doi:10.1109/access.2020.3028390 · Cited by 57
Deep Learning Innovations in the Detection of Lung Cancer: Advances, Trends, and Open Challenges
Liz-López, H., Hernández, Á. A. D. S., Maceiras, S. D., Díaz-Martínez, M. A., & Camacho, D. (2025) · Cognitive Computation · doi:10.1007/s12559-025-10408-2 · Cited by 56
Carmo, L. O. E., van den Merkhof, A., Olczak, J., Gordon, M., Jutte, P. C., Jaarsma, R. L., IJpma, F. F. A., Doornberg, J. N., & Prijs, J. (2021) · Bone & Joint Open · doi:10.1302/2633-1462.210.bjo-2021-0133 · Cited by 56
Kim, D., Chung, J., Choi, J., Succi, M. D., Conklin, J., Longo, M. G. F., Ackman, J. B., Little, B. P., Petranovic, M., Kalra, M. K., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-29437-8 · Cited by 40
Effect of image resolution on automated classification of chest X-rays
Haque, M. I. U., Dubey, A., Danciu, I., Justice, A. C., Ovchinnikova, O. S., & Hinkle, J. D. (2023) · Journal of medical imaging · doi:10.1117/1.jmi.10.4.044503 · Cited by 55
Kim, N., Chang, J. S., Kim, Y. B., & Kim, J. S. (2020) · Radiation Oncology · doi:10.1186/s13014-020-01562-y · Cited by 55
Putting artificial intelligence (AI) on the spot: machine learning evaluation of pulmonary nodules
Tandon, Y. K., Bartholmai, B. J., & Koo, C. W. (2020) · Journal of Thoracic Disease · doi:10.21037/jtd-2019-cptn-03 · Cited by 55
Paul, A., Shen, T. C., Lee, S., Balachandar, N., Peng, Y., Lu, Z., & Summers, R. M. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2021.3054817 · Cited by 55
Rajpurkar, P., Joshi, A., Pareek, A., Chen, P., Kiani, A., Irvin, J., Ng, A. Y., & Lungren, M. P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.11379 · Cited by 55
Tam, M. D. B. S., Dyer, T., Dissez, G., Morgan, T. N., Hughes, M., Illes, J., Rasalingham, R., & Rasalingham, S. (2021) · Clinical Radiology · doi:10.1016/j.crad.2021.03.021 · Cited by 43
Ullah, N., Khan, J. A., Almakdi, S., Khan, M. S., Alshehri, M., Alboaneen, D., & Raza, A. (2022) · Applied Sciences · doi:10.3390/app12126269 · Cited by 53
Weakly Supervised Deep Learning in Radiology
Misera, L., Müller‐Franzes, G. A., Truhn, D., & Kather, J. N. (2024) · Radiology · doi:10.1148/radiol.232085 · Cited by 53
Kim, K.-W., Kim, S., Han, K., Bae, H., Shin, J., & Lim, J. S. (2021) · Korean Journal of Radiology · doi:10.3348/kjr.2020.0447 · Cited by 53
Ariji, Y., Kise, Y., Fukuda, M., Kuwada, C., & Ariji, E. (2022) · Dentomaxillofacial Radiology · doi:10.1259/dmfr.20210515 · Cited by 53
Sun, L., Wang, Z., Pu, H., Yuan, G., Guo, L., Pu, T., & Peng, Z. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104357 · Cited by 52
Hwang, E. J., Kim, K. B., Kim, J. Y., Lim, J., Nam, J. G., Choi, H., Kim, H., Yoon, S. H., Goo, J. M., & Park, C. M. (2021) · PLoS ONE · doi:10.1371/journal.pone.0252440 · Cited by 51
Self-citationArtificial intelligence in thoracic surgery: a narrative review
Bellini, V., Valente, M., Del Rio, P., & Bignami, E. (2021) · Journal of Thoracic Disease · doi:10.21037/jtd-21-761 · Cited by 49
Hwang, E. J., Goo, J. M., Yoon, S. H., Beck, K. S., Seo, J. B., Choi, B. W., Chung, M. J., Park, C. M., Jin, K. N., & Lee, S. M. (2021) · Korean Journal of Radiology · doi:10.3348/kjr.2021.0544 · Cited by 43
Self-citationEvaluating ChatGPT-4V in chest CT diagnostics: a critical image interpretation assessment
Dehdab, R., Brendlin, A., Werner, S., Almansour, H., Gassenmaier, S., Brendel, J. M., Nikolaou, K., & Afat, S. (2024) · Japanese Journal of Radiology · doi:10.1007/s11604-024-01606-3 · Cited by 49
Nam, J. Y., Chung, H. J., Choi, K. S., Lee, H., Kim, T. J., Kim, T. J., Soh, H., Kang, E. A., Cho, S.-J., Im, J. P., et al. (2021) · Gastrointestinal Endoscopy · doi:10.1016/j.gie.2021.08.022 · Cited by 49
Self-citationHong, W., Hwang, E. J., Lee, J. H., Park, J., Goo, J. M., & Park, C. M. (2022) · Radiology · doi:10.1148/radiol.211706 · Cited by 49
Self-citationLee, J. H., Park, S., Hwang, E. J., Goo, J. M., Lee, W. Y., Lee, S., Kim, H., Andrews, J. R., & Park, C. M. (2021) · European Radiology · doi:10.1007/s00330-020-07219-4 · Cited by 47
Self-citationManagement of incidental pulmonary nodules: current strategies and future perspectives
Kim, T. J., Kim, C. H., Lee, H. Y., Chung, M. J., Shin, S. H., Lee, K. J., & Lee, K. S. (2019) · Expert Review of Respiratory Medicine · doi:10.1080/17476348.2020.1697853 · Cited by 47
Hwang, E. J., Hong, J. H., Lee, K. H., Kim, J. I., Nam, J. G., Kim, D., Choi, H., Yoo, S., Goo, J. M., & Park, C. M. (2020) · European Radiology · doi:10.1007/s00330-020-06771-3 · Cited by 47
Self-citationDoherty, G., McLaughlin, L., Hughes, C., McConnell, J., Bond, R., & McFadden, S. (2024) · Radiography · doi:10.1016/j.radi.2023.12.019 · Cited by 38
A robust convolutional neural network for lung nodule detection in the presence of foreign bodies
Schultheiß, M., Schober, S. A., Lodde, M., Bodden, J. H., Aichele, J., Müller-Leisse, C., Renger, B. C., Pfeiffer, F., & Pfeiffer, D. (2020) · Scientific Reports · doi:10.1038/s41598-020-69789-z · Cited by 46
Image synthesis with disentangled attributes for chest X-ray nodule augmentation and detection
Shen, Z., Ouyang, X., Xiao, B., Cheng, J., Shen, D. G., & Wang, Q. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102708 · Cited by 46
A descriptive framework for the field of deep learning applications in medical images
Tian, Y., & Fu, S. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106445 · Cited by 45
An AI-Based Algorithm for the Automatic Classification of Thoracic Radiographs in Cats
Banzato, T., Wodziński, M., Tauceri, F., Donà, C., Scavazza, F., Müller, H., & Zotti, A. (2021) · Frontiers in Veterinary Science · doi:10.3389/fvets.2021.731936 · Cited by 44
Polymeri, E., Sadik, M., Kaboteh, R., Borrelli, P., Enqvist, O., Ulén, J., Ohlsson, M., Trägårdh, E., Poulsen, M. H., Simonsen, J. A., et al. (2019) · Clinical Physiology and Functional Imaging · doi:10.1111/cpf.12611 · Cited by 43
Kim, J. H., Kim, J. Y., Kim, G. H., Kang, D., Kim, I. J., Seo, J., Andrews, J. R., & Park, C. M. (2020) · Journal of Clinical Medicine · doi:10.3390/jcm9061981 · Cited by 42
Self-citationKim, J. H., Han, S. G., Cho, A., Shin, H. J., & Baek, S.-E. (2021) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-021-01679-4 · Cited by 38
Wang, C., Ma, J., Zhang, S., Shao, J., Wang, Y., Zhou, H.-Y., Song, L., Zheng, J., Yu, Y., & Li, W. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00648-z · Cited by 41
Chae, K. J., Jin, G. Y., Ko, S. B., Wang, Y., Zhang, H., Choi, E. J., & Choi, H. (2020) · Academic Radiology · doi:10.1016/j.acra.2019.05.018 · Cited by 40
Mumuni, F., & Mumuni, A. (2023) · Cognitive Systems Research · doi:10.1016/j.cogsys.2023.101188 · Cited by 41
Current Trends in Artificial Intelligence Application for Endourology and Robotic Surgery
Chang, T., Seufert, C., Eminağa, O., Shkolyar, E., Hu, J. C., & Liao, J. C. (2020) · Urologic Clinics of North America · doi:10.1016/j.ucl.2020.09.004 · Cited by 40
Kim, C., Yang, Z., Park, S. H., Hwang, S. H., Oh, Y., Kang, E.-Y., & Yong, H. S. (2023) · European Radiology · doi:10.1007/s00330-022-09315-z · Cited by 38
Self-citationKinoshita, K., Maruyama, T., Kobayashi, N., Imanishi, S., Maruyama, M., Ohira, G., Endo, S., Tochigi, T., Kinoshita, M., Fukui, Y., et al. (2024) · Surgical Endoscopy · doi:10.1007/s00464-024-10939-z · Cited by 39
Blazis, S. P., Dieckens, D., Linsen, P. V. M., & Jarnalo, C. O. M. (2021) · European Journal of Radiology · doi:10.1016/j.ejrad.2021.109526 · Cited by 38
Nam, J. G., Witanto, J. N., Park, S. J., Yoo, S., Goo, J. M., & Yoon, S. H. (2021) · European Radiology · doi:10.1007/s00330-021-08036-z · Cited by 38
Self-citationAmeen, S., Wong, M. C., Yee, K., & Turner, P. A. (2022) · Applied Sciences · doi:10.3390/app12073341 · Cited by 40
Reducing Errors Resulting From Commonly Missed Chest Radiography Findings
Gefter, W. B., & Hatabu, H. (2022) · CHEST Journal · doi:10.1016/j.chest.2022.12.003 · Cited by 38
Application of artificial intelligence technology in the field of orthopedics: a narrative review
Liu, P., Zhang, J., Liu, S., Huo, T., He, J., Xue, M., Fang, Y., Wang, H., Xie, Y., Xie, M., et al. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-023-10638-6 · Cited by 37
AI Applications for Thoracic Imaging: Considerations for Best Practice
Hwang, E. J., Goo, J. M., & Park, C. M. (2025) · Radiology · doi:10.1148/radiol.240650 · Cited by 39
Self-citationHow to Prepare Prospective Psychiatrists in the Era of Artificial Intelligence
Kim, J. W., Jones, K. L., & D’Angelo, E. J. (2019) · Academic Psychiatry · doi:10.1007/s40596-019-01025-x · Cited by 37
Automatic T Staging Using Weakly Supervised Deep Learning for Nasopharyngeal Carcinoma on MR Images
Yang, Q. P., Guo, Y., Ou, X., Wang, J., & Hu, C. (2020) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.27202 · Cited by 37
Chang, S., Kim, H., Suh, Y. J., Choi, D. M., Kim, H., Kim, D. K., Kim, J. Y., Yoo, J. Y., & Choi, B. W. (2021) · European Journal of Radiology · doi:10.1016/j.ejrad.2021.109582 · Cited by 37
Diagnostic performance of artificial intelligence model for pneumonia from chest radiography
Kwon, T., Lee, S. P., Kim, D., Jang, J., Lee, M., Kang, S. U., Kim, H. J., Oh, K.-Y., On, J., Kim, Y. J., et al. (2021) · PLoS ONE · doi:10.1371/journal.pone.0249399 · Cited by 37
Self-citationJin, K. N., Kim, E. Y., Kim, Y. J., Lee, G. P., Kim, H., Oh, S., Kim, Y., Han, J., & Cho, Y. J. (2022) · European Radiology · doi:10.1007/s00330-021-08397-5 · Cited by 37
Self-citationBreaCNet: A high-accuracy breast thermogram classifier based on mobile convolutional neural network
Roslidar, R., Syaryadhi, M., Saddami, K., Pradhan, B., Arnia, F., Syukri, M., & Munadi, K. (2021) · Mathematical Biosciences & Engineering · doi:10.3934/mbe.2022060 · Cited by 37
Ng, C. K. C. (2023) · Children · doi:10.3390/children10081372 · Cited by 37
Murphy, A., & Liszewski, B. (2019) · Journal of medical imaging and radiation sciences · doi:10.1016/j.jmir.2019.09.001 · Cited by 38
Henn, J., Buneß, A., Schmid, M. C., Kalff, J. C., & Matthaei, H. (2021) · Langenbeck s Archives of Surgery · doi:10.1007/s00423-021-02348-w · Cited by 36
New trend in artificial intelligence-based assistive technology for thoracic imaging
Yanagawa, M., Ito, R., Nozaki, T., Fujioka, T., Yamada, A., Fujita, S., Kamagata, K., Fushimi, Y., Tsuboyama, T., Matsui, Y., et al. (2023) · La radiologia medica · doi:10.1007/s11547-023-01691-w · Cited by 36
Should AI allocate livers for transplant? Public attitudes and ethical considerations
Drezga‐Kleiminger, M., Demaree‐Cotton, J., Koplin, J. J., Savulescu, J., & Wilkinson, D. J. C. (2023) · BMC Medical Ethics · doi:10.1186/s12910-023-00983-0 · Cited by 36
Nodule Detection and Generation on Chest X-Rays: NODE21 Challenge
Sogancioglu, E., van Ginneken, B., Behrendt, F., Bengs, M., Schlaefer, A., Radu, M., Xu, D., Sheng, K., Scalzo, F., Marcus, E., et al. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3382042 · Cited by 36
Li, D., Pehrson, L. M., Lauridsen, C. A., Tøttrup, L., Fraccaro, M., Elliott, D., Zając, H. D., Darkner, S., Carlsen, J. F., & Nielsen, M. B. (2021) · Diagnostics · doi:10.3390/diagnostics11122206 · Cited by 35
Kim, E. Y., Kim, Y. J., Choi, W.-J., Jeon, J. S., Kim, M. Y., Oh, D. H., Jin, K. N., & Cho, Y. J. (2022) · PLoS ONE · doi:10.1371/journal.pone.0264383 · Cited by 35
Self-citationNam, J. G., Hwang, E. J., Kim, D., Yoo, S., Choi, H., Goo, J. M., & Park, C. M. (2020) · Radiology Cardiothoracic Imaging · doi:10.1148/ryct.2020190222 · Cited by 34
Self-citationDeep Learning for Detection of Pulmonary Metastasis on Chest Radiographs
Hwang, E. J., Lee, J. S., Lee, J. H., Lim, W. H., Kim, J. H., Choi, K. S., Choi, T. W., Kim, T., Goo, J. M., & Park, C. M. (2021) · Radiology · doi:10.1148/radiol.2021210578 · Cited by 34
Self-citationDiagnostic value of a vision-based intelligent gait analyzer in screening for gait abnormalities
Tang, Y., Wang, Y., Feng, X., Zou, Q., Wang, Q., Ding, J., Shi, R. C.-J., & Wang, X. (2021) · Gait & Posture · doi:10.1016/j.gaitpost.2021.10.028 · Cited by 34
Goncalves, S., Fong, P.-C., & Blokhina, M. (2022) · PubMed · Cited by 34
Artificial intelligence, medications, pharmacogenomics, and ethics
Haga, S. B. (2024) · Pharmacogenomics · doi:10.1080/14622416.2024.2428587 · Cited by 33
Chest X-ray abnormalities localization via ensemble of deep convolutional neural networks
Pham, V. T., Tran, C.-M., Zheng, S., Minh, V. T., & Nath, S. (2021) · International Conference on Advanced Technologies for Communications · doi:10.1109/atc52653.2021.9598342 · Cited by 33
Phillips, N. A., Rajpurkar, P., Sabini, M., Krishnan, R., Zhou, S., Pareek, A., Phu, N. M., Wang, C., Jain, M., Du, N. D., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.06199 · Cited by 33
Kuo, P., Tsai, C. C., López, D. M., Karargyris, A., Pollard, T., Johnson, A. E. W., & Celi, L. A. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00393-9 · Cited by 32
Potential role of artificial intelligence in craniofacial surgery
Ryu, J. Y., Chung, H. Y., & Choi, K. Y. (2021) · Archives of Craniofacial Surgery · doi:10.7181/acfs.2021.00507 · Cited by 32
Prediction of Cognitive Decline for Enrichment of Alzheimer's Disease Clinical Trials
Tam, A., Laurent, C., Gauthier, S. G., & Dansereau, C. L. (2022) · The Journal of Prevention of Alzheimer s Disease · doi:10.14283/jpad.2022.49 · Cited by 32
Kim, Y., Park, J. Y., Hwang, E. J., Lee, S. M., & Park, C. M. (2021) · Journal of Thoracic Disease · doi:10.21037/jtd-21-1342 · Cited by 31
“For identifying abnormalities on CXRs, such as active tuberculosis (20), malignant nodules (21), or major thoracic diseases (19), AI assistance led to meaningful improvements in physician readers’ performance.”
BackgroundSelf-citationLamotkin, A. I., Иванович, К. Д., Анатольевич, Л. И., Livshitz, S. A., & Геннадьевна, П. Е. (2024) · FARMAKOEKONOMIKA Modern Pharmacoeconomics and Pharmacoepidemiology · doi:10.17749/2070-4909/farmakoekonomika.2024.254 · Cited by 30
Robert, D., Sathyamurthy, S., Singh, A. K., Matta, S. A., Tadepalli, M., Tanamala, S., Bosemani, V., Mammarappallil, J. G., & Kundnani, B. (2024) · Academic Radiology · doi:10.1016/j.acra.2024.11.003 · Cited by 29
Hwang, E. J., Goo, J. M., Nam, J. G., Park, C. M., Hong, K. J., & Kim, K. H. (2023) · Korean Journal of Radiology · doi:10.3348/kjr.2022.0651 · Cited by 28
Self-citationKim, D. W., Jang, H. Y., Ko, Y., Son, J. H., Kim, P. H., Kim, S., Lim, J. S., & Park, S. H. (2020) · PLoS ONE · doi:10.1371/journal.pone.0238908 · Cited by 28
Self-citationClinical Artificial Intelligence Applications in Radiology
Lee, S., & Summers, R. M. (2021) · Radiologic Clinics of North America · doi:10.1016/j.rcl.2021.07.001 · Cited by 28
Golkarieh, A., Kiashemshaki, K., Boroujeni, S. R., & Isakan, N. A. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2507.09898 · Cited by 28
Metadata
- Authors
- Nam, J. G., Park, S., Hwang, E. J., Lee, J. H., Jin, K.-N., Lim, K. Y., Vu, T. H., Sohn, J. H., Hwang, S., Goo, J. M., & Park, C. M.
- Affiliations
- University of California, San Francisco (US)
- ORCID
- Venue
- Radiology
- Published
- 2019-01
- Volume
- 290
- Issue
- 1
- Pages
- 218-228
- ISSN
- 0033-8419 (ISSN-L)
- 1527-1315
- OpenAlex
- W2894319790
- Cited by
- 539
- References
- 28
- Citations by year
- 2026: 29 · 2025: 37 · 2024: 81 · 2023: 88 · 2022: 80 · 2021: 113 · 2020: 67 · 2019: 38
- FWCI
- 31.42
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Radiology (publishedVersion)
- PubMed (publishedVersion)
- Seoul National University Open Repository (Seoul National University) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Health Sciences › Medicine › Pulmonary and Respiratory Medicine › Lung Cancer Diagnosis and Treatment
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
- Keywords
- lung cancer, chest radiograph, convolutional neural networks, computer-aided detection, radiograph classification, observer performance, radiologist comparison, external validation, area under the receiver operating characteristic, lung nodule detection, thoracic radiology, lung cancer screening, lung cancer staging
- MeSH terms
- Deep Learning, Adolescent, Adult, Aged, Aged, 80 and over, Algorithms, Female, Humans, Lung Neoplasms, Male, Middle Aged, Radiographic Image Interpretation, Computer-Assisted, Retrospective Studies, Radiography, Thoracic, Reproducibility of Results, Multiple Pulmonary Nodules, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.