Development and Validation of Deep Learning–based Automatic Detection Algorithm for Malignant Pulmonary Nodules on Chest Radiographs
The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
Purpose To develop and validate a deep learning-based automatic detection algorithm (DLAD) for malignant pulmonary nodules on chest radiographs and to compare its performance with physicians including thoracic radiologists. Materials and Methods For this retrospective study, DLAD was developed by using 43 292 chest radiographs (normal radiograph-to-nodule radiograph ratio, 34 067:9225) in 34 676 patients (healthy-to-nodule ratio, 30 784:3892; 19 230 men [mean age, 52.8 years; age range, 18-99 years]; 15 446 women [mean age, 52.3 years; age range, 18-98 years]) obtained between 2010 and 2015, which were labeled and partially annotated by 13 board-certified radiologists, in a convolutional neural network. Radiograph classification and nodule detection performances of DLAD were validated by using one internal and four external data sets from three South Korean hospitals and one U.S. hospital. For internal and external validation, radiograph classification and nodule detection performances of DLAD were evaluated by using the area under the receiver operating characteristic curve (AUROC) and jackknife alternative free-response receiver-operating characteristic (JAFROC) figure of merit (FOM), respectively. An observer performance test involving 18 physicians, including nine board-certified radiologists, was conducted by using one of the four external validation data sets. Performances of DLAD, physicians, and physicians assisted with DLAD were evaluated and compared. Results According to one internal and four external validation data sets, radiograph classification and nodule detection performances of DLAD were a range of 0.92-0.99 (AUROC) and 0.831-0.924 (JAFROC FOM), respectively. DLAD showed a higher AUROC and JAFROC FOM at the observer performance test than 17 of 18 and 15 of 18 physicians, respectively (P < .05), and all physicians showed improved nodule detection performances with DLAD (mean JAFROC FOM improvement, 0.043; range, 0.006-0.190; P < .05). Conclusion This deep learning-based automatic detection algorithm outperformed physicians in radiograph classification and nodule detection performance for malignant pulmonary nodules on chest radiographs, and it enhanced physicians' performances when used as a second reader. © RSNA, 2018 Online supplemental material is available for this article.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“13 (refs. 63–75) studies validated algorithms on external data”
From Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis (2021) · cites this paper as [69]
In the citing paper
“Therefore, possibilities for developing computerized auxiliary diagnostic tools have become almost unlimited(39,40).”
From Artificial intelligence, machine learning, computer-aided diagnosis, and radiomics: advances in imaging towards to precision medicine (2019) · cites this paper as [39]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 2×
“3 (n = 11) 73 (8/11) [43, 91] 27 (9/33) [15, 44] 74 (49/66) [64, 83] 58 (32/55) [45, 70] 75 (33/44) [60, 86]”
DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988) · Biometrics · doi:10.2307/2531595 · Cited by 22,649
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Multiple significance tests: the Bonferroni method
Bland, J. M., & Altman, D. G. (1995) · BMJ · doi:10.1136/bmj.310.6973.170 · Cited by 3,341
Effective Doses in Radiology and Diagnostic Nuclear Medicine: A Catalog
Mettler, F. A., Huda, W., Yoshizumi, T. T., & Mahesh, M. (2008) · Radiology · doi:10.1148/radiol.2481071451 · Cited by 2,008
Benefits and Harms of CT Screening for Lung Cancer: A Systematic Review
Bach, P. B., Mirkin, J. N., Oliver, T. K., Azzoli, C. G., Berry, D. A., Brawley, O. W., Byers, T., Colditz, G. A., Gould, M. K., Jett, J. R., et al. (2012) · JAMA · doi:10.1001/jama.2012.5521 · Cited by 1,244
Lung Nodule Classification Using Deep Features in CT Images
Kumar, D., Wong, A., & Clausi, D. A. (2015) · 2015 12th Conference on Computer and Robot Vision · doi:10.1109/crv.2015.25 · Cited by 398
Cited by
High-performance medicine: the convergence of human and artificial intelligence
Topol, E. J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0300-7 · Cited by 10,450
Key challenges for delivering clinical impact with artificial intelligence
Kelly, C. J., Karthikesalingam, A., Suleyman, M., Corrado, G., & King, D. (2019) · BMC Medicine · doi:10.1186/s12916-019-1426-2 · Cited by 3,136
Liu, X., Faes, L., Kale, A. U., Wagner, S. K., Fu, D. J., Bruynseels, A., Mahendiran, T., Moraes, G., Shamdas, M., Kern, C., et al. (2019) · The Lancet Digital Health · doi:10.1016/s2589-7500(19)30123-2 · Cited by 1,883
Big data and machine learning algorithms for health-care delivery
Ngiam, K. Y., & Khor, I. W. (2019) · The Lancet Oncology · doi:10.1016/s1470-2045(19)30149-4 · Cited by 1,424
A Survey of Deep Active Learning
Ren, P., Xiao, Y., Chang, X., Huang, P.-Y., Li, Z., Gupta, B. B., Chen, X., & Wang, X. (2022) · ACM Computing Surveys · doi:10.1145/3472291 · Cited by 1,169
Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis
Aggarwal, R., Sounderajah, V., Martin, G., Ting, D. S. W., Karthikesalingam, A., King, D., Ashrafian, H., & Darzi, A. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00438-z · Cited by 946
A Novel Transfer Learning Based Approach for Pneumonia Detection in Chest X-ray Images
Chouhan, V., Singh, S. K., Khamparia, A., Gupta, D., Tiwari, P., Moreira, C., Damaševičius, R., & de Albuquerque, V. H. C. (2020) · Applied Sciences · doi:10.3390/app10020559 · Cited by 753
Deep neural network models for computational histopathology: A survey
Srinidhi, C. L., Ciga, O., & Martel, A. L. (2021) · Medical Image Analysis · doi:10.1016/j.media.2020.101813 · Cited by 749
Learning Loss for Active Learning
Yoo, D., & Kweon, I. S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00018 · Cited by 740
Artificial intelligence in cancer diagnosis and prognosis: Opportunities and challenges
Huang, S., Yang, J., Fong, S., & Zhao, Q. (2020) · Cancer Letters · doi:10.1016/j.canlet.2019.12.007 · Cited by 672
Deep learning for chest X-ray analysis: A survey
Çallı, E., Sogancioglu, E., van Ginneken, B., van Leeuwen, K. G., & Murphy, K. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102125 · Cited by 506
Hwang, E. J., Park, S., Jin, K.-N., Kim, J. I., Choi, S. Y., Lee, J. H., Goo, J. M., Aum, J., Yim, J.-J., Cohen, J. G., et al. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.1095 · Cited by 447
Self-citationExternal Validation of Deep Learning Algorithms for Radiologic Diagnosis: A Systematic Review
Yu, A. C., Mohajer, B., & Eng, J. (2022) · Radiology: Artificial Intelligence · doi:10.1148/ryai.210064 · Cited by 408
Artificial Intelligence Versus Clinicians in Disease Diagnosis: Systematic Review
Shen, J., Zhang, C. J. P., Jiang, B., Chen, J., Song, J., Liu, Z., He, Z., Wong, S. Y., Fang, P.-H., & Ming, W.-K. (2019) · JMIR Medical Informatics · doi:10.2196/10010 · Cited by 373
Designing deep learning studies in cancer diagnostics
Kleppe, A., Skrede, O.-J., De Raedt, S., Liestøl, K., Kerr, D. J., & Danielsen, H. E. (2021) · Nature Reviews Cancer · doi:10.1038/s41568-020-00327-9 · Cited by 316
Artificial intelligence in clinical medicine: catalyzing a sustainable global healthcare paradigm
Krishnan, G., Singh, S., Pathania, M., Gosavi, S., Abhishek, S., Parchani, A., & Dhar, M. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1227091 · Cited by 296
Majkowska, A., Mittal, S., Steiner, D. F., Reicher, J. J., McKinney, S. M., Duggan, G. E., Eswaran, K., Cameron Chen, P.-H., Liu, Y., Kalidindi, S. R., et al. (2020) · Radiology · doi:10.1148/radiol.2019191293 · Cited by 277
“Recent advances in deep learning offer promise for improving chest radiograph interpretation (1–4) and there are several recent reports of machine learning models achieving radiologist-level performance for different chest radiograph findings (5–7).”
BackgroundDevelopment and Validation of a Deep Learning Model for Non–Small Cell Lung Cancer Survival
She, Y., Jin, Z., Wu, J., Deng, J., Zhang, L., Su, H., Jiang, G., Liu, H., Xie, D., Cao, N., et al. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.5842 · Cited by 267
Sim, Y., Chung, M. J., Kotter, E., Yune, S., Kim, M., Do, S., Han, K., Kim, H., Yang, S., Lee, D.-J., et al. (2020) · Radiology · doi:10.1148/radiol.2019182465 · Cited by 248
Automated abnormality classification of chest radiographs using deep convolutional neural networks
Tang, Y.-X., Tang, Y.-B., Peng, Y., Yan, K., Bagheri, M., Redd, B. A., Brandon, C. J., Lu, Z., Han, M., Xiao, J., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0273-z · Cited by 248
Hwang, E. J., Park, S., Jin, K.-N., Kim, J. I., Choi, S. Y., Lee, J. H., Goo, J. M., Aum, J., Yim, J.-J., Park, C. M., et al. (2019) · Clinical Infectious Diseases · doi:10.1093/cid/ciy967 · Cited by 241
Self-citationSeah, J. C. Y., Tang, C. H. M., Buchlak, Q. D., Holt, X. G., Wardman, J. B., Aimoldin, A., Esmaili, N., Ahmad, H., Pham, H., Lambert, J. F., et al. (2021) · The Lancet Digital Health · doi:10.1016/s2589-7500(21)00106-0 · Cited by 229
Ni, Q., Sun, Z. Y., Qi, L., Chen, W., Yang, Y., Wang, L., Zhang, X., Yang, L., Fang, Y., Xing, Z., et al. (2020) · European Radiology · doi:10.1007/s00330-020-07044-9 · Cited by 221
Kaplan, A., Cao, H., FitzGerald, J. M., Iannotti, N., Yang, E., Kocks, J. W. H., Kostikas, K., Price, D., Reddel, H. K., Tsiligianni, I., et al. (2021) · The Journal of Allergy and Clinical Immunology: In Practice · doi:10.1016/j.jaip.2021.02.014 · Cited by 219
Santos, M. K., Ferreira Júnior, J. R., Wada, D. T., Tenório, A. P. M., Nogueira-Barbosa, M. H., & Marques, P. M. D. A. (2019) · Radiologia Brasileira · doi:10.1590/0100-3984.2019.0049 · Cited by 214
Artificial intelligence: A critical review of applications for lung nodule and lung cancer
de Margerie-Mellon, C., & Chassagnon, G. (2023) · Diagnostic and Interventional Imaging · doi:10.1016/j.diii.2022.11.007 · Cited by 211
Graham, S. A., Lee, E. E., Jeste, D. V., Van Patten, R., Twamley, E. W., Nebeker, C., Yamada, Y., Kim, H.-C., & Depp, C. A. (2020) · Psychiatry Research · doi:10.1016/j.psychres.2019.112732 · Cited by 211
Deep Learning Techniques to Diagnose Lung Cancer
Wang, L. (2022) · Cancers · doi:10.3390/cancers14225569 · Cited by 209
A Review on Explainable Artificial Intelligence for Healthcare: Why, How, and When?
Bharati, S., Mondal, M. R. H., & Podder, P. (2024) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2023.3266418 · Cited by 203
Artificial intelligence applications for thoracic imaging
Chassagnon, G., Vakalopoulou, M., Paragios, N., & Revel, M.-P. (2020) · European Journal of Radiology · doi:10.1016/j.ejrad.2019.108774 · Cited by 203
Where Is the Artificial Intelligence Applied in Dentistry? Systematic Review and Literature Analysis
Thurzo, A., Urbanová, W., Novák, B., Czako, L., Siebert, T., Stano, P., Mareková, S., Fountoulaki, G., Kosnáčová, H., & Varga, I. (2022) · Healthcare · doi:10.3390/healthcare10071269 · Cited by 189
Algorithmic Management: Bright and Dark Sides, Practical Implications, and Research Opportunities
Benlian, A., Wiener, M., Cram, W. A., Krasnova, H., Maedche, A., Möhlmann, M., Recker, J., & Remus, U. (2022) · Business & Information Systems Engineering · doi:10.1007/s12599-022-00764-w · Cited by 180
“Already, a growing number of studies provide evidence for the performance of AI being on a similar level or even superior to physicians across many areas (Shen et al. 2019), including dermatology (Han et al. 2018) and radiology (Nam et al. 2019; Gonzalez-Castro et al. 2017).”
BackgroundConfidence-Aware Learning for Deep Neural NetworksPreprint
Moon, J., Kim, J., Shin, Y., & Hwang, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.01458 · Cited by 177
Self-citationDzobo, K., Adotey, S. K., Thomford, N. E., & Dzobo, W. (2019) · OMICS A Journal of Integrative Biology · doi:10.1089/omi.2019.0038 · Cited by 174
Wagner, M., Müller-Stich, B. P., Kisilenko, A., Tran, D., Heger, P., Mündermann, L., Lubotsky, D. M., Müller, B., Davitashvili, T., Capek, M., et al. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102770 · Cited by 171
A Review of Deep Learning Techniques for Lung Cancer Screening and Diagnosis Based on CT Images
Thanoon, M. A., Zulkifley, M. A., Mohd Zainuri, M. A. A., & Abdani, S. R. (2023) · Diagnostics · doi:10.3390/diagnostics13162617 · Cited by 170
A Review of Explainable Deep Learning Cancer Detection Models in Medical Imaging
Gulum, M. A., Trombley, C. M., & Kantardzic, M. (2021) · Applied Sciences · doi:10.3390/app11104573 · Cited by 145
Deep learning for lungs cancer detection: a review
Javed, R., Abbas, T., Khan, A. H., Daud, A., Bukhari, A., & Alharbey, R. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10807-1 · Cited by 166
Artificial Intelligence in Nephrology: Core Concepts, Clinical Applications, and Perspectives
Niel, O., & Bastard, P. (2019) · American Journal of Kidney Diseases · doi:10.1053/j.ajkd.2019.05.020 · Cited by 165
Deep Learning for Chest Radiograph Diagnosis in the Emergency Department
Hwang, E. J., Nam, J. G., Lim, W. H., Park, S. J., Jeong, Y. S., Kang, J. H., Hong, E. K., Kim, T. M., Goo, J. M., Park, S., et al. (2019) · Radiology · doi:10.1148/radiol.2019191225 · Cited by 164
Self-citationArtificial Intelligence and Lung Cancer: Impact on Improving Patient Outcomes
Gandhi, Z., Gurram, P., Amgai, B., Lekkala, S. P., Lokhandwala, A., Manne, S., Mohammed, A. S., Koshiya, H., Dewaswala, N., Desai, R., et al. (2023) · Cancers · doi:10.3390/cancers15215236 · Cited by 163
Habuza, T., Navaz, A. N., Hashim, F., Alnajjar, F., Zaki, N., Serhani, M. A., & Statsenko, Y. (2021) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2021.100596 · Cited by 160
Shimazaki, A., Ueda, D., Choppin, A., Yamamoto, A., Honjo, T., Shimahara, Y., & Miki, Y. (2022) · Scientific Reports · doi:10.1038/s41598-021-04667-w · Cited by 160
Multitask Deep Learning for Segmentation and Classification of Primary Bone Tumors on Radiographs
von Schacky, C. E., Wilhelm, N., Schäfer, V. S., Leonhardt, Y., Gassert, F. G., Foreman, S. C., Gassert, F. T., Jung, M., Jungmann, P. M., Russe, M. F., et al. (2021) · Radiology · doi:10.1148/radiol.2021204531 · Cited by 160
Structural and functional radiomics for lung cancer
Wu, G., Jochems, A., Refaee, T., Ibrahim, A., Yan, C., Sanduleanu, S., Woodruff, H. C., & Lambin, P. (2021) · European Journal of Nuclear Medicine and Molecular Imaging · doi:10.1007/s00259-021-05242-1 · Cited by 151
Ouyang, X., Karanam, S., Wu, Z., Chen, T., Huo, J., Zhou, X. S., Wang, Q., & Cheng, J. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.3042773 · Cited by 149
Flores, A. M., Demsas, F., Leeper, N. J., & Ross, E. (2021) · Circulation Research · doi:10.1161/circresaha.121.318224 · Cited by 150
Atasever, S., Azgınoğlu, N., Terzi, D. S., & Terzi, R. (2022) · Clinical Imaging · doi:10.1016/j.clinimag.2022.11.003 · Cited by 148
Nam, J. G., Hwang, E. J., Kim, J., Park, N., Lee, E. H., Kim, H. J., Nam, M., Lee, J. H., Park, C. M., & Goo, J. M. (2023) · Radiology · doi:10.1148/radiol.221894 · Cited by 141
Self-citationAhn, J. S., Ebrahimian, S., McDermott, S., Lee, S., Naccarato, L., Di Capua, J. F., Wu, M. Y., Zhang, E. W., Muse, V., Miller, B., et al. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.29289 · Cited by 138
Yoo, H., Kim, K. H., Singh, R., Digumarthy, S. R., & Kalra, M. K. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.17135 · Cited by 122
Applications of artificial intelligence and machine learning in respiratory medicine
Gonem, S., Janssens, W., Das, N., & Topalovic, M. (2020) · Thorax · doi:10.1136/thoraxjnl-2020-214556 · Cited by 99
Using AI to Improve Radiologist Performance in Detection of Abnormalities on Chest Radiographs
Bennani, S., Regnard, N.-E., Ventre, J., Lassalle, L., Nguyen, T., Ducarouge, A., Dargent, L., Guillo, E., Gouhier, E., Zaimi, S.-H., et al. (2023) · Radiology · doi:10.1148/radiol.230860 · Cited by 120
The impact of artificial intelligence on the reading times of radiologists for chest radiographs
Shin, H. J., Han, K., Ryu, L., & Kim, E. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00829-4 · Cited by 118
Applications of deep learning for the analysis of medical data
Jang, H., & Cho, K. (2019) · Archives of Pharmacal Research · doi:10.1007/s12272-019-01162-9 · Cited by 117
Homayounieh, F., Digumarthy, S., Ebrahimian, S., Rueckel, J., Hoppe, B. F., Sabel, B. O., Conjeti, S., Ridder, K., Sistermanns, M., Wang, L., et al. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.41096 · Cited by 113
Artificial intelligence in pulmonary medicine: computer vision, predictive model and COVID-19
Khemasuwan, D., Sorensen, J. S., & Colt, H. G. (2020) · European Respiratory Review · doi:10.1183/16000617.0181-2020 · Cited by 113
Oakden-Rayner, L., Gale, W., Bonham, T. A., Lungren, M. P., Carneiro, G., Bradley, A. P., & Palmer, L. J. (2022) · The Lancet Digital Health · doi:10.1016/s2589-7500(22)00004-8 · Cited by 93
Personalized cancer vaccine design using AI-powered technologies
Kumar, A., Dixit, S., Srinivasan, K., Dinakaran, M., & Vincent, P. M. D. R. (2024) · Frontiers in Immunology · doi:10.3389/fimmu.2024.1357217 · Cited by 110
Suleman, M. U., Mursaleen, M., Khalil, U., Saboor, A., Bilal, M., Khan, S. A., Subhani, M. A., Hussnain, M. A., Tabassum, S. N., & Tahir, M. R. (2025) · Annals of Medicine and Surgery · doi:10.1097/ms9.0000000000004166 · Cited by 108
Kumazu, Y., Kobayashi, N., Kitamura, N., Rayan, E., Neculoiu, P., Misumi, T., Hojo, Y., Nakamura, T., Kumamoto, T., Kurahashi, Y., et al. (2021) · Scientific Reports · doi:10.1038/s41598-021-00557-3 · Cited by 106
Zhang, J., Yao, K., Liu, P., Liu, Z., Han, T., Zhao, Z., Cao, Y., Zhang, J., Zhang, J., Tian, J., et al. (2020) · EBioMedicine · doi:10.1016/j.ebiom.2020.102933 · Cited by 105
Vicini, S., Bortolotto, C., Rengo, M., Ballerini, D., Bellini, D., Carbone, I., Preda, L., Laghi, A., Coppola, F., & Faggioni, L. (2022) · La radiologia medica · doi:10.1007/s11547-022-01512-6 · Cited by 104
Nam, J. G., Kim, M., Park, J., Hwang, E. J., Lee, J. H., Hong, J. H., Goo, J. M., & Park, C. M. (2021) · European Respiratory Journal · doi:10.1183/13993003.03061-2020 · Cited by 103
Self-citationExplainable artificial intelligence (XAI): From inherent explainability to large language models
Mumuni, F., & Mumuni, A. (2026) · Array · doi:10.1016/j.array.2026.101133 · Cited by 102
Unsupervised Deep Anomaly Detection in Chest Radiographs
Nakao, T., Hanaoka, S., Nomura, Y., Murata, M., Takenaga, T., Miki, S., Watadani, T., Yoshikawa, T., Hayashi, N., & Abe, O. (2021) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-020-00413-2 · Cited by 101
Technical and clinical overview of deep learning in radiology
Ueda, D., Shimazaki, A., & Miki, Y. (2019) · Japanese Journal of Radiology · doi:10.1007/s11604-018-0795-3 · Cited by 100
Zhao, X., Xie, P., Wang, M., Li, W., Pickhardt, P. J., Xia, W., Xiong, F., Zhang, R., Xie, Y. Q., Jian, J., et al. (2020) · EBioMedicine · doi:10.1016/j.ebiom.2020.102780 · Cited by 100
Anderson, P. G., Tarder-Stoll, H., Alpaslan, M., Keathley, N., Levin, D. L., Venkatesh, S., Bartel, E., Sicular, S., Howell, S., Lindsey, R. V., et al. (2024) · Scientific Reports · doi:10.1038/s41598-024-76608-2 · Cited by 99
Attitudes Toward Artificial Intelligence Among Radiologists, IT Specialists, and Industry
Jungmann, F., Jorg, T., Hahn, F., Pinto dos Santos, D., Jungmann, S. M., Düber, C., Mildenberger, P., & Kloeckner, R. (2021) · Academic Radiology · doi:10.1016/j.acra.2020.04.011 · Cited by 85
Liu, B., Chi, W., Li, X., Li, P., Liang, W., Liu, H., Wang, W., & He, J. (2020) · Journal of Cancer Research and Clinical Oncology · doi:10.1007/s00432-019-03098-5 · Cited by 62
Sjoding, M. W., Taylor, D., Motyka, J., Lee, E., Co, I., Claar, D., McSparron, J. I., Ansari, S., Kerlin, M. P., Reilly, J. P., et al. (2021) · The Lancet Digital Health · doi:10.1016/s2589-7500(21)00056-x · Cited by 81
Hamedani, Z., Moradi, M., Kalroozi, F., Manafi Anari, A., Jalalifar, E., Ansari, A., Aski, B. H., Nezamzadeh, M., & Karim, B. (2023) · Health Science Reports · doi:10.1002/hsr2.1543 · Cited by 68
Yoo, H., Lee, S. H., Arru, C. D., Khera, R. D., Singh, R., Siebert, S. M., Kim, D., Lee, Y., Park, J. H., Eom, H. J., et al. (2021) · European Radiology · doi:10.1007/s00330-021-08074-7 · Cited by 95
Lee, J. H., Sun, H. Y., Park, S., Kim, H., Hwang, E. J., Goo, J. M., & Park, C. M. (2020) · Radiology · doi:10.1148/radiol.2020201240 · Cited by 81
Self-citationAutonomous Chest Radiograph Reporting Using AI: Estimation of Clinical Impact
Plesner, L. L., Müller, F. C., Nybing, J. D., Laustrup, L. C., Rasmussen, F., Nielsen, O. W., Boesen, M., & Andersen, M. B. (2023) · Radiology · doi:10.1148/radiol.222268 · Cited by 95
Deep learning applications in pulmonary medical imaging: recent updates and insights on COVID-19
Farhat, H. J., Sakr, G. E., & Kilany, R. (2020) · Machine Vision and Applications · doi:10.1007/s00138-020-01101-5 · Cited by 92
A Machine Learning-Based Prediction Model for Preterm Birth in Rural India
Raja, R., Mukherjee, I., & Sarkar, B. K. (2021) · Journal of Healthcare Engineering · doi:10.1155/2021/6665573 · Cited by 92
Artificial intelligence in food science and nutrition: A narrative review
Miyazawa, T., Hiratsuka, Y., Toda, M., Hatakeyama, N., Ozawa, H., Abe, C., Cheng, T.-Y., Matsushima, Y., Miyawaki, Y., Ashida, K., et al. (2022) · Nutrition Reviews · doi:10.1093/nutrit/nuac033 · Cited by 91
Artificial Intelligence: Review of Current and Future Applications in Medicine
Thomas, L. B. (2021) · Federal Practitioner · doi:10.12788/fp.0174 · Cited by 89
Automatic classification of canine thoracic radiographs using deep learning
Banzato, T., Wodziński, M., Burti, S., Osti, V. L., Rossoni, V., Atzori, M., & Zotti, A. (2021) · Scientific Reports · doi:10.1038/s41598-021-83515-3 · Cited by 87
FairLens: Auditing black-box clinical decision support systems
Panigutti, C., Perotti, A., Panisson, A., Bajardi, P., & Pedreschi, D. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102657 · Cited by 86
Park, S., Lee, S. M., Lee, K. H., Jung, K.-H., Bae, W., Choe, J., & Seo, J. B. (2019) · European Radiology · doi:10.1007/s00330-019-06532-x · Cited by 85
Self-citationArtificial intelligence and sleep: Advancing sleep medicine
Watson, N. F., & Fernandez, C. (2021) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2021.101512 · Cited by 85
Artificial Intelligence in Global Health —A Framework and Strategy for Adoption and Sustainability
Hadley, T. D., Pettit, R. W., Malik, T., Khoei, A. A., & Salihu, H. M. (2020) · International Journal of Maternal and Child Health and AIDS (IJMA) · doi:10.21106/ijma.296 · Cited by 66
Jang, S., Song, H., Shin, Y. J., Kim, J., Kim, J., Lee, K. W., Lee, S. S., Lee, W., Lee, S., & Lee, K. H. (2020) · Radiology · doi:10.1148/radiol.2020200165 · Cited by 72
Deep Learning–based Prescription of Cardiac MRI Planes
Blansit, K., Retson, T., Masutani, E., Bahrami, N., & Hsiao, A. (2019) · Radiology Artificial Intelligence · doi:10.1148/ryai.2019180069 · Cited by 83
Confidence Estimation via Auxiliary Models
Corbière, C., Thome, N., Saporta, A., Vu, T.-H., Cord, M., & Pérez, P. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3085983 · Cited by 82
Self-citationHu, H., Wang, W., Chen, L., Ruan, S., Chen, S., Li, X., Lu, M., Xie, X., & Kuang, M. (2021) · Journal of Gastroenterology and Hepatology · doi:10.1111/jgh.15522 · Cited by 82
Hwang, E. J., & Park, C. M. (2020) · Korean Journal of Radiology · doi:10.3348/kjr.2019.0821 · Cited by 71
Self-citationReview on Pneumonia Image Detection: A Machine Learning Approach
Kareem, A., Liu, H. M., & Sant, P. (2022) · Human-Centric Intelligent Systems · doi:10.1007/s44230-022-00002-2 · Cited by 79
Santos, C. S., & Amorim-Lopes, M. (2025) · BMC Medical Research Methodology · doi:10.1186/s12874-025-02463-y · Cited by 49
Attitudes Of Chinese Cancer Patients Toward The Clinical Use Of Artificial Intelligence
Yang, K., Zeng, Z., Peng, H., & Jiang, Y. (2019) · Patient Preference and Adherence · doi:10.2147/ppa.s225952 · Cited by 73
Current and emerging artificial intelligence applications in chest imaging: a pediatric perspective
Schalekamp, S., Klein, W. M., & van Leeuwen, K. G. (2021) · Pediatric Radiology · doi:10.1007/s00247-021-05146-0 · Cited by 77
Neuroimaging in the Era of Artificial Intelligence: Current Applications
Monsour, R., Dutta, M., Mohamed, A.-Z., Borkowski, A., & Viswanadhan, N. A. (2022) · Federal Practitioner · doi:10.12788/fp.0231 · Cited by 76
Artificial intelligence in cancer: applications, challenges, and future perspectives
Cheng, H., & Shi, S.-S. (2025) · Molecular Cancer · doi:10.1186/s12943-025-02450-3 · Cited by 78
Sung, J., Park, S., Lee, S. M., Bae, W., Park, B., Jung, E., Seo, J. B., & Jung, K.-H. (2021) · Radiology · doi:10.1148/radiol.2021202818 · Cited by 71
Self-citationKunze, K. N., Rossi, D. M., White, G. M., Karhade, A. V., Deng, J., Williams, B. T., & Chahla, J. A. (2020) · Arthroscopy The Journal of Arthroscopic and Related Surgery · doi:10.1016/j.arthro.2020.09.012 · Cited by 75
Artificial intelligence, fetal echocardiography, and congenital heart disease
Day, T. G., Kainz, B., Hajnal, J. V., Razavi, R., & Simpson, J. M. (2021) · Prenatal Diagnosis · doi:10.1002/pd.5892 · Cited by 74
Deep learning applied to automatic disease detection using chest X‐rays
Moses, D. A. (2021) · Journal of Medical Imaging and Radiation Oncology · doi:10.1111/1754-9485.13273 · Cited by 74
Metadata
- Authors
- Nam, J. G., Park, S., Hwang, E. J., Lee, J. H., Jin, K.-N., Lim, K. Y., Vu, T. H., Sohn, J. H., Hwang, S., Goo, J. M., & Park, C. M.
- Affiliations
- University of California, San Francisco (US)
- ORCID
- Venue
- Radiology
- Published
- 2019-01
- Volume
- 290
- Issue
- 1
- Pages
- 218-228
- ISSN
- 0033-8419 (ISSN-L)
- 1527-1315
- OpenAlex
- W2894319790
- Cited by
- 539
- References
- 28
- Citations by year
- 2026: 29 · 2025: 37 · 2024: 81 · 2023: 88 · 2022: 80 · 2021: 113 · 2020: 67 · 2019: 38
- FWCI
- 31.42
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Radiology (publishedVersion)
- PubMed (publishedVersion)
- Seoul National University Open Repository (Seoul National University) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Health Sciences › Medicine › Pulmonary and Respiratory Medicine › Lung Cancer Diagnosis and Treatment
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
- Keywords
- lung cancer, chest radiograph, convolutional neural networks, computer-aided detection, radiograph classification, observer performance, radiologist comparison, external validation, area under the receiver operating characteristic, lung nodule detection, thoracic radiology, lung cancer screening, lung cancer staging
- MeSH terms
- Deep Learning, Adolescent, Adult, Aged, Aged, 80 and over, Algorithms, Female, Humans, Lung Neoplasms, Male, Middle Aged, Radiographic Image Interpretation, Computer-Assisted, Retrospective Studies, Radiography, Thoracic, Reproducibility of Results, Multiple Pulmonary Nodules, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.