Methodologic Guide for Evaluating Clinical Performance and Effect of Artificial Intelligence Technology for Medical Diagnosis and Prediction
The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
The use of artificial intelligence in medicine is currently an issue of great interest, especially with regard to the diagnostic or predictive analysis of medical images. Adoption of an artificial intelligence tool in clinical practice requires careful confirmation of its clinical utility. Herein, the authors explain key methodology points involved in a clinical evaluation of artificial intelligence technology for use in medicine, especially high-dimensional or overparameterized diagnostic or predictive models in which artificial deep neural networks are used, mainly from the standpoints of clinical epidemiology and biostatistics. First, statistical methods for assessing the discrimination and calibration performances of a diagnostic or predictive model are summarized. Next, the effects of disease manifestation spectrum and disease prevalence on the performance results are explained, followed by a discussion of the difference between evaluating the performance with use of internal and external datasets, the importance of using an adequate external dataset obtained from a well-defined clinical cohort to avoid overestimating the clinical performance as a result of overfitting in high-dimensional or overparameterized classification model and spectrum bias, and the essentials for achieving a more robust clinical evaluation. Finally, the authors review the role of clinical trials and observational outcome studies for ultimate clinical verification of diagnostic or predictive artificial intelligence tools through patient outcomes, beyond performance metrics, and how to design such studies. © RSNA, 2018
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This common scenario means that estimations of AI performance based on internal test data may overestimate its real-world performance on external data [73–75].”
From Fairness of artificial intelligence in healthcare: review and recommendations (2024) · cites this paper as [74]
In the citing paper
“Similar to internal validation of the AIPM, external AIPM model validation can be based on discrimination (area under the receiver operating characteristic curve, sensitivity, specificity, positive and negative predictive values), calibration (calibration plot)5,6,13,17,49,56,78, and Decision Curve Analysis5,6,17,49,68,72.”
From Guidelines and quality criteria for artificial intelligence-based prediction models in healthcare: a scoping review (2022) · cites this paper as [56]
In the citing paper
“To ensure the generalizability of the AIPM to the intended healthcare setting, developers are advised to extensively validate the model for representative data from that setting6–8,10,13–15,24,27,56,64,66,68,72,77,79,87,88 (see phase 1, Representativeness).”
From Guidelines and quality criteria for artificial intelligence-based prediction models in healthcare: a scoping review (2022) · cites this paper as [56]
In the citing paper
“The literature recommends to assess generalizability on external data from a different time period, place, or healthcare setting3,7,8,10,16,17,27,56,68,72,79.”
From Guidelines and quality criteria for artificial intelligence-based prediction models in healthcare: a scoping review (2022) · cites this paper as [56]
In the citing paper
“Although prospective validation is rare, it is preferred by the literature5,14,56, as it provides a better idea of the AIPM’s true applicability to medical practice and allows the healthcare professionals to identify and review errors in real time19,72.”
From Guidelines and quality criteria for artificial intelligence-based prediction models in healthcare: a scoping review (2022) · cites this paper as [56]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies
Whiting, P. F., Rutjes, A. W. S., Westwood, M. E., Mallett, S., Deeks, J. J., Reitsma, J. B., Leeflang, M. M. G., Sterne, J. A. C., Bossuyt, P. M. M., & the QUADAS-2 Group* (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-155-8-201110180-00009 · Cited by 14,199
(2016) · Cited by 11,679
Gulshan, V., Peng, L., Coram, M., Stumpe, M. C., Wu, D., Narayanaswamy, A., Venugopalan, S., Widner, K., Madams, T., Cuadros, J., et al. (2016) · JAMA · doi:10.1001/jama.2016.17216 · Cited by 7,697
Collins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · BMJ · doi:10.1136/bmj.g7594 · Cited by 4,388
Ehteshami Bejnordi, B., Veta, M., Johannes van Diest, P., van Ginneken, B., Karssemeijer, N., Litjens, G., van der Laak, J. A. W. M., and the CAMELYON16 Consortium, Hermsen, M., Manson, Q. F., et al. (2017) · JAMA · doi:10.1001/jama.2017.14585 · Cited by 3,293
Lakhani, P., & Sundaram, B. (2017) · Radiology · doi:10.1148/radiol.2017162326 · Cited by 1,775
STARD 2015: An Updated List of Essential Items for Reporting Diagnostic Accuracy Studies
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., et al. (2015) · Radiology · doi:10.1148/radiol.2015151516 · Cited by 1,337
Deep Learning in Medical Imaging: General Overview
Lee, J.-G., Jun, S., Cho, Y.-W., Lee, H., Kim, G. B., Seo, J. B., & Kim, N. (2017) · Korean Journal of Radiology · doi:10.3348/kjr.2017.18.4.570 · Cited by 1,276
Research works printed but not linked: 3
- Steyerberg EW, 2010, Clinical prediction models: a practical approach to development, validation, and updating, 83
- Steyerberg EW, 2010, Clinical prediction models: a practical approach to development, validation, and updating, 299
- Newman TB, 2013, Designing clinical research, 117
Cited by
Items 701–800 of 1,000
Mirahadi, S. S., Rostami, M. T., Taherkhani, S., & Mostofi, S. (2026) · Bratislavské lekárske listy/Bratislava medical journal · doi:10.1007/s44411-026-00545-x · Cited by 2
“Real-world “living labs” or clinical testbeds, built around continuous feedback loops, offer a practical way to accelerate responsible translation by exposing systems to everyday clinical conditions while allowing rapid iteration [128–130].”
Tshivhula, N., Mbunge, E., & Makaba, T. (2026) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-026-03624-9 · Cited by 2
“The main sources of heterogeneity were imaging modality, dataset design, sample size, outcome definition, segmentation method, feature extraction pipeline, model architecture, fusion strategy, validation approach, and reporting completeness [17, 107, 108].”
Artificial intelligence in diagnostics and medical decision making
Levi, M. M. (2026) · European Journal of Internal Medicine · doi:10.1016/j.ejim.2026.107056 · Cited by 2
Emerging artificia intelligence applications in gastroenterology: A review of the literature
Morreale, G. C., Sinagra, E., Vitello, A., Shahini, E., Shahini, E., & Maida, M. F. (2020) · Artificial Intelligence in Gastrointestinal Endoscopy · doi:10.37126/aige.v1.i1.6 · Cited by 2
Guo, L., Hong, K., Zhang, Z., Zheng, B., Jaeger, S., Fuhrman, J. D., Li, H., Giger, M. L., Gabrielian, A. E., Rosenthal, A., et al. (2023) · SPIE Medical Imaging: Computer-Aided Diagnosis · doi:10.1117/12.2653826 · Cited by 2
“To ensure clinical generalizability of the model, it is desirable to have a large dataset with a variety of high-quality images from multiple institutions and different geographic regions 12 .”
BackgroundArtificial intelligence in radiology and its application in liver disease
Park, H. J., Kim, K. W., & Lee, S. S. (2023) · Elsevier eBooks · doi:10.1016/b978-0-323-99136-0.00002-7 · Cited by 2
Maalej, Z., Rejab, F. B., & Nouira, K. (2024) · SN Computer Science · doi:10.1007/s42979-024-02677-9 · Cited by 2
“One of the medical practice areas in which AI is intended to have a huge effect is the analysis of several medical images [11].”
Kotter, E. (2024) · Imaging informatics for healthcare professionals · doi:10.1007/978-3-031-68942-0_3 · Cited by 2
Köse, U., & Deperlioğlu, Ö. (2019) · Innovations in Intelligent Systems and Applications Conference (ASYU) · doi:10.1109/asyu48272.2019.8946427 · Cited by 2
“The study by Park and Han provided a general approach for analyzing clinical performance of artificial intelligence in medical diagnosis [19].”
Current Applications and Future Perspectives of Brain Tumor Imaging
Park, J. E., & Kim, H. S. (2020) · Journal of the Korean Society of Radiology · doi:10.3348/jksr.2020.81.3.467 · Cited by 2
“딥러닝을 이용한 진단능 연구는 아직 임상 검증이 되지 않아 초기 단계이며(70), 본 종설에서는 다루지 않았다.”
Artificial Intelligence and Healthcare: The Effects of COVID-19 on Nigerians
Falana, T., Renner, J. K., Adekoya, A., & Abolurin, O. O. (2021) · Studies in systems, decision and control · doi:10.1007/978-3-030-67151-8_7 · Cited by 2
Walczak, S. (2019) · IGI Global eBooks · doi:10.4018/978-1-7998-1754-3.ch008 · Cited by 2
Jin, H., Lee, S., An, H. J., Choi, C. H., Chie, E. K., Wu, H., Park, J. M., Park, S., & Kim, J.-I. (2022) · Journal of Applied Clinical Medical Physics · doi:10.1002/acm2.13644 · Cited by 2
Self-citationApplication and Challenges of Artificial Intelligence in Medical Imaging
Wang, L., Ding, N., Zuo, P., Wang, X., & Rai, B. K. (2022) · International Conference on Knowledge Engineering and Communication Systems (ICKECS) · doi:10.1109/ickecs56523.2022.10059898 · Cited by 2
“In addition, the biological verification of radiomics features will promote the clinical application of radiomics research [18].”
BackgroundRockall, A., Li, X., Johnson, N. A., Lavdas, I., Santhakumaran, S., Prevost, A. T., Koh, D., Punwani, S., Goh, V., Bharwani, N., et al. (2024) · Efficacy and Mechanism Evaluation · doi:10.3310/kpwq4208 · Cited by 2
Medical Image Recognition for Diagnosis
Esukapalli, V. R., Velmurugan, S. N., Preethi, S., Kammara, C., Mungamuru, D., & Settipalli, H. V. (2024) · International Conference on Computing, Communication and Networking Technologies (ICCCNT) · doi:10.1109/icccnt61001.2024.10726025 · Cited by 2
Deep learning-aided diagnosis of acute abdominal aortic dissection by ultrasound images
Lin, Z., Zheng, J., Deng, Y., Du, L., Liu, F., & Li, Z. (2025) · Emergency Radiology · doi:10.1007/s10140-025-02311-y · Cited by 2
“It was used to assess models’ performance as an external validation [19, 20].”
Robust evaluation of tissue-specific radiomic features for classifying breast tissue density grades
Dong, V., Mankowski, W. C., Filho, T. M. S., McCarthy, A. M., Despina Kontos, B., Maidment, A. D. A., & Barufaldi, B. (2025) · Journal of medical imaging · doi:10.1117/1.jmi.12.s2.s22010 · Cited by 2
“34”
Kong, X., Zhang, A., Zhou, X. M., Zhao, M., Liu, J., Zhang, X., Zhang, W., Meng, X., Li, N., & Yang, Z. (2025) · EJNMMI Research · doi:10.1186/s13550-025-01264-0 · Cited by 2
“However, these end-to-end deep learning-based diagnostics methods are not the ultimate solu-tion, and faces multiple limitations [6].”
Zhu, L., Shi, X., Tang, L., Machida, H., Yang, L., Ma, M., Ha, R., Shen, Y., Wang, F., & Chen, D. (2025) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-025-03049-w · Cited by 2
“DL model is very sensitive to small changes in medical images, even slight angle, noise, and even local pixel changes can lead to model recognition or classification error [6]; Therefore, the quality of CT images is a key factor affecting artificial intelligence CAC examination.”
Bouzid, A. I. H., Benlala, I., de Senneville, B. D., Baldacci, F., Macey, J., Hassen, W. B., Su, P., Bui, S., Zysman, M., Bustin, A., et al. (2025) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.70196 · Cited by 2
มหัสฉริยพงษ์, พ. (2021) · Journal of Primary Care and Family Medicine (PCFM) · Cited by 2
Artificial Intelligence (AI) in Drug Discovery and Medicine
Varun, A. (2019) · Journal of Clinical Cases & Reports · doi:10.46619/joccr.2019.2-1043 · Cited by 2
Le, V. N. T., Kim, J., Yang, Y.-M., & Lee, D. (2021) · Applied Sciences · doi:10.3390/app11209688 · Cited by 2
Data Preparation for Artificial Intelligence
de Araújo, A. L., Hardell, C., Koszek, W. A., Wu, J., & Willemink, M. J. (2022) · Contemporary medical imaging · doi:10.1007/978-3-030-92087-6_4 · Cited by 2
A Medical Image Enhancement to Denoise Poisson Noises Using Neural Network and Autoencoders
Sudha, V., Kalyanasundaram, K., Abishek, R., & Raja, R. (2022) · Lecture notes in networks and systems · doi:10.1007/978-981-19-1012-8_50 · Cited by 2
Xie, X. (2022) · Journal of Environmental and Public Health · doi:10.1155/2022/6546357 · Cited by 2
“Artificial intelligence plays an important role in many fields, such as clinical medical diagnosis [1], college English education [2], enterprise management [3], and technology mining [4].”
BackgroundRetractedAnalysis of Potential Biases on Mammography Datasets for Deep Learning Model Development
Gerbolés, B. Z., López‐Linares, K., García, M. J., Rebescher, K. M., Lalaguna, I., Marco, E. A., Álvarez, M. B. C., Garcia, J., Ledesma‐Carbayo, M. J., & Macía, I. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-17721-7_7 · Cited by 2
Review and Analysis of Disease Diagnostic Models Using AI and ML
Pandey, U., Shakya, T., Rajput, M., Singh, R., & Mangal, T. (2023) · Advances in medical technologies and clinical practice book series · doi:10.4018/978-1-6684-6957-6.ch003 · Cited by 2
The Promise and Perils of Artificial Intelligence in Pharmaceutical Industries and Healthcare System
Mohit Shrivastava, D. D., Dubey, D., Rawat, D., Yadav, A., Gupta, N., Singh, H. K., singh, U., VERMA, S. L., Pandey, P., Shaw, S., et al. (2023) · Pakistan Heart Journal · Cited by 2
Morgan, H., O'Dowd, E. L., Nair, A., & Baldwin, D. (2020) · Translational Lung Cancer Research · doi:10.21037/tlcr-20-586 · Cited by 2
“Given how the performance of malignancy prediction (whether human or machine) vary with prevalence, any predictive model must perform robustly well on both baseline and incidental screening data before it can be considered trustworthy (14).”
Reply to “COVID-19 prediction models should adhere to methodological and reporting standards”
Wu, G., Woodruff, H. C., Chatterjee, A., & Lambin, P. (2020) · European Respiratory Journal · doi:10.1183/13993003.02918-2020 · Cited by 2
“There are numerous checklists or guidelines for diagnostic and predictive models [7-10].”
BackgroundDemirer, M., White, R., Gupta, V., Sebro, R., & Erdal, B. S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.11954 · Cited by 2
“Despite the aforementioned population attributes controlling data bias, the resulting AI Model Development Population represented an abnormally high background prevalence of LLIEDs, potentially impacting positively on reported AI model performance.(47) Conclusion: This project successfully led to the development of AI…”
Socially Beneficial Metaverse: Framework, Technologies, Applications, and ChallengesPreprint
Xu, X., Zhou, X., Bilal, M., Zeadally, S., Crowcroft, J., Qi, L., & Xue, S. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.17260 · Cited by 2
“In recent years, the importance of artificial intelligence has accelerated, and it is currently playing an important role in the fields of autopilot [70], face recognition [71], intelligent medical diagnosis [72] and other fields.”
Garberis, I. (2022) · theses.fr (ABES) · doi:10.70675/9af92710z235bz46f1z9feez1aac5bfd7455 · Cited by 2
Top 10 Tips for Writing about AI in Radiology: A Brief Guide for Authors
Atzen, S. L. (2025) · Radiology · doi:10.1148/radiol.243347 · Cited by 2
Impact of malocclusion on smiling features
Mohammed, H. (2022) · Otago University Research Archive (University of Otago) · Cited by 2
Zhao, S., Li, Z., Wang, Y., Zhao, F., Chen, P., & Pang, G. (2025) · Frontiers in Cell and Developmental Biology · doi:10.3389/fcell.2025.1669651 · Cited by 1
“This is an expected phenomenon often attributed to domain shift, such as differences in MRI scanners, acquisition protocols, and patient populations across institutions (Park and Han, 2018; Kelly et al., 2019).”
How Artificial Intelligence will Reshape the Field of Cardiothoracic Imaging: A Global Perspective
Cecco, C. N. D., Zhang, J., van Assen, M., Wessell, J., Leiner, T., & Lü, B. (2022) · Contemporary medical imaging · doi:10.1007/978-3-030-92087-6_55 · Cited by 1
Kim, D. K., Jung, J. H., Kim, J. K., & Kim, T. (2022) · Current Medical Imaging Formerly Current Medical Imaging Reviews · doi:10.2174/1573405618666220907162616 · Cited by 1
Beeravolu, A. R., Masters, I. B., Jonkman, M., Yeo, K. C., Prountzos, S., Thomas, R. J., Ignatious, E., Azam, S., McCallum, G. B., Alexopoulou, E., et al. (2024) · IEEE Access · doi:10.1109/access.2024.3476436 · Cited by 1
“We believe that straightforward image processing techniques and 3D-based methods can offer substantial insights into diseases and optimize workflows for healthcare professionals more effectively than AI-based systems, which often lack generalizability [46], [47].”
MethodAlli, K. O., Adewale, A. O., & Akintajuwa, A. O. (2025) · Journal of Economics Finance and Management Studies · doi:10.47191/jefms/v8-i2-22 · Cited by 1
Spinal Metastasis—Imaging Using XAI and RAI Techniques
Bagada, A. A., & Patel, P. V. (2025) · Wiley eBooks · doi:10.1002/9781394302444.ch5 · Cited by 1
Deng, M., Li, B., Ma, M., Deng, W., Zeng, X., Wang, Y., & Huang, X. (2025) · Physiological Measurement · doi:10.1088/1361-6579/adfda9 · Cited by 1
A Review on Applications of Artificial Intelligence in Clinical Pharmacy
Anandharaj, G., Saravanakumar, A., PRAKASH, M., Mohanraj, S., Archana, V., Kavin, S. A., S, N. S. P., & Neteesh, J. (2025) · Journal of Pharma Insights and Research. · doi:10.69613/ranff818 · Cited by 1
311AI-enhanced diagnostic materials improving sensitivity for disease detection and diagnostics
Krishnamoorthy, P., Kavitha, V. R., Babu, A. A., Shobana, D., & Kumaran, G. (2025) · De Gruyter eBooks · doi:10.1515/9783112205198-007 · Cited by 1
AI in Clinical Neuroscience Practice
Rudroff, T. (2025) · Neurocultural health and wellbeing · doi:10.1007/978-3-032-11596-6_4 · Cited by 1
Lim, W. H., Lee, J. Y., Lee, J. H., Kim, S., & Kim, H. (2026) · European Radiology · doi:10.1007/s00330-026-12648-8 · Cited by 1
“Importantly, improved diagnostic performance does not necessarily translate into favorable clinical outcomes [28, 29].”
XAI Integration into Cancer Care for Effective Decision Making
Khan, I., & Bhoite, S. (2025) · International Conference on Innovative Data Communication Technologies and Application (ICIDCA) · doi:10.1109/icidca66325.2025.11280442 · Cited by 1
“While these results reflect strong separation capacity, such high values may also signal dataset simplicity or potential over-fitting, warranting further validation on larger, heterogeneous cohorts [33].”
Rahman, M. S., Humayara, F., Rabbi, S. M. E., & Rashid, M. M. (2025) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-025-01770-6 · Cited by 1
“Despite being standard in clinical research, techniques such as bootstrap-based confidence intervals and formal pairwise statistical comparisons are rarely adopted in medical AI evaluations, limiting the reliability of reported performance gains [14, 15].”
Application of Artificial Intelligence and Robotics in Prosthodontics
Modgi, C. M., Singh, T. K., & Gupta, A. (2025) · Lecture notes in bioengineering · doi:10.1007/978-981-95-1470-0_10 · Cited by 1
Smart Models and Medical Imaging Technologies: Analyzing Their Impact on Diagnosis and Treatment
Said, K. K., Elghaieb, I., & Rhaimi, C. B. (2026) · Architecture Image Studies · doi:10.62754/ais.v7i1.884 · Cited by 1
“For example, machine learning algorithms have been successfully embedded in imaging diagnosis systems in medicine to minimize human inputs and hence enhance diagnosis of diseases such as cancer and neurological diseases (Dhawan, 2011; Park & Han, 2018).”
Żerdziński, K., Janiec, J., Dreger, M., Dudek, P., Paszkiewicz, I., Mitręga, A., Bielówka, M., Nawrat, A., Kufel, J., & Rojek, M. (2026) · Diagnostics · doi:10.3390/diagnostics16020243 · Cited by 1
“Across guidance, robust generalizability is a prerequisite: external validation on independent datasets is required, and internal validation alone is insufficient for adoption [15,33,34].”
Wang, P., Liu, W., & Zhou, C. (2026) · Digital Health · doi:10.1177/20552076261428356 · Cited by 1
Xu, S., Guo, C., Xu, Q., Zuo, J., Yang, M., Chen, B., Li, S., Xiao, J., Tang, X., & Qin, Y. (2026) · Journal of Advanced Research · doi:10.1016/j.jare.2026.04.013 · Cited by 1
Lu, J., Ding, J., Wang, P., Mi, B., Zhou, P., & Zheng, F. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1806133 · Cited by 1
Zhang, J. J., Luo, Y., Lai, S., Lou, Y., Yu, H., & Peng, L. (2026) · Translational Cancer Research · doi:10.21037/tcr-2025-1-2705 · Cited by 1
Xiang, L., Fang, Y., & Zhanzhan (2026) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-026-03548-4 · Cited by 1
“…model architectures (e.g., CNNs vs. transformers vs. traditional ML), variable input data modalities (unimodal imaging vs. multimodal integration), inconsistent reference standards, and disparate reporting metrics, complicating cross-study comparisons and obscuring true performance benchmarks [17].”
AI Regulations in Medical Devices
Khinvasara, T. (2026) · Springer handbooks · doi:10.1007/978-3-032-01636-2_40 · Cited by 1
Peer review: historical evolution and reviewers’ learning
Gómez, M. P. A., & Sardanelli, F. (2026) · Insights into Imaging · doi:10.1186/s13244-026-02302-8 · Cited by 1
“In papers using AI methods, the reporting of external validation, calibration, data leakage, reference standard circularity, and availability of code/model documentation needs to be assessed for completeness [40 – 46].”
Qasem, M. H., Sariera, T. M. A., Alhumaid, K. F., Alshraah, S. M., Mufleh, A. S. S., & Chihaoui, N. (2026) · Journal of Imaging · doi:10.3390/jimaging12060228 · Cited by 1
Coronary artery calcification in thoracic cancer radiotherapy: A scoping review
Xue, R., Fidan, U., Vliegenthart, R., van der Meer, P., Niezink, A. G. H., Langendijk, J. A., Crijns, A. P. G., Wijsman, R., & Muijs, C. T. (2026) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2026.111636 · Cited by 1
Artificial Intelligence in Social Work: Bridging Technology and Humanity
An, R., & Lindsey, M. A. (2026) · Springer eBooks · doi:10.1007/978-3-032-18443-6 · Cited by 1
Alshreef, B. S. (2026) · BMC Medical Imaging · doi:10.1186/s12880-026-02507-9 · Cited by 1
Mariotti, F., Cacioppa, L. M., Rossini, N., Bruno, A., Francavilla, G., Felicioli, A., Macchini, M., Coppola, A., Cellina, M. I., & Floridi, C. (2026) · Journal of Imaging · doi:10.3390/jimaging12060274 · Cited by 1
“The effectiveness of AI systems depends not only on predictive accuracy but also on how outputs are interpreted and acted upon during procedures [181].”
Zheng, G., Chai, X., Jin, P., Xin, X., Li, Y., Yang, C., Wei, J., Yan, Z., Zhang, J., Zhao, Q., et al. (2026) · Advanced Science · doi:10.1002/advs.76455 · Cited by 1
Chutani, D., & Yalavarthy, P. K. (2026) · Journal of Biomedical Optics · doi:10.1117/1.jbo.31.8.086006 · Cited by 1
Cabrera-Rodríguez, R., Reyes-Castañeda, I., Lorenzo-Sánchez, I., Valenzuela-Fernández, A., & Trujillo‐González, R. (2026) · New Microbes and New Infections · doi:10.1016/j.nmni.2026.101843 · Cited by 1
“Consequently, rigorous external validation on independent data-sets is considered the gold standard for establishing true generalisability, complementing rather than replacing XAI approaches [301,303 – 306].”
ElKhateeb, S. M., Allam, E., Bakhsh, H. H., Alomair, D., AlShehri, N. A., & Sawan, N. M. (2026) · Dentistry Journal · doi:10.3390/dj14090569 · Cited by 1
“Despite the growing integration of AI into dental practice, the diagnostic performance of different AI systems may vary depending on algorithm design, training datasets, and quality of the radiographic images [7,8].”
Artificial intelligence application in dentistry: umbrella systematic review
Al-Hadi, M. A. A., Ahmed, S. M. A., Eddy, S. S., Nurmalasari, A., Sengupta, K., & Hariyani, N. (2026) · Dental Journal (Majalah Kedokteran Gigi) · doi:10.20473/j.djmkg.v59.i3.p300-314 · Cited by 1
Morfaki, C. (2026) · Hospitals · doi:10.3390/hospitals3040019 · Cited by 1
Prediction of Breast Cancer using Deep Learning Algorithms and Gradient Boosting
Neha, K., Gupta, A., Panwar, G. S., Waghale, G. S., & Goyal, P. (2025) · Journal of Neonatal Surgery · Cited by 1
Han, S. S., Kim, S. H., & Na, J. (2020) · Journal of Investigative Dermatology · doi:10.1016/j.jid.2020.08.024 · Cited by 1
A Diagnostic Nomogram Based on 18F-FDG PET/CT for Bone Metastasis of Gastric Cancer
Wu, C., Lin, X., Li, Z., Chen, Z., Xie, W., Zhang, X., & Wang, X. (2021) · Frontiers in Cell and Developmental Biology · doi:10.3389/fcell.2021.783466 · Cited by 1
“The predictive ability was reflected by comparing observed probabilities with modelpredicted probabilities of the three models by using training set data, validation data and total set data (Han et al., 2016; Hoshino et al., 2018; Park and Han, 2018).”
MethodElezaby, M. A. (2022) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2022.05.013 · Cited by 1
NEOPLASIA TROFOBLÁSTICA GESTACIONAL
da Silva, N. C., Nunes, P. T. D. P., Ribeiro, L. B., Lima, D. C. S., da Silva, J. K. P., Santos, S. M. C., Silveira, Y. G. B., da Silva, K. N., da Silva, J. K., dourado, L. B., et al. (2023) · doi:10.22533/at.ed.10023130612 · Cited by 1
Age of Data in Contemporary Research Articles Published in Representative General Radiology Journals
Kang, J. H., Kim, D. H., Park, S. H., & Baek, J. H. (2018) · Korean Journal of Radiology · doi:10.3348/kjr.2018.19.6.1172 · Cited by 1
“Moreover, in radiology, data timeliness may be especially important since the field relies heavily on new technology particularly digital technology (2-7), which develops and changes faster than in other disciplines.”
BackgroundSelf-citationMartinho, N. J., Soares, R. G. D. S., & Barbosa, V. H. (2021) · doi:10.22533/at.ed.6322101039 · Cited by 1
Object Detection and Image Segmentation for Autonomous Vehicles
Li, C., Huang, C., Zhang, C., Li, J., Liu, B., & Yang, P. (2021) · IEEE International Conference on Information, Communication and Networks (ICICN) · doi:10.1109/icicn52636.2021.9673812 · Cited by 1
Analysis of GLRLM Texture Features Derived From Computed Tomography Scans For COVID-19 Diagnosis
Muhtadi, S., & Hamid, H. (2021) · Biomedical Engineering International Conference · doi:10.1109/bmeicon53485.2021.9745204 · Cited by 1
The Future of Spectral CT: Radiomics and Beyond
Baeßler, B., & Cester, D. (2022) · Medical radiology · doi:10.1007/978-3-030-96285-2_24 · Cited by 1
Artificial intelligence in coronary physiology: where do we stand?
Mody, R., Dash, D., & Mody, D. (2022) · Journal of Transcatheter Interventions · doi:10.31160/jotci202230a20220009 · Cited by 1
Computational Intelligence in Depression Detection
Zawad, M. R. S., Haque, M. Y., Kaiser, M. S., Mahmud, M., & Chen, T. (2022) · Brain informatics and health · doi:10.1007/978-981-19-5272-2_7 · Cited by 1
Unlocking clinical insights from medical images using deep learning
Ushaa, E., & Vishal, E. (2023) · i-manager s Journal on Artificial Intelligence & Machine Learning · doi:10.26634/jaim.1.2.20044 · Cited by 1
GEP-NETs radiomics in action: a systematical review of applications and quality assessment
Wei, C., Jiang, T., Wang, K., Gao, X., Zhang, H., & Wang, X. (2024) · Clinical and Translational Imaging · doi:10.1007/s40336-024-00617-4 · Cited by 1
“For example, confidence intervals and other measures of variability could be required to report alongside p values [92, 93].”
Visualizing Transformers for Breast Histopathology By IJISRT
Priya, A. A., Krishnan, T. P., & Suresh, C. (2024) · International Journal of Innovative Science and Research Technology (IJISRT) · doi:10.38124/ijisrt/ijisrt24mar845 · Cited by 1
Transformative AI in Biomedicine Analysis: Applications, Challenges, and Future Directions
Tiwari, N. K. (2024) · Advances in information security, privacy, and ethics book series · doi:10.4018/979-8-3693-9311-6.ch006 · Cited by 1
Xie, J. (2024) · Thermal Science and Engineering Progress · doi:10.1016/j.tsep.2024.103186 · Cited by 1
Research on artificial intelligence-assisted magnetic resonance imaging: a review
Dong, L. (2024) · Science and Technology of Engineering Chemistry and Environmental Protection · doi:10.61173/7f8mce39 · Cited by 1
“In a feature map, adjacent regions often have similar features, so the amount of data can be reduced by aggregating these regions while retaining the main features [13,14].”
Sharma, D. P., Raghuwanshi, S., Singh, H., Uniyal, M., Prasad, N., Awal, S. S., Yadav, S., & Rajput, B. K. (2025) · Journal of Marine Medical Society · doi:10.4103/jmms.jmms_212_24 · Cited by 1
Breast Cancer Diagnosis: A Multi-Model Machine Learning Approach
Biswas, N., Mahdi, M. A., Islam, T., Shimul, S. A., Pavel, F. H., & Sarkar, D. (2024) · IEEE International Conference on Biomedical Engineering, Computer and Information Technology for Health (BECITHCON) · doi:10.1109/becithcon64160.2024.10962646 · Cited by 1
“An accurate diagnosis is essential in the realm of medical science [3].”
A Revolutionary Method Based on CNN-LSTM to Characterize Knee Osteoarthritis from Radiography
Hardas, R. D. M. (2024) · Journal of chemical health risks · Cited by 1
Manipulation of Artifical Intelligence in Image Based Data: Adversarial Examples Techniques
Altinay, E. A., & Köse, U. (2021) · Journal of Multidisciplinary Developments · Cited by 1
Huang, Y., Zhang, Z., Wang, N., Li, N., Du, M., Hao, T., & Zhan, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.02940 · Cited by 1
COVID-19 forecasting with deep learning: a distressing surveyPreprint
Gutierrez, L., de Medrano, R., & Aznarte, J. L. (2021) · doi:10.36227/techrxiv.16855189 · Cited by 1
An, C., Park, Y. W., Ahn, S. S., Han, K., Kim, H., & Lee, S. (2020) · Research Square · doi:10.21203/rs.3.rs-105766/v1 · Cited by 1
Self-citationYu, Y., Li, X., Li, W., Wang, H., & Wang, Y. (2023) · Research Square · doi:10.21203/rs.3.rs-2530190/v1 · Cited by 1
Xu, W., Shang, Y., & Chen, L. (2024) · Research Square · doi:10.21203/rs.3.rs-3872469/v1 · Cited by 1
Wu, D., Sun, G., & Liang, S. (2025) · Cambridge University Press eBooks · doi:10.1017/9781009587877.002 · Cited by 1
Metadata
- Authors
- Park, S. H., & Han, K.
- Affiliations
- Yonsei University (KR)
- Venue
- Radiology
- Published
- 2018-03
- Volume
- 286
- Issue
- 3
- Pages
- 800-809
- ISSN
- 0033-8419 (ISSN-L)
- 1527-1315
- OpenAlex
- W2783687327
- Cited by
- 894
- References
- 49
- Citations by year
- 2026: 123 · 2025: 98 · 2024: 96 · 2023: 135 · 2022: 111 · 2021: 121 · 2020: 103 · 2019: 80 · 2018: 25
- FWCI
- 1.84
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Radiology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Ministry of Trade, Industry and Energy
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- artificial intelligence in healthcare, deep neural network, medical image diagnosis, prediction model, discrimination and calibration, overfitting, spectrum bias, external validation, disease prevalence, outcomes research, high-dimensional models
- MeSH terms
- Artificial Intelligence, Data Interpretation, Statistical, Diagnostic Imaging, Humans, Image Interpretation, Computer-Assisted, Terminology as Topic, Predictive Value of Tests, Technology Assessment, Biomedical, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.