Assessing Radiology Research on Artificial Intelligence: A Brief Guide for Authors, Reviewers, and Readers—From the Radiology Editorial Board
The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This common scenario means that estimations of AI performance based on internal test data may overestimate its real-world performance on external data [73–75].”
From Fairness of artificial intelligence in healthcare: review and recommendations (2024) · cites this paper as [75]
In the citing paper
“Of all avenues through which DL may be applied to healthcare; medical imaging, part of the wider remit of diagnostics, is seen as the largest and most promising field4,5.”
From Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis (2021) · cites this paper as [5]
Citations
Cites
Moons, K. G. M., Altman, D. G., Reitsma, J. B., Ioannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, G. S. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0698 · Cited by 5,147
Park, S. H., & Han, K. (2018) · Radiology · doi:10.1148/radiol.2017171920 · Cited by 894
Convolutional Neural Networks for Radiologic Images: A Radiologist’s Guide
Soffer, S., Ben-Cohen, A., Shimon, O., Amitai, M. M., Greenspan, H., & Klang, E. (2019) · Radiology · doi:10.1148/radiol.2018180547 · Cited by 577
Geis, J. R., Brady, A. P., Wu, C. C., Spencer, J., Ranschaert, E., Jaremko, J. L., Langer, S. G., Borondy Kitts, A., Birch, J., Shields, W. F., et al. (2019) · Radiology · doi:10.1148/radiol.2019191586 · Cited by 388
Assessment of Convolutional Neural Networks for Automated Classification of Chest Radiographs
Dunnmon, J. A., Yi, D., Langlotz, C. P., Ré, C., Rubin, D. L., & Lungren, M. P. (2019) · Radiology · doi:10.1148/radiol.2018181422 · Cited by 206
Editor’s Note: Publication of AI Research in Radiology
Bluemke, D. A. (2018) · Radiology · doi:10.1148/radiol.2018184021 · Cited by 10
Self-citation
Cited by
Items 101–200 of 344
Mitsuyama, Y., Matsumoto, T., Tatekawa, H., Walston, S. L., Kimura, T., Yamamoto, A., Watanabe, T., Miki, Y., & Ueda, D. (2023) · The Lancet Healthy Longevity · doi:10.1016/s2666-7568(23)00133-2 · Cited by 39
McSweeney, T. P., Tiulpin, A., Saarakkala, S. S., Niinimäki, J. L., Windsor, R., Jamaludin, A., Kadir, T., Karppinen, J. I., & Määttä, J. H. (2022) · Spine · doi:10.1097/brs.0000000000004572 · Cited by 34
Cho, J., Kim, Y. J., Sunwoo, L., Lee, G. P., Nguyen, T. Q., Cho, S. J., Baik, S. H., Bae, Y. J., Choi, B. S., Jung, C., et al. (2021) · Frontiers in Oncology · doi:10.3389/fonc.2021.739639 · Cited by 30
Hainc, N., Mannil, M., Anagnostakou, V., Alkadhi, H., Blüthgen, C., Wacht, L., Bink, A., Husain, S., Kulcsár, Z., & Winklhofer, S. F.-X. (2020) · The Neuroradiology Journal · doi:10.1177/1971400920937647 · Cited by 30
“ment on exact specifications of the commercial software’s CNN, the recently published editorial by the Radiology Editorial Board states that ’Commercially available algorithms are considered publicly available’ and can thus be independently validated.(36)”
MethodZhang, W., Yang, R., Liang, F., Liu, G., Chen, A., Wu, H., Lai, S., Ding, W., Wei, X., Zhen, X., et al. (2021) · Frontiers in Oncology · doi:10.3389/fonc.2021.660629 · Cited by 32
“Secondly, manual VOI delineation is time-consuming and has uncertainties on subsequent radiomics analysis and prediction modeling (45).”
BackgroundMehta, P., Antonelli, M., Singh, S., Grondecka, N., Johnston, E. W., Ahmed, H. U., Emberton, M., Punwani, S., & Sebastien Ourselin, A. (2021) · Cancers · doi:10.3390/cancers13236138 · Cited by 30
Peisen, F., Gerken, A., Hering, A., Brendlin, A., Afat, S., Nikolaou, K., Gatidis, S., Eigentler, T., Amaral, T. M. S., Moltz, J. H., et al. (2022) · Cancers · doi:10.3390/cancers14122992 · Cited by 30
“This drawback hinders a more detailed evaluation of the influence of varying acquisition parameters on radiomics; however, that constraint was accepted to reduce potential selection bias and guarantee a realistic real-life sample as requested by radiological guidelines [42].”
BackgroundLin, C. S., Tsai, D., Wang, C., Chao, Y., Huang, J.-W., Lin, C.-S., & Fang, W. (2024) · Radiology · doi:10.1148/radiol.231937 · Cited by 33
Brejnebøl, M. W., Nielsen, Y. W., Taubmann, O., Eibenberger, E., & Müller, F. C. (2022) · European Journal of Radiology · doi:10.1016/j.ejrad.2022.110216 · Cited by 33
Armato, S. G., Drukker, K., & Hadjiiski, L. M. (2023) · British Journal of Radiology · doi:10.1259/bjr.20221152 · Cited by 37
A Survey of Publicly Available MRI Datasets for Potential Use in Artificial Intelligence Research
Dishner, K. A., McRae‐Posani, B., Bhowmik, A., Jochelson, M. S., Holodny, A. I., Pinker, K., Eskreis‐Winkler, S., & Stember, J. N. (2023) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.29101 · Cited by 35
Berghe, T. V. D., Babin, D., Chen, M., Callens, M., Brack, D., Maes, H., Lievens, J., Lammens, M., Sumere, M. V., Morbée, L., et al. (2023) · European Radiology · doi:10.1007/s00330-023-09704-y · Cited by 27
“To avoid this, these were excluded in the test dataset to prevent overly optimistic statistical results [31, 32].”
BackgroundMethodBartoli, A., Fournel, J., Bentatou, Z., Habib, G., Lalande, A., Bernard, M., Boussel, L., Pontana, F., Dacher, J., Ghattas, B., et al. (2020) · Radiology Artificial Intelligence · doi:10.1148/ryai.2020200021 · Cited by 30
Deep learning in structural and functional lung image analysis
Astley, J., Wild, J. M., & Tahir, B. (2021) · British Journal of Radiology · doi:10.1259/bjr.20201107 · Cited by 29
“Validating on external multicentre data sets that have not been used for training should be the gold- standard in ensuring comparison between methods and generalisability.(65) However, this is uncommon as single- centre data sets, split into training and testing sets, are frequently used.”
MethodGarbin, C., & Marques, O. (2022) · Radiology Artificial Intelligence · doi:10.1148/ryai.210127 · Cited by 31
Chen, X., Li, Y., Zhou, Y., Yang, Y., Yang, J., Pang, P., Wang, Y., Cheng, J., Chen, H., & Guo, Y. (2022) · European Radiology · doi:10.1007/s00330-022-08541-9 · Cited by 26
A large model for non-invasive and personalized management of breast cancer from multiparametric MRI
Luo, L., Wu, M., Li, M., Xin, Y., Wang, Q., Vardhanabhuti, V., Chu, C. W., Li, Z., Zhou, J., Rajpurkar, P., et al. (2025) · Nature Communications · doi:10.1038/s41467-025-58798-z · Cited by 42
“These results showed that MOME has the potential to facilitate non-invasive personalized breast cancer patient management for malignancy screening, biopsy recommendation, and treatment decision support.”
Guo, Y., Chen, X., Lin, X., Chen, L., Shu, J., Pang, P., Cheng, J., Xu, M., & Sun, Z. (2021) · European Radiology · doi:10.1007/s00330-021-07768-2 · Cited by 30
O’Shea, R. J., Sharkey, A. R., Cook, G., & Goh, V. (2021) · European Radiology · doi:10.1007/s00330-021-07881-2 · Cited by 31
“Data items were defined to measure compliance with CLAIM proposal and previously published proposals [1, 18].”
BackgroundMethodSelf-citationRadiomics in Abdominopelvic Solid-Organ Oncologic Imaging: Current Status
Liu, X., Elbanan, M., Luna, A., Haider, M. A., Smith, A. D., Sabottke, C. F., Spieler, B. M., Türkbey, B., Fuentes, D., Moawad, A. W., et al. (2022) · American Journal of Roentgenology · doi:10.2214/ajr.22.27695 · Cited by 32
Pang, H., Yu, Z., Yu, H., Chang, M., Cao, J., Li, Y., Guo, M., Liu, Y., Cao, K., & Fan, G. (2022) · CNS Neuroscience & Therapeutics · doi:10.1111/cns.13959 · Cited by 27
Koçak, B., Yardımcı, A., Yuzkan, S., Keleş, A., Altun, O., Bulut, E., Bayrak, O. N., & Okumus, A. (2022) · Academic Radiology · doi:10.1016/j.acra.2022.11.030 · Cited by 23
Deep Learning-Based Automatic Segmentation of Mandible and Maxilla in Multi-Center CT Images
Park, S., Kim, H. H., Shim, E., Hwang, B.-Y., Kim, Y., Lee, J., & Seo, H. (2022) · Applied Sciences · doi:10.3390/app12031358 · Cited by 27
Data set terminology of deep learning in medicine: a historical review and recommendation
Walston, S. L., Seki, H., Takita, H., Mitsuyama, Y., Sato, S., Hagiwara, A., Ito, R., Hanaoka, S., Miki, Y., & Ueda, D. (2024) · Japanese Journal of Radiology · doi:10.1007/s11604-024-01608-1 · Cited by 29
“Finally, building on the work by Erickson et al. [32], Park et al. [33] and Bluemke et al. [34] the 2020 Checklist for Artificial Intelligence in Medical Imaging (CLAIM) guidelines were the first to explicitly acknowledge the deep learning-centric terminology of model “training, validation…”
The Role of Artificial Intelligence and Machine Learning in Cardiovascular Imaging and Diagnosis
Reza-Soltani, S., Alam, L. F., Debellotte, O., Monga, T. S., Coyalkar, V. R., Tarnate, V. C. A., Ozoalor, C. U., Allam, S. R., Afzal, M., Shah, G. K., et al. (2024) · Cureus · doi:10.7759/cureus.68472 · Cited by 28
“Inconsistencies in image acquisition protocols, variability in equipment calibration, and differences in patient populations across healthcare institutions pose significant challenges [51].”
BackgroundImproving reference standards for validation of AI-based radiography
Duggan, G. E., Reicher, J. J., Liu, Y., Tse, D., & Shetty, S. (2021) · British Journal of Radiology · doi:10.1259/bjr.20210435 · Cited by 27
“14 Typically, reference standards are extracted from clinical radiology reports or reinterpretation of images by one or more readers (where ground truth is defined by the majority of the opinions of the panel).”
BackgroundPradella, M., Weikert, T., Sperl, J. I., Kärgel, R., Cyriac, J., Achermann, R., Sauter, A. W., Bremerich, J., Stieltjes, B., Brantner, P., et al. (2021) · Quantitative Imaging in Medicine and Surgery · doi:10.21037/qims-21-142 · Cited by 27
Pham, N., Hill, V. B., Rauschecker, A. M., Lui, Y. W., Niogi, S. N., Filippi, C. G., Chang, P., Zaharchuk, G., & Wintermark, M. (2023) · American Journal of Neuroradiology · doi:10.3174/ajnr.a7850 · Cited by 27
“utilize turnaround time in outpatients with unexpected bleeds as a metric rather than reporting the overall accuracy of the tool.(15,25) To evaluate potential real-world clinical efficacy and generaliz-”
MethodBrady, A. P., Allen, B., Chong, J., Kotter, E., Kottler, N. E., Mongan, J., Oakden‐Rayner, L., dos Santos, D. P., Tang, A., Wald, C., et al. (2024) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2023.12.005 · Cited by 39
Kim, D. W., Jang, H. Y., Ko, Y., Son, J. H., Kim, P. H., Kim, S., Lim, J. S., & Park, S. H. (2020) · PLoS ONE · doi:10.1371/journal.pone.0238908 · Cited by 28
“However, others recommend referring to them as training, validation, and test sets [16].”
BackgroundTimilsina, M., Buosi, S., Razzaq, M. A., Haque, R., Judge, C. S., & Curry, E. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.109925 · Cited by 32
Wang, S., Han, X., Du, J., Wang, Z., Yuan, C., Chen, Y., Zhu, Y., Dou, X., Xu, X., Xu, H. F., et al. (2021) · Insights into Imaging · doi:10.1186/s13244-021-01117-z · Cited by 26
Kau, T., Ziurlys, M., Taschwer, M., Kloss‐Brandstätter, A., Grabner, G., & Deutschmann, H. (2022) · Neuroradiology · doi:10.1007/s00234-021-02874-w · Cited by 25
Wang, X., Fan, Y., Zhang, N., Li, J., Duan, Y., & Yang, B. (2022) · Frontiers in Neurology · doi:10.3389/fneur.2022.910259 · Cited by 25
“The Radiology editorial board has developed a list of nine key considerations to improve the soundness and applicability of artificial intelligence research in diagnostic imaging (20).”
BackgroundChalkidou, A., Shokraneh, F., Kijauskaite, G., Taylor‐Phillips, S., Halligan, S., Wilkinson, L., Glocker, B., Garrett, P., Denniston, A. K., Mackie, A., et al. (2022) · The Lancet Digital Health · doi:10.1016/s2589-7500(22)00186-8 · Cited by 27
A Role for FDG PET Radiomics in Personalized Medicine?
Cook, G., & Goh, V. (2020) · Seminars in Nuclear Medicine · doi:10.1053/j.semnuclmed.2020.05.002 · Cited by 25
Self-citationBotnari, A., Kadar, M., & Pătraşcu, J. M. (2024) · Diagnostics · doi:10.3390/diagnostics14111090 · Cited by 29
“…and early The ultimate objective is to deploy DL models in clinical se tt ings, provide consistent, e ffi cient, early detection of meniscal tears, and complement healthcare professionals’ expertise [20–23]. integration of DL tools into the complex landscape of medical diagnostics [24–29].”
BackgroundChen, W., Hou, X., Hu, Y., Huang, G., Ye, X., & Nie, S. (2021) · Medical Physics · doi:10.1002/mp.15302 · Cited by 27
Guo, W., She, D., Xing, Z., Lin, X., Wang, F., Song, Y. S., & Cao, D. (2022) · Frontiers in Oncology · doi:10.3389/fonc.2022.796583 · Cited by 27
Radiomics and Radiogenomics of Ovarian Cancer
Panico, C., Avesani, G., Zormpas‐Petridis, K., Rundo, L., Nero, C., & Sala, E. (2023) · Radiologic Clinics of North America · doi:10.1016/j.rcl.2023.02.006 · Cited by 25
Ouyang, H., Meng, F., Liu, J., Song, X., Li, Y., Yuan, Y., Wang, C., Lang, N., Tian, S., Yao, M., et al. (2022) · Frontiers in Oncology · doi:10.3389/fonc.2022.814667 · Cited by 21
Krag, C. H., Müller, F. C., Gandrup, K. L., Raaschou, H., Andersen, M. B., Brejnebøl, M. W., Sagar, M. V., Bojsen, J. A., Rasmussen, B. S., Graumann, O., et al. (2023) · European Journal of Radiology · doi:10.1016/j.ejrad.2023.111126 · Cited by 29
Batool, Z., Kamal, M. A., & Shen, B. (2024) · Journal of Cancer Research and Clinical Oncology · doi:10.1007/s00432-024-05903-2 · Cited by 22
“The implementation of the DL methods has proven to be more straightforward and precise compared to ML (Yan et al. 2023; Bluemke et al. 2020 ).”
MethodRadiologist’s Guide to Evaluating Publications of Clinical Research on AI: How We Do It
Park, S. H., Sul, A.-R., Ko, Y., Jang, H. Y., & Lee, J. (2023) · Radiology · doi:10.1148/radiol.230288 · Cited by 23
Ni, R., Han, K. C.-Z., Haibe‐Kains, B., & Rink, A. (2024) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2024.110332 · Cited by 25
Bhurwani, M. M. S., Snyder, K. V., Waqas, M., Mokin, M. V., Rava, R. A., Podgorsak, A. R., Chin, F., Davies, J. M., Levy, E. I., Siddiqui, A. H., et al. (2021) · Neuroradiology · doi:10.1007/s00234-020-02598-3 · Cited by 20
“Following guidelines proposed by Radiology [24] and in order to prevent network overfitting, we split the dataset with 70% (268 cases) reserved for training, 10% (39 cases) reserved as a validation set used for hyperparameter tuning during training, and 20% (77 cases) reserved for testing.”
MethodMahmood, U. A., Shrestha, R., Bates, . D. B., Mannelli, L., Corrias, G., Erdi, Y. E., & Kanan, C. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.671015 · Cited by 30
“For AI-based software as a medical device, the gold standard for analytical validation is to assess performance on previously unseen independent datasets (Bluemke et al., 2020; Soffer et al., 2019; Kim et al., 2019; El Naqa et al., 2018), followed by a clinical validation study.”
MethodSivanesan, U., Wu, K., McInnes, M. D. F., Dhindsa, K., Salehi, F., & van der Pol, C. B. (2023) · Canadian Association of Radiologists Journal · doi:10.1177/08465371221134056 · Cited by 19
Calimano-Ramirez, L. F., Virarkar, M., Hernandez, M., Ozdemir, S., Kumar, S. P., Gopireddy, D. R., Lall, C. G., Balaji, K. C., Mete, M., & Gümüş, K. (2023) · Abdominal Radiology · doi:10.1007/s00261-023-03924-y · Cited by 21
“We aim to address this issue in forthcoming publications, which could lead to progress in the coming years [58, 59].”
BackgroundComplexities of deep learning-based undersampled MR image reconstruction
Noordman, C. R., Yakar, D., Bosma, J. S., Simonis, F. F. J., & Huisman, H. J. (2023) · European Radiology Experimental · doi:10.1186/s41747-023-00372-7 · Cited by 31
Cho, S. J., Cho, W., Choi, D., Sim, G., Jeong, S. Y., Baik, S. H., Bae, Y. J., Choi, B. S., Kim, J. H., Yoo, S., et al. (2024) · Scientific Reports · doi:10.1038/s41598-024-60781-5 · Cited by 36
Artificial intelligence in neuroradiology: a scoping review of some ethical challenges
Khosravi, P., & Schweitzer, M. (2023) · Frontiers in Radiology · doi:10.3389/fradi.2023.1149461 · Cited by 23
Panch, T., Pollard, T., Mattie, H., Lindemer, E., Keane, P. A., & Celi, L. A. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0295-6 · Cited by 20
“In fact, in recent guidance, the Radiological Society of North America 25 stipulated that an external test set should be used for fi nal statistical reporting of algorithms in research.”
Pennisi, F., Borlini, S., Harrison, H., Cuciniello, R., D’Amelio, A. C., Barclay, M., Ricciardi, G. E., Lyratzopoulos, G., & Renzi, C. (2025) · Cancer Medicine · doi:10.1002/cam4.71463 · Cited by 23
“Furthermore, a clear and transparent description of the training data charac-teristics—such as how data were collected, labeled, and pro-cessed—is critical to identifying potential sources of bias and ensuring clinical applicability [82].”
Kawaguchi, M., Kidokoro, H., Ito, R., Shiraki, A., Suzuki, T., Maki, Y., Tanaka, M., Sakaguchi, Y., Yamamoto, H., Takahashi, Y., et al. (2021) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2021.03.004 · Cited by 17
Taloni, A., Farrelly, F. A., Pontillo, G., Petsas, N., Giannì, C., Ruggieri, S., Petracca, M., Brunetti, A., Pozzilli, C., Pantano, P., et al. (2022) · International Journal of Molecular Sciences · doi:10.3390/ijms231810651 · Cited by 23
“These differences, added to the difference of the MRI tomographs, granted generalizability of the obtained results [41].”
ResultKrzywicki, T., Brona, P., Zbrzezny, A. M., & Grzybowski, A. E. (2023) · Journal of Clinical Medicine · doi:10.3390/jcm12103587 · Cited by 24
Mohamad, D. N. F. P., Mashohor, S., Mahmud, R., Hanafi, M. B., & Bahari, N. B. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10511-6 · Cited by 20
“Automated breast ultrasound (ABUS) represents a recent imaging technique authorized by the Food and Drug Administration (FDA) in 2012 as a supplemental screening device for women with heterogeneously and extremely dense breasts (Boca et al. 2021).”
MethodSantomartino, S. M., Kung, J. E., & Yi, P. H. (2023) · Skeletal Radiology · doi:10.1007/s00256-023-04416-2 · Cited by 22
“External testing is a critical step in model development, as it assesses clinical generalizability [35, 36].”
Antolín, A., Rosón, N., Mast, R., Arce, J., Almodovar, R., Cortada, R., Maceda, A., Escobar, M., Trilla, E., & Moróte, J. (2024) · Cancers · doi:10.3390/cancers16172951 · Cited by 22
“Past similar reviews also highlighted this problem [39,40,42–44], which limits model applicability and robustness [61].”
BackgroundGennari, A. G., Rossi, A., De Cecco, C. N., van Assen, M., Sartoretti, T., Giannopoulos, A. A., Schwyzer, M., Huellner, M. W., & Messerli, M. (2024) · The International Journal of Cardiovascular Imaging · doi:10.1007/s10554-024-03080-4 · Cited by 16
“These steps help reduce overfitting, which refers to an algorithm working exceptionally well on the data (images) it was trained on ( training dataset ) but then fails to generalize adequately to new, unseen data ( testing dataset ) [61].”
BackgroundInfluentialTanioka, S., Aydin, O. U., Hilbert, A., Ishida, F., Tsuda, K., Araki, T., Nakatsuka, Y., Yago, T., Kishimoto, T., Ikezawa, M., et al. (2024) · Scientific Reports · doi:10.1038/s41598-024-67365-3 · Cited by 16
“…hematoma expansion because the programming codes were not disclosed 18–21 Several considerations have been suggested for the soundness of research using artificial intelligence (AI) techniques, such as the use of an external test set for the final report, transparency of algorithms, etc. 30,31 .”
BackgroundArticles That Use Artificial Intelligence for Ultrasound: A Reader’s Guide
Kuang, M., Hu, H.-T., Li, W., Chen, S., & Lü, X. (2021) · Frontiers in Oncology · doi:10.3389/fonc.2021.631813 · Cited by 17
Santomartino, S. M., Hafezi‐Nejad, N., Parekh, V. S., & Yi, P. H. (2023) · Radiology Artificial Intelligence · doi:10.1148/ryai.220062 · Cited by 19
Rivera, Z. C., González-Seguel, F., Horikawa-Strakovsky, A., Granger, C. L., Sarwal, A., Dhar, S., Ntoumenopoulos, G., Chen, J., Bumgardner, C., Parry, S. M., et al. (2025) · Scientific Reports · doi:10.1038/s41598-025-99522-7 · Cited by 23
Woźnicki, P., Siedek, F., van Gastel, M. D. A., dos Santos, D. P., Arjune, S., Karner, L. A., Meyer, F. I., Caldeira, L., Persigehl, T., Gansevoort, R. T., et al. (2022) · Kidney360 · doi:10.34067/kid.0003192022 · Cited by 17
Altukroni, A., Alsaeedi, A., Gonzalez-Losada, C., Lee, J., Alabudh, M., Mirah, M. A., El-Amri, S., & El-Deen, O. E. (2023) · BMC Oral Health · doi:10.1186/s12903-023-03251-0 · Cited by 24
CIRSE Position Paper on Artificial Intelligence in Interventional Radiology
Najafi, A., Cazzato, R. L., Meyer, B. C., Pereira, P. L., Alberich, A., López‐Rueda, A., Ronot, M., Fritz, J. M., Maas, M., Benson, S., et al. (2023) · CardioVascular and Interventional Radiology · doi:10.1007/s00270-023-03521-y · Cited by 21
Yasaka, K., Sato, C., Hirakawa, H., Fujita, N., Kurokawa, M., Watanabe, Y., Kubo, T., & Abe, O. (2023) · Clinical Radiology · doi:10.1016/j.crad.2023.09.022 · Cited by 20
Evaluating artificial intelligence for medical imaging: a primer for clinicians
Keni, S. (2024) · British Journal of Hospital Medicine · doi:10.12968/hmed.2024.0312 · Cited by 20
Current Status of Radiomics and Deep Learning in Liver Imaging
Chu, L. C. H., Park, S., Kawamoto, S., Yuille, A., Hruban, R. H., & Fishman, E. K. (2021) · Journal of Computer Assisted Tomography · doi:10.1097/rct.0000000000001169 · Cited by 17
Fleury, E. D. F. C., & Marcomini, K. (2020) · European Journal of Radiology · doi:10.1016/j.ejrad.2020.109197 · Cited by 15
Bolocan, V.-O., Mitoi, A., Nicu-Canareica, O., Băean, M.-L., Medar, C., & Popa, G.-A. (2025) · Journal of Imaging · doi:10.3390/jimaging11100335 · Cited by 22
“Most troubling, only 12% of studies include true external validation on geographically distinct populations with different scanners and protocols [46].”
Liu, Y., Duan, H., Dong, D., Chen, J., Zhong, L., Zhang, L., Cao, R., Fan, H., Cui, Z., Liu, P., et al. (2022) · Clinical and Translational Medicine · doi:10.1002/ctm2.938 · Cited by 14
Using Artificial Intelligence in Fungal Lung Disease: CPA CT Imaging as an Example
Angelini, E. D., & Shah, A. (2021) · Mycopathologia · doi:10.1007/s11046-021-00546-0 · Cited by 16
“However, radiological societies are working toward reporting standards for AI tools [14–17] that include demonstration of robustness on external cohorts, similar to previous efforts such as the TRIPOD reporting sys-tem for predictive models [18].”
MethodArtificial intelligence innovations in radiology put to the test by health system regulations
Mignot, L., & Schultz, É. (2022) · Réseaux · doi:10.3917/res.232.0065 · Cited by 22
Starmans, M. P. A., Miclea, R. L., Vilgrain, V., Ronot, M., Purcell, Y., Verbeek, J., Niessen, W. J., IJzermans, J. N. M., de Man, R. A., Doukas, M., et al. (2023) · Academic Radiology · doi:10.1016/j.acra.2023.07.024 · Cited by 18
Logullo, P., MacCarthy, A., Dhiman, P., Kirtley, S., Ma, J., Bullock, G. S., & Collins, G. S. (2023) · BJR|Open · doi:10.1259/bjro.20220033 · Cited by 14
Yoshida, K., Tanabe, Y., Nishiyama, H., Matsuda, T., Toritani, H., Kitamura, T., Sakai, S., Watamori, K., Takao, M., Kimura, E., et al. (2023) · Journal of Computer Assisted Tomography · doi:10.1097/rct.0000000000001437 · Cited by 14
Automatic echocardiographic anomalies interpretation using a stacked residual-dense network model
Nurmaini, S., Sapitri, A. I., Tutuko, B., Rachmatullah, M. N., Rini, D. P., Darmawahyuni, A., Firdaus, F., Mandala, S., Nova, R., & Bernolian, N. (2023) · BMC Bioinformatics · doi:10.1186/s12859-023-05493-9 · Cited by 14
Kuwabara, M., Ikawa, F., Sakamoto, S., Okazaki, T., Ishii, D., Hosogai, M., Maeda, Y., Chiku, M., Kitamura, N., Choppin, A., et al. (2023) · Scientific Reports · doi:10.1038/s41598-023-43418-x · Cited by 14
Review of Artificial Intelligence Training Tools and Courses for Radiologists
Richardson, M. L., Adams, S., Agarwal, A. K., Auffermann, W. F., Bhattacharya, A. K., Consul, N., Fotos, J. S., Kelahan, L. C., Lin, C. S., Lo, H. S., et al. (2021) · Academic Radiology · doi:10.1016/j.acra.2020.12.026 · Cited by 15
Radiomics and Deep Learning in Brain Metastases: Current Trends and Roadmap to Future Applications
Park, Y. W., Lee, N., Ahn, S. S., Chang, J. H., & Lee, S. (2021) · Investigative Magnetic Resonance Imaging · doi:10.13104/imri.2021.25.4.266 · Cited by 14
“Currently, several guidance materials already exist (83, 84), and AI- and machine learning-specific guidelines to the STARD statement (STARD-AI) and TRIPOD statement (TRIPOD-ML) are being developed (85, 86).”
BackgroundWriting a Great Review for Radiology
Bluemke, D. A., & Sosna, J. (2020) · Radiology · doi:10.1148/radiol.2020204007 · Cited by 13
Self-citationFields, B. K. K., Calabrese, E., Mongan, J., Cha, S., Hess, C. P., Sugrue, L. P., Chang, S. M., Luks, T. L., Villanueva-Meyer, J. E., Rauschecker, A. M., et al. (2024) · Radiology Artificial Intelligence · doi:10.1148/ryai.230182 · Cited by 19
Self-citationBandyopadhyay, A., Bae, C. J., Cheng, H., Chiang, A. A.-P., Deak, M. C., Seixas, A. A., & Singh, J. R. (2023) · Journal of Clinical Sleep Medicine · doi:10.5664/jcsm.10702 · Cited by 14
Salybekov, A. A., Wolfien, M., Hahn, W., Hidaka, S., & Kobayashi, S. (2024) · Biomedicines · doi:10.3390/biomedicines12030606 · Cited by 20
“If these actual or potential limitations are not identified, it may lead to implicit approval through publication, which, in turn, may support the premature adoption of new technologies [31].”
BackgroundWFUMB Commentary Paper on Artificial intelligence in Medical Ultrasound Imaging
Cui, X. W., Goudie, A., Blaivas, M., Chai, Y. J., Chammas, M. C., Dong, Y. W., Stewart, J. E., Jiang, T.-A., Liang, P., Sehgal, C. M., et al. (2024) · Ultrasound in Medicine & Biology · doi:10.1016/j.ultrasmedbio.2024.10.016 · Cited by 20
Dratsch, T., Caldeira, L., Maintz, D. C., & dos Santos, D. P. (2020) · Insights into Imaging · doi:10.1186/s13244-020-00866-7 · Cited by 13
“For instance, a new checklist with 9 key considerations for authors of radiology research on artificial intelligence can serve as a guideline for authors what critical information should be included in a paper or abstract [24].”
BackgroundFutoma, J., Simons, M. G., Doshi‐Velez, F., & Kamaleswaran, R. (2021) · Critical Care Explorations · doi:10.1097/cce.0000000000000453 · Cited by 15
“Although it is becoming increasingly expected that researchers externally validate clinical prediction models (11, 12), there is scant work addressing what factors affect external generalization (13–16).”
BackgroundNdiaye, A. D., Gasqui, M.-A., Millioz, F., Pérard, M., Lèye-Benoist, F., & Grosgogeat, B. (2024) · Caries Research · doi:10.1159/000536277 · Cited by 17
“Ideally, an external dataset from another institution should be used for the fi nal evaluation to allow the generalizability of the ML or DL model [76].”
Anastasopoulos, C., Yang, S., Pradella, M., D’Antonoli, T. A., Knecht, S., Cyriac, J., Reisert, M., Kellner, E., Achermann, R., Haaf, P., et al. (2021) · Journal of Cardiovascular Magnetic Resonance · doi:10.1186/s12968-021-00791-8 · Cited by 10
“Out of the recently suggested nine key considerations for study design in artificial intelligence image analysis [21], six items were fulfilled and three were not: as a limitation, we did not include a fully independent external test subset (consideration 2) and did not include multivendor image acquisitions (consider…”
BackgroundKsibi, A., Zakariah, M., Ayadi, M. F., Elmannai, H., Shukla, P. K., Halifa, A., & Hamdi, M. (2022) · Computational Intelligence and Neuroscience · doi:10.1155/2022/9414567 · Cited by 11
“A number of studies have shown that deep learning (DL) technologies are the most promising technique for dealing with disease diagnosis using medical imaging [21, 22].”
BackgroundElfer, K. N., Gardecki, E., Garcia, V. L., Ly, A., Hytopoulos, E., Wen, S., Hanna, M. G., Peeters, D. J. E., Saltz, J. H., Ehinger, A., et al. (2024) · Modern Pathology · doi:10.1016/j.modpat.2024.100439 · Cited by 17
“21,22 Recently, Homeyer et al 23 provided a broad review of issues related to compiling test data sets, from specifying the target population to data collection, annotation, and curation, and also bias detection, sample size, and regulatory requirements.”
Sun, C., Xiong, X., Zhang, T., Guan, X., Mao, H., Yang, J., Zhang, X., Sun, Y., Chen, H., & Xie, G. (2021) · BioMed Research International · doi:10.1155/2021/4989297 · Cited by 10
“To evaluate the robustness of a neural network, an external test set is necessary [27].”
BackgroundAvailability and transparency of artificial intelligence models in radiology: a meta-research study
Lee, T., Lee, J. H., Yoon, S. H., Park, S. H., & Kim, H. (2025) · European Radiology · doi:10.1007/s00330-025-11492-6 · Cited by 12
Bhurwani, M. M. S., Snyder, K. V., Waqas, M., Mokin, M. V., Rava, R. A., Podgorsak, A. R., Sommer, K. N., Davies, J. M., Levy, E. I., Siddiqui, A. H., et al. (2021) · SPIE Medical Imaging: Computer-Aided Diagnosis · doi:10.1117/12.2580358 · Cited by 10
“Following the guidelines proposed by Radiology [27], and in order to prevent overfitting of the model, each dataset was split into a training set (70%, 268 cases), a validation set for hyperparameter tuning during training (10%, 39 cases), and a testing set (20%, 77 cases).”
MethodMorland, D., Triumbari, E. K. A., Boldrini, L., Gatta, R., Pizzuto, D. A., & Annunziata, S. (2022) · Diagnostics · doi:10.3390/diagnostics12061330 · Cited by 11
Lee, S. B., Hong, Y., Cho, Y. J., Jeong, D., Lee, J., Yoon, S. H., Lee, S., Choi, Y. H., & Cheon, J. (2023) · Korean Journal of Radiology · doi:10.3348/kjr.2022.0588 · Cited by 12
“A considerable number of articles submitted and published in the field of radiology are related to AI, and many AIbased medical image analysis software programs are being developed [23].”
BackgroundTop 10 Tips for Writing Your Scientific Paper: The Radiology Scientific Style Guide
Atzen, S. L., & Bluemke, D. A. (2022) · Radiology · doi:10.1148/radiol.229005 · Cited by 10
Self-citation
Metadata
- Authors
- Bluemke, D. A., Moy, L., Bredella, M. A., Ertl-Wagner, B. B., Fowler, K. J., Goh, V. J., Halpern, E. F., Hess, C. P., Schiebler, M. L., & Weiss, C. R.
- Affiliations
- University of Wisconsin–Madison (US)
- ORCID
- Venue
- Radiology
- Published
- 2020-03
- Volume
- 294
- Issue
- 3
- Pages
- 487-489
- ISSN
- 0033-8419 (ISSN-L)
- 1527-1315
- OpenAlex
- W2997449172
- Cited by
- 343
- References
- 6
- Citations by year
- 2026: 26 · 2025: 42 · 2024: 49 · 2023: 57 · 2022: 59 · 2021: 71 · 2020: 38
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Radiology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Cancer Research UK (16463)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiology practices and education
- Keywords
- artificial intelligence, radiology research, reporting quality, manuscript review, editorial guidelines
- MeSH terms
- Artificial Intelligence, Humans, Image Interpretation, Computer-Assisted, Manuscripts, Medical as Topic, Radiography, Radiology, Databases, Factual, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.