Radiomics, machine learning, and artificial intelligence—what the neuroradiologist needs to know
Open accessThe DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Abstract
Artificial intelligence (AI) is playing an ever-increasing role in Neuroradiology. When designing AI-based research in neuroradiology and appreciating the literature, it is important to understand the fundamental principles of AI. Training, validation, and test datasets must be defined and set apart as priorities. External validation and testing datasets are preferable, when feasible. The specific type of learning process (supervised vs. unsupervised) and the machine learning model also require definition. Deep learning (DL) is an AI-based approach that is modelled on the structure of neurons of the brain; convolutional neural networks (CNN) are a commonly used example in neuroradiology. Radiomics is a frequently used approach in which a multitude of imaging features are extracted from a region of interest and subsequently reduced and selected to convey diagnostic or prognostic information. Deep radiomics uses CNNs to directly extract features and obviate the need for predefined features. Common limitations and pitfalls in AI-based research in neuroradiology are limited sample sizes (“small-n-large-p problem”), selection bias, as well as overfitting and underfitting.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The perceptron: A probabilistic model for information storage and organization in the brain.
Rosenblatt, F. (1958) · Psychological Review · doi:10.1037/h0042519 · Cited by 12,280
Computational Radiomics System to Decode the Radiographic Phenotype
(2017) · doi:10.1158/0008-5472.can-17-0339 · Cited by 6,593
Some Studies in Machine Learning Using the Game of Checkers
Samuel, A. L. (1959) · IBM Journal of Research and Development · doi:10.1147/rd.33.0210 · Cited by 4,443 · cited 1×
“The term “machine learning” was coined by Arthur Samuel in 1959 [11].”
BackgroundHaralick, R. M., & Shapiro, L. G. (1985) · Computer Vision, Graphics, and Image Processing · doi:10.1016/s0734-189x(85)90153-7 · Cited by 2,253
Sensitivity Analysis of k-Fold Cross Validation in Prediction Error Estimation
Rodriguez, J. D., Perez, A., & Lozano, J. A. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.187 · Cited by 1,890
Machine learning for medical imaging
Erickson, B. J., Korfiatis, P., Akkus, Z., & Kline, T. L. (2017) · RadioGraphics · doi:10.1148/rg.2017160130 · Cited by 1,672
Checklist for Artificial Intelligence in Medical Imaging (CLAIM): a guide for authors and reviewers
Mongan, J., Moy, L., & Kahn, C. E. (2020) · Radiology: Artificial Intelligence · doi:10.1148/ryai.2020200029 · Cited by 1,443
Radiomics in medical imaging—“how-to” guide and critical reflection
van Timmeren, J. E., Cester, D., Tanadini-Lang, S., Alkadhi, H., & Baessler, B. (2020) · Insights into Imaging · doi:10.1186/s13244-020-00887-2 · Cited by 1,316
Radiomics: the facts and the challenges of image analysis
Rizzo, S., Botta, F., Raimondi, S., Origgi, D., Fanciullo, C., Morganti, A. G., & Bellomi, M. (2018) · European Radiology Experimental · doi:10.1186/s41747-018-0068-z · Cited by 1,054
Roberts, M., Driggs, D., Thorpe, M., Gilbey, J., Yeung, M., Ursprung, S., Aviles-Rivero, A. I., Etmann, C., McCague, C., Beer, L., et al. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00307-0 · Cited by 1,044
Ledley, R. S., & Lusted, L. B. (1959) · Science · doi:10.1126/science.130.3366.9 · Cited by 991
Roberts, M. T., Driggs, D., Thorpe, M., Gilbey, J., Yeung, M., Ursprung, S., Avilés-Rivero, A. I., Etmann, C., McCague, C., Beer, L., et al. (2020) · Apollo (University of Cambridge) · doi:10.17863/cam.64000 · Cited by 895
Pesapane, F., Codari, M., & Sardanelli, F. (2018) · European Radiology Experimental · doi:10.1186/s41747-018-0061-6 · Cited by 833
Ten principles of good interdisciplinary team work
Nancarrow, S. A., Booth, A., Ariss, S., Smith, T., Enderby, P., & Roots, A. (2013) · Human Resources for Health · doi:10.1186/1478-4491-11-19 · Cited by 681
Deep learning for lung cancer prognostication: A retrospective multi-cohort radiomics study
Hosny, A., Parmar, C., Coroller, T. P., Grossmann, P., Zeleznik, R., Kumar, A., Bussink, J., Gillies, R. J., Mak, R. H., & Aerts, H. J. W. L. (2018) · PLOS Medicine · doi:10.1371/journal.pmed.1002711 · Cited by 579
Eelbode, T., Bertels, J., Berman, M., Vandermeulen, D., Maes, F., Bisschops, R., & Blaschko, M. B. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.3002417 · Cited by 420
Raunig, D. L., McShane, L. M., Pennello, G., Gatsonis, C., Carson, P. L., Voyvodic, J. T., Wahl, R. L., Kurland, B. F., Schwarz, A. J., Gönen, M., et al. (2015) · Statistical Methods in Medical Research · doi:10.1177/0962280214537344 · Cited by 394
Park, J. E., Park, S. Y., Kim, H. J., & Kim, H. S. (2019) · Korean Journal of Radiology · doi:10.3348/kjr.2018.0070 · Cited by 388
Deep learning with convolutional neural network in radiology
Yasaka, K., Akai, H., Kunimatsu, A., Kiryu, S., & Abe, O. (2018) · Japanese Journal of Radiology · doi:10.1007/s11604-018-0726-3 · Cited by 368
Deep Learning in Neuroradiology
Zaharchuk, G., Gong, E., Wintermark, M., Rubin, D., & Langlotz, C. P. (2018) · American Journal of Neuroradiology · doi:10.3174/ajnr.a5543 · Cited by 296
Carré, A., Klausner, G., Edjlali, M., Lerousseau, M., Briend-Diop, J., Sun, R., Ammari, S., Reuzé, S., Alvarez Andres, E., Estienne, T., et al. (2020) · Scientific Reports · doi:10.1038/s41598-020-69298-z · Cited by 278
The partial area under the summary ROC curve
Walter, S. D. (2005) · Statistics in Medicine · doi:10.1002/sim.2103 · Cited by 239
Winsberg, F., Elkin, M., Macy, J., Bordaz, V., & Weymouth, W. (1967) · Radiology · doi:10.1148/89.2.211 · Cited by 237
Robustness and Reproducibility of Radiomics in Magnetic Resonance Imaging: A Phantom Study
Baeßler, B., Weiss, K., & Pinto dos Santos, D. (2019) · Investigative Radiology · doi:10.1097/rli.0000000000000530 · Cited by 229
Survival analysis in clinical trials: Basics and must know areas
Singh, R., & Mukhopadhyay, K. (2011) · Perspectives in Clinical Research · doi:10.4103/2229-3485.86872 · Cited by 219
for the Canadian Association of Radiologists (CAR) Artificial Intelligence Working Group, Jaremko, J. L., Azar, M., Bromwich, R., Lum, A., Alicia Cheong, L. H., Gibert, M., Laviolette, F., Gray, B., Reinhold, C., et al. (2019) · Canadian Association of Radiologists Journal · doi:10.1016/j.carj.2019.03.001 · Cited by 199
European Society of Radiology (ESR) (2019) · Insights into Imaging · doi:10.1186/s13244-019-0798-3 · Cited by 196
Deep learning workflow in radiology: a primer
Montagnon, E., Cerny, M., Cadrin-Chênevert, A., Hamilton, V., Derennes, T., Ilinca, A., Vandenbroucke-Menu, F., Turcotte, S., Kadoury, S., & Tang, A. (2020) · Insights into Imaging · doi:10.1186/s13244-019-0832-5 · Cited by 183
The Coding of Roentgen Images for Computer Analysis as Applied to Lung Cancer
Lodwick, G. S., Keats, T. E., & Dorst, J. P. (1963) · Radiology · doi:10.1148/81.2.185 · Cited by 145
Li, Q., Bai, H., Chen, Y., Sun, Q., Liu, L., Zhou, S., Wang, G., Liang, C., & Li, Z. (2017) · Scientific Reports · doi:10.1038/s41598-017-14753-7 · Cited by 145
European Society of Radiology (ESR)
Parizel, P. M. (2015) · Cited by 131
A Transfer Learning–Based Active Learning Framework for Brain Tumor Classification
Hao, R., Namdar, K., Liu, L., & Khalvati, F. (2021) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2021.635766 · Cited by 103
Self-citationAutomated Computer Analysis of Radiographic Images
Meyers, P. H., Nice, C. M., Becker, H. C., Nettleton, W. J., Sweeney, J. W., & Meckstroth, G. R. (1964) · Radiology · doi:10.1148/83.6.1029 · Cited by 101
Reasoning Foundations of Medical Diagnosis
Ledley, R. S., & Lusted, L. B. (1985) · Computers and medicine · doi:10.1007/978-1-4613-8554-7_2 · Cited by 96
Rios Velazquez, E., Meier, R., Dunn Jr, W. D., Alexander, B., Wiest, R., Bauer, S., Gutman, D. A., Reyes, M., & Aerts, H. J. W. L. (2015) · Scientific Reports · doi:10.1038/srep16822 · Cited by 92
Artificial Intelligence and Deep Learning in Neuroradiology: Exploring the New Frontier
Kaka, H., Zhang, E., & Khan, N. M. (2020) · Canadian Association of Radiologists Journal · doi:10.1177/0846537120954293 · Cited by 75
Baur, C., Wiestler, B., Mühlau, M., Zimmer, C., Navab, N., & Albarqouni, S. (2021) · Radiology Artificial Intelligence · doi:10.1148/ryai.2021190169 · Cited by 62
A Practical Guide to Artificial Intelligence–Based Image Analysis in Radiology
Weikert, T., Cyriac, J., Yang, S., Nešić, I., Parmar, V., & Stieltjes, B. (2019) · Investigative Radiology · doi:10.1097/rli.0000000000000600 · Cited by 59
Radiomics Repeatability Pitfalls in a Scan-Rescan MRI Study of Glioblastoma
Hoebel, K., Patel, J., Beers, A. L., Chang, K., Singh, P., Brown, J. M., Pinho, M. C., Batchelor, T. T., Gerstner, E. R., Rosen, B. R., et al. (2020) · Radiology Artificial Intelligence · doi:10.1148/ryai.2020190199 · Cited by 58
Generalization of deep learning models for ultra-low-count amyloid PET/MRI using transfer learning
Chen, K. T., Schürer, M., Ouyang, J., Koran, M. E. I., Davidzon, G., Mormino, E. C., Tiepolt, S., Hoffmann, K., Sabri, O., Zaharchuk, G., et al. (2020) · European Journal of Nuclear Medicine and Molecular Imaging · doi:10.1007/s00259-020-04897-6 · Cited by 55
Radiomics and Deep Learning from Research to Clinical Workflow: Neuro-Oncologic Imaging
Park, J. E., Kickingereder, P., & Kim, H. S. (2020) · Korean Journal of Radiology · doi:10.3348/kjr.2019.0847 · Cited by 55
Combining unsupervised and supervised learning for predicting the final stroke lesion
Pinto, A. B., Pereira, S., Meier, R., Wiest, R., Alves, V., Reyes, M., & Silva, C. A. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101888 · Cited by 53
Eltorai, A. E. M., Bratt, A. K., & Guo, H. H. (2020) · Journal of Thoracic Imaging · doi:10.1097/rti.0000000000000453 · Cited by 51
Early neural network development history: the age of Camelot
Eberhart, R. C., & Dobbins, R. W. (1990) · IEEE Engineering in Medicine and Biology Magazine · doi:10.1109/51.59207 · Cited by 36
Schirmer, M. D., Venkataraman, A., Rekik, I., Kim, M., Mostofsky, S. H., Nebel, M. B., Rosch, K. S., Seymour, K. E., Crocetti, D., Irzan, H., et al. (2021) · White Rose Research Online (University of Leeds, The University of Sheffield, University of York) · Cited by 27
Semi-supervised learning for an improved diagnosis of COVID-19 in CT images
Han, C. H., Kim, M., & Kwak, J. T. (2021) · PLoS ONE · doi:10.1371/journal.pone.0249450 · Cited by 26
Finck, T., Schinz, D., Grundl, L., Eisawy, R., Yiğitsoy, M., Moosbauer, J., Pfister, F., & Wiestler, B. (2021) · Investigative Radiology · doi:10.1097/rli.0000000000000775 · Cited by 7
Metadata
- Authors
- Wagner, M. W., Namdar, K., Biswas, A., Monah, S., Khalvati, F., & Ertl-Wagner, B. B.
- Venue
- Neuroradiology
- Published
- 2021-09-18
- Volume
- 63
- Issue
- 12
- Pages
- 1957-1967
- ISSN
- 0028-3940 (ISSN-L)
- 1432-1920
- OpenAlex
- W3201496287
- Cited by
- 165
- References
- 47
- FWCI
- 12.39
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.