The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
Radiomics for precision medicine: Current challenges, future prospects, and the proposal of a new framework
Open accessAbstract
The advancement of artificial intelligence concurrent with the development of medical imaging techniques provided a unique opportunity to turn medical imaging from mostly qualitative, to further quantitative and mineable data that can be explored for the development of clinical decision support systems (cDSS). Radiomics, a method for the high throughput extraction of hand-crafted features from medical images, and deep learning -the data driven modeling techniques based on the principles of simplified brain neuron interactions, are the most researched quantitative imaging techniques. Many studies reported on the potential of such techniques in the context of cDSS. Such techniques could be highly appealing due to the reuse of existing data, automation of clinical workflows, minimal invasiveness, three-dimensional volumetric characterization, and the promise of high accuracy and reproducibility of results and cost-effectiveness. Nevertheless, there are several challenges that quantitative imaging techniques face, and need to be addressed before the translation to clinical use. These challenges include, but are not limited to, the explainability of the models, the reproducibility of the quantitative imaging features, and their sensitivity to variations in image acquisition and reconstruction parameters. In this narrative review, we report on the status of quantitative medical image analysis using radiomics and deep learning, the challenges the field is facing, propose a framework for robust radiomics analysis, and discuss future prospects.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1994) · doi:10.1201/9780429246593 · Cited by 40,500
A logical calculus of the ideas immanent in nervous activity
McCulloch, W. S., & Pitts, W. (1943) · The Bulletin of Mathematical Biophysics · doi:10.1007/bf02478259 · Cited by 18,566
Adjusting batch effects in microarray expression data using empirical Bayes methods
Johnson, W. E., Li, C., & Rabinovic, A. (2007) · Biostatistics · doi:10.1093/biostatistics/kxj037 · Cited by 8,658
Radiomics: Images Are More than Pictures, They Are Data
Gillies, R. J., Kinahan, P. E., & Hricak, H. (2016) · Radiology · doi:10.1148/radiol.2015151169 · Cited by 8,421
Intratumor Heterogeneity and Branched Evolution Revealed by Multiregion Sequencing
Gerlinger, M., Rowan, A. J., Horswell, S., Larkin, J., Endesfelder, D., Gronroos, E., Martinez, P., Matthews, N., Stewart, A., Tarpey, P., et al. (2012) · New England Journal of Medicine · doi:10.1056/nejmoa1113205 · Cited by 7,774
The multimodal brain tumor image segmentation benchmark (BRATS)
Menze, B. H., Jakab, A., Bauer, S., Kalpathy-Cramer, J., Farahani, K., Kirby, J., Burren, Y., Porz, N., Slotboom, J., Wiest, R., et al. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2014.2377694 · Cited by 6,781
Radiomics: extracting more information from medical images using advanced feature analysis
Lambin, P., Rios-Velazquez, E., Leijenaar, R., Carvalho, S., van Stiphout, R. G. P. M., Granton, P., Zegers, C. M. L., Gillies, R., Boellard, R., Dekker, A., et al. (2012) · European Journal of Cancer · doi:10.1016/j.ejca.2011.11.036 · Cited by 6,084
Self-citationRadiomics: the bridge between medical imaging and personalized medicine
Lambin, P., Leijenaar, R. T. H., Deist, T. M., Peerlings, J., de Jong, E. E. C., van Timmeren, J., Sanduleanu, S., Larue, R. T. H. M., Even, A. J. G., Jochems, A., et al. (2017) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2017.141 · Cited by 5,688
Self-citationDecoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach
Aerts, H. J. W. L., Velazquez, E. R., Leijenaar, R. T. H., Parmar, C., Grossmann, P., Carvalho, S., Bussink, J., Monshouwer, R., Haibe-Kains, B., Rietveld, D., et al. (2014) · Nature Communications · doi:10.1038/ncomms5006 · Cited by 5,132
Self-citationDeep learning in medical image analysis
Shen, D., Wu, G., & Suk, H.-I. (2017) · Annual Review of Biomedical Engineering · doi:10.1146/annurev-bioeng-071516-044442 · Cited by 4,968
Self-citationZwanenburg, A., Vallières, M., Abdalah, M. A., Aerts, H. J. W. L., Andrearczyk, V., Apte, A., Ashrafinia, S., Bakas, S., Beukinga, R. J., Boellaard, R., et al. (2020) · Radiology · doi:10.1148/radiol.2020191145 · Cited by 4,177
Self-citationDeep learning for computer vision: A brief review
Voulodimos, A., Doulamis, N., Doulamis, A., & Protopapadakis, E. (2018) · Computational Intelligence and Neuroscience · doi:10.1155/2018/7068349 · Cited by 3,403
Strimbu, K., & Tavel, J. A. (2010) · Current Opinion in HIV and AIDS · doi:10.1097/coh.0b013e32833ed177 · Cited by 2,062
Personalized medicine: Time for one-person trials
Schork, N. J. (2015) · Nature · doi:10.1038/520609a · Cited by 1,223
Applications and limitations of radiomics
Yip, S. S. F., & Aerts, H. J. W. L. (2016) · Physics in Medicine and Biology · doi:10.1088/0031-9155/61/13/r150 · Cited by 1,210
The calibration of CT Hounsfield units for radiotherapy treatment planning
Schneider, U., Pedroni, E., & Lomax, A. (1996) · Physics in Medicine and Biology · doi:10.1088/0031-9155/41/1/009 · Cited by 1,093
Intravenous Contrast Medium Administration and Scan Timing at CT: Considerations and Approaches
Bae, K. T. (2010) · Radiology · doi:10.1148/radiol.10090908 · Cited by 1,067
Intratumor Heterogeneity: Evolution through Space and Time
Swanton, C. (2012) · Cancer Research · doi:10.1158/0008-5472.can-12-2217 · Cited by 931
Vallières, M., Freeman, C. R., Skamene, S. R., & El Naqa, I. (2015) · Physics in Medicine and Biology · doi:10.1088/0031-9155/60/14/5471 · Cited by 897
A tutorial survey of architectures, algorithms, and applications for deep learning
Deng, L. (2014) · APSIPA Transactions on Signal and Information Processing · doi:10.1017/atsip.2013.9 · Cited by 725
Measuring Computed Tomography Scanner Variability of Radiomics Features
Mackin, D., Fave, X., Zhang, L., Fried, D., Yang, J., Taylor, B., Rodriguez-Rivera, E., Dodge, C., Jones, A. K., & Court, L. (2015) · Investigative Radiology · doi:10.1097/rli.0000000000000180 · Cited by 651
Berenguer, R., Pastor-Juan, M. D. R., Canales-Vázquez, J., Castro-García, M., Villas, M. V., Mansilla Legorburo, F., & Sabater, S. (2018) · Radiology · doi:10.1148/radiol.2018172361 · Cited by 622
On Loss Functions for Deep Neural Networks in Classification
Janocha, K., & Czarnecki, W. M. (2017) · Schedae Informaticae · doi:10.4467/20838476si.16.004.6185 · Cited by 591
On standardizing the MR image intensity scale
Ny�l, L. G., & Udupa, J. K. (1999) · Magnetic Resonance in Medicine · doi:10.1002/(sici)1522-2594(199912)42:6<1072::aid-mrm11>3.0.co;2-m · Cited by 583
A Deep Learning Model to Predict a Diagnosis of Alzheimer Disease by Using 18 F-FDG PET of the Brain
Ding, Y., Sohn, J. H., Kawczynski, M. G., Trivedi, H., Harnish, R., Jenkins, N. W., Lituiev, D., Copeland, T. P., Aboian, M. S., Mari Aparici, C., et al. (2019) · Radiology · doi:10.1148/radiol.2018180958 · Cited by 577
Predicting response to cancer immunotherapy using noninvasive radiomic biomarkers
Trebeschi, S., Drago, S. G., Birkbak, N. J., Kurilova, I., Cǎlin, A. M., Delli Pizzi, A., Lalezari, F., Lambregts, D. M. J., Rohaan, M. W., Parmar, C., et al. (2019) · Annals of Oncology · doi:10.1093/annonc/mdz108 · Cited by 566
Quantifying tumour heterogeneity in 18F-FDG PET/CT imaging by texture analysis
Chicklore, S., Goh, V., Siddique, M., Roy, A., Marsden, P. K., & Cook, G. J. R. (2013) · European Journal of Nuclear Medicine and Molecular Imaging · doi:10.1007/s00259-012-2247-0 · Cited by 488
Kickingereder, P., Burth, S., Wick, A., Götz, M., Eidel, O., Schlemmer, H.-P., Maier-Hein, K. H., Wick, W., Bendszus, M., Radbruch, A., et al. (2016) · Radiology · doi:10.1148/radiol.2016160845 · Cited by 446
Leijenaar, R. T. H., Carvalho, S., Velazquez, E. R., van Elmpt, W. J. C., Parmar, C., Hoekstra, O. S., Hoekstra, C. J., Boellaard, R., Dekker, A. L. A. J., Gillies, R. J., et al. (2013) · Acta Oncologica · doi:10.3109/0284186x.2013.812798 · Cited by 427
Self-citationLeijenaar, R. T. H., Nalbantov, G., Carvalho, S., van Elmpt, W. J. C., Troost, E. G. C., Boellaard, R., Aerts, H. J. W. L., Gillies, R. J., & Lambin, P. (2015) · Scientific Reports · doi:10.1038/srep11075 · Cited by 426
Self-citationAbdelaziz Ismael, S. A., Mohammed, A., & Hefny, H. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2019.101779 · Cited by 417
Validation of A Method to Compensate Multicenter Effects Affecting CT Radiomics
Orlhac, F., Frouin, F., Nioche, C., Ayache, N., & Buvat, I. (2019) · Radiology · doi:10.1148/radiol.2019182023 · Cited by 411
A Postreconstruction Harmonization Method for Multicenter Radiomic Studies in PET
Orlhac, F., Boughdad, S., Philippe, C., Stalla-Bourdillon, H., Nioche, C., Champion, L., Soussan, M., Frouin, F., Frouin, V., & Buvat, I. (2018) · Journal of Nuclear Medicine · doi:10.2967/jnumed.117.199935 · Cited by 393
Walsh, S. L. F., Calandriello, L., Silva, M., & Sverzellati, N. (2018) · The Lancet Respiratory Medicine · doi:10.1016/s2213-2600(18)30286-8 · Cited by 390
Exploratory Study to Identify Radiomics Classifiers for Lung Cancer Histology
Wu, W., Parmar, C., Grossmann, P., Quackenbush, J., Lambin, P., Bussink, J., Mak, R., & Aerts, H. J. W. L. (2016) · Frontiers in Oncology · doi:10.3389/fonc.2016.00071 · Cited by 378
Self-citationHorvat, N., Veeraraghavan, H., Khan, M., Blazic, I., Zheng, J., Capanu, M., Sala, E., Garcia-Aguilar, J., Gollub, M. J., & Petkovska, I. (2018) · Radiology · doi:10.1148/radiol.2018172300 · Cited by 355
Tixier, F., Hatt, M., Le Rest, C. C., Le Pogam, A., Corcos, L., & Visvikis, D. (2012) · Journal of Nuclear Medicine · doi:10.2967/jnumed.111.099127 · Cited by 318
Jiang, J., Hu, Y.-C., Liu, C.-J., Halpenny, D., Hellmann, M. D., Deasy, J. O., Mageras, G., & Veeraraghavan, H. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2857800 · Cited by 268
Peerlings, J., Woodruff, H. C., Winfield, J. M., Ibrahim, A., Van Beers, B. E., Heerschap, A., Jackson, A., Wildberger, J. E., Mottaghy, F. M., DeSouza, N. M., et al. (2019) · Scientific Reports · doi:10.1038/s41598-019-41344-5 · Cited by 266
Self-citationRadiomic MRI Phenotyping of Glioblastoma: Improving Survival Prediction
Bae, S., Choi, Y. S., Ahn, S. S., Chang, J. H., Kang, S.-G., Kim, E. H., Kim, S. H., & Lee, S.-K. (2018) · Radiology · doi:10.1148/radiol.2018180200 · Cited by 249
Sibille, L., Seifert, R., Avramovic, N., Vehren, T., Spottiswoode, B., Zuehlsdorff, S., & Schäfers, M. (2020) · Radiology · doi:10.1148/radiol.2019191114 · Cited by 219
Hatt, M., Tixier, F., Cheze Le Rest, C., Pradier, O., & Visvikis, D. (2013) · European Journal of Nuclear Medicine and Molecular Imaging · doi:10.1007/s00259-013-2486-8 · Cited by 208
Lou, B., Doken, S., Zhuang, T., Wingerter, D., Gidwani, M., Mistry, N., Ladic, L., Kamen, A., & Abazeed, M. E. (2019) · The Lancet Digital Health · doi:10.1016/s2589-7500(19)30058-5 · Cited by 206
Shiri, I., Rahmim, A., Ghaffarian, P., Geramifar, P., Abdollahi, H., & Bitarafan-Rajabi, A. (2017) · European Radiology · doi:10.1007/s00330-017-4859-z · Cited by 204
Influence of inter-observer delineation variability on radiomics stability in different tumor sites
Pavic, M., Bogowicz, M., Würms, X., Glatz, S., Finazzi, T., Riesterer, O., Roesch, J., Rudofsky, L., Friess, M., Veit-Haibach, P., et al. (2018) · Acta Oncologica · doi:10.1080/0284186x.2018.1445283 · Cited by 203
Test–Retest Data for Radiomics Feature Stability Analysis: Generalizable or Study-Specific?
van Timmeren, J. E., Leijenaar, R. T. H., van Elmpt, W., Wang, J., Zhang, Z., Dekker, A., & Lambin, P. (2016) · Tomography · doi:10.18383/j.tom.2016.00208 · Cited by 191
Self-citationPredicting Response to Neoadjuvant Chemotherapy with PET Imaging Using Convolutional Neural Networks
Ypsilantis, P.-P., Siddique, M., Sohn, H.-M., Davies, A., Cook, G., Goh, V., & Montana, G. (2015) · PLOS ONE · doi:10.1371/journal.pone.0137036 · Cited by 185
Introduction to Biomedical Imaging
Webb, A., & Kagadis, G. C. (2003) · Medical Physics · doi:10.1118/1.1589017 · Cited by 182
Kirienko, M., Cozzi, L., Antunovic, L., Lozza, L., Fogliata, A., Voulaz, E., Rossi, A., Chiti, A., & Sollini, M. (2018) · European Journal of Nuclear Medicine and Molecular Imaging · doi:10.1007/s00259-017-3837-7 · Cited by 179
Wu, M., Tan, H., Gao, F., Hai, J., Ning, P., Chen, J., Zhu, S., Wang, M., Dou, S., & Shi, D. (2019) · European Radiology · doi:10.1007/s00330-018-5787-2 · Cited by 178
Challenges and Promises of PET Radiomics
Cook, G. J. R., Azad, G., Owczarczyk, K., Siddique, M., & Goh, V. (2018) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2017.12.268 · Cited by 167
Repeatability and reproducibility of MRI-based radiomic features in cervical cancer
Fiset, S., Welch, M. L., Weiss, J., Pintilie, M., Conway, J. L., Milosevic, M., Fyles, A., Traverso, A., Jaffray, D., Metser, U., et al. (2019) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2019.03.001 · Cited by 167
Data Analysis Strategies in Medical Imaging
Parmar, C., Barry, J. D., Hosny, A., Quackenbush, J., & Aerts, H. J. W. L. (2018) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-18-0385 · Cited by 161
Oikonomou, A., Khalvati, F., Tyrrell, P. N., Haider, M. A., Tarique, U., Jiménez‐Juan, L., Tjong, M. C., Poon, I., Eilaghi, A., Ehrlich, L. E., et al. (2018) · Scientific Reports · doi:10.1038/s41598-018-22357-y · Cited by 160
Decision Support Systems in Oncology
Walsh, S., de Jong, E. E. C., van Timmeren, J. E., Ibrahim, A., Compter, I., Peerlings, J., Sanduleanu, S., Refaee, T., Keek, S., Larue, R. T. H. M., et al. (2019) · JCO Clinical Cancer Informatics · doi:10.1200/cci.18.00001 · Cited by 160
Self-citationAssessing Agreement between Radiomic Features Computed for Multiple CT Imaging Settings
Lu, L., Ehmke, R. C., Schwartz, L. H., & Zhao, B. (2016) · PLOS ONE · doi:10.1371/journal.pone.0166550 · Cited by 159
Radiomics in PET: principles and applications
Cook, G., Siddique, M. M., Taylor, B. P., Yip, C., Chicklore, S., & Goh, V. (2014) · Clinical and Translational Imaging · doi:10.1007/s40336-014-0064-0 · Cited by 144
Hardie, R. C., Rogers, S. K., Wilson, T., & Rogers, A. (2007) · Medical Image Analysis · doi:10.1016/j.media.2007.10.004 · Cited by 135
Altazi, B. A., Zhang, G. G., Fernandez, D. C., Montejo, M. E., Hunt, D., Werner, J., Biagioli, M. C., & Moros, E. G. (2017) · Journal of Applied Clinical Medical Physics · doi:10.1002/acm2.12170 · Cited by 130
Learning from scanners: Bias reduction and feature correction in radiomics
Zhovannik, I., Bussink, J., Traverso, A., Shi, Z., Kalendralis, P., Wee, L., Dekker, A., Fijten, R., & Monshouwer, R. (2019) · Clinical and Translational Radiation Oncology · doi:10.1016/j.ctro.2019.07.003 · Cited by 75
Automatic segmentation of cerebral MR images using artificial neural networks
Alirezaie, J., Jernigan, M. E., & Nahmias, C. (1998) · IEEE Transactions on Nuclear Science · doi:10.1109/23.708336 · Cited by 72
Ardila, D., Kiraly, A. P., Bharadwaj, S., Choi, B., Reicher, J. J., Peng, L. H., Tse, D., Etemadi, M., Ye, W., Corrado, G. S., et al. (2019) · Nature Medicine · doi:10.1038/s41591-019-0536-x · Cited by 69
Radiomics Analysis for Clinical Decision Support in Nuclear Medicine
Ibrahim, A., Vallières, M., Woodruff, H. C., Primakov, S. P., Beheshti, M., Keek, S. A., Refaee, T., Sanduleanu, S., Walsh, S., Morin, O., et al. (2019) · Seminars in Nuclear Medicine · doi:10.1053/j.semnuclmed.2019.06.005 · Cited by 68
Self-citation3-D Convolutional Neural Networks for Glioblastoma SegmentationPreprint
Yi, D., Zhou, M., Chen, Z., & Gevaert, O. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.04534 · Cited by 58
Wang, J., Shen, L., Zhong, H., Zhou, Z., Hu, P., Gan, J., Luo, R., Hu, W., & Zhang, Z. (2019) · Scientific Reports · doi:10.1038/s41598-019-51629-4 · Cited by 55
The Emerging Role of Radiomics in COPD and Lung Cancer
Refaee, T., Wu, G., Ibrahim, A., Halilaj, I., Leijenaar, R. T. H., Rogers, W., Gietema, H. A., Hendriks, L. E. L., Lambin, P., & Woodruff, H. C. (2020) · Respiration · doi:10.1159/000505429 · Cited by 52
Self-citationSimhambhatla, R., Okiah, K., Kuchkula, S., & Slater, R. (2019) · SMU Data Science Review · Cited by 49
Oh, K., Chung, Y., Kim, K. W., Kim, W., & Oh, I.-S. (2020) · Scientific Reports · doi:10.1038/s41598-020-62490-1 · Cited by 14
Cited by
Antoniadi, A. M., Du, Y., Guendouz, Y., Wei, L., Mazo, C., Becker, B. A., & Mooney, C. (2021) · Applied Sciences · doi:10.3390/app11115088 · Cited by 629
Scapicchio, C., Gabelloni, M., Barucci, A., Cioni, D., Saba, L., & Neri, E. (2021) · La radiologia medica · doi:10.1007/s11547-021-01389-x · Cited by 435
A Guide to ComBat Harmonization of Imaging Biomarkers in Multicenter Studies
Orlhac, F., Eertink, J. J., Cottereau, A.-S., Zijlstra, J. M., Thieblemont, C., Meignan, M., Boellaard, R., & Buvat, I. (2022) · Journal of Nuclear Medicine · doi:10.2967/jnumed.121.262464 · Cited by 348
Artificial intelligence assists precision medicine in cancer treatment
Liao, J., Li, X., Gan, Y., Han, S., Rong, P., Wang, W., Li, W., & Zhou, L. (2023) · Frontiers in Oncology · doi:10.3389/fonc.2022.998222 · Cited by 256
Mechanistic study of cancer drug delivery: Current techniques, limitations, and future prospects
Imtiaz, S., Ferdous, U. T., Nizela, A., Hasan, A., Shakoor, A., Zia, A. W., & Uddin, S. (2025) · European Journal of Medicinal Chemistry · doi:10.1016/j.ejmech.2025.117535 · Cited by 119
Metadata
- Authors
- Ibrahim, A., Primakov, S., Beuque, M., Woodruff, H. C., Halilaj, I., Wu, G., Refaee, T., Granzier, R., Widaatalla, Y., Hustinx, R., Mottaghy, F. M., & Lambin, P.
- Venue
- Methods
- Publisher
- Elsevier BV
- Published
- 2021-04
- Volume
- 188
- Pages
- 20-29
- ISSN
- 1046-2023 (ISSN-L)
- OpenAlex
- W3032938107
- Cited by
- 265
- References
- 69
- FWCI
- 14.46
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.