The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Radiomics in Oncology: A Practical Guide
Open accessAbstract
Radiomics refers to the extraction of mineable data from medical imaging and has been applied within oncology to improve diagnosis, prognostication, and clinical decision support, with the goal of delivering precision medicine. The authors provide a practical approach for successfully implementing a radiomic workflow from planning and conceptualization through manuscript writing. Applications in oncology typically are either classification tasks that involve computing the probability of a sample belonging to a category, such as benign versus malignant, or prediction of clinical events with a time-to-event analysis, such as overall survival. The radiomic workflow is multidisciplinary, involving radiologists and data and imaging scientists, and follows a stepwise process involving tumor segmentation, image preprocessing, feature extraction, model development, and validation. Images are curated and processed before segmentation, which can be performed on tumors, tumor subregions, or peritumoral zones. Extracted features typically describe the distribution of signal intensities and spatial relationship of pixels within a region of interest. To improve model performance and reduce overfitting, redundant and nonreproducible features are removed. Validation is essential to estimate model performance in new data and can be performed iteratively on samples of the dataset (cross-validation) or on a separate hold-out dataset by using internal or external data. A variety of noncommercial and commercial radiomic software applications can be used. Guidelines and artificial intelligence checklists are useful when planning and writing up radiomic studies. Although interest in the field continues to grow, radiologists should be familiar with potential pitfalls to ensure that meaningful conclusions can be drawn. Online supplemental material is available for this article. Published under a CC BY 4.0 license.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
Textural Features for Image Classification
Haralick, R. M., Shanmugam, K., & Dinstein, I. (1973) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1973.4309314 · Cited by 22,886
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
The control of the false discovery rate in multiple testing under dependency
Benjamini, Y., & Yekutieli, D. (2001) · The Annals of Statistics · doi:10.1214/aos/1013699998 · Cited by 10,490
A simulation study of the number of events per variable in logistic regression analysis
Peduzzi, P., Concato, J., Kemper, E., Holford, T. R., & Feinstein, A. R. (1996) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(96)00236-3 · Cited by 9,655
Radiomics: Images Are More than Pictures, They Are Data
Gillies, R. J., Kinahan, P. E., & Hricak, H. (2016) · Radiology · doi:10.1148/radiol.2015151169 · Cited by 8,421
Nonlinear Component Analysis as a Kernel Eigenvalue Problem
Schölkopf, B., Smola, A., & Müller, K.-R. (1998) · Neural Computation · doi:10.1162/089976698300017467 · Cited by 8,084
Radiomics: extracting more information from medical images using advanced feature analysis
Lambin, P., Rios-Velazquez, E., Leijenaar, R., Carvalho, S., van Stiphout, R. G. P. M., Granton, P., Zegers, C. M. L., Gillies, R., Boellard, R., Dekker, A., et al. (2012) · European Journal of Cancer · doi:10.1016/j.ejca.2011.11.036 · Cited by 6,084
Radiomics: the bridge between medical imaging and personalized medicine
Lambin, P., Leijenaar, R. T. H., Deist, T. M., Peerlings, J., de Jong, E. E. C., van Timmeren, J., Sanduleanu, S., Larue, R. T. H. M., Even, A. J. G., Jochems, A., et al. (2017) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2017.141 · Cited by 5,688
Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach
Aerts, H. J. W. L., Velazquez, E. R., Leijenaar, R. T. H., Parmar, C., Grossmann, P., Carvalho, S., Bussink, J., Monshouwer, R., Haibe-Kains, B., Rietveld, D., et al. (2014) · Nature Communications · doi:10.1038/ncomms5006 · Cited by 5,132
Zwanenburg, A., Vallières, M., Abdalah, M. A., Aerts, H. J. W. L., Andrearczyk, V., Apte, A., Ashrafinia, S., Bakas, S., Beukinga, R. J., Boellaard, R., et al. (2020) · Radiology · doi:10.1148/radiol.2020191145 · Cited by 4,177
Tumour heterogeneity and resistance to cancer therapies
Dagogo-Jack, I., & Shaw, A. T. (2018) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2017.166 · Cited by 3,846 · cited 1×
“For example, radiomic features may reflect temporal and spatial heterogeneity (Fig 2), which is known to be a key determinant of tumor behavior and resistance to therapy (10).”
BackgroundSample size of 12 per group rule of thumb for a pilot study
Julious, S. A. (2005) · Pharmaceutical Statistics · doi:10.1002/pst.185 · Cited by 3,068
The rician distribution of noisy mri data
Gudbjartsson, H., & Patz, S. (1995) · Magnetic Resonance in Medicine · doi:10.1002/mrm.1910340618 · Cited by 2,494
Radiomics: the process and the challenges
Kumar, V., Gu, Y., Basu, S., Berglund, A., Eschrich, S. A., Schabath, M. B., Forster, K., Aerts, H. J. W. L., Dekker, A., Fenstermacher, D., et al. (2012) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2012.06.010 · Cited by 2,258
Peduzzi, P., Concato, J., Feinstein, A. R., & Holford, T. R. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(95)00048-8 · Cited by 2,154 · cited 1×
“This can vary between studies but is a useful guide when embarking on a new study (11,12).”
BackgroundTexture analysis using gray level run lengths
Galloway, M. M. (1975) · Computer Graphics and Image Processing · doi:10.1016/s0146-664x(75)80008-6 · Cited by 2,141
Checklist for Artificial Intelligence in Medical Imaging (CLAIM): a guide for authors and reviewers
Mongan, J., Moy, L., & Kahn, C. E. (2020) · Radiology: Artificial Intelligence · doi:10.1148/ryai.2020200029 · Cited by 1,443 · cited 1×
“To aid authors and to provide a framework for manuscript writing, there are various radiomic- and artificial intelligence–specific checklists, reporting guides, and radiomic quality scores that can be referred to (4,21,48,49), in addition to artificial intelligence extensions of familiar guidelines such as TRIPOD (Tra…”
BackgroundLiu, X., Cruz Rivera, S., Moher, D., Calvert, M. J., Denniston, A. K., The SPIRIT-AI and CONSORT-AI Working Group, SPIRIT-AI and CONSORT-AI Steering Group, Chan, A.-W., Darzi, A., Holmes, C., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-1034-x · Cited by 1,421
Survey: interpolation methods in medical image processing
Lehmann, T. M., Gonner, C., & Spitzer, K. (1999) · IEEE Transactions on Medical Imaging · doi:10.1109/42.816070 · Cited by 1,340
Textural features corresponding to textural properties
Amadasun, M., & King, R. (1989) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/21.44046 · Cited by 1,148
A Review of Methods for Correction of Intensity Inhomogeneity in MRI
Vovk, U., Pernus, F., & Likar, B. (2007) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2006.891486 · Cited by 851
Concato, J., Peduzzi, P., Holford, T. R., & Feinstein, A. R. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(95)00510-2 · Cited by 797
Robust Radiomics Feature Quantification Using Semiautomatic Volumetric Segmentation
Parmar, C., Rios Velazquez, E., Leijenaar, R., Jermoumi, M., Carvalho, S., Mak, R. H., Mitra, S., Shankar, B. U., Kikinis, R., Haibe-Kains, B., et al. (2014) · PLoS ONE · doi:10.1371/journal.pone.0102107 · Cited by 611
Intrinsic dependencies of CT radiomic features on voxel size and number of gray levels
Shafiq‐ul‐Hassan, M., Zhang, G. G., Latifi, K., Ullah, G., Hunt, D. C., Balagurunathan, Y., Abdalah, M. A., Schabath, M. B., Goldgof, D. G., Mackin, D., et al. (2017) · Medical Physics · doi:10.1002/mp.12123 · Cited by 585
The Biological Meaning of Radiomic Features
Tomaszewski, M. R., & Gillies, R. J. (2021) · Radiology · doi:10.1148/radiol.2021202553 · Cited by 549
Rivera, S. C., Liu, X., Chan, A.-W., Denniston, A. K., & Calvert, M. J. (2020) · BMJ · doi:10.1136/bmj.m3210 · Cited by 463
Neighboring gray level dependence matrix for texture classification
Sun, C., & Wee, W. G. (1983) · Computer Vision, Graphics, and Image Processing · doi:10.1016/0734-189x(83)90032-4 · Cited by 408
Quantifying tumour heterogeneity with CT
Ganeshan, B., & Miles, K. A. (2013) · Cancer Imaging · doi:10.1102/1470-7330.2013.0015 · Cited by 395
Langlotz, C. P., Allen, B., Erickson, B. J., Kalpathy-Cramer, J., Bigelow, K., Cook, T. S., Flanders, A. E., Lungren, M. P., Mendelson, D. S., Rudie, J. D., et al. (2019) · Radiology · doi:10.1148/radiol.2019190613 · Cited by 368
Larue, R. T. H. M., Defraene, G., De Ruysscher, D., Lambin, P., & van Elmpt, W. (2017) · The British Journal of Radiology · doi:10.1259/bjr.20160665 · Cited by 363
Bluemke, D. A., Moy, L., Bredella, M. A., Ertl-Wagner, B. B., Fowler, K. J., Goh, V. J., Halpern, E. F., Hess, C. P., Schiebler, M. L., & Weiss, C. R. (2020) · Radiology · doi:10.1148/radiol.2019192515 · Cited by 343
The Biological Meaning of Radiomic Features
Tomaszewski, M. R., & Gillies, R. J. (2021) · Radiology · doi:10.1148/radiol.2021219005 · Cited by 327
Advanced Statistical Matrices for Texture Characterization: Application to Cell Classification
Thibault, G., Angulo, J., & Meyer, F. (2014) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2013.2284600 · Cited by 284
Park, J. E., Kim, D., Kim, H. S., Park, S. Y., Kim, J. Y., Cho, S. J., Shin, J. H., & Kim, J. H. (2020) · European Radiology · doi:10.1007/s00330-019-06360-z · Cited by 282
Larue, R. T. H. M., van Timmeren, J. E., de Jong, E. E. C., Feliciani, G., Leijenaar, R. T. H., Schreurs, W. M. J., Sosef, M. N., Raat, F. H. P. J., van der Zande, F. H. R., Das, M., et al. (2017) · Acta Oncologica · doi:10.1080/0284186x.2017.1351624 · Cited by 262
Assessing robustness of radiomic features by image perturbation
Zwanenburg, A., Leger, S., Agolli, L., Pilz, K., Troost, E. G. C., Richter, C., & Löck, S. (2019) · Scientific Reports · doi:10.1038/s41598-018-36938-4 · Cited by 242
Quantitative imaging of cancer in the postgenomic era: Radio(geno)mics, deep learning, and habitats
Napel, S., Mu, W., Jardim‐Perassi, B. V., Aerts, H. J. W. L., & Gillies, R. J. (2018) · Cancer · doi:10.1002/cncr.31630 · Cited by 229
Fornacon-Wood, I., Mistry, H., Ackermann, C. J., Blackhall, F., McPartlin, A., Faivre-Finn, C., Price, G. J., & O’Connor, J. P. B. (2020) · European Radiology · doi:10.1007/s00330-020-06957-9 · Cited by 198
Self-citationHow to develop a meaningful radiomic signature for clinical use in oncologic patients
Papanikolaou, N., Matos, C., & Koh, D. M. (2020) · Cancer Imaging · doi:10.1186/s40644-020-00311-4 · Cited by 186
Self-citationA decade of radiomics research: are images really data or just patterns in the noise?
dos Santos, D. P., Dietzel, M., & Baeßler, B. (2020) · European Radiology · doi:10.1007/s00330-020-07108-w · Cited by 138
Rahman, M. S., Ambler, G., Choodari‐Oskooei, B., & Omar, R. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0336-2 · Cited by 95
Yip, S. S. F., McCall, K. C., Aristophanous, M., Chen, A. B., Aerts, H. J. W. L., & Berbeco, R. (2014) · PLoS ONE · doi:10.1371/journal.pone.0115510 · Cited by 71
DataSHIELD: An Ethically Robust Solution to Multiple-Site Individual-Level Data Analysis
Budin‐Ljøsne, I., Burton, P., Isaeva, J., Gaye, A., Turner, A. J., Murtagh, M. J., Wallace, S., Ferretti, V., & Harris, J. R. (2014) · Public Health Genomics · doi:10.1159/000368959 · Cited by 44
Du, Q., Baine, M. J., Bavitz, K., McAllister, J., Liang, X., Yu, H., Ryckman, J. M., Yu, L., Jiang, H., Zhou, S., et al. (2019) · PLoS ONE · doi:10.1371/journal.pone.0216480 · Cited by 38
Doran, S., Kumar, S., Orton, M. R., d’Arcy, J. A., Kwaks, F., O'Flynn, E. A. M., Ahmed, Z., Downey, K., Dowsett, M., Turner, N. C., et al. (2021) · Cancer Imaging · doi:10.1186/s40644-021-00406-6 · Cited by 24
Self-citationRethinking the role of clinical imaging
O’Connor, J. P. B. (2017) · eLife · doi:10.7554/elife.30563 · Cited by 20
Self-citationTibshirani (1997) · doi:10.1002/(sici)1097-0258(19970228)16:4<385::aid-sim380>3.0.co;2-3
Cited by
Using artificial intelligence in academic writing and research: An essential productivity tool
Khalifa, M., & Albadawy, M. (2024) · Computer Methods and Programs in Biomedicine Update · doi:10.1016/j.cmpbup.2024.100145 · Cited by 580
Kocak, B., Baessler, B., Bakas, S., Cuocolo, R., Fedorov, A., Maier-Hein, L., Mercaldo, N., Müller, H., Orlhac, F., Pinto dos Santos, D., et al. (2023) · Insights into Imaging · doi:10.1186/s13244-023-01415-8 · Cited by 471
Kocak, B., Akinci D’Antonoli, T., Mercaldo, N., Alberich-Bayarri, A., Baessler, B., Ambrosini, I., Andreychenko, A. E., Bakas, S., Beets-Tan, R. G. H., Bressem, K., et al. (2024) · Insights into Imaging · doi:10.1186/s13244-023-01572-w · Cited by 302
Self-citationOncologic Imaging and Radiomics: A Walkthrough Review of Methodological Challenges
Stanzione, A., Cuocolo, R., Ugga, L., Verde, F., Romeo, V., Brunetti, A., & Maurea, S. (2022) · Cancers · doi:10.3390/cancers14194871 · Cited by 64
Metadata
- Authors
- Shur, J. D., Doran, S. J., Kumar, S., ap Dafydd, D., Downey, K., O’Connor, J. P. B., Papanikolaou, N., Messiou, C., Koh, D.-M., & Orton, M. R.
- Venue
- RadioGraphics
- Published
- 2021-10
- Volume
- 41
- Issue
- 6
- Pages
- 1717-1732
- ISSN
- 0271-5333 (ISSN-L)
- 1527-1323
- OpenAlex
- W3204030525
- Cited by
- 378
- References
- 50
- FWCI
- 28.42
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.