The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Radiomics of CT Features May Be Nonreproducible and Redundant: Influence of CT Acquisition Parameters
Open accessAbstract
Purpose To identify the reproducible and nonredundant radiomics features (RFs) for computed tomography (CT). Materials and Methods Two phantoms were used to test RF reproducibility by using test-retest analysis, by changing the CT acquisition parameters (hereafter, intra-CT analysis), and by comparing five different scanners with the same CT parameters (hereafter, inter-CT analysis). Reproducible RFs were selected by using the concordance correlation coefficient (as a measure of the agreement between variables) and the coefficient of variation (defined as the ratio of the standard deviation to the mean). Redundant features were grouped by using hierarchical cluster analysis. Results A total of 177 RFs including intensity, shape, and texture features were evaluated. The test-retest analysis showed that 91% (161 of 177) of the RFs were reproducible according to concordance correlation coefficient. Reproducibility of intra-CT RFs, based on coefficient of variation, ranged from 89.3% (151 of 177) to 43.1% (76 of 177) where the pitch factor and the reconstruction kernel were modified, respectively. Reproducibility of inter-CT RFs, based on coefficient of variation, also showed large material differences, from 85.3% (151 of 177; wood) to only 15.8% (28 of 177; polyurethane). Ten clusters were identified after the hierarchical cluster analysis and one RF per cluster was chosen as representative. Conclusion Many RFs were redundant and nonreproducible. If all the CT parameters are fixed except field of view, tube voltage, and milliamperage, then the information provided by the analyzed RFs can be summarized in only 10 RFs (each representing a cluster) because of redundancy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Radiomics: Images Are More than Pictures, They Are Data
Gillies, R. J., Kinahan, P. E., & Hricak, H. (2016) · Radiology · doi:10.1148/radiol.2015151169 · Cited by 8,421
Radiomics: extracting more information from medical images using advanced feature analysis
Lambin, P., Rios-Velazquez, E., Leijenaar, R., Carvalho, S., van Stiphout, R. G. P. M., Granton, P., Zegers, C. M. L., Gillies, R., Boellard, R., Dekker, A., et al. (2012) · European Journal of Cancer · doi:10.1016/j.ejca.2011.11.036 · Cited by 6,084
Radiomics: the process and the challenges
Kumar, V., Gu, Y., Basu, S., Berglund, A., Eschrich, S. A., Schabath, M. B., Forster, K., Aerts, H. J. W. L., Dekker, A., Fenstermacher, D., et al. (2012) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2012.06.010 · Cited by 2,258
Applications and limitations of radiomics
Yip, S. S. F., & Aerts, H. J. W. L. (2016) · Physics in Medicine and Biology · doi:10.1088/0031-9155/61/13/r150 · Cited by 1,210
State of the Art: Iterative CT Reconstruction Techniques
Geyer, L. L., Schoepf, U. J., Meinel, F. G., Nance, J. W., Bastarrika, G., Leipsic, J. A., Paul, N. S., Rengo, M., Laghi, A., & De Cecco, C. N. (2015) · Radiology · doi:10.1148/radiol.2015132766 · Cited by 704
Measuring Computed Tomography Scanner Variability of Radiomics Features
Mackin, D., Fave, X., Zhang, L., Fried, D., Yang, J., Taylor, B., Rodriguez-Rivera, E., Dodge, C., Jones, A. K., & Court, L. (2015) · Investigative Radiology · doi:10.1097/rli.0000000000000180 · Cited by 651
Intrinsic dependencies of CT radiomic features on voxel size and number of gray levels
Shafiq‐ul‐Hassan, M., Zhang, G. G., Latifi, K., Ullah, G., Hunt, D. C., Balagurunathan, Y., Abdalah, M. A., Schabath, M. B., Goldgof, D. G., Mackin, D., et al. (2017) · Medical Physics · doi:10.1002/mp.12123 · Cited by 585
Quantifying tumour heterogeneity in 18F-FDG PET/CT imaging by texture analysis
Chicklore, S., Goh, V., Siddique, M., Roy, A., Marsden, P. K., & Cook, G. J. R. (2013) · European Journal of Nuclear Medicine and Molecular Imaging · doi:10.1007/s00259-012-2247-0 · Cited by 488
Characterization of PET/CT images using texture analysis: the past, the present… any future?
Hatt, M., Tixier, F., Pierce, L., Kinahan, P. E., Le Rest, C. C., & Visvikis, D. (2017) · European Journal of Nuclear Medicine and Molecular Imaging · doi:10.1007/s00259-016-3427-0 · Cited by 475
Radiomic feature clusters and Prognostic Signatures specific for Lung and Head & Neck cancer
Parmar, C., Leijenaar, R. T. H., Grossmann, P., Rios Velazquez, E., Bussink, J., Rietveld, D., Rietbergen, M. M., Haibe-Kains, B., Lambin, P., & Aerts, H. J. W. L. (2015) · Scientific Reports · doi:10.1038/srep11044 · Cited by 434
Leijenaar, R. T. H., Carvalho, S., Velazquez, E. R., van Elmpt, W. J. C., Parmar, C., Hoekstra, O. S., Hoekstra, C. J., Boellaard, R., Dekker, A. L. A. J., Gillies, R. J., et al. (2013) · Acta Oncologica · doi:10.3109/0284186x.2013.812798 · Cited by 427
Orlhac, F., Soussan, M., Maisonobe, J.-A., Garcia, C. A., Vanderlinden, B., & Buvat, I. (2014) · Journal of Nuclear Medicine · doi:10.2967/jnumed.113.129858 · Cited by 356
ibex: An open infrastructure software platform to facilitate collaborative work in radiomics
Zhang, L., Fried, D. V., Fave, X. J., Hunter, L. A., Yang, J., & Court, L. E. (2015) · Medical Physics · doi:10.1118/1.4908210 · Cited by 316
Reproducibility and Prognosis of Quantitative Features Extracted from CT Images
Balagurunathan, Y., Gu, Y., Wang, H., Kumar, V., Grove, O., Hawkins, S., Kim, J., Goldgof, D. B., Hall, L. O., Gatenby, R. A., et al. (2014) · Translational Oncology · doi:10.1593/tlo.13844 · Cited by 306
Kessler, L. G., Barnhart, H. X., Buckler, A. J., Choudhury, K. R., Kondratovich, M. V., Toledano, A., Guimaraes, A. R., Filice, R., Zhang, Z., Sullivan, D. C., et al. (2015) · Statistical Methods in Medical Research · doi:10.1177/0962280214537333 · Cited by 293
Test–Retest Reproducibility Analysis of Lung CT Image Features
Balagurunathan, Y., Kumar, V., Gu, Y., Kim, J., Wang, H., Liu, Y., Goldgof, D. B., Hall, L. O., Korn, R., Zhao, B., et al. (2014) · Journal of Digital Imaging · doi:10.1007/s10278-014-9716-x · Cited by 259
CT Radiation Dose and Iterative Reconstruction Techniques
Padole, A., Ali Khawaja, R. D., Kalra, M. K., & Singh, S. (2015) · American Journal of Roentgenology · doi:10.2214/ajr.14.13241 · Cited by 247
Fried, D. V., Tucker, S. L., Zhou, S., Liao, Z., Mawlawi, O., Ibbott, G., & Court, L. E. (2014) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2014.07.020 · Cited by 213
Harmonizing the pixel size in retrospective computed tomography radiomics studies
Mackin, D., Fave, X., Zhang, L., Yang, J., Jones, A. K., Ng, C. S., & Court, L. (2017) · PLOS ONE · doi:10.1371/journal.pone.0178524 · Cited by 165
Diagnostic performance of texture analysis on MRI in grading cerebral gliomas
Skogen, K., Schulz, A., Dormagen, J. B., Ganeshan, B., Helseth, E., & Server, A. (2016) · European Journal of Radiology · doi:10.1016/j.ejrad.2016.01.013 · Cited by 163
Radiomic analysis reveals DCE-MRI features for prediction of molecular subtypes of breast cancer
Fan, M., Li, H., Wang, S., Zheng, B., Zhang, J., & Li, L. (2017) · PLoS ONE · doi:10.1371/journal.pone.0171683 · Cited by 160
Assessing Agreement between Radiomic Features Computed for Multiple CT Imaging Settings
Lu, L., Ehmke, R. C., Schwartz, L. H., & Zhao, B. (2016) · PLOS ONE · doi:10.1371/journal.pone.0166550 · Cited by 159
PET Radiomics in NSCLC: state of the art and a proposal for harmonization of methodology
Sollini, M., Cozzi, L., Antunovic, L., Chiti, A., & Kirienko, M. (2017) · Scientific Reports · doi:10.1038/s41598-017-00426-y · Cited by 158
Kim, H., Park, C. M., Lee, M., Park, S. J., Song, Y., Lee, J. H., Hwang, E. J., & Goo, J. M. (2016) · PLoS ONE · doi:10.1371/journal.pone.0164924 · Cited by 143
Hunter, L. A., Krafft, S. P., Stingo, F. C., Choi, H., Martel, M. K., Kry, S. F., & Court, L. E. (2013) · Medical Physics · doi:10.1118/1.4829514 · Cited by 130
Bogowicz, M., Leijenaar, R. T. H., Tanadini‐Lang, S., Riesterer, O., Pruschy, M. N., Studer, G., Unkelbach, J., Gückenberger, M., Konukoğlu, E., & Lambin, P. (2017) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2017.10.023 · Cited by 115
Texture analysis for the assessment of structural changes in parotid glands induced by radiotherapy
Scalco, E., Fiorino, C., Cattaneo, G. M., Sanguineti, G., & Rizzo, G. (2013) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2013.09.019 · Cited by 82
4DCT imaging to assess radiomics feature stability: An investigation for thoracic cancers
Larue, R. T. H. M., Voorde, L. V. D., van Timmeren, J. E., Leijenaar, R. T. H., Berbée, M., Sosef, M. N., Schreurs, W. M. J., van Elmpt, W., & Lambin, P. (2017) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2017.07.023 · Cited by 79
Rao, A. U. K., Rao, G., Gutman, D. A., Flanders, A. E., Hwang, S. N., Rubin, D. L., Colen, R. R., Zinn, P. O., Jain, R., Wintermark, M., et al. (2015) · Journal of neurosurgery · doi:10.3171/2015.4.jns142732 · Cited by 52
Oliver, J. A., Budzevich, M. M., Hunt, D., Moros, E. G., Latifi, K., Dilling, T. J., Feygelman, V. M., & Zhang, G. G. (2016) · Technology in Cancer Research & Treatment · doi:10.1177/1533034616661852 · Cited by 28
Dealing with Uncertainty in CT Images
Fletcher, J. G., Leng, S., Yu, L., & McCollough, C. H. (2016) · Radiology · doi:10.1148/radiol.2016152771 · Cited by 27
NSCLC tumor shrinkage prediction using quantitative image features
Hunter, L. A., Chen, Y. P., Zhang, L., Matney, J. E., Choi, H., Kry, S. F., Martel, M. K., Stingo, F. C., Liao, Z. X., Gomez, D. R., et al. (2015) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2015.11.004 · Cited by 25
Cited by
Zwanenburg, A., Vallières, M., Abdalah, M. A., Aerts, H. J. W. L., Andrearczyk, V., Apte, A., Ashrafinia, S., Bakas, S., Beukinga, R. J., Boellaard, R., et al. (2020) · Radiology · doi:10.1148/radiol.2020191145 · Cited by 4,177
“Despite the growing clinical interest in radiomics, published studies have been difficult to reproduce and validate (5,9,12–14).”
Radiomics in medical imaging—“how-to” guide and critical reflection
van Timmeren, J. E., Cester, D., Tanadini-Lang, S., Alkadhi, H., & Baessler, B. (2020) · Insights into Imaging · doi:10.1186/s13244-020-00887-2 · Cited by 1,316
AI applications to medical images: From machine learning to deep learning
Castiglioni, I., Rundo, L., Codari, M., Di Leo, G., Salvatore, C., Interlenghi, M., Gallivanone, F., Cozzi, A., D'Amico, N. C., & Sardanelli, F. (2021) · Physica Medica · doi:10.1016/j.ejmp.2021.02.006 · Cited by 710
Validation of A Method to Compensate Multicenter Effects Affecting CT Radiomics
Orlhac, F., Frouin, F., Nioche, C., Ayache, N., & Buvat, I. (2019) · Radiology · doi:10.1148/radiol.2019182023 · Cited by 411
Park, J. E., Park, S. Y., Kim, H. J., & Kim, H. S. (2019) · Korean Journal of Radiology · doi:10.3348/kjr.2018.0070 · Cited by 388
Metadata
- Authors
- Berenguer, R., Pastor-Juan, M. D. R., Canales-Vázquez, J., Castro-García, M., Villas, M. V., Mansilla Legorburo, F., & Sabater, S.
- Venue
- Radiology
- Published
- 2018-08
- Volume
- 288
- Issue
- 2
- Pages
- 407-415
- ISSN
- 0033-8419 (ISSN-L)
- 1527-1315
- OpenAlex
- W2801894005
- Cited by
- 622
- References
- 32
- FWCI
- 43.78
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.