The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Reproducibility of radiomics for deciphering tumor phenotype with imaging
Open accessAbstract
Radiomics (radiogenomics) characterizes tumor phenotypes based on quantitative image features derived from routine radiologic imaging to improve cancer diagnosis, prognosis, prediction and response to therapy. Although radiomic features must be reproducible to qualify as biomarkers for clinical care, little is known about how routine imaging acquisition techniques/parameters affect reproducibility. To begin to fill this knowledge gap, we assessed the reproducibility of a comprehensive, commonly-used set of radiomic features using a unique, same-day repeat computed tomography data set from lung cancer patients. Each scan was reconstructed at 6 imaging settings, varying slice thicknesses (1.25 mm, 2.5 mm and 5 mm) and reconstruction algorithms (sharp, smooth). Reproducibility was assessed using the repeat scans reconstructed at identical imaging setting (6 settings in total). In separate analyses, we explored differences in radiomic features due to different imaging parameters by assessing the agreement of these radiomic features extracted from the repeat scans reconstructed at the same slice thickness but different algorithms (3 settings in total). Our data suggest that radiomic features are reproducible over a wide range of imaging settings. However, smooth and sharp reconstruction algorithms should not be used interchangeably. These findings will raise awareness of the importance of properly setting imaging acquisition parameters in radiomics/radiogenomics research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
A concordance correlation coefficient to evaluate reproducibility.
Lin, L. I.-K. (1989) · Biometrics · doi:10.2307/2532051 · Cited by 8,785
Radiomics: extracting more information from medical images using advanced feature analysis
Lambin, P., Rios-Velazquez, E., Leijenaar, R., Carvalho, S., van Stiphout, R. G. P. M., Granton, P., Zegers, C. M. L., Gillies, R., Boellard, R., Dekker, A., et al. (2012) · European Journal of Cancer · doi:10.1016/j.ejca.2011.11.036 · Cited by 6,084
Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach
Aerts, H. J. W. L., Velazquez, E. R., Leijenaar, R. T. H., Parmar, C., Grossmann, P., Carvalho, S., Bussink, J., Monshouwer, R., Haibe-Kains, B., Rietveld, D., et al. (2014) · Nature Communications · doi:10.1038/ncomms5006 · Cited by 5,132
Radiomics: the process and the challenges
Kumar, V., Gu, Y., Basu, S., Berglund, A., Eschrich, S. A., Schabath, M. B., Forster, K., Aerts, H. J. W. L., Dekker, A., Fenstermacher, D., et al. (2012) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2012.06.010 · Cited by 2,258
Dixon, W. J. (1953) · Biometrics · doi:10.2307/3001634 · Cited by 868
Tixier, F., Le Rest, C. C., Hatt, M., Albarghach, N., Pradier, O., Metges, J.-P., Corcos, L., & Visvikis, D. (2011) · Journal of Nuclear Medicine · doi:10.2967/jnumed.110.082404 · Cited by 696
CT-based radiomic signature predicts distant metastasis in lung adenocarcinoma
Coroller, T. P., Grossmann, P., Hou, Y., Rios Velazquez, E., Leijenaar, R. T. H., Hermann, G., Lambin, P., Haibe-Kains, B., Mak, R. H., & Aerts, H. J. W. L. (2015) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2015.02.015 · Cited by 695
Robust Radiomics Feature Quantification Using Semiautomatic Volumetric Segmentation
Parmar, C., Rios Velazquez, E., Leijenaar, R., Jermoumi, M., Carvalho, S., Mak, R. H., Mitra, S., Shankar, B. U., Kikinis, R., Haibe-Kains, B., et al. (2014) · PLoS ONE · doi:10.1371/journal.pone.0102107 · Cited by 611
Leijenaar, R. T. H., Carvalho, S., Velazquez, E. R., van Elmpt, W. J. C., Parmar, C., Hoekstra, O. S., Hoekstra, C. J., Boellaard, R., Dekker, A. L. A. J., Gillies, R. J., et al. (2013) · Acta Oncologica · doi:10.3109/0284186x.2013.812798 · Cited by 427
Gevaert, O., Xu, J., Hoang, C. D., Leung, A. N., Xu, Y., Quon, A., Rubin, D. L., Napel, S., & Plevritis, S. K. (2012) · Radiology · doi:10.1148/radiol.12111607 · Cited by 398
Ng, F., Kozarski, R., Ganeshan, B., & Goh, V. (2013) · European Journal of Radiology · doi:10.1016/j.ejrad.2012.10.023 · Cited by 362
Galavis, P. E., Hollensen, C., Jallow, N., Paliwal, B., & Jeraj, R. (2010) · Acta Oncologica · doi:10.3109/0284186x.2010.498437 · Cited by 344
Zhao, B., James, L. P., Moskowitz, C. S., Guo, P., Ginsberg, M. S., Lefkowitz, R. A., Qin, Y., Riely, G. J., Kris, M. G., & Schwartz, L. H. (2009) · Radiology · doi:10.1148/radiol.2522081593 · Cited by 339
Self-citationKarlo, C. A., Di Paolo, P. L., Chaim, J., Hakimi, A. A., Ostrovnaya, I., Russo, P., Hricak, H., Motzer, R., Hsieh, J. J., & Akin, O. (2014) · Radiology · doi:10.1148/radiol.13130663 · Cited by 270
Radiogenomic Mapping of Edema/Cellular Invasion MRI-Phenotypes in Glioblastoma Multiforme
Zinn, P. O., Majadan, B., Sathyan, P., Singh, S. K., Majumder, S., Jolesz, F. A., & Colen, R. R. (2011) · PLoS ONE · doi:10.1371/journal.pone.0025451 · Cited by 265
Test–Retest Reproducibility Analysis of Lung CT Image Features
Balagurunathan, Y., Kumar, V., Gu, Y., Kim, J., Wang, H., Liu, Y., Goldgof, D. B., Hall, L. O., Korn, R., Zhao, B., et al. (2014) · Journal of Digital Imaging · doi:10.1007/s10278-014-9716-x · Cited by 259
Self-citationLee, H.-J., Kim, Y. T., Kang, C. H., Zhao, B., Tan, Y., Schwartz, L. H., Persigehl, T., Jeon, Y. K., & Chung, D. H. (2013) · Radiology · doi:10.1148/radiol.13112553 · Cited by 176
Self-citationKuo, M. D., Gollub, J., Sirlin, C. B., Ooi, C., & Chen, X. (2007) · Journal of Vascular and Interventional Radiology · doi:10.1016/j.jvir.2007.04.031 · Cited by 168
Variability of Lung Tumor Measurements on Repeat Computed Tomography Scans Taken Within 15 Minutes
Oxnard, G. R., Zhao, B., Sima, C. S., Ginsberg, M. S., James, L. P., Lefkowitz, R. A., Guo, P., Kris, M. G., Schwartz, L. H., & Riely, G. J. (2011) · Journal of Clinical Oncology · doi:10.1200/jco.2010.33.7071 · Cited by 161
Self-citationExploring Variability in CT Characterization of Tumors: A Preliminary Phantom Study
Zhao, B., Tan, Y., Tsai, W. Y., Schwartz, L. H., & Lü, L. (2014) · Translational Oncology · doi:10.1593/tlo.13865 · Cited by 137
Self-citationHunter, L. A., Krafft, S. P., Stingo, F. C., Choi, H., Martel, M. K., Kry, S. F., & Court, L. E. (2013) · Medical Physics · doi:10.1118/1.4829514 · Cited by 117
Segmentation of lung lesions on CT scans using watershed, active contours, and Markov random field
Tan, Y., Schwartz, L. H., & Zhao, B. (2013) · Medical Physics · doi:10.1118/1.4793409 · Cited by 105
Self-citationZhao, B., Tan, Y., Bell, D. J., Marley, S. E., Guo, P., Mann, H., Scott, M. L. J., Schwartz, L. H., & Ghiorghiu, D. C. (2013) · European Journal of Radiology · doi:10.1016/j.ejrad.2013.02.018 · Cited by 92
Self-citationColen, R. R., Foster, I. T., Gatenby, R. A., Giger, M. L., Gillies, R. J., Gutman, D. A., Heller, M. T., Jain, R., Madabhushi, A., Madhavan, S., et al. (2014) · Translational Oncology · doi:10.1016/j.tranon.2014.07.007 · Cited by 72
Are there imaging characteristics associated with lung adenocarcinomas harboring ALK rearrangements?
Halpenny, D. F., Riely, G. J., Hayes, S. A., Yu, H. A., Zheng, J., Moskowitz, C. S., & Ginsberg, M. S. (2014) · Lung Cancer · doi:10.1016/j.lungcan.2014.09.007 · Cited by 62
Tan, Y., Guo, P., Mann, H., Marley, S. E., Scott, M. L. J., Schwartz, L. H., Ghiorghiu, D. C., & Zhao, B. (2012) · Cancer Imaging · doi:10.1102/1470-7330.2012.0046 · Cited by 33
Self-citationMcNitt‐Gray, M. F., Kim, G. H. J., Zhao, B., Schwartz, L. H., Clunie, D., Cohen, K., Petrick, N., Fenimore, C., Lu, Z., & Buckler, A. J. (2015) · Translational Oncology · doi:10.1016/j.tranon.2015.01.001 · Cited by 28
Self-citation
Cited by
Radiomics: the bridge between medical imaging and personalized medicine
Lambin, P., Leijenaar, R. T. H., Deist, T. M., Peerlings, J., de Jong, E. E. C., van Timmeren, J., Sanduleanu, S., Larue, R. T. H. M., Even, A. J. G., Jochems, A., et al. (2017) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2017.141 · Cited by 5,688
Artificial intelligence in cancer imaging: Clinical challenges and applications
Bi, W. L., Hosny, A., Schabath, M. B., Giger, M. L., Birkbak, N. J., Mehrtash, A., Allison, T., Arnaout, O., Abbosh, C., Dunn, I. F., et al. (2019) · CA: A Cancer Journal for Clinicians · doi:10.3322/caac.21552 · Cited by 1,846
Self-citationRadiomics in medical imaging—“how-to” guide and critical reflection
van Timmeren, J. E., Cester, D., Tanadini-Lang, S., Alkadhi, H., & Baessler, B. (2020) · Insights into Imaging · doi:10.1186/s13244-020-00887-2 · Cited by 1,316
Nioche, C., Orlhac, F., Boughdad, S., Reuzé, S., Goya-Outi, J., Robert, C., Pellot-Barakat, C., Soussan, M., Frouin, F., & Buvat, I. (2018) · Cancer Research · doi:10.1158/0008-5472.can-18-0125 · Cited by 1,167
Liu, Z., Wang, S., Dong, D., Wei, J., Fang, C., Zhou, X., Sun, K., Li, L., Li, B., Wang, M., et al. (2019) · Theranostics · doi:10.7150/thno.30309 · Cited by 967
Metadata
- Authors
- Zhao, B., Tan, Y., Tsai, W.-Y., Qi, J., Xie, C., Lu, L., & Schwartz, L. H.
- Venue
- Scientific Reports
- Published
- 2016-03-24
- Volume
- 6
- Issue
- 1
- Pages
- 23428-23428
- ISSN
- 2045-2322 (ISSN-L)
- OpenAlex
- W2327203407
- Cited by
- 509
- References
- 28
- FWCI
- 44.68
- Type
- journal article
- Language
- en
- Open access
- gold
- Licence
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.