The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Robust Radiomics Feature Quantification Using Semiautomatic Volumetric Segmentation
Open accessAbstract
Due to advances in the acquisition and analysis of medical imaging, it is currently possible to quantify the tumor phenotype. The emerging field of Radiomics addresses this issue by converting medical images into minable data by extracting a large number of quantitative imaging features. One of the main challenges of Radiomics is tumor segmentation. Where manual delineation is time consuming and prone to inter-observer variability, it has been shown that semi-automated approaches are fast and reduce inter-observer variability. In this study, a semiautomatic region growing volumetric segmentation algorithm, implemented in the free and publicly available 3D-Slicer platform, was investigated in terms of its robustness for quantitative imaging feature extraction. Fifty-six 3D-radiomic features, quantifying phenotypic differences based on tumor intensity, shape and texture, were extracted from the computed tomography images of twenty lung cancer patients. These radiomic features were derived from the 3D-tumor volumes defined by three independent observers twice using 3D-Slicer, and compared to manual slice-by-slice delineations of five independent physicians in terms of intra-class correlation coefficient (ICC) and feature range. Radiomic features extracted from 3D-Slicer segmentations had significantly higher reproducibility (ICC = 0.85±0.15, p = 0.0009) compared to the features extracted from the manual segmentations (ICC = 0.77±0.17). Furthermore, we found that features extracted from 3D-Slicer segmentations were more robust, as the range was significantly smaller across observers (p = 3.819e-07), and overlapping with the feature ranges extracted from manual contouring (boundary lower: p = 0.007, higher: p = 5.863e-06). Our results show that 3D-Slicer segmented tumor volumes provide a better alternative to the manual delineation for feature quantification, as they yield more reproducible imaging descriptors. Therefore, 3D-Slicer can be employed for quantitative image feature extraction and image data mining research in large patient cohorts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Jemal, A., Bray, F., Center, M. M., Ferlay, J., Ward, E., & Forman, D. (2011) · CA: A Cancer Journal for Clinicians · doi:10.3322/caac.20107 · Cited by 54,679
Textural Features for Image Classification
Haralick, R. M., Shanmugam, K., & Dinstein, I. (1973) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1973.4309314 · Cited by 22,886
Forming inferences about some intraclass correlation coefficients.
McGraw, K. O., & Wong, S. P. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.1.30 · Cited by 6,903
Radiomics: extracting more information from medical images using advanced feature analysis
Lambin, P., Rios-Velazquez, E., Leijenaar, R., Carvalho, S., van Stiphout, R. G. P. M., Granton, P., Zegers, C. M. L., Gillies, R., Boellard, R., Dekker, A., et al. (2012) · European Journal of Cancer · doi:10.1016/j.ejca.2011.11.036 · Cited by 6,084
Self-citationDecoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach
Aerts, H. J. W. L., Velazquez, E. R., Leijenaar, R. T. H., Parmar, C., Grossmann, P., Carvalho, S., Bussink, J., Monshouwer, R., Haibe-Kains, B., Rietveld, D., et al. (2014) · Nature Communications · doi:10.1038/ncomms5006 · Cited by 5,132
Self-citationRadiomics: the process and the challenges
Kumar, V., Gu, Y., Basu, S., Berglund, A., Eschrich, S. A., Schabath, M. B., Forster, K., Aerts, H. J. W. L., Dekker, A., Fenstermacher, D., et al. (2012) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2012.06.010 · Cited by 2,258 · cited 5×
“Radiomics addresses this issue, and refers to the high throughput extraction of a large number of quantitative and minable imaging features, assuming that these features convey prognostic and predictive information [3,4].”
BackgroundMethodInfluentialSelf-citationTexture analysis using gray level run lengths
Galloway, M. M. (1975) · Computer Graphics and Image Processing · doi:10.1016/s0146-664x(75)80008-6 · Cited by 2,141
CERR: A computational environment for radiotherapy research
Deasy, J. O., Blanco, A. I., & Clark, V. H. (2003) · Medical Physics · doi:10.1118/1.1568978 · Cited by 872
Tixier, F., Le Rest, C. C., Hatt, M., Albarghach, N., Pradier, O., Metges, J.-P., Corcos, L., & Visvikis, D. (2011) · Journal of Nuclear Medicine · doi:10.2967/jnumed.110.082404 · Cited by 696
Decoding global gene expression programs in liver cancer by noninvasive imaging
Segal, E., Sirlin, C. B., Ooi, C., Adler, A. S., Gollub, J., Chen, X., Chan, B. K., Matcuk, G. R., Barry, C. T., Chang, H. Y., et al. (2007) · Nature Biotechnology · doi:10.1038/nbt1306 · Cited by 629 · cited 2×
“For example, quantitative imaging features extracted from CT images have been shown to predict 78% of the gene expression variability in hepatocellular carcinoma [11].”
Background
Cited by
Radiomics in medical imaging—“how-to” guide and critical reflection
van Timmeren, J. E., Cester, D., Tanadini-Lang, S., Alkadhi, H., & Baessler, B. (2020) · Insights into Imaging · doi:10.1186/s13244-020-00887-2 · Cited by 1,316
Applications and limitations of radiomics
Yip, S. S. F., & Aerts, H. J. W. L. (2016) · Physics in Medicine and Biology · doi:10.1088/0031-9155/61/13/r150 · Cited by 1,210
Self-citationMachine Learning methods for Quantitative Radiomic Biomarkers
Parmar, C., Grossmann, P., Bussink, J., Lambin, P., & Aerts, H. J. W. L. (2015) · Scientific Reports · doi:10.1038/srep13087 · Cited by 1,019
Self-citationLiu, Z., Wang, S., Dong, D., Wei, J., Fang, C., Zhou, X., Sun, K., Li, L., Li, B., Wang, M., et al. (2019) · Theranostics · doi:10.7150/thno.30309 · Cited by 967
Repeatability and Reproducibility of Radiomic Features: A Systematic Review
Traverso, A., Wee, L., Dekker, A., & Gillies, R. (2018) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2018.05.053 · Cited by 903
Limkin, E. J., Sun, R., Dercle, L., Zacharaki, E. I., Robert, C., Reuzé, S., Schernberg, A., Paragios, N., Deutsch, E., & Ferté, C. (2017) · Annals of Oncology · doi:10.1093/annonc/mdx034 · Cited by 757
CT-based radiomic signature predicts distant metastasis in lung adenocarcinoma
Coroller, T. P., Grossmann, P., Hou, Y., Rios Velazquez, E., Leijenaar, R. T. H., Hermann, G., Lambin, P., Haibe-Kains, B., Mak, R. H., & Aerts, H. J. W. L. (2015) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2015.02.015 · Cited by 695
“The advantage of the radiomic shape features is that they can be automatically acquired, reproducible [10–12], and take into account the whole tumor volume, whereas clinically assessed tumor diameters aremanually drawn on a CT slice and are therefore limited to one dimension of the tumor.”
Self-citationMeasuring Computed Tomography Scanner Variability of Radiomics Features
Mackin, D., Fave, X., Zhang, L., Fried, D., Yang, J., Taylor, B., Rodriguez-Rivera, E., Dodge, C., Jones, A. K., & Court, L. (2015) · Investigative Radiology · doi:10.1097/rli.0000000000000180 · Cited by 651
Deep Learning Predicts Lung Cancer Treatment Response from Serial Medical Imaging
Xu, Y., Hosny, A., Zeleznik, R., Parmar, C., Coroller, T., Franco, I., Mak, R. H., & Aerts, H. J. W. L. (2019) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-18-2495 · Cited by 628
Self-citationMachine and deep learning methods for radiomics
Avanzo, M., Wei, L., Stancanello, J., Vallières, M., Rao, A., Morin, O., Mattonen, S. A., & El Naqa, I. (2020) · Medical Physics · doi:10.1002/mp.13678 · Cited by 605
Reproducibility of radiomics for deciphering tumor phenotype with imaging
Zhao, B., Tan, Y., Tsai, W.-Y., Qi, J., Xie, C., Lu, L., & Schwartz, L. H. (2016) · Scientific Reports · doi:10.1038/srep23428 · Cited by 509
Beyond imaging: The promise of radiomics
Avanzo, M., Stancanello, J., & El Naqa, I. (2017) · Physica Medica · doi:10.1016/j.ejmp.2017.05.071 · Cited by 483
Leijenaar, R. T. H., Nalbantov, G., Carvalho, S., van Elmpt, W. J. C., Troost, E. G. C., Boellaard, R., Aerts, H. J. W. L., Gillies, R. J., & Lambin, P. (2015) · Scientific Reports · doi:10.1038/srep11075 · Cited by 426
Self-citationRadiomic Machine-Learning Classifiers for Prognostic Biomarkers of Head and Neck Cancer
Parmar, C., Grossmann, P., Rietveld, D., Rietbergen, M. M., Lambin, P., & Aerts, H. J. W. L. (2015) · Frontiers in Oncology · doi:10.3389/fonc.2015.00272 · Cited by 407
Self-citationCardenas, C. E., Yang, J., Anderson, B. M., Court, L. E., & Brock, K. B. (2019) · Seminars in Radiation Oncology · doi:10.1016/j.semradonc.2019.02.001 · Cited by 407
Park, J. E., Park, S. Y., Kim, H. J., & Kim, H. S. (2019) · Korean Journal of Radiology · doi:10.3348/kjr.2018.0070 · Cited by 388
Radiomics in breast cancer classification and prediction
Conti, A., Duggento, A., Indovina, I., Guerrisi, M., & Toschi, N. (2021) · Seminars in Cancer Biology · doi:10.1016/j.semcancer.2020.04.002 · Cited by 386
Radiomics in Oncology: A Practical Guide
Shur, J. D., Doran, S. J., Kumar, S., ap Dafydd, D., Downey, K., O’Connor, J. P. B., Papanikolaou, N., Messiou, C., Koh, D.-M., & Orton, M. R. (2021) · RadioGraphics · doi:10.1148/rg.2021210037 · Cited by 378
Radiomics: from qualitative to quantitative imaging
Rogers, W., Thulasi Seetha, S., Refaee, T. A. G., Lieverse, R. I. Y., Granzier, R. W. Y., Ibrahim, A., Keek, S. A., Sanduleanu, S., Primakov, S. P., Beuque, M. P. L., et al. (2020) · The British Journal of Radiology · doi:10.1259/bjr.20190948 · Cited by 372
Self-citationRadiomics: a new application from established techniques
Parekh, V., & Jacobs, M. A. (2016) · Expert Review of Precision Medicine and Drug Development · doi:10.1080/23808993.2016.1164013 · Cited by 369
Larue, R. T. H. M., Defraene, G., De Ruysscher, D., Lambin, P., & van Elmpt, W. (2017) · The British Journal of Radiology · doi:10.1259/bjr.20160665 · Cited by 363
Self-citationRadiomic phenotype features predict pathological response in non-small cell lung cancer
Coroller, T. P., Agrawal, V., Narayan, V., Hou, Y., Grossmann, P., Lee, S. W., Mak, R. H., & Aerts, H. J. W. L. (2016) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2016.04.004 · Cited by 327
Self-citationRadiomic Features Are Associated With EGFR Mutation Status in Lung Adenocarcinomas
Liu, Y., Kim, J., Balagurunathan, Y., Li, Q., Garcia, A. L., Stringfield, O., Ye, Z., & Gillies, R. J. (2016) · Clinical Lung Cancer · doi:10.1016/j.cllc.2016.02.001 · Cited by 318
Radiogenomics: bridging imaging and genomics
Bodalal, Z., Trebeschi, S., Nguyen-Kim, T. D. L., Schats, W., & Beets-Tan, R. (2019) · Abdominal Radiology · doi:10.1007/s00261-019-02028-w · Cited by 310
Choe, J., Lee, S. M., Do, K.-H., Lee, G., Lee, J.-G., Lee, S. M., & Seo, J. B. (2019) · Radiology · doi:10.1148/radiol.2019181960 · Cited by 296
Radiomics-based Prognosis Analysis for Non-Small Cell Lung Cancer
Zhang, Y., Oikonomou, A., Wong, A., Haider, M. A., & Khalvati, F. (2017) · Scientific Reports · doi:10.1038/srep46349 · Cited by 269
Jiang, J., Hu, Y.-C., Liu, C.-J., Halpenny, D., Hellmann, M. D., Deasy, J. O., Mageras, G., & Veeraraghavan, H. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2857800 · Cited by 268
Radiomics and deep learning in lung cancer
Avanzo, M., Stancanello, J., Pirrone, G., & Sartor, G. (2020) · Strahlentherapie und Onkologie · doi:10.1007/s00066-020-01625-9 · Cited by 263
He, L., Huang, Y., Ma, Z., Liang, C., Liang, C., & Liu, Z. (2016) · Scientific Reports · doi:10.1038/srep34921 · Cited by 256
Understanding Sources of Variation to Improve the Reproducibility of Radiomics
Zhao, B. (2021) · Frontiers in Oncology · doi:10.3389/fonc.2021.633176 · Cited by 158
Development of an Immune-Pathology Informed Radiomics Model for Non-Small Cell Lung Cancer
Tang, C., Hobbs, B., Amer, A., Li, X., Behrens, C., Canales, J. R., Cuentas, E. P., Villalobos, P., Fried, D., Chang, J. Y., et al. (2018) · Scientific Reports · doi:10.1038/s41598-018-20471-5 · Cited by 154
Radiomics feature reproducibility under inter-rater variability in segmentations of CT images
Haarburger, C., Müller-Franzes, G., Weninger, L., Kuhl, C., Truhn, D., & Merhof, D. (2020) · Scientific Reports · doi:10.1038/s41598-020-69534-6 · Cited by 139
Panth, K. M., Leijenaar, R. T. H., Carvalho, S., Lieuwes, N. G., Yaromina, A., Dubois, L., & Lambin, P. (2015) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2015.06.013 · Cited by 133
Self-citationOncologic Imaging and Radiomics: A Walkthrough Review of Methodological Challenges
Stanzione, A., Cuocolo, R., Ugga, L., Verde, F., Romeo, V., Brunetti, A., & Maurea, S. (2022) · Cancers · doi:10.3390/cancers14194871 · Cited by 64
Zhang, Y., Lobo-Mueller, E. M., Karanicolas, P., Gallinger, S., Haider, M. A., & Khalvati, F. (2021) · Scientific Reports · doi:10.1038/s41598-021-80998-y · Cited by 62
Metadata
- Authors
- Parmar, C., Rios Velazquez, E., Leijenaar, R., Jermoumi, M., Carvalho, S., Mak, R. H., Mitra, S., Shankar, B. U., Kikinis, R., Haibe-Kains, B., Lambin, P., & Aerts, H. J. W. L.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2014-07-15
- Volume
- 9
- Issue
- 7
- Pages
- e102107
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2052507258
- Cited by
- 611
- References
- 32
- FWCI
- 21.65
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.