The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Reproducibility and Prognosis of Quantitative Features Extracted from CT Images
Open accessAbstract
We study the reproducibility of quantitative imaging features that are used to describe tumor shape, size, and texture from computed tomography (CT) scans of non-small cell lung cancer (NSCLC). CT images are dependent on various scanning factors. We focus on characterizing image features that are reproducible in the presence of variations due to patient factors and segmentation methods. Thirty-two NSCLC nonenhanced lung CT scans were obtained from the Reference Image Database to Evaluate Response data set. The tumors were segmented using both manual (radiologist expert) and ensemble (software-automated) methods. A set of features (219 three-dimensional and 110 two-dimensional) was computed, and quantitative image features were statistically filtered to identify a subset of reproducible and nonredundant features. The variability in the repeated experiment was measured by the test-retest concordance correlation coefficient (CCCTreT). The natural range in the features, normalized to variance, was measured by the dynamic range (DR). In this study, there were 29 features across segmentation methods found with CCCTreT and DR ≥ 0.9 and R(2) Bet ≥ 0.95. These reproducible features were tested for predicting radiologist prognostic score; some texture features (run-length and Laws kernels) had an area under the curve of 0.9. The representative features were tested for their prognostic capabilities using an independent NSCLC data set (59 lung adenocarcinomas), where one of the texture features, run-length gray-level nonuniformity, was statistically significant in separating the samples into survival groups (P ≤ .046).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Nonparametric Estimation from Incomplete Observations
Kaplan, E. L., & Meier, P. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-4380-9_25 · Cited by 45,181
Nonparametric Estimation from Incomplete Observations
Kaplan, E. L., & Meier, P. (1958) · Journal of the American Statistical Association · doi:10.1080/01621459.1958.10501452 · Cited by 39,158
Principles and procedures of statistics.
Steel, R. G. D., & Torrie, J. H. (1960) · Cited by 24,135
Textural Features for Image Classification
Haralick, R. M., Shanmugam, K., & Dinstein, I. (1973) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1973.4309314 · Cited by 22,886
Robinson, H. F. (1961) · Agronomy Journal · doi:10.2134/agronj1961.00021962005300050002x · Cited by 17,713
New Guidelines to Evaluate the Response to Treatment in Solid Tumors
Therasse, P., Arbuck, S. G., Eisenhauer, E. A., Wanders, J., Kaplan, R. S., Rubinstein, L., Verweij, J., Van Glabbeke, M., van Oosterom, A. T., Christian, M. C., et al. (2000) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/92.3.205 · Cited by 15,660
Jemal, A., Siegel, R., Ward, E., Hao, Y., Xu, J., Murray, T., & Thun, M. J. (2008) · CA: A Cancer Journal for Clinicians · doi:10.3322/ca.2007.0010 · Cited by 10,188
A concordance correlation coefficient to evaluate reproducibility.
Lin, L. I.-K. (1989) · Biometrics · doi:10.2307/2532051 · Cited by 8,785 · cited 1×
“The CCCTreT measures deviation from the 45° line, which is appropriate for repeated experiments and shown to be superior to the Pearson correlation coefficient [26].”
Orthonormal bases of compactly supported wavelets
Daubechies, I. (1988) · Communications on Pure and Applied Mathematics · doi:10.1002/cpa.3160410705 · Cited by 8,190
A review of feature selection techniques in bioinformatics
Saeys, Y., Inza, I., & Larrañaga, P. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm344 · Cited by 5,244
Cited by
Radiomics: the bridge between medical imaging and personalized medicine
Lambin, P., Leijenaar, R. T. H., Deist, T. M., Peerlings, J., de Jong, E. E. C., van Timmeren, J., Sanduleanu, S., Larue, R. T. H. M., Even, A. J. G., Jochems, A., et al. (2017) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2017.141 · Cited by 5,688
Artificial intelligence in cancer imaging: Clinical challenges and applications
Bi, W. L., Hosny, A., Schabath, M. B., Giger, M. L., Birkbak, N. J., Mehrtash, A., Allison, T., Arnaout, O., Abbosh, C., Dunn, I. F., et al. (2019) · CA: A Cancer Journal for Clinicians · doi:10.3322/caac.21552 · Cited by 1,846
“85 Imaging settings, including CT scanners, slice thickness, and reconstruction kernels, also affect the calculation of radiomic features.”
BackgroundSelf-citationRadiomics in medical imaging—“how-to” guide and critical reflection
van Timmeren, J. E., Cester, D., Tanadini-Lang, S., Alkadhi, H., & Baessler, B. (2020) · Insights into Imaging · doi:10.1186/s13244-020-00887-2 · Cited by 1,316
Applications and limitations of radiomics
Yip, S. S. F., & Aerts, H. J. W. L. (2016) · Physics in Medicine and Biology · doi:10.1088/0031-9155/61/13/r150 · Cited by 1,210
Liu, Z., Wang, S., Dong, D., Wei, J., Fang, C., Zhou, X., Sun, K., Li, L., Li, B., Wang, M., et al. (2019) · Theranostics · doi:10.7150/thno.30309 · Cited by 967
Repeatability and Reproducibility of Radiomic Features: A Systematic Review
Traverso, A., Wee, L., Dekker, A., & Gillies, R. (2018) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2018.05.053 · Cited by 903
Self-citationCT-based radiomic signature predicts distant metastasis in lung adenocarcinoma
Coroller, T. P., Grossmann, P., Hou, Y., Rios Velazquez, E., Leijenaar, R. T. H., Hermann, G., Lambin, P., Haibe-Kains, B., Mak, R. H., & Aerts, H. J. W. L. (2015) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2015.02.015 · Cited by 695
Imaging Intratumor Heterogeneity: Role in Therapy Response, Resistance, and Clinical Outcome
O'Connor, J. P. B., Rose, C. J., Waterton, J. C., Carano, R. A. D., Parker, G. J. M., & Jackson, A. (2015) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-14-0990 · Cited by 677
Measuring Computed Tomography Scanner Variability of Radiomics Features
Mackin, D., Fave, X., Zhang, L., Fried, D., Yang, J., Taylor, B., Rodriguez-Rivera, E., Dodge, C., Jones, A. K., & Court, L. (2015) · Investigative Radiology · doi:10.1097/rli.0000000000000180 · Cited by 651
Multi-crop Convolutional Neural Networks for lung nodule malignancy suspiciousness classification
Shen, W., Zhou, M., Yang, F., Yu, D., Dong, D., Yang, C., Zang, Y., & Tian, J. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2016.05.029 · Cited by 635
Berenguer, R., Pastor-Juan, M. D. R., Canales-Vázquez, J., Castro-García, M., Villas, M. V., Mansilla Legorburo, F., & Sabater, S. (2018) · Radiology · doi:10.1148/radiol.2018172361 · Cited by 622
Deep learning for image-based cancer detection and diagnosis − A survey
Hu, Z., Tang, J., Wang, Z., Zhang, K., Zhang, L., & Sun, Q. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.05.014 · Cited by 509
Radiomics and radiogenomics in lung cancer: A review for the clinician
Thawani, R., McLane, M., Beig, N., Ghose, S., Prasanna, P., Velcheti, V., & Madabhushi, A. (2018) · Lung Cancer · doi:10.1016/j.lungcan.2017.10.015 · Cited by 450
Deep Feature Learning for Medical Image Analysis with Convolutional Autoencoder Neural Network
Chen, M., Shi, X., Zhang, Y., Wu, D., & Guizani, M. (2021) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2017.2717439 · Cited by 443
Radiomic feature clusters and Prognostic Signatures specific for Lung and Head & Neck cancer
Parmar, C., Leijenaar, R. T. H., Grossmann, P., Rios Velazquez, E., Bussink, J., Rietveld, D., Rietbergen, M. M., Haibe-Kains, B., Lambin, P., & Aerts, H. J. W. L. (2015) · Scientific Reports · doi:10.1038/srep11044 · Cited by 434
Cancer Diagnosis Using Deep Learning: A Bibliographic Review
Munir, K., Elahi, H., Ayub, A., Frezza, F., & Rizzi, A. (2019) · Cancers · doi:10.3390/cancers11091235 · Cited by 422
Cardenas, C. E., Yang, J., Anderson, B. M., Court, L. E., & Brock, K. B. (2019) · Seminars in Radiation Oncology · doi:10.1016/j.semradonc.2019.02.001 · Cited by 407
Defining the biological basis of radiomic phenotypes in lung cancer
Grossmann, P., Stringfield, O., El-Hachem, N., Bui, M. M., Rios Velazquez, E., Parmar, C., Leijenaar, R. T., Haibe-Kains, B., Lambin, P., Gillies, R. J., et al. (2017) · eLife · doi:10.7554/elife.23421 · Cited by 365
Self-citationLarue, R. T. H. M., Defraene, G., De Ruysscher, D., Lambin, P., & van Elmpt, W. (2017) · The British Journal of Radiology · doi:10.1259/bjr.20160665 · Cited by 363
Delta-radiomics features for the prediction of patient outcomes in non–small cell lung cancer
Fave, X., Zhang, L., Yang, J., Mackin, D., Balter, P., Gomez, D., Followill, D., Jones, A. K., Stingo, F., Liao, Z., et al. (2017) · Scientific Reports · doi:10.1038/s41598-017-00665-z · Cited by 353
False Discovery Rates in PET and CT Studies with Texture Features: A Systematic Review
Chalkidou, A., O’Doherty, M. J., & Marsden, P. K. (2015) · PLOS ONE · doi:10.1371/journal.pone.0124165 · Cited by 344
A review in radiomics: Making personalized medicine a reality via routine imaging
Guiot, J., Vaidyanathan, A., Deprez, L., Zerka, F., Danthine, D., Frix, A., Lambin, P., Bottari, F., Tsoutzidis, N., Miraglio, B., et al. (2022) · Medicinal Research Reviews · doi:10.1002/med.21846 · Cited by 337
Radiomic Features Are Associated With EGFR Mutation Status in Lung Adenocarcinomas
Liu, Y., Kim, J., Balagurunathan, Y., Li, Q., Garcia, A. L., Stringfield, O., Ye, Z., & Gillies, R. J. (2016) · Clinical Lung Cancer · doi:10.1016/j.cllc.2016.02.001 · Cited by 318
Self-citationA radiogenomic dataset of non-small cell lung cancer
Bakr, S., Gevaert, O., Echegaray, S., Ayers, K., Zhou, M., Shafiq, M., Zheng, H., Benson, J. A., Zhang, W., Leung, A. N. C., et al. (2018) · Scientific Data · doi:10.1038/sdata.2018.202 · Cited by 311
Predicting Malignant Nodules from Screening CT Scans
Hawkins, S., Wang, H., Liu, Y., Garcia, A., Stringfield, O., Krewer, H., Li, Q., Cherezov, D., Gatenby, R. A., Balagurunathan, Y., et al. (2016) · Journal of Thoracic Oncology · doi:10.1016/j.jtho.2016.07.002 · Cited by 293
Self-citationGrove, O., Berglund, A. E., Schabath, M. B., Aerts, H. J. W. L., Dekker, A., Wang, H., Velazquez, E. R., Lambin, P., Gu, Y., Balagurunathan, Y., et al. (2015) · PLOS ONE · doi:10.1371/journal.pone.0118261 · Cited by 263
“The method has been first proposed and used to find informative feature set [20].”
MethodSelf-citationLarue, R. T. H. M., van Timmeren, J. E., de Jong, E. E. C., Feliciani, G., Leijenaar, R. T. H., Schreurs, W. M. J., Sosef, M. N., Raat, F. H. P. J., van der Zande, F. H. R., Das, M., et al. (2017) · Acta Oncologica · doi:10.1080/0284186x.2017.1351624 · Cited by 262
Radiomics feature reproducibility under inter-rater variability in segmentations of CT images
Haarburger, C., Müller-Franzes, G., Weninger, L., Kuhl, C., Truhn, D., & Merhof, D. (2020) · Scientific Reports · doi:10.1038/s41598-020-69534-6 · Cited by 139
Permuth, J. B., Collaborative, T. F. P., Choi, J., Balarunathan, Y., Kim, J., Chen, D.-T., Chen, L., Orcutt, S., Doepker, M. P., Gage, K., et al. (2016) · Oncotarget · doi:10.18632/oncotarget.11768 · Cited by 127
“Based on previous successes [19, 21], the entire tumors were identified (solid and cystic components) using a semimanual version of a single click semi-automated ensemble segmentation algorithm within the Definiens Developer XD (Munich, Germany) software platform.”
BackgroundMethodSelf-citationLigero, M., Garcia-Ruiz, A., Viaplana, C., Villacampa, G., Raciti, M. V., Landa, J., Matos, I., Martin-Liberal, J., Ochoa-de-Olza, M., Hierro, C., et al. (2021) · Radiology · doi:10.1148/radiol.2021200928 · Cited by 107
Chakraborty, J., Langdon-Embry, L., Cunanan, K. M., Escalon, J. G., Allen, P. J., Lowery, M. A., O’Reilly, E. M., Gönen, M., Do, R. G., & Simpson, A. L. (2017) · PLOS ONE · doi:10.1371/journal.pone.0188022 · Cited by 85
Yamashita, R., Perrin, T., Chakraborty, J., Chou, J. F., Horvat, N., Koszalka, M. A., Midya, A., Gonen, M., Allen, P., Jarnagin, W. R., et al. (2020) · European Radiology · doi:10.1007/s00330-019-06381-8 · Cited by 76
Polk, S. L., Choi, J. W., McGettigan, M. J., Rose, T., Ahmed, A., Kim, J., Jiang, K., Balagurunathan, Y., Qi, J., Farah, P. T., et al. (2020) · World Journal of Gastroenterology · doi:10.3748/wjg.v26.i24.3458 · Cited by 48
Self-citation
Metadata
- Authors
- Balagurunathan, Y., Gu, Y., Wang, H., Kumar, V., Grove, O., Hawkins, S., Kim, J., Goldgof, D. B., Hall, L. O., Gatenby, R. A., & Gillies, R. J.
- Venue
- Translational Oncology
- Publisher
- Elsevier BV
- Published
- 2014-02
- Volume
- 7
- Issue
- 1
- Pages
- 72-87
- ISSN
- 1936-5233 (ISSN-L)
- OpenAlex
- W2062744135
- Cited by
- 306
- References
- 30
- FWCI
- 18.04
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.