The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Machine Learning methods for Quantitative Radiomic Biomarkers
Open accessAbstract
Radiomics extracts and mines large number of medical imaging features quantifying tumor phenotypic characteristics. Highly accurate and reliable machine-learning approaches can drive the success of radiomic applications in clinical care. In this radiomic study, fourteen feature selection methods and twelve classification methods were examined in terms of their performance and stability for predicting overall survival. A total of 440 radiomic features were extracted from pre-treatment computed tomography (CT) images of 464 lung cancer patients. To ensure the unbiased evaluation of different machine-learning methods, publicly available implementations along with reported parameter configurations were used. Furthermore, we used two independent radiomic cohorts for training (n = 310 patients) and validation (n = 154 patients). We identified that Wilcoxon test based feature selection method WLCX (stability = 0.84 ± 0.05, AUC = 0.65 ± 0.02) and a classification method random forest RF (RSD = 3.52%, AUC = 0.66 ± 0.03) had highest prognostic performance with high stability against data perturbation. Our variability analysis indicated that the choice of classification method is the most dominant source of performance variation (34.21% of total variance). Identification of optimal machine-learning methods for radiomic applications is a crucial step towards stable and clinically relevant radiomic biomarkers, providing a non-invasive way of quantifying and monitoring tumor-phenotypic characteristics in clinical practice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Textural Features for Image Classification
Haralick, R. M., Shanmugam, K., & Dinstein, I. (1973) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1973.4309314 · Cited by 22,886
The Hungarian method for the assignment problem
Kuhn, H. W. (1955) · Naval Research Logistics Quarterly · doi:10.1002/nav.3800020109 · Cited by 13,120
Building Predictive Models in R Using the caret Package
Kuhn, M. (2008) · Journal of Statistical Software · doi:10.18637/jss.v028.i05 · Cited by 8,863
Radiomics: extracting more information from medical images using advanced feature analysis
Lambin, P., Rios-Velazquez, E., Leijenaar, R., Carvalho, S., van Stiphout, R. G. P. M., Granton, P., Zegers, C. M. L., Gillies, R., Boellard, R., Dekker, A., et al. (2012) · European Journal of Cancer · doi:10.1016/j.ejca.2011.11.036 · Cited by 6,084
Self-citationDecoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach
Aerts, H. J. W. L., Velazquez, E. R., Leijenaar, R. T. H., Parmar, C., Grossmann, P., Carvalho, S., Bussink, J., Monshouwer, R., Haibe-Kains, B., Rietveld, D., et al. (2014) · Nature Communications · doi:10.1038/ncomms5006 · Cited by 5,132
Self-citationTexture analysis using gray level run lengths
Galloway, M. M. (1975) · Computer Graphics and Image Processing · doi:10.1016/s0146-664x(75)80008-6 · Cited by 2,141
Graph-based approach for airborne light detection and ranging segmentation
Vilariño, D. L., Cabaleiro, J. C., Martínez, J., Rivera, F. F., & Pena, T. F. (2017) · Journal of Applied Remote Sensing · doi:10.1117/1.jrs.11.015020 · Cited by 1,721
Machine learning: a review of classification and combining techniques
Kotsiantis, S. B., Zaharakis, I. D., & Pintelas, P. E. (2006) · Artificial Intelligence Review · doi:10.1007/s10462-007-9052-3 · Cited by 1,582
Foundations of Machine Learning
Mohri, M., Rostamizadeh, A., & Talwalkar, A. (2018) · doi:10.7551/mitpress/10290.001.0001 · Cited by 1,122
Cited by
Radiomics: the bridge between medical imaging and personalized medicine
Lambin, P., Leijenaar, R. T. H., Deist, T. M., Peerlings, J., de Jong, E. E. C., van Timmeren, J., Sanduleanu, S., Larue, R. T. H. M., Even, A. J. G., Jochems, A., et al. (2017) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2017.141 · Cited by 5,688
Self-citationArtificial intelligence in radiology
Hosny, A., Parmar, C., Quackenbush, J., Schwartz, L. H., & Aerts, H. J. W. L. (2018) · Nature Reviews Cancer · doi:10.1038/s41568-018-0016-5 · Cited by 3,803
Self-citationArtificial intelligence in cancer imaging: Clinical challenges and applications
Bi, W. L., Hosny, A., Schabath, M. B., Giger, M. L., Birkbak, N. J., Mehrtash, A., Allison, T., Arnaout, O., Abbosh, C., Dunn, I. F., et al. (2019) · CA: A Cancer Journal for Clinicians · doi:10.3322/caac.21552 · Cited by 1,846
Self-citationMayerhoefer, M. E., Materka, A., Langs, G., Häggström, I., Szczypiński, P., Gibbs, P., & Cook, G. (2020) · Journal of Nuclear Medicine · doi:10.2967/jnumed.118.222893 · Cited by 1,777
Applications and limitations of radiomics
Yip, S. S. F., & Aerts, H. J. W. L. (2016) · Physics in Medicine and Biology · doi:10.1088/0031-9155/61/13/r150 · Cited by 1,210
Self-citationRadiomics: the facts and the challenges of image analysis
Rizzo, S., Botta, F., Raimondi, S., Origgi, D., Fanciullo, C., Morganti, A. G., & Bellomi, M. (2018) · European Radiology Experimental · doi:10.1186/s41747-018-0068-z · Cited by 1,054
Limkin, E. J., Sun, R., Dercle, L., Zacharaki, E. I., Robert, C., Reuzé, S., Schernberg, A., Paragios, N., Deutsch, E., & Ferté, C. (2017) · Annals of Oncology · doi:10.1093/annonc/mdx034 · Cited by 757
AI applications to medical images: From machine learning to deep learning
Castiglioni, I., Rundo, L., Codari, M., Di Leo, G., Salvatore, C., Interlenghi, M., Gallivanone, F., Cozzi, A., D'Amico, N. C., & Sardanelli, F. (2021) · Physica Medica · doi:10.1016/j.ejmp.2021.02.006 · Cited by 710
The Potential of Radiomic-Based Phenotyping in Precision Medicine: A Review
Aerts, H. J. W. L. (2016) · JAMA Oncology · doi:10.1001/jamaoncol.2016.2631 · Cited by 669
Self-citationStability of feature selection algorithm: A review
Khaire, U. M., & Dhanalakshmi, R. (2022) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2019.06.012 · Cited by 630
Deep Learning Predicts Lung Cancer Treatment Response from Serial Medical Imaging
Xu, Y., Hosny, A., Zeleznik, R., Parmar, C., Coroller, T., Franco, I., Mak, R. H., & Aerts, H. J. W. L. (2019) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-18-2495 · Cited by 628
Self-citationGiger (2018) · doi:10.1016/j.jacr.2017.12.028 · Cited by 634
Machine and deep learning methods for radiomics
Avanzo, M., Wei, L., Stancanello, J., Vallières, M., Rao, A., Morin, O., Mattonen, S. A., & El Naqa, I. (2020) · Medical Physics · doi:10.1002/mp.13678 · Cited by 605
Deep learning for lung cancer prognostication: A retrospective multi-cohort radiomics study
Hosny, A., Parmar, C., Coroller, T. P., Grossmann, P., Zeleznik, R., Kumar, A., Bussink, J., Gillies, R. J., Mak, R. H., & Aerts, H. J. W. L. (2018) · PLOS Medicine · doi:10.1371/journal.pmed.1002711 · Cited by 579
Self-citationBeyond imaging: The promise of radiomics
Avanzo, M., Stancanello, J., & El Naqa, I. (2017) · Physica Medica · doi:10.1016/j.ejmp.2017.05.071 · Cited by 483
Characterization of PET/CT images using texture analysis: the past, the present… any future?
Hatt, M., Tixier, F., Pierce, L., Kinahan, P. E., Le Rest, C. C., & Visvikis, D. (2017) · European Journal of Nuclear Medicine and Molecular Imaging · doi:10.1007/s00259-016-3427-0 · Cited by 475
Radiomics and radiogenomics in lung cancer: A review for the clinician
Thawani, R., McLane, M., Beig, N., Ghose, S., Prasanna, P., Velcheti, V., & Madabhushi, A. (2018) · Lung Cancer · doi:10.1016/j.lungcan.2017.10.015 · Cited by 450
Zhou, M., Scott, J., Chaudhury, B., Hall, L., Goldgof, D., Yeom, K. W., Iv, M., Ou, Y., Kalpathy-Cramer, J., Napel, S., et al. (2018) · American Journal of Neuroradiology · doi:10.3174/ajnr.a5391 · Cited by 415
Radiomic Machine-Learning Classifiers for Prognostic Biomarkers of Head and Neck Cancer
Parmar, C., Grossmann, P., Rietveld, D., Rietbergen, M. M., Lambin, P., & Aerts, H. J. W. L. (2015) · Frontiers in Oncology · doi:10.3389/fonc.2015.00272 · Cited by 407
Self-citationCoenen, A., Kim, Y.-H., Kruk, M., Tesche, C., De Geer, J., Kurata, A., Lubbers, M. L., Daemen, J., Itu, L., Rapaka, S., et al. (2018) · Circulation: Cardiovascular Imaging · doi:10.1161/circimaging.117.007217 · Cited by 397
Somatic Mutations Drive Distinct Imaging Phenotypes in Lung Cancer
Rios Velazquez, E., Parmar, C., Liu, Y., Coroller, T. P., Cruz, G., Stringfield, O., Ye, Z., Makrigiorgos, M., Fennessy, F., Mak, R. H., et al. (2017) · Cancer Research · doi:10.1158/0008-5472.can-17-0122 · Cited by 391
Self-citationChang, K., Bai, H. X., Zhou, H., Su, C., Bi, W. L., Agbodza, E., Kavouridis, V. K., Senders, J. T., Boaro, A., Beers, A., et al. (2018) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-17-2236 · Cited by 391
Radiomics in breast cancer classification and prediction
Conti, A., Duggento, A., Indovina, I., Guerrisi, M., & Toschi, N. (2021) · Seminars in Cancer Biology · doi:10.1016/j.semcancer.2020.04.002 · Cited by 386
Radiomics: a new application from established techniques
Parekh, V., & Jacobs, M. A. (2016) · Expert Review of Precision Medicine and Drug Development · doi:10.1080/23808993.2016.1164013 · Cited by 369
Larue, R. T. H. M., Defraene, G., De Ruysscher, D., Lambin, P., & van Elmpt, W. (2017) · The British Journal of Radiology · doi:10.1259/bjr.20160665 · Cited by 363
Self-citationA review in radiomics: Making personalized medicine a reality via routine imaging
Guiot, J., Vaidyanathan, A., Deprez, L., Zerka, F., Danthine, D., Frix, A., Lambin, P., Bottari, F., Tsoutzidis, N., Miraglio, B., et al. (2022) · Medicinal Research Reviews · doi:10.1002/med.21846 · Cited by 337
Self-citationBeig, N., Khorrami, M., Alilou, M., Prasanna, P., Braman, N., Orooji, M., Rakshit, S., Bera, K., Rajiah, P., Ginsberg, J., et al. (2019) · Radiology · doi:10.1148/radiol.2018180910 · Cited by 328
Radiomic phenotype features predict pathological response in non-small cell lung cancer
Coroller, T. P., Agrawal, V., Narayan, V., Hou, Y., Grossmann, P., Lee, S. W., Mak, R. H., & Aerts, H. J. W. L. (2016) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2016.04.004 · Cited by 327
Self-citationRadiogenomics: bridging imaging and genomics
Bodalal, Z., Trebeschi, S., Nguyen-Kim, T. D. L., Schats, W., & Beets-Tan, R. (2019) · Abdominal Radiology · doi:10.1007/s00261-019-02028-w · Cited by 310
Zwanenburg, A. (2019) · European Journal of Nuclear Medicine and Molecular Imaging · doi:10.1007/s00259-019-04391-8 · Cited by 306
Deist, T. M., Dankers, F. J. W. M., Valdes, G., Wijsman, R., Hsu, I., Oberije, C., Lustberg, T., van Soest, J., Hoebers, F., Jochems, A., et al. (2018) · Medical Physics · doi:10.1002/mp.12967 · Cited by 304
Self-citationLee, G., Lee, H. Y., Park, H., Schiebler, M. L., van Beek, E. J. R., Ohno, Y., Seo, J. B., & Leung, A. (2017) · European Journal of Radiology · doi:10.1016/j.ejrad.2016.09.005 · Cited by 282
Radiomics-based Prognosis Analysis for Non-Small Cell Lung Cancer
Zhang, Y., Oikonomou, A., Wong, A., Haider, M. A., & Khalvati, F. (2017) · Scientific Reports · doi:10.1038/srep46349 · Cited by 269
Radiomics and deep learning in lung cancer
Avanzo, M., Stancanello, J., Pirrone, G., & Sartor, G. (2020) · Strahlentherapie und Onkologie · doi:10.1007/s00066-020-01625-9 · Cited by 263
Santos, M. K., Ferreira Júnior, J. R., Wada, D. T., Tenório, A. P. M., Nogueira-Barbosa, M. H., & Marques, P. M. D. A. (2019) · Radiologia Brasileira · doi:10.1590/0100-3984.2019.0049 · Cited by 214
Elshafeey, N., Kotrotsou, A., Hassan, A., Elshafei, N., Hassan, I., Ahmed, S., Abrol, S., Agarwal, A., El Salek, K., Bergamaschi, S., et al. (2019) · Nature Communications · doi:10.1038/s41467-019-11007-0 · Cited by 147
Coy, H., Hsieh, K., Wu, W., Nagarajan, M. B., Young, J. R., Douek, M. L., Brown, M. S., Scalzo, F., & Raman, S. S. (2019) · Abdominal Radiology · doi:10.1007/s00261-019-01929-0 · Cited by 110
CT radiomics to predict high‐risk intraductal papillary mucinous neoplasms of the pancreas
Chakraborty, J., Midya, A., Gazit, L., Attiyeh, M., Langdon‐Embry, L., Allen, P. J., Do, R. K. G., & Simpson, A. L. (2018) · Medical Physics · doi:10.1002/mp.13159 · Cited by 105
Radiomics in radiooncology – challenging the medical physicist
Peeken, J. C., Bernhofer, M., Wiestler, B., Goldberg, T., Cremers, D., Rost, B., Wilkens, J. J., Combs, S. E., & Nüsslin, F. (2018) · Physica Medica · doi:10.1016/j.ejmp.2018.03.012 · Cited by 98
Zhang, Y., Cheng, C., Liu, Z., Wang, L., Pan, G., Sun, G., Chang, Y., Zuo, C., & Yang, X. (2019) · Medical Physics · doi:10.1002/mp.13733 · Cited by 80
Shayesteh, S., Nazari, M., Salahshour, A., Sandoughdaran, S., Hajianfar, G., Khateri, M., Yaghobi Joybari, A., Jozian, F., Fatehi Feyzabad, S. H., Arabi, H., et al. (2021) · Medical Physics · doi:10.1002/mp.14896 · Cited by 70
Radiogenomics for Precision Medicine With a Big Data Analytics Perspective
Panayides, A. S., Pattichis, M. S., Leandrou, S., Pitris, C., Constantinidou, A., & Pattichis, C. S. (2019) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2018.2879381 · Cited by 66
Zhang, Y., Lobo-Mueller, E. M., Karanicolas, P., Gallinger, S., Haider, M. A., & Khalvati, F. (2021) · Scientific Reports · doi:10.1038/s41598-021-80998-y · Cited by 62
Building reliable radiomic models using image perturbation
Teng, X., Zhang, J., Zwanenburg, A., Sun, J., Huang, Y., Lam, S., Zhang, Y., Li, B., Zhou, T., Xiao, H., et al. (2022) · Scientific Reports · doi:10.1038/s41598-022-14178-x · Cited by 40
Payabvash, S., Palacios, E. M., Owen, J. P., Wang, M. B., Tavassoli, T., Gerdes, M., Brandes-Aitken, A., Marco, E. J., & Mukherjee, P. (2019) · NeuroImage: Clinical · doi:10.1016/j.nicl.2019.101831 · Cited by 21
Radiogenomics predicts the expression of microRNA-1246 in the serum of esophageal cancer patients
Hoshino, I., Yokota, H., Ishige, F., Iwatate, Y., Takeshita, N., Nagase, H., Uno, T., & Matsubara, H. (2020) · Scientific Reports · doi:10.1038/s41598-020-59500-7 · Cited by 19
(2021) · doi:10.1007/s43441-021-00355-z · Cited by 11
Metadata
- Authors
- Parmar, C., Grossmann, P., Bussink, J., Lambin, P., & Aerts, H. J. W. L.
- Venue
- Scientific Reports
- Published
- 2015-08-17
- Volume
- 5
- Issue
- 1
- Pages
- 13087-13087
- ISSN
- 2045-2322 (ISSN-L)
- OpenAlex
- W1408981388
- Cited by
- 1,019
- References
- 40
- FWCI
- 43.85
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.