The DOI matches its Crossref record; 78 of the 78 references it cites were found in a registry or an index.
Repeatability and Reproducibility of Radiomic Features: A Systematic Review
Open accessAbstract
PURPOSE: An ever-growing number of predictive models used to inform clinical decision making have included quantitative, computer-extracted imaging biomarkers, or "radiomic features." Broadly generalizable validity of radiomics-assisted models may be impeded by concerns about reproducibility. We offer a qualitative synthesis of 41 studies that specifically investigated the repeatability and reproducibility of radiomic features, derived from a systematic review of published peer-reviewed literature. METHODS AND MATERIALS: The PubMed electronic database was searched using combinations of the broad Haynes and Ingui filters along with a set of text words specific to cancer, radiomics (including texture analyses), reproducibility, and repeatability. This review has been reported in compliance with Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. From each full-text article, information was extracted regarding cancer type, class of radiomic feature examined, reporting quality of key processing steps, and statistical metric used to segregate stable features. RESULTS: Among 624 unique records, 41 full-text articles were subjected to review. The studies primarily addressed non-small cell lung cancer and oropharyngeal cancer. Only 7 studies addressed in detail every methodologic aspect related to image acquisition, preprocessing, and feature extraction. The repeatability and reproducibility of radiomic features are sensitive at various degrees to processing details such as image acquisition settings, image reconstruction algorithm, digital image preprocessing, and software used to extract radiomic features. First-order features were overall more reproducible than shape metrics and textural features. Entropy was consistently reported as one of the most stable first-order features. There was no emergent consensus regarding either shape metrics or textural features; however, coarseness and contrast appeared among the least reproducible. CONCLUSIONS: Investigations of feature repeatability and reproducibility are currently limited to a small number of cancer types. Reporting quality could be improved regarding details of feature extraction software, digital image manipulation (preprocessing), and the cutoff value used to distinguish stable features.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
New response evaluation criteria in solid tumours: revised RECIST guideline (version 1.1)
Eisenhauer, E. A., Therasse, P., Bogaerts, J., Schwartz, L. H., Sargent, D., Ford, R., Dancey, J., Arbuck, S., Gwyther, S., Mooney, M., et al. (2009) · European Journal of Cancer · doi:10.1016/j.ejca.2008.10.026 · Cited by 29,534
Wang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
New Guidelines to Evaluate the Response to Treatment in Solid Tumors
Therasse, P., Arbuck, S. G., Eisenhauer, E. A., Wanders, J., Kaplan, R. S., Rubinstein, L., Verweij, J., Van Glabbeke, M., van Oosterom, A. T., Christian, M. C., et al. (2000) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/92.3.205 · Cited by 15,660
A concordance correlation coefficient to evaluate reproducibility.
Lin, L. I.-K. (1989) · Biometrics · doi:10.2307/2532051 · Cited by 8,785
Radiomics: extracting more information from medical images using advanced feature analysis
Lambin, P., Rios-Velazquez, E., Leijenaar, R., Carvalho, S., van Stiphout, R. G. P. M., Granton, P., Zegers, C. M. L., Gillies, R., Boellard, R., Dekker, A., et al. (2012) · European Journal of Cancer · doi:10.1016/j.ejca.2011.11.036 · Cited by 6,084
Self-citationDecoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach
Aerts, H. J. W. L., Velazquez, E. R., Leijenaar, R. T. H., Parmar, C., Grossmann, P., Carvalho, S., Bussink, J., Monshouwer, R., Haibe-Kains, B., Rietveld, D., et al. (2014) · Nature Communications · doi:10.1038/ncomms5006 · Cited by 5,132
Self-citationQUANTIFYING TEST-RETEST RELIABILITY USING THE INTRACLASS CORRELATION COEFFICIENT AND THE SEM
WEIR, J. P. (2005) · Journal of Strength and Conditioning Research · doi:10.1519/00124278-200502000-00038 · Cited by 4,842
Collins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · BMJ · doi:10.1136/bmj.g7594 · Cited by 4,388
Collins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · British Journal of Cancer · doi:10.1038/bjc.2014.639 · Cited by 3,293
Radiomics: the process and the challenges
Kumar, V., Gu, Y., Basu, S., Berglund, A., Eschrich, S. A., Schabath, M. B., Forster, K., Aerts, H. J. W. L., Dekker, A., Fenstermacher, D., et al. (2012) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2012.06.010 · Cited by 2,258 · cited 3×
““Reproducibility” refers to features that remain the same when imaged using different equipment, different software, different image acquisition settings, or different operators (eg, other clinics), be that in the same subject or in different subjects (14, 20).”
Self-citationDangers of Using "Optimal" Cutpoints in the Evaluation of Prognostic Factors
Altman, D. G., Lausen, B., Sauerbrei, W., & Schumacher, M. (1994) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/86.11.829 · Cited by 1,143
Imaging biomarker roadmap for cancer studies
O'Connor, J. P. B., Aboagye, E. O., Adams, J. E., Aerts, H. J. W. L., Barrington, S. F., Beer, A. J., Boellaard, R., Bohndiek, S. E., Brady, M., Brown, G., et al. (2017) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2016.162 · Cited by 1,091
Self-citationEncyclopedia of Statistical Sciences
(2004) · Wiley eBooks · doi:10.1002/0471667196 · Cited by 724
Measuring Computed Tomography Scanner Variability of Radiomics Features
Mackin, D., Fave, X., Zhang, L., Fried, D., Yang, J., Taylor, B., Rodriguez-Rivera, E., Dodge, C., Jones, A. K., & Court, L. (2015) · Investigative Radiology · doi:10.1097/rli.0000000000000180 · Cited by 651
(2005) · PubMed · Cited by 612
Robust Radiomics Feature Quantification Using Semiautomatic Volumetric Segmentation
Parmar, C., Rios Velazquez, E., Leijenaar, R., Jermoumi, M., Carvalho, S., Mak, R. H., Mitra, S., Shankar, B. U., Kikinis, R., Haibe-Kains, B., et al. (2014) · PLoS ONE · doi:10.1371/journal.pone.0102107 · Cited by 611
Intrinsic dependencies of CT radiomic features on voxel size and number of gray levels
Shafiq‐ul‐Hassan, M., Zhang, G. G., Latifi, K., Ullah, G., Hunt, D. C., Balagurunathan, Y., Abdalah, M. A., Schabath, M. B., Goldgof, D. G., Mackin, D., et al. (2017) · Medical Physics · doi:10.1002/mp.12123 · Cited by 585
Self-citationHaynes, R. B., & Wilczynski, N. L. (2004) · BMJ · doi:10.1136/bmj.38068.557998.ee · Cited by 547
Understanding the standardized uptake value, its methods, and implications for usage.
Thie, J. A. (2004) · PubMed · Cited by 546
Reproducibility of radiomics for deciphering tumor phenotype with imaging
Zhao, B., Tan, Y., Tsai, W.-Y., Qi, J., Xie, C., Lu, L., & Schwartz, L. H. (2016) · Scientific Reports · doi:10.1038/srep23428 · Cited by 509
Quantifying tumour heterogeneity in 18F-FDG PET/CT imaging by texture analysis
Chicklore, S., Goh, V., Siddique, M., Roy, A., Marsden, P. K., & Cook, G. J. R. (2013) · European Journal of Nuclear Medicine and Molecular Imaging · doi:10.1007/s00259-012-2247-0 · Cited by 488
Haynes, R. B., McKibbon, K. A., Wilczynski, N. L., Walter, S. D., & Werre, S. R. (2005) · BMJ · doi:10.1136/bmj.38446.498542.8f · Cited by 439
Hatt, M., Majdoub, M., Vallières, M., Tixier, F., Le Rest, C. C., Groheux, D., Hindié, E., Martineau, A., Pradier, O., Hustinx, R., et al. (2015) · Journal of Nuclear Medicine · doi:10.2967/jnumed.114.144055 · Cited by 438
Leijenaar, R. T. H., Carvalho, S., Velazquez, E. R., van Elmpt, W. J. C., Parmar, C., Hoekstra, O. S., Hoekstra, C. J., Boellaard, R., Dekker, A. L. A. J., Gillies, R. J., et al. (2013) · Acta Oncologica · doi:10.3109/0284186x.2013.812798 · Cited by 427
Self-citationLarue, R. T. H. M., Defraene, G., De Ruysscher, D., Lambin, P., & van Elmpt, W. (2017) · The British Journal of Radiology · doi:10.1259/bjr.20160665 · Cited by 363
Orlhac, F., Soussan, M., Maisonobe, J.-A., Garcia, C. A., Vanderlinden, B., & Buvat, I. (2014) · Journal of Nuclear Medicine · doi:10.2967/jnumed.113.129858 · Cited by 356
Geersing, G.-J., Bouwmeester, W., Zuithoff, P., Spijker, R., Leeflang, M., & Moons, K. (2012) · PLoS ONE · doi:10.1371/journal.pone.0032844 · Cited by 350
False Discovery Rates in PET and CT Studies with Texture Features: A Systematic Review
Chalkidou, A., O’Doherty, M. J., & Marsden, P. K. (2015) · PLOS ONE · doi:10.1371/journal.pone.0124165 · Cited by 344
Galavis, P. E., Hollensen, C., Jallow, N., Paliwal, B., & Jeraj, R. (2010) · Acta Oncologica · doi:10.3109/0284186x.2010.498437 · Cited by 344
Radiomic phenotype features predict pathological response in non-small cell lung cancer
Coroller, T. P., Agrawal, V., Narayan, V., Hou, Y., Grossmann, P., Lee, S. W., Mak, R. H., & Aerts, H. J. W. L. (2016) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2016.04.004 · Cited by 327
Spearman Correlation Coefficients, Differences between
Myers, L., & Sirois, M. J. (2004) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess5050 · Cited by 321
Tixier, F., Hatt, M., Le Rest, C. C., Le Pogam, A., Corcos, L., & Visvikis, D. (2012) · Journal of Nuclear Medicine · doi:10.2967/jnumed.111.099127 · Cited by 318
ibex: An open infrastructure software platform to facilitate collaborative work in radiomics
Zhang, L., Fried, D. V., Fave, X. J., Hunter, L. A., Yang, J., & Court, L. E. (2015) · Medical Physics · doi:10.1118/1.4908210 · Cited by 316
CT texture analysis using the filtration-histogram method: what do the measurements mean?
Miles, K. A., Ganeshan, B., & Hayball, M. P. (2013) · Cancer Imaging · doi:10.1102/1470-7330.2013.9045 · Cited by 308
Reproducibility and Prognosis of Quantitative Features Extracted from CT Images
Balagurunathan, Y., Gu, Y., Wang, H., Kumar, V., Grove, O., Hawkins, S., Kim, J., Goldgof, D. B., Hall, L. O., Gatenby, R. A., et al. (2014) · Translational Oncology · doi:10.1593/tlo.13844 · Cited by 306
Self-citationvan Velden, F. H. P., Kramer, G. M., Frings, V., Nissen, I. A., Mulder, E. R., de Langen, A. J., Hoekstra, O. S., Smit, E. F., & Boellaard, R. (2016) · Molecular Imaging and Biology · doi:10.1007/s11307-016-0940-2 · Cited by 286
Cross-validation as the objective function for variable-selection techniques
Baumann, K. (2003) · TrAC Trends in Analytical Chemistry · doi:10.1016/s0165-9936(03)00607-1 · Cited by 248
Three-dimensional solid texture analysis in biomedical imaging: Review and opportunities
Depeursinge, A., Foncubierta-Rodriguez, A., Van De Ville, D., & Müller, H. (2014) · Medical Image Analysis · doi:10.1016/j.media.2013.10.005 · Cited by 244
Impact of Image Reconstruction Settings on Texture Features in 18F-FDG PET
Yan, J., Chu-Shern, J. L., Loi, H. Y., Khor, L. K., Sinha, A. K., Quek, S. T., Tham, I. W. K., & Townsend, D. (2015) · Journal of Nuclear Medicine · doi:10.2967/jnumed.115.156927 · Cited by 242
Fried, D. V., Tucker, S. L., Zhou, S., Liao, Z., Mawlawi, O., Ibbott, G., & Court, L. E. (2014) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2014.07.020 · Cited by 213
Hatt, M., Tixier, F., Cheze Le Rest, C., Pradier, O., & Visvikis, D. (2013) · European Journal of Nuclear Medicine and Molecular Imaging · doi:10.1007/s00259-013-2486-8 · Cited by 208
Test–Retest Data for Radiomics Feature Stability Analysis: Generalizable or Study-Specific?
van Timmeren, J. E., Leijenaar, R. T. H., van Elmpt, W., Wang, J., Zhang, Z., Dekker, A., & Lambin, P. (2016) · Tomography · doi:10.18383/j.tom.2016.00208 · Cited by 191
Self-citationSearching for Clinical Prediction Rules in MEDLINE
Ingui, B. J., & Rogers, M. A. M. (2001) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2001.0080391 · Cited by 184
Fave, X., Mackin, D., Yang, J., Zhang, J., Fried, D., Balter, P., Followill, D., Gomez, D., Kyle Jones, A., Stingo, F., et al. (2015) · Medical Physics · doi:10.1118/1.4934826 · Cited by 171
Texture analysis of medical images for radiotherapy applications
Scalco, E., & Rizzo, G. (2017) · The British Journal of Radiology · doi:10.1259/bjr.20160642 · Cited by 165
Desseroit, M.-C., Tixier, F., Weber, W. A., Siegel, B. A., Cheze Le Rest, C., Visvikis, D., & Hatt, M. (2017) · Journal of Nuclear Medicine · doi:10.2967/jnumed.116.180919 · Cited by 160
Bulakbasi, N., Guvenc, I., Onguru, O., Erdogan, E., Tayfun, C., & Ucoz, T. (2004) · Journal of Computer Assisted Tomography · doi:10.1097/00004728-200411000-00003 · Cited by 159
PET Radiomics in NSCLC: state of the art and a proposal for harmonization of methodology
Sollini, M., Cozzi, L., Antunovic, L., Chiti, A., & Kirienko, M. (2017) · Scientific Reports · doi:10.1038/s41598-017-00426-y · Cited by 158
Exploring Variability in CT Characterization of Tumors: A Preliminary Phantom Study
Zhao, B., Tan, Y., Tsai, W. Y., Schwartz, L. H., & Lü, L. (2014) · Translational Oncology · doi:10.1593/tlo.13865 · Cited by 150
Image biomarker standardisation initiativePreprint
Zwanenburg, A., Leger, S., Vallières, M., & Löck, S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.07003 · Cited by 146
Oliver, J. A., Budzevich, M. M., Zhang, G. G., Dilling, T. J., Latifi, K., & Moros, E. G. (2015) · Translational Oncology · doi:10.1016/j.tranon.2015.11.013 · Cited by 129
Kalpathy–Cramer, J., Mamomov, A., Zhao, B., Lü, L., Cherezov, D., Napel, S. A., Echegaray, S., Rubin, D. L., McNitt‐Gray, M. F., Lo, P., et al. (2016) · Tomography · doi:10.18383/j.tom.2016.00235 · Cited by 129
Self-citationEmaminejad, N., Qian, W., Guan, Y., Tan, M., Qiu, Y., Liu, H., & Zheng, B. (2015) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2015.2477688 · Cited by 128
Fave, X. J., Zhang, L., Yang, J., Mackin, D., Balter, P. A., Gómez, D. D. L. R., Followill, D. S., Jones, A. K., Stingo, F. C., & Court, L. E. (2016) · Translational Cancer Research · doi:10.21037/tcr.2016.07.11 · Cited by 121
Lu, L., Lv, W., Jiang, J., Ma, J., Feng, Q., Rahmim, A., & Chen, W. (2016) · Molecular Imaging and Biology · doi:10.1007/s11307-016-0973-6 · Cited by 117
Desseroit, M.-C., Visvikis, D., Tixier, F., Majdoub, M., Perdrisot, R., Guillevin, R., Rest, C. C. L., & Hatt, M. (2016) · European Journal of Nuclear Medicine and Molecular Imaging · doi:10.1007/s00259-016-3325-5 · Cited by 116
Huynh, E., Coroller, T. P., Narayan, V., Agrawal, V., Romano, J., Franco, I. “., Parmar, C., Hou, Y., Mak, R. H., & Aerts, H. J. W. L. (2017) · PLoS ONE · doi:10.1371/journal.pone.0169172 · Cited by 113
Preliminary investigation into sources of uncertainty in quantitative imaging features
Fave, X. J., Cook, M. C., Frederick, A., Zhang, L., Yang, J., Fried, D., Stingo, F. C., & Court, L. E. (2015) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2015.04.006 · Cited by 105
Alobaidli, S., McQuaid, S. J., South, C., Prakash, V., Evans, P., & Nisbet, A. (2014) · British Journal of Radiology · doi:10.1259/bjr.20140369 · Cited by 101
Grootjans, W., Tixier, F., van der Vos, C. S., Vriens, D., Rest, C. C. L., Bussink, J., Oyen, W. J. G., de Geus‐Oei, L., Visvikis, D., & Visser, E. P. (2016) · Journal of Nuclear Medicine · doi:10.2967/jnumed.116.173112 · Cited by 87
The precision of textural analysis in 18F-FDG-PET scans of oesophageal cancer
Doumou, G., Siddique, M. M., Tsoumpas, C., Goh, V., & Cook, G. (2015) · European Radiology · doi:10.1007/s00330-015-3681-8 · Cited by 84
Reproducibility with repeat CT in radiomics study for rectal cancer
Hu, P., Wang, J., Zhong, H., Zhou, Z., Shen, L., Hu, W., & Zhang, Z. (2016) · Oncotarget · doi:10.18632/oncotarget.12199 · Cited by 74
Yip, S. S. F., McCall, K. C., Aristophanous, M., Chen, A. B., Aerts, H. J. W. L., & Berbeco, R. (2014) · PLoS ONE · doi:10.1371/journal.pone.0115510 · Cited by 71
Bagher‐Ebadian, H., Siddiqui, F., Liu, C., Movsas, B., & Chetty, I. J. (2017) · Medical Physics · doi:10.1002/mp.12188 · Cited by 66
Lo, P., Young, S., Kim, H. J., Brown, M. S., & McNitt‐Gray, M. F. (2016) · Medical Physics · doi:10.1118/1.4954845 · Cited by 62
Stability of radiomic features in CT perfusion maps
Bogowicz, M., Riesterer, O., Bundschuh, R. A., Veit‐Haibach, P., Hüllner, M. W., Studer, G., Stieb, S., Glatz, S., Pruschy, M. N., Gückenberger, M., et al. (2016) · Physics in Medicine and Biology · doi:10.1088/1361-6560/61/24/8736 · Cited by 62
Buch, K. A., Li, B., Qureshi, M. M., Kuno, H., Anderson, S. W., & Sakai, O. (2017) · American Journal of Neuroradiology · doi:10.3174/ajnr.a5139 · Cited by 57
Lasnon, C., Majdoub, M., Lavigne, B., Dô, P., Madelaine, J., Visvikis, D., Hatt, M., & Aide, N. (2016) · European Journal of Nuclear Medicine and Molecular Imaging · doi:10.1007/s00259-016-3441-2 · Cited by 53
A Study on the Basic Criteria for Selecting Heterogeneity Parameters of F18-FDG PET Images
Forgács, A., Jonsson, H. P., Dahlbom, M. L., Daver, F., DiFranco, M. D., Opposits, G., Krizsan, A. K., Garai, I., Czernin, J., Varga, J., et al. (2016) · PLoS ONE · doi:10.1371/journal.pone.0164113 · Cited by 50
Guan, Y., Li, W., Jiang, Z., Chen, Y., Liu, S., He, J., Zhou, Z., & Ge, Y. (2016) · Academic Radiology · doi:10.1016/j.acra.2016.08.010 · Cited by 44
Predicting Future Morphological Changes of Lesions from Radiotracer Uptake in 18F-FDG-PET Images
Bağcı, U., Yao, J., Miller-Jaster, K., Chen, X., & Mollura, D. J. (2013) · PLoS ONE · doi:10.1371/journal.pone.0057105 · Cited by 38
Image-based surrogate biomarkers for molecular subtypes of colorectal cancer
Popovici, V. C., Budínská, E., Dušek, L., Kozubek, M., & Bosman, F. T. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btx027 · Cited by 30
Kim, H. G., Chung, Y. E., Lee, Y. H., et al. (2014) · Yonsei Medical Journal · doi:10.3349/ymj.2015.56.1.253 · Cited by 27
Cheng, N.-M., Fang, Y.-H. D., Tsan, D., Hsu, C., & Yen, T. (2016) · PLoS ONE · doi:10.1371/journal.pone.0150509 · Cited by 23
Koo, H. J., Sung, Y. S., Shim, W. H., Xu, H., Choi, C., Kim, H. R., Lee, J. B., & Kim, M. Y. (2017) · PLoS ONE · doi:10.1371/journal.pone.0167955 · Cited by 16
Cited by
Zwanenburg, A., Vallières, M., Abdalah, M. A., Aerts, H. J. W. L., Andrearczyk, V., Apte, A., Ashrafinia, S., Bakas, S., Beukinga, R. J., Boellaard, R., et al. (2020) · Radiology · doi:10.1148/radiol.2020191145 · Cited by 4,177
Self-citationPredicting cancer outcomes with radiomics and artificial intelligence in radiology
Bera, K., Braman, N., Gupta, A., Velcheti, V., & Madabhushi, A. (2022) · Nature Reviews Clinical Oncology · doi:10.1038/s41571-021-00560-7 · Cited by 819
Solving inverse problems using data-driven models
Arridge, S., Maass, P., Öktem, O., & Schönlieb, C.-B. (2019) · Acta Numerica · doi:10.1017/s0962492919000059 · Cited by 686
Kocak, B., Baessler, B., Bakas, S., Cuocolo, R., Fedorov, A., Maier-Hein, L., Mercaldo, N., Müller, H., Orlhac, F., Pinto dos Santos, D., et al. (2023) · Insights into Imaging · doi:10.1186/s13244-023-01415-8 · Cited by 471
Park, J. E., Park, S. Y., Kim, H. J., & Kim, H. S. (2019) · Korean Journal of Radiology · doi:10.3348/kjr.2018.0070 · Cited by 388
Metadata
- Authors
- Traverso, A., Wee, L., Dekker, A., & Gillies, R.
- Venue
- International Journal of Radiation Oncology*Biology*Physics
- Publisher
- Elsevier BV
- Published
- 2018-11
- Volume
- 102
- Issue
- 4
- Pages
- 1143-1158
- ISSN
- 0360-3016 (ISSN-L)
- OpenAlex
- W2806986802
- Cited by
- 903
- References
- 78
- FWCI
- 16.72
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.