The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Reproducibility of CT Radiomic Features within the Same Patient: Influence of Radiation Dose and CT Reconstruction Settings
Open accessAbstract
Background Results of recent phantom studies show that variation in CT acquisition parameters and reconstruction techniques may make radiomic features largely nonreproduceable and of limited use for prognostic clinical studies. Purpose To investigate the effect of CT radiation dose and reconstruction settings on the reproducibility of radiomic features, as well as to identify correction factors for mitigating these sources of variability. Materials and Methods This was a secondary analysis of a prospective study of metastatic liver lesions in patients who underwent staging with single-energy dual-source contrast material–enhanced staging CT between September 2011 and April 2012. Technique parameters were altered, resulting in 28 CT data sets per patient that included different dose levels, section thicknesses, kernels, and reconstruction algorithm settings. By using a training data set (n = 76), reproducible intensity, shape, and texture radiomic features (reproducibility threshold, R2 ≥ 0.95) were selected and correction factors were calculated by using a linear model to convert each radiomic feature to its estimated value in a reference technique. By using a test data set (n = 75), the reproducibility of hierarchical clustering based on 106 radiomic features measured with different CT techniques was assessed. Results Data in 78 patients (mean age, 60 years ± 10; 33 women) with 151 liver lesions were included. The percentage of radiomic features deemed reproducible for any variation of the different technical parameters was 11% (12 of 106). Of all technical parameters, reconstructed section thickness had the largest impact on the reproducibility of radiomic features (12.3% [13 of 106]) if only one technical parameter was changed while all other technical parameters were kept constant. The results of the hierarchical cluster analysis showed improved clustering reproducibility when reproducible radiomic features with dedicated correction factors were used (ρ = 0.39–0.71 vs ρ = 0.14–0.47). Conclusion Most radiomic features are highly affected by CT acquisition and reconstruction settings, to the point of being nonreproducible. Selecting reproducible radiomic features along with study-specific correction factors offers improved clustering reproducibility. © RSNA, 2019 Online supplemental material is available for this article. See also the editorial by Sosna in this issue.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“However, radiomic features are highly sensitive to CT acquisition and reconstruction parameters; features identified as strongly predictive in one scanner environment or protocol may not generalise to another.3839”
From Prognostication and clinical opportunities with AI for coronary artery calcium: a scoping review (2026) · cites this paper as [38]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Molecular portraits of human breast tumours
Perou, C., Sørlie, T., Eisen, M., van de Rijn, M., Jeffrey, S., Rees, C. A., Pollack, J., Ross, D., Johnsen, H., Akslen, L., et al. (2000) · Nature · doi:10.1038/35021093 · Cited by 16,551
Cluster analysis and display of genome-wide expression patterns
Eisen, M. B., Spellman, P. T., Brown, P. O., & Botstein, D. (1998) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.95.25.14863 · Cited by 16,184
Nishimura, R., Osako, T., Nishiyama, Y., Tashima, R., Nakano, M., Fujisue, M., Toyozumi, Y., & Arima, N. (2013) · Oncology · doi:10.1159/000353099 · Cited by 13,239
Radiomics: Images Are More than Pictures, They Are Data
Gillies, R. J., Kinahan, P. E., & Hricak, H. (2016) · Radiology · doi:10.1148/radiol.2015151169 · Cited by 8,421
Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach
Aerts, H. J. W. L., Velazquez, E. R., Leijenaar, R. T. H., Parmar, C., Grossmann, P., Carvalho, S., Bussink, J., Monshouwer, R., Haibe-Kains, B., Rietveld, D., et al. (2014) · Nature Communications · doi:10.1038/ncomms5006 · Cited by 5,132
Ki67 expression in breast cancer
Elkablawy, M. A., Albasri, A. M., Mohammed, R. A., Hussainy, A. S., Nouh, M. M., & Alhujaily, A. S. (2016) · Saudi Medical Journal · doi:10.15537/smj.2016.2.12285 · Cited by 4,382
dendextend: an R package for visualizing, adjusting and comparing trees of hierarchical clustering
Galili, T. (2015) · Bioinformatics · doi:10.1093/bioinformatics/btv428 · Cited by 1,826
Huang, Y., Liang, C., He, L., Tian, J., Liang, C., Chen, X., Ma, Z., & Liu, Z. (2016) · Journal of Clinical Oncology · doi:10.1200/jco.2015.65.9128 · Cited by 1,753
Choi, H., Charnsangavej, C., Faria, S., Macapinlac, H., Burgess, M., Patel, S. R., Chen, L. L., Podoloff, D., & Benjamin, R. (2007) · Journal of Clinical Oncology · doi:10.1200/jco.2006.07.3049 · Cited by 1,508
Sun, R., Limkin, E. J., Vakalopoulou, M., Dercle, L., Champiat, S., Han, S. R., Verlingue, L., Brandao, D., Lancia, A., Ammari, S., et al. (2018) · The Lancet Oncology · doi:10.1016/s1470-2045(18)30413-3 · Cited by 1,236
Flagged first, then by citations
Research works printed but not linked: 4
- Robins M, 2018, Proceedings of SPIE: medical imaging 2018—physics of medical imaging. Vol 10573, 105733W
- Midya A, 2018, J Med Imaging (Bellingham), 5, 011020
- R Development Core Team. R, 2010, A language and environment for statistical computing
- Hatt M, 2018, J Nucl Med, 59, 287
Cited by
Sorted by citations
Items 201–256 of 256
Kahmann, J., Nörenberg, D., Papavassiliu, T., Schoenberg, S. O., Froelich, M. F., & Ayx, I. (2024) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2024.1499219 · Cited by 2
Kinoshita, S., Nakaura, T., Yoshizumi, T., Itoh, S., Ide, T., Noshirο, H., Hamada, T., Kuroki, T., Takami, Y., Nagano, H., et al. (2024) · Hepatology Research · doi:10.1111/hepr.14149 · Cited by 2
Liu, Y., Yin, H., Li, J. J., Wang, Z., Wang, W., & Cui, S. (2025) · Abdominal Radiology · doi:10.1007/s00261-025-05162-w · Cited by 2
Radiomics in non-oncologic musculoskeletal diseases: from pixels to practice
Oh, J., Hong, S. H., Choi, J., Yoo, H. J., & Chae, H.-D. (2025) · Clinical Radiology · doi:10.1016/j.crad.2025.107106 · Cited by 2
Ilyushenkova, J. N., Sazonova, S. I., Popov, E. V., Zavadovsky, K. V., Batalov, R. E., Александрович, А. Е., Moskovskih, T., Popov, S. V., Minin, S. M., & Romanov, A. (2022) · Research Square · doi:10.21203/rs.3.rs-1456502/v1 · Cited by 2
Tan, Z., Mei, H., Qin, C., Zhang, X., Yang, M., Zhang, L., & Wang, J. (2023) · Scientific Reports · doi:10.1038/s41598-023-45198-w · Cited by 1
Li, Z., Gao, Y., Zhang, K., Wang, J., Han, L., Xie, B., Sun, Y., Yan, R., Li, Y., & Cui, H. (2025) · Clinical Radiology · doi:10.1016/j.crad.2025.107092 · Cited by 1
Chen, X., Xia, S., Jiang, H., Lv, F., Yu, Q., Ning, Y., Xie, K., Li, Q., Liu, R., Zhou, Y., et al. (2025) · Scientific Reports · doi:10.1038/s41598-025-23809-y · Cited by 1
Li, Z., Huang, T., Zhang, L., Zhai, X., Zhao, Q., Lu, H., Xu, Q., Han, L., Wang, J., Zhang, G., et al. (2025) · Academic Radiology · doi:10.1016/j.acra.2025.10.052 · Cited by 1
Zhou, Q., Lin, C., Jiang, J., Li, Y., Yu, Y., Huang, S., Han, C., Shi, L., & Shi, L. (2026) · Insights into Imaging · doi:10.1186/s13244-025-02179-z · Cited by 1
Influence of scan mode, tilt, and radiation dose on CT radiomic metrics
Yadav, N., Lei, X., Cen, S. Y., Levy, J., Jensen, K., & Varghese, B. A. (2026) · Journal of Applied Clinical Medical Physics · doi:10.1002/acm2.70462 · Cited by 1
Toward Robust and Generalizable Radio(gen)omics Predictive Models for Brain Tumor Characterization
Nadeem, M., Shaheen, A., Chaudhary, M. F. A., & Mohy‐ud‐Din, H. (2026) · American Journal of Neuroradiology · doi:10.3174/ajnr.a9229 · Cited by 1
Multicenter peritumoral radiomics in oncology: advances, challenges, and future directions
Li, J., Wei, J., Pan, R., Ma, D., Xie, Z., & Gao, Z. (2026) · Radiation Oncology · doi:10.1186/s13014-026-02817-w · Cited by 1
Photon-counting Detector CT Spectral Reconstructions for Radiomics-based Liver Lesion Classification
Pietsch, F. L., Vellala, A. K., Haag, F., Hertel, A., Contreras, J., Kaviani, P., Burade, A., Nörenberg, D., Schmidt, B., Schoenberg, S. O., et al. (2026) · Investigative Radiology · doi:10.1097/rli.0000000000001279 · Cited by 1
Wu, J., Zhang, Y., Wang, J., Chen, C., Hu, S., & Chen, W. (2026) · Journal of Medical Internet Research · doi:10.2196/84223 · Cited by 1
Zhou, Y., Yu, B., Chang, R., Ding, Y., Wang, Y., & Han, M. (2026) · Frontiers in Immunology · doi:10.3389/fimmu.2026.1792331 · Cited by 1
Ding, Y., Meyer, M., Lyu, P., Rigiroli, F., Ramírez-Giraldo, J. C., Lafata, K. J., Yang, S., & Marin, D. (2021) · Acta Radiologica · doi:10.1177/02841851211010396 · Cited by 1
Self-citationData Harmonization to Address the Non-biological Variances in Radiomic Studies
Yang, N., Xing, X., & Yang, G. (2023) · Imaging informatics for healthcare professionals · doi:10.1007/978-3-031-48446-9_5 · Cited by 1
Medical imaging and artificial intelligence
Goatman, K. A. (2025) · Elsevier eBooks · doi:10.1016/b978-0-323-95311-5.00005-1 · Cited by 1
Erasmus, J. J., & Vlahos, I. (2023) · Journal of Thoracic Oncology · doi:10.1016/j.jtho.2023.02.012 · Cited by 1
Prognostication and clinical opportunities with AI for coronary artery calcium: a scoping review
McDonald, V. J. F., Parsa, S., Mastrodicasa, D., Rodriguez, F., Langlotz, C., Maron, D. J., Sandhu, A. T., Dudum, R., & Jain, S. S. (2026) · BMJ Digital Health & AI · doi:10.1136/bmjdh-2026-000053
Du, D., Gu, J., Chen, X., Lv, W., Feng, Q., Rahmim, A., Wu, H., & Lu, L. (2021) · Molecular Imaging and Biology · doi:10.1007/s11307-021-01634-9
Quality-preserving low-cost probabilistic 3D denoising with applications to Computed TomographyPreprint
Horenko, I., Pospíšil, L., Vecchi, E., Albrecht, S., Gerber, A., Rehbock, B., Stroh, A., & Gerber, S. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.08.10.455778
Zhang, C. (2011) · OpenGrey (Institut de l'Information Scientifique et Technique)
Radiomic Phenotyping of the Lung Parenchyma: Feasibility Study in a Screening CohortPreprint
Haghighi, B., Horng, H., Noël, P. B., Cohen, E. A., Pantalone, L., Vachani, A., Rendle, K. A. S., Wainwright, J. V., Saia, C. A., Shinohara, R. T., et al. (2021) · Research Square · doi:10.21203/rs.3.rs-1086873/v1
Beyond the AJR: Radiomics Meets Machine Learning to Improve Outcome Prediction
Cecco, C. N. D., & Monti, C. B. (2022) · American Journal of Roentgenology · doi:10.2214/ajr.22.27740
Kolossváry, M., & Maurovich‐Horvat, P. (2022) · Contemporary medical imaging · doi:10.1007/978-3-030-92087-6_31
Refaee, T. (2022) · doi:10.26481/dis.20220712tr
AI applications in routine clinical imaging
Vaidyanathan, A. (2023) · Research Publications (Maastricht University) · doi:10.26481/dis.20230228av
Robust framework for COVID-19 identication from a multicenter dataset of chest CT scans
Khademi, S., Heidarian, S., Afshar, P., Enshaei, N., Naderkhani, F., Rafiee, M. J., Oikonomou, A., Shafiee, A., Fard, F. B., Plataniotis, K. N., et al. (2023) · PLoS ONE · doi:10.1371/journal.pone.0282121 · Cited by 1
Generative models improve radiomics
Chen, J. (2023) · Research Publications (Maastricht University) · doi:10.26481/dis.20230703jc
Effects of Reconstruction Filter Kernels in Computed Tomography on Radiomic Image Features
Sweetland, K., Chu, K. C. W., Lei, X., Cen, S., Duddalwar, V. A., Varghese, B. A., & Hwang, D. (2023) · International Symposium on Medical Information Processing and Analysis (SIPAIM) · doi:10.1109/sipaim56729.2023.10373503
Weighted sparse constraint-based reconstruction networks for sparse view CT imaging
Kang, Y., Liu, J., Liu, T., & Qiang, J. (2024) · International Conference on Graphics and Image Processing (ICGIP) · doi:10.1117/12.3019505
Advances in Exosomes in the Early Diagnosis of Digestive System Tumor
谭, 聪. (2024) · Advances in Clinical Medicine · doi:10.12677/acm.2024.1482180
Sweetland, K., Duddalwar, V. A., Varghese, B. A., & Hwang, D. (2024) · International Symposium on Medical Information Processing and Analysis (SIPAIM) · doi:10.1109/sipaim62974.2024.10783514
D’hondt, L., Buytaert, D., Kellens, P., Snoeckx, A., & Bacher, K. (2025) · European Radiology Experimental · doi:10.1186/s41747-025-00644-4
Wang, J.-C., Fu, R., Tao, X.-W., Mao, Y.-F., Wang, F., Zhang, Z.-C., Yu, W.-W., Chen, J., He, J., & Sun, B.-C. (2020) · Figshare · doi:10.6084/m9.figshare.12972268
Park, S.-H., Lim, H., Bae, B. K., Hahm, M. H., Chong, G. O., Jeong, S. Y., & Kim, J.-C. (2021) · Figshare · doi:10.6084/m9.figshare.13698140
Wolf, E. V., Müller, L., Schoepf, U. J., Fink, N., Griffith, J. P., Zsarnóczay, E., Baruah, D., Suranyi, P. S., Kabakus, I. M., Halfmann, M. C., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26621887
Wang, J.-C., Fu, R., Tao, X.-W., Mao, Y.-F., Wang, F., Zhang, Z.-C., Yu, W.-W., Chen, J., He, J., & Sun, B.-C. (2020) · Figshare · doi:10.6084/m9.figshare.12972271
Park, S.-H., Lim, H., Bae, B. K., Hahm, M. H., Chong, G. O., Jeong, S. Y., & Kim, J.-C. (2021) · Figshare · doi:10.6084/m9.figshare.13698137
Park, S.-H., Lim, H., Bae, B. K., Hahm, M. H., Chong, G. O., Jeong, S. Y., & Kim, J.-C. (2021) · Figshare · doi:10.6084/m9.figshare.13698134
Artificial Intelligence in Lung Cancer Management: Innovations, Challenges, and Clinical Translation
Jiang, Q., Qiu, J., & KarkonShayan, F. (2026) · Neural Processing Letters · doi:10.1007/s11063-026-11836-3
Asiain, M. M., Amirian, M., del Toro, Ó. J., Aberle, C., Schaer, R., Bach, M., Obmann, M. M., Flouris, K., Müller, H., Stieltjes, B., et al. (2026) · Medical Physics · doi:10.1002/mp.70374
Quantitative Assessment of Lung Nodule: Deep Learning and Radiomics
Hwang, E. J., & Goo, J. M. (2026) · Springer eBooks · doi:10.1007/978-3-032-14103-3_20
Zheng, J., Huang, H., Li, W., Li, S., Liu, J., Lu, Z., Yan, C., & Zhang, W. (2026) · The Innovation Oncology · doi:10.59717/j.xinn-oncol.2026.100011
Sensoy, L., Rich, B. J., Samuels, S. E., Dogan, N., & Delgadillo, R. (2026) · Frontiers in Oncology · doi:10.3389/fonc.2026.1830230
Heidemeier, A., Huflage, H., Rasche, L., Kortüm, K. M., Waldschmidt, J., Einsele, H., Bley, T. A., & Grunz, J. (2026) · Investigative Radiology · doi:10.1097/rli.0000000000001304
Asano, M., Noda, Y., Kawai, N., Kaga, T., Omata, S., Takai, Y., Ito, A., Iwata, T., Miyoshi, T., Elhelaly, A. E., et al. (2026) · Abdominal Radiology · doi:10.1007/s00261-026-05671-2
Zhang, B., Zhuo, Y., Zhan, Y., Song, F., Zhang, Z., & Shan, F. (2026) · Radiology Cardiothoracic Imaging · doi:10.1148/ryct.250464
Huflage, H., Scheiner, F., Grunz, J., Kunz, A. S., Feldle, P., Müller, L., Bley, T. A., & Heidemeier, A. (2026) · Academic Radiology · doi:10.1016/j.acra.2026.08.065
Shen, X., Liu, Z., Yu, W., Li, F., Lu, Y., Li, M., Sun, P., & Liu, A. (2026) · Frontiers in Immunology · doi:10.3389/fimmu.2026.1970256
Nedelcu, A. H., Anton, E., Lupu, A., Ţepordei, R. T., Vicoleanu, S. A. P., Dumitrescu, A. M., Crauciuc, D. V., Chirica, V. A., Morariu, I. D., Lupu, V. V., et al. (2026) · Medical Sciences · doi:10.3390/medsci14060639
Liu, Y., Peng, Y., Chen, F., Huang, J., Yang, J., & Zhong, J. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1955926
Zhu, H., Wei, T., Wang, L., Zhu, L., Chen, Q., Tao, G., Sun, L., Sun, X., Huang, Z., & Yu, H. (2026) · Insights into Imaging · doi:10.1186/s13244-026-02417-y
Metadata
- Authors
- Meyer, M., Ronald, J., Vernuccio, F., Nelson, R. C., Ramirez-Giraldo, J. C., Solomon, J., Patel, B. N., Samei, E., & Marin, D.
- Affiliations
- Heidelberg University (DE)
- ORCID
- Venue
- Radiology
- Published
- 2019-12
- Volume
- 293
- Issue
- 3
- Pages
- 583-591
- ISSN
- 0033-8419 (ISSN-L)
- 1527-1315
- PMC
- PMC10860741
- OpenAlex
- W2977270522
- Cited by
- 258
- References
- 25
- Citations by year
- 2026: 25 · 2025: 23 · 2024: 32 · 2023: 44 · 2022: 51 · 2021: 57 · 2020: 23 · 2019: 2
- FWCI
- 21.98
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Radiology (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Nova Science Publishers (Nova Science Publishers, Inc.) (submittedVersion)
- Funders
- Siemens Healthineers
- National Institute of Biomedical Imaging and Bioengineering (R01EB001838)
- Topics
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Medical Imaging Techniques and Applications
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiation Dose and Imaging
- Keywords
- CT radiomics, reproducibility, radiation dose, section thickness, kernel, reconstruction algorithms, correction factors, metastatic liver lesions, hierarchical clustering
- MeSH terms
- Algorithms, Contrast Media, Female, Humans, Liver Neoplasms, Male, Middle Aged, Neoplasm Staging, Prospective Studies, Radiation Dosage, Radiographic Image Interpretation, Computer-Assisted, Tomography, X-Ray Computed, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
