Reproducibility of CT Radiomic Features within the Same Patient: Influence of Radiation Dose and CT Reconstruction Settings
Open accessAbstract
Background Results of recent phantom studies show that variation in CT acquisition parameters and reconstruction techniques may make radiomic features largely nonreproduceable and of limited use for prognostic clinical studies. Purpose To investigate the effect of CT radiation dose and reconstruction settings on the reproducibility of radiomic features, as well as to identify correction factors for mitigating these sources of variability. Materials and Methods This was a secondary analysis of a prospective study of metastatic liver lesions in patients who underwent staging with single-energy dual-source contrast material–enhanced staging CT between September 2011 and April 2012. Technique parameters were altered, resulting in 28 CT data sets per patient that included different dose levels, section thicknesses, kernels, and reconstruction algorithm settings. By using a training data set (n = 76), reproducible intensity, shape, and texture radiomic features (reproducibility threshold, R2 ≥ 0.95) were selected and correction factors were calculated by using a linear model to convert each radiomic feature to its estimated value in a reference technique. By using a test data set (n = 75), the reproducibility of hierarchical clustering based on 106 radiomic features measured with different CT techniques was assessed. Results Data in 78 patients (mean age, 60 years ± 10; 33 women) with 151 liver lesions were included. The percentage of radiomic features deemed reproducible for any variation of the different technical parameters was 11% (12 of 106). Of all technical parameters, reconstructed section thickness had the largest impact on the reproducibility of radiomic features (12.3% [13 of 106]) if only one technical parameter was changed while all other technical parameters were kept constant. The results of the hierarchical cluster analysis showed improved clustering reproducibility when reproducible radiomic features with dedicated correction factors were used (ρ = 0.39–0.71 vs ρ = 0.14–0.47). Conclusion Most radiomic features are highly affected by CT acquisition and reconstruction settings, to the point of being nonreproducible. Selecting reproducible radiomic features along with study-specific correction factors offers improved clustering reproducibility. © RSNA, 2019 Online supplemental material is available for this article. See also the editorial by Sosna in this issue.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Radiomic features are highly sensitive to CT acquisition and reconstruction parameters; features identified as strongly predictive in one scanner environment or protocol may not generalise to another.
“However, radiomic features are highly sensitive to CT acquisition and reconstruction parameters; features identified as strongly predictive in one scanner environment or protocol may not generalise to another.3839”
From Prognostication and clinical opportunities with AI for coronary artery calcium: a scoping review (2026) · cites this paper as [38]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Molecular portraits of human breast tumours
Perou, C., Sørlie, T., Eisen, M., van de Rijn, M., Jeffrey, S., Rees, C. A., Pollack, J., Ross, D., Johnsen, H., Akslen, L., et al. (2000) · Nature · doi:10.1038/35021093 · Cited by 16,551 · see citing works
Nishimura, R., Osako, T., Nishiyama, Y., Tashima, R., Nakano, M., Fujisue, M., Toyozumi, Y., & Arima, N. (2013) · Oncology · doi:10.1159/000353099 · Cited by 13,239 · see citing works
Cluster analysis and display of genome-wide expression patterns
Eisen, M. B., Spellman, P. T., Brown, P. O., & Botstein, D. (1998) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.95.25.14863 · Cited by 12,617 · see citing works
Radiomics: Images Are More than Pictures, They Are Data
Gillies, R. J., Kinahan, P. E., & Hricak, H. (2016) · Radiology · doi:10.1148/radiol.2015151169 · Cited by 8,421 · see citing works
Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach
Aerts, H. J. W. L., Velazquez, E. R., Leijenaar, R. T. H., Parmar, C., Grossmann, P., Carvalho, S., Bussink, J., Monshouwer, R., Haibe-Kains, B., Rietveld, D., et al. (2014) · Nature Communications · doi:10.1038/ncomms5006 · Cited by 5,132 · see citing works
Ki67 expression in breast cancer
Elkablawy, M. A., Albasri, A. M., Mohammed, R. A., Hussainy, A. S., Nouh, M. M., & Alhujaily, A. S. (2016) · Saudi Medical Journal · doi:10.15537/smj.2016.2.12285 · Cited by 4,382 · see citing works
dendextend: an R package for visualizing, adjusting and comparing trees of hierarchical clustering
Galili, T. (2015) · Bioinformatics · doi:10.1093/bioinformatics/btv428 · Cited by 1,826 · see citing works
Huang, Y., Liang, C., He, L., Tian, J., Liang, C., Chen, X., Ma, Z., & Liu, Z. (2016) · Journal of Clinical Oncology · doi:10.1200/jco.2015.65.9128 · Cited by 1,745 · see citing works
Choi, H., Charnsangavej, C., Faria, S., Macapinlac, H., Burgess, M., Patel, S. R., Chen, L. L., Podoloff, D., & Benjamin, R. (2007) · Journal of Clinical Oncology · doi:10.1200/jco.2006.07.3049 · Cited by 1,508 · see citing works
Sun, R., Limkin, E. J., Vakalopoulou, M., Dercle, L., Champiat, S., Han, S. R., Verlingue, L., Brandao, D., Lancia, A., Ammari, S., et al. (2018) · The Lancet Oncology · doi:10.1016/s1470-2045(18)30413-3 · Cited by 1,236 · see citing works
Imaging biomarker roadmap for cancer studies
O'Connor, J. P. B., Aboagye, E. O., Adams, J. E., Aerts, H. J. W. L., Barrington, S. F., Beer, A. J., Boellaard, R., Bohndiek, S. E., Brady, M., Brown, G., et al. (2017) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2016.162 · Cited by 1,091 · see citing works
CT Texture Analysis: Definitions, Applications, Biologic Correlates, and Challenges
Lubner, M. G., Smith, A. D., Sandrasegaran, K., Sahani, D. V., & Pickhardt, P. J. (2017) · Radiographics · doi:10.1148/rg.2017170056 · Cited by 775 · see citing works
Measuring Computed Tomography Scanner Variability of Radiomics Features
Mackin, D., Fave, X. J., Zhang, L., Fried, D., Yang, J., Taylor, B. A., Rodriguez-Rivera, E., Dodge, C. T., Jones, A. K., & Court, L. E. (2015) · Investigative Radiology · doi:10.1097/rli.0000000000000180 · Cited by 649 · see citing works
Berenguer, R., Pastor-Juan, M. D. R., Canales‐Vázquez, J., Castro‐García, M., Villas, M. V., Legorburo, F. M., & Sabater, S. (2018) · Radiology · doi:10.1148/radiol.2018172361 · Cited by 622 · see citing works
Intrinsic dependencies of CT radiomic features on voxel size and number of gray levels
Shafiq‐ul‐Hassan, M., Zhang, G. G., Latifi, K., Ullah, G., Hunt, D., Balagurunathan, Y., Abdalah, M. A., Schabath, M. B., Goldgof, D. B., Mackin, D., et al. (2017) · Medical Physics · doi:10.1002/mp.12123 · Cited by 587 · see citing works
Validation of A Method to Compensate Multicenter Effects Affecting CT Radiomics
Orlhac, F., Frouin, F., Nioche, C., Ayache, N., & Buvat, I. (2019) · Radiology · doi:10.1148/radiol.2019182023 · Cited by 413 · see citing works
Inter-observer variability of manual contour delineation of structures in CT
Joskowicz, L., Cohen, D., Caplan, N., & Sosna, J. (2018) · European Radiology · doi:10.1007/s00330-018-5695-5 · Cited by 271 · see citing works
Influence of inter-observer delineation variability on radiomics stability in different tumor sites
Pavic, M., Bogowicz, M., Würms, X., Glatz, S., Finazzi, T., Riesterer, O., Roesch, J., Rudofsky, L., Friess, M., Veit‐Haibach, P., et al. (2018) · Acta Oncologica · doi:10.1080/0284186x.2018.1445283 · Cited by 202 · see citing works
Assessing Agreement between Radiomic Features Computed for Multiple CT Imaging Settings
Lü, L., Ehmke, R., Schwartz, L. H., & Zhao, B. (2016) · PLoS ONE · doi:10.1371/journal.pone.0166550 · Cited by 159 · see citing works
PET Radiomics in NSCLC: state of the art and a proposal for harmonization of methodology
Sollini, M., Cozzi, L., Antunovic, L., Chiti, A., & Kirienko, M. (2017) · Scientific Reports · doi:10.1038/s41598-017-00426-y · Cited by 158 · see citing works
Kim, H., Park, C. M., Lee, M., Park, S. J., Song, Y., Lee, J. H., Hwang, E. J., & Goo, J. M. (2016) · PLoS ONE · doi:10.1371/journal.pone.0164924 · Cited by 143 · see citing works
Influence of CT acquisition and reconstruction parameters on radiomic feature reproducibility
Midya, A., Chakraborty, J., Gönen, M., Gian, R. K., & Simpson, A. L. (2018) · Journal of medical imaging · doi:10.1117/1.jmi.5.1.011020 · Cited by 116 · see citing works
Solomon, J., Mileto, A., Nelson, R. C., Choudhury, K. R., & Samei, E. (2015) · Radiology · doi:10.1148/radiol.2015150892 · Cited by 108 · see citing works
Self-citation4DCT imaging to assess radiomics feature stability: An investigation for thoracic cancers
Larue, R. T. H. M., Voorde, L. V. D., van Timmeren, J. E., Leijenaar, R. T. H., Berbée, M., Sosef, M. N., Schreurs, W. M. J., van Elmpt, W., & Lambin, P. (2017) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2017.07.023 · Cited by 75 · see citing works
Smith, A. D., Zhang, X., Bryan, J. A., Souza, F., Roda, M. S., Sirous, R., Zhang, H., Vasanji, A., & Griswold, M. (2016) · Radiology · doi:10.1148/radiol.2016160143 · Cited by 28 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- [13]Robins M, Solomon J, Hoye J, Abadi E, Marin D, Samei E. How reliable are texture measurements? In: Lo JY, Gilat Schmidt T, Chen GH, eds. Proceedings of SPIE: medical imaging 2018—physics of medical imaging. Vol 10573. Bellingham, Wash: International Society for Optics and Photonics, 2018; 105733W.
Cited by
Sorted by citations
Zwanenburg, A., Vallières, M., Abdalah, M. A., Aerts, H. J. W. L., Andrearczyk, V., Apte, A., Ashrafinia, S., Bakas, S., Beukinga, R. J., Boellaard, R., et al. (2020) · Radiology · doi:10.1148/radiol.2020191145 · Cited by 4,177 · see citing works
AI applications to medical images: From machine learning to deep learning
Castiglioni, I., Rundo, L., Codari, M., Leo, G. D., Salvatore, C., Interlenghi, M., Gallivanone, F., Cozzi, A., D’Amico, N. C., & Sardanelli, F. (2021) · Physica Medica · doi:10.1016/j.ejmp.2021.02.006 · Cited by 737 · see citing works
Zhang, Y., Zhang, X., Cheng, Y., Li, B., Teng, X.-Z., Zhang, J., Lam, S., Zhou, T., Ma, Z., Sheng, J., et al. (2023) · Military Medical Research · doi:10.1186/s40779-023-00458-8 · Cited by 200 · see citing works
Wang, S., Yu, H., Gan, Y., Wu, J. Z., Li, E.-C., Li, X., Cao, J., Zhu, Y., Wang, L., Deng, H., et al. (2022) · The Lancet Digital Health · doi:10.1016/s2589-7500(22)00024-3 · Cited by 159 · see citing works
Yang, N., Ser, J. D., Walsh, S. L. F., Schönlieb, C., Roberts, M. T., SELBY, I. A., Howard, K., Owen, J., Neville, J., Guiot, J., et al. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.01.001 · Cited by 152 · see citing works
Radiomics feature reproducibility under inter-rater variability in segmentations of CT images
Haarburger, C., Müller-Franzes, G., Weninger, L., Kuhl, C., Truhn, D., & Merhof, D. (2020) · Scientific Reports · doi:10.1038/s41598-020-69534-6 · Cited by 139 · see citing works
Radiomics of Liver Metastases: A Systematic Review
Fiz, F., Viganò, L., Gennaro, N., Costa, G., Bella, L. L., Boichuk, A., Cavinato, L., Sollini, M., Politi, L. S., Chiti, A., et al. (2020) · Cancers · doi:10.3390/cancers12102881 · Cited by 111 · see citing works
Roy, S. S., Whitehead, T., Quirk, J. D., Salter, A. R., Ademuyiwa, F. O., Li, S., An, H., & Shoghi, K. I. (2020) · EBioMedicine · doi:10.1016/j.ebiom.2020.102963 · Cited by 106 · see citing works
Pfaehler, E. A. G., Zhovannik, I., Wei, L., Boellaard, R., Dekker, A. L. A. J., Monshouwer, R., Naqa, I. E., Bussink, J., Gillies, R. J., Wee, L., et al. (2021) · Physics and Imaging in Radiation Oncology · doi:10.1016/j.phro.2021.10.007 · Cited by 104 · see citing works
Radiomics in Stroke Neuroimaging: Techniques, Applications, and Challenges
Chen, Q., Xia, T., Zhang, M., Xia, N., Liu, J., & Yang, Y. (2021) · Aging and Disease · doi:10.14336/ad.2020.0421 · Cited by 96 · see citing works
Nair, J. K. R., Saeed, U. A., McDougall, C. C., Sabri, A., Kovacina, B., Raidu, B. V. S., Khokhar, R. A., Probst, S., Hirsh, V., Chankowsky, J., et al. (2020) · Canadian Association of Radiologists Journal · doi:10.1177/0846537119899526 · Cited by 92 · see citing works
Hong, J. H., Jung, J., Jo, A., Nam, Y., Pak, S., Lee, S. Y., Park, H., Lee, S., & Kim, S. (2021) · Radiology · doi:10.1148/radiol.2021203783 · Cited by 92 · see citing works
Reiazi, R., Abbas, E., Famiyeh, P., Rezaie, A., Kwan, J. Y. Y., Patel, T., Bratman, S. V., Tadic, T., Liu, F., & Haibe‐Kains, B. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104400 · Cited by 85 · see citing works
Radiomic Analysis: Study Design, Statistical Analysis, and Other Bias Mitigation Strategies
Moskowitz, C. S., Welch, M. L., Jacobs, M. A., Kurland, B. F., & Simpson, A. L. (2022) · Radiology · doi:10.1148/radiol.211597 · Cited by 81 · see citing works
Advances in liver US, CT, and MRI: moving toward the future
Vernuccio, F., Cannella, R., Bartolotta, T. V., Galia, M., Tang, A., & Brancatelli, G. (2021) · European Radiology Experimental · doi:10.1186/s41747-021-00250-0 · Cited by 79 · see citing works
Self-citationGrosu, S., Wesp, P., Graser, A., Maurus, S., Schulz, C., Knösel, T., Cyran, C. C., Ricke, J., Ingrisch, M., & Kazmierczak, P. M. (2021) · Radiology · doi:10.1148/radiol.2021202363 · Cited by 75 · see citing works
Hwang, E. J., & Park, C. M. (2020) · Korean Journal of Radiology · doi:10.3348/kjr.2019.0821 · Cited by 74 · see citing works
Razavi, A. C., Agatston, A. S., Shaw, L. J., Cecco, C. N. D., van Assen, M., Sperling, L. S., Bittencourt, M. S., Daubert, M. A., Nasir, K., Blumenthal, R. S., et al. (2022) · JACC. Cardiovascular imaging · doi:10.1016/j.jcmg.2022.02.026 · Cited by 71 · see citing works
Koçak, B. (2022) · Diagnostic and Interventional Radiology · doi:10.5152/dir.2022.211297 · Cited by 71 · see citing works
Xu, P., Xue, Y., Schoepf, U. J., Varga‐Szemes, Á., Griffith, J. P., Yacoub, B., Zhou, F., Zhou, C., Yang, Y., Xing, W., et al. (2021) · Circulation Cardiovascular Imaging · doi:10.1161/circimaging.120.011747 · Cited by 69 · see citing works
Must-have Qualities of Clinical Research on Artificial Intelligence and Machine Learning
Koçak, B., Cuocolo, R., Santos, D. P. D., Stanzione, A., & Ugga, L. (2023) · Balkan Medical Journal · doi:10.4274/balkanmedj.galenos.2022.2022-11-51 · Cited by 64 · see citing works
CT-based radiomics to predict the pathological grade of bladder cancer
Zhang, G., Xu, L., Zhao, L., Mao, L., Li, X., Jin, Z., & Sun, H. (2020) · European Radiology · doi:10.1007/s00330-020-06893-8 · Cited by 64 · see citing works
Yu, Q., Ning, Y., Wang, A., Li, S., Gu, J., Li, Q., Chen, X., Lv, F., Zhang, X., Yue, Q., et al. (2023) · European Radiology · doi:10.1007/s00330-023-09568-2 · Cited by 61 · see citing works
Park, B. W., Kim, J. K., Heo, C., & Park, K. J. (2020) · Scientific Reports · doi:10.1038/s41598-020-60868-9 · Cited by 60 · see citing works
Koçak, B., Kuş, E. A., & Kılıçkesmez, Ö. (2020) · European Radiology · doi:10.1007/s00330-020-07324-4 · Cited by 55 · see citing works
Integrative radiogenomics for virtual biopsy and treatment monitoring in ovarian cancer
Martín-González, P., Crispin‐Ortuzar, M., Rundo, L., Delgado-Ortet, M., Reinius, M., Beer, L., Woitek, R., Ursprung, S., Addley, H. C., Brenton, J. D., et al. (2020) · Insights into Imaging · doi:10.1186/s13244-020-00895-2 · Cited by 53 · see citing works
A radiomics-based model on non-contrast CT for predicting cirrhosis: make the most of image data
Wang, J., Fu, R., Tao, X., Mao, Y., Wang, F., Zhang, Z., Yu, W., Chen, J., He, J., & Sun, B. (2020) · Biomarker Research · doi:10.1186/s40364-020-00219-y · Cited by 50 · see citing works
Park, S.-H., Lim, H. J., Bae, B. K., Hahm, M. H., Chong, G. O., Jeong, S. Y., & Kim, J. (2021) · Cancer Imaging · doi:10.1186/s40644-021-00388-5 · Cited by 48 · see citing works
Impact of Preprocessing Parameters in Medical Imaging-Based Radiomic Studies: A Systematic Review
Trojani, V., Bassi, M. C., Verzellesi, L., & Bertolini, M. (2024) · Cancers · doi:10.3390/cancers16152668 · Cited by 47 · see citing works
Kolossváry, M., Gerstenblith, G., Bluemke, D. A., Fishman, E. K., Mandler, R. N., Kickler, T. S., Chen, S., Bhatia, S., Lai, S., & Lai, H. C. (2021) · Radiology · doi:10.1148/radiol.2021203179 · Cited by 47 · see citing works
Image-Based Generative Artificial Intelligence in Radiology: Comprehensive Updates
Jung, H. K., Kim, K., Park, J. E., & Kim, N. (2024) · Korean Journal of Radiology · doi:10.3348/kjr.2024.0392 · Cited by 45 · see citing works
Radiomics and Artificial Intelligence for Renal Mass Characterization
Lubner, M. G. (2020) · Radiologic Clinics of North America · doi:10.1016/j.rcl.2020.06.001 · Cited by 43 · see citing works
Han, D., Yu, N., Yu, Y., He, T., & Duan, X. (2022) · La radiologia medica · doi:10.1007/s11547-022-01526-0 · Cited by 41 · see citing works
Zhong, J., Xia, Y., Chen, Y., Li, J., Lu, W., Shi, X., Feng, J., Yan, F., Yao, W., & Zhang, H. (2022) · European Radiology · doi:10.1007/s00330-022-09119-1 · Cited by 40 · see citing works
Xu, Y., Lü, L., Sun, S. H., Linning, E., Lian, W., Yang, H., Schwartz, L. H., Yang, Z., & Zhao, B. (2021) · European Radiology · doi:10.1007/s00330-021-08274-1 · Cited by 40 · see citing works
Radiomics in Nasopharyngeal Carcinoma
Duan, W., Xiong, B., Tian, T., Zou, X., He, Z., & Zhang, L. (2022) · Clinical Medicine Insights Oncology · doi:10.1177/11795549221079186 · Cited by 39 · see citing works
Vernuccio, F., Arnone, F., Cannella, R., Verro, B., Comelli, A., Agnello, F., Stefano, A., Gargano, R., Rodolico, V., Salvaggio, G., et al. (2021) · British Journal of Radiology · doi:10.1259/bjr.20210340 · Cited by 38 · see citing works
Self-citationChen, Y., Zhong, J., Wang, L., Shi, X., Lu, W., Li, J., Feng, J., Xia, Y., Chang, J. R., Fan, J., et al. (2022) · European Radiology · doi:10.1007/s00330-022-08628-3 · Cited by 37 · see citing works
Michallek, F., Genske, U., Niehues, S. M., Hamm, B., & Jahnke, P. (2022) · European Radiology · doi:10.1007/s00330-022-08592-y · Cited by 37 · see citing works
Majumder, S., Katz, S., Kontos, D., & Roshkovan, L. (2023) · BJR|Open · doi:10.1093/bjro/tzad004 · Cited by 42 · see citing works
Artificial Intelligence-Based Treatment Decisions: A New Era for NSCLC
Fiste, O., Gkiozos, I., Charpidou, A., & Syrigos, N. (2024) · Cancers · doi:10.3390/cancers16040831 · Cited by 31 · see citing works
Li, Y., Reyhan, M. L., Zhang⋆, Y., Wang, X., Zhou, J., Zhang, Y., Yue, N. J., & Nie, K. (2022) · Medical Physics · doi:10.1002/mp.15491 · Cited by 36 · see citing works
CT based radiomic approach on first line pembrolizumab in lung cancer
Zerunian, M., Caruso, D., Zucchelli, A., Polici, M., Capalbo, C., Filetti, M., Mazzuca, F., Marchetti, P., & Laghi, A. (2021) · Scientific Reports · doi:10.1038/s41598-021-86113-5 · Cited by 35 · see citing works
Ren, H., Song, H., Wang, J., Xiong, H., Long, B., Gong, M., Liu, J., He, Z., Liu, L., Jiang, X., et al. (2023) · Insights into Imaging · doi:10.1186/s13244-023-01399-5 · Cited by 34 · see citing works
Prayer, F., Hofmanninger, J., Weber, M., Kifjak, D., Willenpart, A., Pan, J., Röhrich, S., Langs, G., & Prosch, H. (2020) · Methods · doi:10.1016/j.ymeth.2020.08.007 · Cited by 33 · see citing works
MRI Radiomics and Predictive Models in Assessing Ischemic Stroke Outcome—A Systematic Review
Dragoș, H.-M., Stan, A. D., Pintican, R. M., Feier, D. S., Lebovici, A., Panaitescu, P.-Ș., Dina, C., Strilciuc, Ș., & Muresanu, D. F. (2023) · Diagnostics · doi:10.3390/diagnostics13050857 · Cited by 34 · see citing works
New advances in radiomics of gastrointestinal stromal tumors
Cannella, R., Grutta, L. L., Midiri, M., & Bartolotta, T. V. (2020) · World Journal of Gastroenterology · doi:10.3748/wjg.v26.i32.4729 · Cited by 32 · see citing works
Lee, S. B., Cho, Y. J., Hong, Y., Jeong, D., Lee, J., Kim, S., Lee, S., & Choi, Y. H. (2021) · Investigative Radiology · doi:10.1097/rli.0000000000000839 · Cited by 32 · see citing works
Anan, N., Zainon, R., & Tamal, M. (2022) · Insights into Imaging · doi:10.1186/s13244-021-01153-9 · Cited by 32 · see citing works
Impact of image quality on radiomics applications
Cui, Y., & Yin, F.-F. (2022) · Physics in Medicine and Biology · doi:10.1088/1361-6560/ac7fd7 · Cited by 30 · see citing works
Radiomics and liver: Where we are and where we are headed?
Maino, C., Vernuccio, F., Cannella, R., Franco, P. N., Giannini, V., Dezio, M., Pisani, A. R., Blandino, A., Faletti, R., Bernardi, E. D., et al. (2024) · European Journal of Radiology · doi:10.1016/j.ejrad.2024.111297 · Cited by 30 · see citing works
Self-citationSensitivity of Myocardial Radiomic Features to Imaging Parameters in Cardiac MR Imaging
Jang, J., El-Rewaidy, H., Ngo, L. H., Mâncio, J., Csécs, I., Rodriguez, J., Pierce, P., Goddu, B., Neisius, U., Manning, W. J., et al. (2021) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.27581 · Cited by 30 · see citing works
Euler, A., Laqua, F. C., Cester, D., Lohaus, N., Sartoretti, T., dos Santos, D. P., Alkadhi, H., & Baeßler, B. (2021) · Cancers · doi:10.3390/cancers13184710 · Cited by 30 · see citing works
Teng, X., Wang, Y., Nicol, A. J., Ching, J. C. F., Wong, E. K. Y., Lam, K. T. C., Zhang, J., Lee, S. W. Y., & Cai, J. (2024) · Diagnostics · doi:10.3390/diagnostics14161835 · Cited by 30 · see citing works
Robustness of dual-energy CT-derived radiomic features across three different scanner types
Lennartz, S., O’Shea, A., Parakh, A., ten Persigehl, T., Baeßler, B., & Kambadakone, A. R. (2021) · European Radiology · doi:10.1007/s00330-021-08249-2 · Cited by 30 · see citing works
Hajianfar, G., Hosseini, S. A., Bagherieh, S., Oveisi, M., Shiri, I., & Zaidi, H. (2024) · Medical & Biological Engineering & Computing · doi:10.1007/s11517-024-03071-6 · Cited by 28 · see citing works
Emaminejad, N., Wahi‐Anwar, M., Kim, G. H. J., Hsu, W. W. Y., Brown, M. S., & McNitt‐Gray, M. F. (2021) · Medical Physics · doi:10.1002/mp.14830 · Cited by 28 · see citing works
Reproducibility and Repeatability of CBCT-Derived Radiomics Features
Wang, H., Zhou, Y., Wang, X., Zhang, Y., Ma, C., Liu, B., Kong, Q., Yue, N. J., Xu, Z., & Nie, K. (2021) · Frontiers in Oncology · doi:10.3389/fonc.2021.773512 · Cited by 28 · see citing works
Masson, I., Da‐ano, R., Lucia, F., Dore, M., Castelli, J., de Monsabert, C. G., Ramée, J., Sellami, S., Visvikis, D., Hatt, M., et al. (2021) · Medical Physics · doi:10.1002/mp.14948 · Cited by 26 · see citing works
Kim, H. Y., Cho, S. J., Sunwoo, L., Baik, S. H., Bae, Y. J., Choi, B. S., Jung, C., & Kim, J. H. (2021) · Neuro-Oncology Advances · doi:10.1093/noajnl/vdab080 · Cited by 26 · see citing works
Schwyzer, M., Messerli, M., Eberhard, M., Skawran, S., Martini, K., & Frauenfelder, T. (2022) · Diagnostic and Interventional Imaging · doi:10.1016/j.diii.2021.12.002 · Cited by 26 · see citing works
Sharma, S., Pal, D., Abadi, E., Sauer, T. J., Segars, W. P., Hsieh, J., & Samei, E. (2022) · Academic Radiology · doi:10.1016/j.acra.2022.06.018 · Cited by 26 · see citing works
Self-citationCannella, R., Santinha, J., Bèaufrere, A., Ronot, M., Sartoris, R., Cauchy, F., Bouattour, M., Matos, C., Papanikolaou, N. K., Vilgrain, V., et al. (2023) · European Radiology · doi:10.1007/s00330-023-09852-1 · Cited by 26 · see citing works
Radiomics in Abdominopelvic Solid-Organ Oncologic Imaging: Current Status
Liu, X., Elbanan, M., Luna, A., Haider, M. A., Smith, A. D., Sabottke, C. F., Spieler, B. M., Türkbey, B., Fuentes, D., Moawad, A. W., et al. (2022) · American Journal of Roentgenology · doi:10.2214/ajr.22.27695 · Cited by 26 · see citing works
Kolossváry, M., Jávorszky, N., Karády, J., Vecsey-Nagy, M., Dávid, T. Z., Simon, J., Szilveszter, B., Merkely, B. P., & Maurovich‐Horvat, P. (2020) · Journal of cardiovascular computed tomography · doi:10.1016/j.jcct.2020.08.001 · Cited by 24 · see citing works
Clinical Artificial Intelligence Applications in Radiology
Lee, S., & Summers, R. M. (2021) · Radiologic Clinics of North America · doi:10.1016/j.rcl.2021.07.001 · Cited by 24 · see citing works
Wolf, E. V., Müller, L., Schoepf, U. J., Fink, N., Griffith, J. P., Zsarnóczay, E., Baruah, D., Suranyi, P. S., Kabakus, I. M., Halfmann, M. C., et al. (2023) · European Radiology Experimental · doi:10.1186/s41747-023-00371-8 · Cited by 24 · see citing works
Fiz, F., Costa, G., Gennaro, N., Bella, L. L., Boichuk, A., Sollini, M., Politi, L. S., Balzarini, L., Torzilli, G., Chiti, A., et al. (2021) · Diagnostics · doi:10.3390/diagnostics11071162 · Cited by 23 · see citing works
Yan, M., & Wang, W. (2020) · Frontiers in Oncology · doi:10.3389/fonc.2020.555514 · Cited by 22 · see citing works
Sheen, H., Kim, J. S., Lee, J. K., Choi, S. Y., Baek, S. Y., & Kim, J. Y. (2021) · Abdominal Radiology · doi:10.1007/s00261-020-02884-x · Cited by 22 · see citing works
Zhu, D., Chen, Q., Xiang, Y., Zhan, C., Zhang, M., Chen, C., Zhuge, Q., Chen, W., Yang, X., & Yang, Y. (2021) · Aging · doi:10.18632/aging.202954 · Cited by 22 · see citing works
Chen, W., Hou, X., Hu, Y., Huang, G., Ye, X., & Nie, S. (2021) · Medical Physics · doi:10.1002/mp.15302 · Cited by 22 · see citing works
Mottola, M., Ursprung, S., Rundo, L., Sánchez, L. E., Klatte, T., Mendichovszky, I. A., Stewart, G. D., Sala, E., & Bevilacqua, A. (2021) · Scientific Reports · doi:10.1038/s41598-021-90985-y · Cited by 23 · see citing works
Generative models improve radiomics reproducibility in low dose CTs: a simulation study
Chen, J., Zhang, C., Traverso, A., Zhovannik, I., Dekker, A. L. A. J., Wee, L., & Bermejo, I. (2021) · Physics in Medicine and Biology · doi:10.1088/1361-6560/ac16c0 · Cited by 21 · see citing works
Singh, A., Horng, H., Roshkovan, L., Weeks, J. K., Hershman, M., Noël, P., Luna, J., Cohen, E., Pantalone, L., Shinohara, R., et al. (2022) · Scientific Reports · doi:10.1038/s41598-022-14160-7 · Cited by 17 · see citing works
Gurbani, S., Morgan, D. D., Jog, V., Dreyfuss, L. D., Shen, M., Das, A., Abel, E. J., & Lubner, M. G. (2021) · Abdominal Radiology · doi:10.1007/s00261-021-03083-y · Cited by 20 · see citing works
Ilyushenkova, J. N., Sazonova, S. I., Popov, E. V., Zavadovsky, K. V., Batalov, R. E., Александрович, А. Е., Moskovskikh, T. V., Popov, S. V., Minin, S. M., & Romanov, A. B. (2022) · Journal of Arrhythmia · doi:10.1002/joa3.12760 · Cited by 20 · see citing works
Zhou, L., Wang, Y., Zhu, W., Zhao, Y., Yu, Y., Hu, Q., & Yu, W. (2024) · Annals of Medicine · doi:10.1080/07853890.2024.2401613 · Cited by 18 · see citing works
Chu, L. C. H., Solmaz, B., Park, S., Kawamoto, S., Yuille, A., Hruban, R. H., & Fishman, E. K. (2020) · Abdominal Radiology · doi:10.1007/s00261-020-02556-w · Cited by 18 · see citing works
Eck, B., Chirra, P. V., Muchhala, A., Hall, S., Bera, K., Tiwari, P., Madabhushi, A., Seiberlich, N., & Viswanath, S. E. (2021) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.27635 · Cited by 18 · see citing works
Assessing radiomics feature stability with simulated CT acquisitions
Flouris, K., Jiménez–del–Toro, O. A., Aberle, C., Bach, M., Schaer, R., Obmann, M. M., Stieltjes, B., Müller, H., Depeursinge, A., & Konukoğlu, E. (2022) · Scientific Reports · doi:10.1038/s41598-022-08301-1 · Cited by 17 · see citing works
Ren, Q.-Q., Zhu, P., Li, C.-D., Yan, M.-J., Liu, S., Zheng, C., & Xia, X. (2022) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2022.872044 · Cited by 18 · see citing works
Zhu, L., Dong, H., Sun, J., Wang, L., Xing, Y., Hu, Y., Lu, J. A., Yang, J., Chu, J., Yan, C., et al. (2024) · European Radiology · doi:10.1007/s00330-024-10976-1 · Cited by 17 · see citing works
Cannella, R., Sartoris, R., Grégory, J., Garzelli, L., Vilgrain, V., Ronot, M., & Burgio, M. D. (2021) · British Journal of Radiology · doi:10.1259/bjr.20210220 · Cited by 17 · see citing works
Jiménez–del–Toro, O. A., Aberle, C., Bach, M., Schaer, R., Obmann, M. M., Flouris, K., Ender Konukoglu, A., Stieltjes, B., Müller, H., & Depeursinge, A. (2021) · PubMed · doi:10.1097/rli.0000000000000795 · Cited by 16 · see citing works
Peng, G., Zhan, Y., Wu, Y., Zeng, C., Wang, S., Guo, L., Liu, W., Luo, L., Wang, R., Huang, K., et al. (2022) · Frontiers in Oncology · doi:10.3389/fonc.2022.988859 · Cited by 16 · see citing works
Du, D., Lv, W., Lv, J., Chen, X., Wu, H., Rahmim, A., & Lu, L. (2022) · European Radiology · doi:10.1007/s00330-022-09229-w · Cited by 16 · see citing works
Machine Learning in Lung Cancer Radiomics
Li, J., Li, Z., Wei, L., & Zhang, X. (2023) · Machine Intelligence Research · doi:10.1007/s11633-022-1364-x · Cited by 16 · see citing works
Spectral CT: Current Liver Applications
Borges, A. P., Antunes, C., & Caseiro‐Alves, F. (2023) · Diagnostics · doi:10.3390/diagnostics13101673 · Cited by 16 · see citing works
Adelsmayr, G., Janisch, M., Müller, H., Holzinger, A., Talakić, E., Janek, E., Streit, S., Fuchsjäger, M., & Schoellnast, H. (2023) · European Journal of Radiology · doi:10.1016/j.ejrad.2023.110931 · Cited by 16 · see citing works
Zhao, W., Hu, Z., Kazerooni, A. F., Koerzdoerfer, G., Nittka, M., Davatzikos, C. A., Viswanath, S. E., Wang, X., Badve, C. A., & Ma, D. (2023) · Investigative Radiology · doi:10.1097/rli.0000000000001026 · Cited by 16 · see citing works
Koçak, B., dos Santos, D. P., & Dietzel, M. (2025) · European Journal of Radiology Artificial Intelligence · doi:10.1016/j.ejrai.2025.100004 · Cited by 16 · see citing works
Reproducibility of CT texture features of pancreatic neuroendocrine neoplasms
Gruzdev, I. S., Zamyatina, K. A., Tikhonova, V. S., Kondratyev, E. V., Glotov, A. V., Karmazanovsky, G. G., & Revishvili, A. S. (2020) · European Journal of Radiology · doi:10.1016/j.ejrad.2020.109371 · Cited by 16 · see citing works
Improving reproducibility and performance of radiomics in low‐dose CT using cycle GANs
Chen, J., Wee, L., Dekker, A. L. A. J., & Bermejo, I. (2022) · Journal of Applied Clinical Medical Physics · doi:10.1002/acm2.13739 · Cited by 16 · see citing works
Montagnon, E., Cerny, M., Hamilton, V., Derennes, T., Ilinca, A. P., Elforaici, M. E. A., Jabbour, G., Rafie, E., Wu, A., Romero, F. P., et al. (2024) · PLoS ONE · doi:10.1371/journal.pone.0307815 · Cited by 15 · see citing works
Chen, F., Ge, Y., Li, S., Liu, M., Wu, J., & Liu, Y. (2022) · Dentomaxillofacial Radiology · doi:10.1259/dmfr.20220009 · Cited by 15 · see citing works
Quality control of radiomic features using 3D-printed CT phantoms
Mahmood, U. A., Apte, A., Kanan, C., Bates, . D. B., Corrias, G., Manneli, L., Oh, J. H., Erdi, Y. E., Nguyen, J., Deasy, J. O., et al. (2021) · Journal of medical imaging · doi:10.1117/1.jmi.8.3.033505 · Cited by 15 · see citing works
Refaee, T., Salahuddin, Z., Widaatalla, Y., Primakov, S. P., Woodruff, H. C., Hustinx, R., Mottaghy, F. M., Ibrahim, A., & Lambin, P. (2022) · Journal of Personalized Medicine · doi:10.3390/jpm12040553 · Cited by 15 · see citing works
Kwieciński, J., Kolossváry, M., Tzolos, E., Meah, M. N., Adamson, P. D., Joshi, N. V., Williams, M. C., van Beek, E. J. R., Berman, D. S., Maurovich‐Horvat, P., et al. (2023) · Arteriosclerosis Thrombosis and Vascular Biology · doi:10.1161/atvbaha.123.319332 · Cited by 15 · see citing works
Lennartz, S., Parakh, A., Cao, J., & Kambadakone, A. R. (2021) · European Radiology · doi:10.1007/s00330-021-08083-6 · Cited by 14 · see citing works
- Authors
- Meyer, M., Ronald, J., Vernuccio, F., Nelson, R. C., Ramirez-Giraldo, J. C., Solomon, J., Patel, B. N., Samei, E., & Marin, D.
- Affiliations
- Heidelberg University (DE)
- ORCID
- Venue
- Radiology
- Published
- 2019-12
- Volume
- 293
- Issue
- 3
- Pages
- 583-591
- ISSN
- 0033-8419 (ISSN-L)
- 1527-1315
- PMC
- PMC10860741
- OpenAlex
- W2977270522
- Cited by
- 258
- References
- 25
- Citations by year
- 2026: 25 · 2025: 23 · 2024: 32 · 2023: 44 · 2022: 51 · 2021: 57 · 2020: 23 · 2019: 2
- FWCI
- 21.98
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Radiology (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Nova Science Publishers (Nova Science Publishers, Inc.) (submittedVersion)
- Funders
- Siemens Healthineers
- National Institute of Biomedical Imaging and Bioengineering (R01EB001838)
- Topics
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Medical Imaging Techniques and Applications
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiation Dose and Imaging
- Keywords
- CT radiomics, reproducibility, radiation dose, section thickness, kernel, reconstruction algorithms, correction factors, metastatic liver lesions, hierarchical clustering
- MeSH terms
- Algorithms, Contrast Media, Female, Humans, Liver Neoplasms, Male, Middle Aged, Neoplasm Staging, Prospective Studies, Radiation Dosage, Radiographic Image Interpretation, Computer-Assisted, Tomography, X-Ray Computed, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review