Robustness and Reproducibility of Radiomics in Magnetic Resonance Imaging: A Phantom Study
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Objectives: The aim of this study was to investigate the robustness and reproducibility of radiomic features in different magnetic resonance imaging sequences. Materials and Methods: A phantom was scanned on a clinical 3 T system using fluid-attenuated inversion recovery (FLAIR), T1-weighted (T1w), and T2-weighted (T2w) sequences with low and high matrix size. For retest data, scans were repeated after repositioning of the phantom. Test and retest datasets were segmented using a semiautomated approach. Intraobserver and interobserver comparison was performed. Radiomic features were extracted after standardized preprocessing of images. Test-retest robustness was assessed using concordance correlation coefficients, dynamic range, and Bland-Altman analyses. Reproducibility was assessed by intraclass correlation coefficients. Results: The number of robust features (concordance correlation coefficient and dynamic range ≥ 0.90) was higher for features calculated from FLAIR than from T1w and T2w images. High-resolution FLAIR images provided the highest percentage of robust features (n = 37/45, 81%). No considerable difference in the number of robust features was observed between low- and high-resolution T1w and T2w images (T1w low: n = 26/45, 56%; T1w high: n = 25/45, 54%; T2 low: n = 21/45, 46%; T2 high: n = 24/45, 52%). A total of 15 (33%) of 45 features showed excellent robustness across all sequences and demonstrated excellent intraobserver and interobserver reproducibility (intraclass correlation coefficient ≥ 0.75). Conclusions: FLAIR delivers the most robust substrate for radiomic analyses. Only 15 of 45 features showed excellent robustness and reproducibility across all sequences. Care must be taken in the interpretation of clinical studies using nonrobust features.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Radiomics: the bridge between medical imaging and personalized medicine
Lambin, P., Leijenaar, R. T. H., Deist, T. M., Peerlings, J., de Jong, E. E. C., van Timmeren, J., Sanduleanu, S., Larue, R. T. H. M., Even, A. J. G., Jochems, A., et al. (2017) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2017.141 · Cited by 5,688
Zwanenburg, A., Vallières, M., Abdalah, M. A., Aerts, H. J. W. L., Andrearczyk, V., Apte, A., Ashrafinia, S., Bakas, S., Beukinga, R. J., Boellaard, R., et al. (2020) · Radiology · doi:10.1148/radiol.2020191145 · Cited by 4,177
Predicting the future - big data, machine learning, and clinical medicine
Obermeyer, Z., & Emanuel, E. J. (2016) · New England Journal of Medicine · doi:10.1056/nejmp1606181 · Cited by 3,652
Cited by
Radiomics in medical imaging—“how-to” guide and critical reflection
van Timmeren, J. E., Cester, D., Tanadini-Lang, S., Alkadhi, H., & Baessler, B. (2020) · Insights into Imaging · doi:10.1186/s13244-020-00887-2 · Cited by 1,316
Moradmand, H., Aghamiri, S. M. R., & Ghaderi, R. (2020) · Journal of Applied Clinical Medical Physics · doi:10.1002/acm2.12795 · Cited by 173
Grosu, S., Wesp, P., Graser, A., Maurus, S., Schulz, C., Knösel, T., Cyran, C. C., Ricke, J., Ingrisch, M., & Kazmierczak, P. M. (2021) · Radiology · doi:10.1148/radiol.2021202363 · Cited by 75
Oncologic Imaging and Radiomics: A Walkthrough Review of Methodological Challenges
Stanzione, A., Cuocolo, R., Ugga, L., Verde, F., Romeo, V., Brunetti, A., & Maurea, S. (2022) · Cancers · doi:10.3390/cancers14194871 · Cited by 64
Can Magnetic Resonance Imaging Radiomics of the Pancreas Predict Postoperative Pancreatic Fistula?
Skawran, S. M., Kambakamba, P., Baessler, B., von Spiczak, J., Kupka, M., Müller, P. C., Moeckli, B., Linecker, M., Petrowsky, H., & Reiner, C. S. (2021) · European Journal of Radiology · doi:10.1016/j.ejrad.2021.109733 · Cited by 37
Metadata
- Authors
- Baeßler, B., Weiss, K., & Pinto dos Santos, D.
- Venue
- Investigative Radiology
- Published
- 2019-04
- Volume
- 54
- Issue
- 4
- Pages
- 221-228
- ISSN
- 0020-9996 (ISSN-L)
- 1536-0210
- OpenAlex
- W2900495198
- Cited by
- 229
- References
- 3
- FWCI
- 13.70
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Robustness and Reproducibility of Radiomics in Magnetic Resonance Imaging: A Phantom Study. https://app.cochat.ai/papers/10.1097/rli.0000000000000530
- The paper
- Baeßler, B., Weiss, K., & Pinto dos Santos, D. (2019). Robustness and Reproducibility of Radiomics in Magnetic Resonance Imaging: A Phantom Study. Investigative Radiology. https://doi.org/10.1097/rli.0000000000000530
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.