Glioblastoma surgery imaging-reporting and data system: validation and performance of the automated segmentation task
Open accessThe DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Abstract
For patients with presumed glioblastoma, essential tumor characteristics are determined from preoperative MR images to optimize the treatment strategy. This procedure is time-consuming and subjective, if performed by crude eyeballing or manually. The standardized GSI-RADS aims to provide neurosurgeons with automatic tumor segmentations to extract tumor features rapidly and objectively. In this study, we improved automatic tumor segmentation and compared the agreement with manual raters, describe the technical details of the different components of GSI-RADS, and determined their speed. Two recent neural network architectures were considered for the segmentation task: nnU-Net and AGU-Net. Two preprocessing schemes were introduced to investigate the tradeoff between performance and processing speed. A summarized description of the tumor feature extraction and standardized reporting process is included. The trained architectures for automatic segmentation and the code for computing the standardized report are distributed as open-source and as open-access software. Validation studies were performed on a dataset of 1594 gadolinium-enhanced T1-weighted MRI volumes from 13 hospitals and 293 T1-weighted MRI volumes from the BraTS challenge. The glioblastoma tumor core segmentation reached a Dice score slightly below 90%, a patientwise F1-score close to 99%, and a 95th percentile Hausdorff distance slightly below 4.0 mm on average with either architecture and the heavy preprocessing scheme. A patient MRI volume can be segmented in less than one minute, and a standardized report can be generated in up to five minutes. The proposed GSI-RADS software showed robust performance on a large collection of MRI volumes from various hospitals and generated results within a reasonable runtime.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Multiple studies33,45 have indicated that smaller lesions generally yield lower segmentation accuracy. Because metastases are typically smaller, this could account for the commonly observed diminished segmentation accuracy.”
From Artificial Intelligence Detection and Segmentation Models: A Systematic Review and Meta-Analysis of Brain Tumors in Magnetic Resonance Imaging (2024) · cites this paper as [45]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2644615 · Cited by 19,631
The 2016 World Health Organization Classification of Tumors of the Central Nervous System: a summary
Louis, D. N., Perry, A., Reifenberger, G., von Deimling, A., Figarella-Branger, D., Cavenee, W. K., Ohgaki, H., Wiestler, O. D., Kleihues, P., & Ellison, D. W. (2016) · Acta Neuropathologica · doi:10.1007/s00401-016-1545-1 · Cited by 15,657 · cited 2×
“The stride values for the convolution layers were as follows, based on the preprocessing performed: strides for P1: [2, 2, 1], [2, 2, 2], [2, 2, 2], [2, 2, 2], [2, 2, 2], strides for P2: [2, 2, 2], [2, 2, 2], [2, 2, 2], [2, 2, 2], [2, 2, 2].”
MethodInfluentialDesikan, R. S., Ségonne, F., Fischl, B., Quinn, B. T., Dickerson, B. C., Blacker, D., Buckner, R. L., Dale, A. M., Maguire, R. P., Hyman, B. T., et al. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.01.021 · Cited by 13,324
The organization of the human cerebral cortex estimated by intrinsic functional connectivity
Thomas Yeo, B. T., Krienen, F. M., Sepulcre, J., Sabuncu, M. R., Lashkari, D., Hollinshead, M., Roffman, J. L., Smoller, J. W., Zöllei, L., Polimeni, J. R., et al. (2011) · Journal of Neurophysiology · doi:10.1152/jn.00338.2011 · Cited by 9,182
Radiomics: Images Are More than Pictures, They Are Data
Gillies, R. J., Kinahan, P. E., & Hricak, H. (2016) · Radiology · doi:10.1148/radiol.2015151169 · Cited by 8,421 · cited 1×
“through advanced computational algorithms can lead to important and reproducible evidence finding [5].”
Background3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation
Çiçek, Ö., Abdulkadir, A., Lienkamp, S. S., Brox, T., & Ronneberger, O. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46723-8_49 · Cited by 7,945
The organization of the human cerebellum estimated by intrinsic functional connectivity
Buckner, R. L., Krienen, F. M., Castellanos, A., Diaz, J. C., & Yeo, B. T. T. (2011) · Journal of Neurophysiology · doi:10.1152/jn.00339.2011 · Cited by 7,304
Research works printed but not linked: 1
- Vezhnevets, 2005, GrowCut: Interactive multi-label ND image segmentation by cellular automata, Proc. Graphicon, Volume 1, 150
Cited by
Preoperative Brain Tumor Imaging: Models and Software for Segmentation and Standardized Reporting
Bouget, D., Pedersen, A., Jakola, A. S., Kavouridis, V. K., Emblem, K. E., Eijgelaar, R. S., Kommers, I. O., Ardon, H., Barkhof, F., Bello, L., et al. (2022) · Frontiers in Neurology · doi:10.3389/fneur.2022.932219 · Cited by 47
Self-citationSegmentation of glioblastomas in early post-operative multi-modal MRI with deep neural networks
Helland, R. H., Ferles, A., Pedersen, A., Kommers, I. O., Ardon, H., Barkhof, F., Bello, L., Berger, M. S., Dunås, T., Nibali, M. C., et al. (2023) · Scientific Reports · doi:10.1038/s41598-023-45456-x · Cited by 46
Self-citationPflüger, I., Wald, T., Isensee, F., Schell, M., Meredig, H., Schlamp, K., Bernhardt, D., Brugnara, G., Heußel, C. P., Debus, J., et al. (2022) · Neuro-Oncology Advances · doi:10.1093/noajnl/vdac138 · Cited by 31
Deep learning in MRI‐guided radiation therapy: A systematic review
Eidex, Z., Ding, Y., Wang, J., Abouei, E., Qiu, R. L. J., Liu, T., Wang, T., & Yang, X. (2023) · Journal of Applied Clinical Medical Physics · doi:10.1002/acm2.14155 · Cited by 31
Veiga-Canuto, D., Alberich, L. C., Jiménez-Pastor, A., Sierra, J. M. C., Gomis-Maya, A., Sangüesa-Nebot, C., Fernández-Patón, M., Heras, B. M. D. L., Taschner‐Mandl, S., Düster, V., et al. (2023) · Cancers · doi:10.3390/cancers15051622 · Cited by 29
“Among the few preceding works that have addressed the issue of external validation of automatic segmentation algorithms in different areas, some studies have explored lesions such as glioblastoma [10], focal cortical dysplasia [11], or liver segments [28,29].”
Background
Metadata
- Authors
- Bouget, D., Eijgelaar, R. S., Pedersen, A., Kommers, I., Ardon, H., Barkhof, F., Bello, L., Berger, M. S., Nibali, M. C., Furtner, J., Fyllingen, E. H., Hervey-Jumper, S., Idema, A. J. S., Kiesel, B., Kloet, A., Mandonnet, E., Müller, D. M. J., Robe, P. A., Rossi, M., Sagberg, L. M., Sciortino, T., Van den Brink, W. A., Wagemakers, M., Widhalm, G., Witte, M. G., Zwinderman, A. H., Reinertsen, I., De Witt Hamer, P. C., & Solheim, O.
- Affiliations
- SINTEF (NO)
- Amsterdam University Medical Centers (NL)
- Elisabeth-TweeSteden Ziekenhuis (NL)
- University of Milan (IT)
- University of California, San Francisco (US)
- Medical University of Vienna (AT)
- Norwegian University of Science and Technology (NO)
- Department of Neurological Surgery, University of California, San Francisco, CA 94143, USA
- Noordwest Ziekenhuisgroep (NL)
- Medisch Centrum Haaglanden (NL)
- Hôpital Lariboisière (FR)
- University Medical Center Utrecht (NL)
- St Olav's University Hospital (NO)
- Department of Neurosurgery, Isala Hospital Zwolle, 8025 AB Zwolle, The Netherlands
- University Medical Center Groningen (NL)
- The Netherlands Cancer Institute (NL)
- Department of Neurosurgery, Amsterdam University Medical Centers, Vrije Universiteit, 1081 HV Amsterdam, The Netherlands
- Corresponding author
- Bouget, David
- ORCID
- Bouget, David
- Eijgelaar, Roelant S.
- Pedersen, André
- Kommers, Ivar
- Ardon, Hilko
- Barkhof, Frederik
- Bello, Lorenzo
- Berger, Mitchel S.
- Nibali, Marco Conti
- Furtner, Julia
- Fyllingen, Even Hovig
- Kiesel, Barbara
- Kloet, Alfred
- Mandonnet, Emmanuel
- Müller, Domenique M. J.
- Robe, Pierre A.
- Rossi, Marco
- Sagberg, Lisa M.
- Sciortino, Tommaso
- Wagemakers, Michiel
- Widhalm, Georg
- Witte, Marnix G.
- Zwinderman, Aeilko H.
- Reinertsen, Ingerid
- De Witt Hamer, Philip C.
- Solheim, Ole
- Venue
- Cancers
- Publisher
- MDPI AG
- Published
- 2021-09-17
- Volume
- 13
- Issue
- 18
- Pages
- 4674
- ISSN
- 2072-6694 (ISSN-L)
- PMC
- PMC8465753
- OpenAlex
- W3201398975
- Cited by
- 19
- References
- 52
- Citations by year
- 2026: 4 · 2025: 2 · 2024: 6 · 2023: 5 · 2022: 2
- FWCI
- 1.30
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Cancers (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, other-oa)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Amsterdam UMC (VU Amsterdam) - Institutional Repository (publishedVersion, other-oa)
- Pure Amsterdam UMC (acceptedVersion, other-oa)
- Archivio Istituzionale della Ricerca (Universita Degli Studi Di Milano) (submittedVersion, cc-by)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
- UCL Discovery (University College London) (submittedVersion)
- NORA - Norwegian Open Research Archives (submittedVersion, cc-by)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion, cc-by)
- Funders
- Norges Teknisk-Naturvitenskapelige Universitet
- Rijksdienst voor Ondernemend Nederland
- Amsterdam University Medical Centers
- National Institute for Health and Care Research
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (2020.027, 10-10400-96-14003)
- Center for Translational Molecular Medicine
- University College London Hospitals NHS Foundation Trust
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Brain Tumor Detection and Classification
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Health Sciences › Medicine › Oncology › Glioma Diagnosis and Treatment
- Keywords
- glioblastoma, automated tumor segmentation, preoperative MRI, nnU-Net, tumor core segmentation, standardized reporting, BraTS, open source software, interobserver agreement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Glioblastoma surgery imaging-reporting and data system: validation and performance of the automated segmentation task. https://app.cochat.ai/papers/10.3390/cancers13184674
- The paper
- Bouget, D., Eijgelaar, R. S., Pedersen, A., Kommers, I., Ardon, H., Barkhof, F., Bello, L., Berger, M. S., Nibali, M. C., Furtner, J., Fyllingen, E. H., Hervey-Jumper, S., Idema, A. J. S., Kiesel, B., Kloet, A., Mandonnet, E., Müller, D. M. J., Robe, P. A., Rossi, M., . . . Solheim, O. (2021). Glioblastoma surgery imaging-reporting and data system: validation and performance of the automated segmentation task. Cancers. https://doi.org/10.3390/cancers13184674
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.