Brain tumor target volume determination for radiation treatment planning through automated MRI segmentation
Abstract
Purpose To assess the effectiveness of two automated magnetic resonance imaging (MRI) segmentation methods in determining the gross tumor volume (GTV) of brain tumors for use in radiation therapy treatment planning.Methods and materials Two automated MRI tumor segmentation methods (supervised k-nearest neighbors [kNN] and automatic knowledge-guided [KG]) were evaluated for their potential as "cyber colleagues." This required an initial determination of the accuracy and variability of radiation oncologists engaged in the manual definition of the GTV in MRI registered with computed tomography images for 11 glioma patients. Three sets of contours were defined for each of these patients by three radiation oncologists. These outlines were compared directly to establish inter- and intraoperator variability among the radiation oncologists. A novel, probabilistic measurement of accuracy was introduced to compare the level of agreement among the automated MRI segmentations. The accuracy was determined by comparing the volumes obtained by the automated segmentation methods with the weighted average volumes prepared by the radiation oncologists.Results Intra- and inter-operator variability in outlining was found to be an average of 20% +/- 15% and 28% +/- 12%, respectively. Lowest intraoperator variability was found for the physician who spent the most time producing the contours. The average accuracy of the kNN segmentation method was 56% +/- 6% for all 11 cases, whereas that of the KG method was 52% +/- 7% for 7 of the 11 cases when compared with the physician contours. For the areas of the contours where the oncologists were in substantial agreement (i.e., the center of the tumor volume), the accuracy of kNN and KG was 75% and 72%, respectively. The automated segmentation methods were found to be least accurate in outlining at the edges of the tumor volume.Conclusions The kNN method was able to segment all cases, whereas the KG method was limited to enhancing tumors and gliomas with clear enhancing edges and no cystic formation. Both methods undersegment the tumor volume when compared with the radiation oncologists and performed within the variability of the contouring performed by experienced radiation oncologists based on the same data.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The preliminary federation model was already within the intra- and inter-rater variability range for this use-case (20% and 28%, respectively), so any further improvements for the full federation consensus model would be expected to be minimal.
“Further noting that the preliminary federation model was already within the intra- and inter-rater variability range for this use-case (20% and 28%, respectively)47, any further improvements for the full federation consensus model would be expected to be minimal35–38.”
From Federated learning enables big data for rare cancer boundary detection (2022) · cites this paper as [47]
Manual segmentation of brain tumor images has intra-expert variabilities of 20 ± 15% and inter-expert variabilities of 28 ± 12%.
“In their work, Mazzara et al. [11] reported intra-expert variabilities of 20 ± 15% and inter-experts variabilities of 28 ± 12% for manual segmentations of brain tumor images.”
From Deep learning for brain MRI segmentation: state of the art and future directions (2017) · cites this paper as [11]
Cites
MRI segmentation: Methods and applications
Clarke, L. P., Velthuizen, R. P., Camacho, M. A., Heine, J., Vaidyanathan, M., Hall, L., Thatcher, R. W., & Silbiger, M. L. (1995) · Magnetic Resonance Imaging · doi:10.1016/0730-725x(94)00124-l · Cited by 697 · see citing works
Self-citationAutomatic tumor segmentation using knowledge-based techniques
Clark, M. C., Hall, L., Goldgof, D. B., Velthuizen, R. P., Murtagh, F. R., & Silbiger, M. S. (1998) · IEEE Transactions on Medical Imaging · doi:10.1109/42.700731 · Cited by 461 · see citing works
Self-citationMeyer, C. R., Boes, J. L., Kim, B., Bland, P. H., Zasadny, K. R., Kison, P. V., Koral, K. F., Frey, K. A., & Wahl, R. L. (1997) · Medical Image Analysis · doi:10.1016/s1361-8415(97)85010-4 · Cited by 460 · see citing works
Maes, F., Vandermeulen, D., & Suetens, P. (1999) · Medical Image Analysis · doi:10.1016/s1361-8415(99)80030-9 · Cited by 393 · see citing works
Automatic segmentation of non-enhancing brain tumors in magnetic resonance images
Fletcher-Heath, L., Hall, L., Goldgof, D. B., & Murtagh, F. R. (2001) · Artificial Intelligence in Medicine · doi:10.1016/s0933-3657(00)00073-7 · Cited by 294 · see citing works
Weltens, C. G., Menten, J. J., Féron, M., Bellon, E., Demaerel, P., Maes, F., den Bogaert, W. F. V., & van der Schueren, E. (2001) · Radiotherapy and Oncology · doi:10.1016/s0167-8140(01)00371-1 · Cited by 187 · see citing works
Knowledge-based classification and tissue labeling of MR images of human brain
Li, C., Goldgof, D. B., & Hall, L. (1993) · IEEE Transactions on Medical Imaging · doi:10.1109/42.251125 · Cited by 173 · see citing works
MRI: Stability of three supervised segmentation techniques
Clarke, L. P., Velthuizen, R. P., Phuphanich, S., Schellenberg, J., Arrington, J. A., & Silbiger, M. L. (1993) · Magnetic Resonance Imaging · doi:10.1016/0730-725x(93)90417-c · Cited by 166 · see citing works
Self-citationHalperin, E. C., Bentel, G. C., Heinz, E. R., et al. (1989) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/0360-3016(89)90548-8 · Cited by 152 · see citing works
Grossman, S. A., O’Neill, A., Grunnet, M. L., Mehta, M. P., Pearlman, J. L., Wagner, H., Gilbert, M. R., Newton, H. B., & Hellman, R. (2003) · Journal of Clinical Oncology · doi:10.1200/jco.2003.10.035 · Cited by 143 · see citing works
Self-citationA quantitative assessment of the addition of MRI to CT-based, 3-D treatment planning of brain tumors
Haken, R. K. T., Thornton, A. F., Sandler, H. M., et al. (1992) · Radiotherapy and Oncology · doi:10.1016/0167-8140(92)90018-p · Cited by 126 · see citing works
Target volumes in radiotherapy for high-grade malignant glioma of the brain
Jansen, E. P. M., Dewit, L. G. H., van Herk, M., et al. (2000) · Radiotherapy and Oncology · doi:10.1016/s0167-8140(00)00216-4 · Cited by 124 · see citing works
Khoo, V. S., Adams, E., Saran, F. H., et al. (2000) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/s0360-3016(99)00541-6 · Cited by 118 · see citing works
MRI Measurement of Brain Tumor Response: Comparison of Visual Metric and Automatic Segmentation
Clarke, L. P., Velthuizen, R. P., Clark, M., Gaviria, J., Hall, L., Goldgof, D. B., Murtagh, R. F., Phuphanich, S., & Brem, S. S. (1998) · Magnetic Resonance Imaging · doi:10.1016/s0730-725x(97)00302-0 · Cited by 104 · see citing works
Self-citationComparison of supervised MRI segmentation methods for tumor volume determination during therapy
Vaidyanathan, M., Clarke, L. P., Velthuizen, R. P., et al. (1995) · Magnetic Resonance Imaging · doi:10.1016/0730-725x(95)00012-6 · Cited by 102 · see citing works
Self-citationUnsupervised Measurement of Brain Tumor Volume on MR Images
Velthuizen, R. P., Clarke, L. P., Phuphanich, S., et al. (1995) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.1880050520 · Cited by 87 · see citing works
Self-citationKleinberg, L. R., Grossman, S. A., Carson, K. A., et al. (2002) · Journal of Clinical Oncology · doi:10.1200/jco.2002.01.096 · Cited by 80 · see citing works
Yamamoto, M., Nagata, Y., Okajima, K., et al. (1999) · Radiotherapy and Oncology · doi:10.1016/s0167-8140(99)00015-8 · Cited by 76 · see citing works
Quality Assurance in Radiotherapy of Breast Cancer Variability in Planning Target Volume Delineation
Pitkänen, K. A. H. M. A. (2001) · Acta Oncologica · doi:10.1080/028418601750071055 · Cited by 69 · see citing works
Monitoring brain tumor response to therapy using MRI segmentation
Vaidyanathan, M., Clarke, L. P., Hall, L., et al. (1997) · Magnetic Resonance Imaging · doi:10.1016/s0730-725x(96)00386-4 · Cited by 67 · see citing works
Caudrelier, J., Vial, S., Gibon, D., et al. (2002) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/s0360-3016(02)03829-4 · Cited by 30 · see citing works
den Berge, D. L. V., Ridder, M. D., & Storme, G. A. (2000) · European Journal of Radiology · doi:10.1016/s0720-048x(99)00182-5 · Cited by 23 · see citing works
Morris, D. E., Bourland, J. D., Rosenman, J. G., et al. (2001) · Seminars in Radiation Oncology · doi:10.1053/srao.2001.22060 · Cited by 18 · see citing works
Results of Irradiation in Patients with High-Grade Gliomas Evaluated by Magnetic Resonance Imaging
Seither, R. B., José, B., Paris, K. J., et al. (1995) · American Journal of Clinical Oncology · doi:10.1097/00000421-199508000-00005 · Cited by 14 · see citing works
New imaging technologies: Prospects for target definition
Henkelman, R. M. (1992) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/0360-3016(92)90041-f · Cited by 8 · see citing works
Hendee, W. R., Barnes, G. T., Crooks, L. E., et al. (1984) · Investigative Radiology · doi:10.1097/00004424-198405001-00014 · Cited by 5 · see citing works
Quiz case: acute pituitary apoplexy.
Stadnik, T. W., Velkeniers, B., Flamez, A., et al. (2000) · PubMed · Cited by 2 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Deep learning for brain MRI segmentation: state of the art and future directions
Akkus, Z., Galimzianova, A., Hoogi, A., Rubin, D. L., & Erickson, B. J. (2017) · Journal of Digital Imaging · doi:10.1007/s10278-017-9983-4 · Cited by 1,129 · see citing works
A survey of MRI-based medical image analysis for brain tumor studies
Bauer, S., Wiest, R., Nolte, L.-P., & Reyes, M. (2013) · Physics in Medicine and Biology · doi:10.1088/0031-9155/58/13/r97 · Cited by 1,036 · see citing works
State of the art survey on MRI brain tumor segmentation
Gordillo, N., Montseny, E., & Sobrevilla, P. (2013) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2013.05.002 · Cited by 697 · see citing works
Federated learning enables big data for rare cancer boundary detection
Pati, S., Baid, U., Edwards, B., Sheller, M., Wang, S.-H., Reina, G. A., Foley, P., Gruzdev, A., Karkada, D., Davatzikos, C., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-33407-5 · Cited by 394 · see citing works
DeepMedic for Brain Tumor Segmentation
Kamnitsas, K., Ferrante, E., Parisot, S., Ledig, C., Nori, A. V., Criminisi, A., Rueckert, D., & Glocker, B. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-55524-9_14 · Cited by 346 · see citing works
Laukamp, K. R., Thiele, F., Shakirin, G., Zopfs, D., Faymonville, A., Timmer, M., Maintz, D., Perkuhn, M., & Borggrefe, J. (2019) · European Radiology · doi:10.1007/s00330-018-5595-8 · Cited by 205 · see citing works
DALSA: domain adaptation for supervised learning from sparsely annotated MR images
Goetz, M., Weber, C., Binczyk, F., Polanska, J., Tarnawski, R., Bobek-Billewicz, B., Koethe, U., Kleesiek, J., Stieltjes, B., & Maier-Hein, K. H. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2463078 · Cited by 98 · see citing works
Laukamp, K. R., Pennig, L., Thiele, F., Reimer, R., Görtz, L., Shakirin, G., Zopfs, D., Timmer, M., Perkuhn, M., & Borggrefe, J. (2021) · Clinical Neuroradiology · doi:10.1007/s00062-020-00884-4 · Cited by 62 · see citing works
Pati, S., Baid, U., Edwards, B., Sheller, M. J., Foley, P., Anthony Reina, G., Thakur, S., Sako, C., Bilello, M., Davatzikos, C., et al. (2022) · Physics in Medicine & Biology · doi:10.1088/1361-6560/ac9449 · Cited by 51 · see citing works
- Authors
- Mazzara, G. P., Velthuizen, R. P., Pearlman, J. L., Greenberg, H. M., & Wagner, H.
- Affiliations
- University of South Florida (US)
- Unilever (United States) (US)
- Moffitt Cancer Center (US)
- Corresponding author
- Mazzara, Gloria P
- Venue
- International Journal of Radiation Oncology*Biology*Physics
- Publisher
- Elsevier BV
- Published
- 2004-05
- Volume
- 59
- Issue
- 1
- Pages
- 300-312
- ISSN
- 0360-3016 (ISSN-L)
- OpenAlex
- W2167878392
- Cited by
- 216
- References
- 27
- Citations by year
- 2026: 6 · 2025: 4 · 2024: 12 · 2023: 14 · 2022: 16 · 2021: 18 · 2020: 16 · 2019: 10 · 2018: 15 · 2017: 12 · 2016: 19 · 2015: 11 · 2014: 11 · 2013: 13 · 2012: 3
- FWCI
- 4.11
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Radiation Oncology*Biology*Physics (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Life Sciences › Neuroscience › Neurology › Brain Tumor Detection and Classification
- Physical Sciences › Physics and Astronomy › Radiation › Advanced Radiotherapy Techniques
- Keywords
- brain tumors, gross tumor volume, MRI segmentation, automatic contouring, k-nearest neighbors, glioma, radiotherapy treatment planning, contour accuracy, CT-MRI registration
- MeSH terms
- Aged, Aged, 80 and over, Algorithms, Brain Neoplasms, False Positive Reactions, Female, Glioma, Humans, Image Processing, Computer-Assisted, Magnetic Resonance Imaging, Male, Middle Aged, Radiotherapy Planning, Computer-Assisted, Time Factors, Tomography, X-Ray Computed, Reproducibility of Results, Observer Variation, Radiation Oncology, Imaging, Three-Dimensional
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review