CoChat

Performance of machine learning algorithms for glioma segmentation of brain MRI: a systematic literature review and meta-analysis

Open access
van Kempen, Evi J., Post, Max, Mannil, Manoj, Witkam, Richard L., ter Laan, Mark, Patel, Ajay, Meijer, Frederick J. A., Henssen, Dylan · 2021 · European Radiology
Cited by 85

The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.

Abstract

Objectives: Different machine learning algorithms (MLAs) for automated segmentation of gliomas have been reported in the literature. Automated segmentation of different tumor characteristics can be of added value for the diagnostic work-up and treatment planning. The purpose of this study was to provide an overview and meta-analysis of different MLA methods. Methods: A systematic literature review and meta-analysis was performed on the eligible studies describing the segmentation of gliomas. Meta-analysis of the performance was conducted on the reported dice similarity coefficient (DSC) score of both the aggregated results as two subgroups (i.e., high-grade and low-grade gliomas). This study was registered in PROSPERO prior to initiation (CRD42020191033). Results: After the literature search (n = 734), 42 studies were included in the systematic literature review. Ten studies were eligible for inclusion in the meta-analysis. Overall, the MLAs from the included studies showed an overall DSC score of 0.84 (95% CI: 0.82–0.86). In addition, a DSC score of 0.83 (95% CI: 0.80–0.87) and 0.82 (95% CI: 0.78–0.87) was observed for the automated glioma segmentation of the high-grade and low-grade gliomas, respectively. However, heterogeneity was considerably high between included studies, and publication bias was observed. Conclusion: MLAs facilitating automated segmentation of gliomas show good accuracy, which is promising for future implementation in neuroradiology. However, before actual implementation, a few hurdles are yet to be overcome. It is crucial that quality guidelines are followed when reporting on MLAs, which includes validation on an external test set. Key Points: • MLAs from the included studies showed an overall DSC score of 0.84 (95% CI: 0.82–0.86), indicating a good performance. • MLA performance was comparable when comparing the segmentation results of the high-grade gliomas and the low-grade gliomas. • For future studies using MLAs, it is crucial that quality guidelines are followed when reporting on MLAs, which includes validation on an external test set.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s00330-021-08035-0

Cites

18 of 18 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 18 references

Research works printed but not linked: 64

  1. Perry A, Wesseling P (2016) Histologic classification of gliomas handbook of clinical neurology. Elsevier, pp 71–95 · DOI · Paper page
  2. Yamahara T, Numa Y, Oishi T et al (2010) Morphological and flow cytometric analysis of cell infiltration in glioblastoma: a comparison of autopsy brain and neuroimaging. Brain Tumor Pathol 27:81–87 · DOI
  3. Johnson DR, Guerin JB, Giannini C, Morris JM, Eckel LJ, Kaufmann TJ (2017) 2016 Updates to the WHO brain tumor classification system: what the radiologist needs to know. Radiographics 37:2164–2180 · DOI · Paper page
  4. Larsen J, Wharton SB, McKevitt F et al (2017) ‘Low grade glioma’: an update for radiologists. Br J Radiol 90:20160600 · DOI
  5. Velthuizen RP, Hall LO, Clarke LP (1999) Feature extraction for MRI segmentation. J Neuroimaging 9:85–90 · doi:10.1111/jon19999285
  6. Ditmer A, Zhang B, Shujaat T et al (2018) Diagnostic accuracy of MRI texture analysis for grading gliomas. J Neurooncol 140:583–589 · DOI
  7. Egger J, Kapur T, Fedorov A et al (2013) GBM volumetry using the 3D Slicer medical image computing platform. Sci Rep 3:1364. https://doi.org/10.1038/srep01364 · DOI · Paper page
  8. Chaddad A, Kucharczyk MJ, Daniel P et al (2019) Radiomics in glioblastoma: current status and challenges facing clinical implementation. Front Oncol 9:374 · DOI · Paper page
  9. Havaei M, Dutil F, Pal C, Larochelle H, Jodoin P-M (2015) A convolutional neural network approach to brain tumor segmentation BrainLes 2015. Springer, pp 195–208 · DOI
  10. Randhawa RS, Modi A, Jain P, Warier P (2016) Improving boundary classification for brain tumor segmentation and longitudinal disease progression. Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries, 2016 10154:65–74 · DOI
  11. Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. 2015 Ieee Conference on Computer Vision and Pattern Recognition (Cvpr). https://doi.org/10.1109/cvpr.2015.7298965:3431-3440 · doi:10.1109/cvpr.2015.7298965:3431-3440
  12. Sakai K, Yamada K (2019) Machine learning studies on major brain diseases: 5-year trends of 2014-2018. Jpn J Radiol 37:34–72 · DOI
  13. Lotan E, Jain R, Razavian N, Fatterpekar GM, Lui YW (2018) State of the art: machine learning applications in glioma imaging. AJR Am J Roentgenol 212:26–37 · DOI
  14. Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group (2010) Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Int J Surg 8:336–341 · DOI · Paper page
  15. Liu XX, Faes L, Kale AU et al (2019) A comparison of deep learning performance against health-care professionals in detecting diseases from medical imaging: a systematic review and meta-analysis. Lancet Digital Health 1:E271–E297 · DOI · Paper page
  16. Yeghiazaryan V, Voiculescu I (2018) Family of boundary overlap metrics for the evaluation of medical image segmentation. J Med Imaging (Bellingham) 5:015006
  17. Taha AA, Hanbury A (2015) Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool. BMC Med Imaging 15:29 · DOI · Paper page
  18. Viechtbauer W (2010) Conducting Meta-Analyses in R with the metafor Package. Journal of Statistical Software, 36(3):1–48. https://doi.org/10.18637/jss.v036.i03 · DOI · Paper page
  19. Higgins JP, Thompson SG, Deeks JJ, Altman DG (2003) Measuring inconsistency in meta-analyses. BMJ 327:557–560 · DOI · Paper page
  20. Amirmoezzi Y, Salehi S, Parsaei H, Kazemi K, Torabi Jahromi A (2019) A knowledge-based system for brain tumor segmentation using only 3D FLAIR images. Australas Phys Eng Sci Med 42:529–540 · DOI
  21. Banerjee S, Mitra S (2020) Novel volumetric sub-region segmentation in brain tumors. Front Comput Neurosci 14:3 · DOI
  22. Bonte S, Goethals I, Van Holen R (2018) Machine learning based brain tumour segmentation on limited data using local texture and abnormality. Comput Biol Med 98:39–47 · DOI
  23. Choi Y, Nam Y, Lee YS et al (2020) IDH1 mutation prediction using MR-based radiomics in glioblastoma: comparison between manual and fully automated deep learning-based approach of tumor segmentation. Eur J Radiol 128:109031 · DOI
  24. Cui S, Mao L, Jiang J, Liu C, Xiong S (2018) Automatic semantic segmentation of brain gliomas from MRI images using a deep cascaded neural network. J Healthc Eng 2018:4940593
  25. Hasan SMK, Linte CA (2018) A modified U-Net convolutional network featuring a nearest-neighbor re-sampling-based elastic-transformation for brain tissue characterization and segmentation. Proc IEEE West N Y Image Signal Process Workshop 2018
  26. Havaei M, Larochelle H, Poulin P, Jodoin PM (2016) Within-brain classification for brain tumor segmentation. Int J Comput Assist Radiol Surg 11:777–788 · DOI
  27. Hussain S, Anwar SM, Majid M (2017) Brain tumor segmentation using cascaded deep convolutional neural network. Annu Int Conf IEEE Eng Med Biol Soc 2017:1998–2001 · DOI
  28. Iqbal S, Ghani Khan MU, Saba T et al (2019) Deep learning model integrating features and novel classifiers fusion for brain tumor segmentation. Microsc Res Tech 82:1302–1315 · DOI
  29. Iqbal S, Ghani MU, Saba T, Rehman A (2018) Brain tumor segmentation in multi-spectral MRI using convolutional neural networks (CNN). Microsc Res Tech 81:419–427 · DOI · Paper page
  30. Jiang J, Wu Y, Huang M, Yang W, Chen W, Feng Q (2013) 3D brain tumor segmentation in multimodal MR images based on learning population- and patient-specific feature sets. Comput Med Imaging Graph 37:512–521 · DOI
  31. Kao PY, Shailja S, Jiang J et al (2019) Improving patch-based convolutional neural networks for MRI brain tumor segmentation by leveraging location information. Front Neurosci 13:1449 · DOI
  32. Li Z, Wang Y, Yu J et al (2017) Low-grade glioma segmentation based on CNN with fully connected CRF. J Healthc Eng 2017:9283480
  33. Liu Y, Shi X, Xia Y et al (2018) Multi-scale V-Net: a deep learning framework for brain tumor segmentation in multiparametric MRI. Med Phys 45(6):e568 · DOI
  34. Meng Z, Fan Z, Zhao Z, Su F (2018) ENS-Unet: end-to-end noise suppression U-Net for brain tumor segmentation. Annu Int Conf IEEE Eng Med Biol Soc 2018:5886–5889 · DOI
  35. Naser MA, Deen MJ (2020) Brain tumor segmentation and grading of lower-grade glioma using deep learning in MRI images. Comput Biol Med 121:103758 · DOI · Paper page
  36. Perkuhn M, Stavrinou P, Thiele F et al (2018) Clinical evaluation of a multiparametric deep learning model for glioblastoma segmentation using heterogeneous magnetic resonance imaging data from clinical routine. Invest Radiol 53:647–654 · DOI · Paper page
  37. Razzak MI, Imran M, Xu G (2019) Efficient brain tumor segmentation with multiscale two-pathway-group conventional neural networks. IEEE J Biomed Health Inform 23:1911–1919 · DOI · Paper page
  38. Savareh BA, Emami H, Hajiabadi M, Azimi SM, Ghafoori M (2019) Wavelet-enhanced convolutional neural network: a new idea in a deep learning paradigm. Biomed Tech (Berl) 64:195–205 · DOI
  39. Soltaninejad M, Yang G, Lambrou T et al (2018) Supervised learning based multimodal MRI brain tumour segmentation using texture features from supervoxels. Comput Methods Programs Biomed 157:69–84 · DOI · Paper page
  40. Sun J, Chen W, Peng S, Liu B (2019) DRRNet: dense residual refine networks for automatic brain tumor segmentation. J Med Syst 43:221 · DOI
  41. Wang F, Niu J, Fan W, Cao Q (2018) Brain tumor medical image segmentation based on CRF 3D-CNN introduction. Basic Clin Paharmacol Toxicol 124(Supplement 2):12
  42. Wu S, Li H, Quang D, Guan Y (2020) Three-plane-assembled deep learning segmentation of gliomas. Radiol Artif Intell 2:e190011 · DOI
  43. Wu Y, Zhao Z, Wu W, Lin Y, Wang M (2019) Automatic glioma segmentation based on adaptive superpixel. BMC Med Imaging 19:73 · DOI
  44. Yang C, Guo X, Wang T et al (2019) Automatic brain tumor segmentation method based on modified convolutional neural network. Annu Int Conf IEEE Eng Med Biol Soc 2019:998–1001 · DOI
  45. Yang T, Song J, Li L (2019) A deep learning model integrating SK-TPCNN and random forests for brain tumor segmentation in MRI. Biocybern Biomed Eng 39(3):613–623. https://doi.org/10.1016/j.bbe.2019.06.003 · DOI
  46. Yang T, Song J, Li L, Tang Q (2020) Improving brain tumor segmentation on MRI based on the deep U-net and residual units. J Xray Sci Technol 28:95–110
  47. Zhao L, Wu W, Corso JJ (2013) Semi-automatic brain tumor segmentation by constrained MRFs using structural trajectories. Med Image Comput Comput Assist Interv 16:567–575
  48. Zhou Z, He Z, Shi M, Du J, Chen D (2020) 3D dense connectivity network with atrous convolutional feature pyramid for brain tumor segmentation in magnetic resonance imaging of human heads. Comput Biol Med 121:103766 · DOI
  49. Zhuge Y, Krauze AV, Ning H et al (2017) Brain tumor segmentation using holistically nested neural networks in MRI images. Med Phys 44:5234–5243 · DOI · Paper page
  50. Dong H, Yang G, Liu F, Mo Y, Guo Y (2017) Automatic brain tumor detection and segmentation using U-Net based fully convolutional networks. In: Valdés Hernández M, González-Castro V (eds) Medical image understanding and analysis. Springer International Publishing, Cham, pp 506–517 · DOI · Paper page
  51. Lyksborg M, Puonti O, Agn M, Larsen R (2015) An ensemble of 2D convolutional neural networks for tumor segmentation. In: Paulsen RR, Pedersen KS (eds) Image Analysis. Springer International Publishing, Cham, pp 201–211 · DOI
  52. Tustison NJ, Shrinidhi KL, Wintermark M et al (2015) Optimal symmetric multimodal templates and concatenated random forests for supervised brain tumor segmentation (simplified) with ANTsR. Neuroinformatics 13:209–225 · DOI · Paper page
  53. Usman K, Rajpoot K (2017) Brain tumor classification from multi-modality MRI using wavelets and machine learning. Pattern Anal Applic 20:871–881 · DOI · Paper page
  54. Xue Y, Xu T, Zhang H, Long LR, Huang XL (2018) SegAN: adversarial network with multi-scale L (1) loss for medical image segmentation. Neuroinformatics 16:383–392 · DOI · Paper page
  55. Durmo F, Lätt J, Rydelius A et al (2018) Brain tumor characterization using multibiometric evaluation of MRI. Tomography 4:14–25 · DOI
  56. De Baene W, Rutten GJM, Sitskoorn MM (2017) The temporal pattern of a lesion modulates the functional network topology of remote brain regions. Neural Plast 2017:3530723 · DOI
  57. Jiang Z, Ding C, Liu M, Tao D (2020) Two-stage cascaded U-Net: 1st place solution to BraTS challenge 2019 segmentation task. Springer International Publishing, Cham, pp 231–241
  58. Zhao Y-X, Zhang Y-M, Liu C-L (2020) Bag of tricks for 3D MRI brain tumor segmentation. Springer International Publishing, Cham, pp 210–220
  59. McKinley R, Rebsamen M, Meier R, Wiest R (2020) Triplanar ensemble of 3D-to-2D CNNs with label-uncertainty for brain tumor segmentation. Springer International Publishing, Cham, pp 379–387
  60. Hosny A, Parmar C, Quackenbush J, Schwartz LH, Aerts H (2018) Artificial intelligence in radiology. Nat Rev Cancer 18:500–510 · DOI · Paper page
  61. Herrmann E, Ermis E, Meier R et al (2019) Fully automated segmentation of the brain resection cavity for radiation target volume definition in glioblastoma patients. Strahlenther Onkol 195:586–586
  62. Meier R, Knecht U, Loosli T et al (2016) Clinical evaluation of a fully-automatic Segmentation method for longitudinal brain tumor volumetry. Sci Rep 6:23376. https://doi.org/10.1038/srep23376 · DOI · Paper page
  63. Zeng K, Bakas S, Sotiras A et al (2016) Segmentation of gliomas in pre-operative and post-operative multimodal magnetic resonance imaging volumes based on a hybrid generative-discriminative framework. Brainlesion 10154:184–194
  64. Tang F, Liang S, Zhong T et al (2020) Postoperative glioma segmentation in CT image using deep feature fusion model guided by multi-sequence MRIs. Eur Radiol 30:823–832 · DOI

Cited by

Metadata

Authors
van Kempen, E. J., Post, M., Mannil, M., Witkam, R. L., ter Laan, M., Patel, A., Meijer, F. J. A., & Henssen, D.
Venue
European Radiology
Published
2021-05-21
Volume
31
Issue
12
Pages
9638-9653
ISSN
  • 0938-7994 (ISSN-L)
  • 1432-1084
OpenAlex
W3161829336
Cited by
85
References
18
FWCI
2.17
Type
journal article
Language
en
Open access
hybrid
Licence

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.