The DOI matches its Crossref record; 132 of the 132 references it cites were found in a registry or an index.
The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS)
Open accessAbstract
In this paper we report the set-up and results of the Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) organized in conjunction with the MICCAI 2012 and 2013 conferences. Twenty state-of-the-art tumor segmentation algorithms were applied to a set of 65 multi-contrast MR scans of low- and high-grade glioma patients-manually annotated by up to four raters-and to 65 comparable scans generated using tumor image simulation software. Quantitative evaluations revealed considerable disagreement between the human raters in segmenting various tumor sub-regions (Dice scores in the range 74%-85%), illustrating the difficulty of this task. We found that different algorithms worked best for different sub-regions (reaching performance comparable to human inter-rater variability), but that no single algorithm ranked in the top for all sub-regions simultaneously. Fusing several good algorithms using a hierarchical majority vote yielded segmentations that consistently ranked above all individual algorithms, indicating remaining opportunities for further methodological improvements. The BRATS image data and manual annotations continue to be publicly available through an online evaluation system as an ongoing benchmarking resource.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This year, BraTS 2018 training dataset included 285 cases (210 HGG and 75 LGG), each with four 3D MRI modalities (T1, T1c, T2 and FLAIR) rigidly aligned, resampled to 1x1x1 mm isotropic resolution and skull-stripped.”
From 3D MRI Brain Tumor Segmentation Using Autoencoder Regularization (2019) · cites this paper as [18]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“different lesion appearances and annotation targets have been reported across tumor benchmarks [3,8,23]”
From Correction-aware interactive 3D tumor segmentation with sparse and revisable prompts (2026) · cites this paper as [23]
The cited source says what the claim attributes to it.
In the citing paper
“Tumor segmentation is less stable because lesions are not tied to a fixed anatomical shape or location and may be small, heterogeneous, or weakly contrasted [3,8,23].”
From Correction-aware interactive 3D tumor segmentation with sparse and revisable prompts (2026) · cites this paper as [23]
The cited source says what the claim attributes to it.
In the citing paper
“Among expert annotators there is often considerable variability206,207.”
From The METRIC-framework for assessing data quality for trustworthy AI in medicine: A systematic review (2024) · cites this paper as [207]
In the citing paper
“The testing dataset (191 cases) allowed only a single submission, and was used to calculate the final challenge ranking.”
From 3D MRI Brain Tumor Segmentation Using Autoencoder Regularization (2019) · cites this paper as [18]
In the citing paper
“The validation dataset (66 cases) allowed multiple submissions and was designed for intermediate evaluations.”
From 3D MRI Brain Tumor Segmentation Using Autoencoder Regularization (2019) · cites this paper as [18]
In the citing paper
“Further noting that the preliminary federation model was already within the intra- and inter-rater variability range for this use-case (20% and 28%, respectively)47, any further improvements for the full federation consensus model would be expected to be minimal35–38.”
From Federated learning enables big data for rare cancer boundary detection (2022) · cites this paper as [35]
In the citing paper
“The complexity of boundary detection drops when moving from smaller to larger sub-compartments, i.e., from ET to TC, and then to WT35–38.”
From Federated learning enables big data for rare cancer boundary detection (2022) · cites this paper as [35]
In the citing paper
“Moreover, varying characteristics of the mpMRI data due to scanner hardware and acquisition protocol differences33,34 were handled at each collaborating site via established harmonized preprocessing pipelines35–39.”
From Federated learning enables big data for rare cancer boundary detection (2022) · cites this paper as [35]
In the citing paper
“Additionally, we used a single off-the-shelf neural network architecture for training, but it has been shown that model ensembles perform better for the task at hand35–38, and it remains to be explored how such a strategy could be explored in a federated study.”
From Federated learning enables big data for rare cancer boundary detection (2022) · cites this paper as [35]
In the citing paper
“The BraTS challenge35–38, seeking methodological advancements in the domain of neuro-oncology, has been providing the community with (i) the largest publicly available and manually-curated mpMRI dataset of diffuse glioma patients (an example of which is illustrated in Fig. 1b), and (ii) a harmonized preprocessing pipeline51,70,71 to handle differences in inter-site acquisition protocols.”
From Federated learning enables big data for rare cancer boundary detection (2022) · cites this paper as [35]
In the citing paper
“This functionality follows the harmonized data preprocessing protocol defined by the BraTS challenge35–38, as described below. This would allow accounting for inter-site acquisition protocol variations, e.g., 3D vs. 2D axial plane acquisitions.”
From Federated learning enables big data for rare cancer boundary detection (2022) · cites this paper as [35]
In the citing paper
“which is typically done in academic research projects35–38”
From Federated learning enables big data for rare cancer boundary detection (2022) · cites this paper as [35]
In the citing paper
“Following the precise definition of our problem statement35–38, ensuring strict compliance with the preprocessing and annotation protocol for the generation of reference standards was vital for the model to learn correct information during training.”
From Federated learning enables big data for rare cancer boundary detection (2022) · cites this paper as [35]
In the citing paper
“Eaton-Rosene et al. [75] proposed a generalizable technique for quantifying uncertainty with Bayesian Neural Networks for semantic segmentation on the BraTS 2017 dataset [76], including 285 subjects with high-or low-grade gliomas.”
From Explainable AI in medical imaging: An overview for clinical practitioners – Beyond saliency-based XAI approaches (2023) · cites this paper as [76]
In the citing paper
“For tumor segmentation in the BraTS dataset Menze et al. (2014) (120 training and 50 test MR scans), the authors report six and seven points increase in Dice over supervised model when 20 and 50 labeled MR images are used for training.”
From Embracing imperfect datasets: A review of deep learning solutions for medical image segmentation (2020) · cites this paper as Menze et al. (2014)
In the citing paper
“The suggested method outperforms other modifications such as CRF post-processing as well as sophisticated test-time data augmentation, winning the first place in the 2018 BraTS challenge”
From Embracing imperfect datasets: A review of deep learning solutions for medical image segmentation (2020) · cites this paper as Menze et al. (2014)
In the citing paper
“their 3D generalization on BraTS dataset Menze et al. (2014) (274 training and 110 testing) leads to marginal performance gains in Dice, i.e. 3.7% over Random Forests, 0.3% over an ensemble method, and merely 0.7% over their proposed architecture”
From Embracing imperfect datasets: A review of deep learning solutions for medical image segmentation (2020) · cites this paper as Menze et al. (2014)
In the citing paper
“And on BraTS 2015 Menze et al. (2014), consisting of 220 multi-modal MR images of brain tumors, 3D RNN-CRF slightly improves the Dice for tumor segmentation from 73.5% ± 10.5% to 73.8% ± 10.5% based upon a split of 85%/15% (187 training and 33 testing).”
From Embracing imperfect datasets: A review of deep learning solutions for medical image segmentation (2020) · cites this paper as Menze et al. (2014)
In the citing paper
“Brain Tumor Image Segmentation Benchmark (BraTS) [104] is a benchmark dataset for brain tumor segmentation.”
From Federated learning for medical image analysis: A survey (2024) · cites this paper as [104]
In the citing paper
“It contains brain MRIs acquired by various scanners from around 19 independent institutions.”
From Federated learning for medical image analysis: A survey (2024) · cites this paper as [104]
In the citing paper
“The existing automatic and semi-automatic brain tumor segmentation methods can be broadly categorized as either generative model based or discriminative model based methods (Menze et al., 2015).”
From A deep learning model integrating FCNNs and CRFs for brain tumor segmentation (2018) · cites this paper as Menze et al., 2015
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Cortes, C., & Vapnik, V. N. (1995) · Machine Learning · doi:10.1023/a:1022627411411 · Cited by 34,565
New response evaluation criteria in solid tumours: revised RECIST guideline (version 1.1)
Eisenhauer, E. A., Therasse, P., Bogaerts, J., Schwartz, L. H., Sargent, D., Ford, R., Dancey, J., Arbuck, S., Gwyther, S., Mooney, M., et al. (2009) · European Journal of Cancer · doi:10.1016/j.ejca.2008.10.026 · Cited by 29,534
Self-citationThe Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
The 2007 WHO Classification of Tumours of the Central Nervous System
Louis, D. N., Ohgaki, H., Wiestler, O. D., Cavenee, W. K., Burger, P. C., Jouvet, A., Scheithauer, B. W., & Kleihues, P. (2007) · Acta Neuropathologica · doi:10.1007/s00401-007-0243-4 · Cited by 15,675
Robust Real-Time Face Detection
Viola, P., & Jones, M. J. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000013087.49260.fb · Cited by 14,097
Research works printed but not linked: 10
- 10.1007/s00401-007-0278-6 · DOI
- Menze, Segmenting glioma in multi-modal images using a generative model for brain lesion segmentation, 1
- Ibanez, 2003, The ITK Software Guide
- Cocosco, 1997, Brainweb: Online interface to a 3D MRI simulated brain database, NeuroImage, 301
- Bauer, Segmentation of brain tumor images based on integrated hierarchical classification and regularization, 32
- 10.1007/978-3-642-33454-2_46 · DOI · Paper page
- 10.2307/2984875 · DOI
- 10.1007/978-3-642-23626-6_44 · DOI
- 10.29172/7c2a6982-6d72-4cd8-bba6-2fccb06a7011 · DOI
- 10.1109/34.969114 · DOI · Paper page
Cited by
Sorted by citations
nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation
Isensee, F., Jaeger, P. F., Kohl, S. A. A., Petersen, J., & Maier-Hein, K. H. (2021) · Nature Methods · doi:10.1038/s41592-020-01008-z · Cited by 10,477
Shin, H.-C., Roth, H. R., Gao, M., Lu, L., Xu, Z., Nogues, I., Yao, J., Mollura, D., & Summers, R. M. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2528162 · Cited by 5,759
Self-citationEfficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation
Kamnitsas, K., Ledig, C., Newcombe, V. F. J., Simpson, J. P., Kane, A. D., Menon, D. K., Rueckert, D., & Glocker, B. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.10.004 · Cited by 3,498
“Table 2: Average performance of our system on the training data of BRATS 2015 as computed on the online evaluation platform and comparison to other submissions visible at the time of manuscript submission.”
BackgroundMethodInfluentialSelf-citationBrain tumor segmentation with Deep Neural Networks
Havaei, M., Davy, A., Warde-Farley, D., Biard, A., Courville, A., Bengio, Y., Pal, C., Jodoin, P.-M., & Larochelle, H. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.05.004 · Cited by 3,278
The future of digital health with federated learning
Rieke, N., Hancox, J., Li, W., Milletarì, F., Roth, H. R., Albarqouni, S., Bakas, S., Galtier, M. N., Landman, B. A., Maier-Hein, K., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-00323-1 · Cited by 4,015
Bakas, S., Akbari, H., Sotiras, A., Bilello, M., Rozycki, M., Kirby, J. S., Freymann, J. B., Farahani, K., & Davatzikos, C. (2017) · Scientific Data · doi:10.1038/sdata.2017.117 · Cited by 3,049
Self-citationBrain Tumor Segmentation Using Convolutional Neural Networks in MRI Images
Pereira, S., Pinto, A., Alves, V., & Silva, C. A. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2538465 · Cited by 2,735
Self-citationSheller, M. J., Edwards, B., Reina, G. A., Martin, J., Pati, S., Kotrotsou, A., Milchenko, M., Xu, W., Marcus, D., Colen, R. R., et al. (2020) · Scientific Reports · doi:10.1038/s41598-020-69250-1 · Cited by 1,646
“The binarized whole tumor (WT) labels for the BraTS 2017 validation data and the additional 22 BraTS 2017 test cases that were moved to BraTS 2019 validation set, were provided to the lead author Micah Sheller after the conclusion of the BraTS 2018 competition and under a signed Non-Disclosure Agreement.”
MethodInfluential3D MRI Brain Tumor Segmentation Using Autoencoder Regularization
Myronenko, A. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-11726-9_28 · Cited by 1,283
Deep multimodal learning: a survey on recent advances and trends
Ramachandram, D., & Taylor, G. W. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2738401 · Cited by 1,139
Deep learning for brain MRI segmentation: state of the art and future directions
Akkus, Z., Galimzianova, A., Hoogi, A., Rubin, D. L., & Erickson, B. J. (2017) · Journal of Digital Imaging · doi:10.1007/s10278-017-9983-4 · Cited by 1,129
Domain adaptation for medical image analysis: A survey
Guan, H., & Liu, M. (2022) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2021.3117407 · Cited by 1,057
Embracing imperfect datasets: A review of deep learning solutions for medical image segmentation
Tajbakhsh, N., Jeyaseelan, L., Li, Q., Chiang, J. N., Wu, Z., & Ding, X. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101693 · Cited by 1,095
“The suggested framework is evaluated in two applications: brain tumor segmentation using the BraTS dataset Menze et al. (2014) (249 training and 25 test MR images) and multi-organ segmentation”
BackgroundMethodInfluentialPreparing Medical Imaging Data for Machine Learning
Willemink, M. J., Koszek, W. A., Hardell, C., Wu, J., Fleischmann, D., Harvey, H., Folio, L. R., Summers, R. M., Rubin, D. L., & Lungren, M. P. (2020) · Radiology · doi:10.1148/radiol.2020192224 · Cited by 1,020
Interactive medical image segmentation using deep learning with image-specific fine tuning
Wang, G., Li, W., Zuluaga, M. A., Pratt, R., Patel, P. A., Aertsen, M., Doel, T., David, A. L., Deprest, J., Ourselin, S., et al. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2791721 · Cited by 843
A deep learning model integrating FCNNs and CRFs for brain tumor segmentation
Zhao, X., Wu, Y., Song, G., Li, Z., Zhang, Y., & Fan, Y. (2018) · Medical Image Analysis · doi:10.1016/j.media.2017.10.002 · Cited by 813
Abdulrahman, S., Tout, H., Ould-Slimane, H., Mourad, A., Talhi, C., & Guizani, M. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3030072 · Cited by 796
Segment anything model for medical image analysis: An experimental study
Mazurowski, M. A., Dong, H., Gu, H., Yang, J., Konz, N., & Zhang, Y. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102918 · Cited by 802
“MRI-Brain The Multimodal Brain Tumor Image Segmentation Benchmark (BraTS) [11] MRI 3 Three parts of brain tumor 13,107”
BackgroundReview of MRI-based brain tumor image segmentation using deep learning methods
Işın, A., Direkoğlu, C., & Şah, M. (2016) · Procedia Computer Science · doi:10.1016/j.procs.2016.09.407 · Cited by 766
“Everyone wants to do the model work, not the data work”: Data Cascades in High-Stakes AI
Sambasivan, N., Kapania, S., Highfill, H., Akrong, D., Paritosh, P., & Aroyo, L. M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445518 · Cited by 781
AI in Medical Imaging Informatics: Current Challenges and Future Directions
Panayides, A. S., Amini, A., Filipovic, N. D., Sharma, A., Tsaftaris, S. A., Young, A., Foran, D., Do, N., Golemati, S., Kurc, T., et al. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.2991043 · Cited by 713
Multi-atlas segmentation of biomedical images: A survey
Iglesias, J. E., & Sabuncu, M. R. (2015) · Medical Image Analysis · doi:10.1016/j.media.2015.06.012 · Cited by 667
Wang, G., Li, W., Aertsen, M., Deprest, J., Ourselin, S., & Vercauteren, T. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.01.103 · Cited by 659
Loss odyssey in medical image segmentation
Ma, J., Chen, J., Ng, M., Huang, R., Li, Y., Li, C., Yang, X., & Martel, A. L. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102035 · Cited by 662
Decentralized federated learning: Fundamentals, state of the art, frameworks, trends, and challenges
Martínez Beltrán, E. T., Pérez, M. Q., Sánchez, P. M. S., Bernal, S. L., Bovet, G., Pérez, M. G., Pérez, G. M., & Celdrán, A. H. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3315746 · Cited by 625
“[96] 2022 Detect brain tumor segmentation, using representative clinical datasets Cross-device Centralized Decentralized Real U-Net CFA FedPer Synchronous Asynchronous Random BRATS [167] Private [88] 2022 Detect misconduct model on specific sites from any learning iteration Cross-device Centralized Decentralized Simul…”
MethodInfluentialSelf-supervised learning for medical image analysis using image context restoration
Chen, L., Bentley, P., Mori, K., Misawa, K., Fujiwara, M., & Rueckert, D. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.101539 · Cited by 575
Sheller, M. J., Reina, G. A., Edwards, B., Martin, J., & Bakas, S. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-11723-8_9 · Cited by 609
NiftyNet: a deep-learning platform for medical imaging
Gibson, E., Li, W., Sudre, C., Fidon, L., Shakir, D. I., Wang, G., Eaton-Rosen, Z., Gray, R., Doel, T., Hu, Y., et al. (2018) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2018.01.025 · Cited by 552
Understanding adversarial attacks on deep learning based medical image analysis systems
Ma, X., Niu, Y., Gu, L., Wang, Y., Zhao, Y., Bailey, J., & Lu, F. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2020.107332 · Cited by 553
Federated learning for medical image analysis: A survey
Guan, H., Yap, P.-T., Bozoki, A., & Liu, M. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110424 · Cited by 518
Deep MRI brain extraction: A 3D convolutional neural network for skull stripping
Kleesiek, J., Urban, G., Hubert, A., Schwarz, D., Maier-Hein, K., Bendszus, M., & Biller, A. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.01.024 · Cited by 505
DeepIGeoS: A Deep Interactive Geodesic Framework for Medical Image Segmentation
Wang, G., Zuluaga, M. A., Li, W., Pratt, R., Patel, P. A., Aertsen, M., Doel, T., David, A. L., Deprest, J., Ourselin, S., et al. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2840695 · Cited by 502
Segment anything model for medical images?
Huang, Y., Yang, X., Liu, L., Zhou, H., Chang, A., Zhou, X., Chen, R., Yu, J., Chen, J., Chen, C., et al. (2024) · Medical Image Analysis · doi:10.1016/j.media.2023.103061 · Cited by 536
“AbdomenCT-1K [22] Liver, kidney, spleen and pancreas CT ACDC [23] Left and right ventricle and left ventricular myocardium cine MRI AMOS 2022 [24] Abdominal multi-organ segmentation CT, MRI AutoLaparo [25] Integrated dataset with multiple image-based perception tasks Colonoscopy BrainPTM 2021 [26] white matter tracts…”
RA-UNet: A Hybrid Deep Attention-Aware Network to Extract Liver and Tumor in CT Scans
Jin, Q., Meng, Z., Sun, C., Cui, H., & Su, R. (2020) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2020.605132 · Cited by 468
Nair, T., Precup, D., Arnold, D. L., & Arbel, T. (2020) · Medical Image Analysis · doi:10.1016/j.media.2019.101557 · Cited by 451
Self-citationBrain tumor detection using fusion of hand crafted and deep learning features
Saba, T., Sameh Mohamed, A., El-Affendi, M., Amin, J., & Sharif, M. (2020) · Cognitive Systems Research · doi:10.1016/j.cogsys.2019.09.007 · Cited by 433
Confidence calibration and predictive uncertainty estimation for deep medical image segmentation
Mehrtash, A., Wells, W. M., Tempany, C. M., Abolmaesumi, P., & Kapur, T. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.3006437 · Cited by 428
ResNet and its application to medical image processing: Research progress and challenges
Xu, W., Fu, Y.-L., & Zhu, D. (2023) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2023.107660 · Cited by 416
Federated learning enables big data for rare cancer boundary detection
Pati, S., Baid, U., Edwards, B., Sheller, M., Wang, S.-H., Reina, G. A., Foley, P., Gruzdev, A., Karkada, D., Davatzikos, C., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-33407-5 · Cited by 394
Park, J. E., Park, S. Y., Kim, H. J., & Kim, H. S. (2019) · Korean Journal of Radiology · doi:10.3348/kjr.2018.0070 · Cited by 388
Langlotz, C. P., Allen, B., Erickson, B. J., Kalpathy-Cramer, J., Bigelow, K., Cook, T. S., Flanders, A. E., Lungren, M. P., Mendelson, D. S., Rudie, J. D., et al. (2019) · Radiology · doi:10.1148/radiol.2019190613 · Cited by 368
Self-citationCausality matters in medical imaging
Castro, D. C., Walker, I., & Glocker, B. (2020) · Nature Communications · doi:10.1038/s41467-020-17478-w · Cited by 364
Self-citationData Augmentation for Brain-Tumor Segmentation: A Review
Nalepa, J., Marcinkiewicz, M., & Kawulok, M. (2019) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2019.00083 · Cited by 340
HeMIS: Hetero-Modal Image Segmentation
Havaei, M., Guizard, N., Chapados, N., & Bengio, Y. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46723-8_54 · Cited by 332
“There are no ground truth provided for these datasets and thus quantitative evaluation can be achieved via an online evaluation system [13].”
MethodInfluentialBig data analysis for brain tumor detection: Deep convolutional neural networks
Amin, J., Sharif, M., Yasmin, M., & Fernandes, S. L. (2018) · Future Generation Computer Systems · doi:10.1016/j.future.2018.04.065 · Cited by 327
DeepMedic for Brain Tumor Segmentation
Kamnitsas, K., Ferrante, E., Parisot, S., Ledig, C., Nori, A. V., Criminisi, A., Rueckert, D., & Glocker, B. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-55524-9_14 · Cited by 346
Self-citationRauniyar, A., Hagos, D. H., Jha, D., Håkegård, J. E., Bagci, U., Rawat, D. B., & Vlassov, V. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3329061 · Cited by 315
Survey on deep learning for radiotherapy
Meyer, P., Noblet, V., Mazzara, C., & Lallement, A. (2018) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2018.05.018 · Cited by 302
Chen, H., Gomez, C., Huang, C.-M., & Unberath, M. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00699-2 · Cited by 300
Semantic segmentation using Vision Transformers: A survey
Thisanke, H., Deshan, C., Chamith, K., Seneviratne, S., Vidanaarachchi, R., & Herath, D. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.106669 · Cited by 288
A comprehensive survey on multimodal medical signals fusion for smart healthcare systems
Muhammad, G., Alshehri, F., Karray, F., Saddik, A. E., Alsulaiman, M., & Falk, T. H. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.06.007 · Cited by 287
Li, Y., El Habib Daho, M., Conze, P.-H., Zeghlache, R., Le Boité, H., Tadayoni, R., Cochener, B., Lamard, M., & Quellec, G. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108635 · Cited by 274
Missing MRI Pulse Sequence Synthesis Using Multi-Modal Generative Adversarial Network
Sharma, A., & Hamarneh, G. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2945521 · Cited by 254
Combining Noise-to-Image and Image-to-Image GANs: Brain MR Image Augmentation for Tumor Detection
Han, C., Rundo, L., Araki, R., Nagano, Y., Furukawa, Y., Mauri, G., Nakayama, H., & Hayashi, H. (2019) · IEEE Access · doi:10.1109/access.2019.2947606 · Cited by 253
Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images
Thaha, M. M., Kumar, K. P. M., Murugan, B. S., Dhanasekeran, S., Vijayakarthick, P., & Selvi, A. S. (2019) · Journal of Medical Systems · doi:10.1007/s10916-019-1416-0 · Cited by 244
van Velzen, S. G. M., Lessmann, N., Velthuis, B. K., Bank, I. E. M., van den Bongard, D. H. J. G., Leiner, T., de Jong, P. A., Veldhuis, W. B., Correa, A., Terry, J. G., et al. (2020) · Radiology · doi:10.1148/radiol.2020191621 · Cited by 244
Neural Network Based Brain Tumor Detection Using Wireless Infrared Imaging Sensor
Mohamed Shakeel, P., Tobely, T. E. E., Al-Feel, H., Manogaran, G., & Baskar, S. (2019) · IEEE Access · doi:10.1109/access.2018.2883957 · Cited by 232
Borys, K., Schmitt, Y. A., Nauta, M., Seifert, C., Krämer, N., Friedrich, C. M., & Nensa, F. (2023) · European Journal of Radiology · doi:10.1016/j.ejrad.2023.110786 · Cited by 233
Federated learning for secure IoMT-applications in smart healthcare systems: A comprehensive review
Rani, S., Kataria, A., Kumar, S., & Tiwari, P. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110658 · Cited by 228
Sharif, M., Amin, J., Raza, M., Yasmin, M., & Satapathy, S. C. (2020) · Pattern Recognition Letters · doi:10.1016/j.patrec.2019.11.017 · Cited by 206
Prayitno, Shyu, C.-R., Putra, K. T., Chen, H.-C., Tsai, Y.-Y., Hossain, K. S. M. T., Jiang, W., & Shae, Z.-Y. (2021) · Applied Sciences · doi:10.3390/app112311191 · Cited by 210
Laukamp, K. R., Thiele, F., Shakirin, G., Zopfs, D., Faymonville, A., Timmer, M., Maintz, D., Perkuhn, M., & Borggrefe, J. (2019) · European Radiology · doi:10.1007/s00330-018-5595-8 · Cited by 205
Dual-force convolutional neural networks for accurate brain tumor segmentation
Chen, S., Ding, C., & Liu, M. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2018.11.009 · Cited by 195
Hu, K., Gan, Q., Zhang, Y., Deng, S., Xiao, F., Huang, W., Cao, C., & Gao, X. (2019) · IEEE Access · doi:10.1109/access.2019.2927433 · Cited by 188
Celard, P., Iglesias, E. L., Sorribes-Fdez, J. M., Romero, R., Vieira, A. S., & Borrajo, L. (2023) · Neural Computing and Applications · doi:10.1007/s00521-022-07953-4 · Cited by 188
Brain Tumor Detection by Using Stacked Autoencoders in Deep Learning
Amin, J., Sharif, M., Gul, N., Raza, M., Anjum, M. A., Nisar, M. W., & Bukhari, S. A. C. (2020) · Journal of Medical Systems · doi:10.1007/s10916-019-1483-2 · Cited by 178
Guo, P., Wang, P., Zhou, J., Jiang, S., & Patel, V. M. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00245 · Cited by 193
User-Guided Segmentation of Multi-modality Medical Imaging Datasets with ITK-SNAP
Yushkevich, P. A., Pashchinskiy, A., Oguz, I., Mohan, S., Schmitt, J. E., Stein, J. M., Zukić, D., Vicory, J., McCormick, M., Yushkevich, N., et al. (2019) · Neuroinformatics · doi:10.1007/s12021-018-9385-x · Cited by 175
Moradmand, H., Aghamiri, S. M. R., & Ghaderi, R. (2020) · Journal of Applied Clinical Medical Physics · doi:10.1002/acm2.12795 · Cited by 173
The METRIC-framework for assessing data quality for trustworthy AI in medicine: A systematic review
Schwabe, D., Becker, K., Seyferth, M., Klaß, A., & Schaeffter, T. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01196-4 · Cited by 169
Monteiro, M., Newcombe, V. F. J., Mathieu, F., Adatia, K., Kamnitsas, K., Ferrante, E., Das, T., Whitehouse, D., Rueckert, D., Menon, D. K., et al. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30085-6 · Cited by 162
Self-citationA Comprehensive Survey on Deep Learning Multi-Modal Fusion: Methods, Technologies and Applications
Jiao, T., Guo, C., Feng, X., Chen, Y., & Song, J. (2024) · Computers, Materials & Continua · doi:10.32604/cmc.2024.053204 · Cited by 158
Ng, D., Lan, X., Yao, M. M.-S., Chan, W. P., & Feng, M. (2021) · Quantitative Imaging in Medicine and Surgery · doi:10.21037/qims-20-595 · Cited by 152
Amin, J., Sharif, M., Yasmin, M., Saba, T., Anjum, M. A., & Fernandes, S. L. (2019) · Journal of Medical Systems · doi:10.1007/s10916-019-1453-8 · Cited by 147
Multi-modality approaches for medical support systems: A systematic review of the last decade
Salvi, M., Loh, H. W., Seoni, S., Barua, P. D., García, S., Molinari, F., & Acharya, U. R. (2024) · Information Fusion · doi:10.1016/j.inffus.2023.102134 · Cited by 144
Brain Tumor Detection Based on Multimodal Information Fusion and Convolutional Neural Network
Li, M., Kuang, L., Xu, S., & Sha, Z. (2019) · IEEE Access · doi:10.1109/access.2019.2958370 · Cited by 140
Hetero-Modal Variational Encoder-Decoder for Joint Modality Completion and Segmentation
Dorent, R., Joutard, S., Modat, M., Ourselin, S., & Vercauteren, T. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-32245-8_9 · Cited by 160
Federated learning for healthcare applications
Chaddad, A., Wu, Y., & Desrosiers, C. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3325822 · Cited by 136
Transfer learning in magnetic resonance brain imaging: a systematic review
Valverde, J. M., Imani, V., Abdollahzadeh, A., De Feo, R., Prakash, M., Ciszek, R., & Tohka, J. (2021) · Journal of Imaging · doi:10.3390/jimaging7040066 · Cited by 137
Dvořák, P., & Menze, B. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-42016-5_6 · Cited by 119
Self-citationAnalyzing the quality and challenges of uncertainty estimations for brain tumor segmentation
Jungo, A., Balsiger, F., & Reyes, M. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.00282 · Cited by 115
Self-citationReviewing Federated Machine Learning and Its Use in Diseases Prediction
Moshawrab, M., Adda, M., Bouzouane, A., Ibrahim, H., & Raad, A. (2023) · Sensors · doi:10.3390/s23042112 · Cited by 114
3D cGAN based cross-modality MR image synthesis for brain tumor segmentation
Yu, B., Zhou, L., Wang, L., Fripp, J., & Bourgeat, P. (2018) · 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018) · doi:10.1109/isbi.2018.8363653 · Cited by 109
Autofocus Layer for Semantic Segmentation
Qin, Y., Kamnitsas, K., Ancha, S., Nanavati, J., Cottrell, G., Criminisi, A., & Nori, A. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00931-1_69 · Cited by 135
Self-citationKainz, W., Neufeld, E., Bolch, W. E., Graff, C. G., Kim, C. H., Kuster, N., Lloyd, B., Morrison, T., Segars, P., Yeom, Y. S., et al. (2019) · IEEE Transactions on Radiation and Plasma Medical Sciences · doi:10.1109/trpms.2018.2883437 · Cited by 109
Deep learning-enabled multi-organ segmentation in whole-body mouse scans
Schoppe, O., Pan, C., Coronel, J., Mai, H., Rong, Z., Todorov, M. I., Müskes, A., Navarro, F., Li, H., Ertürk, A., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-19449-7 · Cited by 104
Self-citationBrain Tumour Segmentation based on Extremely Randomized Forest with high-level features
Pinto, A., Pereira, S., Correia, H., Oliveira, J., Rasteiro, D. M. L. D., & Silva, C. A. (2015) · 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2015.7319032 · Cited by 108
Self-citationDemystifying Brain Tumor Segmentation Networks: Interpretability and Uncertainty Analysis
Natekar, P., Kori, A., & Krishnamurthi, G. (2020) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2020.00006 · Cited by 103
Radiomics in radiooncology – challenging the medical physicist
Peeken, J. C., Bernhofer, M., Wiestler, B., Goldberg, T., Cremers, D., Rost, B., Wilkens, J. J., Combs, S. E., & Nüsslin, F. (2018) · Physica Medica · doi:10.1016/j.ejmp.2018.03.012 · Cited by 98
DALSA: domain adaptation for supervised learning from sparsely annotated MR images
Goetz, M., Weber, C., Binczyk, F., Polanska, J., Tarnawski, R., Bobek-Billewicz, B., Koethe, U., Kleesiek, J., Stieltjes, B., & Maier-Hein, K. H. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2463078 · Cited by 98
Mok, T. C. W., & Chung, A. C. S. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-11723-8_7 · Cited by 95
Thakur, S., Doshi, J., Pati, S., Rathore, S., Sako, C., Bilello, M., Ha, S. M., Shukla, G., Flanders, A., Kotrotsou, A., et al. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.117081 · Cited by 84
Understanding Biases and Disparities in Radiology AI Datasets: A Review
Tripathi, S., Gabriel, K., Dheer, S., Parajuli, A., Augustin, A. I., Elahi, A., Awan, O., & Dako, F. (2023) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2023.06.015 · Cited by 75
SAINT: Spatially Aware Interpolation NeTwork for Medical Slice Synthesis
Peng, C., Lin, W.-A., Liao, H., Chellappa, R., & Zhou, S. K. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00777 · Cited by 75
Deep Feature Learning with Discrimination Mechanism for Brain Tumor Segmentation and Diagnosis
Zhao, L., & Jia, K. (2015) · 2015 International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP) · doi:10.1109/iih-msp.2015.41 · Cited by 67
Self-citationLaukamp, K. R., Pennig, L., Thiele, F., Reimer, R., Görtz, L., Shakirin, G., Zopfs, D., Timmer, M., Perkuhn, M., & Borggrefe, J. (2021) · Clinical Neuroradiology · doi:10.1007/s00062-020-00884-4 · Cited by 62
Scalable Multimodal Convolutional Networks for Brain Tumour Segmentation
Fidon, L., Li, W., Garcia-Peraza-Herrera, L. C., Ekanayake, J., Kitchen, N., Ourselin, S., & Vercauteren, T. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66179-7_33 · Cited by 60
Lekadir, K., Osuala, R., Gallin, C., Lazrak, N., Kushibar, K., Tsakou, G., Aussó, S., Alberich, L. C., Marias, K., Tsiknakis, M., et al. (2021) · arXiv · doi:10.48550/arxiv.2109.09658 · Cited by 58
Rathore, S., Bakas, S., Pati, S., Akbari, H., Kalarot, R., Sridharan, P., Rozycki, M., Bergman, M., Tunc, B., Verma, R., et al. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-75238-9_12 · Cited by 57
Artificial intelligence in glioma imaging: Challenges and advances
Jin, W., Fatehi, M., Abhishek, K., Mallya, M., Toyota, B., & Hamarneh, G. (2020) · Journal of Neural Engineering · doi:10.1088/1741-2552/ab8131 · Cited by 55
Metadata
- Authors
- Menze, B. H., Jakab, A., Bauer, S., Kalpathy-Cramer, J., Farahani, K., Kirby, J., Burren, Y., Porz, N., Slotboom, J., Wiest, R., Lanczi, L., Gerstner, E., Weber, M.-A., Arbel, T., Avants, B. B., Ayache, N., Buendia, P., Collins, D. L., Cordier, N., Corso, J. J., Criminisi, A., Das, T., Delingette, H., Demiralp, C., Durst, C. R., Dojat, M., Doyle, S., Festa, J., Forbes, F., Geremia, E., Glocker, B., Golland, P., Guo, X., Hamamci, A., Iftekharuddin, K. M., Jena, R., John, N. M., Konukoglu, E., Lashkari, D., Mariz, J. A., Meier, R., Pereira, S., Precup, D., Price, S. J., Raviv, T. R., Reza, S. M. S., Ryan, M., Sarikaya, D., Schwartz, L., Shin, H.-C., Shotton, J., Silva, C. A., Sousa, N., Subbanna, N. K., Szekely, G., Taylor, T. J., Thomas, O. M., Tustison, N. J., Unal, G., Vasseur, F., Wintermark, M., Ye, D. H., Zhao, L., Zhao, B., Zikic, D., Prastawa, M., Reyes, M., & Van Leemput, K.
- Affiliations
- Institut national de recherche en sciences et technologies du numérique (FR)
- University of Bern (CH)
- National Institutes of Health (US)
- University Hospital of Bern (CH)
- Harvard University (US)
- McGill University (CA)
- University of Pennsylvania (US)
- Infotech Soft (United States) (US)
- University at Buffalo, State University of New York (US)
- Microsoft Research (United Kingdom) (GB)
- Cambridge University Hospitals NHS Foundation Trust (GB)
- University of Virginia (US)
- University of Minho (PT)
- Imperial College London (GB)
- MIT Computer Science and Artificial Intelligence Laboratory (US)
- Columbia University (US)
- Old Dominion University (US)
- University of Miami (US)
- Ben-Gurion University of the Negev (IL)
- University Hospital Heidelberg (DE)
- Purdue University West Lafayette (US)
- GE Global Research (United States) (US)
- Corresponding author
- Menze, Bjoern H.
- ORCID
- Menze, Bjoern H.
- Farahani, Keyvan
- Kirby, Justin
- Porz, Nicole
- Slotboom, Johannes
- Wiest, Roland
- Gerstner, Elizabeth
- Arbel, Tal
- Avants, Brian B.
- Ayache, Nicholas
- Buendia, Patricia
- Collins, D. Louis
- Cordier, Nicolas
- Corso, Jason J.
- Criminisi, Antonio
- Das, Tilak
- Durst, Christopher R.
- Dojat, Michel
- Doyle, Senan
- Festa, Joana
- Forbes, Florence
- Glocker, Ben
- Golland, Polina
- Meier, Raphael
- Precup, Doina
- Price, Stephen J.
- Raviv, Tammy Riklin
- Ryan, Michael
- Silva, Carlos A.
- Sousa, Nuno
- Thomas, Owen M.
- Tustison, Nicholas J.
- Wintermark, Max
- Ye, Dong Hye
- Zhao, Liang
- Zhao, Binsheng
- Prastawa, Marcel
- Reyes, Mauricio
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2015-10
- Volume
- 34
- Issue
- 10
- Pages
- 1993-2024
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- PMC
- PMC4833122
- OpenAlex
- W1641498739
- Cited by
- 6,781
- References
- 132
- Citations by year
- 2026: 863 · 2025: 937 · 2024: 899 · 2023: 845 · 2022: 791 · 2021: 709 · 2020: 612 · 2019: 468 · 2018: 310 · 2017: 161 · 2016: 120 · 2015: 49
- FWCI
- 9.37
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- IEEE Transactions on Medical Imaging (publishedVersion, other-oa)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- ODU Digital Commons (Old Dominion University) (submittedVersion)
- HAL (submittedVersion, other-oa)
- DSpace@MIT (Massachusetts Institute of Technology) (submittedVersion, cc-by-nc-sa)
- Funders
- National Science Foundation
- National Institute for Health and Care Research (NIHR/CS/009/011)
- European Commission (600841)
- Academy of Finland
- Tekes
- Lundbeckfonden (R141-2013-13117)
- Krebsliga Schweiz
- Technische Universität München
- National Institutes of Health
- Fundação para a Ciência e a Tecnologia
- National Cancer Institute (U01CA154601, R15CA115464)
- National Institute of Biomedical Imaging and Bioengineering (P41EB015902, U54EB005149, R01EB013565)
- National Center for Research Resources (P41-RR-14075, P41RR014075, P41RR013218, P41 RR13218)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Brain Tumor Detection and Classification
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Health Sciences › Medicine › Oncology › Glioma Diagnosis and Treatment
- Keywords
- brain tumor segmentation, glioma, multimodal MRI, benchmark, interobserver variability, algorithm fusion, majority voting, manual annotation
- MeSH terms
- Algorithms, Glioma, Humans, Magnetic Resonance Imaging, Benchmarking, Neuroimaging
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
