Deep learning with mixed supervision for brain tumor segmentation
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Most of the current state-of-the-art methods for tumor segmentation are based on machine learning models trained manually on segmented images. This type of training data is particularly costly, as manual delineation of tumors is not only time-consuming but also requires medical expertise. On the other hand, images with a provided global label (indicating presence or absence of a tumor) are less informative but can be obtained at a substantially lower cost. We propose to use both types of training data (fully annotated and weakly annotated) to train a deep learning model for segmentation. The idea of our approach is to extend segmentation networks with an additional branch performing image-level classification. The model is jointly trained for segmentation and classification tasks to exploit the information contained in weakly annotated images while preventing the network from learning features that are irrelevant for the segmentation task. We evaluate our method on the challenging task of brain tumor segmentation in magnetic resonance images from the Brain Tumor Segmentation 2018 Challenge. We show that the proposed approach provides a significant improvement in segmentation performance compared to the standard supervised learning. The observed improvement is proportional to the ratio between weakly annotated and fully annotated images available for training.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., et al. (2016) · arXiv · doi:10.48550/arxiv.1603.04467 · Cited by 9,408
The multimodal brain tumor image segmentation benchmark (BRATS)
Menze, B. H., Jakab, A., Bauer, S., Kalpathy-Cramer, J., Farahani, K., Kirby, J., Burren, Y., Porz, N., Slotboom, J., Wiest, R., et al. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2014.2377694 · Cited by 6,781
Self-citationDeep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370 · cited 2×
“Simonyan et al.(24) propose to compute the gradient of the classification score with respect to the intensities of pixels and to threshold it in order to localize the object of interest.”
Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation
Kamnitsas, K., Ledig, C., Newcombe, V. F. J., Simpson, J. P., Kane, A. D., Menon, D. K., Rueckert, D., & Glocker, B. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.10.004 · Cited by 3,498
Bakas, S., Akbari, H., Sotiras, A., Bilello, M., Rozycki, M., Kirby, J. S., Freymann, J. B., Farahani, K., & Davatzikos, C. (2017) · Scientific Data · doi:10.1038/sdata.2017.117 · Cited by 3,049 · cited 7×
“We evaluate our method on the challenging task of brain tumor segmentation in multisequence MR scans, using the Training dataset of BRATS 2018 challenge.”
MethodInfluentialA survey of MRI-based medical image analysis for brain tumor studies
Bauer, S., Wiest, R., Nolte, L.-P., & Reyes, M. (2013) · Physics in Medicine and Biology · doi:10.1088/0031-9155/58/13/r97 · Cited by 1,036 · cited 1×
“Magnetic Resonance (MR) images [2] are particularly suitable for brain cancer imaging.”
DeepCut: Object Segmentation From Bounding Box Annotations Using Convolutional Neural Networks
Rajchl, M., Lee, M. C. H., Oktay, O., Kamnitsas, K., Passerat-Palmbach, J., Bai, W., Damodaram, M., Rutherford, M. A., Hajnal, J. V., Kainz, B., et al. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2621185 · Cited by 410
Self-taught object localization with deep networks
Bazzani, L., Bergamo, A., Anguelov, D., & Torresani, L. (2016) · 2016 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2016.7477688 · Cited by 140
Deep Convolutional Neural Networks for the Segmentation of Gliomas in Multi-sequence MRI
Pereira, S., Pinto, A., Alves, V., & Silva, C. A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-30858-6_12 · Cited by 135 · cited 1×
“etworks (CNN) [3, 4]. CNNs have the considerable advantage of automatically learning relevant image features. This ability is particularly important for the tumor segmentation task. CNN-based methods [5, 6, 7, 8] have obtained the best performances on the four last editions of Multimodal Brain Tumor Segmentation Chall…”
MethodCheplygina, V., de Bruijne, M., & Pluim, J. P. W. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.03.009 · Cited by 93
Cited by
Classification of Brain Tumors from MRI Images Using a Convolutional Neural Network
Badža, M. M., & Barjaktarović, M. Č. (2020) · Applied Sciences · doi:10.3390/app10061999 · Cited by 686
Mixed supervision for surface-defect detection: From weakly to fully supervised learning
Božič, J., Tabernik, D., & Skočaj, D. (2021) · Computers in Industry · doi:10.1016/j.compind.2021.103459 · Cited by 377
Image Segmentation for MR Brain Tumor Detection Using Machine Learning: A Review
Soomro, T. A., Zheng, L., Afifi, A. J., Ali, A., Soomro, S., Yin, M., & Gao, J. (2023) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2022.3185292 · Cited by 375
Yang, D., Xu, Z., Li, W., Myronenko, A., Roth, H. R., Harmon, S., Xu, S., Turkbey, B., Turkbey, E., Wang, X., et al. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.101992 · Cited by 279
“supervision for medical image analysis (Shah et al., 2018; Mlynarski et al., 2019).”
Xia, Y., Yang, D., Yu, Z., Liu, F., Cai, J., Yu, L., Zhu, Z., Xu, D., Yuille, A., & Roth, H. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101766 · Cited by 278
Metadata
- Authors
- Mlynarski, P., Delingette, H., Criminisi, A., & Ayache, N.
- Venue
- Journal of Medical Imaging
- Publisher
- SPIE-Intl Soc Optical Eng
- Published
- 2019-08-10
- Volume
- 6
- Issue
- 03
- Pages
- 1
- ISSN
- 2329-4302 (ISSN-L)
- OpenAlex
- W2967982146
- Cited by
- 119
- References
- 11
- FWCI
- 6.20
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.