CoChat
Sign Up
PreprintCited by 3

The DOI matches its DataCite record; 3 of the 3 references it cites were found in a registry or an index.

Diffusion Models for Implicit Image Segmentation Ensembles

Wolleb, Julia, Sandkühler, Robin, Bieder, Florentin, Valmaggia, Philippe, Cattin, Philippe C.·2021·arXiv
DOI 10.48550/arxiv.2112.03145arXiv 2112.03145
Open this paper in CoChat — free account

Abstract

Diffusion models have shown impressive performance for generative modelling of images. In this paper, we present a novel semantic segmentation method based on diffusion models. By modifying the training and sampling scheme, we show that diffusion models can perform lesion segmentation of medical images. To generate an image specific segmentation, we train the model on the ground truth segmentation, and use the image as a prior during training and in every step during the sampling process. With the given stochastic sampling process, we can generate a distribution of segmentation masks. This property allows us to compute pixel-wise uncertainty maps of the segmentation, and allows an implicit ensemble of segmentations that increases the segmentation performance. We evaluate our method on the BRATS2020 dataset for brain tumor segmentation. Compared to state-of-the-art segmentation models, our approach yields good segmentation results and, additionally, detailed uncertainty maps.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2112.03145

Cites

3 of 3 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 3 references

Research works printed but not linked: 26

  1. Abdar, Farhad Pourpanah, Sadiq Hussain, Dana Rezazadegan, Li Liu, Mohammad Ghavamzadeh, Paul Fieguth, Xiaochun Cao, Abbas Khosravi, U Rajendra Acharya, et al. A review of uncertainty quantification in deep learning: Techniques, applications and challenges. Information Fusion, 2021.
  2. Tomer Amit, Eliya Nachmani, Tal Shaharbany, and Lior Wolf. Segdiff: Image segmentation with diffusion probabilistic models. arXiv preprint: arxiv:2112.00390, 12 2021. · arXiv
  3. Vijay Badrinarayanan, Alex Kendall, and Roberto Cipolla. Segnet: A deep convolutional encoder-decoder architecture for image segmentation. IEEE transactions on pattern anal- ysis and machine intelligence, 39(12):2481-2495, 2017.
  4. Spyridon Bakas, Hamed Akbari, Aristeidis Sotiras, Michel Bilello, Martin Rozycki, Justin S Kirby, John B Freymann, Keyvan Farahani, and Christos Davatzikos. Advancing the cancer genome atlas glioma MRI collections with expert segmentation labels and radiomic features. Scientific data, 4(1):1-13, 2017.
  5. Spyridon Bakas, Mauricio Reyes, Andras Jakab, Stefan Bauer, Markus Rempfler, Alessan- dro Crimi, Russell Takeshi Shinohara, Christoph Berger, Sung Min Ha, Martin Rozycki, et al. Identifying the best machine learning algorithms for brain tumor segmentation, progression assessment, and overall survival prediction in the BRATS challenge. arXiv preprint arXiv:1811.02629, 2018. · arXiv
  6. Dmitry Baranchuk, Ivan Rubachev, Andrey Voynov, Valentin Khrulkov, and Artem Babenko. Label-efficient semantic segmentation with diffusion models. arXiv preprint arXiv:2112.03126, 2021. · arXiv
  7. Jooyoung Choi, Sungwon Kim, Yonghyun Jeong, Youngjune Gwon, and Sungroh Yoon. Ilvr: Conditioning method for denoising diffusion probabilistic models. arXiv preprint arXiv:2108.02938, 2021. · arXiv
  8. Terrance DeVries and Graham W Taylor. Leveraging uncertainty estimates for predicting segmentation quality. arXiv preprint arXiv:1807.00502, 2018. · arXiv
  9. Yarin Gal and Zoubin Ghahramani. Dropout as a bayesian approximation: Representing model uncertainty in deep learning. In international conference on machine learning, pages 1050-1059. PMLR, 2016.
  10. Marija Habijan, Hrvoje Leventić, Irena Galić, and Danilo Babin. Whole heart segmentation from ct images using 3d u-net architecture. In 2019 International Conference on Systems, Signals and Image Processing (IWSSIP), pages 121-126. IEEE, 2019.
  11. Fabian Isensee, Paul F Jaeger, Simon AA Kohl, Jens Petersen, and Klaus H Maier-Hein. nnu-net: a self-configuring method for deep learning-based biomedical image segmenta- tion. Nature methods, 18(2):203-211, 2021.
  12. Alain Jungo and Mauricio Reyes. Assessing reliability and challenges of uncertainty esti- mations for medical image segmentation. In International Conference on Medical Image Computing and Computer-Assisted Intervention, pages 48-56. Springer, 2019.
  13. Alex Kendall and Yarin Gal. What uncertainties do we need in bayesian deep learning for computer vision? arXiv preprint arXiv:1703.04977, 2017. · arXiv
  14. Alex Kendall, Vijay Badrinarayanan, and Roberto Cipolla. Bayesian segnet: Model un- certainty in deep convolutional encoder-decoder architectures for scene understanding. arXiv preprint arXiv:1511.02680, 2015a. · arXiv
  15. Alex Kendall, Vijay Badrinarayanan, and Roberto Cipolla. Bayesian segnet: Model un- certainty in deep convolutional encoder-decoder architectures for scene understanding. arXiv preprint arXiv:1511.02680, 2015b. · arXiv
  16. Amish Kumar, Oduri Narayana Murthy, Palash Ghosal, Amritendu Mukherjee, Debashis Nandi, et al. A dense u-net architecture for multiple sclerosis lesion segmentation. In TENCON 2019-2019 IEEE Region 10 Conference (TENCON), pages 662-667. IEEE, 2019.
  17. Raghav Mehta, Angelos Filos, Yarin Gal, and Tal Arbel. Uncertainty evaluation metric for brain tumour segmentation. arXiv preprint arXiv:2005.14262, 2020. · arXiv
  18. Bjoern H Menze, Andras Jakab, Stefan Bauer, Jayashree Kalpathy-Cramer, Keyvan Fara- hani, Justin Kirby, Yuliya Burren, Nicole Porz, Johannes Slotboom, Roland Wiest, et al. The multimodal brain tumor image segmentation benchmark (BRATS). IEEE transac- tions on medical imaging, 34(10):1993-2024, 2014.
  19. John Mitros and Brian Mac Namee. On the validity of bayesian neural networks for uncer- tainty estimation. arXiv preprint arXiv:1912.01530, 2019. · arXiv
  20. Alex Nichol and Prafulla Dhariwal. Improved denoising diffusion probabilistic models. arXiv preprint arXiv:2102.09672, 2021. · arXiv
  21. Olaf Ronneberger, Philipp Fischer, and Thomas Brox. U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical image computing and computer-assisted intervention, pages 234-241. Springer, 2015.
  22. Abhinav Sagar. Uncertainty quantification using variational inference for biomedical image segmentation. arXiv preprint arXiv:2008.07588, 2020. · arXiv
  23. Chitwan Saharia, William Chan, Huiwen Chang, Chris A Lee, Jonathan Ho, Tim Salimans, David J Fleet, and Mohammad Norouzi. Palette: Image-to-image diffusion models. arXiv preprint arXiv:2111.05826, 2021. · arXiv
  24. Hiroshi Sasaki, Chris G Willcocks, and Toby P Breckon. Unit-ddpm: Unpaired image trans- lation with denoising diffusion probabilistic models. arXiv preprint arXiv:2104.05358, 2021. · arXiv
  25. Matthew F Sharrock, W Andrew Mould, Hasan Ali, Meghan Hildreth, Issam A Awad, Daniel F Hanley, and John Muschelli. 3d deep neural network segmentation of intrac- erebral hemorrhage: Development and validation for clinical trials. Neuroinformatics, 19 (3):403-415, 2021.
  26. Zhitao Xiao, Bowen Liu, Lei Geng, Fang Zhang, and Yanbei Liu. Segmentation of lung nodules using improved 3d-unet neural network. Symmetry, 12(11):1787, 2020.

Cited by

Sorted by citations

See all 3

Metadata

Authors
Wolleb, J., Sandkühler, R., Bieder, F., Valmaggia, P., & Cattin, P. C.
Venue
arXiv
Publisher
arXiv
Published
2021
DOI
10.48550/arxiv.2112.03145
arXiv
2112.03145
References
3
Type
Preprint
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Diffusion Models for Implicit Image Segmentation Ensembles. https://app.cochat.ai/papers/10.48550/arxiv.2112.03145
The paper
Wolleb, J., Sandkühler, R., Bieder, F., Valmaggia, P., & Cattin, P. C. (2021). Diffusion Models for Implicit Image Segmentation Ensembles. arXiv. https://doi.org/10.48550/arxiv.2112.03145