Conformal confidence sets for biomedical image segmentation
Open accessAbstract
We develop confidence sets which provide spatial uncertainty guarantees for the output of a black-box machine learning model designed for image segmentation. To do so we adapt conformal inference to the imaging setting, obtaining thresholds on a calibration dataset based on the distribution of the maximum of the transformed logit scores within and outside of the ground truth masks. We prove that these confidence sets, when applied to new predictions of the model, are guaranteed to contain the true unknown segmented mask with desired probability. We show that learning appropriate score transformations on a learning dataset before performing calibration is crucial for optimizing performance. We illustrate and validate our approach on a polpys tumor dataset. To do so we obtain the logit scores from a deep neural network trained for polpys segmentation and show that using distance transformed scores to obtain outer confidence sets and the original scores for inner confidence sets enables tight bounds on tumor location whilst controlling the false coverage rate.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The method adapts inner sets from the segmentation approach of [8] and uses morphological erosion as the counterpart of the dilation-based outer sets in [14].
“We adapt the inner sets from the segmentation approach of [8], and use morphological erosion as the counterpart of the dilation-based outer sets in [14].”
From Controlling False Positives in Image Segmentation via Conformal Prediction (2025) · cites this paper as [8]
Section 3.1 (p. 8) says the paper constructs outer confidence sets using a distance transformation of the predicted mask. That supports the reference to spatially expanded outer sets, but our copy does not describe the method as morphological dilation or establish that its outer sets are dilation-based in the specific sense claimed. (LLM, conf=0.78)
Experimental — accuracy not yet measuredIn semantic segmentation, inner and outer prediction masks have been used targeting coverage of the ground-truth mask.
“For CP in semantic segmentation, [8] have used inner and outer prediction masks targeting coverage of the ground-truth mask.”
From Controlling False Positives in Image Segmentation via Conformal Prediction (2025) · cites this paper as [8]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
A tutorial on conformal prediction
Shafer, G., & Vovk, V. (2007) · arXiv · doi:10.48550/arxiv.0706.3188 · Cited by 655 · cited 1× · see citing works
“…in their most commonly used form - split conformal inference - work by calibrating the predictions of the model on a held-out dataset in order to provide sets which contain the output with a given probability, see Shafer and Vovk (2008) and Angelopou-los and Bates (2021) for good introductions.”
Method
Flagged first, then by citations
Research works printed but not linked: 30
- L´ eo And´ eol, Thomas Fel, Florence De Grancey, and Luca Mossina. Confident object detection via conformal prediction and conformal risk control: an application to railway signaling. In Conformal and Probabilistic Prediction with Applications , pages 36-55. PMLR, 2023.
- Anastasios N Angelopoulos and Stephen Bates. A gentle introduction to conformal prediction and distribution-free uncertainty quantification. arXiv preprint arXiv:2107.07511 , 2021. · arXiv
- Anastasios N Angelopoulos, Stephen Bates, Emmanuel J Cand` es, Michael I Jordan, and Lihua Lei. Learn then test: Calibrating predictive algorithms to achieve risk control. arXiv preprint arXiv:2110.01052 , 2021. · arXiv
- Anastasios N. Angelopoulos, Stephen Bates, Adam Fisch, Lihua Lei, and Tal Schuster. Conformal risk control. In Proceedings of the International Conference on Learning Representations (ICLR) , 2024.
- Stephen Bates, Anastasios Angelopoulos, Lihua Lei, Jitendra Malik, and Michael Jordan. Distribution-free, risk-controlling prediction sets. Journal of the ACM (JACM) , 68(6): 1-34, 2021.
- Yoav Benjamini and Yosef Hochberg. Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal statistical society: series B (Methodological) , 57(1):289-300, 1995.
- Jorge Bernal, Javier S´ anchez, and Fernando Vilarino. Towards automatic polyp detection with a polyp appearance model. Pattern Recognition , 45(9):3166-3182, 2012.
- Gilles Blanchard, Guillermo Durand, Ariane Marandon-Carlhian, and Romain P´ erier. Fdr control and fdp bounds for conformal link prediction. arXiv preprint arXiv:2404.02542 , 2024. · arXiv
- Gunilla Borgefors. Distance transformations in digital images. Computer vision, graphics, and image processing , 34(3):344-371, 1986.
- Hanna Borgli, Vajira Thambawita, Pia H Smedsrud, Steven Hicks, Debesh Jha, Sigrun L Eskeland, Kristin Ranheim Randel, Konstantin Pogorelov, Mathias Lux, Duc Tien Dang Nguyen, et al. Hyperkvasir, a comprehensive multi-class image and video dataset for gastrointestinal endoscopy. Scientific data , 7(1):283, 2020.
- Yen-Chi Chen, Christopher R Genovese, and Larry Wasserman. Density level sets: Asymptotics, inference, and visualization. Journal of the American Statistical Association , 112(520):1684-1696, 2017.
- Florence de Grancey, Jean-Luc Adam, Lucian Alecu, S´ ebastien Gerchinovitz, Franck Mamalet, and David Vigouroux. Object detection with probabilistic guarantees. In Fifth International Workshop on Artificial Intelligence Safety Engineering (WAISE 2022) , 2022.
- Deng-Ping Fan, Ge-Peng Ji, Tao Zhou, Geng Chen, Huazhu Fu, Jianbing Shen, and Ling Shao. Pranet: Parallel reverse attention network for polyp segmentation. In International conference on medical image computing and computer-assisted intervention , pages 263-273. Springer, 2020.
- Chuan Guo, Geoff Pleiss, Yu Sun, and Kilian Q Weinberger. On calibration of modern neural networks. In International conference on machine learning , pages 1321-1330. PMLR, 2017.
- Chirag Gupta, Aleksandr Podkopaev, and Aaditya Ramdas. Distribution-free binary classification: prediction sets, confidence intervals and calibration. Advances in Neural Information Processing Systems , 33:3711-3723, 2020.
- Seyed Ali Jalalifar, Hany Soliman, Arjun Sahgal, and Ali Sadeghi-Naini. Impact of tumour segmentation accuracy on efficacy of quantitative mri biomarkers of radiotherapy outcome in brain metastasis. Cancers , 14(20):5133, 2022.
- Carsten Maple. Geometric design and space planning using the marching squares and marching cube algorithms. In 2003 international conference on geometric modeling and graphics, 2003. Proceedings , pages 90-95. IEEE, 2003.
- Ariane Marandon. Conformal link prediction for false discovery rate control. TEST , pages 1-22, 2024.
- Amanda F Mejia, Yu Yue, David Bolin, Finn Lindgren, and Martin A Lindquist. A bayesian general linear modeling approach to cortical surface fmri data analysis. Journal of the American Statistical Association , 115(530):501-520, 2020.
- Luca Mossina, Joseba Dalmau, and L´ eo And´ eol. Conformal semantic image segmentation: Post-hoc quantification of predictive uncertainty. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 35743584, 2024.
- Bruce Cyusa Mukama, Soundouss Messoudi, Sylvain Rousseau, and S´ ebastien Destercke. Copula-based conformal prediction for object detection: a more efficient approach. Proceedings of Machine Learning Research , 230:1-18, 2024.
- Harris Papadopoulos, Kostas Proedrou, Volodya Vovk, and Alex Gammerman. Inductive confidence machines for regression. In Machine learning: ECML 2002: 13th European conference on machine learning Helsinki, Finland, August 19-23, 2002 proceedings 13 , pages 345-356. Springer, 2002.
- Edward F Patz, Paul Pinsky, Constantine Gatsonis, JoRean D Sicks, Barnett S Kramer, Martin C Tammem¨ agi, Caroline Chiles, William C Black, Denise R Aberle, NLST Overdiagnosis Manuscript Writing Team, et al. Overdiagnosis in low-dose computed tomography screening for lung cancer. JAMA internal medicine , 174(2):269-274, 2014.
- Konstantin Pogorelov, Kristin Ranheim Randel, Carsten Griwodz, Sigrun Losada Eskeland, Thomas de Lange, Dag Johansen, Concetto Spampinato, Duc-Tien DangNguyen, Mathias Lux, Peter Thelin Schmidt, Michael Riegler, and P˚ al Halvorsen. Kvasir: A multi-class image dataset for computer aided gastrointestinal disease detection. In Proceedings of the 8th ACM on Multimedia Systems Conference , MMSys'17, pages 164-169, New York, NY, USA, 2017. ACM. ISBN 978-1-4503-5002-0. doi: 10.1145/3083187.3083212. · DOI
- Juan Silva, Aymeric Histace, Olivier Romain, Xavier Dray, and Bertrand Granado. Toward embedded detection of polyps in wce images for early diagnosis of colorectal cancer. International journal of computer assisted radiology and surgery , 9:283-293, 2014.
- Sophia Sun and Rose Yu. Copula conformal prediction for multi-step time series forecasting. In International Conference on Learning Representations (ICLR) , 2024.
- Ryan J Tibshirani, Rina Foygel Barber, Emmanuel Candes, and Aaditya Ramdas. Conformal prediction under covariate shift. Advances in neural information processing systems , 32, 2019.
- Eric J Topol. High-performance medicine: the convergence of human and artificial intelligence. Nature medicine , 25(1):44-56, 2019.
- Vladimir Vovk, Alexander Gammerman, and Glenn Shafer. Algorithmic learning in a random world , volume 29. Springer, 2005.
- H˚ akan Wieslander, Philip J Harrison, Gabriel Skogberg, Sonya Jackson, Markus Frid´ en, Johan Karlsson, Ola Spjuth, and Carolina W¨ ahlby. Deep learning with conformal prediction for hierarchical analysis of large-scale whole-slide tissue images. IEEE journal of biomedical and health informatics , 25(2):371-380, 2020.
Cited by
Sorted by citations
CONSeg: Voxelwise Uncertainty Quantification for Glioma Segmentation Using Conformal Prediction
Elyassirad, D., Gheiji, B., Vatanparast, M., Ahmadzadeh, A. M., & Faghani, S. (2025) · American Journal of Neuroradiology · doi:10.3174/ajnr.a8914 · Cited by 4 · see citing works
Controlling False Positives in Image Segmentation via Conformal Prediction
Mossina, L., & Friedrich, C. (2025) · arXiv · doi:10.48550/arxiv.2511.15406
- Authors
- Davenport, S.
- Corresponding author
- Davenport, Samuel
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2024
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2410.03406
- OpenAlex
- W4403362813
- Cited by
- 2
- References
- 1
- Citations by year
- 2026: 1 · 2025: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- conformal inference, confidence regions, image segmentation, uncertainty quantification, black-box models, score conversion, distance transform, polyp segmentation, deep neural network
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
