ConfIC-RCA: Statistically Grounded Efficient Estimation of Segmentation Quality
Open accessAbstract
Assessing the quality of automatic image segmentation is crucial in clinical practice, but often very challenging due to the limited availability of ground truth annotations. Reverse Classification Accuracy (RCA) is an approach that estimates the quality of new predictions on unseen samples by training a segmenter on those predictions, and then evaluating it against existing annotated images. In this work we introduce ConfIC-RCA (Conformal In-Context RCA), a novel method for automatically estimating segmentation quality with statistical guarantees in the absence of ground-truth annotations, which consists of two main innovations. First, In-Context RCA, which leverages recent in-context learning models for image segmentation and incorporates retrieval-augmentation techniques to select the most relevant reference images. This approach enables efficient quality estimation with minimal reference data while avoiding the need of training additional models. Second, we introduce Conformal RCA, which extends both the original RCA framework and In-Context RCA to go beyond point estimation. Using tools from split conformal prediction, Conformal RCA produces prediction intervals for segmentation quality providing statistical guarantees that the true score lies within the estimated interval with a user-specified probability. Validated across 10 different medical imaging tasks in various organs and modalities, our methods demonstrate robust performance and computational efficiency, offering a promising solution for automated quality control in clinical workflows, where fast and reliable segmentation assessment is essential. The code is available at https://github.com/mcosarinsky/Conformal-In-Context-RCA
AI snapshot
Written from the paper’s full text.
TL;DR
ConfIC-RCA combines In-Context RCA, using few-shot segmentation models as reverse classifiers with retrieval-augmented reference selection, and Conformal RCA, which uses split conformal prediction to produce statistically grounded intervals for segmentation quality without ground truth. Across 10 medical imaging tasks, it matches or improves traditional atlas-based RCA while being up to two orders of magnitude faster and providing coverage-calibrated quality intervals.
Key findings
- In-Context RCA with SAM 2 and UniverSeg was much faster than atlas-based RCA: atlas took on average about 1 minute per image, while SAM 2 took 0.70 seconds and UniverSeg 0.37 seconds, approximately 85× and 162× faster, respectively.
- Retrieval augmentation improved quality estimation with fewer reference samples; on 3D-IRCAdB and JSRT, retrieval-augmented selection achieved better correlation and lower MAE than random selection as reference size increased.
- On NuCLS histopathology, the SAM 2 variant achieved a correlation of about 0.76 while atlas methods completely failed.
- Conformal RCA produced prediction intervals with target coverage 90% (α = 0.1); empirical coverage varied by dataset and method, e.g. SAM 2 ranged from 82.1% on PH2 to 94.8% on WBC CV, while PHiSeg (CQR) produced tighter intervals than the prior PHiSeg conformal procedure.
- In controlled experiments where calibration and test sets were drawn from the same distribution, empirical marginal coverage surpassed the desired 90% target, supporting the role of exchangeability.
Methods
- Design: ConfIC-RCA has two components: In-Context RCA, which uses in-context/few-shot segmentation models (UniverSeg and SAM 2) as reverse classifiers, and Conformal RCA, which extends RCA with split conformal prediction inspired by Conformalized Quantile Regression but estimates empirical quantiles directly from the RCA score distribution.
- Data: Evaluated on 10 medical imaging datasets—SCD, HC18, PSFHS, PH2, ISIC 2018, NuCLS, JSRT, 3D-IRCAdB, WBC-CV, and WBC-JTSC—covering diverse organs and modalities; images were converted to grayscale and resized to 256×256, with 3D images sliced to keep slices containing the ROI.
- Analysis: Segmentation quality was measured mainly with DSC, with additional ASSD and HD95 analyses; experiments compared In-Context RCA, retrieval-augmented RCA, atlas-based RCA, PHiSeg conformal baselines, MC Dropout, and TTA using correlation, MAE, prediction interval width, empirical coverage, bootstrapped confidence intervals, and paired significance tests.
Limitations
- The paper states that Conformal RCA relies on exchangeability between calibration and test sets; when this is violated by domain shifts in scanner settings or patient populations, coverage can degrade and reliability may suffer in real-world clinical deployment.
- The paper reports that neither Conformal-RCA nor PHiSeg variants consistently reached the target 90% marginal coverage, likely due to exchangeability violations from domain shifts and heterogeneous data sources; controlled same-distribution experiments achieved nominal coverage.
- The paper states that validation on real deployment data and human-in-the-loop studies would be needed to establish clinical reliability and practical utility; it also notes that coverage improves as calibration set size increases, with smaller calibration sets showing lower coverage in Table III.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
20 of 34 cited sources checked · 14 supported · 0 flagged · accuracy not yet measured
- Premisecitation§ I. INTRODUCTION · p. 1
The distribution of RCA scores over the reference set serves as a proxy for the quality of the original segmentation.
“The distribution of scores over the reference set serves as a proxy for the quality of the original segmentation.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [5] [5] V. V. Valindria, I. Lavdas, W. Bai, K. Kamnitsas, E. O. Aboagye, A. G. Rockall, D. Rueckert, and B. Glocker, 'Reverse classification accuracy: Predicting segmentation performance in the absence of ground truth,' IEEE transactions on medical imaging , vol. 36, no. 8, p. 1597-1606, 2017. - source
The Results (p. 5) show distributions of scores across the reference set, but say that selecting the maximum score is the proxy for segmentation quality. Predicting Segmentation Accuracy (p. 4) likewise specifies the maximum, noting that mean and median scores are not useful. The claim captures the use of reference-set scores but is imprecise about which aspect serves as the proxy. (LLM, conf=0.85)
Experimental — accuracy not yet measured
- Interpretationcitation§ I. INTRODUCTION · p. 2
Conformal RCA leverages split conformal prediction to produce statistically grounded confidence intervals for segmentation quality scores.
“At the core of our approach is Conformal RCA , which leverages split conformal prediction [6]-[8] to produce statistically grounded confidence intervals for segmentation quality scores.”
Quote in the paperSubstantial claim1 of 3 sources checked- cites [6] [6] V. Vovk, A. Gammerman, and G. Shafer, Algorithmic Learning in a Random World . Springer-Verlag, 2005. - source
- cites [7] [7] A. N. Angelopoulos and S. Bates, 'A gentle introduction to conformal prediction and distribution-free uncertainty quantification,' 2022. - source
- cites [8] [8] Y. Romano, E. Patterson, and E. Candes, 'Conformalized quantile regression,' in Advances in Neural Information Processing Systems , vol. 32. Curran Associates, Inc., 2019. - source
- Findingown data§ A. Datasets & Computing Resources · p. 5
Unlike previous studies that explored RCA focusing on cardiac MRI or multi-organ segmentation on whole-body MRI only, this work broadens the analysis to a wider range of medical imaging challenges.
“Unlike previous studies that explored RCA focusing on cardiac MRI [28], [29] or multi-organ segmentation on whole-body MRI [5] only, we broaden our analysis to a wider range of medical imaging challenges.”
Quote in the paperNot a substantial claim1 of 3 sources checked- cites [28] [28] R. Robinson et al. , 'Automatic quality control of cardiac mri segmentation in large-scale population imaging,' in MICCAI 2017 . Springer, 2017, pp. 720-727. - source
- cites [29] [29] --, 'Real-time prediction of segmentation quality,' in MICCAI 2018 . Springer, 2018, pp. 578-585. -
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [5] [5] V. V. Valindria, I. Lavdas, W. Bai, K. Kamnitsas, E. O. Aboagye, A. G. Rockall, D. Rueckert, and B. Glocker, 'Reverse classification accuracy: Predicting segmentation performance in the absence of ground truth,' IEEE transactions on medical imaging , vol. 36, no. 8, p. 1597-1606, 2017. - source
- Interpretationcitation§ B. Proposed Method · p. 5
Assuming exchangeability between the test sample and calibration set, the constructed interval provides the marginal coverage guarantee stated in Theorem 3.
“Assuming exchangeability between the test sample and calibration set, the constructed interval provides the marginal coverage guarantee stated in Theorem 3, as shown in [8].”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [8] [8] Y. Romano, E. Patterson, and E. Candes, 'Conformalized quantile regression,' in Advances in Neural Information Processing Systems , vol. 32. Curran Associates, Inc., 2019. - source
- The authors state this as an assumption: Calibration samples and test samples are exchangeable (e.g., i.i.d.).
- Findingown data§ C. Evaluation of In-Context RCA · p. 7
Cosine similarity showed the best results among the considered similarity metrics (Euclidean distance and inner-product).
“Other similarity metrics, such as Euclidean distance and inner-product were also considered, but cosine similarity showed the best results.”
Quote in the paperNot a substantial claim
- Findingown data§ C. Evaluation of In-Context RCA · p. 7
Following RA reference sample selection yields good results without requiring a large reference database.
“We observe that following RA reference sample selection yields good results without requiring a large reference database.”
Quote in the paperSubstantial claim - Findingown data§ C. Evaluation of In-Context RCA · p. 7
The retrieval-augmented (RA) version of UniverSeg and SAM 2 showed better performance than the traditional version in the previous experiment.
“whereas for UniverSeg and SAM 2, we focused exclusively on the RA version as it showed better pefromance in our previous experiment (see Fig. 3).”
Quote in the paperSubstantial claim - Findingown data§ APPENDIX B: CONTROLLED EXPERIMENTS ON EXCHANGEABILITY ASSUMPTION · p. 13
Empirical marginal coverage surpasses the desired 90% target level in the controlled experiment.
“Empirical marginal coverage surpasses the desired 90 % target level, confirming that Conformal RCA achieves valid coverage under ideal conditions.”
Quote in the paperNot a substantial claim - Findingown data§ D. Evaluation of Conformal RCA · p. 9
In controlled settings where the exchangeability assumption holds, the desired nominal coverage level of 90% is achieved.
“In these controlled settings where the exchangeability assumption holds, the desired nominal coverage level of 90% is achieved (see Appendix).”
Quote in the paperSubstantial claim - Findingreasoning§ D. Evaluation of Conformal RCA · p. 8
Neither Conformal-RCA nor the PHiSeg variants consistently reach the target marginal coverage of 90%.
“As shown in panel (b) of Fig. 6, neither our Conformal-RCA nor the PHiSeg variants consistently reach the target marginal coverage of 90%.”
Quote in the paperSubstantial claim - Findingown data§ D. Evaluation of Conformal RCA · p. 8
The chosen quantile levels provide a stable balance between coverage and interval tightness.
“The resulting Pareto frontier analysis, shown in Fig. 5, indicates that the chosen levels provide a stable balance between coverage and interval tightness.”
Quote in the paperSubstantial claim - Findingown data§ A.4 Effect of Calibration Set Size on Conformal Performance · p. 13
Coverage stabilizes as the calibration set size increases.
“Generally, coverage stabilizes as the calibration set size increases, highlighting the practical tradeoffs involved when using smaller calibration sets.”
Quote in the paperNot a substantial claim - Findingown data§ D. Evaluation of Conformal RCA · p. 8
Compared to the conformal procedure used in prior work [35], the CQR variant of PHiSeg produces tighter intervals.
“Importantly, compared to the conformal procedure used in prior work [35], the CQR variant of PHiSeg produces tighter intervals, further highlighting the benefits of following our proposed empirical CQR method within the CP framework.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [35] [35] A. M. Wundram, P. Fischer, M. M¨ uhlebach, L. M. Koch, and C. F. Baumgartner, 'Conformal performance range prediction for segmentation output quality control,' in Uncertainty for Safe Utilization of Machine Learning in Medical Imaging . Springer Nature Switzerland, 2025, pp. 81-91. -
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Findingown data§ A.3 Additional Retrieval-Augmentation Experiments · p. 12
RA consistently improves reference selection compared to random sampling.
“Overall, RA consistently improves reference selection compared to random sampling.”
Quote in the paperNot a substantial claim - Findingown data§ D. Evaluation of Conformal RCA · p. 9
Coverage improves as calibration set size increases.
“Results in Table III show that coverage improves as calibration size increases.”
Quote in the paperNot a substantial claim - Interpretationnone given§ B. Proposed Method · p. 5
Extending RCA with a split conformal prediction approach produces prediction intervals with statistical guarantees under standard conformal assumptions.
“To address this limitation, we extend RCA following a split conformal prediction approach, producing prediction intervals with statistical guarantees under standard conformal assumptions.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: Calibration samples and test samples are exchangeable (e.g., i.i.d.).
- Premisecitation§ B. Performance Interval Estimation · p. 2
The method proposed in [35] applies split conformal prediction to produce intervals for segmentation quality scores with formal coverage guarantees.
“One notable approach is the method proposed in [35], which applies split conformal prediction to produce intervals for segmentation quality scores with formal coverage guarantees.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [35] [35] A. M. Wundram, P. Fischer, M. M¨ uhlebach, L. M. Koch, and C. F. Baumgartner, 'Conformal performance range prediction for segmentation output quality control,' in Uncertainty for Safe Utilization of Machine Learning in Medical Imaging . Springer Nature Switzerland, 2025, pp. 81-91. -
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationown data§ A.3 Additional Retrieval-Augmentation Experiments · p. 12
Domain-adapted embeddings benefit radiological tasks.
“For 3D-IRCAdB, DINOv2 sometimes outperforms the domain-specific MedImageInsight embeddings, whereas for JSRT, RAD-DINO and MedImageInsight embeddings always outperform DINOv2, demonstrating the benefit of domain-adapted embeddings in radiological tasks.”
Quote in the paperNot a substantial claim - Interpretationreasoning§ I. INTRODUCTION · p. 2
The proposed method provides a more informative and reliable assessment of segmentation quality at the individual image level, directly addressing a major limitation of existing methods.
“This allows for a more informative and reliable assessment of segmentation quality at the individual image level, directly addressing a major limitation of existing methods.”
Quote in the paperSubstantial claim - Interpretationreasoning§ VI. CONCLUSION · p. 10
Conformal RCA produces prediction intervals with theoretical statistical guarantees under standard assumptions.
“Second, Conformal RCA extends the traditional RCA procedure using split conformal prediction to produce prediction intervals with theoretical statistical guarantees under standard assumptions, providing a more comprehensive assessment of segmentation quality that moves beyond point estimates.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The calibration and test sets are exchangeable.
- Interpretationown data§ APPENDIX B: CONTROLLED EXPERIMENTS ON EXCHANGEABILITY ASSUMPTION · p. 13
Conformal RCA achieves valid coverage under ideal conditions.
“Empirical marginal coverage surpasses the desired 90 % target level, confirming that Conformal RCA achieves valid coverage under ideal conditions.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The calibration and test sets are exchangeable.
- Interpretationreasoning§ I. INTRODUCTION · p. 2
The proposed method avoids the need to train a new segmentation model by using only a few image-mask pairs.
“In practice, this means we can segment a new image by providing only a few image-mask pairs, avoiding the need to train a new segmentation model.”
Quote in the paperSubstantial claim - Interpretationnone given§ A.1 Correlation Analysis on New Metrics and Methods · p. 12
In-context RCA directly outputs a scalar quality estimate comparable to the target metric on a per-image basis.
“In-context RCA directly outputs a scalar quality estimate that is comparable to the target metric (e.g., predicted DSC or ASSD) on a per-image basis.”
Quote in the paperSubstantial claim
- Classified as probably not a substantial claim. 16
- May combine two claims. 44
- The quote only partly states this claim. 1
Classified as probably not a substantial claim. May combine two claims.
Premisecitation§ I. INTRODUCTION · p. 1RCA works by using the predicted segmentation of a new image as pseudo-ground truth to train a reverse classifier, applying it to reference images with known ground truth, and evaluating performance with metrics like DSC.
“It works by using the predicted segmentation of a new image as a pseudo-ground truth to train a reverse classifier (a segmentation network in our case) 1 . This model is then applied to a set of reference images with known GT, and its performance is evaluated using standard metrics like the DSC.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [5] [5] V. V. Valindria, I. Lavdas, W. Bai, K. Kamnitsas, E. O. Aboagye, A. G. Rockall, D. Rueckert, and B. Glocker, 'Reverse classification accuracy: Predicting segmentation performance in the absence of ground truth,' IEEE transactions on medical imaging , vol. 36, no. 8, p. 1597-1606, 2017. - source
Classified as probably not a substantial claim.
Premisecitation§ I. INTRODUCTION · p. 1Reverse Classification Accuracy (RCA) is a framework designed to predict the performance of an image segmentation method when ground-truth masks are unavailable.
“Reverse Classification Accuracy (RCA) [5] is a framework originally designed to predict the performance of an image segmentation method in scenarios where GT masks are unavailable.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [5] [5] V. V. Valindria, I. Lavdas, W. Bai, K. Kamnitsas, E. O. Aboagye, A. G. Rockall, D. Rueckert, and B. Glocker, 'Reverse classification accuracy: Predicting segmentation performance in the absence of ground truth,' IEEE transactions on medical imaging , vol. 36, no. 8, p. 1597-1606, 2017. - source
May combine two claims.
Premisecitation§ B. Experimental Setup · p. 7DINOv2 has shown strong generalization, making it effective for general tasks, including those in medical imaging.
“While DINOv2 was not explicitly trained for the medical domain, it has shown strong generalization, making it effective for general tasks, including those in medical imaging.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [54] [54] M. Oquab et al. , 'Dinov2: Learning robust visual features without supervision,' 2024. - source
The Introduction and Future work and Discussion report strong performance across varied vision benchmarks and describe DINOv2’s features as transferable across image domains. Our copy does not report a medical-imaging evaluation, so it does not establish that DINOv2 is effective for medical-imaging tasks. (LLM, conf=0.87)
Experimental — accuracy not yet measured
Classified as probably not a substantial claim. May combine two claims.
Premisecitation§ B. Experimental Setup · p. 5UniverSeg is a UNet-like architecture trained on MegaMedical and designed to generalize to unseen medical segmentation tasks without additional training.
“UniverSeg : a UNet-like architecture trained on a large collection of medical segmentation datasets (MegaMedical) and designed to generalize to unseen medical segmentation tasks without additional training.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [10] [10] V. I. Butoi, J. J. G. Ortiz, T. Ma, M. R. Sabuncu, J. V. Guttag, and A. V. Dalca, 'Universeg: Universal medical image segmentation.' in ICCV . IEEE, 2023, pp. 21 381-21 394. - source
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Premisecitation§ B. Experimental Setup · p. 7SAM 2 extends its predecessor by incorporating memory components, enabling adaptation to new tasks and outperforming existing video object segmentation models, especially for temporal tracking.
“SAM 2 [33] extends its predecessor by incorporating memory components (an encoder, bank, and attention mechanism) enabling adaptation to new tasks and outperforming existing video object segmentation models, especially for temporal tracking.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [33] [33] N. Ravi et al. , 'SAM 2: Segment anything in images and videos,' in The Thirteenth International Conference on Learning Representations , 2025. - source
The Model section (pp. 4–5) describes SAM 2 as a generalization of SAM with a memory encoder, bank, and attention mechanism. The Introduction (p. 2) and video-segmentation results (p. 10) report that it outperforms prior approaches on video benchmarks. The paper supports memory-enabled segmentation and tracking across frames, but does not establish that those components enable adaptation to new tasks generally; its stated task is promptable visual segmentation. (LLM, conf=0.86)
Experimental — accuracy not yet measured
May combine two claims.
Premisecitation§ III. IN-CONTEXT RCA · p. 4In-context learning models are computationally efficient and can adapt their predictions based on a small support set.
“Unlike previous approaches, that rely on training CNNs [29] or computationally expensive atlas-based registration methods as reverse classifiers [5], [28], in-context learning models are computationally efficient and can adapt their predictions based on a small support set.”
Quote in the paperSubstantial claim2 of 3 sources checked- cites [9] [9] X. Wang, X. Zhang, Y. Cao, W. Wang, C. Shen, and T. Huang, 'Seggpt: Towards segmenting everything in context,' in Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) , 2023, pp. 1130-1140. - source
- cites [10] [10] V. I. Butoi, J. J. G. Ortiz, T. Ma, M. R. Sabuncu, J. V. Guttag, and A. V. Dalca, 'Universeg: Universal medical image segmentation.' in ICCV . IEEE, 2023, pp. 21 381-21 394. - source
- cites [11] [11] J. Zhu, Y. Qi, and J. Wu, 'Medical sam 2: Segment medical images as video via segment anything model 2,' CoRR , vol. abs/2408.00874, 2024. - source
Related Works (p. 3) says few-shot methods adapt to new tasks with minimal annotated samples and describes one-prompt segmentation without retraining. The cited paper does not establish that in-context learning models are computationally efficient, particularly relative to the approaches named in the citing sentence. (LLM, conf=0.86)
Experimental — accuracy not yet measured
May combine two claims.
Premisecitation§ B. Performance Interval Estimation · p. 2The method in [35] constructs its intervals from nonconformity scores based on softmax scores, which are known to suffer from calibration issues.
“In addition, the method constructs its intervals from nonconformity scores based on the softmax scores [39], [40], which are known to suffer from calibration issues [41], [42].”
Quote in the paperSubstantial claim2 of 3 sources checked- cites [39] [39] Z. Li, K. Kamnitsas, M. Islam, C. Chen, and B. Glocker, 'Estimating model performance under domain shifts with class-specific confidence scores,' in Medical Image Computing and Computer Assisted Intervention -MICCAI 2022: 25th International Conference, Singapore, September 18-22, 2022, Proceedings, Part VII . Springer-Verlag, 2022, p. 693-703. - source
The Introduction (p. 2) and Method (p. 4) describe softmax-based confidence scores and explain that uncalibrated probabilities may not reflect real accuracy. The paper describes estimating model performance from those scores, but does not describe constructing intervals from nonconformity scores; that part of the attributed claim is unsupported. (LLM, conf=0.86)
Experimental — accuracy not yet measured - cites [40] [40] P. K¨ ohler, J. Fadugba, P. Berens, and L. M. Koch, 'Efficiently correcting patch-based segmentation errors to control image-level performance in retinal images,' in Proceedings of The 7nd International Conference on Medical Imaging with Deep Learning , vol. 250. PMLR, 2024, pp. 841-856. -
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [41] [41] C. Guo, G. Pleiss, Y. Sun, and K. Q. Weinberger, 'On calibration of modern neural networks,' in Proceedings of the 34th International Conference on Machine Learning - Volume 70 . JMLR.org, 2017, p. 1321-1330. - source
May combine two claims.
Premisecitation§ B. Proposed Method · p. 5RCA tends to underestimate segmentation quality, making higher scores more informative.
“This asymmetry captures the observation that RCA tends to underestimate segmentation quality, making higher scores more informative [5].”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [5] [5] V. V. Valindria, I. Lavdas, W. Bai, K. Kamnitsas, E. O. Aboagye, A. G. Rockall, D. Rueckert, and B. Glocker, 'Reverse classification accuracy: Predicting segmentation performance in the absence of ground truth,' IEEE transactions on medical imaging , vol. 36, no. 8, p. 1597-1606, 2017. - source
In “Quantifying Prediction Accuracy” (p. 5), the paper says that a predicted score consistently lower than the real score could still be useful, but presents this as a hypothetical bias, not an observed tendency. Its results (p. 5) describe one RCA classifier’s predictions as close to the real scores, while the Discussion (p. 8) says RCA can identify high-quality segmentations. The paper therefore supports the usefulness of high scores, but not the claimed general tendency to underestimate quality or the conclusion that high scores are more informative than low ones. (LLM, conf=0.86)
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S3 (load-bearing).
Premisecitation§ B. Experimental Setup · p. 7A similar retrieval-augmented approach for few-shot medical image segmentation has been explored in [56], demonstrating its effectiveness in similar scenarios.
“In fact, a similar retrievalaugmented approach for few-shot medical image segmentation has been explored in [56], demonstrating its effectiveness in similar scenarios.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [56] [56] L. Zhao et al. , 'Retrieval-augmented few-shot medical image segmentation with foundation models,' 2024. - source
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Premisecitation§ A. Preliminaries: Split Conformal Prediction · p. 4CQR maintains the coverage guarantee of conformal prediction while often producing tighter, more locally adaptive intervals compared to residual-based methods, particularly in heteroscedastic settings.
“This approach maintains the coverage guarantee of CP while often producing tighter, more locally adaptive intervals compared to residual-based methods, particularly in heteroscedastic settings [8].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [8] [8] Y. Romano, E. Patterson, and E. Candes, 'Conformalized quantile regression,' in Advances in Neural Information Processing Systems , vol. 32. Curran Associates, Inc., 2019. - source
Probably not a substantial claim: may not pass S3 (load-bearing).
Premisecitation§ B. Experimental Setup · p. 6UniverSeg was trained on 53 open-access medical segmentation datasets called MegaMedical, covering a wide range of image modalities and structures.
“It was trained on a collection of 53 open-access medical segmentation datasets called MegaMedical, covering a wide range of image modalities and structures.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [10] [10] V. I. Butoi, J. J. G. Ortiz, T. Ma, M. R. Sabuncu, J. V. Guttag, and A. V. Dalca, 'Universeg: Universal medical image segmentation.' in ICCV . IEEE, 2023, pp. 21 381-21 394. - source
Probably not a substantial claim: may not pass S3 (load-bearing).
Premisecitation§ C. Evaluation of In-Context RCA · p. 7A single-atlas approach offers the strongest results in the classical RCA framework.
“We compared the performance of In-Context RCA with a singleatlas approach, known to offer the strongest results in the classical RCA framework [5], [28].”
Quote in the paperNot a substantial claim1 of 2 sources checked- cites [5] [5] V. V. Valindria, I. Lavdas, W. Bai, K. Kamnitsas, E. O. Aboagye, A. G. Rockall, D. Rueckert, and B. Glocker, 'Reverse classification accuracy: Predicting segmentation performance in the absence of ground truth,' IEEE transactions on medical imaging , vol. 36, no. 8, p. 1597-1606, 2017. - source
- cites [28] [28] R. Robinson et al. , 'Automatic quality control of cardiac mri segmentation in large-scale population imaging,' in MICCAI 2017 . Springer, 2017, pp. 720-727. - source
Probably not a substantial claim: may not pass S3 (load-bearing).
Premisecitation§ D. Evaluation of Conformal RCA · p. 8PHiSeg is the top performer in the work of [35].
“In order to enable direct comparison with [35], we adopt PHiSeg [37]-the top performer in that work-as our backbone segmentation model.”
Quote in the paperNot a substantial claim2 of 2 sources checked- cites [35] [35] A. M. Wundram, P. Fischer, M. M¨ uhlebach, L. M. Koch, and C. F. Baumgartner, 'Conformal performance range prediction for segmentation output quality control,' in Uncertainty for Safe Utilization of Machine Learning in Medical Imaging . Springer Nature Switzerland, 2025, pp. 81-91. - source
- cites [37] [37] C. F. Baumgartner et al. , 'Phiseg: Capturing uncertainty in medical image segmentation,' in Medical Image Computing and Computer Assisted Intervention - MICCAI 2019: 22nd International Conference, Shenzhen, China, October 13-17, 2019, Proceedings, Part II . SpringerVerlag, 2019, p. 119-127. - source
Classified as probably not a substantial claim. May combine two claims.
Findingnone given§ B. Experimental Setup · p. 6Bold values indicate the best performing methods exhibiting significant differences with respect to the non-bold values (p < 0.01, paired test), but no significant differences among themselves.
“Bold values indicate the best performing methods exhibiting significant differences with respect to the non-bold values ( p < 0 . 01 , paired test), but no significant differences among themselves.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown data§ C. Evaluation of In-Context RCA · p. 7Larger reference sets noticeably increase inference time per image without any meaningful improvement in prediction accuracy.
“Larger sets noticeably increase inference time per image without any meaningful improvement in prediction accuracy.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown data§ C. Evaluation of In-Context RCA · p. 7Retrieval-augmentation achieves better results with fewer reference samples than random selection, reducing inference time.
“However, RA achieves better results with fewer reference samples, what is particularly beneficial during deployment, as it reduces inference time.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown data§ B. Experimental Setup · p. 6In both random and retrieval-augmented cases, retrieval-augmentation achieves better performance with fewer samples, as shown by higher correlation and lower MAE.
“In both cases retrieval-augmentation achieves better performance with fewer samples, as shown by higher correlation and lower MAE (bold indicates the best value).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown data§ Our Contributions : · p. 3Experiments on 10 diverse medical imaging datasets demonstrate strong performance across different modalities and anatomy, broadening the scope of RCA while reducing inference time.
“We conduct extensive experiments on 10 diverse medical imaging datasets, demonstrating strong performance across different modalities and anatomy. We significantly broaden the scope of RCA while reducing inference time.”
- Also stated in: § ConfIC-RCA: Statistically Grounded Efficient Estimation of Segmentation Quality · p. 1 · boosted
“Validated across 10 different medical imaging tasks in various organs and modalities, our methods demonstrate robust performance and computational efficiency, offering a promising solution for automated quality control in clinical workflows, where fast and reliable segmentation assessment is essential.”
Quote in the paperSubstantial claim- Also stated in: § ConfIC-RCA: Statistically Grounded Efficient Estimation of Segmentation Quality · p. 1 · boosted
May combine two claims.
Findingown data§ C. Evaluation of In-Context RCA · p. 7As the number of reference samples increases, both random selection and retrieval-augmentation show improved performance, yielding higher correlation and lower mean absolute error.
“As the number of reference samples increases, both methods show improved performance, yielding higher correlation and lower mean absolute error (MAE).”
Quote in the paperSubstantial claimMay combine two claims.
Findingreasoning§ I. INTRODUCTION · p. 2Using in-context segmentation models as reverse classifiers significantly reduces the computational cost of RCA while maintaining high accuracy.
“By using in-context segmentation models as reverse classifiers, our framework significantly reduces the computational cost of RCA while maintaining high accuracy, making it more suitable for clinical use.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown data§ C. Evaluation of In-Context RCA · p. 8In-Context RCA demonstrates similar and, in some cases, better results compared to the Atlas method, while being significantly more computationally efficient.
“We observe that InContext RCA demonstrates similar and, in some cases, better results compared to the Atlas method, while being significantly more computationally efficient.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown data§ A.3 Additional Retrieval-Augmentation Experiments · p. 12For 3D-IRCAdB, DINOv2 sometimes outperforms the domain-specific MedImageInsight embeddings, whereas for JSRT, RAD-DINO and MedImageInsight embeddings always outperform DINOv2.
“For 3D-IRCAdB, DINOv2 sometimes outperforms the domain-specific MedImageInsight embeddings, whereas for JSRT, RAD-DINO and MedImageInsight embeddings always outperform DINOv2, demonstrating the benefit of domain-adapted embeddings in radiological tasks.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown data§ D. Evaluation of Conformal RCA · p. 8Compared to the PHiSeg baseline, UniverSeg occasionally produces wider intervals; however, both SAM 2 and Atlas consistently attain lower median widths and reduced spread, indicating more robust uncertainty quantification.
“Compared to the PHiSeg baseline, UniverSeg occasionally produces wider intervals; however, both SAM 2 and Atlas consistently attain lower median widths and reduced spread, indicating more robust uncertainty quantification.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown data§ D. Evaluation of Conformal RCA · p. 8Among Conformal-RCA variants, SAM 2 and Atlas achieve consistently tight intervals, whereas UniverSeg yields somewhat wider intervals.
“Among our Conformal-RCA variants, SAM 2 and Atlas achieve consistently tight intervals, whereas UniverSeg yields somewhat wider intervals.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown data§ C. Evaluation of In-Context RCA · p. 8The classic RCA-atlas method takes on average one minute to process each image, while SAM 2 and UniverSeg achieve the same task in 0.70 seconds and 0.37 seconds respectively, approximately 85 and 162 times faster.
“Importantly, while the classic RCA-atlas method takes on average one minute to process each image, SAM 2 and UniverSeg achieve the same task in just 0.70 seconds and 0.37 seconds respectively, approximately 85 and 162 times faster.”
Quote in the paperSubstantial claimMay combine two claims.
Findingnone given§ D. Evaluation of Conformal RCA · p. 8SAM 2 offers a substantial computational speed-up over the atlas-based approach while maintaining similar interval quality.
“Notably, SAM 2 offers a substantial computational speed-up over the atlas-based approach while maintaining similar interval quality.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown data§ C. Evaluation of In-Context RCA · p. 8In the NuCLS histopathology dataset, the SAM 2 variant achieves a correlation of about 0.76 while Atlas methods completely fail.
“Particularly in highly irregular segmentation problems like the NuCLS histopathology dataset, our SAM 2 variant achieves good correlation of about 0.76 while Atlas methods completely fail.”
Quote in the paperSubstantial claimMay combine two claims.
Premisenone given§ I. INTRODUCTION · p. 1RCA suffers from two main limitations: it is computationally inefficient and lacks a mechanism to quantify uncertainty of its predictions.
“Even though RCA has been widely adopted in the medical imaging community, it still suffers from two main limitations: it is very inefficient in computational terms and it lacks a mechanism to quantify the uncertainty of its predictions.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationreasoning§ Our Contributions : · p. 3ConfIC-RCA is the first model-agnostic framework for segmentation quality estimation that provides prediction intervals with statistical guarantees, enabling image-level uncertainty quantification.
“We introduce ConfIC-RCA , the first model-agnostic framework for segmentation quality estimation that provides prediction intervals with statistical guarantees, enabling image-level uncertainty quantification.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone given§ B. Experimental Setup · p. 6In all cases, 95% confidence intervals were obtained via bootstrapping.
“In all cases 95% confidence intervals obtained via bootstrapping.”
Quote in the paperNot a substantial claimMay combine two claims.
Premisenone given§ B. Proposed Method · p. 5Traditional RCA yields a point estimate of segmentation quality for an individual image but does not quantify the uncertainty associated with this prediction.
“Traditional RCA yields a point estimate of segmentation quality for an individual image, as defined in Eq. (2). However, it does not quantify the uncertainty associated with this prediction.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationnone given§ III. IN-CONTEXT RCA · p. 4Dynamic selection of the reference dataset on a per-case basis based on retrieval similarity enables the use of smaller, more relevant reference datasets, improving both computational efficiency and prediction quality.
“We also introduce a dynamic selection of the reference dataset on a per-case basis based on retrieval similarity, enabling the use of smaller, more relevant reference datasets. This approach improves both computational efficiency and prediction quality.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationnone given§ Our Contributions : · p. 3In-Context RCA is a practical enhancement of traditional RCA that leverages few-shot segmentation models to improve computational efficiency and adapt to new tasks without additional training.
“We propose In-Context RCA as a practical enhancement of the traditional RCA framework, leveraging few-shot segmentation models to improve computational efficiency and adapt to new tasks without requiring additional training.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationreasoning§ B. Experimental Setup · p. 7Reducing the RCA reference database by dynamically retrieving the most relevant reference images on a per-case basis optimizes computational efficiency while maintaining and even improving the quality of predictions.
“This allows the model to focus on smaller, more relevant subsets of data, optimizing computational efficiency while maintaining and even improving the quality of predictions.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Premisecitation§ A. Preliminaries: Split Conformal Prediction · p. 4Split conformal prediction provides statistically valid prediction sets or intervals under minimal assumptions.
“Conformal Prediction (CP) is a model-agnostic, distributionfree framework for uncertainty quantification that provides statistically valid prediction sets or intervals, for classification and regression tasks respectively, under minimal assumptions [6], [7].”
Quote in the paperSubstantial claim0 of 2 sources checkedMay combine two claims.
Interpretationreasoning§ B. Proposed Method · p. 5Computing empirical quantiles directly from the RCA score distribution captures the uncertainty inherent in the RCA procedure while maintaining computational efficiency.
“This allows us to naturally capture the uncertainty inherent in the RCA procedure while maintaining computational efficiency.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Premisecitation§ A. Preliminaries: Split Conformal Prediction · p. 4The only required assumption for split conformal prediction is that calibration samples and test samples are exchangeable (e.g., i.i.d.).
“The only required assumption is that the calibration samples and the test samples are exchangeable (e.g., the samples are i.i.d.).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [7] [7] A. N. Angelopoulos and S. Bates, 'A gentle introduction to conformal prediction and distribution-free uncertainty quantification,' 2022. - source
- The authors state this as an assumption: Calibration samples and test samples are exchangeable (e.g., i.i.d.).
May combine two claims.
Interpretationcitation§ I. INTRODUCTION · p. 2Conformal RCA quantifies uncertainty and provides statistical guarantees that the true segmentation quality lies within the predicted interval with a user-specified probability.
“Unlike traditional RCA, which provides only a single point estimate (e.g., mean or maximum over reference scores), Conformal RCA quantifies the uncertainty associated with each prediction and provides statistical guarantees that the true segmentation quality lies within the predicted interval with a user-specified probability.”
- Also stated in: § ConfIC-RCA: Statistically Grounded Efficient Estimation of Segmentation Quality · p. 1 · plain
“Using tools from split conformal prediction, Conformal RCA produces prediction intervals for segmentation quality providing statistical guarantees that the true score lies within the estimated interval with a user-specified probability.”
Quote in the paperSubstantial claim- Also stated in: § ConfIC-RCA: Statistically Grounded Efficient Estimation of Segmentation Quality · p. 1 · plain
Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.
Interpretationnone given§ B. Proposed Method · p. 5The procedure can be applied with any reverse segmenter and can be readily combined with the proposed in-context approach.
“Note that the procedure can be applied with any reverse segmenter and can thus be readily combined with the proposed in-context approach.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationnone given§ Our Contributions : · p. 3Retrieval-Augmented RCA is a more efficient variant of RCA that uses embedding-based retrieval to select the most relevant reference images as few-shot examples, enhancing efficiency and accuracy.
“We introduce Retrieval-Augmented RCA, a more efficient variant of RCA that uses embedding-based retrieval to select the most relevant reference images to be used as few-shot examples, enhancing efficiency and accuracy.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Premisecitation§ B. Experimental Setup · p. 6SAM 2 is a foundational segmentation model originally developed for general-domain image and video segmentation, recently adapted to few-shot medical image segmentation.
“SAM 2 : a foundational segmentation model originally developed for general-domain image and video segmentation, recently adapted to few-shot medical image segmentation [34].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [34] [34] Y. Bai, Q. Yu, B. Yun, D. Jin, Y. Xia, and Y. Wang, 'Fs-medsam2: Exploring the potential of sam2 for few-shot medical image segmentation without fine-tuning.' CoRR , vol. abs/2409.04298, 2024. -
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Interpretationnone given§ Our Contributions : · p. 3The approach estimates quantiles directly from the RCA reference set instead of training a quantile regression model, avoiding additional training.
“We base our approach on CQR, but unlike prior work that trains a quantile regression model, we estimate the quantiles directly from the RCA reference set, avoiding additional training.”
Quote in the paperSubstantial claimMay combine two claims.
Premisecitation§ B. Experimental Setup · p. 7For medical few-shot segmentation, SAM 2 treats the support set as initial frames of a sequence with segmentation masks as prompts, effectively transferring segmentation masks from annotated to unannotated examples.
“For medical few-shot segmentation (FSS) [34], SAM 2 treats the support set as initial frames of a sequence, with their segmentation masks serving as prompts. Despite having no temporal connection between images, this approach effectively transfers segmentation masks from annotated to unannotated examples (see [34] for more details).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [34] [34] Y. Bai, Q. Yu, B. Yun, D. Jin, Y. Xia, and Y. Wang, 'Fs-medsam2: Exploring the potential of sam2 for few-shot medical image segmentation without fine-tuning.' CoRR , vol. abs/2409.04298, 2024. -
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
The quote only partly states this claim.
Study design and conductown data§ D. Evaluation of Conformal RCA · p. 8The quantile levels pl=0.3 and ph=0.9 were selected based on a systematic sensitivity analysis over multiple symmetric and asymmetric quantile pairs, evaluating the trade-off between empirical coverage and interval width across datasets.
“These values were selected based on a systematic sensitivity analysis over multiple symmetric and asymmetric quantile pairs, evaluating the trade-off between empirical coverage and interval width across datasets.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown data§ VI. CONCLUSION · p. 10In-Context RCA overcomes the limitations imposed by atlas-based methods, allowing it to tackle scenarios beyond anatomical segmentation, such as cell images.
“It also overcomes the limitations imposed by atlas-based methods allowing to tackle scenarios beyond anatomical segmentation, such as cell images.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationreasoning§ A.1 Correlation Analysis on New Metrics and Methods · p. 12MC Dropout and TTA require additional post-processing to derive an image-level quality proxy.
“As a result, these methods require additional post-processing to derive an image-level quality proxy.”
Quote in the paperSubstantial claim- Rests on an assumption: TTA and MC Dropout estimate epistemic uncertainty from multiple stochastic segmentation outputs and are commonly used as proxies for segmentation quality.
May combine two claims.
Interpretationnone given§ B. Performance Interval Estimation · p. 2Conformal RCA is model-agnostic and can be used to estimate quality intervals for segmentation masks regardless of the underlying architecture or training procedure used to produce them.
“In this work, we introduce Conformal RCA, which unlike previous approaches, is model-agnostic and can be used to estimate quality intervals for segmentation masks regardless of the underlying architecture or training procedure used to produce them.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Interpretationnone given§ VI. CONCLUSION · p. 10Conformal RCA relies on the exchangeability assumption between calibration and test sets.
“A remaining limitation is the reliance of exchangeability between calibration and test sets.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown data§ VI. CONCLUSION · p. 10Conformal RCA produces meaningful prediction intervals that outperform existing conformal prediction approaches for segmentation quality control.
“Conformal RCA demonstrates the ability to produce meaningful prediction intervals that outperform existing conformal prediction approaches for segmentation quality control.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationreasoning§ VI. CONCLUSION · p. 9In-Context RCA enables efficient quality estimation using smaller reference databases while either matching or improving prediction accuracy of traditional RCA.
“This combination enables efficient quality estimation using smaller reference databases while either matching or improving prediction accuracy of traditional RCA.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationnone given§ D. Evaluation of Conformal RCA · p. 8Conformal-RCA is model-agnostic and applicable to any underlying segmentation network regardless of output format.
“Importantly, Conformal-RCA remains model-agnostic, making it applicable to any underlying segmentation network regardless of output format.”
- Also stated in: § VI. CONCLUSION · p. 10 · plain
“Unlike previous interval-estimation approaches that rely on specialized probabilistic architectures and require calibrated softmax outputs, Conformal RCA is fully model-agnostic and easily integrates with any segmentation network.”
Quote in the paperNot a substantial claim- Also stated in: § VI. CONCLUSION · p. 10 · plain
May combine two claims.
Interpretationreasoning§ I. INTRODUCTION · p. 1The proposed method addresses both limitations of RCA by introducing ConfIC-RCA, a model-agnostic framework that combines two complementary advances.
“In this work, we address both limitations by introducing ConfIC-RCA (Conformal In-Context RCA) , a model-agnostic framework that combines two complementary advances.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown data§ VI. CONCLUSION · p. 10In-Context RCA achieves comparable or superior performance to traditional atlas-based approaches while being up to two orders of magnitude faster.
“Experimental results conducted across diverse medical imaging modalities, show that In-Context RCA achieves comparable or superior performance to traditional atlas-based approaches while being up to two orders of magnitude faster.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationreasoning§ VI. CONCLUSION · p. 10When the exchangeability assumption is violated (e.g., due to domain shifts in scanner settings or patient populations), coverage can degrade, which may affect reliability in real-world clinical deployments.
“When this assumption is violated (e.g., due to domain shifts in scanner settings or patient populations), coverage can degrade which may affect reliability in real-world clinical deployments.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The calibration and test sets are exchangeable.
The paper relies on this without support.
Limited availability of reference annotations in clinical settings makes continuous assessment of deployed segmentation methods challenging.
“Once a segmentation method is deployed in practice, continuously assessing its real performance on new unseen data samples becomes a challenging task, mainly due to the limited availability of reference annotations in clinical settings.”
The authors state this as an assumption.
Calibration samples and test samples are exchangeable (e.g., i.i.d.).
“The only required assumption is that the calibration samples and the test samples are exchangeable (e.g., the samples are i.i.d.).”
“Assuming exchangeability between the test sample and calibration set, the constructed interval provides the marginal coverage guarantee stated in Theorem 3, as shown in [8].”
The authors state this as an assumption.
Higher values of the quality metric ρ correspond to better quality estimations.
“assuming that higher values of ρ correspond to better quality estimations.”
The authors state this as an assumption.
If the predicted segmentation S_I is of high quality, the RCA segmenter should perform well on at least some reference images, and if S_I is of poor quality, it should perform poorly on the reference database.
“The underlying hypothesis is that if S I is of high quality, the RCA segmenter should perform well on at least some of the reference images, resulting in high values of ρ . Conversely, if S I is of poor quality, the segmenter is expected to perform poorly on the reference database.”
The authors state this as an assumption.
The calibration and test sets are exchangeable.
“A remaining limitation is the reliance of exchangeability between calibration and test sets.”
The paper relies on this without support.
TTA and MC Dropout estimate epistemic uncertainty from multiple stochastic segmentation outputs and are commonly used as proxies for segmentation quality.
“These methods estimate epistemic uncertainty from multiple stochastic segmentation outputs and are commonly used as proxies for segmentation quality.”
“In contrast, approaches like MC Dropout and TTA estimate epistemic uncertainty rather than segmentation quality itself.”
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404 · cited 1× · see citing works
“1) Simulating Masks of Diverse Quality: To evaluate In-Context RCA, we generate segmentation masks of varying quality by training a small U-Net [58] for 10 epochs and saving the lower and higher-quality segmentations.”
Kirillov, A., Mintun, E., Ravi, N., Mao, H., Rolland, C., Gustafson, L., Xiao, T., Whitehead, S., Berg, A. C., Lo, W.-Y., et al. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00371 · Cited by 11,953 · cited 1× · see citing works
“2) SAM 2-Based Reverse Segmenter: Segment Anything Model (SAM) [53] is a foundation model for image and video segmentation guided by prompts.”
Dropout as a bayesian approximation: Representing model uncertainty in deep learning
Gal, Y., & Ghahramani, Z. (2015) · arXiv · doi:10.48550/arxiv.1506.02142 · Cited by 6,471 · cited 2× · see citing works
“…input—such as Probabilistic U-Net [36] or PHiSeg [37]—or rely on alternative uncertainty estimation techniques like test-time augmentation [21], Monte-Carlo dropout [20], or ensembling [38]; all of which add further implementation overhead and yielded lower performance in the reported experiments.”
Prototypical Networks for Few-shot LearningPreprint
Snell, J., Swersky, K., & Zemel, R. S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.05175 · Cited by 5,863 · cited 1× · see citing works
“While traditional approaches are often based on prototypical networks [31], [32], more advanced models such as UniverSeg [10] and foundational models like SAM 2 [11], [33], [34] delivered more promising results on a wide range of medical tasks.”
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles
Lakshminarayanan, B., Pritzel, A., & Blundell, C. (2016) · arXiv · doi:10.48550/arxiv.1612.01474 · Cited by 3,666 · cited 1× · see citing works
“…input—such as Probabilistic U-Net [36] or PHiSeg [37]—or rely on alternative uncertainty estimation techniques like test-time augmentation [21], Monte-Carlo dropout [20], or ensembling [38]; all of which add further implementation overhead and yielded lower performance in the reported experiments.”
On calibration of modern neural networks
Guo, C., Pleiss, G., Sun, Y., & Weinberger, K. Q. (2017) · arXiv · doi:10.48550/arxiv.1706.04599 · Cited by 3,435 · cited 1× · see citing works
“In addition, the method constructs its intervals from nonconformity scores based on the softmax scores [39], [40], which are known to su ff er from calibration issues [41], [42].”
Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool
Taha, A. A., & Hanbury, A. (2015) · BMC Medical Imaging · doi:10.1186/s12880-015-0068-x · Cited by 3,022 · cited 1× · see citing works
“Commonly used metrics include the Dice-Sørensen coe ffi cient (DSC) and other overlap-based measures [1], as well as distance-based metrics, such as the Hausdor ff distance or the average symmetric surface distance (ASSD) [2], [3].”
Algorithmic Learning in a Random World
(2005) · doi:10.1007/b106715 · Cited by 1,119 · see citing works
DINOv2: Learning Robust Visual Features without Supervision
Oquab, M., Darcet, T., Moutakanni, T., Vo, H., Szafraniec, M., Khalidov, V., Fernandez, P., Haziza, D., Massa, F., El-Nouby, A., et al. (2023) · arXiv · doi:10.48550/arxiv.2304.07193 · Cited by 1,078 · cited 2× · see citing works
“…reference sets to RA-based selection, where the k most similar images are chosen based on embeddings from di ff erent backbone models: DINOv2 [54] (general domain), MedImageInsight [59] (pretrained on a large and diverse set of medical imaging modalities including X-ray, CT, MRI, dermoscopy,…”
Distribution-Free Predictive Inference for Regression
Lei, J., G’Sell, M., Rinaldo, A., Tibshirani, R. J., & Wasserman, L. (2018) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1307116 · Cited by 1,049 · cited 1× · see citing works
“To better account for heteroscedasticity, i.e. when the noise variance varies across the input domain, a locally weighted nonconformity score has been proposed: s ( x , y ) = | y − ˆ f ( x ) | ˆ σ ( x ) , where ˆ σ ( x ) is the estimated standard error of the residual [43].”
PH<sup>2</sup> - A dermoscopic image database for research and benchmarking
Mendonca, T., Ferreira, P. M., Marques, J. S., Marcal, A. R. S., & Rozeira, J. (2013) · 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2013.6610779 · Cited by 1,009 · cited 1× · see citing works
“We evaluate In-Context RCA using two representative in-context segmentation models: • UniverSeg : a UNet-like architecture trained on a large collection of medical segmentation datasets (MegaMed-ical) and designed to generalize to unseen medical segmentation tasks without additional training.”
Development of a Digital Image Database for Chest Radiographs With and Without a Lung Nodule
Shiraishi, J., Katsuragawa, S., Ikezoe, J., Matsumoto, T., Kobayashi, T., Komatsu, K.-I., Matsui, M., Fujita, H., Kodera, Y., & Doi, K. (2000) · American Journal of Roentgenology · doi:10.2214/ajr.174.1.1740071 · Cited by 1,009 · cited 1× · see citing works
“2 including SCD [44], HC18 [45], PSFHS [46], PH2 [47], ISIC 2018 [48], NuCLS [49], JSRT [50], 3D-IRCAdB [51], WBC-CV and WBC-JTSC [52].”
Codella, N., Rotemberg, V., Tschandl, P., Celebi, M. E., Dusza, S., Gutman, D., Helba, B., Kalloo, A., Liopyris, K., Marchetti, M., et al. (2019) · arXiv · doi:10.48550/arxiv.1902.03368 · Cited by 984 · cited 1× · see citing works
“2 including SCD [44], HC18 [45], PSFHS [46], PH2 [47], ISIC 2018 [48], NuCLS [49], JSRT [50], 3D-IRCAdB [51], WBC-CV and WBC-JTSC [52].”
Generalized Overlap Measures for Evaluation and Validation in Medical Image Analysis
Crum, W. R., Camara, O., & Hill, D. L. G. (2006) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2006.880587 · Cited by 776 · cited 1× · see citing works
“Commonly used metrics include the Dice-Sørensen coe ffi cient (DSC) and other overlap-based measures [1], as well as distance-based metrics, such as the Hausdor ff distance or the average symmetric surface distance (ASSD) [2], [3].”
Towards a guideline for evaluation metrics in medical image segmentation
Müller, D., Soto-Rey, I., & Kramer, F. (2022) · BMC Research Notes · doi:10.1186/s13104-022-06096-y · Cited by 668 · cited 1× · see citing works
“Commonly used metrics include the Dice-Sørensen coe ffi cient (DSC) and other overlap-based measures [1], as well as distance-based metrics, such as the Hausdor ff distance or the average symmetric surface distance (ASSD) [2], [3].”
Douze, M., Guzhva, A., Deng, C., Johnson, J., Szilvasy, G., Mazaré, P.-E., Lomeli, M., Hosseini, L., & Jégou, H. (2026) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2025.3618474 · Cited by 478 · cited 2× · see citing works
“In the case of X-ray images, we leverage RAD-DINO [57], a domain-specific version of DINOv2 fine-tuned for radiology, as we expect it to further improve performance.”
A probabilistic u-net for segmentation of ambiguous images
Kohl, S. A. A., Romera-Paredes, B., Meyer, C., De Fauw, J., Ledsam, J. R., Maier-Hein, K. H., Eslami, S. M. A., Rezende, D. J., & Ronneberger, O. (2018) · arXiv · doi:10.48550/arxiv.1806.05034 · Cited by 439 · cited 1× · see citing works
“…train specialised probabilistic segmentation models that can sample multiple plausible outputs for the same input—such as Probabilistic U-Net [36] or PHiSeg [37]—or rely on alternative uncertainty estimation techniques like test-time augmentation [21], Monte-Carlo dropout [20], or ensembling…”
Conformal prediction beyond exchangeability
Barber, R. F., Candès, E. J., Ramdas, A., & Tibshirani, R. J. (2023) · The Annals of Statistics · doi:10.1214/23-aos2276 · Cited by 395 · cited 1× · see citing works
“Developing methods that are robust to distribution shifts is an important direction for future work, and remains an open problem even beyond medical imaging, as current approaches su ff er from inexact adaptations and increased prediction sets [60], [61].”
Evaluation Framework for Algorithms Segmenting Short Axis Cardiac MRI.
Radau, P. E., Lu, Y., Connelly, K. A., Paul, G. A., Dick, A. J., & Wright, G. A. (2009) · The MIDAS Journal · doi:10.54294/g80ruo · Cited by 373 · cited 1× · see citing works
“2 including SCD [44], HC18 [45], PSFHS [46], PH2 [47], ISIC 2018 [48], NuCLS [49], JSRT [50], 3D-IRCAdB [51], WBC-CV and WBC-JTSC [52].”
SegGPT: Towards Segmenting Everything In Context
Wang, X., Zhang, X., Cao, Y., Wang, W., Shen, C., & Huang, T. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00110 · Cited by 310 · cited 1× · see citing works
“To improve practicality and e ffi ciency, we incorporate In-Context RCA , which uses in-context learning segmentation models [9], [10], [11] that can perform new segmentation tasks by conditioning on a small set of labeled examples without requiring any additional training.”
SAM 2: Segment Anything in Images and Videos
Ravi, N., Gabeur, V., Hu, Y.-T., Hu, R., Ryali, C., Ma, T., Khedr, H., Rädle, R., Rolland, C., Gustafson, L., et al. (2024) · arXiv · doi:10.48550/arxiv.2408.00714 · Cited by 300 · cited 2× · see citing works
“While traditional approaches are often based on prototypical networks [31], [32], more advanced models such as UniverSeg [10] and foundational models like SAM 2 [11], [33], [34] delivered more promising results on a wide range of medical tasks.”
Algorithmic Learning in a Random World
Vovk, V., Gammerman, A., & Shafer, G. (2022) · doi:10.1007/978-3-031-06649-8 · Cited by 296 · cited 4× · see citing works
“Accordingly, we clip the predicted interval C ( S I ) to this range to ensure plausible quality estimates.”
InfluentialSelf-supervision with Superpixels: Training Few-Shot Medical Image Segmentation Without Annotation
Ouyang, C., Biffi, C., Chen, C., Kart, T., Qiu, H., & Rueckert, D. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58526-6_45 · Cited by 285 · cited 1× · see citing works
“While traditional approaches are often based on prototypical networks [31], [32], more advanced models such as UniverSeg [10] and foundational models like SAM 2 [11], [33], [34] delivered more promising results on a wide range of medical tasks.”
Automated measurement of fetal head circumference using 2D ultrasound images
van den Heuvel, T. L. A., de Bruijn, D., de Korte, C. L., & Ginneken, B. V. (2018) · PLOS ONE · doi:10.1371/journal.pone.0200412 · Cited by 280 · cited 1× · see citing works
“2 including SCD [44], HC18 [45], PSFHS [46], PH2 [47], ISIC 2018 [48], NuCLS [49], JSRT [50], 3D-IRCAdB [51], WBC-CV and WBC-JTSC [52].”
Fast and robust segmentation of white blood cell images by self-supervised learning
Zheng, X., Wang, Y., Wang, G., & Liu, J. (2018) · Micron · doi:10.1016/j.micron.2018.01.010 · Cited by 251 · cited 1× · see citing works
“2 including SCD [44], HC18 [45], PSFHS [46], PH2 [47], ISIC 2018 [48], NuCLS [49], JSRT [50], 3D-IRCAdB [51], WBC-CV and WBC-JTSC [52].”
A gentle introduction to conformal prediction and distribution-free uncertainty quantification
Angelopoulos, A. N., & Bates, S. (2021) · arXiv · doi:10.48550/arxiv.2107.07511 · Cited by 240 · cited 2× · see citing works
“This asymmetry captures the observation that RCA tends to under-estimate segmentation quality, making higher scores more informative [5].”
Conformalized Quantile Regression
Romano, Y., Patterson, E., & Candès, E. J. (2019) · arXiv · doi:10.48550/arxiv.1905.03222 · Cited by 236 · cited 5× · see citing works
“…[35], we base our conformal prediction framework on Confor-malized Quantile Regression (CQR), leveraging its ability to produce tighter prediction intervals than alternative conformal approaches commonly used for regression [8], and introducing novel modifications tailored to the RCA procedure.”
InfluentialSelf-Supervised Learning for Few-Shot Medical Image Segmentation
Ouyang, C., Biffi, C., Chen, C., Kart, T., Qiu, H., & Rueckert, D. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3150682 · Cited by 232 · cited 1× · see citing works
“Recently, Few-shot Semantic Segmentation (FSS) methods —which extend in-context learning to address segmentation tasks— have shown great potential in the medical domain, particularly with limited annotations [30].”
UniverSeg: Universal Medical Image Segmentation
Butoi, V. I., Gonzalez Ortiz, J. J., Ma, T., Sabuncu, M. R., Guttag, J., & Dalca, A. V. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01960 · Cited by 195 · cited 4× · see citing works
“Since UniverSeg supports only binary segmentation, for multi-class we process them separately (including background), and then select the most likely class per pixel using softmax, as described in [10].”
InfluentialPrototypical Siamese Networks for Few-shot Learning
Wang, J., & Zhai, Y. (2020) · IEEE International Conference on Electronics Information and Emergency Communication · doi:10.1109/iceiec49280.2020.9152261 · Cited by 183 · cited 1× · see citing works
“While traditional approaches are often based on prototypical networks [31], [32], more advanced models such as UniverSeg [10] and foundational models like SAM 2 [11], [33], [34] delivered more promising results on a wide range of medical tasks.”
Class-Conditional Conformal Prediction With Many Classes
Ding, T., Angelopoulos, A. N., Bates, S., et al. (2023) · Neural Information Processing Systems · doi:10.48550/arxiv.2306.09335 · Cited by 167 · cited 1×
“Developing methods that are robust to distribution shifts is an important direction for future work, and remains an open problem even beyond medical imaging, as current approaches su ff er from inexact adaptations and increased prediction sets [60], [61].”
Reverse Classification Accuracy: Predicting Segmentation Performance in the Absence of Ground Truth
Valindria, V. V., Lavdas, I., Bai, W., Kamnitsas, K., Aboagye, E. O., Rockall, A. G., Rueckert, D., & Glocker, B. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2665165 · Cited by 152 · cited 5× · see citing works
“Reverse Classification Accuracy (RCA) [5] is a framework originally designed to predict the performance of an image segmentation method in scenarios where GT masks are unavailable.”
InfluentialAmgad, M. T., Atteya, L. A., Hussein, H., Mohammed, K. H., Hafiz, E. O. A., Elsebaie, M. A., Alhusseiny, A. M., AlMoslemany, M. A., Elmatboly, A. M., Pappalardo, P. A., et al. (2022) · GigaScience · doi:10.1093/gigascience/giac037 · Cited by 136 · cited 1× · see citing works
“We evaluate In-Context RCA using two representative in-context segmentation models: • UniverSeg : a UNet-like architecture trained on a large collection of medical segmentation datasets (MegaMed-ical) and designed to generalize to unseen medical segmentation tasks without additional training.”
Cross Validation Framework to Choose amongst Models and Datasets for Transfer Learning
Zhong, E., Fan, W., Yang, Q., Verscheure, O., & Ren, J. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15939-8_35 · Cited by 132 · cited 1× · see citing works
“Other previous studies rely on a reverse-testing strategy, where a new classifier is trained on predictions on the test data and evaluated again on the training data [25], [26], [27].”
Exploring scalable medical image encoders beyond text supervision
Pérez-García, F., Sharma, H., Bond-Taylor, S., Bouzid, K., Salvatelli, V., Ilse, M., Bannur, S., Castro, D. C., Schwaighofer, A., Lungren, M. P., et al. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-024-00965-w · Cited by 115 · cited 1× · see citing works
“We compared the performance of In-Context RCA with a single-atlas approach, known to o ff er the strongest results in the classical RCA framework [5], [28].”
Evaluating Segmentation Error without Ground Truth
Kohlberger, T., Singh, V., Alvino, C., Bahlmann, C., & Grady, L. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33415-3_65 · Cited by 102 · cited 1× · see citing works
“Such approaches have been applied to prostate segmentation [12], cardiac segmentation [13], and a more generic framework has been used to assess the quality for automated segmentations for lung and liver in [14].”
Real-Time Prediction of Segmentation Quality
Robinson, R., Oktay, O., Bai, W., Valindria, V. V., Sanghvi, M. M., Aung, N., Paiva, J. M., Zemrak, F., Fung, K., Lukaschuk, E. I., et al. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00937-3_66 · Cited by 61 · cited 3× · see citing works
“In [29] the authors propose using a neural network to directly estimate prediction quality, aiming to mitigate the time constraint.”
MedImageInsight: An Open-Source Embedding Model for General Domain Medical ImagingPreprint
Codella, N. C. F., Jin, Y., Jain, S., et al. (2024) · arXiv.org · doi:10.48550/arxiv.2410.06542 · Cited by 61 · cited 2× · see citing works
“For a more complete evaluation, including MedImageIn-sight [59] embeddings pretrained on diverse medical imaging Authorized licensed use limited to the terms of the applicable license agreement with IEEE.”
Automated Quality Control for Segmentation of Myocardial Perfusion SPECT
Xu, Y. X., Kavanagh, P., Fish, M. B., et al. (2009) · Journal of Nuclear Medicine · doi:10.2967/jnumed.108.061333 · Cited by 56 · cited 1× · see citing works
“Such approaches have been applied to prostate segmentation [12], cardiac segmentation [13], and a more generic framework has been used to assess the quality for automated segmentations for lung and liver in [14].”
CheXmask: a large-scale dataset of anatomical segmentation masks for multi-center chest x-ray images
Gaggion, N., Mosquera, C., Mansilla, L., Saidman, J. M., Aineseder, M., Milone, D. H., & Ferrante, E. (2024) · Scientific Data · doi:10.1038/s41597-024-03358-1 · Cited by 48 · cited 1× · see citing works
“Other previous studies rely on a reverse-testing strategy, where a new classifier is trained on predictions on the test data and evaluated again on the training data [25], [26], [27].”
Self-citationMedical image segmentation automatic quality control: A multi-dimensional approach
Fournel, J., Bartoli, A., Bendahan, D., Guye, M., Bernard, M., Rauseo, E., Khanji, M. Y., Petersen, S. E., Jacquier, A., & Ghattas, B. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102213 · Cited by 45 · cited 1× · see citing works
“Additionally, a CNN-based approach was developed for automated quality control of left ventricle segmentation in cardiac MRI [24].”
Medical SAM 2: Segment medical images as video via Segment Anything Model 2
Zhu, J., Hamdi, A., Qi, Y., Jin, Y., & Wu, J. (2024) · arXiv · doi:10.48550/arxiv.2408.00874 · Cited by 42 · cited 2× · see citing works
“To improve practicality and e ffi ciency, we incorporate In-Context RCA , which uses in-context learning segmentation models [9], [10], [11] that can perform new segmentation tasks by conditioning on a small set of labeled examples without requiring any additional training.”
Automatic Quality Control of Cardiac MRI Segmentation in Large-Scale Population Imaging
Robinson, R., Valindria, V. V., Bai, W., Suzuki, H., Matthews, P. M., Page, C., Rueckert, D., & Glocker, B. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66182-7_82 · Cited by 37 · cited 5× · see citing works
“Unlike previous studies that explored RCA focusing on cardiac MRI [28], [29] or multi-organ segmentation on whole-body MRI [5] only, we broaden our analysis to a wider range of medical imaging challenges.”
InfluentialReverse testing: an efficient framework to select amongst classifiers under sample selection bias
Fan, W., & Davidson, I. (2006) · Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1150402.1150422 · Cited by 35 · cited 1× · see citing works
“Other previous studies rely on a reverse-testing strategy, where a new classifier is trained on predictions on the test data and evaluated again on the training data [25], [26], [27].”
PHiSeg: Capturing Uncertainty in Medical Image Segmentation
Baumgartner, C. F., Tezcan, K. C., Chaitanya, K., Hötker, A. M., Muehlematter, U. J., Schawkat, K., Becker, A. S., Donati, O., & Konukoglu, E. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-32245-8_14 · Cited by 34 · cited 2× · see citing works
“…probabilistic segmentation models that can sample multiple plausible outputs for the same input—such as Probabilistic U-Net [36] or PHiSeg [37]—or rely on alternative uncertainty estimation techniques like test-time augmentation [21], Monte-Carlo dropout [20], or ensembling [38]; all of…”
Class-Conditional Conformal Prediction with Many Classes
Ding, T., Angelopoulos, A. N., Bates, S., et al. (2023) · neural information processing systems · doi:10.52202/075280-2817 · Cited by 33 · see citing works
A Novel Quality Control Algorithm for Medical Image Segmentation Based on Fuzzy Uncertainty
Qiao, L., Chen, X., Chen, C., & Garibaldi, J. M. (2022) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2022.3228332 · Cited by 32 · cited 1× · see citing works
“A common strategy is to compute epistemic uncertainty maps from multiple segmentation outputs using techniques such as MC Dropout or test-time augmentation (TTA) [20], [21], [22].”
Functional Imaging and Modeling of the Heart
Ennis, D., Perotti, L., & Wang, V. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-78710-3 · Cited by 28 · see citing works
Deep Generative Model-Based Quality Control for Cardiac MRI Segmentation
Wang, S., Tarroni, G., Qin, C., Mo, Y., Dai, C., Chen, C., Glocker, B., Guo, Y., Rueckert, D., & Bai, W. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-59719-1_9 · Cited by 27 · cited 1× · see citing works
“For instance, [15] train a generative model to learn a manifold of good-quality cardiac MRI segmentations and then evaluate new segmentations by their projection error.”
Bai, J., Zhou, Z., Ou, Z., Koehler, G., Stock, R., Maier-Hein, K. H., Elbatel, M., Martí, R., Li, X., Qiu, Y., et al. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103353 · Cited by 27 · cited 1× · see citing works
“2 including SCD [44], HC18 [45], PSFHS [46], PH2 [47], ISIC 2018 [48], NuCLS [49], JSRT [50], 3D-IRCAdB [51], WBC-CV and WBC-JTSC [52].”
A Quality Control System for Automated Prostate Segmentation on T2-Weighted MRI
Sunoqrot, M. R. S., Selnæs, K. M., Sandsmark, E., Nketiah, G. A., Zavala‐Romero, O., Stoyanova, R. S., Bathen, T. F., & Elschot, M. (2020) · Diagnostics · doi:10.3390/diagnostics10090714 · Cited by 26 · cited 1× · see citing works
“Such approaches have been applied to prostate segmentation [12], cardiac segmentation [13], and a more generic framework has been used to assess the quality for automated segmentations for lung and liver in [14].”
An Alarm System for Segmentation Algorithm Based on Shape Model
Liu, F., Xia, Y., Yang, D., Yuille, A., & Xu, D. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.01075 · Cited by 25 · cited 1× · see citing works
“Similarly, [16] use a shape-model-based VAE to capture a low-dimensional feature space of acceptable segmentations and predict quality via a learned regressor.”
Retrieval-Augmented Few-Shot Medical Image Segmentation With Foundation Models
Zhao, L., Chen, X., Chen, E. Z., Liu, Y., Chen, T., & Sun, S. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3568479 · Cited by 19 · cited 1× · see citing works
“To implement this, we embed all the images from the reference database using DINOv2 embeddings [54] and then create a vector database using FAISS [55], which enables e ffi cient similarity search.”
On Temperature Scaling and Conformal Prediction of Deep Classifiers
Dabah, L., & Tirer, T. (2024) · International Conference on Machine Learning · doi:10.48550/arxiv.2402.05806 · Cited by 19 · cited 1×
“In addition, the method constructs its intervals from nonconformity scores based on the softmax scores [39], [40], which are known to su ff er from calibration issues [41], [42].”
Self-citationEstimating Model Performance under Domain Shifts with Class-Specific Confidence Scores
Li, Z., Kamnitsas, K., Islam, M., Chen, C., & Glocker, B. (2022) · arXiv · doi:10.48550/arxiv.2207.09957 · Cited by 16 · cited 2×
“For PHiSeg, we follow the conformal calibration procedure described in [35]: for each input image, N = 50 stochastic segmentations are generated, and the DSC is estimated from the softmax outputs [39], yielding a distribution of predicted DSCs per sample.”
Estimating Model Performance Under Domain Shifts with Class-Specific Confidence Scores
Li, Z., Kamnitsas, K., Islam, M., Chen, C., & Glocker, B. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-16449-1_66 · Cited by 16 · see citing works
Efficient Model Monitoring for Quality Control in Cardiac Image Segmentation
Galati, F., & Zuluaga, M. A. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-78710-3_11 · Cited by 15 · cited 1× · see citing works
“[17] propose global and pixel-wise quality measures using a convolutional autoencoder trained on ground-truth masks.”
Medical Image Computing and Computer Assisted Intervention – MICCAI 2020
(2020) · Lecture notes in computer science · doi:10.1007/978-3-030-59719-1 · Cited by 15 · see citing works
A Quantitative Comparison of Epistemic Uncertainty Maps Applied to Multi-Class Segmentation
Camarasa, R., Bos, D., Hendrikse, J., Nederkoorn, P. J., Kooi, M. E., van der Lugt, A., & de Bruijne, M. (2021) · The Journal of Machine Learning for Biomedical Imaging · doi:10.59275/j.melba.2021-ec49 · Cited by 12 · cited 2× · see citing works
“Following [23], we first compute the mean predictive probability map across N = 50 output samples, then evaluate pixel-wise entropy for each class, and finally average entropy values to obtain a scalar uncertainty score.”
Unsupervised Quality Control of Image Segmentation Based on Bayesian Learning
Audelan, B., & Delingette, H. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-32245-8_3 · Cited by 12 · cited 1× · see citing works
“For instance, [19] follow an unsupervised Bayesian framework for brain tumor and left ventricle myocardium segmentation, measuring segmentation adequacy via a probabilistic model combining intensity and spatial priors.”
Unsupervised Bias Discovery in Medical Image Segmentation
Gaggion, N., Echeveste, R., Mansilla, L., et al. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-45249-9_26 · Cited by 5 · see citing works
Self-citationConformal Performance Range Prediction for Segmentation Output Quality Control
Wundram, A. M., Fischer, P., Muehlebach, M., Koch, L. M., & Baumgartner, C. F. (2024) · arXiv · doi:10.48550/arxiv.2407.13307 · Cited by 3 · cited 8×
“Unlike [35], we base our conformal prediction framework on Confor-malized Quantile Regression (CQR), leveraging its ability to produce tighter prediction intervals than alternative conformal approaches commonly used for regression [8], and introducing novel modifications tailored to the RCA…”
InfluentialQCResUNet: Joint Subject-Level and Voxel-Level Prediction of Segmentation Quality
Qiu, P., Chakrabarty, S., Nguyen, P., Ghosh, S. S., & Sotiras, A. (2023) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-43901-8_17 · Cited by 3 · cited 1× · see citing works
“QCResUNet [18] jointly predicts subject-level quality scores and voxel-level error maps using a multi-task deep network.”
Conformal Performance Range Prediction for Segmentation Output Quality Control
Wundram, A. M., Fischer, P., Muehlebach, M., et al. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73158-7_8 · Cited by 3 · see citing works
Unsupervised bias discovery in medical image segmentation
Gaggion, N., Echeveste, R., Mansilla, L., et al. (2023) · CLIP/FAIMI/EPIMI@MICCAI · doi:10.48550/arxiv.2309.00451 · Cited by 1 · cited 1×
“However, evaluation remains a critical task, especially for identifying instances where an image segmentation method may fail in automatic pipelines due to unexpected changes, e.g. in patient demographics [4] or acquisition protocols.”
Self-citation
Flagged first, then by citations
Research works printed but not linked: 5
- [30][30] C. Ouyang, C. Biffi, C. Chen, T. Kart, H. Qiu, and D. Rueckert, 'Selfsupervised learning for few-shot medical image segmentation,' IEEE Transactions on Medical Imaging , vol. 41, no. 7, pp. 1837-1848, 2022. -
- [31][31] J. Snell, K. Swersky, and R. Zemel, 'Prototypical networks for fewshot learning,' in Proceedings of the 31st International Conference on Neural Information Processing Systems . Curran Associates Inc., 2017, p. 4080-4090. -
- [34][34] Y. Bai, Q. Yu, B. Yun, D. Jin, Y. Xia, and Y. Wang, 'Fs-medsam2: Exploring the potential of sam2 for few-shot medical image segmentation without fine-tuning.' CoRR , vol. abs/2409.04298, 2024. - · arXiv
- [40][40] P. K¨ ohler, J. Fadugba, P. Berens, and L. M. Koch, 'Efficiently correcting patch-based segmentation errors to control image-level performance in retinal images,' in Proceedings of The 7nd International Conference on Medical Imaging with Deep Learning , vol. 250. PMLR, 2024, pp. 841-856. -
- [51][51] L. Soler et al. , '3d image reconstruction for comparison of algorithm database: A patient specific anatomical and medical image database,' IRCAD, Strasbourg, France, Tech. Rep , vol. 1, no. 1, 2010. -
Cited by
Sorted by citations
Efficient Conformal Prediction for Regression Models under Label Noise
Cohen, Y., Goldberger, J., & Tirer, T. (2025) · arXiv.org · doi:10.48550/arxiv.2509.15120 · Cited by 3
“CP has become an important calibration tool in safety-critical applications such as medical imaging [11]–[14].”
Self-citationChirp Localization via Fine-Tuned Transformer Model: A Proof-of-Concept Study
Bahador, N., & Lankarany, M. (2025) · arXiv.org · doi:10.48550/arxiv.2503.22713 · Cited by 3
“ICL, combined with retrieval-augmentation techniques, has improved segmentation tasks by leveraging ground truth annotations (Gu et al., 2025; Cosarinsky et al., 2025).”
DART: Scaling a Shape Representation Across Anatomical Classes and Imaging Modalities
Swarna, K., Bassi, P., Ngo, L., et al. (2026) · doi:10.48550/arxiv.2610.27605
“Quality-estimation methods score a mask without reference annotations rather than correcting it (Cosarinsky et al., 2026; Galati & Zuluaga, 2021; Wang et al., 2020a; Chen et al., 2026).”
MID: Mask-Image Distributional Divergence for Evaluating Medical Image Segmentation
Marcianó, V., Zhang, X.-M., Guglielmo, G., et al. (2026) · doi:10.48550/arxiv.2610.17354
“Second, when GT annotations are unavailable, an alternative is to generate surrogate references using encoder-decoder refinement models [8, 14, 22, 31, 39]; however, these approaches require training additional models for each target dataset, which is computationally expensive and limits…”
- Authors
- Cosarinsky, M., Billot, R., Mansilla, L., Jimenez, G., Gaggión, N., Fu, G., Tirer, T., & Ferrante, E.
- Affiliations
- National University of General San Martín (AR)
- Consejo Nacional de Investigaciones Científicas y Técnicas (AR)
- Centre National de la Recherche Scientifique (FR)
- Bar-Ilan University (IL)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2025
- Volume
- 45
- Issue
- 7
- Pages
- 3545-3557
- ISSN
- 0278-0062 (ISSN-L)
- arXiv
- 2503.04522
- OpenAlex
- W7147452949
- Semantic Scholar
- a0cea546e8ccb4145d42f56338b14a6cbce56978
- Cited by
- 0
- References
- 65
- FWCI
- 0.00
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Medical Imaging (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by-sa)
- arXiv (Cornell University)
- Funders
- Israel Science Foundation (1940/23)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- automated image segmentation, conformal prediction, split conformal prediction, prediction intervals, in-context learning, automated quality control, medical image segmentation
- MeSH terms
- Machine Learning, Classification Algorithms, Algorithms, Humans, Image Processing, Computer-Assisted
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-21.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-21.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review