Cross-Model Agreement as a Deployment-Time Reliability Signal for Automatic Polyp Segmentation

May combine two claims.

SegFormer-B0 significantly outperforms both the Independent YOLO Referee (p < 0.001) and UNet++ (p = 4.29 × 10 -3 ) by DeLong's test.

“The DeLong analysis confirms that SegFormer-B0 significantly outperforms both the Independent YOLO Referee (p < 0.001) and UNet++ (p = 4.29 × 10 -3 ), establishing that the improvement associated with cross-architecture diversity is statistically significant rather than arising from random sampling variation.”

May combine two claims.

SegFormer-B0 significantly outperforms the same-architecture control and UNet++ as referees.

“significantly outperforming the same-architecture control and UNet++, and exceeding a representative Test-Time Augmentation baseline by 0.055 ROC-AUC under an identical protocol”

• Also stated in: § 1. Introduction · plain

  “significantly outperforming the same-architecture control and UNet++, and outperforming representative single-model uncertainty (TTA) and morphology-based baselines.”

May combine two claims.

Empty-mask status is referee-specific, so the restricted subsets differ in composition and size across referees.

“Empty-mask status is referee-specific, so the restricted subsets differ in composition and size across referees.”

May combine two claims.

Agreement Dice and Agreement IoU produced identical rankings and therefore identical ROC-AUC and Spearman correlation values.

“As expected from Eq. 4, Agreement Dice and Agreement IoU produced identical rankings and therefore identical ROC-AUC and Spearman correlation values.”

May combine two claims.

Centroid Distance and Boundary Agreement each provide strong failure-detection signals close to the overlap-based descriptors.

“Centroid Distance and Boundary Agreement each provide strong failure-detection signals close to the overlap-based descriptors.”

May combine two claims.

The Independent YOLO Referee (same-architecture control) achieved ROC-AUC = 0.923, was outperformed by SegFormer-B0 (0.960) and UNet++ (0.938), and exceeded MedSAM (0.863).

“The Independent YOLO Referee (samearchitecture control, ROC-AUC = 0.923) is outperformed by both SegFormer-B0 (0.960) and UNet++ (0.938), while exceeding MedSAM (0.863).”

May combine two claims.

UNet++ achieves a higher ROC-AUC than the same-architecture control, although a direct DeLong comparison between UNet++ and the Independent YOLO Referee was not performed.

“UNet++ also achieves a higher ROC-AUC than the same-architecture control, although a direct DeLong comparison between UNet++ and the Independent YOLO Referee was not performed.”

May combine two claims.

Images with higher Agreement Dice values generally exhibit more accurate segmentations, whereas low agreement values are predominantly associated with segmentation failures.

“Fig. 3 shows the association between the Agreement Dice value and the corresponding ground-truth Dice score for all images in the standardized benchmark: images with higher Agreement Dice values generally exhibit more accurate segmentations, whereas low agreement values are predominantly associated with segmentation failures.”

May combine two claims.

MedSAM achieved the lowest ROC-AUC (0.863) among the four referees, underperforming even the same-architecture YOLO control.

“MedSAM is a partial exception to this trend: despite being the most architecturally distinct of the four referees, it achieved the lowest ROC-AUC (0.863), underperforming even the same-architecture YOLO control.”

May combine two claims.

The four empty-mask groups sum to exactly 1,223 images, confirming complete coverage of the benchmark.

“The four groups sum to exactly 1,223 images, confirming complete coverage of the benchmark.”

May combine two claims. The quote only partly states this claim.

975 of 1,223 images (79.7%) fall into the 'Both Non-Empty' group, and within this group the true segmentation failure rate is 4.82%.

“The overwhelming majority of the benchmark (975 of 1,223 images, 79.7%) falls into the”

May combine two claims.

On the full standardized benchmark, RBQE with the SegFormer-B0 referee achieved a ROC-AUC of 0.960, compared with 0.905 for the TTA baseline and 0.927 for the best-performing morphology-based baseline (Circularity), exceeding TTA by 0.055 ROC-AUC and morphology by 0.033 ROC-AUC.

“On the full standardized benchmark, RBQE with the SegFormer-B0 referee achieved a ROC-AUC of 0.960, compared with 0.905 for the TTA baseline and 0.927 for the best-performing morphology-based baseline (Circularity), exceeding the protocol-matched TTA baseline by 0.055 ROC-AUC and the morphologybased baseline by 0.033 ROC-AUC.”

May combine two claims.

RBQE exhibits stable performance across multiple Dice failure thresholds (0.30, 0.40, 0.50, 0.60, and 0.70), indicating that the agreement-based reliability signal is not restricted to a particular operating point.

“Overall, the proposed framework exhibits stable performance across multiple failure thresholds, indicating that the agreement-based reliability signal is not restricted to a particular operating point.”

May combine two claims.

Both 'Both Empty' and 'Primary Empty Only' cases correspond to complete segmentation failure (100% failure rate).

“As expected, both”

May combine two claims.

On the identical, protocol-matched restricted subset, RBQE exceeds the morphology baseline by 0.167 ROC-AUC and TTA by 0.255 ROC-AUC, a substantially wider margin than on the full benchmark (0.033 and 0.055, respectively).

“On the identical, protocol-matched restricted subset, RBQE therefore exceeds the morphology baseline by 0.167 ROC-AUC and TTA by 0.255 ROC-AUC -a substantially wider margin than on the full benchmark (0.033 and 0.055, respectively).”

May combine two claims.

On the restricted subset, morphology-based SQE falls from 0.927 to 0.709, TTA falls from 0.905 to 0.621, and RBQE (SegFormer-B0) falls from 0.960 to 0.876.

“Both baselines degrade substantially more than RBQE when trivially separable empty-mask cases are excluded: morphology-based SQE falls from 0.927 to 0.709, and TTA falls from 0.905 to 0.621, whereas RBQE (SegFormer-B0) falls from 0.960 to 0.876.”

May combine two claims. The quote only partly states this claim.

The Independent YOLO Referee on its own 975-image 'Both Non-Empty' subset yields an ROC-AUC of 0.783, compared with 0.923 on the full standardized benchmark, a proportionally larger reduction than observed for SegFormer-B0.

“Repeating this restricted evaluation for the Independent YOLO Referee on its own 975-image”

May combine two claims.

Under referee-specific descriptor selection, SegFormer-B0 and the Independent YOLO Referee are unaffected, UNet++ improves modestly under Area Ratio (0.938 → 0.943), and MedSAM improves under Centroid Distance (0.863 → 0.873).

“SegFormer-B0 and the Independent YOLO Referee are unaffected, since Agreement Dice is already their best descriptor; UNet++ improves modestly under Area Ratio (0.938 → 0.943), and MedSAM improves under Centroid Distance (0.863 → 0.873).”

May combine two claims.

On the 1,046-image restricted subset, Agreement Dice achieves an ROC-AUC of 0.876, compared with 0.960 on the full standardized benchmark.

“On this subset, Agreement Dice achieves an ROC-AUC of 0.876, compared with 0.960 on the full standardized benchmark.”

May combine two claims.

MedSAM operates as a frozen foundation model at a substantially higher input resolution (1024 × 1024), resulting in greater inference cost despite eliminating the need for referee training.

“In contrast, MedSAM operates as a frozen foundation model at a substantially higher input resolution (1024 × 1024), resulting in greater inference cost despite eliminating the need for referee training.”

May combine two claims. The quote only partly states this claim.

Agreement Dice and Agreement IoU achieved ROC-AUC = 0.960, Centroid Distance 0.951, and Boundary Agreement 0.949 on the 1,223-image benchmark with SegFormer-B0 referee.

“The strongest agreement descriptors in this study -Agreement Dice and Agreement IoU (ROC-AUC = 0.960), followed by Centroid Distance (0.951) and Boundary Agreement (0.949)”

May combine two claims.

In the high-quality segmentation case, the primary and referee models produce highly consistent segmentation masks with substantial overlap and similar boundary localization, and the computed Agreement Dice value is high, correctly reflecting the successful segmentation outcome.

“In the high-quality segmentation case (Fig. 9, first row), the primary and referee models produce highly consistent segmentation masks with substantial overlap and similar boundary localization; consequently, the computed Agreement Dice value is high, correctly reflecting the successful segmentation outcome.”

May combine two claims.

The failed segmentation case is characterized by pronounced disagreement between the independently trained models, and the Agreement Dice value decreases substantially, enabling RBQE to correctly identify this segmentation as unreliable.

“In contrast, the failed segmentation case (third row) is characterized by pronounced disagreement between the independently trained models, manifesting as incomplete lesion delineation, inaccurate boundary localization, or a missed polyp; as a result, the Agreement Dice value decreases substantially, enabling RBQE to correctly identify this segmentation as unreliable.”

May combine two claims.

Rejecting the lowest-agreement half of predictions raises mean retained DSC from 0.731 to 0.911, and retaining only the top 10% raises it further to 0.945.

“rejecting the lowest-agreement half of predictions raises mean retained DSC from 0.731 to 0.911, and retaining only the top 10% raises it further to 0.945”

May combine two claims.

In the fourth-row case, the primary and referee models agree closely with each other (Agreement Dice = 0.793) despite both diverging substantially from the ground truth (DSC = 0.467).

“Here the primary and referee models agree closely with each other (Agreement Dice = 0.793) despite both diverging substantially from the ground truth (DSC = 0.467): the two models converge on a similar, but similarly wrong, delineation of the lesion.”

May combine two claims.

In several challenging cases, one model produces a reasonable segmentation while the other fails, leading to low agreement that serves as an effective indicator of reduced prediction reliability.

“In several challenging cases, one model produces a reasonable segmentation while the other fails, leading to low agreement that serves as an effective indicator of reduced prediction reliability.”

May combine two claims.

Cross-architecture referees provided a further, statistically significant improvement, with SegFormer-B0 achieving the strongest overall performance (0.960).

“Cross-architecture referees provided a further, statistically significant improvement, with SegFormer-B0 achieving the strongest overall performance (0.960).”

May combine two claims.

Across a standardized external benchmark of 1,223 colonoscopy images spanning four independent public datasets, RBQE's performance was robust to the choice of failure threshold and to the choice of referee architecture.

“Across a standardized external benchmark of 1,223 colonoscopy images spanning four independent public datasets, RBQE's performance was shown to be robust to the choice of failure threshold and to the choice of referee architecture.”

Classified as probably not a substantial claim.

MedSAM was used as a frozen, officially released pretrained checkpoint, applied directly at inference without any additional training or fine-tuning on Kvasir-SEG or the external evaluation datasets.

“MedSAM was used as a frozen, officially released pretrained checkpoint, applied directly at inference without any additional training or fine-tuning on Kvasir-SEG or the external evaluation datasets.”

Classified as probably not a substantial claim. May combine two claims.

The 100-image held-out subset was not used for training or model selection and was not included in the external RBQE benchmark.

“The 100-image held-out subset was not used for training or model selection and was not included in the external RBQE benchmark.”

May combine two claims.

Existing SQE approaches derive their quality signal from a single model's behavior, ensembles of identically architected models, or per-image reverse-classifier fitting against a reference atlas.

“existing SQE approaches derive their quality signal either from a single model's own behavior (confidence scores, predictive entropy, Monte Carlo (MC) Dropout, Test-Time Augmentation(TTA)), from disagreement among ensembles of identically architected models, or from per-image reverse-classifier fitting against a reference atlas”

May combine two claims.

The 25 excluded cases provide no meaningful information regarding the ability of RBQE to distinguish reliable from unreliable segmentations; including them would artificially inflate agreement-based quality estimation metrics.

“Since these cases contain no segmented foreground in either mask, they represent degenerate cases that provide no meaningful information regarding the ability of RBQE to distinguish reliable from unreliable segmentations; including them would artificially inflate agreement-based quality estimation metrics while contributing no evidence regarding segmentation correctness.”

Classified as probably not a substantial claim.

SegFormer-B0 serves as the principal cross-architecture referee throughout this study.

“SegFormer-B0 serves as the principal cross-architecture referee throughout this study.”

May combine two claims.

Kvasir-SEG was used solely for training the primary and referee models; no images from Kvasir-SEG were included in the final evaluation benchmark.

“The Kvasir-SEG dataset was used solely for training the primary segmentation model and the referee segmentation models; no images from Kvasir-SEG were included in the final evaluation benchmark.”

Classified as probably not a substantial claim.

The Independent YOLO Referee was trained using an architecture and training protocol identical to the primary segmentation model, but with an independent random weight initialization and optimization trajectory.

“A second YOLOv8n-Seg model was trained using an architecture and training protocol identical to the primary segmentation model, but with an independent random weight initialization and optimization trajectory.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The 130 Both Empty cases remained in the standardized benchmark because benchmark membership was determined once, using the SegFormer-B0 exclusion criterion, before evaluating the other referee configurations.

“they remained in the standardized benchmark because benchmark membership was determined once, using the SegFormer-B0 exclusion criterion, before evaluating the other referee configurations.”

May combine two claims.

These SQE families respectively inherit the deployed model's calibration errors, a shared architectural inductive bias, and a substantial per-image retraining cost.

“these families respectively inherit the deployed model's calibration errors, a shared architectural inductive bias, and a substantial per-image retraining cost.”

May combine two claims.

Agreement IoU is a strictly monotonic function of Agreement Dice for any pair of masks, so the two descriptors yield identical rank orderings and identical ROC-AUC values for failure detection.

“Note that IoU agr is a strictly monotonic function of D agr for any pair of masks, IoU agr = D agr 2 -D agr ,(4) and therefore the two descriptors yield identical rank orderings, and consequently identical ROC-AUC values for failure detection and identical Spearman correlations with ground-truth segmentation quality”

Classified as probably not a substantial claim.

Four referee configurations were evaluated, chosen to separate two design axes: referee independence and architectural diversity.

“using four referee configurations chosen to separate two design axes: referee independence and architectural diversity.”

• Also stated in: § 3.4. Referee configurations: independence and architectural diversity · plain

  “four referee configurations were investigated, arranged along the two design axes introduced in Section 1: one same-architecture, independently trained control; two cross-architecture, independently trained referees; and one cross-architecture, prompt-coupled control.”

May combine two claims.

RBQE requires no per-image retraining, no quality-labelled training data, and no modification of the deployed primary model.

“with no per-image retraining, no quality-labelled training data, and no modification of the deployed primary model”

• Also stated in: § 3.1. Overview · plain

  “it therefore requires no additional training, no architectural modification of the primary model, and no ground-truth annotations at inference.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Additional threshold sensitivity analyses assess robustness under alternative failure definitions.

“while additional threshold sensitivity analyses (Section 5.4) assess robustness under alternative failure definitions.”

Probably not a substantial claim: may not pass S3 (load-bearing).

A meta-analysis of 43 tandem-colonoscopy studies (>15,000 procedures) reported an adenoma miss rate of 26% (95% CI: 23-30%).

“a meta-analysis of 43 tandem-colonoscopy studies (>15,000 procedures) reported an adenoma miss rate of 26% (95% CI: 23-30%) [2].”

• cites [2]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

All four referee models were trained or evaluated exclusively using the Kvasir-SEG dataset (for trainable referees) or the officially released pretrained checkpoint (for MedSAM), and none were fine-tuned or adapted on any of the four external evaluation datasets.

“All four referee models were trained or evaluated exclusively using the Kvasir-SEG dataset (for the three trainable referees) or the officially released pretrained checkpoint (for MedSAM), and none were fine-tuned or adapted on any of the four external evaluation datasets”

Probably not a substantial claim: may not pass S3 (load-bearing).

The primary segmentation model was trained exclusively on the Kvasir-SEG dataset (1,000 images).

“The primary segmentation model was trained exclusively on the Kvasir-SEG dataset (1,000 images) [17] using the official Ultralytics implementation.”

• cites [17]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim. May combine two claims.

For the SegFormer-B0 configuration, excluding images with negligible foreground removed 177 images, all primary-empty with non-empty SegFormer-B0 referee, yielding a restricted subset of 1,046 images.

“this removed 177 images -all corresponding to a primary-empty prediction with a non-empty SegFormer-B0 referee mask (177 primary-empty, 0 referee-empty) -yielding a restricted subset of 1,046 images”

Classified as probably not a substantial claim.

RBQE is designed as a self-contained, post-hoc reliability module that can be attached to any deployed segmentation pipeline producing a binary or probabilistic mask.

“It is designed as a self-contained, post-hoc reliability module that can, in principle, be attached to any deployed segmentation pipeline producing a binary or probabilistic mask”

Probably not a substantial claim: may not pass S3 (load-bearing).

The Kvasir-SEG dataset was randomly partitioned into 700 training, 200 validation, and 100 held-out test images.

“The dataset was randomly partitioned into 700 training, 200 validation, and 100 held-out test images (70/20/10 split).”

May combine two claims.

Independent training alone suffices to produce a useful reliability signal, and architectural diversity adds a significant increment.

“Independence alone suffices; diversity adds a significant increment.”

May combine two claims.

The Independent YOLO Referee shares no weights, training checkpoints, or optimization state with the primary model and was never used to produce the primary segmentation.

“This model shares no weights, training checkpoints, or optimization state with the primary model and was never used to produce the primary segmentation.”

May combine two claims.

Cross-model consistency provides an informative surrogate indicator of segmentation reliability: strong agreement between independently trained primary and referee models generally corresponds to successful segmentation, while substantial disagreement is associated with failure.

“Overall, cross-model consistency provides an informative surrogate indicator of segmentation reliability: strong agreement between the independently trained primary and referee models generally corresponds to successful segmentation, while substantial disagreement is associated with failure.”

May combine two claims.

The agreement descriptors are computed using simple, deterministic geometric operations on binary segmentation masks, introducing negligible computational cost relative to segmentation inference and requiring no optimization or additional learnable parameters during deployment.

“The agreement descriptors are subsequently computed using simple, deterministic geometric operations on binary segmentation masks, introducing negligible computational cost relative to the segmentation inference itself and requiring no optimization or additional learnable parameters during deployment.”

May combine two claims.

RBQE continues to provide meaningful discrimination across the evaluated range, confirming that its effectiveness does not depend on a single empirically selected Dice threshold.

“Nevertheless, RBQE continues to provide meaningful discrimination across the evaluated range, confirming that its effectiveness does not depend on a single empirically selected Dice threshold and remains applicable under different clinical requirements.”

May combine two claims.

Agreement-based reliability estimation is measurably stronger than both a purely geometric baseline and a representative single-model uncertainty method, while requiring only one additional referee forward pass at deployment.

“These results indicate that agreement-based reliability estimation is not merely competitive with, but measurably stronger than, both a purely geometric baseline and a representative single-model uncertainty method, while requiring only one additional referee forward pass at deployment.”

May combine two claims.

Single-model uncertainty signals such as TTA remain bound to the calibration and stochastic behavior of the model being interrogated, whereas RBQE derives its reliability signal from agreement between two independently trained segmentation models.

“These results are consistent with the central hypothesis of this work: single-model uncertainty signals such as TTA remain bound to the calibration and stochastic behavior of the model being interrogated, whereas RBQE derives its reliability signal from agreement between two independently trained segmentation models.”

May combine two claims.

Both baselines comparatively rely on the same easily detected empty-mask cases that RBQE's restricted evaluation excludes: circularity is undefined or trivially informative for an empty mask, and TTA's zero-prediction-count signal is maximally informative precisely when the primary model produces no prediction at all.

“This pattern is consistent with both baselines' comparative reliance on the same easily detected empty-mask cases that RBQE's restricted evaluation deliberately excludes: circularity is undefined or trivially informative for an empty mask, and TTA's zero-prediction-count signal is, by construction, maximally informative precisely when the primary model produces no prediction at all.”

May combine two claims.

MedSAM's lower ROC-AUC is attributable to its prompt-driven inference paradigm: because its segmentation prompt is derived from the primary model's own predicted mask, its output is not fully independent of the primary model.

“As established in Section 3.4, this is attributable to MedSAM's prompt-driven inference paradigm: because its segmentation prompt is derived from the primary model's own predicted mask, its output is not fully independent of the primary model, despite the substantial architectural difference between a promptable foundation model and a convolutional detector.”

May combine two claims.

Agreement Dice is not only an effective binary failure detector but also a useful continuous ranking signal: predictions it deems more reliable are, on average, genuinely of higher quality.

“This confirms that Agreement Dice is not only an effective binary failure detector, but also a useful continuous ranking signal: predictions it deems more reliable are, on average, genuinely of higher quality, supporting its use as a practical triage mechanism in clinical deployment where a proportion of predictions can be flagged for expert review rather than accepted automatically.”

May combine two claims.

Geometric properties of the predicted mask contain useful information about segmentation quality, but such descriptors cannot identify failures in which a predicted mask remains geometrically plausible while being incorrectly localized or delineated relative to the true lesion.

“The morphology-based baseline demonstrates that geometric properties of the predicted mask contain useful information about segmentation quality; however, such descriptors cannot identify failures in which a predicted mask remains geometrically plausible while being incorrectly localized or delineated relative to the true lesion.”

May combine two claims.

Independent training alone provides a useful reliability signal, while architectural diversity can provide additional discriminative strength when the referee remains genuinely independent of the primary model.

“These results support the interpretation that independent training alone provides a useful reliability signal, while architectural diversity can provide additional discriminative strength when the referee remains genuinely independent of the primary model.”

May combine two claims.

RBQE requires no per-image retraining and no atlas dependency, unlike RCA.

“Unlike RCA [11], which requires fitting a new reverse classifier for every test image against a reference atlas, RBQE requires no per-image retraining and no atlas dependency”

• cites [11]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

TTA, like other single-model uncertainty methods, remains fundamentally bound to the calibration of one model and is therefore vulnerable precisely when that model is confidently wrong.

“TTA, like other single-model uncertainty methods, remains fundamentally bound to the calibration of one model and is therefore vulnerable precisely when that model is confidently wrong”

May combine two claims.

Agreement between predictions of independently trained models can provide an additional check on the primary model's reliability, although shared dataset exposure and systematic biases can still produce correlated errors.

“Consequently, agreement between their predictions can provide an additional check on the primary model's reliability, although shared dataset exposure and systematic biases can still produce correlated errors”

• AssumptionThe authors state this as an assumption: Independently trained models fail in different ways.

May combine two claims.

Model independence is the necessary foundation of the agreement signal; architectural diversity is a further, though not strictly required, source of additional discriminative strength; and output-level coupling is sufficient to undermine the signal even under maximal architectural diversity.

“model independence is the necessary foundation of the agreement signal, architectural diversity a further -though not strictly required -source of additional discriminative strength, and output-level coupling (as in MedSAM's prompt dependence) is sufficient to undermine the signal even under maximal architectural diversity.”

• AssumptionThe authors state this as an assumption: Independently trained models fail in different ways.

May combine two claims.

RBQE can operate as a triage mechanism, flagging a tunable proportion of the least reliable predictions for expert review while allowing high-agreement predictions to proceed with greater confidence.

“RBQE can therefore operate not only as a binary alarm, but as a triage mechanism, flagging a tunable proportion of the least reliable predictions for expert review while allowing high-agreement predictions to proceed with greater confidence”

• AssumptionRests on an assumption: During real-time colonoscopy, ground-truth segmentation is unavailable, and learned segmentation accuracy cannot be directly measured at the point of use.
• AssumptionRests on an assumption: Segmentation failures are most likely to occur under challenging imaging conditions (poor illumination, small polyps, domain shift) in which clinicians can least afford an undetected error.

May combine two claims.

RBQE provides a reference-free, post-hoc reliability signal that can be computed alongside the primary model's prediction using one additional referee forward pass, without requiring quality-labelled training data.

“RBQE addresses this gap by providing a reference-free, post-hoc reliability signal that can be computed alongside the primary model's prediction using one additional referee forward pass, without requiring quality-labelled training data.”

• AssumptionRests on an assumption: During real-time colonoscopy, ground-truth segmentation is unavailable, and learned segmentation accuracy cannot be directly measured at the point of use.

May combine two claims.

RBQE's strongest results arise specifically from cross-architecture referees, indicating that architectural diversity provides genuine additional signal beyond what ensemble-style disagreement alone would offer.

“RBQE's strongest results arise specifically from cross-architecture referees, indicating that architectural diversity provides genuine additional signal beyond what ensemble-style disagreement alone would offer.”

• AssumptionThe authors state this as an assumption: Independently trained models fail in different ways.

May combine two claims.

RBQE estimates the reliability of a segmentation prediction as a whole, but does not localize which region of a prediction is unreliable.

“RBQE estimates the reliability of a segmentation prediction as a whole, but does not localize which region of a prediction is unreliable.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The generalizability of agreement-based reliability estimation to multiclass segmentation problems, or to other medical imaging modalities beyond colonoscopy, remains to be established.

“the generalizability of agreement-based reliability estimation to multiclass segmentation problems, or to other medical imaging modalities beyond colonoscopy, remains to be established.”

May combine two claims.

Deployment of RBQE in a new clinical setting requires either training an additional referee model or identifying a suitable pretrained one.

“deployment in a new clinical setting requires either training an additional referee model or identifying a suitable pretrained one”

Classified as probably not a substantial claim.

The agreement descriptors employed in this study are deterministic geometric measures computed directly from binary masks.

“Third, the agreement descriptors employed in this study are deterministic geometric measures computed directly from binary masks.”

May combine two claims.

This design does not incorporate probabilistic segmentation outputs, feature-space similarity, or topology-aware representations.

“this design does not incorporate probabilistic segmentation outputs, feature-space similarity, or topology-aware representations”

Probably not a substantial claim: may not pass S3 (load-bearing).

This study evaluates RBQE exclusively on binary polyp segmentation.

“First, this study evaluates RBQE exclusively on binary polyp segmentation.”

Probably not a substantial claim: may not pass S3 (load-bearing).

This evaluation, comprising 1,223 external images across four independent public benchmarks, is retrospective.

“Fourth, this evaluation, although comprising 1,223 external images across four independent public benchmarks, is retrospective.”

May combine two claims.

This work introduced Referee-Based Quality Estimation (RBQE), a deployment-time, reference-free framework that estimates segmentation reliability through agreement between a primary segmentation model and an independently trained referee, requiring no ground-truth annotations, no quality-labelled training data, and no modification of the deployed segmentation model.

“This work introduced Referee-Based Quality Estimation (RBQE), a deployment-time, reference-free framework that estimates segmentation reliability through agreement between a primary segmentation model and an independently trained referee, requiring no ground-truth annotations, no quality-labelled training data, and no modification of the deployed segmentation model.”

• AssumptionRests on an assumption: During real-time colonoscopy, ground-truth segmentation is unavailable, and learned segmentation accuracy cannot be directly measured at the point of use.