Correction-aware interactive 3D tumor segmentation with sparse and revisable prompts
Open accessAbstract
Interactive 3D tumor segmentation addresses a practical annotation setting: when an automatic or promptable prediction is incomplete, over-segmented, or anatomically implausible, the user can correct it directly through visual prompts. Most promptable medical segmentation methods, however, are still developed and evaluated around clean-prompt protocols. In realistic volumetric correction, users may combine clicks, boxes, and scribbles, inspect the updated mask, edit only selected informative slices, and revise earlier instructions across rounds. Existing interactive models therefore face three practical limitations: Accuracy can depend strongly on prompt type and density; dense-scribble protocols impose high interaction burden; and cross-round corrections can create ambiguous prompt histories that are not explicitly represented. We propose a correction-aware multi-prompt framework for interactive 3D tumor segmentation. Instead of treating prompts as a static clean condition, the framework models them as revisions to an evolving mask. It integrates clicks, a 3D bounding box, and scribbles with mask-feedback refinement; samples prompts from residual errors; supports sparse scribbles on informative slices; and uses a revision-aware prompt memory to separate the latest positive and negative instructions from locations whose prompt label has changed. Experiments on MSD-Colon and KiTS21 kidney tumor benchmarks compare the proposed method with automatic, promptable, and interactive baselines under standard and sparse-prompt protocols, together with a synthetic analysis of cross-round prompt revision. The proposed method achieves higher segmentation accuracy across prompt settings, with larger differences when scribbles are limited to sparse informative slices and more consistent refinement when prompt labels are revised. These findings support modeling interactive 3D tumor segmentation as a sparse, iterative, and revisable visual correction process rather than as a clean-prompt segmentation task. Code is publicly available at https://github.com/HaoLi12345/interactive_segmentation .
AI snapshot
Written from the paper’s full text.
TL;DR
The paper proposes a correction-aware multi-prompt framework for interactive 3D tumor segmentation that models prompts as sparse, revisable residual corrections to an evolving mask. On MSD-Colon and KiTS21, it improves Dice over PRISM under standard and sparse-scribble protocols, with larger gains when scribbles are limited to informative slices.
Key findings
- Under the standard PRISM multi-prompt protocol, Dice increased from 93.79% to 95.43% on MSD-Colon and from 96.58% to 97.19% on KiTS21; NSD was 99.96% on MSD-Colon for both methods and 99.80% to 99.81% on KiTS21.
- In sparse-scribble evaluation at 1, 3, and 5 edited slices, Dice differences (Ours − PRISM) were +1.91, +4.23, and +4.25 on MSD-Colon and +1.12, +1.56, and +1.60 on KiTS21; dense-scribble differences were +1.69 and +0.55.
- In the synthetic cross-round prompt-revision test, final Dice differences (Ours − PRISM) at 50/100/200 relabeled voxels per round were +3.32/+3.31/+2.74 on MSD-Colon and +1.40/+1.04/+0.77 on KiTS21.
- The proposed method remained above PRISM throughout the 11 interaction rounds, and qualitative examples followed the reference contour more closely with fewer visible residual errors.
Methods
- Correction-aware multi-prompt framework built on a PRISM-style promptable 3D backbone; it accepts clicks, a 3D bounding box, scribbles, and the previous mask, and uses a refinement head to predict an error map and residual correction, plus a revision-aware prompt memory separating latest positive/negative instructions and revised locations.
- Data: MSD-Colon (126 abdominal CT volumes; 26 test cases) and KiTS21 kidney tumor (300 CT volumes; 61 test cases), using released PRISM splits and preprocessing, 128×128×128 inputs, MONAI, and 11 interaction rounds.
- Evaluation compared automatic, promptable, and interactive baselines under the standard PRISM protocol, sparse-scribble budgets of 1/3/5 edited slices, and a synthetic cross-round revision protocol; metrics were Dice and Normalized Surface Dice at 2 mm, with a single trained model and single evaluation seed.
Limitations
- Paper-stated: evaluation is limited to MSD-Colon and KiTS21; prompts are simulated from reference masks and do not measure real annotation time, prompt placement variability, or user decision-making; sparse-slice prompting and revision-aware memory are evaluated jointly without component ablations; the revision protocol is synthetic; recent foundation-model systems such as VISTA3D, nnInteractive, and MedSAM2 are not directly benchmarked; and experiments use a single split and single evaluation seed.
- Evident from the text: the sparse-scribble comparison uses a PRISM checkpoint trained with dense-scribble assumptions while the proposed model is trained with a dense/sparse mixture, so sparse results attribute performance to the full correction-aware formulation rather than isolating a single component; NSD is near saturation in several settings, limiting its sensitivity to the reported improvements.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
22 of 23 cited sources checked · 12 supported · 0 flagged · accuracy not yet measured
- Premisecitation
Different lesion appearances and annotation targets have been reported across tumor benchmarks.
“different lesion appearances and annotation targets have been reported across tumor benchmarks [3,8,23]”
Quote in the paperSubstantial claim3 of 3 sources checked- cites [3] Bilic, P., Christ, P., Li, H.B., Vorontsov, E., Ben-Cohen, A., Kaissis, G., Szeskin, A., Jacobs, C., Mamani, G.E.H., Chartrand, G., et al.: The liver tumor segmentation benchmark (LiTS). Med. Image Anal. 84, 102680 (2023). https://doi.org/10.1016/j.media.2022.102680 source
- cites [8] Heller, N., Isensee, F., Trofimova, D., Tejpaul, R., Zhao, Z., Chen, H., Wang, L., Golts, A., Khapun, D., Shats, D., et al.: The KiTS21 challenge: automatic segmentation of kidneys, renal tumors, and renal cysts in corticomedullary-phase CT. arXiv preprint arXiv:2307.01984, (2023). https://doi.org/10.48550/arXiv.2307.01984 source
- cites [23] Menze, B.H., Jakab, A., Bauer, S., Kalpathy-Cramer, J., Farahani, K., Kirby, J., Burren, Y., Porz, N., Slotboom, J., Wiest, R., et al.: The multimodal brain tumor image segmentation benchmark (BRATS). IEEE Trans. Med. Imaging 34(10), 1993–2024 (2015). https://doi.org/10.1109/TMI.2014.2377694 source
- Premisecitation
Most promptable medical segmentation methods are still developed and evaluated around clean-prompt protocols.
“Most promptable medical segmentation methods, however, are still developed and evaluated around clean-prompt protocols.”
- Also stated in: § 3.1 Overview · plain
“Many promptable segmentation protocols are built around a clean and sufficient prompt set for each image [5,17,29].”
Quote in the paperSubstantial claim3 of 3 sources checked- cites [5] Gong, S., Zhong, Y., Ma, W., Li, J., Wang, Z., Zhang, J., Heng, P.-A., Dou, Q.: 3DSAM-adapter: holistic adaptation of SAM from 2D to 3D for promptable tumor segmentation. Med. Image Anal. 98, 103324 (2024). https://doi.org/10.1016/j.media.2024.103324 source
Section 3.3 (page unavailable) says accurate prompt guidance is difficult in medical images and that a model can fail when prompts are inaccurate, supporting the concern about reliance on clean prompts. It does not establish that most promptable medical segmentation methods are developed and evaluated under clean-prompt protocols. (LLM, conf=0.75)
Experimental — accuracy not yet measured - cites [17] Li, H., Liu, H., Hu, D., Wang, J., Oguz, I.: Promise: Prompt-driven 3D medical image segmentation using pretrained image foundation models. In 2024 IEEE 21st International Symposium on Biomedical Imaging (ISBI), pages 1–5. IEEE, (2024b). https://doi.org/10.1109/ISBI56570.2024.10635207 source
The Methods > Prompt encoder section (page unavailable) contrasts ProMISe’s training with a previous method that used points from the target region, which lends limited support to the idea that some prior work used carefully placed prompts. It does not establish that most promptable medical segmentation methods were developed and evaluated under clean-prompt protocols; ProMISe itself trains with background points to improve generalizability to noisy prompts. (LLM, conf=0.76)
Experimental — accuracy not yet measured - cites [29] Wang, H., Guo, S., Ye, J., Deng, Z., Cheng, J., Li, T., Chen, J., Su, Y., Huang, Z., Shen, Y., Fu, B., Zhang, S., He, J., Qiao, Y.: SAM-Med3D: Towards general-purpose segmentation models for volumetric medical images. arXiv preprint arXiv:2310.15161, (2023). https://doi.org/10.48550/arXiv.2310.15161 source
Section 4.3 (page unavailable) evaluates SAM, SAM-Med2D, and SAM-Med3D using a point sampled from the target foreground, followed by points sampled from prediction-error regions. This supports the clean-prompt characterization of that evaluation, but the paper does not establish that most promptable medical segmentation methods are developed and evaluated under such protocols. (LLM, conf=0.83)
Experimental — accuracy not yet measured
- Also stated in: § 3.1 Overview · plain
- Premisecitation
Tumor segmentation is less stable because lesions are not tied to a fixed anatomical shape or location and may be small, heterogeneous, or weakly contrasted.
“Tumor segmentation is less stable because lesions are not tied to a fixed anatomical shape or location and may be small, heterogeneous, or weakly contrasted [3,8,23].”
Quote in the paperSubstantial claim3 of 3 sources checked- cites [3] Bilic, P., Christ, P., Li, H.B., Vorontsov, E., Ben-Cohen, A., Kaissis, G., Szeskin, A., Jacobs, C., Mamani, G.E.H., Chartrand, G., et al.: The liver tumor segmentation benchmark (LiTS). Med. Image Anal. 84, 102680 (2023). https://doi.org/10.1016/j.media.2022.102680 source
- cites [8] Heller, N., Isensee, F., Trofimova, D., Tejpaul, R., Zhao, Z., Chen, H., Wang, L., Golts, A., Khapun, D., Shats, D., et al.: The KiTS21 challenge: automatic segmentation of kidneys, renal tumors, and renal cysts in corticomedullary-phase CT. arXiv preprint arXiv:2307.01984, (2023). https://doi.org/10.48550/arXiv.2307.01984 source
Section 3.4.3 reports lower average Dice for tumor than kidney segmentation (0.8813 versus 0.9748), and Section 3.1 describes substantial variation in how teams delineated the tumor–kidney boundary. The paper does not attribute that difficulty to lesions lacking a fixed shape or location, or to their being small, heterogeneous, or weakly contrasted. (LLM, conf=0.86)
Experimental — accuracy not yet measured - cites [23] Menze, B.H., Jakab, A., Bauer, S., Kalpathy-Cramer, J., Farahani, K., Kirby, J., Burren, Y., Porz, N., Slotboom, J., Wiest, R., et al.: The multimodal brain tumor image segmentation benchmark (BRATS). IEEE Trans. Med. Imaging 34(10), 1993–2024 (2015). https://doi.org/10.1109/TMI.2014.2377694 source
- Premisecitation
Test-time performance of interactive 3D medical segmentation can vary with the placement and selection strategy of point prompts.
“Prior analysis of interactive 3D medical segmentation has shown that testtime performance can vary with the placement and selection strategy of point prompts [18].”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [18] Li, H., Liu, H., Hu, D., Wang, J., Oguz, I.: Assessing test-time variability for interactive 3D medical image segmentation with diverse point prompts. In 2024 IEEE 21st International Symposium on Biomedical Imaging (ISBI), pages 1–5. IEEE, (2024c). https://doi.org/10.1109/ISBI56570.2024.10635343 source
- Premisecitation
In annotation workflows, an interactive model can reduce the amount of slice-by-slice contouring needed to create training labels.
“In annotation workflows, an interactive model can reduce the amount of slice-by-slice contouring needed to create training labels [28,31].”
Quote in the paperSubstantial claim2 of 2 sources checked- cites [28] Wang, G., Zuluaga, M.A., Li, W., Pratt, R., Patel, P.A., Aertsen, M., Doel, T., David, A.L., Deprest, J., Ourselin, S., Vercauteren, T.: DeepIGeoS: a deep interactive geodesic framework for medical image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 41(7), 1559–1572 (2019). https://doi.org/10.1109/TPAMI.2018.2840695 source
The Introduction and Method describe an interactive model that starts with automatic segmentation and uses clicks or short scribbles to refine it, reducing manual annotation effort. They do not establish that it reduces slice-by-slice contouring specifically to create training labels; the Method instead describes using existing ground truth to train the refinement network. (LLM, conf=0.83)
Experimental — accuracy not yet measured - cites [31] Yushkevich, P.A., Piven, J., Hazlett, H.C., Smith, R.G., Ho, S., Gee, J.C., Gerig, G.: User-guided 3D active contour segmentation of anatomical structures: significantly improved efficiency and reliability. Neuroimage 31(3), 1116–1128 (2006). https://doi.org/10.1016/j.neuroimage.2006.01.015 source
- Interpretationcitation
If a voxel is labeled as foreground in one round and background in a later round, PRISM's two-map refinement input can activate both positive and negative prompt channels at that location.
“If a voxel is labeled as foreground in one round and background in a later round, PRISM's two-map refinement input can activate both positive and negative prompt channels at that location.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [16] Li, H., Liu, H., Hu, D., Wang, J., Oguz, I.: PRISM: a promptable and robust interactive segmentation model with visual prompts. In Medical Image Computing and Computer Assisted Intervention – MICCAI 2024, volume 15003 of Lecture Notes in Computer Science, pages 389–399. Springer Nature Switzerland, (2024a). https://doi.org/10.1007/978-3-031-72384-1_37 source
- Findingreasoning
The method improves performance under prompt protocols that better reflect practical 3D annotation.
“Instead of relying on dense volume-wide scribbles, the method generates corrections from residual error and retains sparse scribbles on informative slices, improving performance under prompt protocols that better reflect practical 3D annotation.”
Quote in the paperSubstantial claim - Findingnone given
Sparse and residual-error refinement improves performance under practical sparse-prompt settings.
“In particular, sparse and residual-error refinement improves performance under practical sparseprompt settings.”
Quote in the paperSubstantial claim - Findingown data
The Dice difference between the proposed method and PRISM is larger when scribbles are sparse.
“The Dice difference is larger when scribbles are sparse.”
- Also stated in: § 7 Conclusion · plain
“shows larger differences when scribble input is restricted to a small number of informative slices”
Quote in the paperSubstantial claim - Also stated in: § 7 Conclusion · plain
- Findingown data
The case-wise scatter plots indicate that the difference is not driven only by a few outlying volumes: many volumes lie above the equal-performance line under sparse budgets.
“The case-wise scatter plots indicate that the difference is not driven only by a few outlying volumes: Many volumes lie above the equalperformance line under sparse budgets.”
Quote in the paperSubstantial claim - Findingown data
Table 3 shows that the proposed method achieves higher final Dice than PRISM at all tested revision levels on both MSD-Colon and KiTS21.
“The proposed method achieves higher final Dice than PRISM at all tested revision levels on both datasets.”
Quote in the paperSubstantial claim - Findingown data
On MSD-Colon, the difference between the proposed method and PRISM is larger with three or five edited slices than under dense scribbles.
“On MSD-Colon, the difference is larger with three or five edited slices than under dense scribbles.”
Quote in the paperSubstantial claim - Premisereasoning
Cross-round corrections can create ambiguous prompt histories that are not explicitly represented in existing interactive models.
“If the model accumulates positive and negative prompts without explicitly representing such revisions, the refinement module can receive an ambiguous refinement input.”
Quote in the paperSubstantial claim- Rests on an assumption: In multi-round interaction, prompts are not independent.
- Rests on an assumption: A later prompt may clarify, refine, or contradict an earlier instruction.
- Rests on an assumption: In a multi-round interaction, the prompt history can be revised.
- Rests on an assumption: A voxel marked as foreground in an early round may later be marked as background after the user sees an over-segmentation, or the reverse may occur for a missed tumor region.
- Premisenone given
A simple alternative to thin scribbles with a fixed geometric rule, such as using every k-th slice, ignores where the current prediction is wrong.
“A simple alternative is to thin scribbles with a fixed geometric rule, such as using every k-th slice, but this ignores where the current prediction is wrong.”
Quote in the paperSubstantial claim - Interpretationown data
These findings support modeling interactive 3D tumor segmentation as a sparse, iterative, and revisable visual correction process rather than as a clean-prompt segmentation task.
“These findings support modeling interactive 3D tumor segmentation as a sparse, iterative, and revisable visual correction process rather than as a clean-prompt segmentation task.”
Quote in the paperSubstantial claim - Interpretationown data
The analysis supports the role of revision-aware memory as a defined prompt-history representation under cross-round prompt changes.
“Together with Table 3, this analysis supports the role of revision-aware memory as a defined prompt-history representation under cross-round prompt changes.”
Quote in the paperSubstantial claim - Interpretationown data
The results suggest that interactive 3D tumor segmentation is better evaluated as a sparse and revisable refinement process than as a clean-prompt segmentation task.
“The results suggest that interactive 3D tumor segmentation is better evaluated as a sparse and revisable refinement process than as a cleanprompt segmentation task.”
Quote in the paperSubstantial claim- Rests on an assumption: Practical 3D editing is unlikely to provide dense scribbles throughout the volume.
- Interpretationown data
The results support modeling interactive 3D tumor segmentation as a correction-aware process rather than as clean-prompt conditioning.
“The results support modeling interactive 3D tumor segmentation as a correction-aware process rather than as cleanprompt conditioning.”
Quote in the paperSubstantial claim- Rests on an assumption: Practical 3D editing is unlikely to provide dense scribbles throughout the volume.
- Interpretationown data
The case-wise view is consistent with the aggregate conclusion from Table 2: sparse prompts are where the proposed interaction modeling yields the largest observed difference.
“This case-wise view is consistent with the aggregate conclusion from Table 2: sparse prompts are where the proposed interaction modeling yields the largest observed difference.”
Quote in the paperNot a substantial claim - Premisereasoning
A mask can remain within a surface tolerance while still missing or over-including a task-relevant amount of tumor.
“A mask can remain within a surface tolerance while still missing or over-including a task-relevant amount of tumor.”
Quote in the paperSubstantial claim - Study design and conductnone given
The evaluation is limited to MSD-Colon and KiTS21 kidney tumor.
“First, the evaluation is limited to MSD-Colon and KiTS21 kidney tumor.”
Quote in the paperNot a substantial claim
- May combine two claims. 43
- Classified as probably not a substantial claim. 17
- The quote only partly states this claim. 1
May combine two claims.
PremisecitationMSD-Colon contains 126 abdominal CT volumes with colon tumor annotations, and KiTS21 contains 300 CT volumes with kidney tumor annotations.
“MSD-Colon contains 126 abdominal CT volumes with colon tumor annotations, and KiTS21 contains 300 CT volumes with kidney tumor annotations.”
Quote in the paperSubstantial claim2 of 2 sources checked- cites [2] Antonelli, M., Reinke, A., Bakas, S., Farahani, K., Kopp-Schneider, A., Landman, B.A., Litjens, G., Menze, B., Ronneberger, O., Summers, R.M., et al.: The medical segmentation decathlon. Nat. Commun. 13, 4128 (2022). https://doi.org/10.1038/s41467-022-30695-9 source
Table 2 (Methods, The Decathlon mission; page unavailable) lists the Colon task as 190 CT volumes targeting colon cancer primaries, split into 126 training and 64 test volumes. Thus 126 is not the total stated in the claim. The paper’s dataset summary does not address KiTS21 or its claimed 300 kidney-tumor CT volumes. (LLM, conf=0.90)
Experimental — accuracy not yet measured - cites [8] Heller, N., Isensee, F., Trofimova, D., Tejpaul, R., Zhao, Z., Chen, H., Wang, L., Golts, A., Khapun, D., Shats, D., et al.: The KiTS21 challenge: automatic segmentation of kidneys, renal tumors, and renal cysts in corticomedullary-phase CT. arXiv preprint arXiv:2307.01984, (2023). https://doi.org/10.48550/arXiv.2307.01984 source
Section 2.1.1 (page unavailable) identifies 300 CT cases for the KiTS21 training set, supporting the kidney-tumor portion of the claim. Section 2.1.2 (page unavailable) describes a separate 100-case test set, so 300 is not the full KiTS21 dataset. The paper does not address the claimed 126 MSD-Colon volumes or their annotations. (LLM, conf=0.90)
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Premisecitation3DSAM-Adapter and SAM-Med3D adapt SAM-style prompting to 3D medical images, while ProMISe is a prompt-driven 3D medical segmentation method based on pretrained image foundation models.
“3DSAM-Adapter [5] and SAM-Med3D [29] adapt SAM-style prompting to 3D medical images, while ProMISe [17] is a prompt-driven 3D medical segmenta-tion method based on pretrained image foundation models.”
Quote in the paperNot a substantial claim3 of 3 sources checked- cites [5] Gong, S., Zhong, Y., Ma, W., Li, J., Wang, Z., Zhang, J., Heng, P.-A., Dou, Q.: 3DSAM-adapter: holistic adaptation of SAM from 2D to 3D for promptable tumor segmentation. Med. Image Anal. 98, 103324 (2024). https://doi.org/10.1016/j.media.2024.103324 source
- cites [29] Wang, H., Guo, S., Ye, J., Deng, Z., Cheng, J., Li, T., Chen, J., Su, Y., Huang, Z., Shen, Y., Fu, B., Zhang, S., He, J., Qiao, Y.: SAM-Med3D: Towards general-purpose segmentation models for volumetric medical images. arXiv preprint arXiv:2310.15161, (2023). https://doi.org/10.48550/arXiv.2310.15161 source
- cites [17] Li, H., Liu, H., Hu, D., Wang, J., Oguz, I.: Promise: Prompt-driven 3D medical image segmentation using pretrained image foundation models. In 2024 IEEE 21st International Symposium on Biomedical Imaging (ISBI), pages 1–5. IEEE, (2024b). https://doi.org/10.1109/ISBI56570.2024.10635207 source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationnnU-Net is a widely used reference baseline for medical image segmentation because of its self-configuring training and preprocessing pipeline.
“nnU-Net is a widely used reference baseline for medical image segmentation because of its self-configuring training and preprocessing pipeline.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [9] Isensee, F., Jaeger, P.F., Kohl, S.A.A., Petersen, J., Maier-Hein, K.H.: nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation. Nat. Methods 18(2), 203–211 (2021). https://doi.org/10.1038/s41592-020-01008-z source
The Discussion (pp. 10–12) describes nnU-Net as a standardized baseline for comparing methods, and the Introduction (p. 2) explains how it automatically configures its pipeline. These passages support its suitability as a reference baseline, but they do not establish that it was already widely used as one. (LLM, conf=0.86)
Experimental — accuracy not yet measured
May combine two claims.
Study design and conductcitationTo make the comparison with PRISM controlled, we use the released PRISM data splits without resampling the train/test partition, resulting in 26 test cases for MSD-Colon and 61 test cases for KiTS21.
“To make the comparison with PRISM [16] controlled, we use the released PRISM data splits without resampling the train/test partition, resulting in 26 test cases for MSD-Colon and 61 test cases for KiTS21.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [16] Li, H., Liu, H., Hu, D., Wang, J., Oguz, I.: PRISM: a promptable and robust interactive segmentation model with visual prompts. In Medical Image Computing and Computer Assisted Intervention – MICCAI 2024, volume 15003 of Lecture Notes in Computer Science, pages 389–399. Springer Nature Switzerland, (2024a). https://doi.org/10.1007/978-3-031-72384-1_37 source
The Experiments > Datasets passage says PRISM used colon and kidney datasets with 126 and 300 cases, respectively, and adopted a 70/10/20 training/validation/testing split from a prior study. It does not give the exact test counts of 26 and 61 or state that those partitions were released; the citing authors’ decision not to resample is their own procedure. (LLM, conf=0.82)
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Premisecitation3D UX-Net and Swin-UNETR represent recent high-capacity 3D architectures based on convolutional and transformer-style volumetric modeling.
“3D UX-Net and Swin-UNETR represent recent high-capacity 3D architectures based on convolutional and transformer-style volumetric modeling.”
Quote in the paperNot a substantial claim1 of 2 sources checked- cites [13] Lee, H.H., Bao, S., Huo, Y., Landman, B.A.: 3D UX-Net: a large kernel volumetric convnet modernizing hierarchical transformer for medical image segmentation. In The Eleventh International Conference on Learning Representations, (2023). https://openreview.net/forum?id=wsZsjOSytRA source
Checked before — its earlier verdict is held back until a new check runs.
- cites [27] Tang, Y., Yang, D., Li, W., Roth, H.R., Landman, B., Xu, D., Nath, V., Hatamizadeh, A.: Self-supervised pre-training of swin transformers for 3D medical image analysis. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 20730–20740, (2022). https://doi.org/10.1109/CVPR52688.2022.02007 source
Section 3, “Swin UNETR” (page not provided), describes a Swin Transformer encoder using 3D patches and a CNN-based decoder; the Models table lists 61.98 million parameters, supporting the description of Swin UNETR as a high-capacity volumetric architecture. The copy does not identify or describe 3D UX-Net as the convolutional counterpart (searched: “3D UX-Net” and “convolutional architectures high capacity 3D UX-Net”). (LLM, conf=0.88)
Experimental — accuracy not yet measured
May combine two claims.
PremisecitationPRISM combines clicks, 3D bounding boxes, and scribbles with an iterative refinement head, making it a closely matched baseline for interactive 3D tumor segmentation.
“PRISM [16] combines clicks, 3D bounding boxes, and scribbles with an iterative refinement head, making it a closely matched baseline for interactive 3D tumor segmentation.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [16] Li, H., Liu, H., Hu, D., Wang, J., Oguz, I.: PRISM: a promptable and robust interactive segmentation model with visual prompts. In Medical Image Computing and Computer Assisted Intervention – MICCAI 2024, volume 15003 of Lecture Notes in Computer Science, pages 389–399. Springer Nature Switzerland, (2024a). https://doi.org/10.1007/978-3-031-72384-1_37 source
May combine two claims.
Findingown dataOn MSD-Colon, the difference between the proposed method and PRISM appears from the early rounds and persists to the final prediction.
“On MSD-Colon, the difference appears from the early rounds and persists to the final prediction.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataQualitative examples in Fig. 5 show that PRISM can leave residual boundary errors or produce small changes in the edited region across later rounds, while the proposed method follows the reference contour more closely and reaches a stable mask with fewer visible residual errors.
“PRISM can leave residual boundary errors or produce small changes in the edited region across later rounds.The proposed method follows the reference contour more closely in these examples and reaches a stable mask with fewer visible residual errors.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataTable 2 shows that the proposed method obtains higher Dice than PRISM at every tested prompt budget on both MSD-Colon and KiTS21.
“Table 2 shows that the proposed method obtains higher Dice than PRISM at every tested prompt budget on both datasets.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataBoth PRISM and the proposed method improve as additional prompts are provided, but the proposed method remains above PRISM throughout the 11-round refinement sequence.
“Both PRISM and the proposed method improve as additional prompts are provided, but the proposed method remains above PRISM throughout the refinement sequence.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe proposed method achieves higher segmentation accuracy across prompt settings, with larger differences when scribbles are limited to sparse informative slices and more consistent refinement when prompt labels are revised.
“The proposed method achieves higher segmentation accuracy across prompt settings, with larger differences when scribbles are limited to sparse informative slices and more consistent refinement when prompt labels are revised.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataUnder the standard multi-prompt protocol, NSD changes little: 99.96% on MSD-Colon for both methods and 99.80% to 99.81% on KiTS21.
“NSD is already close to saturation under the standard pro-tocol and changes little: 99.96% on MSD-Colon for both methods and 99.80% to 99.81% on KiTS21.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataOn KiTS21, the two curves are closer because the final Dice is already high for both methods, but the proposed method remains consistently higher.
“On KiTS21, the two curves are closer because the final Dice is already high for both methods, but the proposed method remains consistently higher.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataUnder the standard multi-prompt protocol, the proposed method increases Dice from 93.79% to 95.43% on MSD-Colon and from 96.58% to 97.19% on KiTS21 kidney tumor.
“Under the same multi-prompt setting, the proposed method increases Dice from 93.79% to 95.43% on MSD-Colon and from 96.58% to 97.19% on KiTS21 kidney tumor.”
- Also stated in: § 7 Conclusion · plain
“On MSD-Colon and KiTS21 kidney tumor, the framework improves Dice over PRISM under the standard multi-prompt protocol”
Quote in the paperSubstantial claim- Also stated in: § 7 Conclusion · plain
May combine two claims.
Findingown dataNSD changes less systematically across budgets because it is already high for both methods, especially on KiTS21.
“NSD changes less systematically across budgets because it is already high for both methods, especially on KiTS21.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataOn MSD-Colon, most per-volume points lie above the diagonal with one, three, and five edited slices, with the clearest separation at the three- and five-slice budgets; under the dense-scribble protocol, the gap is smaller but the points remain largely on or above the diagonal.
“On MSD-Colon, most points lie above the diagonal with one, three, and five edited slices, with the clearest separation at the three-and five-slice budgets.Under the dense-scribble protocol, the gap is smaller but the points remain largely on or above the diagonal.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe qualitative example shows a revision sequence in which this representation yields a smoother refinement trajectory, while the synthetic revision table shows higher final Dice under several levels of cross-round relabeling.
“The qualitative example shows a revision sequence in which this representation yields a smoother refinement trajectory, while the synthetic revision table shows higher final Dice under several levels of cross-round relabeling.”
Quote in the paperSubstantial claimMay combine two claims.
FindingreasoningThe difference in final Dice is larger on MSD-Colon and becomes smaller as more prompt voxels are revised.
“The difference is larger on MSD-Colon and becomes smaller as more prompt voxels are revised, indicating that heavier synthetic revision creates a more challenging prompt-history configuration.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataOn KiTS21, the points are more tightly clustered near the diagonal because both methods already obtain high Dice; even in this saturated regime, the sparse-budget panels show an upward shift for the proposed method, while the dense protocol shows only a modest difference.
“On KiTS21, the points are more tightly clustered near the diagonal because both methods already obtain high Dice.Even in this saturated regime, the sparse-budget panels show an upward shift for the proposed method, while the dense protocol shows only a modest difference.”
Quote in the paperSubstantial claimMay combine two claims.
FindingreasoningThe effect is smaller on KiTS21, where both methods already operate in a high-Dice regime, but the same direction is observed across prompt budgets.
“The effect is smaller on KiTS21, where both methods already operate in a high-Dice regime, but the same direction is observed across prompt budgets.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataWith only one edited slice, both methods operate under a severe correction budget, and the difference is correspondingly smaller.
“With only one edited slice, both methods operate under a severe correction budget, and the difference is correspondingly smaller.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe proposed method more closely follows the reference contour over the refinement sequence, while PRISM retains residual boundary errors or changes near the lesion boundary across later rounds.
“The proposed examples show how the iterative curves in Fig. 4 appear visually: the proposed method more closely follows the reference contour over the refinement sequence, while PRISM retains residual boundary errors or changes near the lesion boundary across later rounds”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataFigure 6 shows that with three or five edited slices, the proposed method separates from PRISM as refinement proceeds; with one edited slice, the curves are closer in the early rounds, but the final Dice remains higher for the proposed method.
“With three or five edited slices, the proposed method separates from PRISM as refinement proceeds.With one edited slice, the curves are closer in the early rounds, but the final Dice remains higher for the proposed method.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataIn a revision sequence under sparse scribbles, PRISM exhibits a non-monotone Dice trajectory, whereas the proposed method changes more smoothly and ends with higher Dice.
“When prompt labels are revised across rounds, PRISM exhibits a non-monotone Dice trajectory, whereas the proposed method changes more smoothly and ends with higher Dice in this sequence.”
Quote in the paperSubstantial claimMay combine two claims.
FindingreasoningOn KiTS21, the corresponding differences are smaller because the baseline is already strong, but the same trend is preserved.
“On KiTS21, the corresponding differences are smaller because the baseline is already strong, but the same trend is preserved.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenThe revision analysis is synthetic and is used to examine the prompt-memory representation, not to claim that the model is insensitive to arbitrary wrong prompts.
“The revision analysis is synthetic and is used to examine the prompt-memory representation, not to claim that the model is insensitive to arbitrary wrong prompts.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.
Premisenone givenRandomizing the orientation prevents the model from depending on a single anatomical view: Compact and elongated tumors may be easier to correct from different planes.
“Randomizing the orientation prevents the model from depending on a single anatomical view: Compact and elongated tumors may be easier to correct from different planes.”
Quote in the paperNot a substantial claim- Rests on an assumption: Tumor segmentation errors are often local, heterogeneous, and not well described by a single global object prior.
May combine two claims.
PremisereasoningCommon two-map memories accumulate foreground and background prompts separately; when a voxel is later relabeled, this creates an ambiguous input in which the same location can be active in both maps.
“Common two-map memories accumulate foreground and background prompts separately; when a voxel is later relabeled, this creates a ambiguous input in which the same location can be active in both maps.”
Quote in the paperSubstantial claim- Rests on an assumption: In a multi-round interaction, the prompt history can be revised.
- Rests on an assumption: A voxel marked as foreground in an early round may later be marked as background after the user sees an over-segmentation, or the reverse may occur for a missed tumor region.
Probably not a substantial claim: may not pass S4 (based). May combine two claims.
Premisenone givenDense-scribble protocols can tightly constrain a 3D mask, but they assume more user input than is available in many annotation-oriented editing sessions.
“Dense-scribble protocols can tightly constrain a 3D mask, but they assume more user input than is available in many annotation-oriented editing sessions.”
Quote in the paperNot a substantial claim- Rests on an assumption: In practical correction, prompts are often sparse because only a few slices contain the most informative errors.
- Rests on an assumption: In a practical 3D editing session, the user is more likely to correct selected slices where the model is visibly wrong than to annotate the entire volume densely.
May combine two claims.
Interpretationown dataUnder dense multi-prompt interaction, the main measurable difference between the proposed method and PRISM is in volumetric overlap; the surface-tolerance metric is already near ceiling for both interactive methods.
“Thus, under dense multi-prompt interaction, the main measurable difference is in volumetric overlap; the surface-tolerance metric is already near ceiling for both interactive methods.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningThese methods provide a reference for how far fully automatic segmentation can go without user correction.
“These methods provide a reference for how far fully automatic segmentation can go without user correction.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
InterpretationreasoningThese baselines are relevant because they test whether general or medical promptable models can handle challenging 3D tumor segmentation under point-based interaction.
“These baselines are relevant because they test whether general or medical promptable models can handle challenging 3D tumor segmentation under point-based interaction.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningFor much longer editing sessions, C t could become saturated if many locations are repeatedly revised.
“For much longer editing sessions, however, C t could become saturated if many locations are repeatedly revised.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningThis motivates interactive refinement rather than replacing automatic segmentation entirely.
“This motivates interactive refinement rather than replacing automatic segmentation entirely: The initial prediction can be useful, but the user needs an efficient way to correct the cases where it fails.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Study design and conductreasoningThis keeps the experimental comparison focused on the interaction modeling changes rather than on preprocessing or data-split differences.
“This keeps the experimental comparison focused on the interaction modeling changes rather than on preprocessing or data-split differences.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningIn this setting, the observed differences reflect the value of sparse residual-error prompting and revision-aware prompt-history modeling.
“In this setting, the observed differences reflect the value of sparse residual-error prompting and revision-aware prompt-history modeling.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductreasoningThe sparse-slice prompt distribution and revision-aware memory are evaluated as a joint framework; isolating their individual contributions would require additional retraining and ablation experiments.
“Third, the sparse-slice prompt distribution and revision-aware memory are evaluated as a joint framework.Isolating their individual contributions would require additional retraining and ablation experiments.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningDense scribbles strongly constrain the mask and can reduce the need for learned correction behavior; sparse scribbles leave larger parts of the volume unconstrained and require the model to propagate limited user input through the 3D prediction.
“Dense scribbles strongly constrain the mask and can reduce the need for learned correction behavior.Sparse scribbles, in contrast, leave larger parts of the volume unconstrained and require the model to propagate limited user input through the 3D prediction.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningRanking residual-error slices and training with sparse informative scribbles expose the model to the sparse regime.
“Ranking residual-error slices and training with sparse informative scribbles expose the model to this regime.”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductreasoningPrompts are simulated from reference masks; this does not measure real annotation time, prompt placement variability, or user decision-making.
“Second, prompts are simulated from reference masks.This is standard for interactive segmentation benchmarking, but it does not measure real annotation time, prompt placement variability, or user decision-making.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenThe prompt-revision protocol is synthetic; it illustrates a refinement-input failure mode, but it is not a complete model of routine annotation-oriented editing.
“Fourth, the prompt-revision protocol is synthetic; it illustrates a refinement-input failure mode, but it is not a complete model of routine annotation-oriented editing.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataNSD is close to saturation in several settings, particularly for KiTS21, while Dice still changes with the prompt budget; this indicates that the observed improvements are mainly reflected in volumetric overlap and residual tumor volume rather than in large changes to the surface-tolerance metric.
“In several settings, NSD is close to saturation, particularly for KiTS21, while Dice still changes with the prompt budget.This indicates that the observed improvements are mainly reflected in volumetric overlap and residual tumor volume rather than in large changes to the surface-tolerance metric.”
Quote in the paperSubstantial claimMay combine two claims. The quote only partly states this claim.
Interpretationown dataThe improvement of the proposed method over PRISM is consistent but modest under the standard dense multi-prompt protocol, and increases when scribbles are restricted to a small number of informative slices, especially on MSD-Colon.
“When scribbles are restricted to a small number of informative slices, the difference increases, especially on MSD-Colon.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
InterpretationreasoningThis choice means that the sparse-scribble results attribute performance to the complete correction-aware formulation rather than isolating a single component.
“This choice reflects the intended deployment regime of the proposed framework, and it also means that the sparse-scribble results attribute performance to the complete correction-aware formulation rather than isolating a single component.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningThe proposed memory keeps the latest positive and negative instructions as the active instructions and records revised locations in a separate channel.
“The proposed memory keeps the latest positive and negative instructions as the active instructions and records revised locations in a separate channel.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataThe model can use a small number of informative 2D corrections without requiring dense volume-wide scribbles.
“Together with Table 2, these results indicate that the model can use a small number of informative 2D corrections without requiring dense volume-wide scribbles.”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductnone givenPRISM is evaluated under the same sparse test-time slice budgets, but its released checkpoint was trained with dense scribble assumptions, whereas the proposed model is trained with a mixture of dense and sparse informative-slice prompts.
“PRISM is evaluated under the same sparse test-time slice budgets, but its released checkpoint was trained with dense scribble assumptions, whereas the proposed model is trained with a mixture of dense and sparse informative-slice prompts.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenThe experiments use a single split and a single evaluation seed.
“Finally, the experiments use a single split and a single evaluation seed.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningThe proposed sparse-prompt modeling and latest-write memory are not tied to a specific decoder in principle; they operate on prompt coordinates, the previous mask, and the refinement input.
“The proposed sparse-prompt modeling and latest-write memory are not tied to a specific decoder in principle; they operate on prompt coordinates, the previous mask, and the refinement input.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Study design and conductnone givenThe implementation keeps the promptable backbone, prompt family, data splits, and simulation protocol as close as possible to PRISM so that the prompt process becomes the main variable under study.
“The implementation keeps the promptable backbone, prompt family, data splits, and simulation protocol as close as possible to PRISM so that the prompt process becomes the main variable under study.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationreasoningThey could therefore be incorporated into other promptable 3D segmentation systems, although this paper evaluates them within a PRISM-compatible implementation to keep the comparison controlled.
“They could therefore be incorporated into other promptable 3D segmentation systems, although this paper evaluates them within a PRISM-compatible implementation to keep the comparison controlled.”
Quote in the paperNot a substantial claim
The paper relies on this without support.
In practical correction, users may combine clicks, boxes, and scribbles.
“Users may combine clicks, boxes, and scribbles; prompts are often sparse because only a few slices contain the most informative errors; and earlier prompts may be revised after the prediction has been inspected.”
The paper relies on this without support.
In practical correction, prompts are often sparse because only a few slices contain the most informative errors.
“Users may combine clicks, boxes, and scribbles; prompts are often sparse because only a few slices contain the most informative errors; and earlier prompts may be revised after the prediction has been inspected.”
The paper relies on this without support.
In practical correction, earlier prompts may be revised after the prediction has been inspected.
“Users may combine clicks, boxes, and scribbles; prompts are often sparse because only a few slices contain the most informative errors; and earlier prompts may be revised after the prediction has been inspected.”
The paper relies on this without support.
Dense scribbles through every lesion-containing slice increase user burden.
“Dense scribbles through every lesion-containing slice can provide strong supervision, but they also increase user burden.”
The paper relies on this without support.
In a practical 3D editing session, the user is more likely to correct selected slices where the model is visibly wrong than to annotate the entire volume densely.
“In a practical 3D editing session, the user is more likely to correct selected slices where the model is visibly wrong than to annotate the entire volume densely.”
The paper relies on this without support.
In multi-round interaction, prompts are not independent.
“Multi-round interaction means that prompts are not independent.”
The paper relies on this without support.
A later prompt may clarify, refine, or contradict an earlier instruction.
“A later prompt may clarify, refine, or contradict an earlier instruction.”
The paper relies on this without support.
Users tend to edit selected slices where the prediction visibly fails, rather than drawing dense scribbles throughout the volume.
“Users tend to edit selected slices where the prediction visibly fails, rather than drawing dense scribbles throughout the volume.”
The paper relies on this without support.
Prompt history can contain cross-round revisions, such as changing a previous foreground instruction to background after inspecting an updated mask.
“In addition, prompt history can contain cross-round revisions, such as changing a previous foreground instruction to background after inspecting an updated mask.”
The paper relies on this without support.
Tumor segmentation errors are often local, heterogeneous, and not well described by a single global object prior.
“This is useful for tumors, where errors are often local, heterogeneous, and not well described by a single global object prior (Fig. 3a).”
The paper relies on this without support.
A user may correct only a few informative slices, and a later correction can revise an earlier prompt after the segmentation is updated.
“A user may correct only a few informative slices, and a later correction can revise an earlier prompt after the segmentation is updated.”
The paper relies on this without support.
In a multi-round interaction, the prompt history can be revised.
“In a multi-round interaction, the prompt history can be revised.”
The paper relies on this without support.
A voxel marked as foreground in an early round may later be marked as background after the user sees an over-segmentation, or the reverse may occur for a missed tumor region.
“A voxel marked as foreground in an early round may later be marked as background after the user sees an over-segmentation, or the reverse may occur for a missed tumor region.”
The paper relies on this without support.
Practical 3D editing is unlikely to provide dense scribbles throughout the volume.
“This pattern supports the central motivation of the method: An interactive tumor segmentation model should use sparse corrections effectively, because practical 3D editing is unlikely to provide dense scribbles throughout the volume.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
PRISM dense-protocol results differ between tables
MinorTable 1 gives PRISM Dice of 93.79% on MSD-Colon and 96.58% on KiTS21; the dense row of Table 2 gives 93.74% and 96.64% for the stated standard PRISM protocol. The tables do not explain why the same baseline setting has different results.
“| Interactive | PRISM [16] | 1 point + box + scribbles | 93.79 | 99.96 | 96.58 | 99.80 |”
“| dense | 93.74 | 99.96 | 95.43 | 99.96 | +1.69 | 96.64 | 99.81 | 97.19 | 99.81 | +0.55 |”
Cites
Kirillov, A., Mintun, E., Ravi, N., Mao, H., Rolland, C., Gustafson, L., Xiao, T., Whitehead, S., Berg, A. C., Lo, W.-Y., et al. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00371 · Cited by 11,953 · cited 3× · see citing works
“Starting from point-and box-based prompting in SAM [12], recent medical systems extend promptable segmentation to 2D and 3D medical images, including volumetric tumor segmentation [5, 7, 10, 16, 17, 21, 22, 29].”
nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation
Isensee, F., Jaeger, P. F., Kohl, S. A. A., Petersen, J., & Maier-Hein, K. H. (2021) · Nature Methods · doi:10.1038/s41592-020-01008-z · Cited by 10,477 · see citing works
Yushkevich, P. A., Piven, J., Hazlett, H. C., Smith, R. G., Ho, S., Gee, J. C., & Gerig, G. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.01.015 · Cited by 8,868 · see citing works
The multimodal brain tumor image segmentation benchmark (BRATS)
Menze, B. H., Jakab, A., Bauer, S., Kalpathy-Cramer, J., Farahani, K., Kirby, J., Burren, Y., Porz, N., Slotboom, J., Wiest, R., et al. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2014.2377694 · Cited by 6,781 · see citing works
GrabCut: Interactive foreground extraction using iterated graph cuts
Rother, C., Kolmogorov, V., & Blake, A. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015720 · Cited by 5,703 · see citing works
Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach
Aerts, H. J. W. L., Velazquez, E. R., Leijenaar, R. T. H., Parmar, C., Grossmann, P., Carvalho, S., Bussink, J., Monshouwer, R., Haibe-Kains, B., Rietveld, D., et al. (2014) · Nature Communications · doi:10.1038/ncomms5006 · Cited by 5,132 · cited 2× · see citing works
“Fully automatic segmentation remains the dominant formulation for many medical image analysis tasks, including quantitative imaging and tumor response assessment [1, 11].”
Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images
Boykov, Y. Y., & Jolly, M.-P. (2002) · Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001 · doi:10.1109/iccv.2001.937505 · Cited by 3,674 · cited 3× · see citing works
“Instead of requiring the model to produce an acceptable mask in a single pass, the user can guide the model with simple prompts and correct remaining errors after seeing the prediction [4, 28].”
Segment anything in medical images
Ma, J., He, Y., Li, F., Han, L., You, C., & Wang, B. (2024) · Nature Communications · doi:10.1038/s41467-024-44824-z · Cited by 2,913 · cited 2× · see citing works
“MedSAM [21] and MedSAM2 [22] adapt the SAM-style interface to medical images and videos, often operating with 2D or slice-wise prompts.”
The Liver Tumor Segmentation Benchmark (LiTS)
Bilic, P., Christ, P., Li, H. B., Vorontsov, E., Ben-Cohen, A., Kaissis, G., Szeskin, A., Jacobs, C., Mamani, G. E. H., Chartrand, G., et al. (2023) · Medical Image Analysis · doi:10.1016/j.media.2022.102680 · Cited by 1,412 · see citing works
Self-citationThe Medical Segmentation Decathlon
Antonelli, M., Reinke, A., Bakas, S., Farahani, K., Kopp-Schneider, A., Landman, B. A., Litjens, G., Menze, B., Ronneberger, O., Summers, R. M., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-30695-9 · Cited by 1,384 · cited 2× · see citing works
“Public datasets and challenges have supported systematic comparison across organs and tumors, including the Medical Segmentation Decathlon [2] and KiTS21 [8].”
Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysis
Tang, Y., Yang, D., Li, W., Roth, H. R., Landman, B., Xu, D., Nath, V., & Hatamizadeh, A. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.02007 · Cited by 849 · cited 2× · see citing works
“Strong automatic baselines, including convolutional and transformer-based 3D networks, can produce accurate masks for many anatomical structures [9, 13, 27].”
DeepIGeoS: A Deep Interactive Geodesic Framework for Medical Image Segmentation
Wang, G., Zuluaga, M. A., Li, W., Pratt, R., Patel, P. A., Aertsen, M., Doel, T., David, A. L., Deprest, J., Ourselin, S., et al. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2840695 · Cited by 502 · cited 3× · see citing works
“In medical imaging, several promptable systems move beyond single-prompt segmentation and use iterative refinement to correct an initial model prediction [28, 31].”
Deep Interactive Object Selection
Xu, N., Price, B., Cohen, S., Yang, J., & Huang, T. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.47 · Cited by 460 · cited 1× · see citing works
“Deep interactive object selection introduced click-based distance maps as network inputs [30], while later meth-ods improved iterative refinement by feeding the previous mask back to the network and by designing interaction-aware training protocols [26].”
Kickingereder, P., Isensee, F., Tursunova, I., Petersen, J., Neuberger, U., Bonekamp, D., Brugnara, G., Schell, M., Keßler, T., Foltyn‐Dumitru, M., et al. (2019) · The Lancet Oncology · doi:10.1016/s1470-2045(19)30098-1 · Cited by 459 · cited 1× · see citing works
“Fully automatic segmentation remains the dominant formulation for many medical image analysis tasks, including quantitative imaging and tumor response assessment [1, 11].”
Tumor-Cut: Segmentation of Brain Tumors on Contrast Enhanced MR Images for Radiosurgery Applications
Hamamci, A., Kucuk, N., Karaman, K., Engin, K., & Unal, G. (2012) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2011.2181857 · Cited by 286 · cited 1× · see citing works
“…with morphological thinning, multiplying the skeleton by a random smooth noise mask to create disconnected strokes, applying an elastic warp with smoothing sampled from [ 4 , 16 ] and magnitude sampled from [ 1 , 6 ] , and masking the warped strokes back into the corresponding residual region.”
Reviving Iterative Training with Mask Guidance for Interactive Segmentation
Sofiiuk, K., Petrov, I. A., & Konushin, A. (2022) · Proceedings - International Conference on Image Processing · doi:10.1109/icip46576.2022.9897365 · Cited by 264 · cited 1× · see citing works
“Deep interactive object selection introduced click-based distance maps as network inputs [30], while later meth-ods improved iterative refinement by feeding the previous mask back to the network and by designing interaction-aware training protocols [26].”
Interactive Image Segmentation With First Click Attention
Zheng, L. L., Zhang, Z., Chen, L.-Z., et al. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01335 · Cited by 194 · see citing works
SAM-Med3D: Towards General-Purpose Segmentation Models for Volumetric Medical Images
Wang, H., Guo, S., Jin, Y., Deng, Z., Cheng, J., Li, T., Chen, J., Su, Y., Huang, Z., Shen, Y., et al. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-91721-9_4 · Cited by 173 · cited 4× · see citing works
“3DSAM-Adapter [5] and SAM-Med3D [29] move the promptable formulation into volumetric medical images.”
InfluentialMONAI: Medical Open Network for AI
Ma, N., Li, W., Brown, R., et al. (2020) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.4323058 · Cited by 166 · see citing works
3DSAM-adapter: Holistic adaptation of SAM from 2D to 3D for promptable tumor segmentation
Gong, S., Zhong, Y., Ma, W., Li, J., Wang, Z., Zhang, J., Heng, P.-A., & Dou, Q. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103324 · Cited by 156 · cited 4× · see citing works
“3DSAM-Adapter [5] and SAM-Med3D [29] move the promptable formulation into volumetric medical images.”
InfluentialSimpleClick: Interactive Image Segmentation with Simple Vision Transformers
Liu, Q., Xu, Z., Bertasius, G., & Niethammer, M. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02037 · Cited by 143 · cited 1× · see citing works
“First-click attention and SimpleClick further study how user clicks should be represented inside modern visual backbones [19, 20].”
SAM-Med3D: Towards General-purpose Segmentation Models for Volumetric Medical Images
Wang, H., Guo, S., Ye, J., Deng, Z., Cheng, J., Li, T., Chen, J., Su, Y., Huang, Z., Shen, Y., et al. (2023) · arXiv · doi:10.48550/arxiv.2310.15161 · Cited by 115
VISTA3D: A Unified Segmentation Foundation Model For 3D Medical Imaging
He, Y., Guo, P., Tang, Y., Myronenko, A., Nath, V., Xu, Z., Yang, D. F., Zhao, C., Simon, B., Belue, M. J., et al. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01943 · Cited by 85 · see citing works
Heller, N., Isensee, F., Trofimova, D., Tejpaul, R., Zhao, Z., Chen, H., Wang, L., Golts, A., Khapun, D., Shats, D., et al. (2023) · arXiv · doi:10.48550/arxiv.2307.01984 · Cited by 35 · cited 4× · see citing works
“…especially relevant for tumor segmentation, where different lesion appearances and annotation targets have been reported across tumor benchmarks [3, 8, 23], and where different cases may call for different interactions: A compact lesion may be corrected with a few clicks, an elongated lesion may…”
InfluentialPromise: Prompt-Driven 3D Medical Image Segmentation Using Pretrained Image Foundation Models
Li, H., Liu, H., Hu, D., Wang, J., & Oguz, I. (2024) · 2024 IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi56570.2024.10635207 · Cited by 29 · see citing works
Self-citationCats: Complementary CNN and Transformer Encoders for Segmentation
Li, H., Hu, D., Liu, H., Wang, J., & Oğuz, İ. (2022) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi52829.2022.9761596 · Cited by 26 · cited 1× · see citing works
“The PRISM-style image encoder follows the hybrid CNN/Transformer design used in CATS v1 and CATS v2 [14, 15], which combines local convolutional features with longer-range transformer features for volumetric medical segmentation.”
Self-citationPRISM: A Promptable and Robust Interactive Segmentation Model with Visual Prompts
Li, H., Liu, H., Hu, D., Wang, J., & Oguz, I. (2024) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-72384-1_37 · Cited by 12 · see citing works
Self-citationnnInteractive: Redefining 3D Promptable SegmentationPreprint
Isensee, F., Rokuss, M., Krämer, L., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.08373 · Cited by 12 · cited 2× · see citing works
“Starting from point-and box-based prompting in SAM [12], recent medical systems extend promptable segmentation to 2D and 3D medical images, including volumetric tumor segmentation [5, 7, 10, 16, 17, 21, 22, 29].”
MedSAM2: Segment Anything in 3D Medical Images and VideosPreprint
Ma, J., Yang, Z., Kim, S., Chen, B., Baharoon, M., Fallahpour, A., Asakereh, R., Lyu, H., & Wang, B. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2504.03600 · Cited by 12 · cited 3× · see citing works
“MedSAM [21] and MedSAM2 [22] adapt the SAM-style interface to medical images and videos, often operating with 2D or slice-wise prompts.”
Li, H., Liu, H., Hu, D., Wang, J., & Oguz, I. (2024) · 2024 IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi56570.2024.10635343 · Cited by 9 · cited 1× · see citing works
“Prior analysis of interactive 3D medical segmentation has shown that test-time performance can vary with the placement and selection strategy of point prompts [18].”
Self-citationCATS v2: hybrid encoders for robust medical segmentation
Li, H., Liu, H., Hu, D., et al. (2024) · SPIE Medical Imaging: Image Processing · doi:10.1117/12.3006820 · Cited by 6 · cited 1× · see citing works
“The PRISM-style image encoder follows the hybrid CNN/Transformer design used in CATS v1 and CATS v2 [14, 15], which combines local convolutional features with longer-range transformer features for volumetric medical segmentation.”
Self-citationLee, H. H., Bao, S., Huo, Y., & Landman, B. A. (2022) · arXiv · doi:10.48550/arxiv.2209.15076
MONAI: Medical Open Network for AI
(2022) · Zenodo · doi:10.5281/zenodo.7245821
CATS v2: Hybrid encoders for robust medical segmentation
Li, H., Liu, H., Hu, D., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.06377
Self-citation
Flagged first, then by citations
- Authors
- Li, H., & Li, H.
- Venue
- The Visual Computer
- Published
- 2026-06-29
- Volume
- 42
- Issue
- 9
- ISSN
- 0178-2789 (ISSN-L)
- 1432-2315
- OpenAlex
- W7166590722
- Semantic Scholar
- 51c7d03e4c9c3bd03740db781c0e299aa38b3675
- Cited by
- 0
- References
- 30
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- The Visual Computer (publishedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Life Sciences › Neuroscience › Neurology › Brain Tumor Detection and Classification
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- visual prompts, kidney tumor segmentation, medical image segmentation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-22.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-22.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review