CoChat
Sign Up
PreprintCited by 1Medical Image Segmentation TechniquesArtificial Intelligence in Healthcare and EducationMultimodal Machine Learning Applications

MedSAM-Agent: Empowering Interactive Medical Image Segmentation with Multi-turn Agentic Reinforcement Learning

Open access
Liu, Shengyuan, Bao, Liuxin, Yang, Qi, Geng, Wanting, Zheng, Boyun, Li, Chenxin, Chen, Wenting, Peng, Houwen +1 more·2026·arXiv
DOI 10.48550/arxiv.2602.03320arXiv 2602.03320
Open this paper in CoChat — free accountOpen PDF

Abstract

Medical image segmentation is evolving from task-specific models toward generalizable frameworks. Recent research leverages Multi-modal Large Language Models (MLLMs) as autonomous agents, employing reinforcement learning with verifiable reward (RLVR) to orchestrate specialized tools like the Segment Anything Model (SAM). However, these approaches often rely on single-turn, rigid interaction strategies and lack process-level supervision during training, which hinders their ability to fully exploit the dynamic potential of interactive tools and leads to redundant actions. To bridge this gap, we propose MedSAM-Agent, a framework that reformulates interactive segmentation as a multi-step autonomous decision-making process. First, we introduce a hybrid prompting strategy for expert-curated trajectory generation, enabling the model to internalize human-like decision heuristics and adaptive refinement strategies. Furthermore, we develop a two-stage training pipeline that integrates multi-turn, end-to-end outcome verification with a clinical-fidelity process reward design to promote interaction parsimony and decision efficiency. Extensive experiments across 6 medical modalities and 21 datasets demonstrate that MedSAM-Agent achieves state-of-the-art performance, effectively unifying autonomous medical reasoning with robust, iterative optimization. Code is available \href{https://github.com/CUHK-AIM-Group/MedSAM-Agent}{here}.

AI snapshot

Written from the paper’s full text.

TL;DR

MedSAM-Agent reformulates interactive medical image segmentation as a multi-turn autonomous decision process, using a hybrid box/point prompting strategy and a two-stage SFT+RL pipeline with process-level rewards. It reports state-of-the-art performance across 6 medical modalities and 21 datasets while improving interaction efficiency.

Key findings

  • MedSAM-Agent reports strong average segmentation across 6 modalities: Ours-MedSAM2 reaches mean Dice 0.794 / IoU 0.705, and Ours-IMISNet reaches mean Dice 0.763 / IoU 0.670 (Table 1).
  • The hybrid action strategy outperforms single strategies in SFT: Hybrid achieves IoU 0.686, versus Sequential-Click IoU 0.623 and Box-to-Point IoU 0.649; Box-to-Point also reduces average turns from 2.94 to 2.06 (Table 3).
  • Full SFT+RL reaches Dice 0.794 / IoU 0.705 with 2.11 average turns; removing process rewards degrades performance or efficiency, e.g., w/o R_imp drops to Dice 0.772 / IoU 0.688, w/o R_over increases turns to 2.24, and w/o R_cost increases turns to 2.26 (Table 3).
  • The learned policy shows zero-shot tool-agnostic transfer: an agent trained with IMISNet tested on SAM2 reaches BTCV Dice 0.764 / IoU 0.680, and one trained with MedSAM2 tested on IMISNet reaches BTCV Dice 0.761 / IoU 0.682 (Table 2).

Methods

  • The framework treats segmentation as a multi-step decision process: the policy model, based on Qwen3-VL-8B, selects actions including bounding boxes, positive/negative point clicks, and stop; observations are updated masks from interactive segmentation backends such as SAM2.1-Base, MedSAM2, and IMISNet.
  • Expert-curated trajectories are generated with a hybrid prompting strategy combining Box-to-Point and Sequential-Click paradigms, using error-driven FN/FP refinement, progress-constrained sampling with ΔIoU ≥ τ = 0.04, up to N = 5 retries, and K = 5 maximum refinement clicks; SFT data include 449,133 samples from MedSAM2 and 519,515 from IMISNet.
  • Training is two-stage: SFT cold-start with Llama-Factory (lr 1e-5, batch 64, 4 epochs, LLM backbone only), then RLVR with GRPO via Verl (lr 1e-5, batch 8, sampling 8, max interaction turn 5), using format, quality, progressive improvement, overshoot, and tool-cost rewards; experiments use 21 datasets across 6 modalities on 8× NVIDIA H20 GPUs.

Limitations

  • The paper states that the current study focuses on 2D image slices and plans future extension to 3D volumetric modalities; it also notes that multi-turn iterative paradigms may increase cumulative inference latency and proposes early-exit, speculative decoding, or KV-cache optimization as future remedies.
  • The text makes evident that performance depends on the underlying segmentation model: the authors note that agent performance is “intrinsically linked to the foundational capabilities of the underlying segmentation model,” with models like IMISNet strong on CT but weaker on X-Ray.
  • An evident inconsistency appears in the reported tables: the paper claims the agent exceeds the static single-turn upper bound, but Table 1 reports MedSAM-Box average Dice 0.876 / IoU 0.797, higher than Ours-MedSAM2 average Dice 0.794 / IoU 0.705.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

DataCite · 10.48550/arxiv.2602.03320

Cites

110 of 110 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

9 of 14 cited sources checked · 3 supported · 1 flagged · accuracy not yet measured

  • Premisecitation

    Existing MLLM-based interactive segmentation methods rely on single-turn, rigid interaction strategies.

    “Current studies either rely on single-turn prompts (You & Wu, 2025;Liu et al., 2025b;Huang et al., 2025a;Li et al., 2024), treating SAM as a static segmentor rather than an iterative agent, or adhere to rigid, point-only trajectories (Zhu et al., 2025;Jiang et al., 2026).”
    Quote in the paperSubstantial claim1 of 3 sources checked
    • cites You & Wu, 2025 source
    • cites Liu et al., 2025b

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Huang et al., 2025a

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Premisecitation

    Existing RLVR frameworks for segmentation focus predominantly on terminal outcomes and neglect the efficiency and logical coherence of intermediate actions.

    “Existing RLVR frameworks (You & Wu, 2025;Huang et al., 2025a;Liu et al., 2025b;Jiang et al., 2025b;Liu et al., 2025c;Su et al., 2025a) focus predominantly on terminal outcomes, such as the final segmentation accuracy (e.g., Dice or IoU), while neglecting the efficiency and logical coherence of intermediate actions.”
    Quote in the paperSubstantial claim1 of 3 sources checked
    • cites You & Wu, 2025 source

      Section 3.1 (p. 4) describes Seg-R1’s rewards as output-format compliance and segmentation quality measured by IoU and S-Measure, supporting its use as an example of outcome-focused segmentation RL. The paper does not establish that existing RLVR frameworks generally neglect the efficiency or logical coherence of intermediate actions. (LLM, conf=0.78)

      Experimental — accuracy not yet measured
    • cites Huang et al., 2025a

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Liu et al., 2025b

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Findingown data

    MedSAM-Agent outperforms ideal single-turn baselines (Single-Turn Point and Single-Turn Box) on evaluated datasets.

    “As illustrated in Fig. 3, which details the performance trajectories on the FH-PS-AOP (Jieyun & ZhanHong, 2024) and Radiography (Chowdhury et al., 2020) datasets, MedSAM-Agent outperforms these ideal single-turn baselines.”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites Jieyun & ZhanHong, 2024

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Chowdhury et al., 2020 source
  • Premisecitation

    Existing methods typically restrict the action space to sequential clicks.

    “they typically restrict the action space to sequential clicks.”
    Quote in the paperSubstantial claim2 of 2 sources checked
    • cites Zhu et al., 2025 source

      Section 4.1 (p. 4) describes an existing iterative click-simulation strategy, and Section 5.1 (p. 6) says SimpleClick accepts only points. But Section 2.3 (p. 3) also describes interactive segmentation using boxes and scribbles, so the paper does not establish that existing methods typically restrict their action space to sequential clicks. (LLM, conf=0.76)

      Experimental — accuracy not yet measured
    • cites Jiang et al., 2026 source

      Section 3.2 (p. 4) says the paper adopts a click-simulation strategy from prior research that generates successive click actions. Section 3.1 (p. 3) describes IBISAgent’s own action space as click operations or a final answer. These passages support sequential clicks as an approach, but do not establish that existing methods typically restrict their action spaces to them. (LLM, conf=0.76)

      Experimental — accuracy not yet measured
  • Findingcitation

    Seg-R1 significantly outperforms other general-purpose MLLMs on medical datasets.

    “In contrast, although Seg-R1 (You & Wu, 2025) was not specifically fine-tuned on medical domain data, it significantly outperforms other general-purpose MLLMs.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites You & Wu, 2025 source

      The Introduction (p. 2) says Seg-R1 was trained on foreground-segmentation image-mask pairs, and the comparison results (p. 8) show it outperforming several models on ReasonSeg. But our copy does not report a comparison on medical datasets, so it does not support extending that result to the medical setting. (LLM, conf=0.84)

      Experimental — accuracy not yet measured
  • Classified as probably not a substantial claim. 12
  • May combine two claims. 24
  • The quote only partly states this claim. 1

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductcitation

    Spatial coordinates were mapped to absolute integers within a [0, 1000] range to ensure compatibility with the Qwen3-VL architecture.

    “During the construction of interaction trajectories, we map the spatial coordinates to absolute integers within a [0, 1000] range to ensure compatibility with the Qwen3-VL (Bai et al., 2025) architecture.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Bai et al., 2025 source

      The citation identifies Bai et al. (2025) as describing the Qwen3-VL architecture, but the cited report describes Qwen2.5-VL. Its Model Architecture section (p. 5) also says Qwen2.5-VL uses actual image dimensions for coordinates rather than normalizing them to a fixed range. The citing authors’ statement that they map coordinates is their own method, not a method attributed to this source. (LLM, conf=0.88)

      Checked by a reasoning model — may be wrong.

      Experimental — accuracy not yet measured

  • May combine two claims.

    Findingcitation

    IMISNet demonstrates exceptional proficiency in CT datasets but its performance significantly decreases on X-Ray, as observed in the Radiography results.

    “For instance, while specialized models like IMISNet demonstrate exceptional proficiency in CT datasets, their performance significantly decreases when applied to X-Ray, as observed in the Radiography (Chowdhury et al., 2020) results.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Chowdhury et al., 2020 source

      The Database Description identifies the authors’ radiography dataset as chest X-ray images, supporting the reference to Radiography as an X-ray dataset. The cited paper’s experimental results concern X-ray classification; our copy does not report IMISNet’s CT performance or a decrease when it is applied to X-rays (searched: IMISNet, CT datasets and X-ray performance). (LLM, conf=0.79)

      Experimental — accuracy not yet measured

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Using MedSAM2, 334,616 trajectories were initially generated for both the Box-to-Point and Sequential-Click strategies.

    “Based on this trajectory generation pipeline, we initially generated 334,616 trajectories for both the Box-to-Point and Sequential-Click strategies using MedSAM2.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    The baseline model achieves basic segmentation but often suffers from inefficient interaction trajectories and redundant operations.

    “Our results indicate that while the baseline model achieves basic segmentation, it often suffers from inefficient interaction trajectories and redundant operations.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    The performance of the autonomous agent is intrinsically linked to the foundational capabilities of the underlying segmentation model, but it can improve upon baseline results through strategic interaction.

    “The empirical results reveal that the performance of our autonomous agent is intrinsically linked to the foundational capabilities of the underlying segmentation model, yet it demonstrates a unique capacity to improve upon baseline results through strategic interaction.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingreasoning

    After filtering, there were 188,687 click-based and 260,446 box-based trajectories, totaling 449,133 high-quality samples.

    “This resulted in 188,687 click-based and 260,446 box-based trajectories, totaling 449,133 high-quality samples.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    Excluding R_over causes the agent to fail to terminate at optimal states, increasing average interaction turns from 2.11 to 2.24.

    “When R over is excluded, the agent fails to terminate the process at optimal states, leading to an increase in average interaction turns (n turn ) from 2.11 to 2.24.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    The dataset used in this work comprises 419,659 triplets across 6 modalities.

    “Total 6 Modalities 419,659”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Using IMISNet, the procedure yielded 235,993 click trajectories and 283,522 box trajectories, totaling 519,515 samples.

    “A similar procedure was applied using IMISNet, yielding 235,993 click trajectories and 283,522 box trajectories, for a total of 519,515 samples.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationown data

    The two-stage pipeline achieves a superior balance of precision and interaction turns, demonstrating that process-aware rewards align the agent's behavior with clinical accuracy and operational efficiency.

    “Overall, the two-stage pipeline achieves the superior balance of precision and interaction turns, demonstrating that process-aware rewards successfully align the agent's behavior with both clinical accuracy and operational efficiency.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    The system prompt ensures that the MLLM interprets the medical image as a dynamic environment requiring strategic intervention.

    “This prompt ensures that the MLLM interprets the medical image not as a static object, but as a dynamic environment requiring strategic intervention.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationreasoning

    By engaging in multiple rounds of interaction, the agent achieves performance surpassing the inherent limits of a single-turn approach, demonstrating the significance of multi-turn strategic engagement.

    “By engaging in multiple rounds of interaction, the agent achieves performance that surpasses the inherent limits of a single-turn approach, thereby demonstrating the fundamental significance of multi-turn strategic engagement.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    To ensure the efficiency of synthesized trajectories, a progress-constrained sampling mechanism is implemented.

    “To ensure the efficiency of synthesized trajectories, we implement a progress-constrained sampling mechanism.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationreasoning

    The hybrid prompting strategy and two-stage training pipeline optimized by fine-grained process rewards enable the model to function as a self-refinement agent capable of achieving expert-level segmentation across diverse imaging modalities.

    “Through a hybrid prompting strategy and a two-stage training pipeline optimized by fine-grained process rewards, we enable the model to function as a self-refinement agent capable of achieving expert-level segmentation across diverse imaging modalities.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Interpretationown data

    The agent adaptively selects the optimal interaction depth, effectively balancing segmentation precision with procedural efficiency.

    “Furthermore, the diminishing sample counts across successive turns confirm the agent's ability to adaptively select the optimal interaction depth, effectively balancing segmentation precision with procedural efficiency.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Interpretationreasoning

    Active perception allows the agent to enhance raw model capabilities to reach the high precision required for clinical diagnostics, proving that autonomous, multi-turn strategic interaction is superior to passive, single-turn prompting.

    “This active perception allows the agent to enhance raw model capabilities to reach the high precision required for clinical diagnostics, proving that autonomous, multi-turn strategic interaction is superior to passive, single-turn prompting paradigms.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Interpretationown data

    The agent has internalized a sophisticated refinement logic rather than simple tool invocation.

    “Notably, the Final Mean IoU achieved by our agent exceeds the theoretical upper bound of static prompts across all evaluated modalities, proving that the agent has internalized a sophisticated refinement logic rather than simple tool invocation.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Interpretationreasoning

    The cold-start SFT phase aligns the model's initial policy distribution with decision-making heuristics of medical experts, acquiring fundamental visual grounding capabilities.

    “This cold-start phase is foundational for the subsequent reinforcement learning stage; by minimizing the imitation loss, the model aligns its initial policy distribution with the decision-making heuristics of medical experts, effectively acquiring fundamental visual grounding capabilities.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Medical experts commonly employ interactive segmentation tools iteratively, providing positive and negative click points based on the original image and real-time updated mask.

  • Classified as probably not a substantial claim.

    Study design and conductreasoning

    Each simulated action is required to yield an incremental IoU gain (∆IoU) exceeding a predefined threshold τ.

    “We require each simulated action to yield an incremental IoU gain (∆IoU) exceeding a predefined threshold τ :”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Interpretationreasoning

    The subsequent RL stage enables the model to generalize across tools and optimize for procedural efficiency.

    “The subsequent RL stage then enables the model to generalize across tools and optimize for procedural efficiency.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S4 (based).

    Study design and conductnone given

    To guarantee trajectory quality, each action in trajectory generation is constrained to yield a measurable IoU improvement, filtering out ineffective interactions through an iterative retry mechanism.

    “Furthermore, to guarantee trajectory quality, we enforce a constraint where each action must yield a measurable IoU improvement, filtering out ineffective interactions through an iterative retry mechanism.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationreasoning

    RL is adept at strategy optimization but struggles with the initial grounding problem in complex medical contexts.

    “This discrepancy highlights that while RL is adept at strategy optimization, it struggles with the initial grounding problem in complex medical contexts.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Interpretationown data

    MedSAM-Agent demonstrates exceptional cross-modal generalization and tool-use versatility.

    “Consequently, MedSAM-Agent achieves state-of-the-art performance across 6 medical modalities and 21 datasets, demonstrating exceptional cross-modal generalization and tool-use versatility.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Interpretationreasoning

    The autonomous refinement loop mimics a clinician's iterative workflow, proving that the model can internalize sophisticated decision heuristics to achieve superior mask fidelity in challenging clinical environments.

    “This autonomous refinement loop effectively mimics a clinician's iterative workflow, proving that the model can successfully internalize sophisticated decision heuristics to achieve superior mask fidelity in challenging clinical environments.”
    Quote in the paperSubstantial claim

  • Classified as probably not a substantial claim.

    Study design and conductnone given

    To ensure SFT data quality, an IoU threshold of 0.7 was applied to filter out low-performing samples.

    “To ensure the quality of the Supervised Fine-Tuning (SFT) data, we applied an IoU threshold of 0.7 to filter out low-performing samples.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Interpretationreasoning

    Omitting the dedicated thinking token accelerates inference speed by reducing token overhead and forces the model to prioritize dense image-level features over textual deliberation.

    “This design choice is driven by two primary objectives: first, to significantly accelerate inference speed by reducing token overhead; and second, to force the model to prioritize dense image-level features over textual deliberation.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Interpretationreasoning

    The hybrid approach's success stems from its alignment with human intuition: it uses the box to establish a reliable global context and subsequent points for precise local refinement.

    “This success stems from the fact that the hybrid approach aligns with human intuition: it leverages the box to establish a reliable global context and uses subsequent points for precise local refinement.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Interpretationreasoning

    The <seg> token-based paradigm suffers from limited generalization and faces significant hurdles when transferring to the specialized medical domain without extensive in-domain fine-tuning.

    “This suggests that the <seg> token-based paradigm suffers from limited generalization and faces significant hurdles when transferring to the specialized medical domain without extensive in-domain fine-tuning.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Interpretationown data

    Combining box and point strategies is the most effective way to navigate complex medical lesions, minimizing redundant actions while maximizing segmentation fidelity.

    “These results prove that combining box and point strategies is the most effective way to navigate complex medical lesions, as it minimizes redundant actions while maximizing segmentation fidelity.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Interpretationown data

    Experimental results show the framework's superior performance and robust generalization, demonstrating its potential to reduce the workload of clinical professionals.

    “Experimental results underscore the framework's superior performance and robust generalization, demonstrating its potential to reduce the workload of clinical professionals.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Interpretationreasoning

    The agent becomes capable of interpreting complex target descriptions and performing pixel-level reasoning via iterative tool invocations.

    “Through carefully designed RL training, the agent becomes capable of interpreting complex target descriptions and performing pixel-level reasoning via iterative tool invocations.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Medical experts commonly employ interactive segmentation tools iteratively, providing positive and negative click points based on the original image and real-time updated mask.

  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    The hybrid prompting strategy enables the model to internalize human-like decision heuristics and adaptive refinement strategies.

    “First, we introduce a hybrid prompting strategy for expertcurated trajectory generation, enabling the model to internalize human-like decision heuristics and adaptive refinement strategies.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Human workflows often initiate segmentation by defining an ROI.

  • Probably not a substantial claim: may not pass S3 (load-bearing). The quote only partly states this claim.

    Study design and conductreasoning

    The system prompt enforces a 'Single Action per Turn' rule, requiring the model to observe visual feedback from the segmentation backend before the next refinement step.

    “To maintain procedural clarity, the system prompt enforces a”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Interpretationreasoning

    The coordinate normalization enables the model to effectively process spatial prompts and achieve high-precision interactive segmentation.

    “This normalization enables the model to effectively process spatial prompts and achieve high-precision interactive segmentation.”
    Quote in the paperNot a substantial claim
34 of 34

  • The paper relies on this without support.

    Medical experts commonly employ interactive segmentation tools iteratively, providing positive and negative click points based on the original image and real-time updated mask.

    “Given an image I and a segmentation target prompt P , medical experts commonly employ interactive segmentation tools: based on the original image I and the real-time updated mask M , they iteratively provide positive click points (marking regions confirmed as the target) and negative click points (excluding non-target regions).”

  • The paper relies on this without support.

    Human workflows often initiate segmentation by defining an ROI.

    “Such a limitation fails to capture the multi-modal nature of human workflows, where practitioners often initiate segmentation by defining an ROI.”

  • The authors state this as an assumption.

    An expert-level trajectory must consist of informative and effective actions.

    “We contend that an expert-level trajectory must consist of informative and effective actions; consequently, we enforce a constraint where each simulated action must yield an incremental IoU gain (∆IoU) exceeding a predefined threshold τ .”

  • The paper relies on this without support.

    The Dice coefficient offers higher sensitivity to small-scale lesions and anatomical structures, thereby mitigating penalty variance in class-imbalanced scenarios.

    “While IoU provides a standard geometric consistency measure, the inclusion of the Dice coefficient is critical for medical contexts, as it offers higher sensitivity to small-scale lesions and anatomical structures, thereby mitigating the penalty variance in class-imbalanced scenarios.”

  • The paper relies on this without support.

    Box prompt performance is the empirical upper bound for single-turn interactive segmentation.

    “The Box prompt performance is generally regarded as the empirical upper bound for single-turn interactive segmentation.”

  • The paper relies on this without support.

    Practitioners often initiate segmentation by defining a Bounding Box before refining with precise clicks.

    “where practitioners often initiate segmentation by defining a Bounding Box before refining with precise clicks.”

  • The paper relies on this without support.

    The hybrid prompting strategy generates diverse and realistic interaction trajectories.

    “This strategy encompasses both Box-to-Point and Sequential-Click paradigms to generate diverse and realistic interaction trajectories.”
7 of 7

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Algorithm's mask update omits the current action

    Minor

    Algorithm 1 computes the new mask from the previous state, which does not contain the current action. The method description instead explicitly includes the current action in the mask update, as required for that action to affect the result.

1 of 1

Cites

Flagged first, then by citations

Research works printed but not linked: 1

  1. Landman, B., Xu, Z., Igelsias, J., Styner, M., Langerak, T., and Klein, A. Miccai multi-atlas labeling beyond the cranial vault-workshop and challenge. In Proc. MICCAI Multi-Atlas Labeling Beyond Cranial Vault-Workshop Challenge, volume 5, pp. 12, 2015.

Cited by

Sorted by citations

Authors
Liu, S., Bao, L., Yang, Q., Geng, W., Zheng, B., Li, C., Chen, W., Peng, H., & Yuan, Y.
Affiliations
  • Chinese University of Hong Kong (HK)
  • Tencent (China) (CN)
  • Stanford University (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2026
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2602.03320
arXiv
2602.03320
OpenAlex
W7127627266
Semantic Scholar
4b464d3fd19849ea7f635dfd5291cc37a5f88a16
Cited by
1
References
91
Citations by year
2026: 1
Type
posted content
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
Keywords
medical image segmentation, Segment Anything Model, multi-turn reinforcement learning, agentic reinforcement learning, multimodal large language models, interactive segmentation, trajectory generation, process rewards, autonomous agents, clinical reasoning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-22.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-22.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review