CoChat

MedLSAM: Localize and segment anything model for 3D CT images

Open access
Lei, Wenhui, Xu, Wei, Li, Kang, Zhang, Xiaofan, Zhang, Shaoting · 2025 · Medical Image Analysis
Cited by 78

The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.

Abstract

Recent advancements in foundation models have shown significant potential in medical image analysis. However, there is still a gap in models specifically designed for medical image localization. To address this, we introduce MedLAM, a 3D medical foundation localization model that accurately identifies any anatomical part within the body using only a few template scans. MedLAM employs two self-supervision tasks: unified anatomical mapping (UAM) and multi-scale similarity (MSS) across a comprehensive dataset of 14,012 CT scans. Furthermore, we developed MedLSAM by integrating MedLAM with the Segment Anything Model (SAM). This innovative framework requires extreme point annotations across three directions on several templates to enable MedLAM to locate the target anatomical structure in the image, with SAM performing the segmentation. It significantly reduces the amount of manual annotation required by SAM in 3D medical imaging scenarios. We conducted extensive experiments on two 3D datasets covering 38 distinct organs. Our findings are twofold: (1) MedLAM can directly localize anatomical structures using just a few template scans, achieving performance comparable to fully supervised models; (2) MedLSAM closely matches the performance of SAM and its specialized medical adaptations with manual prompts, while minimizing the need for extensive point annotations across the entire dataset. Moreover, MedLAM has the potential to be seamlessly integrated with future 3D SAM models, paving the way for enhanced segmentation performance. Our code is public at https://github.com/openmedlab/MedLSAM.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.media.2024.103370

Cites

28 of 28 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 28 references

Research works printed but not linked: 23

  1. Bo, 2021, Toward human intervention-free clinical diagnosis of intracranial aneurysm via deep neural network, Patterns, 2, 10.1016/j.patter.2020.100197 · DOI
  2. Chen, 2021, Fast and accurate craniomaxillofacial landmark detection via 3D faster R-CNN, IEEE Trans. Med. Imaging, 40, 3867, 10.1109/TMI.2021.3099509 · DOI
  3. Dai, 2016, R-fcn: Object detection via region-based fully convolutional networks, Adv. Neural Inf. Process. Syst., 29
  4. Gatidis, 2022, A whole-body FDG-pet/CT dataset with manually annotated tumor lesions, Sci. Data, 9, 601, 10.1038/s41597-022-01718-3 · DOI · Paper page
  5. Grossberg, 2018, Imaging and clinical data archive for head and neck squamous cell carcinoma patients treated with radiotherapy, Sci. Data, 5, 1, 10.1038/s41597-018-0002-5 · DOI · Paper page
  6. He, K., Gkioxari, G., Dollár, P., Girshick, R., 2017. Mask r-cnn. In: Proceedings of the IEEE International Conference on Computer Vision. pp. 2961–2969. · DOI · Paper page
  7. Heller, 2020, The state of the art in kidney and kidney tumor segmentation in contrast-enhanced CT imaging: Results of the KiTS19 challenge, Med. Image Anal.
  8. Humpire-Mamani, 2018, Efficient organ localization using multi-label convolutional neural networks in thorax-abdomen CT scans, Phys. Med. Biol., 63, 10.1088/1361-6560/aab4b3 · DOI
  9. Hussain, 2021, Cascaded regression neural nets for kidney localization and segmentation-free volume estimation, IEEE Trans. Med. Imaging, 40, 1555, 10.1109/TMI.2021.3060465 · DOI
  10. Kwan, 2018, Radiomic biomarkers to refine risk models for distant metastasis in HPV-related oropharyngeal carcinoma, Int. J. Radiat. Oncol.* Biol.* Phys., 102, 1107, 10.1016/j.ijrobp.2018.01.057 · DOI
  11. Lei, 2021, Automatic segmentation of organs-at-risk from head-and-neck CT using separable convolutional neural network with hard-region-weighted loss, Neurocomputing, 442, 184, 10.1016/j.neucom.2021.01.135 · DOI
  12. Li, L.H., Zhang, P., Zhang, H., Yang, J., Li, C., Zhong, Y., Wang, L., Yuan, L., Zhang, L., Hwang, J.-N., et al., 2022. Grounded language-image pre-training. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 10965–10975. · DOI · Paper page
  13. Liu, Z., Mao, H., Wu, C.-Y., Feichtenhofer, C., Darrell, T., Xie, S., 2022. A convnet for the 2020s. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 11976–11986. · DOI · Paper page
  14. Lowe, 2019, Multicenter trial of [18F] fluorodeoxyglucose positron emission tomography/computed tomography staging of head and neck cancer and negative predictive value and surgical impact in the N0 neck: results from ACRIN 6685, J. Clin. Oncol., 37, 1704, 10.1200/JCO.18.01182 · DOI
  15. Luo, 2022, WORD: A large scale dataset, benchmark and clinical applicable study for abdominal organ segmentation from CT image, Med. Image Anal., 82, 10.1016/j.media.2022.102642 · DOI · Paper page
  16. Ma, 2022, Fast and low-GPU-memory abdomen CT organ segmentation: the flare challenge, Med. Image Anal., 82, 10.1016/j.media.2022.102616 · DOI · Paper page
  17. Revel, 2021, Study of thoracic CT in COVID-19: the STOIC project, Radiology, 301, E361, 10.1148/radiol.2021210384 · DOI
  18. Sun, 2013, Validation of anatomical landmarks-based registration for image-guided surgery: an in-vitro study, J. Cranio-Maxillofac. Surg., 41, 522, 10.1016/j.jcms.2012.11.017 · doi:10.1016/j.jcms.2012.11.017
  19. Vallieres, 2017, Radiomics strategies for risk assessment of tumour failure in head-and-neck cancer, Sci. Rep., 7, 10117, 10.1038/s41598-017-10371-5 · DOI · Paper page
  20. Wan, 2023, Multi-target landmark detection with incomplete images via reinforcement learning and shape prior embedding, Med. Image Anal., 10.1016/j.media.2023.102875 · DOI
  21. Xie, E., Ding, J., Wang, W., Zhan, X., Xu, H., Sun, P., Li, Z., Luo, P., 2021. Detco: Unsupervised contrastive learning for object detection. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. pp. 8392–8401. · DOI · Paper page
  22. Zhang, 2018, Automatic nodule detection for lung cancer in CT images: A review, Comput. Biol. Med., 103, 287, 10.1016/j.compbiomed.2018.10.033 · DOI
  23. Zhang, 2022, Glipv2: Unifying localization and vision-language understanding, Adv. Neural Inf. Process. Syst., 35, 36067

Cited by

See all 78

Metadata

Authors
Lei, W., Xu, W., Li, K., Zhang, X., & Zhang, S.
Venue
Medical Image Analysis
Publisher
Elsevier BV
Published
2025-01
Volume
99
Pages
103370
ISSN
1361-8415 (ISSN-L)
OpenAlex
W4403424772
Cited by
78
References
28
FWCI
10.74
Type
journal article
Language
en
Open access
green
Funders
National Natural Science Foundation of China (62301311)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: MedLSAM: Localize and segment anything model for 3D CT images. https://app.cochat.ai/papers/10.1016/j.media.2024.103370
The paper
Lei, W., Xu, W., Li, K., Zhang, X., & Zhang, S. (2025). MedLSAM: Localize and segment anything model for 3D CT images. Medical Image Analysis. https://doi.org/10.1016/j.media.2024.103370

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.