MedLSAM: Localize and segment anything model for 3D CT images
Open accessThe DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
Recent advancements in foundation models have shown significant potential in medical image analysis. However, there is still a gap in models specifically designed for medical image localization. To address this, we introduce MedLAM, a 3D medical foundation localization model that accurately identifies any anatomical part within the body using only a few template scans. MedLAM employs two self-supervision tasks: unified anatomical mapping (UAM) and multi-scale similarity (MSS) across a comprehensive dataset of 14,012 CT scans. Furthermore, we developed MedLSAM by integrating MedLAM with the Segment Anything Model (SAM). This innovative framework requires extreme point annotations across three directions on several templates to enable MedLAM to locate the target anatomical structure in the image, with SAM performing the segmentation. It significantly reduces the amount of manual annotation required by SAM in 3D medical imaging scenarios. We conducted extensive experiments on two 3D datasets covering 38 distinct organs. Our findings are twofold: (1) MedLAM can directly localize anatomical structures using just a few template scans, achieving performance comparable to fully supervised models; (2) MedLSAM closely matches the performance of SAM and its specialized medical adaptations with manual prompts, while minimizing the need for extensive point annotations across the entire dataset. Moreover, MedLAM has the potential to be seamlessly integrated with future 3D SAM models, paving the way for enhanced segmentation performance. Our code is public at https://github.com/openmedlab/MedLSAM.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Self-citationAdam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293
nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation
Isensee, F., Jaeger, P. F., Kohl, S. A. A., Petersen, J., & Maier-Hein, K. H. (2021) · Nature Methods · doi:10.1038/s41592-020-01008-z · Cited by 10,477
Emerging Properties in Self-Supervised Vision Transformers
Caron, M., Touvron, H., Misra, I., Jegou, H., Mairal, J., Bojanowski, P., & Joulin, A. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00951 · Cited by 5,638
Training language models to follow instructions with human feedback
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C. L., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2203.02155 · Cited by 4,208
SlowFast Networks for Video Recognition
Feichtenhofer, C., Fan, H., Malik, J., & He, K. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00630 · Cited by 4,007
Research works printed but not linked: 23
- Bo, 2021, Toward human intervention-free clinical diagnosis of intracranial aneurysm via deep neural network, Patterns, 2, 10.1016/j.patter.2020.100197 · DOI
- Chen, 2021, Fast and accurate craniomaxillofacial landmark detection via 3D faster R-CNN, IEEE Trans. Med. Imaging, 40, 3867, 10.1109/TMI.2021.3099509 · DOI
- Dai, 2016, R-fcn: Object detection via region-based fully convolutional networks, Adv. Neural Inf. Process. Syst., 29
- Gatidis, 2022, A whole-body FDG-pet/CT dataset with manually annotated tumor lesions, Sci. Data, 9, 601, 10.1038/s41597-022-01718-3 · DOI · Paper page
- Grossberg, 2018, Imaging and clinical data archive for head and neck squamous cell carcinoma patients treated with radiotherapy, Sci. Data, 5, 1, 10.1038/s41597-018-0002-5 · DOI · Paper page
- He, K., Gkioxari, G., Dollár, P., Girshick, R., 2017. Mask r-cnn. In: Proceedings of the IEEE International Conference on Computer Vision. pp. 2961–2969. · DOI · Paper page
- Heller, 2020, The state of the art in kidney and kidney tumor segmentation in contrast-enhanced CT imaging: Results of the KiTS19 challenge, Med. Image Anal.
- Humpire-Mamani, 2018, Efficient organ localization using multi-label convolutional neural networks in thorax-abdomen CT scans, Phys. Med. Biol., 63, 10.1088/1361-6560/aab4b3 · DOI
- Hussain, 2021, Cascaded regression neural nets for kidney localization and segmentation-free volume estimation, IEEE Trans. Med. Imaging, 40, 1555, 10.1109/TMI.2021.3060465 · DOI
- Kwan, 2018, Radiomic biomarkers to refine risk models for distant metastasis in HPV-related oropharyngeal carcinoma, Int. J. Radiat. Oncol.* Biol.* Phys., 102, 1107, 10.1016/j.ijrobp.2018.01.057 · DOI
- Lei, 2021, Automatic segmentation of organs-at-risk from head-and-neck CT using separable convolutional neural network with hard-region-weighted loss, Neurocomputing, 442, 184, 10.1016/j.neucom.2021.01.135 · DOI
- Li, L.H., Zhang, P., Zhang, H., Yang, J., Li, C., Zhong, Y., Wang, L., Yuan, L., Zhang, L., Hwang, J.-N., et al., 2022. Grounded language-image pre-training. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 10965–10975. · DOI · Paper page
- Liu, Z., Mao, H., Wu, C.-Y., Feichtenhofer, C., Darrell, T., Xie, S., 2022. A convnet for the 2020s. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 11976–11986. · DOI · Paper page
- Lowe, 2019, Multicenter trial of [18F] fluorodeoxyglucose positron emission tomography/computed tomography staging of head and neck cancer and negative predictive value and surgical impact in the N0 neck: results from ACRIN 6685, J. Clin. Oncol., 37, 1704, 10.1200/JCO.18.01182 · DOI
- Luo, 2022, WORD: A large scale dataset, benchmark and clinical applicable study for abdominal organ segmentation from CT image, Med. Image Anal., 82, 10.1016/j.media.2022.102642 · DOI · Paper page
- Ma, 2022, Fast and low-GPU-memory abdomen CT organ segmentation: the flare challenge, Med. Image Anal., 82, 10.1016/j.media.2022.102616 · DOI · Paper page
- Revel, 2021, Study of thoracic CT in COVID-19: the STOIC project, Radiology, 301, E361, 10.1148/radiol.2021210384 · DOI
- Sun, 2013, Validation of anatomical landmarks-based registration for image-guided surgery: an in-vitro study, J. Cranio-Maxillofac. Surg., 41, 522, 10.1016/j.jcms.2012.11.017 · doi:10.1016/j.jcms.2012.11.017
- Vallieres, 2017, Radiomics strategies for risk assessment of tumour failure in head-and-neck cancer, Sci. Rep., 7, 10117, 10.1038/s41598-017-10371-5 · DOI · Paper page
- Wan, 2023, Multi-target landmark detection with incomplete images via reinforcement learning and shape prior embedding, Med. Image Anal., 10.1016/j.media.2023.102875 · DOI
- Xie, E., Ding, J., Wang, W., Zhan, X., Xu, H., Sun, P., Li, Z., Luo, P., 2021. Detco: Unsupervised contrastive learning for object detection. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. pp. 8392–8401. · DOI · Paper page
- Zhang, 2018, Automatic nodule detection for lung cancer in CT images: A review, Comput. Biol. Med., 103, 287, 10.1016/j.compbiomed.2018.10.033 · DOI
- Zhang, 2022, Glipv2: Unifying localization and vision-language understanding, Adv. Neural Inf. Process. Syst., 35, 36067
Cited by
MMedAgent: Learning to Use Medical Tools with Multi-modal Agent
Li, B., Yan, T., Pan, Y., Luo, J., Ji, R., Ding, J., Xu, Z., Liu, S., Dong, H., Lin, Z., et al. (2024) · arXiv · doi:10.48550/arxiv.2407.02483 · Cited by 65
Ethical framework for responsible foundational models in medical imaging
Jha, D., Durak, G., Das, A., Sanjotra, J., Susladkar, O., Sarkar, S., Rauniyar, A., Kumar Tomar, N., Peng, L., Li, S., et al. (2025) · Frontiers in Medicine · doi:10.3389/fmed.2025.1544501 · Cited by 21
Retrieval-Augmented Few-Shot Medical Image Segmentation With Foundation Models
Zhao, L., Chen, X., Chen, E. Z., Liu, Y., Chen, T., & Sun, S. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3568479 · Cited by 19
“D medical image segmentation [14], [15].”
Konwer, A., Yang, Z., Bas, E., Xiao, C., Prasanna, P., Bhatia, P., & Kass-Hout, T. (2025) · 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52734.2025.01955 · Cited by 17
Metadata
- Authors
- Lei, W., Xu, W., Li, K., Zhang, X., & Zhang, S.
- Venue
- Medical Image Analysis
- Publisher
- Elsevier BV
- Published
- 2025-01
- Volume
- 99
- Pages
- 103370
- ISSN
- 1361-8415 (ISSN-L)
- OpenAlex
- W4403424772
- Cited by
- 78
- References
- 28
- FWCI
- 10.74
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- doi.org/10.15223/policy-017 (stm-asf)
- doi.org/10.15223/policy-037 (stm-asf)
- doi.org/10.15223/policy-012 (stm-asf)
- doi.org/10.15223/policy-029 (stm-asf)
- doi.org/10.15223/policy-004 (stm-asf)
- Funders
- National Natural Science Foundation of China (62301311)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: MedLSAM: Localize and segment anything model for 3D CT images. https://app.cochat.ai/papers/10.1016/j.media.2024.103370
- The paper
- Lei, W., Xu, W., Li, K., Zhang, X., & Zhang, S. (2025). MedLSAM: Localize and segment anything model for 3D CT images. Medical Image Analysis. https://doi.org/10.1016/j.media.2024.103370
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.