The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
The Segment Anything Model (SAM) for remote sensing applications: From zero to one shot
Open accessAbstract
Segmentation is an essential step for remote sensing image processing. This study aims to advance the application of the Segment Anything Model (SAM), an innovative image segmentation model by Meta AI, in the field of remote sensing image analysis. SAM is known for its exceptional generalization capabilities and zero-shot learning, making it a promising approach to processing aerial and orbital images from diverse geographical contexts. Our exploration involved testing SAM across multi-scale datasets using various input prompts, such as bounding boxes, individual points, and text descriptors. To enhance the model’s performance, we implemented a novel automated technique that combines a text-prompt-derived general example with one-shot training. This adjustment resulted in an improvement in accuracy, underscoring SAM’s potential for deployment in remote sensing imagery and reducing the need for manual annotation. Despite the limitations, encountered with lower spatial resolution images, SAM exhibits promising adaptability to remote sensing data analysis. We recommend future research to enhance the model’s proficiency through integration with supplementary fine-tuning techniques and other networks. Furthermore, we provide the open-source code of our modifications on online repositories, encouraging further and broader adaptations of SAM to the remote sensing domain.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation
Powers, D. M. W. (2020) · arXiv · doi:10.48550/arxiv.2010.16061 · Cited by 5,440
SGDR: Stochastic Gradient Descent with Warm Restarts
Loshchilov, I., & Hutter, F. (2016) · arXiv · doi:10.48550/arxiv.1608.03983 · Cited by 5,309
Image segmentation using deep learning: A survey
Minaee, S., Boykov, Y. Y., Porikli, F., Plaza, A. J., Kehtarnavaz, N., & Terzopoulos, D. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3059968 · Cited by 3,796
Grounding DINO: Marrying DINO with Grounded Pre-training for Open-Set Object Detection
Liu, S., Zeng, Z., Ren, T., Li, F., Zhang, H., Yang, J., Jiang, Q., Li, C., Yang, J., Su, H., et al. (2025) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-72970-6_3 · Cited by 2,074
Deep learning in environmental remote sensing: Achievements and challenges
Yuan, Q., Shen, H., Li, T., Li, Z., Li, S., Jiang, Y., Xu, H., Tan, W., Yang, Q., Wang, J., et al. (2020) · Remote Sensing of Environment · doi:10.1016/j.rse.2020.111716 · Cited by 1,697
Flamingo: a Visual Language Model for Few-Shot Learning
Alayrac, J.-B., Donahue, J., Luc, P., Miech, A., Barr, I., Hasson, Y., Lenc, K., Mensch, A., Millican, K., Reynolds, M., et al. (2022) · arXiv · doi:10.48550/arxiv.2204.14198 · Cited by 1,555
Optical remotely sensed time series data for land cover classification: A review
Gómez, C., White, J. C., & Wulder, M. A. (2016) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2016.03.008 · Cited by 1,217
DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detection
Zhang, H., Li, F., Liu, S., Zhang, L., Su, H., Zhu, J., Ni, L. M., & Shum, H.-Y. (2022) · arXiv · Cited by 1,154
Amani, M., Ghorbanian, A., Ahmadi, S. A., Kakooei, M., Moghimi, A., Mirmazloumi, S. M., Moghaddam, S. H. A., Mahdavi, S., Ghahremanloo, M., Parsian, S., et al. (2020) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2020.3021052 · Cited by 1,150
Self-citationGrounded Language-Image Pre-training
Li, L. H., Zhang, P., Zhang, H., Yang, J., Li, C., Zhong, Y., Wang, L., Yuan, L., Zhang, L., Hwang, J.-N., et al. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01069 · Cited by 1,086
Vision-Language Models for Vision Tasks: A Survey
Zhang, J., Huang, J., Jin, S., & Lu, S. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3369699 · Cited by 1,051
Land-cover classification with high-resolution remote sensing images using transferable deep models
Tong, X.-Y., Xia, G.-S., Lu, Q., Shen, H., Li, S., You, S., & Zhang, L. (2020) · Remote Sensing of Environment · doi:10.1016/j.rse.2019.111322 · Cited by 978
A review of deep learning methods for semantic segmentation of remote sensing imagery
Yuan, X., Shi, J., & Gu, L. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.114417 · Cited by 766
Hossain, M. D., & Chen, D. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.02.009 · Cited by 697
Remote sensing platforms and sensors: A survey
Toth, C., & Jóźków, G. (2016) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2015.10.004 · Cited by 685
Object Detection in Aerial Images: A Large-Scale Benchmark and Challenges
Ding, J., Xue, N., Xia, G.-S., Bai, X., Yang, W., Yang, M. Y., Belongie, S., Luo, J., Datcu, M., Pelillo, M., et al. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3117983 · Cited by 678
UniFormer: Unifying Convolution and Self-Attention for Visual Recognition
Li, K., Wang, Y., Zhang, J., Gao, P., Song, G., Liu, Y., Li, H., & Qiao, Y. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3282631 · Cited by 616
Big Data for Remote Sensing: Challenges and Opportunities
Chi, M., Plaza, A., Benediktsson, J. A., Sun, Z., Shen, J., & Zhu, Y. (2016) · Proceedings of the IEEE · doi:10.1109/jproc.2016.2598228 · Cited by 599
RemoteCLIP: A Vision Language Foundation Model for Remote Sensing
Liu, F., Chen, D., Guan, Z., Zhou, X., Zhu, J., Ye, Q., Fu, L., & Zhou, J. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3390838 · Cited by 507
A review on deep learning in UAV remote sensing
Osco, L. P., Marcato Junior, J., Marques Ramos, A. P., de Castro Jorge, L. A., Fatholahi, S. N., de Andrade Silva, J., Matsubara, E. T., Pistori, H., Gonçalves, W. N., & Li, J. (2021) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2021.102456 · Cited by 458
Self-citationLoveDA: A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentation
Wang, J., Zheng, Z., Ma, A., Lu, X., & Zhong, Y. (2021) · arXiv · doi:10.48550/arxiv.2110.08733 · Cited by 431
Transformers in Remote Sensing: A Survey
Aleissaee, A. A., Kumar, A., Anwer, R. M., Khan, S., Cholakkal, H., Xia, G.-S., & Khan, F. S. (2023) · Remote Sensing · doi:10.3390/rs15071860 · Cited by 417
Personalize Segment Anything Model with One ShotPreprint
Zhang, R., Jiang, Z., Guo, Z., Yan, S., Pan, J., Ma, X., Dong, H., Gao, P., & Li, H. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.03048 · Cited by 396
Zheng, Z., Zhong, Y., Wang, J., & Ma, A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00415 · Cited by 343
Remote sensing image segmentation advances: A meta-analysis
Kotaridis, I., & Lazaridou, M. (2021) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2021.01.020 · Cited by 312
RSVQA: Visual Question Answering for Remote Sensing Data
Lobry, S., Marcos, D., Murray, J., & Tuia, D. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.2988782 · Cited by 305
Weakly Supervised Deep Learning for Segmentation of Remote Sensing Imagery
Wang, S., Chen, W., Xie, S. M., Azzari, G., & Lobell, D. B. (2020) · Remote Sensing · doi:10.3390/rs12020207 · Cited by 265
Research Progress on Few-Shot Learning for Remote Sensing Image Interpretation
Sun, X., Wang, B., Wang, Z., Li, H., Li, H., & Fu, K. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2021.3052869 · Cited by 239
Transformer-Based Visual Segmentation: A Survey
Li, X., Ding, H., Yuan, H., Zhang, W., Pang, J., Cheng, G., Chen, K., Liu, Z., & Loy, C. C. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3434373 · Cited by 236
Benjdira, B., Bazi, Y., Koubaa, A., & Ouni, K. (2019) · Remote Sensing · doi:10.3390/rs11111369 · Cited by 215
Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Models
Wu, C., Yin, S., Qi, W., Wang, X., Tang, Z., & Duan, N. (2023) · arXiv · doi:10.48550/arxiv.2303.04671 · Cited by 197
Osco, L. P., Arruda, M. D. S. D., Marcato Junior, J., da Silva, N. B., Ramos, A. P. M., Moryia, É. A. S., Imai, N. N., Pereira, D. R., Creste, J. E., Matsubara, E. T., et al. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.12.010 · Cited by 193
Self-citationBoguszewski, A., Batorski, D., Ziemba-Jankowska, N., Dziedzic, T., & Zambrzycka, A. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00121 · Cited by 164
Ma, A., Wang, J., Zhong, Y., & Zheng, Z. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3097148 · Cited by 164
GLIPv2: Unifying Localization and Vision-Language Understanding
Zhang, H., Zhang, P., Hu, X., Chen, Y.-C., Li, L., Dai, X., Wang, L., Yuan, L., Hwang, J.-N., & Gao, J. (2022) · neural information processing systems · doi:10.52202/068431-2614 · Cited by 162
Augmented Language Models: a Survey
Mialon, G., Dessì, R., Lomeli, M., Nalmpantis, C., Pasunuru, R., Raileanu, R., Rozière, B., Schick, T., Dwivedi-Yu, J., Celikyilmaz, A., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.07842 · Cited by 160
Jozdani, S. E., Chen, D., Pouliot, D., & Johnson, B. A. (2022) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2022.102734 · Cited by 139
samgeo: A Python package for segmenting geospatial data with the Segment Anything Model (SAM)
Wu, Q., & Osco, L. P. (2023) · The Journal of Open Source Software · doi:10.21105/joss.05663 · Cited by 121
Self-citationAI Security for Geoscience and Remote Sensing: Challenges and future trends
Xu, Y., Bai, T., Yu, W., Chang, S., Atkinson, P. M., & Ghamisi, P. (2023) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2023.3272825 · Cited by 108
Advances in geocomputation and geospatial artificial intelligence (GeoAI) for mapping
Song, Y., Kalácska, M., Gašparović, M., Yao, J., & Najibi, N. (2023) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2023.103300 · Cited by 102
Semantic Segmentation of Tree-Canopy in Urban Environment with Pixel-Wise Deep Learning
Martins, J. A. C., Nogueira, K., Osco, L. P., Gomes, F. D. G., Furuya, D. E. G., Gonçalves, W. N., Sant’Ana, D. A., Ramos, A. P. M., Liesenberg, V., dos Santos, J. A., et al. (2021) · Remote Sensing · doi:10.3390/rs13163054 · Cited by 96
Self-citationOsco, L. P., Nogueira, K., Ramos, A. P. M., Pinheiro, M. M. F., Furuya, D. E. G., Gonçalves, W. N., Jorge, L. A. D. C., Marcato, J., & dos Santos, J. A. (2021) · Precision Agriculture · doi:10.1007/s11119-020-09777-5 · Cited by 87
Self-citationZhang, X., Jin, J., Lan, Z., Li, C., Fan, M., Wang, Y., Yu, X., & Zhang, Y. (2020) · Remote Sensing · doi:10.3390/rs12020221 · Cited by 78
Semantic segmentation with labeling uncertainty and class imbalance applied to vegetation mapping
Bressan, P. O., Marcato, J., Martins, J. A. C., de Melo, M. J., Gonçalves, D. N., Freitas, D. M., Ramos, A. P. M., Furuya, M. T. G., Osco, L. P., Silva, J. D. A., et al. (2022) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2022.102690 · Cited by 67
Self-citationPanoptic Segmentation Meets Remote Sensing
de Carvalho, O. L. F., de Carvalho, O. L. F., Silva, C. R., de Albuquerque, A. O., Santana, N. C., Borges, D. L., Gomes, R. A. T., & Guimarães, R. F. (2022) · Remote Sensing · doi:10.3390/rs14040965 · Cited by 66
Wu, Z., Hou, B., Ren, B., Ren, Z., Wang, S., & Jiao, L. (2021) · Remote Sensing · doi:10.3390/rs13132582 · Cited by 65
LMM Modality Transfer: A Pre-Requisite for Autonomous GIS AgentsPreprint
Mai, G., Huang, W., Sun, J., et al. (2023) · arXiv (Cornell University) · doi:10.4230/lipics.cosit.2026.7 · Cited by 65
Transformers for mapping burned areas in Brazilian Pantanal and Amazon with PlanetScope imagery
Gonçalves, D. N., Marcato, J., Carrilho, A. C., Acosta, P. R., Ramos, A. P. M., Gomes, F. D. G., Osco, L. P., Oliveira, M. D. R., Martins, J. A. C., Damasceno‐Júnior, G. A., et al. (2022) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2022.103151 · Cited by 47
Self-citationTransforming remote sensing images to textual descriptions
Zia, U., Riaz, M. M., & Ghafoor, A. (2022) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2022.102741 · Cited by 42
Deep learning-based semantic segmentation of urban-scale 3D meshes in remote sensing: A survey
Adam, J. M., Liu, W., Zang, Y., Afzal, M. K., Bello, S. A., Muhammad, A. U., Wang, C., & Li, J. (2023) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2023.103365 · Cited by 40
Self-citationFew shot object detection in remote sensing images
Zhang, X., Zhang, H., & Jiang, Z. (2021) · Image and signal processing for remote sensing. Conference · doi:10.1117/12.2598444 · Cited by 37
A Comprehensive Survey of Optical Remote Sensing Image Segmentation Methods
Wang, Y., Lv, H., Deng, R., & Zhuang, S. (2020) · Canadian Journal of Remote Sensing · doi:10.1080/07038992.2020.1805729 · Cited by 35
Deep learning in different remote sensing image categories and applications: status and prospects
Bai, Y., Zhao, Y., Shao, Y., Zhang, X., & Yuan, X. (2022) · International Journal of Remote Sensing · doi:10.1080/01431161.2022.2048319 · Cited by 35
Zhang, R., Li, G., Wunderlich, T. A., & Wang, L. (2021) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2021.102411 · Cited by 28
Bebis, G. N., Boyle, R., Parvin, B., Koracin, D. R., Pavlidis, I. T., Feris, R., McGraw, T., Elendt, M., Kopper, R., Ragan, E. D., et al. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-27863-6 · Cited by 28
Cascaded panoptic segmentation method for high resolution remote sensing image
Hua, X., Wang, X., Rui, T., Shao, F., & Wang, D. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2021.107515 · Cited by 24
Gharibbafghi, Z., Tian, J., & Reinartz, P. H. (2018) · Remote Sensing · doi:10.3390/rs10111824 · Cited by 19
Li, K., Hu, X., Jiang, H., Shu, Z., & Zhang, M. (2020) · Remote Sensing · doi:10.3390/rs12050789 · Cited by 18
Deep learning instance segmentation framework for burnt area instances characterization
Safder, Q., Zheng, Z., Xia, J., et al. (2022) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2022.103146 · Cited by 17
Zhang, Z., Zhang, Q., Hu, X., Zhang, M., & Zhu, D. (2023) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2023.05.026 · Cited by 16
Cited by
Chen, K., Liu, C., Chen, H., Zhang, H., Li, W., Zou, Z., & Shi, Z. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3356074 · Cited by 383
El Ghazouali, S., Mhirit, Y., Oukhrid, A., Michelucci, U., & Nouira, H. (2024) · Sensors · doi:10.3390/s24092889 · Cited by 24
Metadata
- Authors
- Osco, L. P., Wu, Q., de Lemos, E. L., Gonçalves, W. N., Ramos, A. P. M., Li, J., & Marcato, J.
- Venue
- International Journal of Applied Earth Observation and Geoinformation
- Publisher
- Elsevier BV
- Published
- 2023-11
- Volume
- 124
- Pages
- 103540
- ISSN
- 0303-2434 (ISSN-L)
- 1569-8432
- OpenAlex
- W4388129777
- Cited by
- 338
- References
- 61
- FWCI
- 37.33
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.