DeepAndes: A Self-Supervised Vision Foundation Model for Multi-Spectral Remote Sensing Imagery of the Andes
Open accessAbstract
By mapping sites at large scales using remotely sensed data, archaeologists can generate unique insights into long-term demographic trends, inter-regional social networks, and past adaptations to climate change. Remote sensing surveys complement field-based approaches, and their reach can be especially great when combined with deep learning and computer vision techniques. However, conventional supervised deep learning methods face challenges in annotating fine-grained archaeological features at scale. While recent vision foundation models have shown remarkable success in learning large-scale remote sensing data with minimal annotations, most off-the-shelf solutions are designed for RGB images rather than multi-spectral satellite imagery, such as the 8-band data used in our study. In this paper, we introduce DeepAndes, a transformer-based vision foundation model trained on three million multi-spectral satellite images, specifically tailored for Andean archaeology. DeepAndes incorporates a customized DINOv2 self-supervised learning algorithm optimized for 8-band multi-spectral imagery, marking the first foundation model designed explicitly for the Andes region. We evaluate its image understanding performance through imbalanced image classification, image instance retrieval, and pixel-level semantic segmentation tasks. Our experiments show that DeepAndes achieves superior F1 scores, mean average precision, and Dice scores in few-shot learning scenarios, significantly outperforming models trained from scratch or pre-trained on smaller datasets. This underscores the effectiveness of large-scale self-supervised pre-training in archaeological remote sensing. Codes will be available on https://github.com/geopacha/DeepAndes.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · see citing works
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · see citing works
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · see citing works
Momentum Contrast for Unsupervised Visual Representation Learning
He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00975 · Cited by 13,347 · see citing works
Emerging Properties in Self-Supervised Vision Transformers
Caron, M., Touvron, H., Misra, I., Jegou, H., Mairal, J., Bojanowski, P., & Joulin, A. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00951 · Cited by 5,638 · cited 4× · see citing works
“1) DINOv2 Architecture: DINOv2 (and its earlier variant DINO [8]) employs a contrastive learning framework with Authorized licensed use limited to the terms of the applicable license agreement with IEEE.”
InfluentialSelf-Supervised Visual Feature Learning With Deep Neural Networks: A Survey
Jing, L., & Tian, Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2992393 · Cited by 2,036 · see citing works
SpectralGPT: Spectral Remote Sensing Foundation Model
Hong, D., Zhang, B., Li, X., Li, Y., Li, C., Yao, J. T., Yokoya, N., Li, H., Ghamisi, P., Jia, X., et al. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3362475 · Cited by 1,002 · see citing works
A survey on addressing high-class imbalance in big data
Leevy, J. L., Khoshgoftaar, T. M., Bauder, R. A., & Seliya, N. (2018) · Journal Of Big Data · doi:10.1186/s40537-018-0151-6 · Cited by 777 · see citing works
A comprehensive survey on pretrained foundation models: a history from BERT to ChatGPT
Zhou, C., Li, Q., Li, C., Yu, J., Liu, Y., Wang, G., Zhang, K., Ji, C., Yan, Q., He, L., et al. (2024) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-024-02443-6 · Cited by 704 · see citing works
A foundation model for clinical-grade computational pathology and rare cancers detection
Vorontsov, E., Bozkurt, A., Casson, A., Shaikovski, G., Zelechowski, M., Severson, K., Zimmermann, E., Hall, J., Tenenholtz, N., Fusi, N., et al. (2024) · Nature Medicine · doi:10.1038/s41591-024-03141-0 · Cited by 572 · see citing works
RemoteCLIP: A Vision Language Foundation Model for Remote Sensing
Liu, F., Chen, D., Guan, Z., Zhou, X., Zhu, J., Ye, Q., Fu, L., & Zhou, J. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3390838 · Cited by 507 · see citing works
Self-citationDouze, M., Guzhva, A., Deng, C., Johnson, J., Szilvasy, G., Mazaré, P.-E., Lomeli, M., Hosseini, L., & Jégou, H. (2026) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2025.3618474 · Cited by 478 · see citing works
U-KAN Makes Strong Backbone for Medical Image Segmentation and Generation
Li, C., Liu, X., Li, W., Wang, C., Liu, H., Liu, Y., Chen, Z., & Yuan, Y. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i5.32491 · Cited by 471 · see citing works
Machine Learning and Deep Learning Applications-A Vision
Sharma, N., Sharma, R., & Jindal, N. (2021) · Global Transitions Proceedings · doi:10.1016/j.gltp.2021.01.004 · Cited by 466 · see citing works
Transfer learning in environmental remote sensing
Ma, Y., Chen, S., Ermon, S., & Lobell, D. B. (2023) · Remote Sensing of Environment · doi:10.1016/j.rse.2023.113924 · Cited by 448 · see citing works
Foundation Models Defining a New Era in Vision: A Survey and Outlook
Awais, M., Naseer, M., Khan, S., Anwer, R. M., Cholakkal, H., Shah, M., Yang, M.-H., & Khan, F. S. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3506283 · Cited by 304 · see citing works
Orfeo ToolBox: open source processing of remote sensing images
Grizonnet, M., Michel, J., Poughon, V., Inglada, J., Savinaud, M., & Cresson, R. (2017) · Open Geospatial Data Software and Standards · doi:10.1186/s40965-017-0031-6 · Cited by 301 · see citing works
Guo, X., Lao, J., Dang, B., Zhang, Y., Yu, L., Ru, L., Zhong, L., Huang, Z., Wu, K., Hu, D., et al. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.02613 · Cited by 290 · see citing works
Overview of URBAN 2000: A Multiscale Field Study of Dispersion through an Urban Environment
Allwine, K. J., Shinn, J. H., Streit, G. E., Clawson, K. L., & Brown, M. J. (2002) · Bulletin of the American Meteorological Society · doi:10.1175/1520-0477(2002)083 · Cited by 217 · see citing works
Vision Foundation Models in Remote Sensing: A survey
Lu, S., Guo, J., Zimmer-Dauphinee, J. R., Nieusma, J. M., Wang, X., VanValkenburgh, P., Wernke, S. A., & Huo, Y. (2025) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2025.3541952 · Cited by 145 · see citing works
Self-citationFuller, R. M., Groom, G. B., Mugisha, S., Ipulet, P., Pomeroy, D. E., Katende, A., BAILEY, R. G., & Ogutu‐Ohwayo, R. (1998) · Biological Conservation · doi:10.1016/s0006-3207(98)00005-6 · Cited by 141 · see citing works
Mediterranean Islands, Fragile Communities and Persistent Landscapes
Bevan, A., & Conolly, J. (2013) · Cambridge University Press eBooks · doi:10.1017/cbo9781139519748 · Cited by 88 · see citing works
Long-Term Demographic Change: A Perspective from the Valley of Oaxaca, Mexico
Feinman, G. M., Kowalewski, S. A., Finsten, L. M., Blanton, R. E., & Nicholas, L. M. (1985) · Journal of Field Archaeology · doi:10.1179/jfa.1985.12.3.333 · Cited by 84 · see citing works
Self-Supervised Material and Texture Representation Learning for Remote Sensing Tasks
Akiva, P., Purri, M., & Leotta, M. J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00803 · Cited by 75 · see citing works
Rethinking Transformers Pre-training for Multi-Spectral Satellite Imagery
Noman, M., Naseer, M., Cholakkal, H., Anwer, R. M., Khan, S., & Khan, F. S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02627 · Cited by 74 · see citing works
Regional-Scale Archaeological Remote Sensing in the Age of Big Data
Casana, J. (2014) · Advances in Archaeological Practice · doi:10.7183/2326-3768.2.3.222 · Cited by 65 · see citing works
Extending global-local view alignment for self-supervised learning with remote sensing imagery
Wanyan, X., Seneviratne, S., Shen, S., & Kirley, M. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00251 · Cited by 49 · see citing works
Brain-Inspired Remote Sensing Foundation Models and Open Problems: A Comprehensive Survey
Jiao, L., Huang, Z., Lu, X., Liu, X., Yang, Y., Zhao, J., Zhang, J., Hou, B., Yang, S., Liu, F., et al. (2023) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2023.3316302 · Cited by 45 · see citing works
Self-citationBig Archaeology: Horizons and Blindspots
VanValkenburgh, P., & Dufton, J. A. (2020) · Journal of Field Archaeology · doi:10.1080/00934690.2020.1714307 · Cited by 44 · see citing works
Self-citationPrehispanic Settlement Patterns in the Upper Mantaro and Tarma Drainages, Junín, Peru
Parsons, J. R., Hastings, C. M., & Mendieta, R. M. (2000) · doi:10.3998/mpub.11395652 · Cited by 43 · see citing works
On-Site Recording of Excavation Data Using Mobile GIS
Tripcevich, N., & Wernke, S. A. (2010) · Journal of Field Archaeology · doi:10.1179/009346910x12707321242511 · Cited by 28 · see citing works
Self-citationWernke, S. A., VanValkenburgh, P., Zimmer-Dauphinee, J. R., Whitlock, B., Morrow, G. S., Smith, R., Smit, D. K., Ortega, G. R., Jara, K. R., Plekhov, D., et al. (2023) · Antiquity · doi:10.15184/aqy.2023.177 · Cited by 21 · see citing works
Self-citationSakai, M., Sakurai, A., Lu, S., Olano, J., Albrecht, C. M., Hamann, H. F., & Freitag, M. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2407652121 · Cited by 18 · see citing works
Self-citationFeng, Y., Wang, P., Diao, W., et al. (2023) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss52108.2023.10282433 · Cited by 10 · see citing works
An Agenda for Multimodal Foundation Models for Earth Observation
Dias, P. A., Potnis, A. V., Guggilam, S., et al. (2023) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss52108.2023.10282966 · Cited by 10 · see citing works
Li, Y., Tan, J., Dang, B., Ye, M., Bartalev, S. A., Шинкаренко, С. С., Wang, L., Zhang, Y., Ru, L., Guo, X., et al. (2025) · The Innovation · doi:10.1016/j.xinn.2025.100841 · Cited by 7 · see citing works
ASIGN: An Anatomy-aware Spatial Imputation Graphic Network for 3D Spatial Transcriptomics
Zhu, J., Deng, R., Yao, T., Xiong, J., Qu, C., Guo, J., Lu, S., Yin, M., Wang, Y., Zhao, S., et al. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02871 · Cited by 7 · see citing works
Self-citationYue, J., Yao, T., Deng, R., Lu, S., Guo, J., Liu, Q., Xiong, J., Yin, M., Yang, H., & Huo, Y. (2025) · Journal of Pathology Informatics · doi:10.1016/j.jpi.2025.100433 · Cited by 5 · see citing works
Self-citationXu, J., Guo, J., Zimmer-Dauphinee, J. R., Liu, Q., Shi, Y., Asad, Z., Wilkes, D. M., VanValkenburgh, P., Wernke, S. A., & Huo, Y. (2023) · International Journal of Remote Sensing · doi:10.1080/01431161.2023.2192879 · Cited by 4 · see citing works
Self-citationCui, C., Deng, R., Guo, J., et al. (2024) · IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI ...) · doi:10.1109/bhi62660.2024.10913563 · Cited by 3 · see citing works
Self-citationAssessment of cell nuclei AI foundation models in kidney pathology
Guo, J., Lu, S., Cui, C., Deng, R., Yao, T., Tao, Z., Lin, Y., Lionts, M., Liu, Q., Xiong, J., et al. (2025) · SPIE Medical Imaging: Image Perception, Observer Performance, and Technology Assessment · doi:10.1117/12.3047301 · Cited by 3 · see citing works
Self-citationTshFNA-Examiner: A Nuclei Segmentation and Cancer Assessment Framework for Thyroid Cytology Image
Ke, J., Zhu, J., Yang, X., Zhang, H., Sun, Y., Wang, J. E., Lu, Y., Shen, Y., Liu, S., Jiang, F., et al. (2024) · Journal of Shanghai Jiaotong University (Science) · doi:10.1007/s12204-024-2743-y · Cited by 1 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Still being checked.
- Authors
- Guo, J., Zimmer-Dauphinee, J. R., Nieusma, J. M., Lu, S., Liu, Q., Deng, R., Cui, C., Yue, J., Lin, Y., Yao, T., Xiong, J., Zhu, J., Qu, C., Yang, Y., Wilkes, M., Wang, X., VanValkenburgh, P., Wernke, S. A., & Huo, Y.
- Affiliations
- Vanderbilt University (US)
- Oak Ridge National Laboratory (US)
- Brown University (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2025
- Volume
- 18
- Pages
- 26983-26999
- ISSN
- 1939-1404 (ISSN-L)
- arXiv
- 2504.20303
- OpenAlex
- W4414955865
- Cited by
- 7
- References
- 42
- Citations by year
- 2026: 5 · 2025: 2
- FWCI
- 1.96
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- arXiv (Cornell University)
- Funders
- National Science Foundation (DEAC05- 00OR22725, 2419794, 2106717, 2419793)
- U.S. Department of Energy (AC05-00OR22725, DE--AC05--00OR22725)
- Battelle (DE-AC05- 00OR22725, AC05-00OR22725, DE-AC05)
- Vanderbilt University
- Oak Ridge National Laboratory (AC05-00OR22725, DE-AC05-00OR22725)
- Topics
- Physical Sciences › Engineering › Media Technology › Remote-Sensing Image Classification
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Earth and Planetary Sciences › Space and Planetary Science › Archaeological Research and Protection
- Keywords
- vision foundation models, self-supervised learning, DINOv2, multispectral satellite imagery, Andean archaeology, archaeological site detection, remote sensing in archaeology, transformer models, semantic segmentation, image retrieval, few-shot learning, imbalanced classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review