The DOI matches its Crossref record; 83 of the 83 references it cites were found in a registry or an index.
Advancing Plain Vision Transformer Toward Remote Sensing Foundation Model
Abstract
Large-scale vision foundation models have made significant progress in visual tasks on natural images, with vision transformers (ViTs) being the primary choice due to their good scalability and representation ability. However, large-scale models in remote sensing (RS) have not yet been sufficiently explored. In this article, we resort to plain ViTs with about 100 million parameters and make the first attempt to propose large vision models tailored to RS tasks and investigate how such large models perform. To handle the large sizes and objects of arbitrary orientations in RS images, we propose a new rotated varied-size window attention to replace the original full attention in transformers, which can significantly reduce the computational cost and memory footprint while learning better object representation by extracting rich context from the generated diverse windows. Experiments on detection tasks show the superiority of our model over all state-of-the-art models, achieving 81.24% mean average precision (mAP) on the DOTA-V1.0 dataset. The results of our models on downstream classification and segmentation tasks also show competitive performance compared to existing advanced methods. Further experiments show the advantages of our models in terms of computational complexity and data efficiency in transferring. The code and models will be released athttps://github.com/ViTAE-Transformer/Remote-Sensing-RVSA.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.324 · Cited by 30,581
MobileNetV2: Inverted Residuals and Linear Bottlenecks
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., & Chen, L.-C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00474 · Cited by 28,755
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018) · arXiv · doi:10.48550/arxiv.1802.02611 · Cited by 20,063
Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_49 · Cited by 20,054
Zhao, H., Shi, J., Qi, X., Wang, X., & Jia, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.660 · Cited by 16,438
Decoupled Weight Decay Regularization
Loshchilov, I., & Hutter, F. (2017) · arXiv · doi:10.48550/arxiv.1711.05101 · Cited by 12,522
Fully convolutional networks for semantic segmentation
Shelhamer, E., Long, J., & Darrell, T. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2572683 · Cited by 11,898
Wang, X., Girshick, R., Gupta, A., & He, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00813 · Cited by 11,596
Masked Autoencoders Are Scalable Vision Learners
He, K., Chen, X., Xie, S., Li, Y., Dollar, P., & Girshick, R. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01553 · Cited by 8,489
Dual Attention Network for Scene Segmentation
Fu, J., Liu, J., Tian, H., Li, Y., Bao, Y., Fang, Z., & Lu, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00326 · Cited by 7,351
DOTA: A Large-Scale Dataset for Object Detection in Aerial Images
Xia, G.-S., Bai, X., Ding, J., Zhu, Z., Belongie, S., Luo, J., Datcu, M., Pelillo, M., & Zhang, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00418 · Cited by 3,414
Self-citationBag-of-visual-words and spatial extensions for land-use classification
Yang, Y., & Newsam, S. (2010) · Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems · doi:10.1145/1869790.1869829 · Cited by 2,969
Remote Sensing Image Scene Classification: Benchmark and State of the Art
Cheng, G., Han, J., & Lu, X. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2675998 · Cited by 2,926
Swin Transformer V2: Scaling Up Capacity and Resolution
Liu, Z., Hu, H., Lin, Y., Yao, Z., Xie, Z., Wei, Y., Ning, J., Cao, Y., Zhang, Z., Dong, L., et al. (2021) · arXiv · doi:10.48550/arxiv.2111.09883 · Cited by 2,679
On the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676
AID: A benchmark data set for performance evaluation of aerial scene classification
Xia, G.-S., Hu, J., Hu, F., Shi, B., Bai, X., Zhong, Y., Zhang, L., & Lu, X. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2685945 · Cited by 2,372
Self-citationSearching for activation functions
Ramachandran, P., Zoph, B., & Le, Q. V. (2017) · arXiv · doi:10.48550/arxiv.1710.05941 · Cited by 2,335 · cited 1×
“, a convolutional layer, a batch normalization layer, a SiLU layer [50], and a convolutional layer in sequence, to save”
BackgroundObject detection in optical remote sensing images: A survey and a new benchmark
Li, K., Wan, G., Cheng, G., Meng, L., & Han, J. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.11.023 · Cited by 2,317 · cited 10×
“0 [43] and DIOR-R [44] for evaluation.”
MethodInfluentialUnified Perceptual Parsing for Scene Understanding
Xiao, T., Liu, Y., Zhou, B., Jiang, Y., & Sun, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01228-1_26 · Cited by 2,201 · cited 3×
“First, we only use the classical segmentation framework UperNet, which can not effectively propagate highlevel semantics to the high-resolution features.”
MethodImproved Baselines with Momentum Contrastive Learning
Chen, X., Fan, H., Girshick, R., & He, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.04297 · Cited by 1,956
Learning RoI Transformer for Oriented Object Detection in Aerial Images
Ding, J., Xue, N., Long, Y., Xia, G.-S., & Lu, Q. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00296 · Cited by 1,666
Understanding the Effective Receptive Field in Deep Convolutional Neural Networks
Luo, W., Li, Y., Urtasun, R., & Zemel, R. (2017) · arXiv · doi:10.48550/arxiv.1701.04128 · Cited by 1,575
Panoptic Feature Pyramid Networks
Kirillov, A., Girshick, R., He, K., & Dollár, P. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00656 · Cited by 1,460
BEiT: BERT Pre-Training of Image Transformers
Bao, H., Dong, L., Piao, S., & Wei, F. (2021) · arXiv · doi:10.48550/arxiv.2106.08254 · Cited by 1,392
CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windows
Dong, X., Bao, J., Chen, D., Zhang, W., Yu, N., Yuan, L., Chen, D., & Guo, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01181 · Cited by 1,358
Oriented R-CNN for Object Detection
Xie, X., Cheng, G., Wang, J., Yao, X., & Han, J. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00350 · Cited by 1,351
Wang, L., Li, R., Zhang, C., Fang, S., Duan, C., Meng, X., & Atkinson, P. M. (2022) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2022.06.008 · Cited by 1,349
SimMIM: a Simple Framework for Masked Image Modeling
Xie, Z., Zhang, Z., Cao, Y., Lin, Y., Bao, J., Yao, Z., Dai, Q., & Hu, H. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00943 · Cited by 1,255
R3Det: Refined Single-Stage Detector with Feature Refinement for Rotating Object
Yang, X., Yan, J., Feng, Z., & He, T. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i4.16426 · Cited by 1,238
SNUNet-CD: A Densely Connected Siamese Network for Change Detection of VHR Images
Fang, S., Li, K., Shao, J., & Li, Z. (2022) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2021.3056416 · Cited by 1,182
Align Deep Features for Oriented Object Detection
Han, J., Ding, J., Li, J., & Xia, G.-S. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3062048 · Cited by 1,039
Gliding Vertex on the Horizontal Bounding Box for Multi-Oriented Object Detection
Xu, Y., Fu, M., Wang, Q., Wang, Y., Chen, K., Xia, G.-S., & Bai, X. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2974745 · Cited by 1,014
Self-citationSwitch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity
Fedus, W., Zoph, B., & Shazeer, N. (2021) · arXiv · doi:10.48550/arxiv.2101.03961 · Cited by 1,005
ReDet: A Rotation-equivariant Detector for Aerial Object Detection
Han, J., Ding, J., Xue, N., & Xia, G.-S. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00281 · Cited by 939
CoAtNet: Marrying Convolution and Attention for All Data Sizes
Dai, Z., Liu, H., Le, Q. V., & Tan, M. (2021) · arXiv · doi:10.48550/arxiv.2106.04803 · Cited by 925 · cited 1×
“introducing inductive bias [9], [22], [23].”
Zhai, X., Kolesnikov, A., Houlsby, N., & Beyer, L. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01179 · Cited by 891
Exploring Plain Vision Transformer Backbones for Object Detection
Li, Y., Mao, H., Girshick, R., & He, K. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-20077-9_17 · Cited by 809
Zhang, J., & Tao, D. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3039359 · Cited by 774
Self-citationChen, J., Yuan, Z., Peng, J., Chen, L., Huang, H., Zhu, J., Liu, Y., & Li, H. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2020.3037893 · Cited by 679
Oriented RepPoints for Aerial Object Detection
Li, W., Chen, Y., Hu, K., & Zhu, J. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00187 · Cited by 556
CoCa: Contrastive Captioners are Image-Text Foundation Models
Yu, J., Wang, Z., Vasudevan, V., Yeung, L., Seyedhosseini, M., & Wu, Y. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2205.01917 · Cited by 503
ViTPose: Simple Vision Transformer Baselines for Human Pose Estimation
Xu, Y., Zhang, J., Zhang, Q., & Tao, D. (2022) · neural information processing systems · doi:10.52202/068431-2795 · Cited by 501
Self-citationAnchor-Free Oriented Proposal Generator for Object Detection
Cheng, G., Wang, J., Li, K., Xie, X., Lang, C., Yao, Y., & Han, J. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3183022 · Cited by 449
Florence: A New Foundation Model for Computer Vision
Yuan, L., Chen, D., Chen, Y.-L., Codella, N., Dai, X., Gao, J., Hu, H., Huang, X., Li, B., Li, C., et al. (2021) · arXiv · doi:10.48550/arxiv.2111.11432 · Cited by 389
Seasonal Contrast: Unsupervised Pre-Training from Uncurated Remote Sensing Data
Manas, O., Lacoste, A., Giro-i-Nieto, X., Vazquez, D., & Rodriguez, P. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00928 · Cited by 354
Zheng, Z., Zhong, Y., Wang, J., & Ma, A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00415 · Cited by 343
Graph Information Aggregation Cross-Domain Few-Shot Learning for Hyperspectral Image Classification
Zhang, Y., Li, W., Zhang, M., Wang, S., Tao, R., & Du, Q. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3185795 · Cited by 340
The KFIoU Loss for Rotated Object DetectionPreprint
Yang, X. Q., Zhou, Y., Zhang, G., Yang, J., Wang, W., Yan, J., Zhang, X., & Tian, Q. C. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2201.12558 · Cited by 332
Nested Network With Two-Stream Pyramid for Salient Object Detection in Optical Remote Sensing Images
Li, C., Cong, R., Hou, J., Zhang, S., Qian, Y., & Kwong, S. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2925070 · Cited by 330
RingMo: A Remote Sensing Foundation Model With Masked Image Modeling
Sun, X., Wang, P., Lu, W., Zhu, Z., Lu, X., He, Q., Li, J., Rong, X., Yang, Z., Chang, H., et al. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3194732 · Cited by 323
Zhang, Y., Li, W., Zhang, M., Qu, Y., Tao, R., & Qi, H. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3109872 · Cited by 304
Geography-Aware Self-Supervised Learning
Ayush, K., Uzkent, B., Meng, C., Tanmay, K., Burke, M., Lobell, D., & Ermon, S. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01002 · Cited by 288
ViTAEv2: Vision Transformer Advanced by Exploring Inductive Bias for Image Recognition and Beyond
Zhang, Q., Xu, Y., Zhang, J., & Tao, D. (2023) · International Journal of Computer Vision · doi:10.1007/s11263-022-01739-w · Cited by 277
Self-citationAO2-DETR: Arbitrary-Oriented Object Detection Transformer
Dai, L., Liu, H., Tang, H., Wu, Z., & Song, P. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3222906 · Cited by 276
On Creating Benchmark Dataset for Aerial Image Interpretation: Reviews, Guidances, and Million-AID
Long, Y., Xia, G.-S., Li, S., Yang, W., Yang, M. Y., Zhu, X. X., Zhang, L., & Li, D. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2021.3070368 · Cited by 250
Self-citationAn Empirical Study of Remote Sensing Pretraining
Wang, D., Zhang, J., Du, B., Xia, G.-S., & Tao, D. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3176603 · Cited by 231
Self-citationDual-Aligned Oriented Detector
Cheng, G., Yao, Y., Li, S., Li, K., Xie, X., Wang, J., Yao, X., & Han, J. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3149780 · Cited by 188
Zhang, X., Sun, Y., Shang, K., Zhang, L., & Wang, S. (2016) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2016.2577339 · Cited by 181
Self-citationXu, K., Huang, H., Deng, P., & Li, Y. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3071369 · Cited by 179
iSAID: A Large-scale Dataset for Instance Segmentation in Aerial Images
Zamir, S. W., Arora, A., Gupta, A., Khan, S. H., Sun, G., Khan, F. S., Zhu, F., Shao, L., Xia, G.-S., & Bai, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.12886 · Cited by 168
Ma, A., Wang, J., Zhong, Y., & Zheng, Z. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3097148 · Cited by 164
Remote Sensing Scene Classification via Multi-Branch Local Attention Network
Chen, S.-B., Wei, Q.-S., Wang, W.-Z., Tang, J., Luo, B., & Wang, Z. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3127851 · Cited by 163
Remote Sensing Image Scene Classification Based on an Enhanced Attention Module
Zhao, Z., Li, J., Luo, Z., Li, J., & Chen, C. (2020) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2020.3011405 · Cited by 151
Cross-Scene Hyperspectral Image Classification With Discriminative Cooperative Alignment
Zhang, Y., Li, W., Tao, R., Peng, J., Du, Q., & Cai, Z. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3046756 · Cited by 144
Geographical Knowledge-Driven Representation Learning for Remote Sensing Images
Li, W., Chen, K., Chen, H., & Shi, Z. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3115569 · Cited by 112
Pale Transformer: A General Vision Transformer Backbone with Pale-Shaped Attention
Wu, S., Wu, T., Tan, H., & Guo, G. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i3.20176 · Cited by 110
Local Semantic Enhanced ConvNet for Aerial Scene Recognition
Bi, Q., Qin, K., Zhang, H., & Xia, G.-S. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3092816 · Cited by 93
VSA: Learning Varied-Size Window Attention in Vision Transformers
Zhang, Q., Xu, Y., Zhang, J., & Tao, D. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19806-9_27 · Cited by 93
Self-citationA Multiscale Attention Network for Remote Sensing Scene Images Classification
Zhang, G., Xu, W., Zhao, W., Huang, C., Ng, E. Y. K., Chen, Y., & Su, J. D. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2021.3109661 · Cited by 68
Zhang, T., Gao, P., Dong, H., Zhuang, Y., Wang, G., Zhang, W., & Chen, H. (2022) · Remote Sensing · doi:10.3390/rs14225675 · Cited by 67
MGML: Multigranularity Multilevel Feature Ensemble Network for Remote Sensing Scene Classification
Zhao, Q., Lyu, S., Li, Y., Ma, Y., & Chen, L. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3106391 · Cited by 62
Anchor Retouching via Model Interaction for Robust Object Detection in Aerial Images
Liang, D., Geng, Q., Wei, Z., Анатольевич, В. Д., Kim, E. L., Wei, M., & Zhou, H. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3136350 · Cited by 62
Qin, P., Cai, Y., Liu, J., Fan, P., & Sun, M. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2021.3123080 · Cited by 60
Gated Recurrent Multiattention Network for VHR Remote Sensing Image Classification
Li, B., Guo, Y., Yang, J., Wang, L., Wang, Y., & An, W. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3093914 · Cited by 59
RegionCL: Can Simple Region Swapping Contribute to Contrastive Learning?Preprint
Xu, Y., Zhang, Q., Zhang, J., & Tao, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.12309 · Cited by 22
Self-citationBest Representation Branch Model for Remote Sensing Image Scene Classification
Zhang, X., An, W., Sun, J., Wu, H., Zhang, W., & Du, Y. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2021.3114404 · Cited by 19
A Lightweight Relu-Based Feature Fusion For Aerial Scene Classification
Arefeen, M. A., Nimi, S. T., Uddin, M. Y. S., & Li, Z. (2021) · Proceedings - International Conference on Image Processing · doi:10.1109/icip42928.2021.9506524 · Cited by 15
Cited by
SpectralGPT: Spectral Remote Sensing Foundation Model
Hong, D., Zhang, B., Li, X., Li, Y., Li, C., Yao, J., Yokoya, N., Li, H., Ghamisi, P., Jia, X., et al. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3362475 · Cited by 930
Large Selective Kernel Network for Remote Sensing Object Detection
Li, Y., Hou, Q., Zheng, Z., Cheng, M.-M., Yang, J., & Li, X. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01540 · Cited by 893
A Survey on Self-Supervised Learning: Algorithms, Applications, and Future Trends
Gui, J., Chen, T., Zhang, J., Cao, Q., Sun, Z., Luo, H., & Tao, D. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3415112 · Cited by 552
Self-citationRemoteCLIP: A Vision Language Foundation Model for Remote Sensing
Liu, F., Chen, D., Guan, Z., Zhou, X., Zhu, J., Ye, Q., Fu, L., & Zhou, J. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3390838 · Cited by 507
“Several recent studies, including SatMAE [12], Scale-MAE [13], ViTAE [14], Billion-scale MAE [15], RingMo [16], and geospatial foundation models (GFM) [17], have employed MIM on large vision transformers (ViT) and large-scale satellite imagery datasets, yielding encouraging results.”
MethodArtificial intelligence for geoscience: Progress, challenges, and perspectives
Zhao, T., Wang, S., Ouyang, C., Chen, M., Liu, C., Zhang, J., Yu, L., Wang, F., Xie, Y., Li, J., et al. (2024) · The Innovation · doi:10.1016/j.xinn.2024.100691 · Cited by 360
Self-citation
Metadata
- Authors
- Wang, D., Zhang, Q., Xu, Y., Zhang, J., Du, B., Tao, D., & Zhang, L.
- Venue
- IEEE Transactions on Geoscience and Remote Sensing
- Published
- 2023
- Volume
- 61
- Pages
- 1-15
- ISSN
- 0196-2892 (ISSN-L)
- 1558-0644
- OpenAlex
- W4312795296
- Cited by
- 287
- References
- 83
- FWCI
- 20.07
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.