Self-Supervised Learning in Remote Sensing: A review
Open accessThe DOI matches its Crossref record; 263 of the 265 references it cites were found in a registry or an index.
Abstract
In deep learning research, self-supervised learning (SSL) has received great attention, triggering interest within both the computer vision and remote sensing communities. While there has been big success in computer vision, most of the potential of SSL in the domain of Earth observation remains locked. In this article, we provide an introduction to and a review of the concepts and latest developments in SSL for computer vision in the context of remote sensing. Further, we provide a preliminary benchmark of modern SSL algorithms on popular remote sensing datasets, verifying the potential of SSL in remote sensing and providing an extended study on data augmentations. Finally, we identify a list of promising directions of future research in SSL for Earth observation (SSL4EO) to pave the way for the fruitful interaction of both domains.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
FaceNet: A unified embedding for face recognition and clustering
Schroff, F., Kalenichenko, D., & Philbin, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298682 · Cited by 15,267
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
Momentum Contrast for Unsupervised Visual Representation Learning
He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00975 · Cited by 13,347
Jain, A. K., Murty, M. N., & Flynn, P. J. (1999) · ACM Computing Surveys · doi:10.1145/331499.331504 · Cited by 13,199
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235
Wold, S., Esbensen, K., & Geladi, P. (1987) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/0169-7439(87)80084-9 · Cited by 11,606
Abdi, H., & Williams, L. J. (2010) · WIREs Computational Statistics · doi:10.1002/wics.101 · Cited by 11,104
A simple framework for contrastive learning of visual representations
Chen, T., Kornblith, S., Norouzi, M., & Hinton, G. (2020) · arXiv · doi:10.48550/arxiv.2002.05709 · Cited by 10,857
Masked Autoencoders Are Scalable Vision Learners
He, K., Chen, X., Xie, S., Li, Y., Dollar, P., & Girshick, R. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01553 · Cited by 8,489
A Comprehensive Survey on Transfer Learning
Zhuang, F., Qi, Z., Duan, K., Xi, D., Zhu, Y., Zhu, H., Xiong, H., & He, Q. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2020.3004555 · Cited by 6,678 · cited 1×
“This procedure is commonly referred to as transfer learning [16].”
Representation Learning with Contrastive Predictive Coding
Oord, A. V. D., Li, Y., & Vinyals, O. (2018) · arXiv · doi:10.48550/arxiv.1807.03748 · Cited by 6,242 · cited 5×
“Contrastive Predictive Coding (CPC) [71].”
BackgroundMethodInfluentialEmerging Properties in Self-Supervised Vision Transformers
Caron, M., Touvron, H., Misra, I., Jégou, H., Mairal, J., Bojanowski, P., & Joulin, A. (2021) · arXiv · Cited by 5,932
Context Encoders: Feature Learning by Inpainting
Pathak, D., Krahenbuhl, P., Donahue, J., Darrell, T., & Efros, A. A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.278 · Cited by 5,691
Emerging Properties in Self-Supervised Vision Transformers
Caron, M., Touvron, H., Misra, I., Jegou, H., Mairal, J., Bojanowski, P., & Joulin, A. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00951 · Cited by 5,638 · cited 3×
“Among these, two popular techniques are kernel visualization [49, 50, 51] for CNN and feature map visualization [49, 52, 53] for both CNN and ViT.”
BackgroundMethodError Detecting and Error Correcting Codes
Hamming, R. W. (1950) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1950.tb00463.x · Cited by 5,377
Tarvainen, A., & Valpola, H. (2017) · arXiv · doi:10.48550/arxiv.1703.01780 · Cited by 4,275
(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1953039 · Cited by 4,051
Distance Metric Learning for Large Margin Nearest Neighbor Classification
Weinberger, K. Q., & Saul, L. K. (2009) · Journal of Machine Learning Research · doi:10.5555/1577069.1577078 · Cited by 4,044
Learning a Similarity Metric Discriminatively, with Application to Face Verification
Chopra, S., Hadsell, R., & LeCun, Y. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.202 · Cited by 4,036
Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning
Grill, J.-B., Strub, F., Altché, F., Tallec, C., Richemond, P. H., Buchatskaya, E., Doersch, C., Pires, B. A., Guo, Z. D., Azar, M. G., et al. (2020) · arXiv · doi:10.48550/arxiv.2006.07733 · Cited by 3,846 · cited 2×
“Bootstrap Your Own Latent (BYOL) [83].”
BackgroundVariational Inference: A Review for Statisticians
Blei, D. M., Kucukelbir, A., & McAuliffe, J. D. (2017) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1285773 · Cited by 3,811
Exploring Simple Siamese Representation Learning
Chen, X., & He, K. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01549 · Cited by 3,725
Unsupervised Feature Learning via Non-parametric Instance Discrimination
Wu, Z., Xiong, Y., Yu, S. X., & Lin, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00393 · Cited by 3,664
Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources
Zhu, X. X., Tuia, D., Mou, L., Xia, G.-S., Zhang, L., Xu, F., & Fraundorfer, F. (2017) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2017.2762307 · Cited by 3,400
Self-citationZhang, R., Isola, P., & Efros, A. A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46487-9_40 · Cited by 3,178
Noise-contrastive estimation: A new estimation principle for unnormalized statistical models
Gutmann, M. U., & Hyvärinen, A. (2010) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 2,992
Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles
Noroozi, M., & Favaro, P. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_5 · Cited by 2,775 · cited 2×
“For example, Noroozi et al. [63] built a jigsaw puzzle from randomly ordered tiles of an image.”
BackgroundDeep Clustering for Unsupervised Learning of Visual Features
Caron, M., Bojanowski, P., Joulin, A., & Douze, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_9 · Cited by 2,674
A survey on semi-supervised learning
van Engelen, J. E., & Hoos, H. H. (2020) · Machine Learning · doi:10.1007/s10994-019-05855-6 · Cited by 2,666
Unsupervised Visual Representation Learning by Context Prediction
Doersch, C., Gupta, A., & Efros, A. A. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.167 · Cited by 2,629
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments
Caron, M., Misra, I., Mairal, J., Goyal, P., Bojanowski, P., & Joulin, A. (2020) · arXiv · doi:10.48550/arxiv.2006.09882 · Cited by 2,499
Unsupervised Representation Learning by Predicting Image Rotations
Gidaris, S., Singh, P., & Komodakis, N. (2018) · arXiv · doi:10.48550/arxiv.1803.07728 · Cited by 2,477 · cited 3×
“Among others, predicting rotation angles [49, 128] and image inpainting [64, 129] are popular approaches.”
BackgroundMethodDeep learning in remote sensing applications: A meta-analysis and review
Ma, L., Liu, Y., Zhang, X., Ye, Y., Yin, G., & Johnson, B. A. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.04.015 · Cited by 2,456
Globally and locally consistent image completion
Iizuka, S., Simo-Serra, E., & Ishikawa, H. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073659 · Cited by 2,203 · cited 1×
“Among others, predicting rotation angles [49, 128] and image inpainting [64, 129] are popular approaches.”
BackgroundDesigning Network Design Spaces
Radosavovic, I., Kosaraju, R. P., Girshick, R., He, K., & Dollar, P. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01044 · Cited by 2,084
Self-Supervised Visual Feature Learning With Deep Neural Networks: A Survey
Jing, L., & Tian, Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2992393 · Cited by 2,036 · cited 1×
“While there exist comprehensive surveys of SSL in computer vision [9]–[12], a didactic and up-to-date introduction to the remote sensing community is missing.”
BackgroundTian, Y., Krishnan, D., & Isola, P. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58621-8_45 · Cited by 1,997
Learning deep representations by mutual information estimation and maximization
Hjelm, R. D., Fedorov, A., Lavoie-Marchildon, S., Grewal, K., Bachman, P., Trischler, A., & Bengio, Y. (2018) · arXiv · doi:10.48550/arxiv.1808.06670 · Cited by 1,991
Improved Baselines with Momentum Contrastive Learning
Chen, X., Fan, H., Girshick, R., & He, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.04297 · Cited by 1,956
EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classification
Helber, P., Bischke, B., Dengel, A., & Borth, D. (2019) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2019.2918242 · Cited by 1,951 · cited 2×
“In addition, we use EuroSAT [248] for transfer learning evaluation, which is a small single-label land cover classification dataset containing 27,000 64*64 Sentinel-2 patches.”
MethodA brief introduction to weakly supervised learning
Zhou, Z.-H. (2018) · National Science Review · doi:10.1093/nsr/nwx106 · Cited by 1,899
Unsupervised Learning of Video Representations using LSTMs
Srivastava, N., Mansimov, E., & Salakhutdinov, R. (2015) · arXiv · doi:10.48550/arxiv.1502.04681 · Cited by 1,861
An Empirical Study of Training Self-Supervised Vision Transformers
Chen, X., Xie, S., & He, K. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00950 · Cited by 1,648 · cited 4×
“The authors also proposed a Transformer version, MoCo-v3 [77], by replacing the ResNet [17] backbone of the encoder to a ViT [18].”
BackgroundMethodInfluentialMakhzani, A., Shlens, J., Jaitly, N., Goodfellow, I., & Frey, B. (2015) · arXiv · doi:10.48550/arxiv.1511.05644 · Cited by 1,579
Self-Supervised Learning of Pretext-Invariant Representations
Misra, I., & van der Maaten, L. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00674 · Cited by 1,435 · cited 4×
“In addition, Misra and van der Maaten [74] proposed pretext-invariant representation learning (PIRL), using pretext tasks in predictive SSL to transform the input image and let the model learn the invariances.”
BackgroundMethodInfluentialPossible Principles Underlying the Transformations of Sensory Messages
Barlow, H. B. (2012) · Sensory Communication · doi:10.7551/mitpress/9780262518420.003.0013 · Cited by 1,269
Cheng, G., Yang, C., Yao, X., Guo, L., & Han, J. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2783902 · Cited by 1,226
Discriminative Unsupervised Feature Learning with Convolutional Neural NetworksPreprint
Dosovitskiy, A., Springenberg, J. T., Riedmiller, M., & Brox, T. (2014) · arXiv (Cornell University) · Cited by 1,153
Self-supervised Learning: Generative or Contrastive
Liu, X., Zhang, F., Hou, Z., Mian, L., Wang, Z., Zhang, J., & Tang, J. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3090866 · Cited by 1,087
Data-Efficient Image Recognition with Contrastive Predictive Coding
Hénaff, O. J., Srinivas, A., De Fauw, J., Razavi, A., Doersch, C., Eslami, S. M. A., & Oord, A. V. D. (2019) · arXiv · doi:10.48550/arxiv.1905.09272 · Cited by 1,014
Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation
Zhang, L., Song, J., Gao, A., Chen, J., Bao, C., & Ma, K. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00381 · Cited by 954
Learning Representations for Automatic Colorization
Larsson, G., Maire, M., & Shakhnarovich, G. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_35 · Cited by 946 · cited 1×
“The work was further extended to hue/chroma color space, and per-pixel color histograms were applied for better representation learning [137].”
MethodShuffle and Learn: Unsupervised Learning Using Temporal Order Verification
Misra, I., Zitnick, C. L., & Hebert, M. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_32 · Cited by 779
Open access to Earth land-cover map
Jun, C., Ban, Y., & Li, S. (2014) · Nature · doi:10.1038/514434c · Cited by 773
What makes for good views for contrastive learning
Tian, Y., Sun, C., Poole, B., Krishnan, D., Schmid, C., & Isola, P. (2020) · arXiv · doi:10.48550/arxiv.2005.10243 · Cited by 773
A review of deep learning methods for semantic segmentation of remote sensing imagery
Yuan, X., Shi, J., & Gu, L. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.114417 · Cited by 766
Unsupervised Learning for Physical Interaction through Video Prediction
Finn, C., Goodfellow, I., & Levine, S. (2016) · arXiv · doi:10.48550/arxiv.1605.07157 · Cited by 759
Barlow Twins: Self-Supervised Learning via Redundancy Reduction
Žbontar, J., Jing, L., Misra, I., LeCun, Y., & Deny, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.03230 · Cited by 751
Generative Adversarial Networks for Hyperspectral Image Classification
Zhu, L., Chen, Y., Ghamisi, P., & Benediktsson, J. A. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2805286 · Cited by 734
Unsupervised Deep Feature Extraction for Remote Sensing Image Classification
Romero, A., Gatta, C., & Camps-Valls, G. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2015.2478379 · Cited by 729
Li, Y., Hu, P., Liu, Z., Peng, D., Zhou, J. T., & Peng, X. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i10.17037 · Cited by 714
Kulis, B. (2013) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000019 · Cited by 672
Split-Brain Autoencoders: Unsupervised Learning by Cross-Channel Prediction
Zhang, R., Isola, P., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.76 · Cited by 616
Donahue, J., Krähenbühl, P., & Darrell, T. J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.09782 · Cited by 616
Prototypical Contrastive Learning of Unsupervised Representations
Li, J., Zhou, P., Xiong, C., & Hoi, S. C. H. (2020) · arXiv · doi:10.48550/arxiv.2005.04966 · Cited by 611
Multi-task Self-Supervised Visual Learning
Doersch, C., & Zisserman, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.226 · Cited by 598
Adversarially Learned Inference
Dumoulin, V., Belghazi, M. I., Poole, B., Mastropietro, O., Lamb, A., Arjovsky, M., & Courville, A. C. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.00704 · Cited by 579
Unsupervised Representation Learning by Sorting Sequences
Lee, H.-Y., Huang, J.-B., Singh, M., & Yang, M.-H. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.79 · Cited by 534
Bigearthnet: A Large-Scale Benchmark Archive for Remote Sensing Image Understanding
Sumbul, G., Charfuelan, M., Demir, B., & Markl, V. (2019) · IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium · doi:10.1109/igarss.2019.8900532 · Cited by 534
Decomposing Motion and Content for Natural Video Sequence Prediction
Villegas, R., Yang, J., Hong, S., Lin, X., & Lee, H. (2017) · arXiv · doi:10.48550/arxiv.1706.08033 · Cited by 488 · cited 1×
“Provided its superior performance to model temporal dynamics, LSTM [127] or LSTM variants dominate existing methods to encode temporal correlation in video data [141, 142, 143].”
MethodOn Variational Bounds of Mutual Information
Poole, B., Ozair, S., Oord, A. V. D., Alemi, A. A., & Tucker, G. (2019) · arXiv · doi:10.48550/arxiv.1905.06922 · Cited by 480 · cited 1×
“InfoNCE loss is also connected to mutual information, as minimizing the InfoNCE loss can be seen as maximizing a lower bound of the mutual information between f ( x ) and f ( x + ) [170].”
BackgroundDeep learning for remote sensing image classification: A survey
Li, Y., Zhang, H., Xue, X., Jiang, Y., & Shen, Q. (2018) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1264 · Cited by 472
Colorization as a Proxy Task for Visual Understanding
Larsson, G., Maire, M., & Shakhnarovich, G. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.96 · Cited by 458
Deep Learning for Change Detection in Remote Sensing Images: Comprehensive Review and Meta-Analysis
Khelifi, L., & Mignotte, M. (2020) · IEEE Access · doi:10.1109/access.2020.3008036 · Cited by 441
Learning Features by Watching Objects Move
Pathak, D., Girshick, R., Dollar, P., Darrell, T., & Hariharan, B. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.638 · Cited by 436
Optical flow modeling and computation: A survey
Fortun, D., Bouthemy, P., & Kervrann, C. (2015) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2015.02.008 · Cited by 431
Unsupervised Feature Learning for Aerial Scene Classification
Cheriyadat, A. M. (2014) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2013.2241444 · Cited by 421
Self-Supervised Video Representation Learning with Odd-One-Out Networks
Fernando, B., Bilen, H., Gavves, E., & Gould, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.607 · Cited by 421 · cited 1×
“Frame order prediction in self-supervised learning can be further divided into two distinct approaches: (1) temporal order verification [144, 145, 146, 147], and (2) temporal order recognition [148, 149, 66].”
BackgroundBig Self-Supervised Models are Strong Semi-Supervised Learners
Chen, T., Kornblith, S., Swersky, K., Norouzi, M., & Hinton, G. E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.10029 · Cited by 421
Local Aggregation for Unsupervised Learning of Visual Embeddings
Zhuang, C., Zhai, A., & Yamins, D. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00610 · Cited by 417
Self-Supervised Spatiotemporal Learning via Video Clip Order Prediction
Xu, D., Xiao, J., Zhao, Z., Shao, J., Xie, D., & Zhuang, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01058 · Cited by 415
Deep Learning Meets Hyperspectral Image Analysis: A Multidisciplinary Review
Signoroni, A., Savardi, M., Baronio, A., & Benini, S. (2019) · Journal of Imaging · doi:10.3390/jimaging5050052 · Cited by 385
Exploring Simple Siamese Representation Learning
Chen, X., & He, K. (2020) · arXiv · doi:10.48550/arxiv.2011.10566 · Cited by 381
Ambient Sound Provides Supervision for Visual Learning
Owens, A., Wu, J., McDermott, J. H., Freeman, W. T., & Torralba, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_48 · Cited by 373
Schmitt, M., Hughes, L. H., Qiu, C., & Zhu, X. X. (2019) · ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences · doi:10.5194/isprs-annals-iv-2-w7-153-2019 · Cited by 372
Self-citationModular learning in neural networks
Ballard, D. H. (1987) · National Conference on Artificial Intelligence · Cited by 362
Deep Learning Meets SAR: Concepts, models, pitfalls, and perspectives
Zhu, X. X., Montazeri, S., Ali, M., Hua, Y., Wang, Y., Mou, L., Shi, Y., Xu, F., & Bamler, R. (2021) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2020.3046356 · Cited by 357
Self-citationSeasonal Contrast: Unsupervised Pre-Training from Uncurated Remote Sensing Data
Manas, O., Lacoste, A., Giro-i-Nieto, X., Vazquez, D., & Rodriguez, P. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00928 · Cited by 354
Large Scale Adversarial Representation Learning
Donahue, J., & Simonyan, K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.02544 · Cited by 351
(2019) · neural information processing systems · Cited by 350
Fuzzy clustering algorithms for unsupervised change detection in remote sensing images
Ghosh, A., Mishra, N. S., & Ghosh, S. (2011) · Information Sciences · doi:10.1016/j.ins.2010.10.016 · Cited by 345
VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning
Bardes, A., Ponce, J., & LeCun, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.04906 · Cited by 330
Vanschoren, J. (2019) · The Springer Series on Challenges in Machine Learning · doi:10.1007/978-3-030-05318-5_2 · Cited by 328
Representation Learning by Learning to Count
Noroozi, M., Pirsiavash, H., & Favaro, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.628 · Cited by 324
Self-Supervised Video Representation Learning with Space-Time Cubic Puzzles
Kim, D., Cho, D., & Kweon, I. S. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33018545 · Cited by 319
Semisupervised Neural Networks for Efficient Hyperspectral Image Classification
Ratle, F., Camps-Valls, G., & Weston, J. (2010) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2009.2037898 · Cited by 316
Learning and Using the Arrow of Time
Wei, D., Lim, J., Zisserman, A., & Freeman, W. T. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00840 · Cited by 315
Understanding self-supervised Learning Dynamics without Contrastive PairsPreprint
Tian, Y., Chen, X., & Ganguli, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.06810 · Cited by 300
Boosting Self-Supervised Learning via Knowledge Transfer
Noroozi, M., Vinjimoor, A., Favaro, P., & Pirsiavash, H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00975 · Cited by 296
Zhang, P., Gong, M., Su, L., Liu, J., & Li, Z. (2016) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2016.02.013 · Cited by 294
Mou, L., Ghamisi, P., & Zhu, X. X. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2748160 · Cited by 294
Self-citationMultiobjective Genetic Clustering for Pixel Classification in Remote Sensing Imagery
Bandyopadhyay, S., Maulik, U., & Mukhopadhyay, A. (2007) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2007.892604 · Cited by 289
Remote Sensing Scene Classification by Unsupervised Representation Learning
Lu, X., Zheng, X., & Yuan, Y. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2702596 · Cited by 288
Geography-Aware Self-Supervised Learning
Ayush, K., Uzkent, B., Meng, C., Tanmay, K., Burke, M., Lobell, D., & Ermon, S. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01002 · Cited by 288
X-ModalNet: A semi-supervised deep cross-modal network for classification of remote sensing data
Hong, D., Yokoya, N., Xia, G.-S., Chanussot, J., & Zhu, X. X. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.06.014 · Cited by 257
Self-citationHong, D., Yokoya, N., Ge, N., Chanussot, J., & Zhu, X. X. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2018.10.006 · Cited by 256
Self-citationHill, B., Roger, T., & Vorhagen, F. W. (1997) · ACM Transactions on Graphics · doi:10.1145/248210.248212 · Cited by 255
On Mutual Information Maximization for Representation Learning
Tschannen, M., Djolonga, J., Rubenstein, P. K., Gelly, S., & Lučić, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.13625 · Cited by 253
EndNet: Sparse AutoEncoder Network for Endmember Extraction and Hyperspectral Unmixing
Ozkan, S., Kaya, B., & Akar, G. B. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2856929 · Cited by 244
Zabalza, J., Ren, J., Yang, M., Zhang, Y., Wang, J., Marshall, S., & Han, J. (2014) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2014.04.006 · Cited by 242
Hong, D., Gao, L., Yao, J., Yokoya, N., Chanussot, J., Heiden, U., & Zhang, B. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3082289 · Cited by 234
XCiT: Cross-Covariance Image Transformers
El-Nouby, A., Touvron, H., Caron, M., Bojanowski, P., Douze, M., Joulin, A., Ivan Laptev, A., Neverova, N., Synnaeve, G., Verbeek, J. J., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.09681 · Cited by 227
Self-Supervised Representation Learning by Rotation Feature Decoupling
Feng, Z., Xu, C., & Tao, D. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01061 · Cited by 225
CoSpace: Common Subspace Learning From Hyperspectral-Multispectral Correspondences
Hong, D., Yokoya, N., Chanussot, J., & Zhu, X. X. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2890705 · Cited by 221
Self-citationUnsupervised Learning Based On Artificial Neural Network: A Review
Dike, H. U., Zhou, Y., Deveerasetty, K. K., & Wu, Q. (2018) · 2018 IEEE International Conference on Cyborg and Bionic Systems (CBS) · doi:10.1109/cbs.2018.8612259 · Cited by 216
Self-Supervised Pretraining of Transformers for Satellite Image Time Series Classification
Yuan, Y., & Lin, L. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2020.3036602 · Cited by 204
Exploring Vision Transformers for Polarimetric SAR Image Classification
Dong, H., Zhang, L., & Zou, B. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3137383 · Cited by 204
iBOT: Image BERT Pre-Training with Online Tokenizer
Zhou, J., Wei, C., Wang, H., Shen, W., Xie, C., Yuille, A., & Kong, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.07832 · Cited by 201
Masked Autoencoders Are Scalable Vision Learners
He, K., Chen, X., Xie, S., Li, Y., Dollár, P., & Girshick, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.06377 · Cited by 198
Semisupervised Self-Learning for Hyperspectral Image Classification
Dopido, I., Li, J., Marpu, P. R., Plaza, A., Bioucas Dias, J. M., & Benediktsson, J. A. (2013) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2012.2228275 · Cited by 194
Cross-Domain Self-Supervised Multi-task Feature Learning Using Synthetic Imagery
Ren, Z., & Lee, Y. J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00086 · Cited by 190
Review on self-supervised image recognition using deep neural networks
Ohri, K., & Kumar, M. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107090 · Cited by 179
Tile2Vec: Unsupervised Representation Learning for Spatially Distributed Data
Jean, N., Wang, S., Samar, A., Azzari, G., Lobell, D., & Ermon, S. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33013967 · Cited by 176
Cross-Attention in Coupled Unmixing Nets for Unsupervised Hyperspectral Super-Resolution
Yao, J., Hong, D., Chanussot, J., Meng, D., Zhu, X., & Xu, Z. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58526-6_13 · Cited by 170
Self-citationLi, H., Li, Y., Zhang, G., Liu, R., Huang, H., Zhu, Q., & Tao, C. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3147513 · Cited by 170
Hyperspectral Imagery Classification Based on Contrastive Learning
Hou, S., Shi, H., Cao, X., Zhang, X., & Jiao, L. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3139099 · Cited by 162
Speckle2Void: Deep Self-Supervised SAR Despeckling With Blind-Spot Convolutional Neural Networks
Molini, A. B., Valsesia, D., Fracastoro, G., & Magli, E. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3065461 · Cited by 160
A Survey on Contrastive Self-Supervised Learning
Jaiswal, A., Babu, A. R., Zadeh, M. Z., Banerjee, D., & Makedon, F. (2020) · Technologies · doi:10.3390/technologies9010002 · Cited by 154
Self-Supervised Learning With Adaptive Distillation for Hyperspectral Image Classification
Yue, J., Fang, L., Rahmani, H., & Ghamisi, P. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3057768 · Cited by 151
Semantic Segmentation of Remote Sensing Images With Sparse Annotations
Hua, Y., Marcos, D., Mou, L., Zhu, X. X., & Tuia, D. (2021) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2021.3051053 · Cited by 147
Self-citationDeep Multiview Learning for Hyperspectral Image Classification
Liu, B., Yu, A., Yu, X., Wang, R., Gao, K., & Guo, W. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3034133 · Cited by 144
Hong, D., Yokoya, N., Chanussot, J., Xu, J., & Zhu, X. X. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.09.008 · Cited by 143
Self-citationSelf-supervised Pretraining of Visual Features in the Wild
Goyal, P., Caron, M., Lefaudeux, B., Xu, M., Wang, P., Pai, V., Singh, M., Liptchinsky, V., Misra, I., Joulin, A., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.01988 · Cited by 141 · cited 2×
“Indeed, by distilling representative features from unlabeled data, SSL algorithms are already outperforming supervised pre-training on many problems [7].”
MethodWei, C., Xie, L., Ren, X., Xia, Y., Su, C., Liu, J., Tian, Q., & Yuille, A. L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00201 · Cited by 139
Unsupervised Multilayer Feature Learning for Satellite Image Scene Classification
Li, Y., Tao, C., Tan, Y., Shang, K., & Tian, J. (2016) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2015.2503142 · Cited by 137
Cheng, G., Sun, X., Li, K., Guo, L., & Han, J. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3081421 · Cited by 130
Improvements to Context Based Self-Supervised Learning
Mundhenk, T. N., Ho, D., & Chen, B. Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00973 · Cited by 124
Yuan, Y., Lin, L., Liu, Q., Hang, R., & Zhou, Z.-G. (2021) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2021.102651 · Cited by 123
Zhao, L., Luo, W., Liao, Q., Chen, S., & Wu, J. (2022) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2022.3159549 · Cited by 123
Self-Taught Feature Learning for Hyperspectral Image Classification
Kemker, R., & Kanan, C. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2651639 · Cited by 120
Fan, J., Han, M., & Wang, J. (2009) · Pattern Recognition · doi:10.1016/j.patcog.2009.04.013 · Cited by 118
Self-Supervised Multisensor Change Detection
Saha, S., Ebel, P., & Zhu, X. X. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3109957 · Cited by 118
Self-citationSelf-Supervised Learning of Remote Sensing Scene Representations Using Contrastive Multiview Coding
Stojnic, V., & Risojevic, V. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00129 · Cited by 118
Self-Supervised Feature Learning by Learning to Spot Artifacts
Jenni, S., & Favaro, P. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00289 · Cited by 115
Tao, C., Qi, J., Lu, W., Wang, H., & Li, H. (2022) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2020.3038420 · Cited by 115
Self-Supervised SAR-Optical Data Fusion of Sentinel-1/-2 Images
Chen, Y., & Bruzzone, L. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3128072 · Cited by 113
Self-supervised Vision Transformers for Land-cover Segmentation and Classification
Scheibenreif, L., Hanna, J., Mommert, M., & Borth, D. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00148 · Cited by 112
Hong, D., Yokoya, N., Chanussot, J., Xu, J., & Zhu, X. X. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.3028931 · Cited by 108
Self-citationBlind Hyperspectral Unmixing Using Autoencoders: A Critical Comparison
Palsson, B., Sveinsson, J. R., & Ulfarsson, M. O. (2022) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2021.3140154 · Cited by 107 · cited 3×
“AUTOENCODERS IN REMOTE SENSING AEs have been widely used to learn representation from various remote sensing data like multispectral images [92]–[99], HSIs [100]–[107], and SAR images [108]–[111].”
MethodKang, J., Fernandez-Beltran, R., Duan, P., Liu, S., & Plaza, A. J. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3007029 · Cited by 106
Jigsaw Clustering for Unsupervised Visual Representation Learning
Chen, P., Liu, S., & Jia, J. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01136 · Cited by 104
Semisupervised Change Detection Using Graph Convolutional Network
Saha, S., Mou, L., Zhu, X. X., Bovolo, F., & Bruzzone, L. (2020) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2020.2985340 · Cited by 103
Self-citationAdversarial Autoencoder Network for Hyperspectral Unmixing
Jin, Q., Ma, Y., Fan, F., Huang, J., Mei, X., & Ma, J. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3114203 · Cited by 101
Self-Supervised Change Detection in Multiview Remote Sensing Images
Chen, Y., & Bruzzone, L. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3089453 · Cited by 100
Self-supervised learning-based oil spill detection of hyperspectral images
Duan, P., Xie, Z., Kang, X., & Shutao Li, A. (2022) · Science China Technological Sciences · doi:10.1007/s11431-021-1989-9 · Cited by 98
Transferable network with Siamese architecture for anomaly detection in hyperspectral images
Rao, W., Qu, Y., Gao, L., Sun, X., Wu, Y., & Zhang, B. (2021) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2021.102669 · Cited by 95
SELF-LABELLING VIA SIMULTANEOUS CLUSTERING AND REPRESENTATION LEARNING
Asano, Y. M., Rupprecht, C., & Vedaldi, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.05371 · Cited by 94
RaVÆn: unsupervised change detection of extreme events using ML on-board satellites
Růžička, V., Vaughan, A., Martini, D. D., Fulton, J., Salvatelli, V., Bridges, C., Mateo‐García, G., & Zantedeschi, V. (2022) · Scientific Reports · doi:10.1038/s41598-022-19437-5 · Cited by 85
Geographical Knowledge-Driven Representation Learning for Remote Sensing Images
Li, W., Chen, K., Chen, H., & Shi, Z. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3115569 · Cited by 83
Munyati, C. (2004) · Geocarto International · doi:10.1080/10106040408542313 · Cited by 82
Efficient Self-supervised Vision Transformers for Representation Learning
Li, C., Yang, J., Zhang, P., Gao, M., Xiao, B., Dai, X., Yuan, L., & Gao, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.09785 · Cited by 82
Hu, J., Hong, D., & Zhu, X. X. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2924113 · Cited by 81
Self-citationFrom Principal Subspaces to Principal Components with Linear Autoencoders
Plaut, E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.10253 · Cited by 80
Contrastive Self-Supervised Learning With Smoothed Representation for Remote Sensing
Jung, H., Oh, Y., Jeong, S., Lee, C., & Jeon, T. (2022) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2021.3069799 · Cited by 80
Cao, Z., Li, X., Feng, Y., Chen, S., Xia, C., & Zhao, L. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.07.015 · Cited by 78
Dong, H., Ma, W., Wu, Y., Zhang, J., & Jiao, L. (2020) · Remote Sensing · doi:10.3390/rs12111868 · Cited by 77
Zhao, Z., Luo, Z., Li, J., Chen, C., & Piao, Y. (2020) · Remote Sensing · doi:10.3390/rs12203276 · Cited by 75
Seasonal Contrast: Unsupervised Pre-Training from Uncurated Remote Sensing DataPreprint
Mañas, O., Lacoste, A., Giró-i-Nieto, X., Vázquez, D., & Rodríguez, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.16607 · Cited by 75
Self-supervised Pre-training Enhances Change Detection in Sentinel-2 Imagery
Leenstra, M., Marcos, D., Bovolo, F., & Tuia, D. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-68787-8_42 · Cited by 73
Self-supervised monocular depth estimation from oblique UAV videos
Madhuanand, L., Nex, F., & Yang, M. Y. (2021) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2021.03.024 · Cited by 73
SAE-Net: A Deep Neural Network for SAR Autofocus
Pu, W. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3139914 · Cited by 72
Self-supervised audiovisual representation learning for remote sensing data
Heidler, K., Mou, L., Hu, D., Jin, P., Li, G., Gan, C., Wen, J.-R., & Zhu, X. X. (2022) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2022.103130 · Cited by 70
Self-citationLi, W., Chen, H., & Shi, Z. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2021.3090418 · Cited by 69
Unsupervised Deep Joint Segmentation of Multitemporal High-Resolution Images
Saha, S., Mou, L., Qiu, C., Zhu, X. X., Bovolo, F., & Bruzzone, L. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.2990640 · Cited by 67
Self-citationSelf-Supervised Learning for Invariant Representations From Multi-Spectral and SAR Images
Jain, P., Schoen-Phelan, B., & Ross, R. (2022) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2022.3204888 · Cited by 67
Semantic-Aware Dense Representation Learning for Remote Sensing Image Change Detection
Chen, H., Li, W., Chen, S., & Shi, Z. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3203769 · Cited by 66
Mining Hard Negative Samples for SAR-Optical Image Matching Using Generative Adversarial Networks
Hughes, L. H., Schmitt, M., & Zhu, X. X. (2018) · Remote Sensing · doi:10.3390/rs10101552 · Cited by 64
Self-citationContrastive Learning-Based Dual Dynamic GCN for SAR Image Scene Classification
Liu, F., Qian, X., Jiao, L., Zhang, X., Li, L., & Cui, Y. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3174873 · Cited by 64
Robust and Adaptive Network Flows
Bertsimas, D., Nasrabadi, E., & Stiller, S. (2013) · Operations Research · doi:10.1287/opre.2013.1200 · Cited by 63
A Mutual Information-Based Self-Supervised Learning Model for PolSAR Land Cover Classification
Ren, B., Zhao, Y., Hou, B., Chanussot, J., & Jiao, L. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3048967 · Cited by 63
SAR Image Classification Using Contrastive Learning and Pseudo-Labels With Limited Data
Wang, C., Gu, H., & Su, W. (2021) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2021.3069224 · Cited by 63
Zhu, M., Fan, J., Yang, Q., & Chen, T. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3131152 · Cited by 61
Self-Supervised Feature Learning for Semantic Segmentation of Overhead Imagery.
Singh, S., Batra, A., Pang, G., Torresani, L., Basu, S., Paluri, M., & Jawahar, C. V. (2018) · Singapore Management University Institutional Knowledge (InK) (Singapore Management University) · Cited by 61
Unsupervised Deep Representation Learning and Few-Shot Classification of PolSAR Images
Zhang, L., Zhang, S., Zou, B., & Dong, H. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3043191 · Cited by 60
Self-Supervised Vision Transformers for Joint SAR-Optical Representation Learning
Wang, Y., Albrecht, C. M., & Zhu, X. X. (2022) · IGARSS 2022 - 2022 IEEE International Geoscience and Remote Sensing Symposium · doi:10.1109/igarss46834.2022.9883983 · Cited by 59
Self-citationContrastive Learning Based on Transformer for Hyperspectral Image Classification
Hu, X. Y., Li, T., Zhou, T., Liu, Y., & Peng, Y. (2021) · Applied Sciences · doi:10.3390/app11188670 · Cited by 58
Cross-Domain Contrastive Learning for Hyperspectral Image Classification
Guan, P., & Lam, E. Y. M. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3176637 · Cited by 58
Self-supervised multi-image super-resolution for push-frame satellite images
Nguyen, N. L., Anger, J., Davy, A., Arias, P., & Facciolo, G. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00123 · Cited by 57
H2O-Net: Self-Supervised Flood Segmentation via Adversarial Domain Adaptation and Label Refinement
Akiva, P., Purri, M., Dana, K., Tellman, B., & Anderson, T. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00016 · Cited by 54
The color out of space: learning self-supervised representations for Earth Observation imagery
Vincenzi, S., Porrello, A., Buzzega, P., Cipriano, M., Fronte, P., Cuccu, R., Ippoliti, C., Conte, A., & Calderara, S. (2021) · 2020 25th International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr48806.2021.9413112 · Cited by 52
Self-Supervised Deep Learning to Reconstruct Seismic Data With Consecutively Missing Traces
Huang, H., Wang, T., Cheng, J., Xiong, Y., Wang, C., & Geng, J. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3148994 · Cited by 52
Unsupervised Learning using Sequential Verification for Action Recognition.Preprint
Misra, I., Zitnick, C. L., & Hebert, M. (2016) · arXiv (Cornell University) · Cited by 51
Urban Flood Mapping With Bitemporal Multispectral Imagery Via a Self-Supervised Learning Framework
Peng, B., Huang, Q., Vongkusolkit, J., Gao, S., Wright, D. B., Fang, Z. N., & Qiang, Y. (2020) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2020.3047677 · Cited by 51
Research works printed but not linked: 3
- [55] Andrew Ng et al. 'Sparse autoencoder'. In: CS294A Lecture notes 72.2011 (2011), pp. 1-19 (cit. on p. 4). -
- [59] Ian Goodfellow et al. 'Generative adversarial nets'. In: Advances in neural information processing systems 27 (2014) (cit. on pp. 4, 5). -
- [233] Xinyu Wang et al. 'A Self-Supervised Denoising Network for Satellite-Airborne-Ground Hyperspectral Imagery'. In: IEEE Transactions on Geoscience and Remote Sensing (2021) (cit. on pp. 16, 18). - · DOI
Cited by
RemoteCLIP: A Vision Language Foundation Model for Remote Sensing
Liu, F., Chen, D., Guan, Z., Zhou, X., Zhu, J., Ye, Q., Fu, L., & Zhou, J. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3390838 · Cited by 507
“The research landscape of SSL-based foundation models for remote sensing closely mirrors this categorization [31].”
BackgroundArtificial intelligence for geoscience: Progress, challenges, and perspectives
Zhao, T., Wang, S., Ouyang, C., Chen, M., Liu, C., Zhang, J., Yu, L., Wang, F., Xie, Y., Li, J., et al. (2024) · The Innovation · doi:10.1016/j.xinn.2024.100691 · Cited by 360
Vision-Language Models in Remote Sensing: Current progress and future trends
Li, X., Wen, C., Hu, Y., Yuan, Z., & Zhu, X. X. (2024) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2024.3383473 · Cited by 178
Self-citationVision Foundation Models in Remote Sensing: A survey
Lu, S., Guo, J., Zimmer-Dauphinee, J. R., Nieusma, J. M., Wang, X., VanValkenburgh, P., Wernke, S. A., & Huo, Y. (2025) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2025.3541952 · Cited by 261
Foundation Models for Remote Sensing and Earth Observation: A survey
Xiao, A., Xuan, W., Wang, J., Huang, J., Tao, D., Lu, S., & Yokoya, N. (2025) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2025.3576766 · Cited by 257
Metadata
- Authors
- Wang, Y., Albrecht, C. M., Braham, N. A. A., Mou, L., & Zhu, X. X.
- Affiliations
- Deutsches Zentrum für Luft- und Raumfahrt e. V. (DLR) (DE)
- Venue
- IEEE Geoscience and Remote Sensing Magazine
- Published
- 2022-12
- Volume
- 10
- Issue
- 4
- Pages
- 213-247
- ISSN
- 2168-6831 (ISSN-L)
- 2473-2397
- 2373-7468
- OpenAlex
- W4283697304
- Cited by
- 364
- References
- 254
- Citations by year
- 2026: 90 · 2025: 121 · 2024: 95 · 2023: 49 · 2022: 9
- FWCI
- 28.62
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Geoscience and Remote Sensing Magazine (publishedVersion)
- elib (German Aerospace Center) (acceptedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- European Research Council (ERC-2016-StG-714087, 957407)
- Helmholtz Association (ZT-I-PF-5-01)
- Helmholtz Klimainitiative (HICAM) and Helmholtz Excellent Professorship (W2-W3-100)
- German Federal Ministry of Education and Research (01DD20001)
- German Federal Ministry for Economic Affairs and Climate Action (50EE2201C)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Remote-Sensing Image Classification
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- self-supervised learning, remote sensing, Earth observation, data augmentation, satellite imagery, deep learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.