Multisource Data Reconstruction-Based Deep Unsupervised Hashing for Unisource Remote Sensing Image Retrieval
The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Abstract
Unsupervised hashing for remote sensing (RS) image retrieval first extracts image features and then use these features to construct supervised information (e.g., pseudo-labels) to train hashing networks. Existing methods usually regard RS images as natural images to extract unisource features. However, these features only contain partial information about ground objects and cannot produce reliable pseudo-labels. In addition, existing methods only generate a pseudo single-label to annotate each RS image, which cannot accurately represent multiple scenes in a RS image. To address these drawbacks, this paper proposes a new Multisource data reconstruction-based deep unsupervised Hashing method, called MrHash, which explores the characteristics of RS images to construct reliable pseudo-labels. In particular, we first use geographic coordinates to obtain different satellite images and develop a novel autoencoder network to extract multisource features from these images. Then pseudo multi-labels are designed to deal with the coexistence of multiple scenes in a single image. These labels are generated by a custom probability function with extracted multisource features. Finally, we propose a novel multi-semantic hash loss by using the Kull-back–Leibler (KL) divergence to preserve the semantic similarity of these pseudo multi-labels in Hamming space. Our newly developed MrHash only uses multisource images to construct supervised information, and hash code generation still relies on a unisource input image. Experiments on benchmark datasets clearly show the superiority of the proposed method over state-of-the-art baselines. https://github.com/sunyuxi/MrHash.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope
Oliva, A., & Torralba, A. (2001) · International Journal of Computer Vision · doi:10.1023/a:1011139631724 · Cited by 6,319
Unsupervised deep embedding for clustering analysis
Xie, J., Girshick, R., & Farhadi, A. (2015) · arXiv · doi:10.48550/arxiv.1511.06335 · Cited by 2,476
EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classification
Helber, P., Bischke, B., Dengel, A., & Borth, D. (2019) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2019.2918242 · Cited by 1,951 · cited 1×
“1) EuroSAT: It [52] is a georeferenced benchmark dataset.”
BackgroundGong, Y., Lazebnik, S., Gordo, A., & Perronnin, F. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.193 · Cited by 1,834
PatternNet: A benchmark dataset for performance evaluation of remote sensing image retrieval
Zhou, W., Newsam, S., Li, C., & Shao, Z. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2018.01.004 · Cited by 571
Learning Compact Binary Descriptors with Unsupervised Deep Neural Networks
Lin, K., Lu, J., Chen, C.-S., & Zhou, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.133 · Cited by 363
Large-Scale Remote Sensing Image Retrieval by Deep Hashing Neural Networks
Li, Y., Zhang, Y., Huang, X., Zhu, H., & Ma, J. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2756911 · Cited by 276
Image retrieval from remote sensing big data: A survey
Li, Y., Ma, J., & Zhang, Y. (2021) · Information Fusion · doi:10.1016/j.inffus.2020.10.008 · Cited by 233
Exploring a Fine-Grained Multiscale Method for Cross-Modal Remote Sensing Image Retrieval
Yuan, Z., Zhang, W., Fu, K., Li, X., Deng, C., Wang, H., & Sun, X. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3078451 · Cited by 228
Self-citationRemote Sensing Cross-Modal Text-Image Retrieval Based on Global and Local Information
Yuan, Z., Zhang, W., Tian, C., Rong, X., Zhang, Z., Wang, H., Fu, K., & Sun, X. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3163706 · Cited by 178
Li, Y., Zhang, Y., Huang, X., & Ma, J. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2839705 · Cited by 170
Semantic Structure-based Unsupervised Deep Hashing
Yang, E., Deng, C., Liu, T., Liu, W., & Tao, D. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/148 · Cited by 168
A Deep Semantic Alignment Network for the Cross-Modal Image-Text Retrieval in Remote Sensing
Cheng, Q., Zhou, Y., Fu, P., Xu, Y. X., & Zhang, L. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2021.3070872 · Cited by 168
Auto-Encoding Twin-Bottleneck Hashing
Shen, Y., Qin, J., Chen, J., Yu, M., Liu, L., Zhu, F., Shen, F., & Shao, L. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00289 · Cited by 159
Hashing-Based Scalable Remote Sensing Image Search and Retrieval in Large Archives
Demir, B., & Bruzzone, L. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2015.2469138 · Cited by 151
Exploiting Deep Features for Remote Sensing Image Retrieval: A Systematic Investigation
Tong, X.-Y., Xia, G.-S., Hu, F., Zhong, Y., Datcu, M., & Zhang, L. (2020) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2019.2948924 · Cited by 132
Deep Hash Learning for Remote Sensing Image Retrieval
Liu, C., Ma, J., Tang, X., Liu, F., Zhang, X., & Jiao, L. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3007533 · Cited by 132
Siamese graph convolutional network for content based remote sensing image retrieval
Chaudhuri, U., Banerjee, B., & Bhattacharya, A. (2019) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2019.04.004 · Cited by 125
Kang, J. S., Fernández-Beltrán, R., Hong, D., Chanussot, J., & Plaza, A. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3016020 · Cited by 107
Self-citationSimilarity-Based Unsupervised Deep Transfer Learning for Remote Sensing Image Retrieval
Liu, Y., Ding, L., Chen, C., & Liu, Y. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.2984703 · Cited by 98
Li, P., Han, L., Tao, X., Zhang, X., Grecos, C., Plaza, A., & Ren, P. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.2981997 · Cited by 90
Self-citationA Three-Layered Graph-Based Learning Approach for Remote Sensing Image Retrieval
Wang, Y., Zhang, L., Tong, X., Zhang, L., Zhang, Z., Liu, H., Xing, X., & Mathiopoulos, P. T. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2579648 · Cited by 88
Tu, R.-C., Mao, X.-L., & Wei, W. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/479 · Cited by 86
Deep Hashing Learning for Visual and Semantic Retrieval of Remote Sensing Images
Song, W., Shutao Li, A., & Benediktsson, J. A. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3035676 · Cited by 84
Deep Cross-Modal Image–Voice Retrieval in Remote Sensing
Chen, Y., Lu, X., & Wang, S. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.2979273 · Cited by 82
Partial Randomness Hashing for Large-Scale Remote Sensing Image Retrieval
Li, P., & Ren, P. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2651056 · Cited by 78
Asymmetric Hash Code Learning for Remote Sensing Image Retrieval
Song, W., Gao, Z. Y., Dian, R., Ghamisi, P., Zhang, Y., & Benediktsson, J. A. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3143571 · Cited by 67
Unsupervised deep hashing through learning soft pseudo label for remote sensing image retrieval
Sun, Y., Ye, Y., Li, X., Feng, S., Zhang, B., Kang, J. S., & Dai, K. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107807 · Cited by 66
Self-citationSemantics-Consistent Representation Learning for Remote Sensing Image–Voice Retrieval
Ning, H., Zhao, B., & Yuan, Y. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3060705 · Cited by 62
Pseudo Label based Unsupervised Deep Discriminative Hashing for Image Retrieval
Hu, Q., Wu, J., Cheng, J., Wu, L., & Lu, H. (2017) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3123266.3123403 · Cited by 61
Unsupervised Deep K-Means Hashing for Efficient Image Retrieval and Clustering
Dong, X. M., Liu, L., Zhu, L., Cheng, Z., & Zhang, H. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.3035775 · Cited by 60
Learning to Translate for Cross-Source Remote Sensing Image Retrieval
Xiong, W., Lv, Y., Zhang, X., & Cui, Y. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.2968096 · Cited by 51
Meta-Hashing for Remote Sensing Image Retrieval
Tang, X., Yang, Y., Ma, J., Cheung, Y., Liu, C., Liu, F., Zhang, X., & Jiao, L. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3136159 · Cited by 48
Unsupervised Remote Sensing Image Retrieval Using Probabilistic Latent Semantic Hashing
Fernández-Beltrán, R., Demir, B., Pla, F., & Plaza, A. (2020) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2020.2969491 · Cited by 46
Self-citationCohesion Intensive Deep Hashing for Remote Sensing Image Retrieval
Han, L., Li, P., Bai, X. P., Grecos, C., Zhang, X., & Ren, P. (2019) · Remote Sensing · doi:10.3390/rs12010101 · Cited by 44
He, X., Wang, P., & Cheng, J. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00295 · Cited by 41
Large-Scale Remote Sensing Image Retrieval Based on Semi-Supervised Adversarial Hashing
Tang, X., Liu, C., Ma, J., Zhang, X., Liu, F., & Jiao, L. (2019) · Remote Sensing · doi:10.3390/rs11172055 · Cited by 39
A Progressive Content-Based Image Retrieval in JPEG 2000 Compressed Remote Sensing Archives
Byju, A. P., Demir, B., & Bruzzone, L. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.2969374 · Cited by 39
Mental Retrieval of Remote Sensing Images via Adversarial Sketch-Image Feature Learning
Xu, F., Yang, W. T., Jiang, T., Lin, S., Luo, H., & Xia, G.-S. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.2984316 · Cited by 39
Adversarial Hash-Code Learning for Remote Sensing Image Retrieval
Liu, C., Ma, J., Tang, X., Zhang, X., & Jiao, L. (2019) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2019.8900431 · Cited by 34
Eagle-Eyed Multitask CNNs for Aerial Image Retrieval and Scene Classification
Liu, Y., Han, Z., Chen, C., Ding, L., & Liu, Y. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.2979011 · Cited by 31
Deep Quadruple-Based Hashing for Remote Sensing Image-Sound Retrieval
Chen, Y., Xiong, S., Mou, L., & Zhu, X. X. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3155283 · Cited by 31
Hashing for Localization (HfL): A Baseline for Fast Localizing Objects in a Large-Scale Scene
Han, L., Li, P., Plaza, A., & Ren, P. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3114207 · Cited by 30
Self-citationA Zero-Shot Sketch-Based Intermodal Object Retrieval Scheme for Remote Sensing Images
Chaudhuri, U., Banerjee, B., Bhattacharya, A., & Datcu, M. P. (2021) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2021.3056392 · Cited by 29
Cao, Y., Wang, Y., Peng, J., Zhang, L., Xu, L., Yan, K., & Li, L. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.2991545 · Cited by 27
Cohesion Intensive Hash Code Book Coconstruction for Efficiently Localizing Sketch Depicted Scenes
Fang, Y., Li, P., Zhang, J., & Ren, P. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3132296 · Cited by 25
Zero-Shot Cross-Modal Retrieval for Remote Sensing Images With Minimal Supervision
Chaudhuri, U., Bose, R., Banerjee, B., Bhattacharya, A., & Datcu, M. P. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3196307 · Cited by 24
Sümbül, G., Xiang, J., & Demir, B. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3204914 · Cited by 21
Global Optimization: Combining Local Loss With Result Ranking Loss in Remote Sensing Image Retrieval
Fan, L., Zhao, H., & Zhao, H. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3029334 · Cited by 20
Toward Multilabel Image Retrieval for Remote Sensing
Imbriaco, R., Sebastian, C., Bondarev, E., & de With, P. H. N. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3095957 · Cited by 19
Deep Hashing Based on Class-Discriminated Neighborhood Embedding
Kang, J. S., Fernández-Beltrán, R., Ye, Z., Tong, X., & Plaza, A. (2020) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2020.3027954 · Cited by 15
Self-citationDFLLR: Deep Feature Learning With Latent Relationship Embedding for Remote Sensing Image Retrieval
Liu, L., Wang, Y., Peng, J., & Plaza, A. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3097361 · Cited by 12
Self-citationRemote Sensing Image Retrieval Based on Semi-Supervised Deep Hashing Learning
Tang, X., Liu, C., Zhang, X., et al. (2019) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2019.8898676 · Cited by 6
Research works printed but not linked: 9
- 10.1109/TGRS.2021.3124326 · DOI
- 10.1109/LGRS.2020.2974629 · doi:10.1109/lgrs.2020.2974629
- 10.1109/LGRS.2018.2870686 · doi:10.1109/lgrs.2018.2870686
- Weiss, Spectral hashing, 1753
- Liu, Hashing with graphs, 2011, 1
- Gionis, Similarity search in high dimensions via hashing, 518
- Jiang, Scalable graph hashing with feature transformation, 2248
- 10.1007/springerreference_61724 · doi:10.1007/springerreference_61724
- 10.1109/TGRS.2022.3160097 · DOI
Cited by
Visual Grounding in Remote Sensing Images
Sun, Y., Feng, S., Li, X., Ye, Y., Kang, J., & Huang, X. (2022) · Proceedings of the 30th ACM International Conference on Multimedia · doi:10.1145/3503161.3548316 · Cited by 81
Self-citationBackground Reconstruction via 3D-Transformer Network for Hyperspectral Anomaly Detection
Wu, Z., & Wang, B. (2023) · Remote Sensing · doi:10.3390/rs15184592 · Cited by 13
Metadata
- Authors
- Sun, Y., Ye, Y., Kang, J., Fernandez-Beltran, R., Ban, Y., Li, X., Zhang, B., & Plaza, A.
- Venue
- IEEE Transactions on Geoscience and Remote Sensing
- Published
- 2022
- Volume
- 60
- Pages
- 1-16
- ISSN
- 0196-2892 (ISSN-L)
- 1558-0644
- OpenAlex
- W4313229413
- Cited by
- 466
- References
- 53
- FWCI
- 36.75
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Funders
- Shenzhen Science and Technology Program (JCYJ20210324120208022, JCYJ20200109113014456, KCXFZ20211020163403005)
- National Nature Science Foundation of China (62272130)
- European Space Agency (59333)
- National Remote Sensing Centre of China (NRSCC)’s Dragon 5 Cooperartion Program (59333)
- Jiangsu Province Science Foundation for Youths (BK20210707)
- National Natural Science Foundation of China (62101371)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.