The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
CVM-Net: Cross-View Matching Network for Image-Based Ground-to-Aerial Geo-Localization
Abstract
The problem of localization on a geo-referenced aerial/satellite map given a query ground view image remains challenging due to the drastic change in viewpoint that causes traditional image descriptors based matching to fail. We leverage on the recent success of deep learning to propose the CVM-Net for the cross-view image-based ground-to-aerial geo-localization task. Specifically, our network is based on the Siamese architecture to do metric learning for the matching task. We first use the fully convolutional layers to extract local image features, which are then encoded into global image descriptors using the powerful NetVLAD. As part of the training procedure, we also introduce a simple yet effective weighted soft margin ranking loss function that not only speeds up the training convergence but also improves the final matching accuracy. Experimental results show that our proposed network significantly outperforms the state-of-the-art approaches on two existing benchmarking datasets. Our code and models are publicly available on the project website.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
FaceNet: A unified embedding for face recognition and clustering
Schroff, F., Kalenichenko, D., & Philbin, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298682 · Cited by 15,267
SURF: Speeded Up Robust Features
Bay, H., Tuytelaars, T., & Van Gool, L. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_32 · Cited by 14,955 · cited 1×
“This causes cross-view matching with traditional handcrafted features like SIFT [25] and SURF [7] to fail.”
MethodTensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., et al. (2016) · arXiv · doi:10.48550/arxiv.1603.04467 · Cited by 9,408
Video Google: a text retrieval approach to object matching in videos
Sivic, & Zisserman (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238663 · Cited by 6,367
Learning a Similarity Metric Discriminatively, with Application to Face Verification
Chopra, S., Hadsell, R., & LeCun, Y. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.202 · Cited by 4,036
Scalable Recognition with a Vocabulary Tree
Nister, D., & Stewenius, H. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.264 · Cited by 3,579
Aggregating local descriptors into a compact image representation
Jegou, H., Douze, M., Schmid, C., & Perez, P. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540039 · Cited by 2,692
In Defense of the Triplet Loss for Person Re-Identification
Hermans, A., Beyer, L., & Leibe, B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.07737 · Cited by 2,687
NetVLAD: CNN Architecture for Weakly Supervised Place Recognition
Arandjelovic, R., Gronat, P., Torii, A., Pajdla, T., & Sivic, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.572 · Cited by 2,584
(2014) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 2,534
NetVLAD: CNN architecture for weakly supervised place recognitionPreprint
Arandjelović, R., Gronát, P., Torii, A., Pajdla, T., & Šivic, J. (2015) · arXiv (Cornell University) · Cited by 1,790
Deep Metric Learning via Lifted Structured Feature Embedding
Song, H. O., Xiang, Y., Jegelka, S., & Savarese, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.434 · Cited by 1,630
Person Re-identification by Multi-Channel Parts-Based CNN with Improved Triplet Loss Function
Cheng, D., Gong, Y., Zhou, S., Wang, J., & Zheng, N. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.149 · Cited by 1,247
Beyond Triplet Loss: A Deep Quadruplet Network for Person Re-identification
Chen, W., Chen, X., Zhang, J., & Huang, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.145 · Cited by 1,224
Learning to compare image patches via convolutional neural networks
Zagoruyko, S., & Komodakis, N. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299064 · Cited by 1,140
IM2GPS: estimating geographic information from a single image
Hays, J., & Efros, A. A. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587784 · Cited by 877
MatchNet: Unifying feature and metric learning for patch-based matching
Han, X., Leung, T., Jia, Y., Sukthankar, R., & Berg, A. C. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298948 · Cited by 825
Deep feature learning with relative distance comparison for person re-identification
Ding, S., Lin, L., Wang, G., & Chao, H. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2015.04.005 · Cited by 684
Deep Metric Learning with Angular Loss
Wang, J., Zhou, F., Wen, S., Liu, X., & Lin, Y. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.283 · Cited by 542
Learning deep representations for ground-to-aerial geolocalization
Lin, T.-Y., Cui, Y., Belongie, S., & Hays, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299135 · Cited by 401
Wide-Area Image Geolocalization with Aerial Reference Imagery
Workman, S., Souvenir, R., & Jacobs, N. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.451 · Cited by 400
Joint Learning of Single-Image and Cross-Image Representations for Person Re-identification
Wang, F., Zuo, W., Lin, L., Zhang, D., & Zhang, L. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.144 · Cited by 389
Learning to rank in person re-identification with metric ensembles
Paisitkriangkrai, S., Shen, C., & van den Hengel, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298794 · Cited by 385
Cross-View Image Geolocalization
Lin, T.-Y., Belongie, S., & Hays, J. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.120 · Cited by 291
Localizing and Orienting Street Views Using Overhead Imagery
Vo, N. N., & Hays, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_30 · Cited by 283
Predicting Ground-Level Scene Layout from Aerial Imagery
Zhai, M., Bessinger, Z., Workman, S., & Jacobs, N. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.440 · Cited by 265
Cross-View Image Matching for Geo-Localization in Urban Environments
Tian, Y., Chen, C., & Shah, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.216 · Cited by 221
Video Google: Efficient Visual Search of Videos
Sivic, J., & Zisserman, A. (2006) · Lecture Notes in Computer Science · doi:10.1007/11957959_7 · Cited by 208
Image Geo-Localization Based on MultipleNearest Neighbor Feature Matching UsingGeneralized Graphs
Zamir, A. R., & Shah, M. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2299799 · Cited by 205
Scalable 6-DOF Localization on Mobile Devices
Middelberg, S., Sattler, T., Untzelmann, O., & Kobbelt, L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10605-2_18 · Cited by 200
Multi-Scale Triplet CNN for Person Re-Identification
Liu, J., Zha, Z.-J., Tian, Q., et al. (2016) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2964284.2967209 · Cited by 192
Deep Visual-Semantic Quantization for Efficient Image Retrieval
Cao, Y., Long, M., Wang, J., & Liu, S. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.104 · Cited by 150
Large-Scale Location Recognition and the Geometric Burstiness Problem
Sattler, T., Havlena, M., Konrad Schindler, B., & Pollefeys, M. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.175 · Cited by 149
Revisiting IM2GPS in the Deep Learning Era
Vo, N., Jacobs, N., & Hays, J. H. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.286 · Cited by 141
On the location dependence of convolutional neural network features
Workman, S., & Jacobs, N. (2015) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2015.7301385 · Cited by 140
Shady dealings: Robust, long-term visual localisation using illumination invariance
McManus, C., Churchill, W., Maddern, W., Stewart, A. D., & Newman, P. M. (2014) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2014.6906961 · Cited by 140
Joint Learning for Attribute-Consistent Person Re-Identification
Khamis, S., Kuo, C.-H., Singh, V. K., Shet, V. D., & Davis, L. S. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16199-0_10 · Cited by 132
Geo-localization of street views with aerial image databases
Bansal, M., Sawhney, H., Cheng, H., et al. (2011) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2072298.2071954 · Cited by 128
Accurate Geo-Registration by Ground-to-Aerial Image Matching
Shan, Q., Wu, C., Curless, B., et al. (2014) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2014.69 · Cited by 110
A framework for global vehicle localization using stereo images and satellite and road maps
Senlet, T., & Elgammal, A. (2011) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2011.6130498 · Cited by 86
Vision based robot localization by ground to satellite matching in GPS-denied situations
Viswanathan, A., Pires, B. R., & Huber, D. (2014) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2014.6942560 · Cited by 79
Correlation Hashing Network for Efficient Cross-Modal Retrieval
Cao, Y., Long, M., & Wang, J. (2017) · British Machine Vision Conference (BMVC) · doi:10.5244/c.31.128 · Cited by 65
Robust Visual Place Recognition with Graph Kernels
Stumm, E. S., Christopher Mei, A., Lacroix, S., Nieto, J. I., Hutter, M., & Siegwart, R. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.491 · Cited by 61
Vehicle Ego-Localization by Matching In-Vehicle Camera Images to an Aerial Image
Noda, M., Takahashi, T., Deguchi, D., et al. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-22819-3_17 · Cited by 59
Satellite image based precise robot localization on sidewalks
Senlet, T., & Elgammal, A. (2012) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2012.6225352 · Cited by 39
Cited by
University-1652: A Multi-view Multi-source Benchmark for Drone-based Geo-localization
Zheng, Z., Wei, Y., & Yang, Y. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413896 · Cited by 402
Lending Orientation to Neural Networks for Cross-View Geo-Localization
Liu, L., & Li, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00577 · Cited by 336
Each Part Matters: Local Patterns Facilitate Cross-View Geo-Localization
Wang, T., Zheng, Z., Yan, C., Zhang, J., Sun, Y., Zheng, B., & Yang, Y. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3061265 · Cited by 306
Metadata
- Authors
- Hu, S., Feng, M., Nguyen, R. M. H., & Lee, G. H.
- Venue
- 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2018-06
- Pages
- 7258-7267
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2799087793
- Cited by
- 394
- References
- 51
- FWCI
- 5.69
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.