The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Rethinking Visual Geo-localization for Large-Scale Applications
Open accessAbstract
Visual Geo-localization (VG) is the task of estimating the position where a given photo was taken by comparing it with a large database of images of known locations. To investigate how existing techniques would perform on a real-world city-wide VG application, we build San Francisco eXtra Large, a new dataset covering a whole city and providing a wide range of challenging cases, with a size 30x bigger than the previous largest dataset for visual geo-localization. We find that current methods fail to scale to such large datasets, therefore we design a new highly scalable training technique, called CosPlace, which casts the training as a classification problem avoiding the expensive mining needed by the commonly used contrastive learning. We achieve state-of-the-art performance on a wide range of datasets and find that CosPlace is robust to heavy domain changes. Moreover, we show that, compared to the previous state-of-the-art, CosPlace requires roughly 80% less GPU memory at train time, and it achieves better results with 8x smaller descriptors, paving the way for city-wide real-world visual geo-localization. Dataset, code and trained models are available for research purposes at https://github.com/gmberton/CosPlace.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Vision meets robotics: The KITTI dataset
Geiger, A., Lenz, P., Stiller, C., & Urtasun, R. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913491297 · Cited by 9,913
ArcFace: Additive Angular Margin Loss for Deep Face Recognition
Deng, J., Guo, J., Xue, N., & Zafeiriou, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00482 · Cited by 7,781
2008 IEEE Conference on Computer Vision and Pattern Recognition
(2008) · doi:10.1109/cvpr12618.2008 · Cited by 4,212
CosFace: Large Margin Cosine Loss for Deep Face Recognition
Wang, H., Wang, Y., Zhou, Z., Ji, X., Gong, D., Zhou, J., Li, Z., & Liu, W. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00552 · Cited by 3,034
Object retrieval with large vocabularies and fast spatial matching
Philbin, J., Chum, O., Isard, M., Sivic, J., & Zisserman, A. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383172 · Cited by 2,929
NetVLAD: CNN architecture for weakly supervised place recognitionPreprint
Arandjelović, R., Gronát, P., Torii, A., Pajdla, T., & Šivic, J. (2015) · arXiv (Cornell University) · Cited by 1,790
1 year, 1000 km: The Oxford RobotCar dataset
Maddern, W., Pascoe, G., Linegar, C., & Newman, P. (2017) · The International Journal of Robotics Research · doi:10.1177/0278364916679498 · Cited by 1,632
Lost in quantization: Improving particular object retrieval in large scale image databases
Philbin, J., Chum, O., Isard, M., Sivic, J., & Zisserman, A. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587635 · Cited by 1,478
Fine-Tuning CNN Image Retrieval with No Human Annotation
Radenovic, F., Tolias, G., & Chum, O. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2846566 · Cited by 1,472
2012 IEEE Conference on Computer Vision and Pattern Recognition
(2012) · doi:10.1109/cvpr17489.2012 · Cited by 1,259
IEEE Winter Conference on Applications of Computer Vision
(2014) · doi:10.1109/wacv31811.2014 · Cited by 1,001
IEEE International Conference On Robotics And Automation
(2001) · Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164) · doi:10.1109/robot.2001.932732 · Cited by 759
British Machine Vision Conference 2000
Mirmehdi, M. (2002) · Image and Vision Computing · doi:10.1016/s0262-8856(02)00048-3 · Cited by 716
2001 IEEE/RSJ International Conference on Intelligent Robots and Systems
(2001) · Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems Expanding the Societal Role of Robotics in the the Next Millennium (Cat No 01CH37180) IROS-01 · doi:10.1109/iros.2001.976235 · Cited by 635
University of Michigan North Campus long-term vision and lidar dataset
Carlevaris-Bianco, N., Ushani, A. K., & Eustice, R. M. (2016) · The International Journal of Robotics Research · doi:10.1177/0278364915614638 · Cited by 576
Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognition
Hausler, S., Garg, S., Xu, M., Milford, M., & Fischer, T. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01392 · Cited by 444
City-scale landmark identification on mobile devices
Chen, D. M., Baatz, G., Koser, K., Tsai, S. S., Vedantham, R., Pylvanainen, T., Roimela, K., Chen, X., Bach, J., Pollefeys, M., et al. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995610 · Cited by 400
PlaNet - Photo Geolocation with Convolutional Neural Networks
Weyand, T., Kostrikov, I., & Philbin, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_3 · Cited by 395
Mapping a Suburb With a Single Camera Using a Biologically Inspired SLAM System
Milford, M. J., & Wyeth, G. F. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.2004520 · Cited by 378
Unifying Deep Local and Global Features for Image Search
Cao, B., Araujo, A., & Sim, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58565-5_43 · Cited by 366
Spatial Pyramid-Enhanced NetVLAD With Weighted Triplet Loss for Place Recognition
Yu, J., Zhu, C., Zhang, J., Huang, Q., & Tao, D. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2908982 · Cited by 352
Deep learning features at scale for visual place recognition
Chen, Z., Jacobson, A., Sunderhauf, N., Upcroft, B., Liu, L., Shen, C., Reid, I., & Milford, M. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989366 · Cited by 344
Google Landmarks Dataset v2 – A Large-Scale Benchmark for Instance-Level Recognition and Retrieval
Weyand, T., Araujo, A., Cao, B., & Sim, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00265 · Cited by 303
Escaping the Big Data Paradigm with Compact Transformers
Hassani, A., Walton, S., Shah, N., Abuduweili, A., Li, J., & Shi, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.05704 · Cited by 287
Highly scalable appearance-only SLAM - FAB-MAP 2.0
Cummins, M., & Newman, P. (2009) · Robotics: Science and Systems V · doi:10.15607/rss.2009.v.039 · Cited by 282
Learned Contextual Feature Reweighting for Image Geo-Localization
Kim, H. J., Dunn, E., & Frahm, J.-M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.346 · Cited by 228
Mapillary Street-Level Sequences: A Dataset for Lifelong Place Recognition
Warburg, F., Hauberg, S., Lopez-Antequera, M., Gargallo, P., Kuang, Y., & Civera, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00270 · Cited by 227
Avoiding Confusing Features in Place Recognition
Knopp, J., Sivic, J., & Pajdla, T. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15549-9_54 · Cited by 208
Image Geo-Localization Based on MultipleNearest Neighbor Feature Matching UsingGeneralized Graphs
Zamir, A. R., & Shah, M. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2299799 · Cited by 205
Self-supervising Fine-Grained Region Similarities for Large-Scale Image Localization
Ge, Y., Wang, H., Zhu, F., Zhao, R., & Li, H. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58548-8_22 · Cited by 165
Zaffar, M., Garg, S., Milford, M. J., Kooij, J. F. P., Flynn, D., McDonald-Maier, K. D., & Ehsan, S. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01469-5 · Cited by 162
Khaliq, A., Ehsan, S., Chen, Z., Milford, M. J., & McDonald-Maier, K. D. (2019) · IEEE Transactions on Robotics · doi:10.1109/tro.2019.2956352 · Cited by 161
Are Large-Scale 3D Models Really Necessary for Accurate Visual Localization?
Torii, A., Taira, H., Šivic, J., Pollefeys, M., Okutomi, M., Pajdla, T., & Sattler, T. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2941876 · Cited by 147
Visual Place Recognition with Repetitive Structures
Torii, A., Šivic, J., Okutomi, M., & Pajdla, T. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2409868 · Cited by 136
24/7 Place Recognition by View Synthesis
Torii, A., Arandjelović, R., Šivic, J., Okutomi, M., & Pajdla, T. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2667665 · Cited by 121
Learning Context Flexible Attention Model for Long-Term Visual Place Recognition
Chen, Z., Liu, L., Sa, I., Ge, Z., & Chli, M. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2859916 · Cited by 117
Stochastic Attraction-Repulsion Embedding for Large Scale Image Localization
Liu, L., Li, H., & Dai, Y. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00266 · Cited by 114
Instance-level Image Retrieval using Reranking Transformers
Tan, F., Yuan, J., & Ordóñez, V. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01189 · Cited by 112
Deep Visual Geo-localization Benchmark
Berton, G., Mereu, R., Trivigno, G., Masone, C., Csurka, G., Sattler, T., & Barbara Caputo, B. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00532 · Cited by 107
Self-citationSemantic–geometric visual place recognition: a new perspective for reconciling opposing views
Garg, S., Sünderhauf, N., & Milford, M. J. (2019) · The International Journal of Robotics Research · doi:10.1177/0278364919839761 · Cited by 105
Geolocation Estimation of Photos Using a Hierarchical Model and Scene Classification
Müller-Budack, E., Pustu-Iren, K., & Ewerth, R. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01258-8_35 · Cited by 96
Attention-based Pyramid Aggregation Network for Visual Place Recognition
Zhu, Y., Wang, J., Xie, L., & Zheng, L. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240525 · Cited by 92
Multi-Process Fusion: Visual Place Recognition Using Multiple Image Processing Methods
Hausler, S., Jacobson, A., & Milford, M. J. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2898427 · Cited by 87
Scalable Place Recognition Under Appearance Change for Autonomous Driving
Doan, A.-D., Latif, Y., Chin, T.-J., Liu, Y., Do, T.-T., & Reid, I. D. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00941 · Cited by 75
Attentional Pyramid Pooling of Salient Visual Residuals for Place Recognition
Peng, G., Zhang, J., Li, H., & Wang, D. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00092 · Cited by 60
Large-Scale Image Geo-Localization Using Dominant Sets
Zemene, E., Tesfaye, Y. T., Idrees, H., Prati, A., Pelillo, M., & Shah, M. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2787132 · Cited by 49
Viewpoint Invariant Dense Matching for Visual Geolocalization
Berton, G., Masone, C., Paolicelli, V., & Barbara Caputo, B. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01195 · Cited by 40
Self-citationA Performance Comparison of Loss Functions for Deep Face RecognitionPreprint
Srivastava, Y., Murali, V., & Dubey, S. R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.05903 · Cited by 33
Unifying Visual Localization and Scene Recognition for People With Visual Impairment
Cheng, R., Wang, K., Bai, J. Y., & Xu, Z. (2020) · IEEE Access · doi:10.1109/access.2020.2984718 · Cited by 28
Bansal, A., Badino, H., & Huber, D. (2014) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2014.6856605 · Cited by 25
Leveraging EfficientNet and Contrastive Learning for Accurate Global-scale Location Estimation
Kordopatis-Zilos, G., Galopoulos, P., Papadopoulos, S., & Kompatsiaris, I. Y. (2021) · International Conference on Multimedia Retrieval · doi:10.1145/3460426.3463644 · Cited by 22
Cited by
MixVPR: Feature Mixing for Visual Place Recognition
Ali-Bey, A., Chaib-Draa, B., & Giguere, P. (2023) · 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv56688.2023.00301 · Cited by 256
MARs: Multi-view Attention Regularizations for Patch-based Feature Recognition of Space Terrain
Chase, T., & Dantu, K. (2024) · arXiv · doi:10.48550/arxiv.2410.05182 · Cited by 5
Metadata
- Authors
- Berton, G., Masone, C., & Caputo, B.
- Venue
- 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2022-06
- Pages
- 4868-4878
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W4312854990
- Cited by
- 272
- References
- 52
- FWCI
- 21.44
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.