The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
IM2GPS: estimating geographic information from a single image
Open accessAbstract
Estimating geographic information from an image is an excellent, difficult high-level computer vision problem whose time has come. The emergence of vast amounts of geographically-calibrated image data is a great reason for computer vision to start looking globally - on the scale of the entire planet! In this paper, we propose a simple algorithm for estimating a distribution over geographic locations from a single image using a purely data-driven scene matching approach. For this task, we leverage a dataset of over 6 million GPS-tagged images from the Internet. We represent the estimated image location as a probability distribution over the Earthpsilas surface. We quantitatively evaluate our approach in several geolocation tasks and demonstrate encouraging performance (up to 30 times better than chance). We show that geolocation estimates can provide the basis for numerous other image understanding tasks such as population density estimation, land cover estimation or urban/rural classification.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mean shift: a robust approach toward feature space analysis
Comaniciu, D., & Meer, P. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.1000236 · Cited by 11,305
Martin, D., Fowlkes, C., Tal, D., & Malik, J. (2002) · Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001 · doi:10.1109/iccv.2001.937655 · Cited by 8,216
Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope
Oliva, A., & Torralba, A. (2001) · International Journal of Computer Vision · doi:10.1023/a:1011139631724 · Cited by 6,319
Photo tourism: exploring photo collections in 3D
Snavely, N., Seitz, S. M., & Szeliski, R. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141964 · Cited by 2,866
Chapter 2 Building the gist of a scene: the role of global image features in recognition
Oliva, A., & Torralba, A. (2006) · Progress in Brain Research · doi:10.1016/s0079-6123(06)55002-2 · Cited by 1,434
The proactive brain: using analogies and associations to generate predictions
Bar, M. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.05.005 · Cited by 1,144
Total Recall: Automatic Query Expansion with a Generative Feature Model for Object Retrieval
Chum, O., Philbin, J., Sivic, J., Isard, M., & Zisserman, A. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408891 · Cited by 859
What, where and who? Classifying events by scene and object recognition
Li, L.-J., & Fei-Fei, L. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408872 · Cited by 781
Photo tourism: exploring photo collections in 3D
Snavely, N., Seitz, S. M., & Szeliski, R. (2006) · ACM SIGGRAPH 2006 Papers on - SIGGRAPH '06 · doi:10.1145/1179352.1141964 · Cited by 696
Scene completion using millions of photographs
Hays, J., & Efros, A. A. (2007) · ACM SIGGRAPH 2007 papers · doi:10.1145/1275808.1276382 · Cited by 687
Self-citation
Cited by
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293
Flownet: Learning optical flow with convolutional networks
Dosovitskiy, A., Fischer, P., Ilg, E., Hausser, P., Hazirbas, C., Golkov, V., Smagt, P. V. D., Cremers, D., & Brox, T. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.316 · Cited by 4,313
“We use the code framework by Hays and Efros [18] 4.”
MethodSUN database: Large-scale scene recognition from abbey to zoo
Xiao, J., Hays, J., Ehinger, K. A., Oliva, A., & Torralba, A. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539970 · Cited by 3,283
Self-citationMayer, N., Ilg, E., Hausser, P., Fischer, P., Cremers, D., Dosovitskiy, A., & Brox, T. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.438 · Cited by 2,488
Image-Based Recommendations on Styles and Substitutes
McAuley, J., Targett, C., Shi, Q., & van den Hengel, A. (2015) · Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/2766462.2767755 · Cited by 2,280
Shortcut learning in deep neural networks
Geirhos, R., Jacobsen, J.-H., Michaelis, C., Zemel, R., Brendel, W., Bethge, M., & Wichmann, F. A. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-00257-z · Cited by 2,224
YFCC100M: the new data in multimedia research
Thomee, B., Shamma, D. A., Friedland, G., Elizalde, B., Ni, K., Poland, D., Borth, D., & Li, L.-J. (2016) · Communications of the ACM · doi:10.1145/2812802 · Cited by 1,541
Scalable Nearest Neighbor Algorithms for High Dimensional Data
Muja, M., & Lowe, D. G. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2321376 · Cited by 1,407
Elwood, S., Goodchild, M. F., & Sui, D. Z. (2012) · Annals of the Association of American Geographers · doi:10.1080/00045608.2011.595657 · Cited by 863
Crandall, D. J., Backstrom, L., Huttenlocher, D., & Kleinberg, J. (2009) · Proceedings of the 18th international conference on World wide web · doi:10.1145/1526709.1526812 · Cited by 769
CENTRIST: A Visual Descriptor for Scene Categorization
Wu, J., & Rehg, J. M. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.224 · Cited by 709
What makes Paris look like Paris?
Doersch, C., Singh, S., Gupta, A., Sivic, J., & Efros, A. A. (2012) · ACM Transactions on Graphics · doi:10.1145/2185520.2185597 · Cited by 663
Self-citationComputer Vision for Autonomous Vehicles: Problems, Datasets and State of the Art
Janai, J., Güney, F., Behl, A., & Geiger, A. (2020) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000079 · Cited by 643
Efficient & Effective Prioritized Matching for Large-Scale Image-Based Localization
Sattler, T., Leibe, B., & Kobbelt, L. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2611662 · Cited by 563
FlowNet: Learning Optical Flow with Convolutional Networks
Fischer, P., Dosovitskiy, A., Ilg, E., Haeusser, P., Hazırbaş, C., Golkov, V., van der Smagt, P., Cremers, D., & Brox, T. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.06852 · Cited by 562
End-to-End Learning of Deep Visual Representations for Image Retrieval
Gordo, A., Almazán, J., Revaud, J., & Larlus, D. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-017-1016-8 · Cited by 537
24/7 place recognition by view synthesis
Torii, A., Arandjelovic, R., Sivic, J., Okutomi, M., & Pajdla, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298790 · Cited by 536
Unsupervised Discovery of Mid-Level Discriminative Patches
Singh, S., Gupta, A., & Efros, A. A. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33709-3_6 · Cited by 491
Self-citationAn empirical study of context in object detection
Divvala, S. K., Hoiem, D., Hays, J. H., Efros, A. A., & Hebert, M. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206532 · Cited by 490
Self-citationFast image-based localization using direct 2D-to-3D matching
Sattler, T., Leibe, B., & Kobbelt, L. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126302 · Cited by 480
SuperParsing: Scalable Nonparametric Image Parsing with Superpixels
Tighe, J., & Lazebnik, S. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15555-0_26 · Cited by 477
Location Recognition Using Prioritized Feature Matching
Li, Y., Snavely, N., & Huttenlocher, D. P. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15552-9_57 · Cited by 436
LabelMe: Online Image Annotation and Applications
Torralba, A., Russell, B. C., & Yuen, J. (2010) · Proceedings of the IEEE · doi:10.1109/jproc.2010.2050290 · Cited by 431
Aesthetics and Emotions in Images
Joshi, D., Datta, R., Fedorovskaya, E., Luong, Q.-T., Wang, J., Li, J., & Luo, J. (2011) · IEEE Signal Processing Magazine · doi:10.1109/msp.2011.941851 · Cited by 408
With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representations
Dwibedi, D., Aytar, Y., Tompson, J., Sermanet, P., & Zisserman, A. (2021) · arXiv · doi:10.48550/arxiv.2104.14548 · Cited by 405
With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representations
Dwibedi, D., Aytar, Y., Tompson, J., Sermanet, P., & Zisserman, A. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00945 · Cited by 404
Learning deep representations for ground-to-aerial geolocalization
Lin, T.-Y., Cui, Y., Belongie, S., & Hays, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299135 · Cited by 401
Self-citationWide-Area Image Geolocalization with Aerial Reference Imagery
Workman, S., Souvenir, R., & Jacobs, N. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.451 · Cited by 400
Composing Text and Image for Image Retrieval - an Empirical Odyssey
Vo, N., Jiang, L., Sun, C., Murphy, K., Li, L.-J., Fei-Fei, L., & Hays, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00660 · Cited by 399
Self-citationPlaNet - Photo Geolocation with Convolutional Neural Networks
Weyand, T., Kostrikov, I., & Philbin, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_3 · Cited by 395
CVM-Net: Cross-View Matching Network for Image-Based Ground-to-Aerial Geo-Localization
Hu, S., Feng, M., Nguyen, R. M. H., & Lee, G. H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00758 · Cited by 394
Exploring the travel behaviors of inbound tourists to Hong Kong using geotagged photos
Vu, H. Q., Li, G., Law, R., & Ye, B. H. (2015) · Tourism Management · doi:10.1016/j.tourman.2014.07.003 · Cited by 371
Worldwide Pose Estimation Using 3D Point Clouds
Li, Y., Snavely, N., Huttenlocher, D., & Fua, P. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33718-5_2 · Cited by 366
Tour the world: Building a web-scale landmark recognition engine
Zheng, Y.-T., Zhao, M., Song, Y., Adam, H., Buddemeier, U., Bissacco, A., Brucher, F., Chua, T.-S., & Neven, H. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206749 · Cited by 341
SUN Database: Exploring a Large Collection of Scene Categories
Xiao, J., Ehinger, K. A., Hays, J., Torralba, A., & Oliva, A. (2016) · International Journal of Computer Vision · doi:10.1007/s11263-014-0748-y · Cited by 331
Self-citationTravel route recommendation using geotags in photo sharing sites
Kurashima, T., Iwata, T., Irie, G., & Fujimura, K. (2010) · Proceedings of the 19th ACM international conference on Information and knowledge management · doi:10.1145/1871437.1871513 · Cited by 317
On the "localness" of user-generated content
Hecht, B. J., & Gergle, D. (2010) · Proceedings of the 2010 ACM conference on Computer supported cooperative work · doi:10.1145/1718918.1718962 · Cited by 309
Cross-View Image Geolocalization
Lin, T.-Y., Belongie, S., & Hays, J. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.120 · Cited by 291
Self-citationGeography-Aware Self-Supervised Learning
Ayush, K., Uzkent, B., Meng, C., Tanmay, K., Burke, M., Lobell, D., & Ermon, S. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01002 · Cited by 288
Localizing and Orienting Street Views Using Overhead Imagery
Vo, N. N., & Hays, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_30 · Cited by 283
Self-citationPlacing flickr photos on a map
Serdyukov, P., Murdock, V., & van Zwol, R. (2009) · Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1571941.1572025 · Cited by 277
Presence-Only Geographical Priors for Fine-Grained Image Classification
Aodha, O. M., Cole, E., & Perona, P. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00969 · Cited by 149
Travel route recommendation using geotagged photos
Kurashima, T., Iwata, T., Irie, G., & Fujimura, K. (2013) · Knowledge and Information Systems · doi:10.1007/s10115-012-0580-z · Cited by 108
Tweet-mapping Method for Tourist Spots Based on Now-Tweets and Spot-photos
Oku, K., Hattori, F., & Kawagoe, K. (2015) · Procedia Computer Science · doi:10.1016/j.procs.2015.08.202 · Cited by 17
Metadata
- Authors
- Hays, J., & Efros, A. A.
- Venue
- 2008 IEEE Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2008-06
- Pages
- 1-8
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2103163130
- Cited by
- 877
- References
- 18
- FWCI
- 39.27
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.