Visual Place Recognition: A Survey
Open accessThe DOI matches its Crossref record; 233 of the 239 references it cites were found in a registry or an index.
Abstract
Visual place recognition is a challenging problem due to the vast range of ways in which the appearance of real-world places can vary. In recent years, improvements in visual sensing capabilities, an ever-increasing focus on long-term mobile robot autonomy, and the ability to draw on state-of-the-art research in other disciplines-particularly recognition in computer vision and animal navigation in neuroscience-have all contributed to significant advances in visual place recognition systems. This paper presents a survey of the visual place recognition research landscape. We start by introducing the concepts behind place recognition-the role of place recognition in the animal kingdom, how a “place” is defined in a robotics context, and the major components of a place recognition system. Long-term robot operations have revealed that changing appearance can be a significant factor in visual place recognition failure; therefore, we discuss how place recognition solutions can implicitly or explicitly account for appearance change within the environment. Finally, we close with a discussion on the future of visual place recognition, in particular with respect to the rapid advances being made in the related fields of deep learning, semantic scene understanding, and video description.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 1×
“with a mid-level convolutional neural network (CNN) feature [124] to identify and extract landmarks as illustrated in Fig.”
BackgroundHistograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584 · cited 3×
“McManus et al. [120] used the global descriptor HOG [121] on image patches to learn condition invariant scene signatures, while Sünderhauf et al. [122] used the Edge Boxes object proposal method [123] combined with a mid-level convolutional neural network (CNN) feature [124] to identify and extract landmarks as illust…”
Method(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
A Computational Approach to Edge Detection
Canny, J. (1986) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1986.4767851 · Cited by 30,004 · cited 1×
“Lamon et al. [105] used a variety of image features—such as edges [106], corners [107], and color patches—combined into a fingerprint of a location.”
BackgroundObject recognition from local scale-invariant features
Lowe, D. G. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790410 · Cited by 16,472 · cited 11×
“The U-SIFT [72] descriptor was shown to display the greatest lighting invariance of the tested descriptors.”
MethodInfluentialSURF: Speeded Up Robust Features
Bay, H., Tuytelaars, T., & Van Gool, L. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_32 · Cited by 14,955
A Combined Corner and Edge Detector
Harris, C., & Stephens, M. (1988) · Procedings of the Alvey Vision Conference 1988 · doi:10.5244/c.2.23 · Cited by 12,901 · cited 1×
“Lamon et al. [105] used a variety of image features—such as edges [106], corners [107], and color patches—combined into a fingerprint of a location.”
BackgroundBlei, D. M., Ng, A. Y., & Jordan, M. I. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0082 · Cited by 12,223
Baeza-Yates, R. A., & Ribeiro-Neto, B. A. (1999) · Cited by 11,505
ORB: An efficient alternative to SIFT or SURF
Rublee, E., Rabaud, V., Konolige, K., & Bradski, G. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126544 · Cited by 11,037 · cited 1×
“SIFT features as in [76], CenSurE features as in FrameSLAM [2], or ORB features [137] as in ORB-SLAM [136].”
Method
Research works printed but not linked: 6
- neira, 0, Mobile robot localization and map building using monocular vision, Proc 5th Symp Intell Robot Syst, 275
- lynch, 1960, The Image of the City
- 10.1177/0278364914551008 · DOI
- 10.1177/027836402761412467 · doi:10.1177/027836402761412467 · Paper page
- 10.21236/ADA576491 · doi:10.21236/ada576491 · Paper page
- sim, 2005, Vision-based SLAM using the Rao-Blackwellised particle filter, Proc IJCAI Workshop Reason Uncertainty Robot
Cited by
Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age
Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., Reid, I., & Leonard, J. J. (2016) · IEEE Transactions on Robotics · doi:10.1109/tro.2016.2624754 · Cited by 3,596
“[160], and some of its challenges are discussed in Section III.”
Self-citationPast, present, and future of simultaneous localization and mapping: Toward the robust-perception age
Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., Reid, I. D., & Leonard, J. J. (2016) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-138892 · Cited by 3,048
Self-citationSimultaneous Localization and Mapping: A Survey of Current Trends in Autonomous Driving
Bresson, G., Alsayed, Z., Yu, L., & Glaser, S. (2017) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2017.2749181 · Cited by 885
“focus on how to deal with seasonal or weather changes and we refer our readers to this survey [93] for a detailed view of this field, independently of loop closure.”
Autonomous vehicle perception: The technology of today and tomorrow
Van Brummelen, J., O’Brien, M., Gruyer, D., & Najjaran, H. (2018) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2018.02.012 · Cited by 869
Benchmarking 6DOF Outdoor Visual Localization in Changing Conditions
Sattler, T., Maddern, W., Toft, C., Torii, A., Hammarstrand, L., Stenborg, E., Safari, D., Okutomi, M., Pollefeys, M., Sivic, J., et al. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00897 · Cited by 699
“They are often used for place recognition [1, 17, 41, 55, 66, 69] and loop-closure detection [20,25,48].”
BackgroundComputer Vision for Autonomous Vehicles: Problems, Datasets and State of the Art
Janai, J., Güney, F., Behl, A., & Geiger, A. (2020) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000079 · Cited by 643
A review of multimodal image matching: Methods and applications
Jiang, X., Ma, J., Xiao, G., Shao, Z., & Guo, X. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.02.012 · Cited by 532
“Image localization mainly consists of the image processing module, the mapping framework, and the belief generation module [506].”
BackgroundPatch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognition
Hausler, S., Garg, S., Xu, M., Milford, M., & Fischer, T. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01392 · Cited by 444
“VPR is typically framed as an image retrieval task [45, 59, 76, 24], where, given a query image, the most similar database image (alongside associated metadata such as the camera pose) is retrieved.”
BackgroundSelf-citationSegMatch: Segment based place recognition in 3D point clouds
Dube, R., Dugas, D., Stumm, E., Nieto, J., Siegwart, R., & Cadena, C. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989618 · Cited by 339
“[2] state that using descriptors at the level of segments or objects could provide the benefits of both local and global feature approaches.”
BackgroundMethodVisual-Inertial Navigation: A Concise Review
Huang, G. (2019) · 2019 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2019.8793604 · Cited by 391
“In particular, whether or not performing loop closures in VINS either via mapping [83, 101, 102] and/or place recognition [103, 104, 105, 106, 107, 108] is one of the key differences between VIO and SLAM.”
BackgroundA survey of state-of-the-art on visual SLAM
Abaspur Kazerouni, I., Fitzgerald, L., Dooly, G., & Toal, D. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.117734 · Cited by 383
Spatial Pyramid-Enhanced NetVLAD With Weighted Triplet Loss for Place Recognition
Yu, J., Zhu, C., Zhang, J., Huang, Q., & Tao, D. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2908982 · Cited by 352
LPD-Net: 3D Point Cloud Learning for Large-Scale Place Recognition and Environment Analysis
Liu, Z., Zhou, S., Suo, C., Yin, P., Chen, W., Wang, H., Li, H., & Liu, Y. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00292 · Cited by 325
“Thanks to the feasibility of extracting visual feature descriptors from a query image of a local scene, vision-based approaches have achieved good retrieval performance for place recognitions with respect to the reference map [19, 9].”
BackgroundKim, G., Choi, S., & Kim, A. (2022) · IEEE Transactions on Robotics · doi:10.1109/tro.2021.3116424 · Cited by 319
MulRan: Multimodal Range Dataset for Urban Place Recognition
Kim, G., Park, Y. S., Cho, Y., Jeong, J., & Kim, A. (2020) · 2020 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra40945.2020.9197298 · Cited by 301
“We used the precision-recall curve [38] as the evaluation metric and the results are depicted in Fig.”
MethodOverlapNet: Loop Closing for LiDAR-based SLAM
Chen, X., Läbe, T., Milioto, A., Röhling, T., Vysotska, O., Haag, A., Behley, J., & Stachniss, C. (2020) · Robotics: Science and Systems XVI · doi:10.15607/rss.2020.xvi.009 · Cited by 240
“[21] for an overview of approaches using cameras.”
MethodVisual place recognition: A survey from deep learning perspective
Zhang, X., Wang, L., & Su, Y. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2020.107760 · Cited by 261
A survey on Visual-Based Localization: On the benefit of heterogeneous data
Piasco, N., Sidibé, D., Demonceaux, C., & Gouet-Brunet, V. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.09.013 · Cited by 236
“VisualPlace Recognition is a roboticist problem, defined in the general sense in [111] as the visual ability of a human, an animal or a robot to recognize an already visited place.”
BackgroundMethodInfluentialMa, J., Zhang, J., Xu, J., Ai, R., Gu, W., & Chen, X. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3178797 · Cited by 236
“In contrast to camera-based place recognition [1], [2], [3], [4], [5], LiDAR-based place recognition [6], [7], [8], [9] is comparably robust to day-and-night light changes and different weather conditions.”
BackgroundMethodComputer Vision for Autonomous Vehicles: Problems, Datasets and State of the Art
Janai, J., Güney, F., Behl, A., & Geiger, A. (2020) · doi:10.1561/9781680836899 · Cited by 232
Mapillary Street-Level Sequences: A Dataset for Lifelong Place Recognition
Warburg, F., Hauberg, S., Lopez-Antequera, M., Gargallo, P., Kuang, Y., & Civera, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00270 · Cited by 227
“hand-crafted features, particularly for drastic appearance changes [5, 31, 55].”
BackgroundSegMap: Segment-based mapping and localization using data-driven descriptors
Dubé, R., Cramariuc, A., Dugas, D., Sommer, H., Dymczyk, M., Nieto, J., Siegwart, R., & Cadena, C. (2020) · The International Journal of Robotics Research · doi:10.1177/0278364919863090 · Cited by 214
“earance has, however, significant limitations. In spite of tremendous progress within this field, state-of-the-art algorithms still struggle with changing seasons, weather or even day-night variations (Lowry et al. (2016)). On the other hand, several approaches address the variability of appearance by relying instead on…”
BackgroundMethodSLAM; definition and evolution
Taheri, H., & Xia, Z. C. (2021) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2020.104032 · Cited by 217
Venon, A., Dupuis, Y., Vasseur, P., & Merriaux, P. (2022) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2022.3167733 · Cited by 205
“on place recognition have been done in the visual modality and are described in the following survey [125].”
MethodAnyLoc: Towards Universal Visual Place Recognition
Keetha, N., Mishra, A., Karhade, J., Jatavallabhula, K. M., Scherer, S., Krishna, M., & Garg, S. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3343602 · Cited by 199
“There exists a variety of VPR methods and alternative problem formulations [3], [7]–[10]; in this work, we focus on global descriptors , which offer the best tradeoff between accurate matching and search efficiency [6], [11], [12].”
BackgroundHydra: A Real-time Spatial Perception System for 3D Scene Graph Construction and Optimization
Hughes, N., Chang, Y., & Carlone, L. (2022) · Robotics: Science and Systems XVIII · doi:10.15607/rss.2022.xviii.050 · Cited by 202
“Established approaches for visual loop closure detection in robotics trace back to place recognition and image retrieval techniques in computer vision; these approaches are broadly adopted in SLAM pipelines but are known to suffer from appearance and viewpoint changes [36].”
Long-Term Visual Localization Revisited
Toft, C., Maddern, W., Torii, A., Hammarstrand, L., Stenborg, E., Safari, D., Okutomi, M., Pollefeys, M., Sivic, J., Pajdla, T., et al. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3032010 · Cited by 190
“They are often used for place recognition [2], [17], [51], [68], [83], [89] and loop-closure detection [21], [28], [59].”
BackgroundA Survey on Deep Visual Place Recognition
Masone, C., & Caputo, B. (2021) · IEEE Access · doi:10.1109/access.2021.3054937 · Cited by 192
“Given its different perspective, this survey can be considered complementary to [3], [4] and we encourage the reader who wants to get a broader view on the subject to consult also these other documents.”
BackgroundInfluentialJiang, D., Li, G., Tan, C., Huang, L., Sun, Y., & Kong, J. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2021.04.019 · Cited by 192
Artificial Intelligence for Long-Term Robot Autonomy: A Survey
Kunze, L., Hawes, N., Duckett, T., Hanheide, M., & Krajnik, T. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2860628 · Cited by 191
TransVPR: Transformer-Based Place Recognition with Multi-Level Attention Aggregation
Wang, R., Shen, Y., Zuo, W., Zhou, S., & Zheng, N. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01328 · Cited by 185
“Visual Place Recognition (VPR) is an essential and challenging problem in autonomous driving and robot localization systems, which is usually defined as an image retrieval problem [27].”
BackgroundThe Trouble with Autopilots: Assisted and Autonomous Driving on the Social Road
Brown, B., & Laurier, E. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025462 · Cited by 186
“It is important to note that while there has been impressive progress [44], significant challenges remain on basic tasks–such as using vision to locate a car [11].”
BackgroundSegMap: 3D Segment Mapping using Data-Driven Descriptors
Dubé, R., Cramariuc, A., Dugas, D., Nieto, J., Siegwart, R., & Cadena, C. (2018) · Robotics: Science and Systems XIV · doi:10.15607/rss.2018.xiv.003 · Cited by 186
“This transformation is fed to an incremental pose-graph SLAM solver which in turn estimates, in real-time, the trajectories of all robots [8].”
BackgroundInfluentialX-View: Graph-Based Semantic Multi-View Localization
Gawel, A., Don, C. D., Siegwart, R., Nieto, J., & Cadena, C. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2801879 · Cited by 183
AntBot: A six-legged walking robot able to home like desert ants in outdoor environments
Dupeyroux, J., Serres, J. R., & Viollet, S. (2019) · Science Robotics · doi:10.1126/scirobotics.aau0307 · Cited by 179
Tsintotas, K. A., Bampis, L., & Gasteratos, A. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3175656 · Cited by 175
“Similar surveys can be found in the related literature, although they focus more on mapping techniques [4]–[6] or place recognition, relevant to robotics and other research areas, including computer vision, viz., Lowry et al. [7], Zhang et al. [8], Masone and Caputo [9], and Garg et al. [10].”
BackgroundAre Large-Scale 3D Models Really Necessary for Accurate Visual Localization?
Sattler, T., Torii, A., Sivic, J., Pollefeys, M., Taira, H., Okutomi, M., & Pajdla, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.654 · Cited by 170
“Determining the location from which a photo was taken is a key challenge in the navigation of autonomous vehicles such as self-driving cars and drones [28], robotics [30], mobile Augmented Reality [31, 32], and Structure-fromMotion (SfM) [2, 14, 42, 43].”
BackgroundKhaliq, A., Ehsan, S., Chen, Z., Milford, M. J., & McDonald-Maier, K. D. (2019) · IEEE Transactions on Robotics · doi:10.1109/tro.2019.2956352 · Cited by 182
“Visual place recognition (VPR) can also be interpreted as an image retrieval system that tries to recognize a place by matching it with the places from the stored database [1].”
BackgroundSelf-citationZaffar, M., Garg, S., Milford, M. J., Kooij, J. F. P., Flynn, D., McDonald-Maier, K. D., & Ehsan, S. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01469-5 · Cited by 212
“niques, datasets and evaluation metrics has been thoroughly reviewed by Lowry et al. (2015).”
BackgroundSelf-citationOptimal Transport Aggregation for Visual Place Recognition
Izquierdo, S., & Civera, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01672 · Cited by 330
“The significant research efforts on VPR have been exhaustively compiled in a number of surveys and tutorials over the years [19, 36, 37, 49, 64].”
BackgroundSelf-Supervised Visual Descriptor Learning for Dense Correspondence
Schmidt, T., Newcombe, R., & Fox, D. (2017) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2016.2634089 · Cited by 148
“[15] provide a useful overview of visual place recognition, the challenges involved, and the important to robotics of identifying correspondences.”
BackgroundAn online multi-robot SLAM system for 3D LiDARs
Dubé, R., Gawel, A., Sommer, H., Nieto, J. I., Siegwart, R., & Cadena, C. (2017) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8202268 · Cited by 167
“approaches [3] which can however become unreliable when strong changes in illumination occur, and in the presence of strong viewpoint variations [4].”
BackgroundLightweight Unsupervised Deep Loop Closure
Merrill, N., & Huang, G. P. (2018) · Robotics: Science and Systems · doi:10.15607/rss.2018.xiv.032 · Cited by 171
A Survey on Global LiDAR Localization: Challenges, Advances and Open Problems
Yin, H., Xu, X., Lu, S., Chen, X., Xiong, R., Shen, S., Stachniss, C., & Wang, Y. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02019-5 · Cited by 203
“From the view of global LiDAR localization, we present a complete survey that covers relevant topics, like the ones [7], [17] on vision.”
InfluentialSemantic Graph Based Place Recognition for 3D Point Clouds
Kong, X., Yang, X., Zhai, G., Zhao, X., Zeng, X., Wang, M., Liu, Y., Li, W., & Wen, F. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341060 · Cited by 140
“However, due to the interference of external conditions such as weather, seasons, illumination, and viewpoint changes, image-based methods are probably failed to retrieve the correct match [8].”
BackgroundLocalization and Mapping for Robots in Agriculture and Forestry: A Survey
Aguiar, A., dos Santos, F. N., Boaventura‐Cunha, J., Sobreira, H., & Sousa, A. J. (2020) · Robotics · doi:10.3390/robotics9040097 · Cited by 168
“As stated by Lowry et al. [50], a topological map is conceptually a biological cognitive map, where nodes represent possible places in the world and edges the possible paths that connect these nodes.”
Deep regression for monocular camera-based 6-DoF global localization in outdoor environments
Naseer, T., & Burgard, W. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8205957 · Cited by 137
“Recently, convolutional neural networks (CNNs) have shown tremendous progress in the area of visual place recognition in such perceptually challenging conditions [13].”
BackgroundWang, K., Gou, C., Zheng, N., Rehg, J. M., & Wang, F. (2017) · Artificial Intelligence Review · doi:10.1007/s10462-017-9569-z · Cited by 138
“One suchexampleisvisualplacerecognition,whichreferstodetectingwhentwoimagesinavideo sequencedepictthesamelocation,possiblyundercameraviewpointorillumination-related appearancechanges(Lowryetal.2016).”
Chen, C., Zhu, H. J., Li, M., & You, S. (2018) · Robotics · doi:10.3390/robotics7030045 · Cited by 146
“Loop closure schematic, reproduced from [108].”
Are Large-Scale 3D Models Really Necessary for Accurate Visual Localization?
Torii, A., Taira, H., Sivic, J., Pollefeys, M., Okutomi, M., Pajdla, T., & Sattler, T. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2941876 · Cited by 126
“D ETERMINING the location from which a photo was taken is a key challenge in the navigation of autonomous vehicles such as self-driving cars and drones [1], robotics [2], mobile Augmented Reality [3], [4], and Structure-from-Motion (SfM) [5], [6], [7], [8].”
BackgroundIncremental Adversarial Domain Adaptation for Continually Changing Environments
Wulfmeier, M., Bewley, A., & Posner, I. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460982 · Cited by 114
$R^{2}$ Former: Unified Retrieval and Reranking Transformer for Place Recognition
Zhu, S., Yang, L., Chen, C., Shah, M. A., Shen, X., & Wang, H. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01856 · Cited by 203
“Visual place recognition (VPR) [2,21,38,39,47,58,60] is traditionally addressed with nearest neighbor search on aggregated [28] hand-crafted features [12, 37].”
BackgroundNeuroSLAM: a brain-inspired SLAM system for 3D environments
Yu, F., Shang, J., Hu, Y., & Milford, M. J. (2019) · Biological Cybernetics · doi:10.1007/s00422-019-00806-9 · Cited by 131
Self-citationZheng, H., Zhong, Z., Hu, R., Xiao, B., Wu, Y., Yu, F., Liu, X., Li, G., & Deng, L. (2024) · Nature Communications · doi:10.1038/s41467-023-44614-z · Cited by 184
“Therobot visual place recognition has become an increasingly important area in the robotics community, as it enables robots to better comprehend the spatial properties of the environment 52 .”
Acharya, D., Khoshelham, K., & Winter, S. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.02.020 · Cited by 127
LoGG3D-Net: Locally Guided Global Descriptor Learning for 3D Place Recognition
Vidanapathirana, K., Ramezani, M., Moghadam, P., Sridharan, S., & Fookes, C. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9811753 · Cited by 167
“Compared to visual place recognition [3], the use of”
BackgroundChen, C., Wang, B., Lu, C. X., Trigoni, N., & Markham, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.12567 · Cited by 207
“…being developed, for example, odometry estimation (including visual odometry [9], [10], [11], visual-inertial odometry [12], [13], [14], [15] and LIDAR odometry [16]), image-based localization [17], [18], place recognition [19], SLAM [10], [20], [21], and structure from motion (SfM) [22], [23].”
BackgroundDelight: An Efficient Descriptor for Global Localisation Using LiDAR Intensities
Cop, K. P., Borges, P. V. K., & Dubé, R. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8460940 · Cited by 124
“Cameras have also been successfully applied for place recognition [1], but they suffer from lower performance in unfavourable lighting conditions.”
BackgroundSemantics for Robotic Mapping, Perception and Interaction: A Survey
Garg, S., Sünderhauf, N., Dayoub, F., Morrison, D., Cosgun, A., Carneiro, G., Wu, Q., Chin, T.-J., Reid, I., Gould, S., et al. (2020) · Foundations and Trends® in Robotics · doi:10.1561/2300000059 · Cited by 105
Self-citationDiSCO: Differentiable Scan Context With Orientation
Xu, X., Yin, H., Chen, Z., Li, Y., Wang, Y., & Xiong, R. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3060741 · Cited by 114
“Thanks to the rich information in vision sensors, lots of successful visual place recognition methods were presented [1], [2], [3].”
BackgroundEvers, C., & Naylor, P. A. (2018) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2018.2828321 · Cited by 112
“Simultaneous Localization and Mapping (SLAM) is classically applied in applications such as robotics using visual and optical sensors [1]–[3].”
Method4D crop monitoring: Spatio-temporal reconstruction for agriculture
Dong, J., Burnham, J. G., Boots, B., Rains, G. C., & Dellaert, F. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989447 · Cited by 129
Ultra-wideband aided fast localization and mapping system
Wang, C., Zhang, H., Nguyen, T.-M., & Xie, L. (2017) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8205968 · Cited by 114
“So far most of the works on loop closure detections are still based on visual techniques which require additional computational resources or pretrained data [6], [7].”
BackgroundLocNet: Global Localization in 3D Point Clouds for Mobile Vehicles
Yin, H., Tang, L., Ding, X., Wang, Y., & Xiong, R. (2018) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2018.8500682 · Cited by 119
“The results of a place recognition algorithm are described using precision and recall metrics [20].”
MethodDeep learning methods for fingerprint-based indoor positioning: a review
Alhomayani, F. M., & Mahoor, M. H. (2020) · Journal of Location Based Services · doi:10.1080/17489725.2020.1817582 · Cited by 134
“The main source of positioning error is caused by perceptual aliasing [58], in which two images of two different places appear similar due to lighting conditions or repetitive structures and surfaces.”
BackgroundCollaborative visual SLAM for multiple agents:A brief survey
Zou, D., Tan, P., & Yu, W. (2019) · Virtual Reality & Intelligent Hardware · doi:10.1016/j.vrih.2019.09.002 · Cited by 99
“Place recognition [56] is a fundamental task for detection of revisited area for loop closure or overlapping area for map fusion, through checking whether the two images are similar or not.”
BackgroundA comprehensive review of recent advances on deep vision systems
Abbas, Q., Ibrahim, M. E. A., & Jaffar, M. A. (2019) · Artificial Intelligence Review · doi:10.1007/s10462-018-9633-3 · Cited by 99
“However, these surveys focused only on one type of the deep learning methods which is the CNN (Chellappa 2016) or on a specific object recognition application (Lowry et al. 2016).”
BackgroundRobust normal vector estimation in 3D point clouds through iterative principal component analysis
Sanchez, J., Denis, F., Cœurjolly, D., Florent Dupont, A., Trassoudaine, L., & Checchin, P. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.02.018 · Cited by 99
Beyond Cross-view Image Retrieval: Highly Accurate Vehicle Localization Using Satellite Image
Shi, Y., & Li, H. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01650 · Cited by 176
“It is solved by ground-toground (G2G) image matching [3, 8, 9, 13, 14, 20, 29, 34, 36, 40, 43, 58].”
BackgroundDeep Learning for Visual Localization and Mapping: A Survey
Chen, C., Wang, B., Lu, C. X., Trigoni, N., & Markham, A. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3309809 · Cited by 97
“[5] 2016 SLAM in robust-perception age Cadena et al.”
A Survey of Deep Learning Applications to Autonomous Vehicle Control
Kuutti, S., Bowden, R., Jin, Y., Barber, P., & Fallah, S. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2962338 · Cited by 96
“in autonomous vehicle applications, including planning and decision making [27]–[31], perception [32]–[36], as well as mapping and localisation [37]–[39].”
BackgroundLajoie, P., Ramtoula, B., Wu, F., & Beltrame, G. (2022) · Field Robotics · doi:10.55417/fr.2022032 · Cited by 127
“In the case of visual sensors, the place recognition problem has been studied extensively (Lowry et al., 2016).”
BackgroundSemantic–geometric visual place recognition: a new perspective for reconciling opposing views
Garg, S., Sünderhauf, N., & Milford, M. J. (2019) · The International Journal of Robotics Research · doi:10.1177/0278364919839761 · Cited by 116
“Because of both improving camera technology and its relevance to many mobile autonomy applications, VPR has been an area of increasing research attention over the past decade (Lowry et al., 2016).”
BackgroundSelf-citationProgress and Development Trend of Space Intelligent Robot Technology
Jiang, Z., Cao, X., Huang, X., Li, H., & Ceccarelli, M. (2022) · Space Science & Technology · doi:10.34133/2022/9832053 · Cited by 95
“Meanwhile, machine vision is an important basis for robotic manipulation, and the image filtering, recognition, and accurate positioning methods of the current machine vision have made great progress [26, 27].”
BackgroundDeep Visual Geo-localization Benchmark
Berton, G., Mereu, R., Trivigno, G., Masone, C., Csurka, G., Sattler, T., & Caputo, B. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00532 · Cited by 153
“The only available benchmark focused specifically on VG/VPR is VPR-Bench [80].”
MethodZaffar, M., Ehsan, S., Milford, M. J., & McDonald-Maier, K. D. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2969917 · Cited by 116
“The extensive review performed by Lowry et al. in [1] identifies high precision to be a desirable characteristic of a VPR system due to the advent of false-positive prediction systems (as in [59], [60], [61]).”
BackgroundSelf-citationRobust Long-Term Registration of UAV Images of Crop Fields for Precision Agriculture
Chebrolu, N., Labe, T., & Stachniss, C. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2849603 · Cited by 89
“hensive survey of the visual place recognition techniques can be found in [13].”
BackgroundAitken, J. M., Evans, M. H., Worley, R., Edwards, S., Zhang, R., Dodd, T. J., Mihaylova, L. S., & Anderson, S. (2021) · IEEE Access · doi:10.1109/access.2021.3115981 · Cited by 116
“Cameras can also be used in appearance-based SLAM methods [36], [43] and to recognise landmark features in pipes such as T-junctions, elbows etc.”
MethodRING++: Roto-Translation Invariant Gram for Global Localization on a Sparse Scan Map
Xu, X., Lu, S., Wu, J., Lu, H., Zhu, Q., Liao, Y., Xiong, R., & Wang, Y. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2023.3303035 · Cited by 122
“However, these approaches are sensitive to illumination and seasonal changes between current and mapping session [1], [2].”
BackgroundRobotic Room-Level Localization Using Multiple Sets of Sonar Measurements
Liu, H., Sun, F., Fang, B., & Zhang, X. (2016) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2016.2618978 · Cited by 88
“Reference [25] provided a comprehensive review of the current state of place recognition research that was relevant both to robotics and other fields of research, including computer vision and neuroscience.”
BackgroundBrain-inspired multimodal hybrid neural network for robot place recognition
Yu, F., Wu, Y., Ma, S., Xu, M., Li, H., Qu, H., Song, C., Wang, T., Zhao, R. J., & Shi, L. (2023) · Science Robotics · doi:10.1126/scirobotics.abm6996 · Cited by 90
“Many recent studies have achieved great progress in improving the performance of place recognition with a single image or jointly with image, geometric, and semantic information ( 1 – 5 ).”
BackgroundDing, L., Huang, L., Li, S., Gao, H., Deng, H., Li, Y., & Liu, G. (2020) · IEEE Transactions on Robotics · doi:10.1109/tro.2020.2981822 · Cited by 91
“Considering that the slip ratio is also defined as the difference between the commanded longitudinal motion and actual longitudinal motion at the WMR level, the measured travel distanceDm and the estimated travel distance De [40], [44] are substituted into (40) to approximate typical values of the slip estimation erro…”
MethodInfluential4Seasons: A Cross-Season Dataset for Multi-Weather SLAM in Autonomous Driving
Wenzel, P., Wang, R., Yang, N., Cheng, Q., Khan, Q., von Stumberg, L., Zeller, N., & Cremers, D. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-71278-5_29 · Cited by 113
“Global place recognition refers to the task of retrieving the most similar database image given a query image [26].”
BackgroundCricaVPR: Cross-Image Correlation-Aware Representation Learning for Visual Place Recognition
Lu, F. H., Lan, X., Zhang, L., Jiang, D., Wang, Y., & Yuan, C. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01587 · Cited by 160
“However, there are three key challenges in VPR: condition (e.g., lighting, weather, and season) variations, viewpoint variations, and perceptual aliasing [40] (difficult to distinguish highly similar images taken from different places).”
BackgroundFast loop-closure detection using visual-word-vectors from image sequences
Bampis, L., Amanatiadis, A. A., & Gasteratos, A. C. (2017) · The International Journal of Robotics Research · doi:10.1177/0278364917740639 · Cited by 85
“For an extended survey of vPR, the reader can refer to the work of Lowry et al. (2016).”
BackgroundDARE-SLAM: Degeneracy-Aware and Resilient Loop Closing in Perceptually-Degraded Environments
Ebadi, K., Palieri, M., Wood, S. L., Padgett, C. W., & Agha–mohammadi, A. (2021) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-021-01362-w · Cited by 97
“localization and place recognition is a popular and well studied problem in the robotics and computer vision literature [16], and while great progress has been made in visual loop closure detection [17,18], vision-based methods are faced with many challenges in perceptuallydegraded environments including reduced visib…”
BackgroundGOSMatch: Graph-of-Semantics Matching for Detecting Loop Closures in 3D LiDAR data
Zhu, Y., Ma, Y., Chen, L. F., Liu, C., Ye, M., & Li, L. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341299 · Cited by 82
“Though many vision-based methods have been proposed in recent years [2]–[4], it may draw unreliable results in the cases of dramatic changes on illumination [5] or viewpoint [6].”
BackgroundAdvances in Inference and Representation for Simultaneous Localization and Mapping
Rosen, D. M., Doherty, K., Espinoza, A. T., & Leonard, J. J. (2021) · Annual Review of Control Robotics and Autonomous Systems · doi:10.1146/annurev-control-072720-082553 · Cited by 106
“(15) addressed the specific problem of place recognition, which is closely related to issues of environmental representation and semantic mapping but aimed primarily at the problem of identifying loop closures.”
BackgroundSelf-citationSimultaneous Localization And Mapping: Present, Future, and the Robust-Perception Age.Preprint
Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., Reid, I. D., & Leonard, J. J. (2016) · arXiv (Cornell University) · Cited by 90
Self-citationAssigning Visual Words to Places for Loop Closure Detection
Tsintotas, K. A., Bampis, L., & Gasteratos, A. C. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8461146 · Cited by 77
“In recent autonomous systems with increased computational powers, cameras have become the primary sensor modules for appearance-based place recognition due to the rich information they provide [6].”
BackgroundRobust Visual Localization in Dynamic Environments Based on Sparse Motion Removal
Cheng, J., Wang, C., & Meng, M. Q. ‐. (2019) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2019.2940543 · Cited by 76
“Addressing the dynamic factors has been a hot topic in SLAM community and many popular algorithms have been developed to deal with the temporal changes [11], which provides a good insight.”
BackgroundIndoor Relocalization in Challenging Environments With Dual-Stream Convolutional Neural Networks
Li, R., Liu, Q., Gui, J., Gu, D., & Hu, H. (2017) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2017.2664920 · Cited by 80
“Relocalization could also be transferred to a loop closure detector in SLAM [8].”
BackgroundScalable Place Recognition Under Appearance Change for Autonomous Driving
Doan, A.-D., Latif, Y., Chin, T.-J., Liu, Y., Do, T.-T., & Reid, I. D. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00941 · Cited by 88
“Place recognition (PR) is the broad problem of recognizing “places” based on visual inputs [26, 6].”
BackgroundAerial orthoimage generation for UAV remote sensing: Review
Zhang, J., Xu, S., Zhao, Y., Sun, J., Xu, S., & Zhang, X. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.08.007 · Cited by 88
Foundations of spatial perception for robotics: Hierarchical representations and real-time systems
Hughes, N., Chang, Y., Hu, S., Talak, R., Abdulhai, R., Strader, J., & Carlone, L. (2024) · The International Journal of Robotics Research · doi:10.1177/02783649241229725 · Cited by 145
“Established approaches for visual loop closure detection in robotics trace back to place recognition and image retrieval techniques in computer vision; these approaches are broadly adopted in SLAM pipelines but are known to suffer from appearance and viewpoint changes (Lowry et al., 2016).”
Image Provenance Analysis at Scale
Moreira, D., Bharati, A., Brogan, J., Pinto, A., Parowski, M., Bowyer, K. W., Flynn, P. J., Rocha, A., & Scheirer, W. J. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2865674 · Cited by 73
Probabilistic Data Association via Mixture Models for Robust Semantic SLAM
Doherty, K., Baxter, D. P., Schneeweiss, E., & Leonard, J. J. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9197382 · Cited by 76
“loop closure (see, for example [15]), whereas in semantic SLAM we also want to locate and classify discrete objects.”
Self-citationLiu, Z., Suo, C., Zhou, S., Xu, F., Wei, H., Chen, W., Wang, H., Liang, X., & Liu, Y. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8967875 · Cited by 76
“These visual feature descriptors can be aggregated into a global descriptor of the scene for place recognition [4].”
BackgroundEvent-Based Visual Place Recognition With Ensembles of Temporal Windows
Fischer, T., & Milford, M. J. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.3025505 · Cited by 88
“As an excellent survey on VPR can be found in [17], we limit our”
Self-citationSeqOT: A Spatial–Temporal Transformer Network for Place Recognition Using Sequential LiDAR Data
Ma, J., Chen, X., Xu, J., & Xiong, G. (2022) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2022.3229385 · Cited by 69
“Place recognition is a classic topic in robotics and computer vision [2], [3], [10], [11], [12].”
Background
Metadata
- Authors
- Lowry, S., Sünderhauf, N., Newman, P., Leonard, J. J., Cox, D., Corke, P., & Milford, M. J.
- Affiliations
- Queensland University of Technology (AU)
- University of Oxford (GB)
- MIT Computer Science and Artificial Intelligence Laboratory (US)
- Harvard University (US)
- ORCID
- Venue
- IEEE Transactions on Robotics
- Published
- 2016-02
- Volume
- 32
- Issue
- 1
- Pages
- 1-19
- ISSN
- 1552-3098 (ISSN-L)
- 1941-0468
- OpenAlex
- W2284029970
- Cited by
- 1,079
- References
- 239
- Citations by year
- 2026: 47 · 2025: 63 · 2024: 111 · 2023: 112 · 2022: 109 · 2021: 148 · 2020: 156 · 2019: 132 · 2018: 100 · 2017: 72 · 2016: 29
- FWCI
- 97.28
- Type
- journal article
- Language
- en
- Open access
- green
- purl.org
- Licence
- Locations
- IEEE Transactions on Robotics (publishedVersion)
- QUT ePrints (Queensland University of Technology) (submittedVersion)
- Funders
- ARC Future Fellowship (FT140101229)
- Australian Centre for Robotic Vision
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Spatial Cognition and Navigation
- Keywords
- visual place recognition, place recognition, appearance changes, animal navigation, semantic scene understanding, audio description, deep learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.