Visual Place Recognition: A Survey
Open accessThe DOI matches its Crossref record; 233 of the 239 references it cites were found in a registry or an index.
Abstract
Visual place recognition is a challenging problem due to the vast range of ways in which the appearance of real-world places can vary. In recent years, improvements in visual sensing capabilities, an ever-increasing focus on long-term mobile robot autonomy, and the ability to draw on state-of-the-art research in other disciplines-particularly recognition in computer vision and animal navigation in neuroscience-have all contributed to significant advances in visual place recognition systems. This paper presents a survey of the visual place recognition research landscape. We start by introducing the concepts behind place recognition-the role of place recognition in the animal kingdom, how a “place” is defined in a robotics context, and the major components of a place recognition system. Long-term robot operations have revealed that changing appearance can be a significant factor in visual place recognition failure; therefore, we discuss how place recognition solutions can implicitly or explicitly account for appearance change within the environment. Finally, we close with a discussion on the future of visual place recognition, in particular with respect to the rapid advances being made in the related fields of deep learning, semantic scene understanding, and video description.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 1×
“with a mid-level convolutional neural network (CNN) feature [124] to identify and extract landmarks as illustrated in Fig.”
BackgroundHistograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584 · cited 3×
“McManus et al. [120] used the global descriptor HOG [121] on image patches to learn condition invariant scene signatures, while Sünderhauf et al. [122] used the Edge Boxes object proposal method [123] combined with a mid-level convolutional neural network (CNN) feature [124] to identify and extract landmarks as illust…”
Method(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
A Computational Approach to Edge Detection
Canny, J. (1986) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1986.4767851 · Cited by 30,004 · cited 1×
“Lamon et al. [105] used a variety of image features—such as edges [106], corners [107], and color patches—combined into a fingerprint of a location.”
BackgroundObject recognition from local scale-invariant features
Lowe, D. G. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790410 · Cited by 16,472 · cited 11×
“The U-SIFT [72] descriptor was shown to display the greatest lighting invariance of the tested descriptors.”
MethodInfluentialSURF: Speeded Up Robust Features
Bay, H., Tuytelaars, T., & Van Gool, L. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_32 · Cited by 14,955
A Combined Corner and Edge Detector
Harris, C., & Stephens, M. (1988) · Procedings of the Alvey Vision Conference 1988 · doi:10.5244/c.2.23 · Cited by 12,901 · cited 1×
“Lamon et al. [105] used a variety of image features—such as edges [106], corners [107], and color patches—combined into a fingerprint of a location.”
BackgroundBlei, D. M., Ng, A. Y., & Jordan, M. I. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0082 · Cited by 12,223
Baeza-Yates, R. A., & Ribeiro-Neto, B. A. (1999) · Cited by 11,505
ORB: An efficient alternative to SIFT or SURF
Rublee, E., Rabaud, V., Konolige, K., & Bradski, G. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126544 · Cited by 11,037 · cited 1×
“SIFT features as in [76], CenSurE features as in FrameSLAM [2], or ORB features [137] as in ORB-SLAM [136].”
Method
Research works printed but not linked: 6
- neira, 0, Mobile robot localization and map building using monocular vision, Proc 5th Symp Intell Robot Syst, 275
- lynch, 1960, The Image of the City
- 10.1177/0278364914551008 · DOI
- 10.1177/027836402761412467 · doi:10.1177/027836402761412467 · Paper page
- 10.21236/ADA576491 · doi:10.21236/ada576491 · Paper page
- sim, 2005, Vision-based SLAM using the Rao-Blackwellised particle filter, Proc IJCAI Workshop Reason Uncertainty Robot
Cited by
Items 201–300 of 1,000
Visual Semantic Navigation Based on Deep Learning for Indoor Mobile Robots
Wang, L., Zhao, L., Huo, G., Li, R., Hou, Z., Luo, P., Sun, Z., Wang, K., & Yang, C. (2018) · Complexity · doi:10.1155/2018/1627185 · Cited by 32
“Semantics in mobile robot navigation has been mainly used for place recognition, allowing mobile robots to build relationships based on places [13].”
BackgroundMemorable Maps: A Framework for Re-Defining Places in Visual Place Recognition
Zaffar, M., Ehsan, S., Milford, M. J., & McDonald-Maier, K. D. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3001228 · Cited by 40
Self-citationChen, H., ZHANG, G., & Ye, Y. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.3010580 · Cited by 32
“Currently, the appearance-based method dominates the field of loop closure detection and place recognition [7].”
MethodEfficient Environmental Context Prediction for Lower Limb Prostheses
Zhong, B., da Silva, R. L., Tran, M., Huang, H., & Lobaton, E. J. (2021) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2021.3084036 · Cited by 33
“For an environment prediction system, deep neural networks are commonly used because they have shown promising performance for complex visual tasks, such as semantic segmentation [15], site recognition [16] and grasping target recognition [17].”
MethodDual-Layer Path Planning With Pose SLAM for Autonomous Exploration in GPS-Denied Environments
Shi, Z., Cui, R., Yan, W., & Li, Y. (2023) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2023.3288187 · Cited by 35
“It is more efficient to constrain sensory matches to a few neighboring poses using filter information, rather than directly searching for features in a sensor database [32], [33].”
BackgroundLearning Deployable Navigation Policies at Kilometer Scale from a Single TraversalPreprint
Bruce, J., Sünderhauf, N., Mirowski, P., Hadsell, R. T., & Milford, M. J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.05211 · Cited by 39
“…places in the face of appearance and viewpoint change [36]; however, reducing perceptual aliasing and appearance differences is an active area of research in place recognition and SLAM [25] and many other techniques developed for that purpose may also provide improvements in work like ours.”
BackgroundMethodSelf-citationEvaluation of Object Proposals and ConvNet Features for Landmark-based Visual Place Recognition
Hou, Y., Zhang, H., & Zhou, S. (2017) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-017-0735-y · Cited by 28
“In visual place recognition, the precision-recall curve is regarded as a standard evaluation criterion [1, 2, 20].”
BackgroundMethodInfluentialSpoxelNet: Spherical Voxel-based Deep Place Recognition for 3D Point Clouds of Crowded Indoor Spaces
Chang, M. Y., Yeon, S., Ryu, S., & Lee, D. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341549 · Cited by 30
Hu, H., Wang, H., Liu, Z., & Chen, W. (2021) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2021.1003907 · Cited by 35
“Recent works for condition-invariant deep representation learning [5], [58], [59] in long-term changing environments mainly rely on varianceremoval or other auxiliary information introduced in II-A .”
BackgroundSurvey of maps of dynamics for mobile robots
Kucner, T. P., Magnusson, M., Mghames, S., Palmieri, L., Verdoja, F., Swaminathan, C. S., Krajník, T., Schaffernicht, E., Bellotto, N., Hanheide, M., et al. (2023) · The International Journal of Robotics Research · doi:10.1177/02783649231190428 · Cited by 42
“As we have already pointed out a thorough overview of the methods coping with place recognition under appearance change can be found in a survey by Lowry et al. (2016), followed by a more recent survey by Zhang et al. (2021), that approaches the problem from the deep learning perspective.”
BackgroundNeuromorphic sequence learning with an event camera on routes through vegetation
Zhu, L., Mangan, M., & Webb, B. H. (2023) · Science Robotics · doi:10.1126/scirobotics.adg3679 · Cited by 34
Benchmarking 6-DOF Outdoor Visual Localization in Changing ConditionsPreprint
Sattler, T., Maddern, W., Toft, C., Torii, A., Hammarstrand, L., Stenborg, E., Safari, D., Okutomi, M., Pollefeys, M., Šivic, J., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.09092 · Cited by 51
“…the impact of changing conditions on the highly related place recognition problem has received significant attention, especially in the robotics community [16, 40, 46, 51, 72, 76] where robust localization under varying conditions is critical for visual navigation of autonomous vehicles.”
BackgroundA hybrid compact neural architecture for visual place recognition
Chancán, M., Hernandez-Nunez, L., Narendra, A., Barron, A. B., & Milford, M. J. (2020) · QUT ePrints (Queensland University of Technology) · Cited by 29
Self-citationSTA-VPR: Spatio-Temporal Alignment for Visual Place Recognition
Lu, F. H., Chen, B., Zhou, X., & Song, D. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3067623 · Cited by 30
“other hand, multiple different places in an environment can exhibit high similarity, which leads to a problem known as perceptual aliasing [1].”
BackgroundLoop-Closure Detection Using Local Relative Orientation Matching
Ma, J., Ye, X., Zhou, H., Mei, X., & Fan, F. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3074520 · Cited by 29
Vector Semantic Representations as Descriptors for Visual Place Recognition
Neubert, P., Schubert, S., Schlegel, K., & Protzel, P. (2021) · Robotics: Science and Systems · doi:10.15607/rss.2021.xvii.083 · Cited by 36
“Visual place recognition [39] is an important task in mobile robotics and used for loop closure detection in SLAM or candidate selection for visual localization [56].”
MethodKong, D., Fang, Z., Hou, K., Li, H., Jiang, J., Coleman, S., & Kerr, D. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3168892 · Cited by 32
“V ISUAL place recognition (VPR) [1] [2] aims to help a robot or a vision-based navigation system determine”
BackgroundHighly Robust Visual Place Recognition Through Spatial Matching of CNN Features
Camara, L. G., Gaebert, C., & Přeučil, L. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9196967 · Cited by 30
“In particular, systems whose main sensors are cameras typically solve loop closure by Visual Place Recognition (VPR) [6, 7, 8, 6, 9, 10], a fundamental and still open problem in computer vision.”
BackgroundStructVPR: Distill Structural Knowledge with Weighting Samples for Visual Place Recognition
Shen, Y., Zhou, S., Fu, J., Wang, R., Chen, S., & Zheng, N. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01079 · Cited by 38
“Visual place recognition (VPR) is a critical task in autonomous driving and robotics, and researchers usually regard it as an image retrieval problem [28, 30, 54].”
BackgroundLeveraging Map Retrieval and Alignment for Robust UAV Visual Geo-Localization
He, M., Liu, J., Gu, P., & Meng, Z. (2024) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2024.3418097 · Cited by 28
“These approaches draw inspiration from the visual place recognition (VPR) problem [26], [27], [28], [29] and organize the satellite maps as a geo-referenced database for image retrieval.”
BackgroundScene Recognition for Indoor Localization of Mobile Robots Using Deep CNN
Woźniak, P., Afrisal, H., Esparza, R. G., & Kwolek, B. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00692-1_13 · Cited by 31
“Visual place recognition algorithm is one of many solutions to provide a mobile robot with a localization ability, particularly for navigating in an indoor environment in which the robot’s localization and navigation cannot only rely on the Ground Positioning System (GPS) [16].”
BackgroundGao, H., Zhang, X., Yuan, J., Song, J., & Fang, Y. (2019) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2018.2890455 · Cited by 28
“SUES is different from the classical BoW, which is dependent of the quality of vocabulary obtained from offline training [17], [18].”
BackgroundVision-based UAVs Aerial Image Localization: A Survey
Xu, Y., Pan, L., Du, C., Li, J., Jing, N., & Wu, J. (2018) · ACM SIGSPATIAL International Workshop on AI for Geographic Knowledge Discovery (GeoAI) · doi:10.1145/3281548.3281556 · Cited by 38
“Lowry and Davison [14, 45] also mentioned that local features can be used in conjunction with metric information to support metric modifications for localization.”
BackgroundCheng, R., Wang, K., Lin, S., Hu, W., Yang, K., Huang, X. M., Li, H., Sun, D., & Bai, J. Y. (2019) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2019.8917508 · Cited by 28
“The proliferation of computer vision has spurred the researchers to propose a great deal of vision-based localization solutions [1], [2], [6]–[10].”
BackgroundRelocalization With Submaps: Multi-Session Mapping for Planetary Rovers Equipped With Stereo Cameras
Giubilato, R., Vayugundla, M., Schuster, M. J., Stürzl, W., Wedler, A., Triebel, R., & Debei, S. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2964157 · Cited by 31
“Traditional approaches for re-localization using cameras involve matching sparse visual features with a database [10], mostly by means of aggregation techniques such as FABMAP2 [11], BoW or VLAD [12].”
MethodDo, H., Hong, S., & Kim, J. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.3010731 · Cited by 32
“[1] and [2] provide thorough surveys of work related to appearance-based place recognition, many of which try to handle this problem of perceptual aliasing.”
BackgroundTracking‐DOSeqSLAM: A dynamic sequence‐based visual place recognition paradigm
Tsintotas, K. A., Bampis, L., Gasteratos, A. C., & FIET (2021) · IET Computer Vision · doi:10.1049/cvi2.12041 · Cited by 29
“Visual place recognition, the ability to identify a known location in the environment using vision as the main sensory input, is achieved using cameras that provide low‐ cost means for the generation of extremely rich and dense data [16].”
BackgroundLu, S., Xu, X., Yin, H., Chen, Z., Xiong, R., & Wang, Y. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981308 · Cited by 44
“To address the problem, a great number of works take the strategy originated from visual localization [3, 4, 5] by dividing the problem into two phases: place recognition first and then pose estimation [6, 7, 8, 9].”
BackgroundLSVL: Large-scale season-invariant visual localization for UAVs
Kinnari, J., Renzulli, R., Verdoja, F., & Kyrki, V. (2023) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2023.104497 · Cited by 36
“Compared to [21], we show signifi-cantly faster convergence, tolerance to seasonal variation and we demonstrate performance with real experiments.”
BackgroundIntegration of vision and topological self-localization for intelligent vehicles
Li, Y., Hu, Z., Hu, Y., & Chu, D. (2018) · Mechatronics · doi:10.1016/j.mechatronics.2018.02.012 · Cited by 27
Detecting the Expectancy of a Place Using Nearby Context for Appearance-Based Mapping
Kazmi, S. M. A. M., & Mertsching, B. (2019) · IEEE Transactions on Robotics · doi:10.1109/tro.2019.2926475 · Cited by 29
“The global description of a scene is robust to dynamic conditions as compared to the local description [13].”
BackgroundAutomatic Discovery of Political Meme Genres with Diverse Appearances
Theisen, W., Brogan, J., Thomas, P. B., Moreira, D., Phoa, P., Weninger, T., & Scheirer, W. J. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v15i1.18097 · Cited by 34
Predictive and adaptive maps for long-term visual navigation in changing environments
Halodová, L., Dvořáková, E., Majer, F., Vintr, T., Mozos, Ó. M., Dayoub, F., & Krajník, T. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8967994 · Cited by 29
“long-term visual localisation in [27] and a general review of AI methods for long-term autonomy in [28].”
BackgroundZero-Shot Multi-View Indoor Localization via Graph Location Networks
Chiou, M.-J., Liu, Z., Yin, Y., Liu, A.-A., & Zimmermann, R. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413856 · Cited by 30
“Note that while our method is closely related to outdoor place recognition [3, 27, 43] and is possible to incorporate corresponding techniques (e.”
MethodSemSegMap – 3D Segment-based Semantic Localization
Cramariuc, A., Tschopp, F., Alatur, N., Benz, S., Falck, T., Brühlmeier, M., Hahn, B. P., Nieto, J. I., & Siegwart, R. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636156 · Cited by 40
“More precise visual keypoint-based place recognition methods are well studied [14] and of significant interest [15], but they present their own set of challenges with regards to scalability, viewpoint, and illumination changes.”
BackgroundSpiking Neural Networks for Visual Place Recognition Via Weighted Neuronal Assignments
Hussaini, S., Milford, M. J., & Fischer, T. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3149030 · Cited by 35
“…critical in enabling long-term mobile robot autonomy in challenging environments: it can aid in the global re-localization of mobile robots, minimize model errors by acting as a closed-loop detection algorithm, and can be used as a component of robust localization and mapping algorithms [14], [15].”
Self-citationActive Perception for Outdoor Localisation with an Omnidirectional Camera
Jayasuriya, M., Ranasinghe, R., & Dissanayake, G. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9340974 · Cited by 26
“Furthermore, these rely on “loop closure” which is essential to avoid the inevitable drift in the location estimate, which is challenging in outdoor urban settings due to dynamic objects and appearance changes [13] [14].”
BackgroundPlace Recognition: An Overview of Vision Perspective
Zeng, Z., Zhang, J., Wang, X., Chen, Y., & Zhu, C. (2018) · Applied Sciences · doi:10.3390/app8112257 · Cited by 30
“…last few decades, e.g., the principles of how animals recognize and remember places and relationship between places in a neuroscience perspective Lowry et al. (2016), a new way of describing places using convolutional neural networks, a number of datasets specifically for places are put forward.”
Backgroundi3dLoc: Image-to-range Cross-domain Localization Robust to Inconsistent Environmental Conditions
Yin, P., Xu, L., Zhang, J., Choset, H., & Scherer, S. (2021) · Robotics: Science and Systems · doi:10.15607/rss.2021.xvii.027 · Cited by 27
SVG-Loop: Semantic–Visual–Geometric Information-Based Loop Closure Detection
Yuan, Z., Xu, K., Zhou, X., Deng, B., & Ma, Y. (2021) · Remote Sensing · doi:10.3390/rs13173520 · Cited by 27
“One of the classic algorithms is FAB-MAP [8], which uses the Chow Liu tree structure to construct a bag of visual words.”
MethodA Survey on Monocular Re-Localization: From the Perspective of Scene Map Representation
Miao, J., Jiang, K., Wen, T., Wang, Y., Jia, P., Wijaya, B., Zhao, X., Qian, C., Xiao, Z., Huang, J. H., et al. (2024) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2024.3378716 · Cited by 54
“In this field, some proposals estimate ego pose by historical pose of retrieved geo-tagged frames as shown in Fig.”
Sequence-based sparse optimization methods for long-term loop closure detection in visual SLAM
Han, F., Wang, H., Huang, G. P., & Zhang, H. (2018) · Autonomous Robots · doi:10.1007/s10514-018-9736-3 · Cited by 26
“Loop closure detection is an integrated component of all visual SLAM techniques, which uses visual features to recognize revisited locations (Lowry et al. 2016).”
Voxel-Based Representation Learning for Place Recognition Based on 3D Point Clouds
Siva, S., Nahman, Z., & Zhang, H. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9340992 · Cited by 29
“It has been observed that, while performing long-term place recognition, global features outperform local features [7], [27], [28].”
BackgroundMethodLightweight Unsupervised Deep Loop ClosurePreprint
Merrill, N., & Huang, G. P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.07703 · Cited by 25
“paper in Section V. II. RELATED WORK Due to its importance, loop closure, or place recognition, has attracted significant attention in recent years. Many different algorithms have been introduced (see [1, 21] and references therein), with variant performance characteristics in terms of complexity, robustness and efficie…”
MethodInfluentialDeep Learning for Scene Classification: A SurveyPreprint
Zeng, D., Liao, M., Tavakolian, M., Guo, Y., Zhou, B., Hu, D., Pietikäinen, M., & Liu, L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.10531 · Cited by 59
“, remote sensing scene classification [62], [64], [65], acoustic scene classification [66], [67], place classification [68], [69], etc.”
BackgroundVisual Localization Using Sparse Semantic 3D Map
Shi, T., Shen, S., Gao, X., & Zhu, L. (2019) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2019.8802957 · Cited by 32
“2D image-based localization methods [10, 11, 12, 13] cast the localization problem as an image retrieval problem.”
MethodHierarchical visual localization for visually impaired people using multimodal images
Cheng, R., Hu, W., Chen, H., Fang, Y., Wang, K., Xu, Z., & Bai, J. Y. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113743 · Cited by 27
“Leveraging images to localize is known as visual localization or place recognition , which is to retrieve the corresponding image (or estimate the camera pose) of a given query image from a priori database (Lowry et al., 2016).”
BackgroundSparse Pose Graph Optimization in Cycle Space
Bai, F., Vidal‐Calleja, T., & Grisetti, G. (2021) · IEEE Transactions on Robotics · doi:10.1109/tro.2021.3050328 · Cited by 28
“An edge is created if there exists a relative geometric relation between two poses, i.e. relative poses , which can be produced by a wheel-encoder, scan-matching [21], [65], [66], epipolar geometry [67], [68], or visual loop-closing techniques etc. [69], [70].”
BackgroundSeqMatchNet: Contrastive Learning with Sequence Matching for Place Recognition & Relocalization
Garg, S., Vankadari, M. B., & Milford, M. J. (2021) · Conference on Robot Learning · Cited by 43
Self-citationHou, K., Kong, D., Jiang, J., Zhuang, H., Huang, X., & Fang, Z. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3268850 · Cited by 26
“V ISUAL place recognition (VPR) [1], [2], [3], [4] is a vital sub-problem in the autonomous navigation of mobile robots, which has attracted the attention of many researchers in recent years.”
BackgroundVisual Place Recognition for Autonomous Mobile Robots
Horst, M., & Möller, R. (2017) · Robotics · doi:10.3390/robotics6020009 · Cited by 25
“A recent survey on visual place recognition, focusing on feature- and signature-based methods, is available in [12].”
BackgroundMethodGriffith, S., Chahine, G., & Pradalier, C. (2017) · The International Journal of Robotics Research · doi:10.1177/0278364917730606 · Cited by 25
“Many different approaches have been proposed to improve condition invariance in different environments (see e.g. Lowry et al., 2016, for a review of methods for place recognition; see e.g. Roy and Isler, 2016, for a method designed for surveying apple orchards).”
MethodAccurate Smartphone Indoor Visual Positioning Based on a High-Precision 3D Photorealistic Map
Wu, T., Liu, J., Zheng, L., Liu, K., & xu, B. (2018) · Sensors · doi:10.3390/s18061974 · Cited by 23
“These methods usually contain two steps, namely, place recognition [14] and perspective-n-point(PnP) [15], which calculates the extrinsic parameters.”
MethodVIZARD: Reliable Visual Localization for Autonomous Vehicles in Urban Outdoor Environments
Bürki, M., Schaupp, L., Dymczyk, M., Dubé, R., Cadena, C., Siegwart, R., & Nieto, J. I. (2019) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2019.8814017 · Cited by 30
“have received most attention in recent years [1], [2].”
BackgroundPoint-Cloud-Based Place Recognition Using CNN Feature Extraction
Sun, T., Liu, M., Ye, H., & Yeung, D. (2019) · IEEE Sensors Journal · doi:10.1109/jsen.2019.2937740 · Cited by 25
“Not surprisingly, visual place recognition also turns to CNNs for feature extraction [7], [9], [25], [35], [36], [55].”
Spatio-Semantic ConvNet-Based Visual Place Recognition
Camara, L. G., & Přeučil, L. (2019) · European Conference on Mobile Robots · doi:10.1109/ecmr.2019.8870948 · Cited by 23
“In the field of mobile robotics and particularly in applications requiring long-term navigation and localization [1, 2], the problem of Visual Place Recognition (VPR) is a fundamental one and still an open computer vision research topic [3, 4, 5, 6].”
BackgroundUnified Representation Learning for Cross Model Compatibility
Wang, C.-Y., Chang, Y.-L., Yang, S.-T., Chen, D., & Lai, S. (2020) · British Machine Vision Conference (BMVC) · doi:10.5244/c.34.55 · Cited by 39
Cross-View Matching for Vehicle Localization by Learning Geographically Local Representations
Xia, Z., Booij, O., Manfredi, M., & Kooij, J. F. P. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3088076 · Cited by 36
“In visual localization, a majority of works target ground-level image matching [19], the scalability of those methods is limited by the sparse coverage of geo-tagged ground-level images.”
BackgroundHe, G., Zhang, Q., & Zhuang, Y. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3191648 · Cited by 27
BioSLAM: A Bioinspired Lifelong Memory System for General Place Recognition
Yin, P., Abuduweili, A., Zhao, S., Xu, L., Liu, C., & Scherer, S. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2023.3306615 · Cited by 38
“The navigation task usually contains the PR or loop closure detection (LCD) module as stated in [16], [17], [18], which mainly serves as the data association for large-scale relocalization and map optimization in SLAM tasks.”
BackgroundMethodZou, X., Li, J., Wang, Y., Liang, F., Wu, W., Wang, H., Yang, B., & Dong, Z. (2023) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2023.11.005 · Cited by 25
RGB2LIDAR: Towards Solving Large-Scale Cross-Modal Visual Localization
Mithun, N. C., Sikka, K., Chiu, H.-P., Samarasekera, S., & Kumar, R. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413647 · Cited by 28
“We refer our readers to [57], [47] and [24] for a comprehensive reviews on state-of-the-art approaches on vision-based localization.”
BackgroundRelative navigation of autonomous GPS-degraded micro air vehicles
Wheeler, D. O., Koch, D. P., Jackson, J. S., Ellingson, G. J., Nyholm, P. W., McLain, T. W., & Beard, R. W. (2020) · Autonomous Robots · doi:10.1007/s10514-019-09899-4 · Cited by 25
SeqSLAM with Bag of Visual Words for Appearance Based Loop Closure Detection
Tsintotas, K. A., Bampis, L., Rallis, S., & Gasteratos, A. C. (2018) · Mechanisms and machine science · doi:10.1007/978-3-030-00232-9_61 · Cited by 23
DOSeqSLAM: Dynamic On-line Sequence Based Loop Closure Detection Algorithm for SLAM
Tsintotas, K. A., Bampis, L., & Gasteratos, A. C. (2018) · IEEE International Conference on Imaging Systems and Techniques (IST) · doi:10.1109/ist.2018.8577113 · Cited by 22
“The richness of the acquired information guided the researchers in robotics community to produce appearance-based systems and specifically, methods which rely their functionality solely on the incoming visual information [5].”
TB-Places: A Data Set for Visual Place Recognition in Garden Environments
Leyva-Vallina, M., Strisciuglio, N., López-Antequera, M., Tyleček, R., Blaich, M., & Petkov, N. (2019) · IEEE Access · doi:10.1109/access.2019.2910150 · Cited by 26
“Visual place recognition consists of recognizing a previously seen place by evaluating visual cues only from images acquired by a camera system [1], [2].”
BackgroundMethodPiasco, N., Sidibé, D., Gouet-Brunet, V., & Demonceaux, C. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-020-01363-6 · Cited by 32
Confidant: A Privacy Controller for Social Robots
Tang, B., Sullivan, D., Çağıltay, B., Chandrasekaran, V., Fawaz, K., & Mutlu, B. (2022) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri53351.2022.9889540 · Cited by 38
“, in a home [75] or non-domestic environments such as offices, medical facilities, and restaurants [76]).”
BackgroundEfficient 3D LIDAR based loop closing using deep neural network
Yin, H., Ding, X., Tang, L., Wang, Y., & Xiong, R. (2017) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio.2017.8324463 · Cited by 22
“In recent years, convolution neural networks are used as robust feature extractors for visual place recognition [10].”
BackgroundLearning to Fuse Multiscale Features for Visual Place Recognition
Mao, J., Hu, X., He, X., Zhang, L., Wu, L., & Milford, M. J. (2018) · IEEE Access · doi:10.1109/access.2018.2889030 · Cited by 20
“It is an active research topic in both robotics [1] and computer vision [2]–[4], associated with various applications such as autonomous vehicles [5], [6] and image retrieval [7].”
BackgroundSelf-citationAre State-of-the-art Visual Place Recognition Techniques any Good for Aerial Robotics?
Zaffar, M., Khaliq, A., Ehsan, S., Milford, M. J., Alexis, K., & McDonald-Maier, K. D. (2019) · Open Access at Essex (University of Essex) · doi:10.48550/arxiv.1904.07967 · Cited by 31
“thus termed and surveyed as Visual Place Recognition in [1].”
BackgroundSelf-citationAlijani, F., & Rahtu, E. (2020) · IEEE International Workshop on Multimedia Signal Processing (MMSP) · doi:10.1109/mmsp48831.2020.9287063 · Cited by 21
“Visual Place Recognition (VPR) is a subcategory of CBIR to identify images which belong to same locations in robotics and autonomous systems [3].”
BackgroundEv-ReconNet: Visual Place Recognition Using Event Camera With Spiking Neural Networks
Lee, H., & Hwang, H. (2023) · IEEE Sensors Journal · doi:10.1109/jsen.2023.3298828 · Cited by 23
Are you ABLE to perform a life-long visual topological localization?
Arroyo, R., Alcantarilla, P. F., Bergasa, L. M., & Romera, E. (2017) · Autonomous Robots · doi:10.1007/s10514-017-9664-7 · Cited by 23
“Furthermore, a great number of novel approaches have been presented following the research line started by FAB-MAP, as studied in surveys such as Garcia-Fidalgo and Ortiz (2015) or Lowry et al. (2016).”
MethodReal-Time Visual Place Recognition Based on Analyzing Distribution of Multi-scale CNN Landmarks
Xin, Z., Cui, X., Zhang, J., Yang, Y., & Wang, Y. (2018) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-018-0804-x · Cited by 20
“Visual place recognition is the task of identifying locations which are previously visited [1].”
BackgroundSeqSLAM++: View-based robot localization and navigation
Oishi, S., Inoue, Y., Miura, J., & Tanaka, S. (2018) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2018.10.014 · Cited by 25
“Such an image-to-image matching also appears in the context of loop closure detection for SLAM [23, 24] or in visual place recogni-65 tion [25].”
Garg, S., & Milford, M. J. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9196827 · Cited by 22
“The topic has been extensively researched for decades [1] with researchers exploring different aspects of the problem, such as dealing with appearance [2], [3] and viewpoint variations [4], [5], and large-scale localization [6], [7], [8] and navigation [9].”
BackgroundSelf-citationAppearance-Based Loop Closure Detection via Locality-Driven Accurate Motion Field Learning
Zhang, K., Jiang, X., & Ma, J. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3086822 · Cited by 22
ECFRNet: Effective corner feature representations network for image corner detection
Jing, J., Liu, C., Zhang, W., Gao, Y., & Sun, C. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118673 · Cited by 38
Meier, K. C., Chung, S., & Hutchinson, S. (2017) · Journal of Field Robotics · doi:10.1002/rob.21759 · Cited by 24
Compressed Holistic ConvNet Representations for Detecting Loop Closures in Dynamic Environments
Wang, S., Lv, X., Liu, X., & Ye, D. (2020) · IEEE Access · doi:10.1109/access.2020.2982228 · Cited by 22
“Loop closure detection is a recognition problem which can also be regarded as an image retrieval task or visual place The associate editor coordinating the review of this manuscript and approving it for publication was Yongqiang Zhao . recognition [2].”
BackgroundContrastive Learning for Image Registration in Visual Teach and Repeat Navigation
Rozsypálek, Z., Broughton, G., Linder, P., Rouček, T., Blaha, J., Mentzl, L., Kusumam, K., & Krajník, T. (2022) · Sensors · doi:10.3390/s22082975 · Cited by 22
How Many Events Do You Need? Event-Based Visual Place Recognition Using Sparse But Varying Pixels
Fischer, T., & Milford, M. J. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3216226 · Cited by 33
“Challenges for VPR include changes in the appearance of the scene due to the time of day, season, and weather; structural changes due to occlusions and new constructions; and viewpoint changes [3].”
BackgroundSelf-citationViT-based Terrain Recognition System for wearable soft exosuit
Yang, F., Chen, C., Wang, Z., Chen, H., Liu, Y. Z., Li, G., & Wu, X. (2023) · Biomimetic Intelligence and Robotics · doi:10.1016/j.birob.2023.100087 · Cited by 20
IVPR: An Instant Visual Place Recognition Approach Based on Structural Lines in Manhattan World
Pei, L., Liu, K., Zou, D., Li, T., Wu, Q., Zhu, Y., Li, Y., He, Z., Chen, Y., & Sartori, D. (2019) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2019.2941359 · Cited by 23
“Lowry et al. [15] described a place as a precise position with zero dimension or as a larger area where a region represents a 2-”
BackgroundRobot perceptual adaptation to environment changes for long-term human teammate following
Siva, S., & Zhang, H. (2020) · The International Journal of Robotics Research · doi:10.1177/0278364919896625 · Cited by 21
“…place recognition focus on creating representations that encode the holistic layout of the environment based upon global feature extraction (Lowry et al., 2016), deep learning (Arroyo et al., 2016; Sunderhauf et al., 2015), multimodal feature integration (Han et al., 2016), and…”
BackgroundScalable Place Recognition Under Appearance Change for Autonomous DrivingPreprint
Doan, A.-D., Latif, Y., Chin, T.-J., Liu, Y., Do, T.-T., & Reid, I. D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.00178 · Cited by 20
“Place recognition (PR) is the broad problem of recognizing “places” based on visual inputs [26, 6].”
BackgroundData-Efficient Large Scale Place Recognition With Graded Similarity SupervisionPreprint
Leyva-Vallina, M., Strisciuglio, N., & Petkov, N. (2021) · arXiv (Cornell University) · doi:10.34894/w4ligp · Cited by 44
Multimodal representation learning for place recognition using deep Hebbian predictive coding
Pearson, M. J., Dora, S., Struckmeier, O., Knowles, T. C., Mitchinson, B., Tiwari, K., Kyrki, V., Bohte, S., & Pennartz, C. M. A. (2021) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.732023 · Cited by 19
“Place recognition is the ability to interpret and recall sensory views of the world to inform an estimate of location or pose, with visual place recognition being its most common and well-studied form Lowry et al. (2016).”
BackgroundSequence-based mapping for probabilistic visual loop-closure detection
Tsintotas, K. A., Bampis, L., An, S., Fragulis, G. F., Mouroutsos, S. G., & Gasteratos, A. C. (2021) · IEEE International Conference on Imaging Systems and Techniques (IST) · doi:10.1109/ist50367.2021.9651458 · Cited by 19
Eskandari, M., & Savkin, A. V. (2023) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2023.3298607 · Cited by 19
“…by the conventional extended Kalman filter (EKF-SLAM) [16], particle filter (Fast-SLAM) [17], and graph-based SLAM [18], the place recognition techniques [19] have gained attention and vision SLAM [20] (utilizing visual odometry) have been considered for autonomous driving/navigation of vehicles.”
MethodI2P-Rec: Recognizing Images on Large-Scale Point Cloud Maps Through Bird's Eye View Projections
Zheng, S., Li, Y., Yu, Z., Yu, B., Cao, S., Wang, M., Xu, J., Ai, R., Gu, W., Lun, L., et al. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10341907 · Cited by 21
“Benefiting from the local image features [18], [19] and the bag-of-words techniques [20], a number of image-based place recognition methods [10], [21], [22], [23], [24] have been developed.”
BackgroundDeep Homography Estimation for Visual Place Recognition
Lu, F., Dong, S., Zhang, L., Liu, B., Lan, X., Jiang, D., & Yuan, C. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i9.28901 · Cited by 20
“2) Images captured at different places can be similar, which may lead to perceptual aliasing (Lowry et al. 2016).”
BackgroundApplications of Spiking Neural Networks in Visual Place Recognition
Hussaini, S., Milford, M. J., & Fischer, T. (2024) · IEEE Transactions on Robotics · doi:10.1109/tro.2024.3508053 · Cited by 29
“Ourcontributionshighlighttheviabilityof SNNsforVPR,offeringscalableandrobustsolutions,andpavingthewayfortheirapplicationinvariousenergy-sensitiverobotic tasks.”
Self-citationOmnidirectional Multisensory Perception Fusion for Long-Term Place Recognition
Siva, S., & Zhang, H. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8461042 · Cited by 20
“When environments show changes in illumination conditions, global features outperform local features [1], [3], [9].”
BackgroundSubspace-based multi-view fusion for instance-level image retrieval
Li, J., Yang, B., Yang, W., Sun, C., & Xu, J. (2020) · The Visual Computer · doi:10.1007/s00371-020-01828-2 · Cited by 21
“This problem is also tightly associated with a variety of vision applications, such as place recognition [10,18,44], loop closure detection [41,72,77] and invariant scene description [62].”
BackgroundTomită, M.-A., Zaffar, M., Milford, M. J., McDonald-Maier, K. D., & Ehsan, S. (2021) · IEEE Access · doi:10.1109/access.2021.3107778 · Cited by 21
“descriptors cannot handle viewpoint variation [2].”
BackgroundInfluentialSelf-citationArcanjo, B., Ferrarini, B., Milford, M. J., McDonald-Maier, K. D., & Ehsan, S. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3140827 · Cited by 32
Self-citationVisual place recognition for aerial imagery: A survey
Moskalenko, I., Kornilova, A., & Ferrer, G. (2024) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2024.104837 · Cited by 24
“Visual geolocalization can be implemented through various methods, typically relying on a pre-built database of images with known locations (39).”
MethodTransfer Learning for Humanoid Robot Appearance-Based Localization in a Visual Map
Ovalle-Magallanes, E., Aldana-Murillo, N. G., Avina‐Cervantes, J. G., Ruiz-Pinales, J., Cepeda–Negrete, J., & Ledesma, S. (2021) · IEEE Access · doi:10.1109/access.2020.3048936 · Cited by 17
“An autonomous robot localization using only visual information, also known as an appearance-based localization system, is difficult to implement because of many factors such as illumination, perspective, and type of sensors [7].”
Background
Metadata
- Authors
- Lowry, S., Sünderhauf, N., Newman, P., Leonard, J. J., Cox, D., Corke, P., & Milford, M. J.
- Affiliations
- Queensland University of Technology (AU)
- University of Oxford (GB)
- MIT Computer Science and Artificial Intelligence Laboratory (US)
- Harvard University (US)
- ORCID
- Venue
- IEEE Transactions on Robotics
- Published
- 2016-02
- Volume
- 32
- Issue
- 1
- Pages
- 1-19
- ISSN
- 1552-3098 (ISSN-L)
- 1941-0468
- OpenAlex
- W2284029970
- Cited by
- 1,079
- References
- 239
- Citations by year
- 2026: 47 · 2025: 63 · 2024: 111 · 2023: 112 · 2022: 109 · 2021: 148 · 2020: 156 · 2019: 132 · 2018: 100 · 2017: 72 · 2016: 29
- FWCI
- 97.28
- Type
- journal article
- Language
- en
- Open access
- green
- purl.org
- Licence
- Locations
- IEEE Transactions on Robotics (publishedVersion)
- QUT ePrints (Queensland University of Technology) (submittedVersion)
- Funders
- ARC Future Fellowship (FT140101229)
- Australian Centre for Robotic Vision
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Spatial Cognition and Navigation
- Keywords
- visual place recognition, place recognition, appearance changes, animal navigation, semantic scene understanding, audio description, deep learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.