Visual Place Recognition: A Survey
Open accessThe DOI matches its Crossref record; 233 of the 239 references it cites were found in a registry or an index.
Abstract
Visual place recognition is a challenging problem due to the vast range of ways in which the appearance of real-world places can vary. In recent years, improvements in visual sensing capabilities, an ever-increasing focus on long-term mobile robot autonomy, and the ability to draw on state-of-the-art research in other disciplines-particularly recognition in computer vision and animal navigation in neuroscience-have all contributed to significant advances in visual place recognition systems. This paper presents a survey of the visual place recognition research landscape. We start by introducing the concepts behind place recognition-the role of place recognition in the animal kingdom, how a “place” is defined in a robotics context, and the major components of a place recognition system. Long-term robot operations have revealed that changing appearance can be a significant factor in visual place recognition failure; therefore, we discuss how place recognition solutions can implicitly or explicitly account for appearance change within the environment. Finally, we close with a discussion on the future of visual place recognition, in particular with respect to the rapid advances being made in the related fields of deep learning, semantic scene understanding, and video description.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 1×
“with a mid-level convolutional neural network (CNN) feature [124] to identify and extract landmarks as illustrated in Fig.”
BackgroundHistograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584 · cited 3×
“McManus et al. [120] used the global descriptor HOG [121] on image patches to learn condition invariant scene signatures, while Sünderhauf et al. [122] used the Edge Boxes object proposal method [123] combined with a mid-level convolutional neural network (CNN) feature [124] to identify and extract landmarks as illust…”
Method(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
A Computational Approach to Edge Detection
Canny, J. (1986) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1986.4767851 · Cited by 30,004 · cited 1×
“Lamon et al. [105] used a variety of image features—such as edges [106], corners [107], and color patches—combined into a fingerprint of a location.”
BackgroundObject recognition from local scale-invariant features
Lowe, D. G. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790410 · Cited by 16,472 · cited 11×
“The U-SIFT [72] descriptor was shown to display the greatest lighting invariance of the tested descriptors.”
MethodInfluentialSURF: Speeded Up Robust Features
Bay, H., Tuytelaars, T., & Van Gool, L. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_32 · Cited by 14,955
A Combined Corner and Edge Detector
Harris, C., & Stephens, M. (1988) · Procedings of the Alvey Vision Conference 1988 · doi:10.5244/c.2.23 · Cited by 12,901 · cited 1×
“Lamon et al. [105] used a variety of image features—such as edges [106], corners [107], and color patches—combined into a fingerprint of a location.”
BackgroundBlei, D. M., Ng, A. Y., & Jordan, M. I. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0082 · Cited by 12,223
Baeza-Yates, R. A., & Ribeiro-Neto, B. A. (1999) · Cited by 11,505
ORB: An efficient alternative to SIFT or SURF
Rublee, E., Rabaud, V., Konolige, K., & Bradski, G. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126544 · Cited by 11,037 · cited 1×
“SIFT features as in [76], CenSurE features as in FrameSLAM [2], or ORB features [137] as in ORB-SLAM [136].”
Method
Research works printed but not linked: 6
- neira, 0, Mobile robot localization and map building using monocular vision, Proc 5th Symp Intell Robot Syst, 275
- lynch, 1960, The Image of the City
- 10.1177/0278364914551008 · DOI
- 10.1177/027836402761412467 · doi:10.1177/027836402761412467 · Paper page
- 10.21236/ADA576491 · doi:10.21236/ada576491 · Paper page
- sim, 2005, Vision-based SLAM using the Rao-Blackwellised particle filter, Proc IJCAI Workshop Reason Uncertainty Robot
Cited by
Items 301–400 of 1,000
Toward Holistic Scene Understanding: A Transfer of Human Scene Perception to Mobile Robots
Graf, F., Lindermayr, J., Odabaşı, Ç., & Huber, M. F. (2022) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2022.3210587 · Cited by 20
“Examples are extracting the semantic by (re)-detection of objects [41], [42], humans [43], [44], and places [45]; 3D reconstruction of the scene by Simultaneous Localization and Mapping (SLAM) [32], [46], [47]; or enriching metric information by semantics, known as semantic segmentation [33], [48], [49].”
BackgroundPark, J.-M., Kim, U.-H., Lee, S., & Kim, J.-H. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01338 · Cited by 32
“The SCD task in general requires visual place recognition (VPR) [39] to pair the current scene (query) with the scenes (reference) stored in a database system.”
BackgroundA Review of Common Techniques for Visual Simultaneous Localization and Mapping
Dai, Y., Wu, J., & Wang, D. (2023) · Journal of Robotics · doi:10.1155/2023/8872822 · Cited by 25
Graph-Based Robust Localization of Object-Level Map for Mobile Robotic Navigation
Zhao, L., Deng, X., Li, R., Gui, X., Sun, J., Li, T., & Zhang, B. (2023) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2023.3245208 · Cited by 20
“But when it comes to the environmental changes like season changes, daytime changes, or large viewpoint changes, these approaches tend to fail [12].”
BackgroundMeng, C., Duan, Y., He, C., Wang, D., Fan, X., & Zhang, Y. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3377562 · Cited by 23
“CameraandLiDARarecurrentlythedominantsensorsfor placerecognition[4].”
Multi-modal and inertial sensor solutions for navigation-type factor graphs
Fourie, D. (2017) · Woods Hole Open Access Server (WHOAS) · doi:10.1575/1912/9305 · Cited by 18
Bampis, L., & Gasteratos, A. C. (2019) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2019.01.004 · Cited by 18
A Novel Loop Closure Detection Method Using Line Features
Dong, R., Wei, Z., Liu, C., & Kan, J. (2019) · IEEE Access · doi:10.1109/access.2019.2934521 · Cited by 18
“Readers can investigate extended survey through the work of [28].”
BackgroundScene Understanding: A Survey to See the World at a Single Glance
Pawar, P. G., & Devendran, V. (2019) · International Conference on Intelligent Communication and Computational Techniques (ICCT) · doi:10.1109/icct46177.2019.8969051 · Cited by 22
“Therefore, we can say that recognition pattern is advanced [5].”
BackgroundGaussian Process Gradient Maps for Loop-Closure Detection in Unstructured Planetary Environments
Gentil, C. L., Vayugundla, M., Giubilato, R., Stürzl, W., Vidal‐Calleja, T., & Triebel, R. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341667 · Cited by 19
“appearance-based 2D local feature detectors and descriptors has enabled many reliable and large-scale place recognition systems using vision [1].”
BackgroundA Point Cloud Registration Pipeline using Gaussian Process Regression for Bathymetric SLAM
Hitchcox, T., & Forbes, J. R. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9340944 · Cited by 18
“from the visual place recognition literature [3].”
Generalized Maximum Correntropy Kalman Filter for Target Tracking in TianGong-2 Space Laboratory
Mo, Y., Wang, Y., Hong, Y., Chen, B., Li, H., & Jiang, Z. (2022) · Space Science & Technology · doi:10.34133/2022/9796015 · Cited by 18
“During space station missions, robots need to perform precise operations on tools or task objects, which relies on accurate tracking of the target [8, 9].”
BackgroundA biological-inspired episodic cognitive map building framework for mobile robot navigation
Liu, D., Cong, M., Zou, Q., & Du, Y. (2017) · International Journal of Advanced Robotic Systems · doi:10.1177/1729881417705922 · Cited by 17
A two-level framework for place recognition with 3D LiDAR based on spatial relation graph
Gong, Y., Sun, F., Yuan, J., Zhu, W., & Sun, Q. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.108171 · Cited by 17
3-D LiDAR-Based Place Recognition Techniques: A Review of the Past Ten Years
Du, Z., Ji, S., & Khoshelham, K. (2024) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2024.3403194 · Cited by 28
Toward Robust Visual Place Recognition for Mobile Robots With an End-to-End Dark-Enhanced Net
Li, Z., Shang, T., Xu, P., Deng, Z., & Zhang, R. (2024) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2024.3476574 · Cited by 22
“Generally, the VPR approaches can be categorized as convolutional neural network (CNN)-based approaches [8] and ViT-based approaches [9].”
Camera Relocalization with Ellipsoidal Abstraction of Objects
Gaudillière, V., Simon, G., & Berger, M. (2019) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar.2019.00017 · Cited by 20
“Moreover, it oper ates at the level of objects, which are inherently more discriminative than local features in scene understanding and localization tasks, and are also more robust to viewpoint or illumination changes [20].”
Online Visual Place Recognition via Saliency Re-identification
Wang, H., Wang, C., & Xie, L. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341703 · Cited by 18
“Visual place recognition, also known as loop closure detection, is the task to identify repetitive places or landmarks [1], [2] during autonomous navigation.”
BackgroundFast and Memory Efficient Graph Optimization via ICM for Visual Place Recognition
Schubert, S., Neubert, P., & Protzel, P. (2021) · Robotics: Science and Systems · doi:10.15607/rss.2021.xvii.091 · Cited by 16
“An overview of existing methods is given in a survey from 2016 [19].”
MethodEfficient Localisation Using Images and OpenStreetMaps
Zhou, M., Chen, X., Samano, N., Stachniss, C., & Calway, A. D. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9635972 · Cited by 33
“That using vision falls broadly into two categories: indirect methods, which match online images with georeferenced images [9], with resolution dependent of image density; and direct methods, typically based on dense 3-D models, as in [10], [11], [12], for example, which provide accurate full metric pose estimates.”
MethodHou, Y., Zhang, H., Zhou, S., & Zou, H. (2017) · IEEE Access · doi:10.1109/access.2017.2698524 · Cited by 18
“Therefore, it has become a popular direction of VPR research [17] although there is plenty of space for improvement.”
BackgroundMethodInfluentialFast Approximate Geodesics for Deep Generative Models
Chen, N., Ferroni, F., Klushyn, A., Paraschos, A., Bayer, J., & van der Smagt, P. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-30484-3_45 · Cited by 18
LCD – Line Clustering and Description for Place Recognition
Taubner, F., Tschopp, F., Novković, T., Siegwart, R., & Furrer, F. (2020) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv50981.2020.00101 · Cited by 21
“Visual descriptors can be categorized as global descriptors, which describe the whole image, and local descriptors, describing local patches in the image [30].”
BackgroundInfluentialIterative learning of human partner’s desired trajectory for proactive human–robot collaboration
Xia, J., Huang, D., Li, Y., & Qin, N. (2020) · International Journal of Intelligent Robotics and Applications · doi:10.1007/s41315-020-00132-5 · Cited by 16
Yang, B., Xu, X., Ren, J., Cheng, L., Guo, L., & Zhang, Z. (2021) · Pattern Recognition Letters · doi:10.1016/j.patrec.2021.11.028 · Cited by 16
A survey of computational methods for iconic image analysis
van Noord, N. (2022) · Digital Scholarship in the Humanities · doi:10.1093/llc/fqac003 · Cited by 29
How Do You Do It? Fine-Grained Action Understanding with Pseudo-Adverbs
Doughty, H., & Snoek, C. G. M. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01346 · Cited by 24
“Previous works can address the question of what is happening in a video [80], when an action is happening [68], who is performing an action [73] and where it is taking place [44].”
High Accuracy and Low Complexity Lidar Place Recognition Using Unitary Invariant Frobenius Norm
Wang, W., Min, H., Wu, X., Hou, X., Li, Y., & Zhao, X. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3221979 · Cited by 16
“Although drifts are inevitable in the entire SLAM processing and usually militate against the estimated state accompanied by trajectory [5], the impact of drifts can be effectively eliminated by visiting the same place multiple times [6] and thereby creating a consistent map.”
BackgroundAttention-Enhanced Cross-Modal Localization Between Spherical Images and Point Clouds
Zhao, Z., Yu, H., Lyu, C., Yang, W. T., & Scherer, S. (2023) · IEEE Sensors Journal · doi:10.1109/jsen.2023.3306377 · Cited by 21
“on image-to-image retrieval [4] is sensitive to illumination and”
BackgroundNie, J., Feng, J.-M., Xue, D., Pan, F., Liu, W., da Hu, J., & Cheng, S. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3320489 · Cited by 21
“In [38] and [42], a set of metrics are presented to evaluate the performance of VPR technologies.”
BackgroundMethodPlaceFormer: Transformer-Based Visual Place Recognition Using Multi-Scale Patch Selection and Fusion
Kannan, S. S., & Min, B. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3408075 · Cited by 23
“Global descriptors [2], [3] provide a concise representation of the image in a single vector, facilitating efficient large-scale searches.”
BackgroundDataset and Benchmark: Novel Sensors for Autonomous Vehicle Perception
Carmichael, S., Buchan, A. D., Ramanagopal, M. S., Ravi, R., Vasudevan, R., & Skinner, K. A. (2024) · The International Journal of Robotics Research · doi:10.1177/02783649241273554 · Cited by 29
“We evaluate the opposing viewpoint focused method LoST-X Garg et al. (2018) and the seminal method NetVLAD Arandjelovic et al. (2016).”
DTG : Diffusion-based Trajectory Generation for Mapless Global Navigation
Liang, J., Payandeh, A., Song, D., Xiao, X., & Manocha, D. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10802055 · Cited by 38
“Global planning requires a comprehensive cost map for path planning [40], [41] and accurate robot localization [42], [43] to follow the paths.”
Vision-based Markov localization for long-term autonomy
Naseer, T., Suger, B., Ruhnke, M., & Burgard, W. (2016) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2016.11.008 · Cited by 16
Viewpoint invariant semantic object and scene categorization with RGB-D sensors
Zaki, H. F. M., Faisal Shafait, B., & Mian, A. S. (2018) · Autonomous Robots · doi:10.1007/s10514-018-9776-8 · Cited by 16
Stabilize an Unsupervised Feature Learning for LiDAR-based Place Recognition
Yin, P., Xu, L., Liu, Z., Li, L., Salman, H., He, Y., Xu, W., Wang, H., & Choset, H. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593562 · Cited by 17
A Brief Review on Loop Closure Detection with 3D Point Cloud
Wang, Z., Shen, Y., Cai, B., & Saleem, M. T. (2019) · IEEE International Conference on Real-time Computing and Robotics (RCAR) · doi:10.1109/rcar47638.2019.9044021 · Cited by 16
Change detection using weighted features for image-based localization
Derner, E., Gómez, C., Hernandez, A. C., Barber, R., & Babuška, R. (2020) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2020.103676 · Cited by 17
“Change detection and localization in dynamic environments has attracted the interest of many authors and various approaches have been proposed, as surveyed for example in [2] and [3].”
BackgroundLocal to Global: Efficient Visual Localization for a Monocular Camera
Lee, S. J., Kim, D.-H., Hwang, S. S., & Lee, D. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00228 · Cited by 20
“Furthermore, it uses the NetVLAD model for image representation, rather than the BoW model [21].”
MethodChen, L., Jin, S., & Xia, Z. (2021) · Sensors · doi:10.3390/s21010310 · Cited by 19
“Given a query image, the purpose of visual place recognition is to find the most similar images upon repeated traversals, which is also known as loop closure detection [1].”
BackgroundCrowdDriven: A New Challenging Dataset for Outdoor Visual Localization
Jafarzadeh, A., López-Antequera, M., Gargallo, P., Kuang, Y., Toft, C., Kahl, F., & Sattler, T. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00970 · Cited by 22
“For an overview over place recognition techniques, we refer the reader to [26,47].”
MethodDimensionality reduction through visual data resampling for low-storage loop-closure detection
Tsintotas, K. A., An, S., Papapetros, I. T., Konstantinidis, F. K., Sirakoulis, G. C., & Gasteratos, A. C. (2022) · IEEE International Conference on Imaging Systems and Techniques (IST) · doi:10.1109/ist55454.2022.9827748 · Cited by 16
Mobile Robot Localization: Where We Are and What Are the Challenges?
Skrzypczyński, P. (2017) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-54042-9_23 · Cited by 22
Manifold Regularization Graph Structure Auto-Encoder to Detect Loop Closure for Visual SLAM
Wang, Z., Peng, Z., Guan, Y., & Wu, L. (2019) · IEEE Access · doi:10.1109/access.2019.2914943 · Cited by 17
“First, the most specific mapping framework based on the mapping relationship between topological maps is topology metric or topological mapping [11].”
Kuse, M., & Shen, S. (2021) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2021.103813 · Cited by 17
What makes visual place recognition easy or hard?Preprint
Schubert, S., & Neubert, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.12671 · Cited by 26
“Visual place recognition is an important subproblem of mobile robot localization and subject of intense research, please refer to [1], [2] for surveys.”
BackgroundPlace recognition survey: An update on deep learning approachesPreprint
Barros, T., Pereira, R., Garrote, L., Premebida, C., & Nunes, U. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.10458 · Cited by 32
“Classical approaches rely on handcrafted descriptors such as SWIFT [15], SURF [16], Multiscale Super-pixel Grids [17], HOG [18] or bag-of-words [19], which are mainly build based on the knowledge of domain experts (see [3] for further understanding).”
BackgroundMethodInfluentialInstaIndoor and multi-modal deep learning for indoor scene recognition
Glavan, A. I., & Talavera, E. (2022) · Neural Computing and Applications · doi:10.1007/s00521-021-06781-2 · Cited by 17
“Scene classification represents a growing field of research in computer vision [8, 15, 39, 77].”
BackgroundAdaptive-Attentive Geolocalization From Few Queries: A Hybrid Approach
Paolicelli, V., Berton, G., Montagna, F., Masone, C., & Barbara Caputo, B. (2022) · Frontiers in Computer Science · doi:10.3389/fcomp.2022.841817 · Cited by 21
“Visual Place Recognition.”
Progress in symmetry preserving robot perception and control through geometry and learning
Ghaffari, M., Zhang, R., Zhu, M., Lin, C. E., Lin, T.-Y., Teng, S., Li, T., Liu, T., & Song, J. (2022) · Frontiers in Robotics and AI · doi:10.3389/frobt.2022.969380 · Cited by 31
Salient-VPR: Salient Weighted Global Descriptor for Visual Place Recognition
Wang, K., Luo, S., Chen, T., & Lǚ, J. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3219466 · Cited by 15
“This problem is often addressed as visual place recognition (VPR) and is an indispensable module for various applications, ranging from autonomous vehicles [3], [4] and geo-localization [5] to augmented and virtual reality [6].”
BackgroundFeng, Y., & Sun, Y. (2024) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2024.3361093 · Cited by 20
“Compared to traditional methods that consist of various modules [7], such as localization [8], [9], [10], [11], perception [12], [13], [14], Yuchao Feng is with the Department of Mechanical Engineering, The Hong Kong Polytechnic University, Kowloon, Hong Kong (e-mail: yuchao.feng@connect.polyu.hk).”
U-BEV: Height-aware Bird’s-Eye-View Segmentation and Neural Map-based Relocalization
Camiletto, A. B., Bochicchio, A., Liniger, A., Dai, D., & Gawel, A. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10802787 · Cited by 31
“Image-based relocalization and place recognition are among the fundamental challenges for autonomous agents and have been active research topics in the robotics community for over a decade [1], [2].”
Visual Localization across Seasons Using Sequence Matching Based on Multi-Feature Combination
Qiao, Y., Cappelle, C., & Ruichek, Y. (2017) · Sensors · doi:10.3390/s17112442 · Cited by 15
“Since visual sensors are widely used in the robotic community, visual localization based on place recognition plays a key role in visual Simultaneous Localization and Mappings (vSLAM) systems [1,2].”
BackgroundSLAM-based Underwater Adaptive Sampling Using Autonomous Vehicles
Rahmati, M., Karten, S., & Pompili, D. (2018) · MTS/IEEE OCEANS Conference (OCEANS) · doi:10.1109/oceans.2018.8604552 · Cited by 15
“revolutionized visual place recognition systems [15].”
Loop closure detection using CNN words
Liu, Q., & Duan, F. (2019) · Intelligent Service Robotics · doi:10.1007/s11370-019-00284-9 · Cited by 15
Loop Closure Detection Via Maximization of Mutual Information
ZHANG, G., Yan, X., & Ye, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2937967 · Cited by 15
“LITERATURE REVIEW Currently, the appearance-based method has been the golden standard in the field of place recognition and loop closure detection [17].”
MethodA Novel Approach to Image-Sequence-Based Mobile Robot Place Recognition
Yuan, J., Zhu, W., Dong, X., Sun, F., Zhang, X., Sun, Q., & Huang, Y. (2019) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2019.2956321 · Cited by 18
“Generally, place recognition algorithms based on the single-frame image are always to find the best matching from the place database for a new image [12].”
BackgroundBK tree indexing for active vision-based loop-closure detection in autonomous navigation
Tsintotas, K. A., Sevetlidis, V., Papapetros, I. T., Balaska, V. E., Psomoulis, A., & Gasteratos, A. C. (2022) · Mediterranean Conference on Control and Automation (MED) · doi:10.1109/med54222.2022.9837138 · Cited by 15
Designing Motion: Lessons for Self-driving and Robotic Motion from Human Traffic Interaction
Brown, B. A. T., Laurier, É., & Vinkhuyzen, E. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3567555 · Cited by 23
“It is important to note that while there has been impressive progress [44], significant challenges remain on basic tasks–such as using vision to locate a car [8].”
BackgroundMultidimensional Particle Filter for Long-Term Visual Teach and Repeat in Changing Environments
Rozsypálek, Z., Rouček, T., Vintr, T., & Krajník, T. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3244418 · Cited by 18
“Other authors pointed out that the aforementioned method decreases vision-based localization performance indoors and at night [31] and proposed more general concepts of condition-invariant place description [32].”
BackgroundReal-Time Visual Place Recognition for Personal Localization on a Mobile Device
Nowicki, M., Wietrzykowski, J., & Skrzypczyński, P. (2017) · Wireless Personal Communications · doi:10.1007/s11277-017-4502-y · Cited by 15
“Another possibility in visual localization is the appearance-based place recognition [20].”
BackgroundMethodEpisodic Memory Multimodal Learning for Robot Sensorimotor Map Building and Navigation
Chin, W. H., Toda, Y., Kubota, N., Loo, C. K., & Seera, M. (2018) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2018.2875309 · Cited by 15
“the spatial relationship between these landmarks in an environment [3], [4].”
BackgroundAdaptive Image Processing Methods for Outdoor Autonomous Vehicles
Halodová, L., Dvořáková, E., Majer, F., Ulrich, J., Vintr, T., Kusumam, K., & Krajník, T. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-14984-0_34 · Cited by 19
An Unsupervised Neural Network for Loop Detection in Underwater Visual SLAM
Burguera, A., & Font, F. B. (2020) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-020-01235-8 · Cited by 18
“Additionally, most existing NN used to perform place recognition are slow to perform feature extraction or querying [24].”
MethodGao, P., & Zhang, H. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9196906 · Cited by 16
“For long-term place recognition, it is essential to construct a robust representation for places with challenges caused by environment variances during long periods of time [17].”
BackgroundGaussian Belief Space Path Planning for Minimum Sensing Navigation
Pedram, A. R., Funada, R., & Tanaka, T. (2022) · IEEE Transactions on Robotics · doi:10.1109/tro.2022.3228128 · Cited by 21
“vision techniques [71] and a camera model [72].”
MethodReddy, S. S., Rao, V. V. R. M., Sravani, K., & Nrusimhadri, S. (2024) · Bulletin of Electrical Engineering and Informatics · doi:10.11591/eei.v13i2.5947 · Cited by 14
“[24] overview of works on visual location identification.”
BackgroundOn the Estimation of Image-Matching Uncertainty in Visual Place Recognition
Zaffar, M., Nan, L., & Kooij, J. F. P. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01680 · Cited by 29
“It has applications in vehicle localization [57], 3D modeling [1], image search [46], and loop-closure in Simultaneous Localization and Mapping (SLAM) [8, 28].”
BackgroundMethodInfluentialCheshfar, M., Maghami, M. H., Amiri, P., Garakani, H. G., & Lavagno, L. (2024) · IEEE Access · doi:10.1109/access.2024.3510677 · Cited by 21
Submap-Based Pose-Graph Visual SLAM: A Robust Visual Exploration and Localization System
Chen, W., Zhu, L., Guan, Y., Kube, C. R., & Zhang, H. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8594097 · Cited by 16
Homing Pigeon-Inspired Autonomous Navigation System for Unmanned Aerial Vehicles
Duan, H., Xin, L., & Shi, Y. (2021) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2021.3054060 · Cited by 14
A Robust Optical Flow Tracking Method Based On Prediction Model for Visual-Inertial Odometry
Zhu, S., Yang, S., Hu, P., & Qu, X. H. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3079806 · Cited by 16
“The results show that our method can reach a higher localization accuracy even without using loop closure [20].”
MethodDeep learning based decomposition for visual navigation in industrial platforms
Djenouri, Y., Hatleskog, J., Hjelmervik, J. M., Bjørne, E., Utstumo, T., & Mobarhan, M. H. (2021) · Applied Intelligence · doi:10.1007/s10489-021-02908-z · Cited by 14
“At the heart of the visual navigation problem is the place recognition task, which involves recognition and localization of a given query image [5, 31].”
Background3D Recognition Based on Sensor Modalities for Robotic Systems: A Survey
Manzoor, S., Joo, S.-H., Kim, E., Bae, S.-H., In, G.-G., Pyo, J.-W., & Kuc, T. (2021) · Sensors · doi:10.3390/s21217120 · Cited by 15
“Camera-based place recognition methods contain efficient descriptive information, but they struggle to cope with illumination and occlusion problems [142].”
BackgroundHierarchical Loop Closure Detection for Long-term Visual SLAM with Semantic-Geometric Descriptors
Singh, G., Wu, M., Lam, S.-K., & Minh, D. V. (2021) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc48978.2021.9564866 · Cited by 17
“Among the appearance methods, the BOW model is the most popular [11, 4] due to its efficiency in representing places in the form of compact visual words and tree-based indexing.”
BackgroundMethodInfluentialVisual Loop-Closure Detection via Prominent Feature Tracking
Papapetros, I. T., Balaska, V. E., & Gasteratos, A. C. (2022) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-022-01581-9 · Cited by 16
“While both local and global features are widely used in vPR to detect LCs, during severe condition variances of the environment and high view-point camera changes respectively, both methods exhibit limitations [25, 52].”
BackgroundZhang, Q., Xu, Z., Kang, Y., Hao, F., Ren, Z., & Cheng, J. S. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.111015 · Cited by 14
TSVR-Net: An End-to-End Ground-Penetrating Radar Images Registration and Location Network
Bi, B., Shen, L., Zhang, P., Huang, X., Xin, Q., & Jin, T. (2023) · Remote Sensing · doi:10.3390/rs15133428 · Cited by 18
Learning Sequence Descriptor Based on Spatio-Temporal Attention for Visual Place Recognition
Zhao, J., Feng-lin, Z., Cai, Y., Tian, G., Mu, W., Ye, C., & Feng, T. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3354627 · Cited by 20
“V ISUAL place recognition (VPR) aims to retrieve frames from a geotagged database that are located at the same place as the queried frame [1].”
BackgroundMethodSemantics-enhanced discriminative descriptor learning for LiDAR-based place recognition
Chen, Y., Zhuang, Y., Huai, J., Li, Q., Wang, B., El-Bendary, N., & Yılmaz, A. (2024) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2024.03.002 · Cited by 13
VLAD-BuFF: Burst-Aware Fast Feature Aggregation for Visual Place Recognition
Khaliq, A., Xu, M., Hausler, S., Milford, M. J., & Garg, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72784-9_25 · Cited by 13
“In this section, we provide a brief overview of learning-based VPR. Detailed literature review on the VPR task more generally is provided in [19, 37, 39, 54, 67, 76, 80].”
BackgroundSelf-citationClose, But Not There: Boosting Geographic Distance Sensitivity in Visual Place Recognition
Izquierdo, S., & Civera, J. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73464-9_15 · Cited by 14
Topological localization using Wi-Fi and vision merged into FABMAP framework
Nowakowski, M., Joly, C., Dalibard, S., Garcia, N., & Moutarde, F. (2017) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206171 · Cited by 13
“To achieve a longterm and robust global localization, some algorithms describe locations by their appearances [1].”
BackgroundPlace and Object Recognition by CNN-Based COSFIRE Filters
López-Antequera, M., Vallina, M. L., Strisciuglio, N., & Petkov, N. (2019) · IEEE Access · doi:10.1109/access.2019.2918267 · Cited by 14
“In visual place recognition one has to recognize a previously visited place based on visual cues only [14], [15].”
Detection-by-Localization: Maintenance-Free Change Object Detector
Kanji, T. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8793482 · Cited by 13
“, visual place recognition [1], loop-closure detection [2], map-matching [3]), we propose the reuse of selflocalization capability to address the latter requirement (i.”
BackgroundIntelligent Reference Curation for Visual Place Recognition Via Bayesian Selective Fusion
Molloy, T. L., Fischer, T., Milford, M. J., & Nair, G. N. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.3047791 · Cited by 16
“Research on VPR over several decades [1] has therefore explored techniques for robust image comparison including deep-learnt image descriptors [2]–[4], sequence”
BackgroundSelf-citationAn, S.-Y., & Kim, J.-Y. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3151154 · Cited by 14
“There are a method using an image itself through deep learning and a method using 2D/3D maps generated by several types of sensors [10].”
MethodAn Illumination-Invariant Shadow-Based Scene Matching Navigation Approach in Low-Altitude Flight
Wang, H., Cheng, Y., Liu, N., Zhao, Y., Chan, J. C.-W., & Li, Z. (2022) · Remote Sensing · doi:10.3390/rs14163869 · Cited by 16
Spatio-Temporal Graph Localization Networks for Image-based Navigation
Niwa, T., Taguchi, S., & Hirose, N. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981958 · Cited by 19
“metric map can represent a detailed environment, maintaining its accuracy is challenging due to estimation errors of the camera parameters and noise from the sensors and actuators [1]–[3].”
BackgroundBioinspired magnetoreception and navigation in nonorthogonal environments using magnetic signatures
Taylor, B. K., & Corbin, S. (2019) · Bioinspiration & Biomimetics · doi:10.1088/1748-3190/ab40f8 · Cited by 13
“simultaneous localization and mapping techniques (Cadena et al 2016, Lowry et al 2016)), which may allow the effects of a nonorthogonal environment to be calibrated out en-route. We will investigate this possibility in future studies. Our study provides interesting possibilities in terms of measurement frequency and a…”
BackgroundMethodInfluentialIndoor Topological Localization Based on a Novel Deep Learning Technique
Liu, Q., Li, R., Hu, H., & Gu, D. (2020) · Cognitive Computation · doi:10.1007/s12559-019-09693-5 · Cited by 13
A Bio-Inspired Goal-Directed Visual Navigation Model for Aerial Mobile Robots
Mao, J., Hu, X., Zhang, L., He, X., & Milford, M. J. (2020) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-020-01190-4 · Cited by 14
“Topological navigation has also been extensively studied in mobile robots [18, 25].”
BackgroundMethodInfluentialSelf-citationSpatio-Temporal Memory for Navigation in a Mushroom Body Model
Zhu, L., Mangan, M., & Webb, B. H. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-64313-3_39 · Cited by 16
Hou, Y., Zhang, H., Zhou, S., & Zou, H. (2017) · Mobile Information Systems · doi:10.1155/2017/8104386 · Cited by 13
“Recently, a ConvNet landmark-based visual localization approach proposed in [13] has achieved state-of-the-art localization accuracy under conditions of significant environmental and viewpoint changes, raising the interest of the community [1, 14, 15].”
BackgroundMethodInfluentialDeepSeqSLAM: A Trainable CNN+RNN for Joint Global Description and Sequence-based Place RecognitionPreprint
Chancán, M., & Milford, M. J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.08518 · Cited by 25
“Localization is a key component for enabling the deployment of autonomous vehicles (AV) with full self-driving capabilities in real environments, including a range of other driver assistance features such as place recognition [4, 12, 27, 36, 43], multi-object tracking [49, 14], road scene understanding [5, 24, 23], ob…”
BackgroundSelf-citationGraffMatch: Global Matching of 3D Lines and Planes for Wide Baseline LiDAR Registration
Lusk, P. C., Parikh, D., & How, J. P. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3229224 · Cited by 14
“In visual settings, appearance-based descriptors are commonly used for image retrieval or place recognition [1], [2], [3].”
BackgroundSelf-Supervised Feature Learning for Long-Term Metric Visual Localization
Chen, Y., & Barfoot, T. D. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3227866 · Cited by 14
“[25] provide a thorough overview of existing methods for place recognition.”
BackgroundGraph-Based Global Robot Localization Informing Situational Graphs with Architectural Graphs
Shaheer, M., Millan-Romera, J. A., Bavle, H., Sánchez-López, J. L., Civera, J., & Voos, H. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10341373 · Cited by 29
“Initial localization is usually performed by sensor-reading-to-map matching [7], [8], which is frequently referred to as re-localization [9], place recognition [10] or the kidnapped robot prolem [11].”
BackgroundAnkenbauer, J., Lusk, P. C., Thomas, A., & How, J. P. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10342267 · Cited by 20
“These methods may fail when localizing a ground vehicle driving north in a reference map built from a ground vehicle driving south in the same area [16].”
BackgroundMethodInfluential
Metadata
- Authors
- Lowry, S., Sünderhauf, N., Newman, P., Leonard, J. J., Cox, D., Corke, P., & Milford, M. J.
- Affiliations
- Queensland University of Technology (AU)
- University of Oxford (GB)
- MIT Computer Science and Artificial Intelligence Laboratory (US)
- Harvard University (US)
- ORCID
- Venue
- IEEE Transactions on Robotics
- Published
- 2016-02
- Volume
- 32
- Issue
- 1
- Pages
- 1-19
- ISSN
- 1552-3098 (ISSN-L)
- 1941-0468
- OpenAlex
- W2284029970
- Cited by
- 1,079
- References
- 239
- Citations by year
- 2026: 47 · 2025: 63 · 2024: 111 · 2023: 112 · 2022: 109 · 2021: 148 · 2020: 156 · 2019: 132 · 2018: 100 · 2017: 72 · 2016: 29
- FWCI
- 97.28
- Type
- journal article
- Language
- en
- Open access
- green
- purl.org
- Licence
- Locations
- IEEE Transactions on Robotics (publishedVersion)
- QUT ePrints (Queensland University of Technology) (submittedVersion)
- Funders
- ARC Future Fellowship (FT140101229)
- Australian Centre for Robotic Vision
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Spatial Cognition and Navigation
- Keywords
- visual place recognition, place recognition, appearance changes, animal navigation, semantic scene understanding, audio description, deep learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.