The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.
A Review of Visual-LiDAR Fusion based Simultaneous Localization and Mapping
Open accessAbstract
Autonomous navigation requires both a precise and robust mapping and localization solution. In this context, Simultaneous Localization and Mapping (SLAM) is a very well-suited solution. SLAM is used for many applications including mobile robotics, self-driving cars, unmanned aerial vehicles, or autonomous underwater vehicles. In these domains, both visual and visual-IMU SLAM are well studied, and improvements are regularly proposed in the literature. However, LiDAR-SLAM techniques seem to be relatively the same as ten or twenty years ago. Moreover, few research works focus on vision-LiDAR approaches, whereas such a fusion would have many advantages. Indeed, hybridized solutions offer improvements in the performance of SLAM, especially with respect to aggressive motion, lack of light, or lack of visual features. This study provides a comprehensive survey on visual-LiDAR SLAM. After a summary of the basic idea of SLAM and its implementation, we give a complete review of the state-of-the-art of SLAM research, focusing on solutions using vision, LiDAR, and a sensor fusion of both modalities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A method for registration of 3-D shapes
Besl, P. J., & McKay, N. D. (1992) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.121791 · Cited by 18,103
ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras
Mur-Artal, R., & Tardos, J. D. (2017) · IEEE Transactions on Robotics · doi:10.1109/tro.2017.2705103 · Cited by 6,898 · cited 1×
“Such research works generated semi-dense maps representing the environment, but direct SLAM approaches are time consuming and often require GPU based processing.”
BackgroundORB-SLAM: A Versatile and Accurate Monocular SLAM System
Mur-Artal, R., Montiel, J. M. M., & Tardos, J. D. (2015) · IEEE Transactions on Robotics · doi:10.1109/tro.2015.2463671 · Cited by 6,778
Parallel Tracking and Mapping for Small AR Workspaces
Klein, G., & Murray, D. (2007) · 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2007.4538852 · Cited by 4,346
Simultaneous localization and mapping: part I
Durrant-Whyte, H., & Bailey, T. (2006) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2006.1638022 · Cited by 4,199
KinectFusion: Real-time dense surface mapping and tracking
Newcombe, R. A., Fitzgibbon, A., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A. J., Kohi, P., Shotton, J., & Hodges, S. (2011) · 2011 10th IEEE International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2011.6092378 · Cited by 4,008
MonoSLAM: Real-time single camera SLAM
Davison, A. J., Reid, I. D., Molton, N. D., & Stasse, O. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1049 · Cited by 3,959
LSD-SLAM: Large-scale direct monocular SLAM
Engel, J., Schöps, T., & Cremers, D. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10605-2_54 · Cited by 3,851
ORB-SLAM: A Versatile and Accurate Monocular SLAM System
Mur-Artal, R., Montiel, J. M. M., & Tardos, J. D. (2015) · Zaguan (Universidad de Zaragoza) · Cited by 3,153
Engel, J., Koltun, V., & Cremers, D. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2658577 · Cited by 2,924
Simultaneous localization and mapping (SLAM): part II
Bailey, T., & Durrant-Whyte, H. (2006) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2006.1678144 · Cited by 2,554
Microsoft Kinect Sensor and Its Effect
Zhang, Z. (2012) · IEEE Multimedia · doi:10.1109/mmul.2012.24 · Cited by 2,487
Improved Techniques for Grid Mapping With Rao-Blackwellized Particle Filters
Grisetti, G., Stachniss, C., & Burgard, W. (2007) · IEEE Transactions on Robotics · doi:10.1109/tro.2006.889486 · Cited by 2,439
SVO: Fast semi-direct monocular visual odometry
Forster, C., Pizzoli, M., & Scaramuzza, D. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6906584 · Cited by 2,205
DTAM: Dense tracking and mapping in real-time
Newcombe, R. A., Lovegrove, S. J., & Davison, A. J. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126513 · Cited by 2,078 · cited 1×
“In this category, the most known methods are DTAM [25], LSD-SLAM [26], SVO [27], or DSO [28,29].”
MethodReal-time loop closure in 2D LIDAR SLAM
Hess, W., Kohler, D., Rapp, H., & Andor, D. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487258 · Cited by 1,938
Real-time simultaneous localisation and mapping with a single camera
Davison (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238654 · Cited by 1,733
Segal, A., Haehnel, D., & Thrun, S. (2009) · Robotics: Science and Systems V · doi:10.15607/rss.2009.v.021 · Cited by 1,526
FAB-MAP: Probabilistic Localization and Mapping in the Space of Appearance
Cummins, M., & Newman, P. (2008) · The International Journal of Robotics Research · doi:10.1177/0278364908090961 · Cited by 1,472
A Tutorial on Graph-Based SLAM
Grisetti, G., Kummerle, R., Stachniss, C., & Burgard, W. (2010) · IEEE Intelligent Transportation Systems Magazine · doi:10.1109/mits.2010.939925 · Cited by 1,345
Globally Consistent Range Scan Alignment for Environment Mapping
Lu, F., & Milios, E. (1997) · Autonomous Robots · doi:10.1023/a:1008854305733 · Cited by 1,304
Mobile robot localization by tracking geometric beacons
Leonard, J. J., & Durrant-Whyte, H. F. (1991) · IEEE Transactions on Robotics and Automation · doi:10.1109/70.88147 · Cited by 1,245
RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments
Henry, P., Krainin, M., Herbst, E., Ren, X., & Fox, D. (2012) · The International Journal of Robotics Research · doi:10.1177/0278364911434148 · Cited by 1,161
Dense visual SLAM for RGB-D cameras
Kerl, C., Sturm, J., & Cremers, D. (2013) · 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2013.6696650 · Cited by 909
Visual simultaneous localization and mapping: a survey
Fuentes-Pacheco, J., Ruiz-Ascencio, J., & Rendón-Mancha, J. M. (2015) · Artificial Intelligence Review · doi:10.1007/s10462-012-9365-8 · Cited by 883
Low-drift and real-time lidar odometry and mapping
Zhang, J., & Singh, S. (2017) · Autonomous Robots · doi:10.1007/s10514-016-9548-2 · Cited by 820
CNN-SLAM: Real-Time Dense Monocular SLAM with Learned Depth Prediction
Tateno, K., Tombari, F., Laina, I., & Navab, N. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.695 · Cited by 800
Visual-lidar odometry and mapping: low-drift, robust, and fast
Zhang, J., & Singh, S. (2015) · 2015 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2015.7139486 · Cited by 747
Grisetti, G., Stachniss, C., & Burgard, W. (2005) · Proceedings of the 2005 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2005.1570477 · Cited by 734
An evaluation of the RGB-D SLAM system
Endres, F., Hess, J., Engelhard, N., Sturm, J., Cremers, D., & Burgard, W. (2012) · 2012 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2012.6225199 · Cited by 731
Visual SLAM algorithms: a survey from 2010 to 2016
Taketomi, T., Uchiyama, H., & Ikeda, S. (2017) · IPSJ Transactions on Computer Vision and Applications · doi:10.1186/s41074-017-0027-2 · Cited by 725
Position referencing and consistent world modeling for mobile robots
Chatila, R., & Laumond, J. (2005) · Proceedings. 1985 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.1985.1087373 · Cited by 567
6D SLAM—3D mapping outdoor environments
Nüchter, A., Lingemann, K., Hertzberg, J., & Surmann, H. (2007) · Journal of Field Robotics · doi:10.1002/rob.20209 · Cited by 450
Strasdat, H., Montiel, J. M. M., & Davison, A. J. (2012) · Image and Vision Computing · doi:10.1016/j.imavis.2012.02.009 · Cited by 439
Real-Time 3D Reconstruction and 6-DoF Tracking with an Event Camera
Kim, H., Leutenegger, S., & Davison, A. J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_21 · Cited by 438
Koide, K., Miura, J., & Menegatti, E. (2019) · International Journal of Advanced Robotic Systems · doi:10.1177/1729881419841532 · Cited by 413
Stereo DSO: Large-Scale Direct Sparse Visual Odometry with Stereo Cameras
Wang, R., Schworer, M., & Cremers, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.421 · Cited by 401
Efficient Sparse Pose Adjustment for 2D mapping
Konolige, K., Grisetti, G., Kümmerle, R., Burgard, W., Limketkai, B., & Vincent, R. (2010) · 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2010.5649043 · Cited by 395
CodeSLAM - Learning a Compact, Optimisable Representation for Dense Visual SLAM
Bloesch, M., Czarnowski, J., Clark, R., Leutenegger, S., & Davison, A. J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00271 · Cited by 372
KinectFusion: Real-time dense surface mapping and tracking
Newcombe, R. A., Davison, A. J., Izadi, S., Kohli, P., Hilliges, O., Shotton, J., Molyneaux, D., Hodges, S. E., Kim, D., & Fitzgibbon, A. W. (2011) · IEEE International Symposium on Mixed and Augmented Reality (ISMAR) · doi:10.1109/ismar.2011.6162880 · Cited by 296
Limo: Lidar-monocular visual odometry
Graeter, J., Wilczynski, A., & Lauer, M. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8594394 · Cited by 261
Simultaneous Mosaicing and Tracking with an Event Camera
Kim, H., Handa, A., Benosman, R., Ieng, S.-H., & Davison, A. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.26 · Cited by 247
Video-rate localization in multiple maps for wearable augmented reality
Castle, R., Klein, G., & Murray, D. W. (2008) · 2008 12th IEEE International Symposium on Wearable Computers · doi:10.1109/iswc.2008.4911577 · Cited by 223
LIMO: Lidar-Monocular Visual OdometryPreprint
Gräter, J., Wilczynski, A., & Lauer, M. (2018) · IEEE/RJS International Conference on Intelligent RObots and Systems · doi:10.48550/arxiv.1807.07524 · Cited by 216
Precise Ego-Motion Estimation with Millimeter-Wave Radar Under Diverse and Challenging Conditions
Cen, S. H., & Newman, P. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460687 · Cited by 214
Salas-Moreno, R. F., Glocken, B., Kelly, P. H. J., & Davison, A. J. (2014) · 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) · doi:10.1109/ismar.2014.6948422 · Cited by 175
A Discussion of Simultaneous Localization and Mapping
Frese, U. (2006) · Autonomous Robots · doi:10.1007/s10514-006-5735-x · Cited by 169
Autonomous Driving in the Real World: Experiences with Tesla Autopilot and Summon
Dikmen, M., & Burns, C. M. (2016) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3003715.3005465 · Cited by 152
River mapping from a flying robot: state estimation, river detection, and obstacle mapping
Scherer, S., Rehder, J., Achar, S., Cover, H., Chambers, A., Nuske, S. T., & Singh, S. (2012) · Autonomous Robots · doi:10.1007/s10514-012-9293-0 · Cited by 139
Event-based 3D SLAM with a depth-augmented dynamic vision sensor
Weikersdorfer, D., Adrian, D. B., Cremers, D., & Conradt, J. (2014) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2014.6906882 · Cited by 138
Appearance-based loop detection from 3D laser data using the normal distributions transform
Magnusson, M., Andreasson, H., Nüchter, A., & Lilienthal, A. J. (2009) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2009.5152712 · Cited by 133
Fast Laser Scan Matching using Polar Coordinates
Diosi, A., & Kleeman, L. (2007) · The International Journal of Robotics Research · doi:10.1177/0278364907082042 · Cited by 132
MonoFusion: Real-time 3D reconstruction of small scenes with a single web camera
Pradeep, V., Rhemann, C., Izadi, S., Zach, C., Bleyer, M., & Bathiche, S. (2013) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar.2013.6671767 · Cited by 123
Direct Visual SLAM Using Sparse Depth for Camera-LiDAR System
Shin, Y.-S., Park, Y. S., & Kim, A. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8461102 · Cited by 116
A Constant-Time Efficient Stereo SLAM System
Christopher Mei, A., Sibley, G., Cummins, M., Newman, P. M., & Reid, I. D. (2009) · British Machine Vision Conference (BMVC) · doi:10.5244/c.23.54 · Cited by 111
Landmark based radar SLAM using graph optimization
Schuster, F., Keller, C. G., Rapp, M., Haueis, M., & Curio, C. (2016) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2016.7795967 · Cited by 103
Localization and Mapping Using Only a Rotating FMCW Radar Sensor
Vivet, D., Checchin, P., & Chapuis, R. (2013) · Sensors · doi:10.3390/s130404527 · Cited by 101
Self-citationWhen 2.5D is not enough: Simultaneous reconstruction, segmentation and recognition on dense SLAM
Tateno, K., Tombari, F., & Navab, N. (2016) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2016.7487378 · Cited by 92
López-Guillén, E., García, S., Barea, R., Bergasa, L. M., Molinos, E. J., Arroyo, R., Romera, E., & Pardo, S. (2017) · Sensors · doi:10.3390/s17040802 · Cited by 86
High-Precision Depth Estimation Using Uncalibrated LiDAR and Stereo Fusion
Park, K., Kim, S., & Sohn, K. (2019) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2891788 · Cited by 83
Jiang, G., Yin, L., Jin, S., Tian, C., Ma, X., & Ou, Y. (2019) · Applied Sciences · doi:10.3390/app9102105 · Cited by 78
Visually bootstrapped generalized ICP
Pandey, G., Savarese, S., McBride, J. R., & Eustice, R. M. (2011) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2011.5980322 · Cited by 54
Visual laser-SLAM in large-scale indoor environments
Liang, X., Chen, H., Li, Y., & Liu, Y. (2016) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio.2016.7866271 · Cited by 53
Zhang, Z., Zhao, R., Liu, E., Yan, K., & Ma, Y. (2018) · Sensors · doi:10.3390/s18061948 · Cited by 53
Visual SLAM: Why Bundle Adjust?
Parra, Á., Chin, T.-J., Eriksson, A. P., & Reid, I. (2019) · IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2019.8793749 · Cited by 47
SLAM of Robot based on the Fusion of Vision and LIDAR
Xu, Y., Ou, Y., & Xu, T. (2018) · IEEE International Conference on Cyborg and Bionic Systems (CBS) · doi:10.1109/cbs.2018.8612212 · Cited by 46
A Tight Coupling of Vision-Lidar Measurements for an Effective Odometry
Seo, Y., & Chou, C. (2019) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2019.8814164 · Cited by 38
Martín, F., Triebel, R., Moreno, L. E., & Siegwart, R. (2013) · Robotica · doi:10.1017/s026357471300060x · Cited by 32
Boersma, R., van Arem, B., & Rieck, F. (2018) · World Electric Vehicle Journal · doi:10.3390/wevj9010015 · Cited by 30
Loop Detection and Correction of 3D Laser-Based SLAM with Visual Information
Zhu, Z., Yang, S., Dai, H., & Li, F. (2018) · Computer Animation (CA) · doi:10.1145/3205326.3205357 · Cited by 28
Deep Learning for Visual Navigation of Unmanned Ground Vehicles : A review
O’Mahony, N., Campbell, S., Krpálková, L., Riordan, D., Walsh, J. L., Murphy, A., & Ryan, C. (2018) · Irish Signals and Systems Conference · doi:10.1109/issc.2018.8585381 · Cited by 25
Accurate Direct Visual-Laser Odometry with Explicit Occlusion Handling and Plane Detection
Huang, K., Xiao, J., & Stachniss, C. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8793629 · Cited by 22
Research on active SLAM with fusion of monocular vision and laser range data
Sun, F., Zhou, Y., Li, C., & Huang, Y. (2010) · World Congress on Intelligent Control and Automation · doi:10.1109/wcica.2010.5554412 · Cited by 14
Cited by
Lvi-sam: Tightly-coupled lidar-visual-inertial odometry via smoothing and mapping
Shan, T., Englot, B., Ratti, C., & Rus, D. (2021) · 2021 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra48506.2021.9561996 · Cited by 624
Gupta, A., Anpalagan, A., Guan, L., & Khwaja, A. S. (2021) · Array · doi:10.1016/j.array.2021.100057 · Cited by 565
Milestones in Autonomous Driving and Intelligent Vehicles: Survey of Surveys
Chen, L., Li, Y., Huang, C., Li, B., Xing, Y., Tian, D., Li, L., Hu, Z., Na, X., Li, Z., et al. (2023) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2022.3223131 · Cited by 511
Lin, J., & Zhang, F. (2022) · 2022 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra46639.2022.9811935 · Cited by 423
F-LOAM : Fast LiDAR Odometry and Mapping
Wang, H., Wang, C., Chen, C.-L., & Xie, L. (2021) · 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636655 · Cited by 416
Metadata
- Authors
- Debeunne, C., & Vivet, D.
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2020-04-07
- Volume
- 20
- Issue
- 7
- Pages
- 2068
- ISSN
- 1424-8220 (ISSN-L)
- OpenAlex
- W3015235064
- Cited by
- 386
- References
- 73
- FWCI
- 35.74
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.