The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual–Inertial, and Multimap SLAM
Open accessAbstract
This article presents ORB-SLAM3, the first system able to perform visual, visual-inertial and multimap SLAM with monocular, stereo and RGB-D cameras, using pin-hole and fisheye lens models. The first main novelty is a tightly integrated visual-inertial SLAM system that fully relies on maximuma posteriori(MAP) estimation, even during IMU initialization, resulting in real-time robust operation in small and large, indoor and outdoor environments, being two to ten times more accurate than previous approaches. The second main novelty is a multiple map system relying on a new place recognition method with improved recall that lets ORB-SLAM3 survive to long periods of poor visual information: when it gets lost, it starts a new map that will be seamlessly merged with previous maps when revisiting them. Compared with visual odometry systems that only use information from the last few seconds, ORB-SLAM3 is the first system able to reuse in all the algorithm stages all previous information from high parallax co-visible keyframes, even if they are widely separated in time or come from previous mapping sessions, boosting accuracy. Our experiments show that, in all sensor configurations, ORB-SLAM3 is as robust as the best systems available in the literature and significantly more accurate. Notably, our stereo-inertial SLAM achieves an average accuracy of 3.5 cm in the EuRoC drone and 9 mm under quick hand-held motions in the room of TUM-VI dataset, representative of AR/VR scenarios. For the benefit of the community we make public the source code.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras
Mur-Artal, R., & Tardos, J. D. (2017) · IEEE Transactions on Robotics · doi:10.1109/tro.2017.2705103 · Cited by 6,898
Self-citationORB-SLAM: A Versatile and Accurate Monocular SLAM System
Mur-Artal, R., Montiel, J. M. M., & Tardos, J. D. (2015) · IEEE Transactions on Robotics · doi:10.1109/tro.2015.2463671 · Cited by 6,778
Self-citationTsai, R. (1987) · IEEE Journal on Robotics and Automation · doi:10.1109/jra.1987.1087109 · Cited by 5,838
VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator
Qin, T., Li, P., & Shen, S. (2018) · IEEE Transactions on Robotics · doi:10.1109/tro.2018.2853729 · Cited by 4,669
Parallel Tracking and Mapping for Small AR Workspaces
Klein, G., & Murray, D. (2007) · 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2007.4538852 · Cited by 4,346
Closed-form solution of absolute orientation using unit quaternions
Horn, B. K. P. (1987) · Journal of the Optical Society of America A · doi:10.1364/josaa.4.000629 · Cited by 4,116
A benchmark for the evaluation of RGB-D SLAM systems
Sturm, J., Engelhard, N., Endres, F., Burgard, W., & Cremers, D. (2012) · 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2012.6385773 · Cited by 3,976
MonoSLAM: Real-time single camera SLAM
Davison, A. J., Reid, I. D., Molton, N. D., & Stasse, O. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1049 · Cited by 3,959
LSD-SLAM: Large-scale direct monocular SLAM
Engel, J., Schöps, T., & Cremers, D. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10605-2_54 · Cited by 3,851
Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age
Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., Reid, I., & Leonard, J. J. (2016) · IEEE Transactions on Robotics · doi:10.1109/tro.2016.2624754 · Cited by 3,596
EPnP: An Accurate O(n) Solution to the PnP Problem
Lepetit, V., Moreno-Noguer, F., & Fua, P. (2009) · International Journal of Computer Vision · doi:10.1007/s11263-008-0152-6 · Cited by 3,298
Engel, J., Koltun, V., & Cremers, D. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2658577 · Cited by 2,924
SVO: Fast semi-direct monocular visual odometry
Forster, C., Pizzoli, M., & Scaramuzza, D. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6906584 · Cited by 2,205
The EuRoC micro aerial vehicle datasets
Burri, M., Nikolic, J., Gohl, P., Schneider, T., Rehder, J., Omari, S., Achtelik, M. W., & Siegwart, R. (2016) · The International Journal of Robotics Research · doi:10.1177/0278364915620033 · Cited by 2,066
A Multi-State Constraint Kalman Filter for Vision-aided Inertial Navigation
Mourikis, A. I., & Roumeliotis, S. I. (2007) · Proceedings 2007 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2007.364024 · Cited by 1,951
Bags of Binary Words for Fast Place Recognition in Image Sequences
Galvez-López, D., & Tardos, J. D. (2012) · IEEE Transactions on Robotics · doi:10.1109/tro.2012.2197158 · Cited by 1,913
Real-time simultaneous localisation and mapping with a single camera
Davison (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238654 · Cited by 1,733
Keyframe-based visual–inertial odometry using nonlinear optimization
Leutenegger, S., Lynen, S., Bosse, M., Siegwart, R., & Furgale, P. (2015) · The International Journal of Robotics Research · doi:10.1177/0278364914554813 · Cited by 1,723
On-Manifold Preintegration for Real-Time Visual--Inertial Odometry
Forster, C., Carlone, L., Dellaert, F., & Scaramuzza, D. (2017) · IEEE Transactions on Robotics · doi:10.1109/tro.2016.2597321 · Cited by 1,502
A generic camera model and calibration method for conventional, wide-angle, and fish-eye lenses
Kannala, J., & Brandt, S. S. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.153 · Cited by 949
SVO: Semidirect Visual Odometry for Monocular and Multicamera Systems
Forster, C., Zhang, Z., Gassner, M., Werlberger, M., & Scaramuzza, D. (2017) · IEEE Transactions on Robotics · doi:10.1109/tro.2016.2623335 · Cited by 922
Robust visual inertial odometry using a direct EKF-based approach
Bloesch, M., Omari, S., Hutter, M., & Siegwart, R. (2015) · 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353389 · Cited by 917
High-precision, consistent EKF-based visual-inertial odometry
Li, M., & Mourikis, A. I. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913481251 · Cited by 813
Visual-Inertial Monocular SLAM With Map Reuse
Mur-Artal, R., & Tardos, J. D. (2017) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2017.2653359 · Cited by 795
Inverse Depth Parametrization for Monocular SLAM
Civera, J., Davison, A. J., & Montiel, J. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.2003276 · Cited by 779
(2020) · doi:10.1109/icra40945.2020.9196885 · Cited by 633
Large-scale direct SLAM with stereo cameras
Engel, J., Stuckler, J., & Cremers, D. (2015) · 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353631 · Cited by 539
Parallel Tracking and Mapping on a camera phone
Klein, G., & Murray, D. (2009) · 2009 8th IEEE International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2009.5336495 · Cited by 522
Iterated extended Kalman filter based visual-inertial odometry using direct photometric feedback
Bloesch, M., Burri, M., Omari, S., Hutter, M., & Siegwart, R. (2017) · The International Journal of Robotics Research · doi:10.1177/0278364917728574 · Cited by 485
The TUM VI Benchmark for Evaluating Visual-Inertial Odometry
Schubert, D., Goll, T., Demmel, N., Usenko, V., Stuckler, J., & Cremers, D. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593419 · Cited by 473
Lupton, T., & Sukkarieh, S. (2012) · IEEE Transactions on Robotics · doi:10.1109/tro.2011.2170332 · Cited by 469
Keyframe-Based Visual-Inertial SLAM using Nonlinear Optimization
Leutenegger, S., Furgale, P., Rabaud, V., Chli, M., Konolige, K., & Siegwart, R. (2013) · Robotics: Science and Systems IX · doi:10.15607/rss.2013.ix.037 · Cited by 447
Strasdat, H., Montiel, J. M. M., & Davison, A. J. (2012) · Image and Vision Computing · doi:10.1016/j.imavis.2012.02.009 · Cited by 439
D3VO: Deep Depth, Deep Pose and Deep Uncertainty for Monocular Visual Odometry
Yang, N., von Stumberg, L., Wang, R., & Cremers, D. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00136 · Cited by 438
Stereo DSO: Large-Scale Direct Sparse Visual Odometry with Stereo Cameras
Wang, R., Schworer, M., & Cremers, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.421 · Cited by 401
A Benchmark Comparison of Monocular Visual-Inertial Odometry Algorithms for Flying Robots
Delmerico, J., & Scaramuzza, D. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460664 · Cited by 399
Improving the Agility of Keyframe-Based SLAM
Klein, G., & Murray, D. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88688-4_59 · Cited by 335
LDSO: Direct Sparse Odometry with Loop Closure
Gao, X., Wang, R., Demmel, N., & Cremers, D. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593376 · Cited by 327
Scale Drift-Aware Large Scale Monocular SLAM
Strasdat, H., M. M. Montiel, J., & Davison, A. (2010) · Robotics: Science and Systems VI · doi:10.15607/rss.2010.vi.010 · Cited by 323
Double window optimisation for constant time visual SLAM
Strasdat, H., Davison, A. J., Montiel, J. M. M., & Konolige, K. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126517 · Cited by 296
Self-citationFast relocalisation and loop closing in keyframe-based SLAM
Mur-Artal, R., & Tardos, J. D. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6906953 · Cited by 264
Civera, J., Grasa, O. G., Davison, A. J., & Montiel, J. M. M. (2010) · Journal of Field Robotics · doi:10.1002/rob.20345 · Cited by 261
C2TAM: A Cloud framework for cooperative tracking and mapping
Riazuelo, L., Civera, J., & Montiel, J. M. M. (2014) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2013.11.007 · Cited by 254
Schmuck, P., & Chli, M. (2019) · Journal of Field Robotics · doi:10.1002/rob.21854 · Cited by 253
Mapping Large Loops with a Single Hand-Held Camera
Clemente, L., Davison, A., Reid, I., Neira, J., & Tardos, J. (2007) · Robotics: Science and Systems III · doi:10.15607/rss.2007.iii.038 · Cited by 248
Direct Sparse Visual-Inertial Odometry Using Dynamic Marginalization
Von Stumberg, L., Usenko, V., & Cremers, D. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8462905 · Cited by 235
Video-rate localization in multiple maps for wearable augmented reality
Castle, R., Klein, G., & Murray, D. W. (2008) · 2008 12th IEEE International Symposium on Wearable Computers · doi:10.1109/iswc.2008.4911577 · Cited by 223
Visual-Inertial Mapping With Non-Linear Factor Recovery
Usenko, V., Demmel, N., Schubert, D., Stuckler, J., & Cremers, D. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2961227 · Cited by 221
Collaborative monocular SLAM with multiple Micro Aerial Vehicles
Forster, C., Lynen, S., Kneip, L., & Scaramuzza, D. (2013) · 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2013.6696923 · Cited by 201
Multi-UAV collaborative monocular SLAM
Schmuck, P., & Chli, M. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989445 · Cited by 188
Unified Loop Closing and Recovery for Real Time Monocular SLAM
Eade, E., & Drummond, T. W. (2008) · British Machine Vision Conference (BMVC) · doi:10.5244/c.22.6 · Cited by 181
Closed-Form Solution of Visual-Inertial Structure from Motion
Martinelli, A. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0647-7 · Cited by 148
Zubizarreta, J., Aguinaga, I., & Montiel, J. M. M. (2020) · IEEE Transactions on Robotics · doi:10.1109/tro.2020.2991614 · Cited by 145
Simultaneous State Initialization and Gyroscope Bias Calibration in Visual Inertial Aided Navigation
Kaiser, J., Martinelli, A., Fontana, F., & Scaramuzza, D. (2016) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2016.2521413 · Cited by 129
Omnidirectional DSO: Direct Sparse Odometry With Fisheye Cameras
Matsuki, H., von Stumberg, L., Usenko, V., Stückler, J., & Cremers, D. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2855443 · Cited by 115
A comparative analysis of tightly-coupled monocular, binocular, and stereo VINS
Paul, M. K., Wu, K., Hesch, J. A., Nerurkar, E. D., & Roumeliotis, S. I. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989022 · Cited by 101
ORBSLAM-Atlas: a robust and accurate multi-map system
Elvira, R., Tardós, J. D., & Montiel, J. M. M. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8967572 · Cited by 85
Self-citationInertial-Only Optimization for Visual-Inertial Initialization
Campos, C., Montiel, J. M. M., & Tardós, J. D. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9197334 · Cited by 84
Self-citationLoosely-Coupled Semi-Direct Monocular SLAM
Lee, S. H., & Civera, J. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2889156 · Cited by 81
Fast and Robust Initialization for Visual-Inertial SLAM
Campos, C., Montiel, J. M. M., & Tardós, J. D. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8793718 · Cited by 47
Self-citationMOARSLAM: Multiple Operator Augmented RSLAM
Morrison, J. G., Gálvez‐López, D., & Sibley, G. (2016) · Springer tracts in advanced robotics · doi:10.1007/978-4-431-55879-8_9 · Cited by 35
Alternating-Stereo VINS: Observability Analysis and Performance Evaluation
Paul, M. K., & Roumeliotis, S. I. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00497 · Cited by 28
SLAMM: Visual monocular SLAM with continuous mapping using multiple maps
Daoud, H. A., Sabri, A. Q. M., Loo, C. K., & Alsahag, A. M. M. (2018) · PLoS ONE · doi:10.1371/journal.pone.0195878 · Cited by 24
Cited by
FAST-LIO2: Fast Direct LiDAR-Inertial Odometry
Xu, W., Cai, Y., He, D., Lin, J., & Zhang, F. (2022) · IEEE Transactions on Robotics · doi:10.1109/tro.2022.3141876 · Cited by 1,750
SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAM
Keetha, N., Karhade, J., Jatavallabhula, K. M., Yang, G., Scherer, S., Ramanan, D., & Luiten, J. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.02018 · Cited by 462
A Comprehensive Survey of Visual SLAM Algorithms
Macario Barros, A., Michel, M., Moline, Y., Corre, G., & Carrel, F. (2022) · Robotics · doi:10.3390/robotics11010024 · Cited by 429
Autonomous driving system: A comprehensive survey
Zhao, J., Zhao, W., Deng, B., Wang, Z., Zhang, F., Zheng, W., Cao, W., Nan, J., Lian, Y., & Burke, A. F. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122836 · Cited by 361
Grounding Image Matching in 3D with MASt3R
Leroy, V., Cabon, Y., & Revaud, J. (2024) · arXiv · doi:10.48550/arxiv.2406.09756 · Cited by 309
Metadata
- Authors
- Campos, C., Elvira, R., Rodriguez, J. J. G., M. Montiel, J. M., & D. Tardos, J.
- Venue
- IEEE Transactions on Robotics
- Published
- 2021-12
- Volume
- 37
- Issue
- 6
- Pages
- 1874-1890
- ISSN
- 1552-3098 (ISSN-L)
- 1941-0468
- OpenAlex
- W3043971245
- Cited by
- 4,274
- References
- 64
- FWCI
- 299.56
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.