ORB-SLAM: A Versatile and Accurate Monocular SLAM System
Open accessThe DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Abstract
This paper presents ORB-SLAM, a feature-based monocular simultaneous localization and mapping (SLAM) system that operates in real time, in small and large indoor and outdoor environments. The system is robust to severe motion clutter, allows wide baseline loop closing and relocalization, and includes full automatic initialization. Building on excellent algorithms of recent years, we designed from scratch a novel system that uses the same features for all SLAM tasks: tracking, mapping, relocalization, and loop closing. A survival of the fittest strategy that selects the points and keyframes of the reconstruction leads to excellent robustness and generates a compact and trackable map that only grows if the scene content changes, allowing lifelong operation. We present an exhaustive evaluation in 27 sequences from the most popular datasets. ORB-SLAM achieves unprecedented performance with respect to other state-of-the-art monocular SLAM approaches. For the benefit of the community, we make the source code public.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Most SLAM methods represent the scene as a set of sparse 3D landmarks corresponding to discriminative features in the environment (e.g., lines, corners) [179]”
From Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age (2016) · cites this paper as [179]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589 · cited 3×
“This reduced in more than one order of magnitude the time needed for feature extraction, compared with SURF [18] and SIFT [19] features that were used in bags of words approaches so far.”
MethodMultiple View Geometry in Computer Vision
Hartley, R., & Zisserman, A. (2004) · doi:10.1017/cbo9780511811685 · Cited by 21,070
SURF: Speeded Up Robust Features
Bay, H., Tuytelaars, T., & Van Gool, L. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_32 · Cited by 14,955
ORB: An efficient alternative to SIFT or SURF
Rublee, E., Rabaud, V., Konolige, K., & Bradski, G. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126544 · Cited by 11,037 · cited 3×
“We chose ORB [9], which are oriented multiscale FAST corners with a 256-bit descriptor associated.”
BackgroundMethodVision meets robotics: The KITTI dataset
Geiger, A., Lenz, P., Stiller, C., & Urtasun, R. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913491297 · Cited by 9,913 · cited 3×
“The odometry benchmark from the KITTI dataset [40] contains 11 sequences from a car driven around a residential area with accurate ground truth from GPS and a Velodyne laser scanner.”
MethodMachine Learning for High-Speed Corner Detection
Rosten, E., & Drummond, T. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_34 · Cited by 4,555 · cited 1×
“DBoW2 [5] used for the first time bags of binary words obtained from BRIEF descriptors [16] along with the very efficient FAST feature detector [17].”
MethodParallel Tracking and Mapping for Small AR Workspaces
Klein, G., & Murray, D. (2007) · 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2007.4538852 · Cited by 4,346 · cited 7×
“The most representative keyframe-based SLAM system is probably PTAM by Klein and Murray [4].”
MethodInfluentialClosed-form solution of absolute orientation using unit quaternions
Horn, B. K. P. (1987) · Journal of the Optical Society of America A · doi:10.1364/josaa.4.000629 · Cited by 4,116
Bundle Adjustment — A Modern Synthesis
Triggs, B., McLauchlan, P. F., Hartley, R. I., & Fitzgibbon, A. W. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-44480-7_21 · Cited by 3,988 · cited 3×
“BUNDLE adjustment (BA) is known to provide accurate estimates of camera localizations as well as a sparse geometrical reconstruction [1], [2], given that a strong network of matches and good initial guesses are provided.”
BackgroundInfluentialA benchmark for the evaluation of RGB-D SLAM systems
Sturm, J., Engelhard, N., Endres, F., Burgard, W., & Cremers, D. (2012) · 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2012.6385773 · Cited by 3,976 · cited 6×
“Reconstruction and graphs in the sequence fr3 long off ice household from the TUM RGB-D Benchmark [38].”
BackgroundMethodInfluential
Cited by
ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras
Mur-Artal, R., & Tardos, J. D. (2017) · IEEE Transactions on Robotics · doi:10.1109/tro.2017.2705103 · Cited by 6,898
“Left: Monocular ORB-SLAM [1], right: ORB-SLAM2 (stereo).”
BackgroundMethodResultInfluentialSelf-citationVINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator
Qin, T., Li, P., & Shen, S. (2018) · IEEE Transactions on Robotics · doi:10.1109/tro.2018.2853729 · Cited by 4,669
“ORB-SLAM [4] is able to close loops and reuse the map, which takes advantage of Bag-of-World [6].”
BackgroundMethodInfluentialORB-SLAM3: An Accurate Open-Source Library for Visual, Visual–Inertial, and Multimap SLAM
Campos, C., Elvira, R., Rodriguez, J. J. G., M. Montiel, J. M., & D. Tardos, J. (2021) · IEEE Transactions on Robotics · doi:10.1109/tro.2021.3075644 · Cited by 4,274
Self-citationPast, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age
Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., Reid, I., & Leonard, J. J. (2016) · IEEE Transactions on Robotics · doi:10.1109/tro.2016.2624754 · Cited by 3,596
“They allow to build accurate and robust SLAM systems with automatic relocation and loop closing [179].”
InfluentialSuperPoint: Self-Supervised Interest Point Detection and Description
DeTone, D., Malisiewicz, T., & Rabinovich, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00060 · Cited by 3,355
Past, present, and future of simultaneous localization and mapping: Toward the robust-perception age
Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., Reid, I. D., & Leonard, J. J. (2016) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-138892 · Cited by 3,048
Engel, J., Koltun, V., & Cremers, D. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2658577 · Cited by 2,924
Unsupervised Learning of Depth and Ego-Motion from Video
Zhou, T., Brown, M., Snavely, N., & Lowe, D. G. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.700 · Cited by 2,910
“Absolute Trajectory Error (ATE) on the KITTI odometry split averaged over all 5 -frame snippets (lower is better).”
MethodInfluentialDigging Into Self-Supervised Monocular Depth Estimation
Godard, C., Aodha, O. M., Firman, M., & Brostow, G. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00393 · Cited by 2,561
“Our pose network is larger and deeper than previous Sequence 09 Sequence 10 # frames ORB-Slam [45] 0.014 ± 0.008 0 .012 ± 0.011 - DDVO [63] 0.045 ± 0.108 0 .033 ± 0.074 3 Zhou* [76] 0.050 ± 0.039 0 .034 ± 0.028 5 → 2 Zhou [76] 0.021 ± 0.017 0 .020 ± 0.015 5 Zhou [76] † 0.016 ± 0.009 0 .013 ± 0.009…”
InfluentialDynaSLAM: Tracking, Mapping, and Inpainting in Dynamic Scenes
Bescos, B., Facil, J. M., Civera, J., & Neira, J. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2860039 · Cited by 1,263
“All the methods –both feature-based and direct ones– that map the static scene parts only from the information contained in the sequence [1], [3], [9], [12]–[17], fail to estimate lifelong models when an a priori dynamic object remains static, e.”
BackgroundMethodGeoNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Pose
Yin, Z., & Shi, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00212 · Cited by 1,256
Visual Place Recognition: A Survey
Lowry, S., Sünderhauf, N., Newman, P., Leonard, J. J., Cox, D., Corke, P., & Milford, M. J. (2016) · IEEE Transactions on Robotics · doi:10.1109/tro.2015.2496823 · Cited by 1,079
“Metric information can be sparse: that is, range measurements are associated with local features such as image patches as in MonoSLAM [7], SIFT features as in [76], CenSurE features as in FrameSLAM [2], or ORB features [137] as in ORB-SLAM [136].”
MethodImage Matching from Handcrafted to Deep Features: A Survey
Ma, J., Jiang, X., Fan, A., Jiang, J., & Yan, J. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-020-01359-2 · Cited by 990
“Loop closure detection–another core module in SLAM application–refers to accurately asserting that an agent has returned to a previously visited location.”
BackgroundInfluentialLabbé, M., & Michaud, F. (2019) · Journal of Field Robotics · doi:10.1002/rob.21831 · Cited by 989
“…Depth Estimation (REMODE) (Pizzoli, Forster, & Scaramuzza, 2014), DT ‐ SLAM (Herrera, Kim, Kannala, Pulli, & Heikkilä, 2014), large-scale direct monocular SLAM (LSD ‐ SLAM) (Engel, Schöps, & Cremers, 2014) or oriented FAST and rotated BRIEF (ORB) ‐ SLAM (Mur ‐ Artal, Montiel, & Tardos, 2015).”
LightGlue: Local Feature Matching at Light Speed
Lindenberger, P., Sarlin, P.-E., & Pollefeys, M. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01616 · Cited by 943
“This opens up exciting prospects for deploying deep matchers in latency-sensitive applications like SLAM [45, 5] or re-constructing larger scenes from crowd-sourced data [25, 60, 39, 57].”
BackgroundDeepvo: towards end-to-end visual odometry with deep recurrent convolutional neural networks
Wang, S., Clark, R., Wen, H., & Trigoni, N. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989236 · Cited by 970
“Examples include keyframe base PTAM [9] and ORB-SLAM [10].”
BackgroundSVO: Semidirect Visual Odometry for Monocular and Multicamera Systems
Forster, C., Zhang, Z., Gassner, M., Werlberger, M., & Scaramuzza, D. (2017) · IEEE Transactions on Robotics · doi:10.1109/tro.2016.2623335 · Cited by 922
Stereo magnification: learning view synthesis using multiplane images
Zhou, T., Tucker, R., Flynn, J., Fyffe, G., & Snavely, N. (2018) · ACM Transactions on Graphics · doi:10.1145/3197517.3201323 · Cited by 776
Geometric Loss Functions for Camera Pose Regression with Deep Learning
Kendall, A., & Cipolla, R. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.694 · Cited by 803
“State of the art localisation systems perform very well within controlled environments [24, 34, 12, 33, 44].”
BackgroundCNN-SLAM: Real-Time Dense Monocular SLAM with Learned Depth Prediction
Tateno, K., Tombari, F., Laina, I., & Navab, N. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.695 · Cited by 800
“We also tried ORB-SLAM on this sequence but it completely fails, given the lack of the necessary baseline to initialize the algorithm.”
BackgroundMethodInfluentialVisual-Inertial Monocular SLAM With Map Reuse
Mur-Artal, R., & Tardos, J. D. (2017) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2017.2653359 · Cited by 795
“While we build on ORB-SLAM [12], any other SLAM could be used.”
BackgroundMethodInfluentialSelf-citationZhang, J., & Tao, D. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3039359 · Cited by 774
“In traditional methods such as ORB-SLAM [135], the front end and back end are two separate modules.”
MethodVisual SLAM algorithms: a survey from 2010 to 2016
Taketomi, T., Uchiyama, H., & Ikeda, S. (2017) · IPSJ Transactions on Computer Vision and Applications · doi:10.1186/s41074-017-0027-2 · Cited by 725
“As an extension of PTAM, ORB-SLAM [38] includes BA, vision based closed loop detection, and 7 DoF pose graph optimization.”
MethodInfluentialThe Replica Dataset: A Digital Replica of Indoor Spaces
Straub, J., Whelan, T. J., Ma, L., Chen, Y., Wijmans, E., Green, S., Engel, J. J., Mur-Artal, R., Ren, C. Y., Verma, S., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.05797 · Cited by 357
“The wide-angle greyscale video data together with the IMU data is used by an in-house SLAM system, similar to state-of-the-art systems like [10], [22], to provide 6 degree of freedom (DoF) poses.”
MethodSelf-citationZhan, H., Garg, R., Weerasekera, C. S., Li, K., Agarwal, H., & Reid, I. M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00043 · Cited by 705
Benchmarking 6DOF Outdoor Visual Localization in Changing Conditions
Sattler, T., Maddern, W., Toft, C., Torii, A., Hammarstrand, L., Stenborg, E., Safari, D., Okutomi, M., Pollefeys, M., Sivic, J., et al. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00897 · Cited by 699
“They are often used for place recognition [1, 17, 41, 55, 66, 69] and loop-closure detection [20,25,48].”
BackgroundRIFT: Multi-Modal Image Matching Based on Radiation-Variation Insensitive Feature Transform
Li, J., Hu, Q., & Ai, M. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2959244 · Cited by 651
A Tutorial on Quantitative Trajectory Evaluation for Visual(-Inertial) Odometry
Zhang, Z., & Scaramuzza, D. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593941 · Cited by 658
“ATE is also widely used to evaluate visual odometry/SLAM algorithms, for example, in [2], [3], [4].”
MethodSparse-to-Dense: Depth Prediction from Sparse Depth Samples and a Single Image
Ma, F., & Karaman, S. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460184 · Cited by 650
Computer Vision for Autonomous Vehicles: Problems, Datasets and State of the Art
Janai, J., Güney, F., Behl, A., & Geiger, A. (2020) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000079 · Cited by 643
BARF: Bundle-Adjusting Neural Radiance Fields
Lin, C.-H., Ma, W.-C., Torralba, A., & Lucey, S. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00569 · Cited by 628
“These can be classified into (a) indirect methods that rely on keypoint detection and matching [6, 32] and (b) direct methods that exploit photometric consistency [2, 12].”
BackgroundMethod(2020) · doi:10.1109/icra40945.2020.9196885 · Cited by 633
“First, while Back-end Geometry Sema-ntics ORB-SLAM [22] mono g2o points DSO [23] mono g2o points VINS-mono [24] mono/IMU Ceres points VINS-Fusion [25] mono/Stereo/IMU Ceres points ROVIOLI [26] stereo/IMU EKF points ElasticFusion [18] RGB-D alternation surfels Voxblox [27] RGB-D [26] TSDF SLAM++…”
BackgroundSpeeded up detection of squared fiducial markers
Romero-Ramirez, F. J., Muñoz-Salinas, R., & Medina-Carnicer, R. (2018) · Image and Vision Computing · doi:10.1016/j.imavis.2018.05.004 · Cited by 623
DSAC — Differentiable RANSAC for Camera Localization
Brachmann, E., Krull, A., Nowozin, S., Shotton, J., Michel, F., Gumhold, S., & Rother, C. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.267 · Cited by 607
“However, DSAC can be deployed in any deep learning pipeline where robust optimization is beneficial, for example learning structure from motion or SLAM end-to-end.”
MethodThe ApolloScape Open Dataset for Autonomous Driving and Its Application
Huang, X., Wang, P., Cheng, X., Zhou, D., Geng, Q., & Yang, R. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2926463 · Cited by 615
“Then, we experimented a leading open-source monocular SLAM algorithm, i.e., ORB-SLAM [90], to do self-localization.”
The ApolloScape Open Dataset for Autonomous Driving and its Application
Huang, X., Wang, P., Cheng, X., Zhou, D., Geng, Q., & Yang, R. (2018) · arXiv · doi:10.48550/arxiv.1803.06184 · Cited by 615
“Then, we experimented a leading open-source monocular SLAM algorithm, i.e., ORB-SLAM [90], to do self-localization.”
UnDeepVO: Monocular Visual Odometry Through Unsupervised Deep Learning
Li, R., Wang, S., Long, Z., & Gu, D. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8461251 · Cited by 581
Choy, C., Dong, W., & Koltun, V. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00259 · Cited by 548
PL-SLAM: A Stereo SLAM System Through the Combination of Points and Line Segments
Gomez-Ojeda, R., Moreno, F.-A., Zuniga-Noel, D., Scaramuzza, D., & Gonzalez-Jimenez, J. (2019) · IEEE Transactions on Robotics · doi:10.1109/tro.2019.2899783 · Cited by 560
Internet of vehicles in big data era
Xu, W., Zhou, H., Cheng, N., Lyu, F., Shi, W., Chen, J., & Shen, X. (2018) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2017.7510736 · Cited by 565
“In [123], Mur-Artal et al.”
Collaborative Multi-Robot Search and Rescue: Planning, Coordination, Perception, and Active Vision
Queralta, J. P., Taipalmaa, J., Can Pullinen, B., Sarker, V. K., Nguyen Gia, T., Tenhunen, H., Gabbouj, M., Raitoharju, J., & Westerlund, T. (2020) · IEEE Access · doi:10.1109/access.2020.3030190 · Cited by 526
“Simultaneous Localization and Mapping (SLAM) approaches utilize odometry algorithms to build local maps [116], [117], while utilizing those maps later on for more stable and global localization, where now the global term refers to the scope of the mission since deployment, or since the process of…”
MethodModelling uncertainty in deep learning for camera relocalization
Kendall, A., & Cipolla, R. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487679 · Cited by 548
“Visual SLAM [1], [4], [5], [9], and relocalization research [10], [11], has largely focused on registering viewpoints using point-based landmark features, such as SIFT [2] or ORB [3].”
BackgroundDu, G., Wang, K., Lian, S., & Zhao, K. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-020-09888-5 · Cited by 475
Geometry-Aware Learning of Maps for Camera Localization
Brahmbhatt, S., Gu, J., Kim, K., Hays, J., & Kautz, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00277 · Cited by 530
Matsuki, H., Murai, R., Kelly, P. H. J., & Davison, A. J. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01708 · Cited by 493
“Dense SLAM: Dense visual SLAM focuses on reconstructing detailed 3D maps, unlike sparse SLAM methods which excel in pose estimation [4, 5, 21] but typically yield maps useful mainly for localisation.”
Deep reinforcement learning based mobile robot navigation: A review
Zhu, K., & Zhang, T. (2021) · Tsinghua Science and Technology · doi:10.26599/tst.2021.9010012 · Cited by 499
“Classical visual SLAM methods, such as LSD-SLAM [2] and ORB-SLAM [3] , face two main challenges: (1) designing effective image features to express image information and (2) possible failure of the algorithm in cases of object movement, camera parameter change, illumination change, and single…”
MethodCubeSLAM: Monocular 3-D Object SLAM
Yang, S., & Scherer, S. (2019) · IEEE Transactions on Robotics · doi:10.1109/tro.2019.2909168 · Cited by 454
“The system is built on feature point based ORB SLAM2 [4], which includes the front end of camera tracking and back end of BA.”
BackgroundMethodInfluentialPL-SLAM: Real-time monocular visual SLAM with points and lines
Pumarola, A., Vakhitov, A., Agudo, A., Sanfeliu, A., & Moreno-Noguer, F. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989522 · Cited by 482
“Among them, the ORB-SLAM [18] seems to be the current state-of-the-art, yielding better accuracy than the direct methods counterparts.”
BackgroundMethodInfluentialUnsupervised Scale-consistent Depth and Ego-motion Learning from Monocular VideoPreprint
Bian, J.-W., Li, Z., Wang, N., Zhan, H., Shen, C., Cheng, M., & Reid, I. D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.10553 · Cited by 651
“We also report the results of ORB-SLAM [12] system (without loop closing) as a reference, though emphasize that this results in a comparison note between a simple frame-to-frame pose estimation framework with a Visual SLAM system, in which the latter has a strong back-end optimization system (i.”
BackgroundMethodResultInfluentialDeep learning for monocular depth estimation: A review
Ming, Y., Meng, X., Fan, C., & Yu, H. (2021) · Neurocomputing · doi:10.1016/j.neucom.2020.12.089 · Cited by 454
Probabilistic data association for semantic SLAM
Bowman, S. L., Atanasov, N., Daniilidis, K., & Pappas, G. J. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989203 · Cited by 462
“The trajectories estimated by our algorithm, by the ROVIO visual-inertial odometry algorithm [31], and by the ORB-SLAM2 visual SLAM algorithm [44], [45], projected into the x-y plane, are shown in Fig.”
MethodPatch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognition
Hausler, S., Garg, S., Xu, M., Milford, M., & Fischer, T. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01392 · Cited by 444
“Visual Place Recognition (VPR) is a key prerequisite for many robotics and autonomous system applications, both as a stand-alone positioning capability when using a prior map and as a key component of full Simultaneous Localization And Mapping (SLAM) systems.”
MethodTartanAir: A Dataset to Push the Limits of Visual SLAM
Wang, W., Zhu, D., Wang, X., Hu, Y., Qiu, Y., Wang, C., Hu, Y., Kapoor, A., & Scherer, S. (2020) · 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341801 · Cited by 456
“We sample 3-5 trajectories in each environment using medium motion pattern, and run ORB-M and ORB-S on each trajectory for 5 times.”
MethodInfluentialF-LOAM : Fast LiDAR Odometry and Mapping
Wang, H., Wang, C., Chen, C.-L., & Xie, L. (2021) · 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636655 · Cited by 416
“Most state-ofthe-art SLAM methods have been evaluated on this dataset, e.g., ORB-SLAM [24], VINS-Fusion [25], LIMO [26], and LSD-SLAM [27].”
A Comprehensive Survey of Visual SLAM Algorithms
Macario Barros, A., Michel, M., Moline, Y., Corre, G., & Carrel, F. (2022) · Robotics · doi:10.3390/robotics11010024 · Cited by 429
“In addition, the algorithm is capable of operating with a high frame rate, since it does not need to extract features for every frame [41], which enables its operation in a low-cost embedded system, as with the embedded platform considered by [40] that consists in an Odroid-U2.”
MethodD3VO: Deep Depth, Deep Pose and Deep Uncertainty for Monocular Visual Odometry
Yang, N., von Stumberg, L., Wang, R., & Cremers, D. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00136 · Cited by 438
“While monocular methods [16,52] have the advantage of low hardware ) and D eep uncertainty ( Σ ) estimation.”
BackgroundMethodRichter, S. R., Hayder, Z., & Koltun, V. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.243 · Cited by 419
“We benchmark two state-of-the-art systems that represent different approaches to monocular visual odometry: ORB-SLAM2, which tracks sparse features [45], and DSO, which optimizes a photometric objective defined over image intensities [15].”
BackgroundMaskFusion: Real-Time Recognition, Tracking and Reconstruction of Multiple Moving Objects
Runz, M., Buffier, M., & Agapito, L. (2018) · 2018 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) · doi:10.1109/ismar.2018.00024 · Cited by 415
PPF-FoldNet: Unsupervised Learning of Rotation Invariant 3D Local Descriptors
Deng, H., Birdal, T., & Ilic, S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01228-1_37 · Cited by 400
Stereo DSO: Large-Scale Direct Sparse Visual Odometry with Stereo Cameras
Wang, R., Schworer, M., & Cremers, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.421 · Cited by 401
“While we are witnessing an ongoing competition between keypoint based algorithms and direct algorithms, recently Direct Sparse Odometry (DSO) [7] was shown to outperform the state-of-the-art keypoint based monocular SLAM algorithm ORB-SLAM [21] in terms of both accuracy and robustness on a fairly large dataset for mon…”
BackgroundMethodVisual-Inertial Navigation: A Concise Review
Huang, G. (2019) · 2019 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2019.8793604 · Cited by 391
“An example of a current state-of-the-art indirect visual SLAM is the ORB-SLAM2 [83, 112], which performs graph-based optimization of camera poses using information from 3D feature point correspondences.”
BackgroundDeep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstruction
Chabra, R., Lenssen, J. E., Ilg, E., Schmidt, T., Straub, J., Lovegrove, S., & Newcombe, R. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58526-6_36 · Cited by 380
A survey of state-of-the-art on visual SLAM
Abaspur Kazerouni, I., Fitzgerald, L., Dooly, G., & Toal, D. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.117734 · Cited by 383
A Review of Visual-LiDAR Fusion based Simultaneous Localization and Mapping
Debeunne, C., & Vivet, D. (2020) · Sensors · doi:10.3390/s20072068 · Cited by 386
“Such research works generated semi-dense maps representing the environment, but direct SLAM approaches are time consuming and often require GPU based processing.”
BackgroundVisual SLAM and Structure from Motion in Dynamic Environments: A Survey
Saputra, M. R. U., Markham, A., & Trigoni, N. (2019) · ACM Computing Surveys · doi:10.1145/3177853 · Cited by 398
“Recent state-of-the-art techniques like ORB-SLAM [113] integrate hardware and algorithmic advancement in the past decade by including parallel computing, ORB features [131], statistical model selection [155], loop closures based on bag-of-words place recognition [26, 41], local bundle adjustment…”
MethodImage matching across wide baselines: From paper to practice
Jin, Y., Mishkin, D., Mishchuk, A., Matas, J., Fua, P., Yi, K. M., & Trulls, E. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-020-01385-0 · Cited by 388
Learning Two-View Correspondences and Geometry Using Order-Aware Network
Zhang, J., Sun, D., Luo, Z., Yao, A., Zhou, L., Shen, T., Chen, Y., Liao, H., & Quan, L. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00594 · Cited by 343
“Current state-of-the-art SfM [37, 33] and SLAM [21] pipelines commonly start from local feature extraction and matching.”
BackgroundCodeSLAM - Learning a Compact, Optimisable Representation for Dense Visual SLAM
Bloesch, M., Czarnowski, J., Clark, R., Leutenegger, S., & Davison, A. J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00271 · Cited by 372
The Architectural Implications of Autonomous Driving: Constraints and Acceleration
Lin, S.-C., Zhang, Y., Hsu, C.-H., Skach, M., Haque, M. E., Tang, L., & Mars, J. (2018) · Proceedings of the Twenty-Third International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3173162.3173191 · Cited by 367
“For localization (LOC), we use ORB-SLAM [52], which has been ranked top of the available open source algorithms for localizing the vehicle on the KITTI datasets [20], as well as on the TUM benchmark suite [65].”
MethodInfluentialNeRF--: Neural Radiance Fields Without Known Camera Parameters
Wang, Z., Wu, S., Xie, W., Chen, M., & Prisacariu, V. A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.07064 · Cited by 245
Unsupervised Deep Homography: A Fast and Robust Homography Estimation Model
Nguyen, T., Chen, S. W., Shivakumar, S. S., Taylor, C. J., & Kumar, V. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2809549 · Cited by 374
A General Optimisation‐Based Framework for Global Pose Estimation With Multiple Sensors
Qin, T., Cao, S., Pan, J., & Shen, S. (2025) · IET Cyber-Systems and Robotics · doi:10.1049/csy2.70023 · Cited by 477
Vision-based navigation and guidance for agricultural autonomous vehicles and robots: A review
Bai, Y., Zhang, B., Xu, N., Zhou, J., Shi, J., & Diao, Z. (2023) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2022.107584 · Cited by 353
IQA: Visual Question Answering in Interactive Environments
Gordon, D., Kembhavi, A., Rastegari, M., Redmon, J., Fox, D., & Farhadi, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00430 · Cited by 352
DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Cameras
Teed, Z., & Deng, J. H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.10869 · Cited by 227
“Following prior work, we evaluate the accuracy of the camera trajectory [31, 15, 41], primarily using Absolute Trajectory Error (ATE) [43].”
MethodXiao, L., Wang, J., Qiu, X., Rong, Z., & Zou, X. (2019) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2019.03.012 · Cited by 348
A General Optimization-based Framework for Local Odometry Estimation with Multiple Sensors
Qin, T., Pan, J., Cao, S., & Shen, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.03638 · Cited by 279
“In this experiment, we compare our results with ORBSLAM [4], a state-of-the-art visual odometry method that works with stereo cameras.”
BackgroundDeep Virtual Stereo Odometry: Leveraging Deep Depth Prediction for Monocular Direct Sparse Odometry
Yang, N., Wang, R., Stückler, J., & Cremers, D. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01237-3_50 · Cited by 346
LDSO: Direct Sparse Odometry with Loop Closure
Gao, X., Wang, R., Demmel, N., & Cremers, D. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593376 · Cited by 327
State of the Art on 3D Reconstruction with RGB‐D Cameras
Zollhöfer, M., Stotko, P., Görlitz, A., Theobalt, C., Nießner, M., Klein, R., & Kolb, A. (2018) · Computer Graphics Forum · doi:10.1111/cgf.13386 · Cited by 339
Parallel Tracking and Verifying: A Framework for Real-Time and High Accuracy Visual Tracking
Fan, H., & Ling, H. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.585 · Cited by 329
“By splitting tracking and mapping into two parallel threads, PTAM ( parallel tracking and mapping ) [23] provides one of the most popular SLAM frameworks with many important extensions ( e.g ., [32]).”
QuadricSLAM: Dual Quadrics From Object Detections as Landmarks in Object-Oriented SLAM
Nicholson, L., Milford, M., & Sunderhauf, N. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2866205 · Cited by 325
“This is supported by further experiments that demonstrated it was possible to improve the trajectory error compared to ORB-SLAM2 on a number of sequences by rejecting objects with high bounding box variance.”
BackgroundInfluentialDetect-SLAM: Making Object Detection and SLAM Mutually Beneficial
Zhong, F., Wang, S., Zhang, Z., Chen, C., & Wang, Y. (2018) · 2018 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2018.00115 · Cited by 307
“We employ the ORB-SLAM [18] and Single Shot Multi-box Object Detector(SSD) [14] in Detect-SLAM.”
BackgroundMethodGrounding Image Matching in 3D with MASt3R
Leroy, V., Cabon, Y., & Revaud, J. (2025) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-73220-1_5 · Cited by 305
Monocular depth estimation based on deep learning: An overview
Zhao, C., Sun, Q., Zhang, C., Tang, Y., & Qian, F. (2020) · Science China Technological Sciences · doi:10.1007/s11431-020-1582-8 · Cited by 310
UAV in the advent of the twenties: Where we stand and what is next
Nex, F., Armenakis, C., Cramer, M., Cucci, D. A., Gerke, M., Honkavaara, E., Kukko, A., Persello, C., & Skaloud, J. (2022) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2021.12.006 · Cited by 309
“Feature-based methods rely on the tracking of distinctive features in the images (Campos et al., 2020; Mur-Artal et al., 2015) while direct methods rely on the actual pixel intensities, attempting to employ the entire image frame (Cremers, 2017; Engel et al.”
MethodA Comparative Analysis of LiDAR SLAM-Based Indoor Navigation for Autonomous Vehicles
Zou, Q., Sun, Q., Chen, L., Nie, B., & Li, Q. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3063477 · Cited by 321
“For loop-closure detection, methods based on the bag-of-words (BoW) technique were popular used [17], [19], [36], where the accumulative error can largely be eliminated by optimizing a pose graph.”
BackgroundMethodOpenVSLAM: A Versatile Visual SLAM Framework
Sumikura, S., Shibuya, M., & Sakurada, K. (2019) · Proceedings of the 27th ACM International Conference on Multimedia · doi:10.1145/3343031.3350539 · Cited by 302
“In particular, ORB–SLAM [10, 11], LSD–SLAM [4], and DSO [3] constitute major approaches regarded as de facto standards of visual SLAM, which performs SLAM processing using imagery.”
BackgroundMethodInfluentialGrounding Image Matching in 3D with MASt3R
Leroy, V., Cabon, Y., & Revaud, J. (2024) · arXiv · doi:10.48550/arxiv.2406.09756 · Cited by 309
“…correspondences between pixels across different images of the same scene, denoted as image matching , constitutes a core component of all 3D vision applications, spanning mapping [14,61], localization [41,72], navigation [15], photogrammetry [34, 64] and autonomous robotics in general [63,87].”
BackgroundEvery Pixel Counts ++: Joint Learning of Geometry and Motion with 3D Holistic Understanding
Luo, C., Yang, Z., Wang, P., Wang, Y., Xu, W., Nevatia, R., & Yuille, A. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2930258 · Cited by 301
“As shown in Table 7, our trained MotionNet shows superior performance with respect to visual SLAM methods (ORB-SLAM), and is comparable to other unsupervised learning methods with slight improvement on two test sequences.”
MethodInfluentialWeb AR: A Promising Future for Mobile Augmented Reality—State of the Art, Challenges, and Insights
Qiao, X., Ren, P., Dustdar, S., Liu, L., Ma, H., & Chen, J. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2895105 · Cited by 293
“For the markerless Mobile AR implementation method, although there have already been some efforts to reduce the computational complexity of SLAM (e.g., ORB-SLAM [31]), it is still challenging to port it to the Web.”
BackgroundReview of visual odometry: types, approaches, challenges, and applications
Aqel, M. O. A., Marhaban, M. H., Saripan, M. I., & Ismail, N. B. (2016) · SpringerPlus · doi:10.1186/s40064-016-3573-7 · Cited by 292
“For example, LSD-SLAM and ORB-SLAM are real-time algorithm for simultaneous localization and mapping with a monocular freely-moving camera (Engel et al. 2014; Mur-Artal et al. 2015).”
MethodEfficient structure from motion for large-scale UAV images: A review and a comparison of SfM tools
Jiang, S., Jiang, C., & Jiang, W. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.04.016 · Cited by 286
DISK: Learning local features with policy gradient
Tyszkiewicz, M. J., Fua, P., & Trulls, E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.13566 · Cited by 187
“Local features have been a key computer vision technology since the introduction of SIFT [20], enabling applications such as Structure-from-Motion (SfM) [1, 15, 36], SLAM [27], re-localization [23], and many others.”
MethodCascaded Refinement Network for Point Cloud Completion
Wang, X., Ang, M. H., & Lee, G. H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00087 · Cited by 271
Deep Drone Racing: From Simulation to Reality With Domain Randomization
Loquercio, A., Kaufmann, E., Ranftl, R., Dosovitskiy, A., Koltun, V., & Scaramuzza, D. (2020) · IEEE Transactions on Robotics · doi:10.1109/tro.2019.2942989 · Cited by 272
“5(a)], a SLAM-based state estimator [5], [11] would have less drift than a VIO baseline, but we empirically found the latency of existing open-source SLAM pipelines to be too high for closed-loop control.”
BackgroundSchonberger, J. L., Pollefeys, M., Geiger, A., & Sattler, T. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00721 · Cited by 267
Multiple UAV Systems: A Survey
Skorobogatov, G., Barrado, C., & Salamí, E. (2020) · Unmanned Systems · doi:10.1142/s2301385020500090 · Cited by 261
“In this particular paper, authors used ORB-SLAM2 system [107] both for tests and as an inspiration for some parts of their own system.”
MethodArtificial intelligence (AI) in augmented reality (AR)-assisted manufacturing applications: a review
Sahu, C. K., Young, C., & Rai, R. (2021) · International Journal of Production Research · doi:10.1080/00207543.2020.1859636 · Cited by 256
“It was further developed as parallel tracking and mapping (PTAM) (Klein and Murray 2007) and Oriented FAST and Rotated Binary Robust Independent Elementary Features (BRIEF) (ORB)-SLAM (Mur-Artal, Montiel, and Tardos 2015) for various applications.”
Method
Metadata
- Authors
- Mur-Artal, R., Montiel, J. M. M., & Tardos, J. D.
- Affiliations
- Universidad de Zaragoza (ES)
- Venue
- IEEE Transactions on Robotics
- Published
- 2015-10
- Volume
- 31
- Issue
- 5
- Pages
- 1147-1163
- ISSN
- 1552-3098 (ISSN-L)
- 1941-0468
- OpenAlex
- W1612997784
- Cited by
- 6,778
- References
- 46
- Citations by year
- 2026: 441 · 2025: 784 · 2024: 857 · 2023: 847 · 2022: 776 · 2021: 738 · 2020: 672 · 2019: 653 · 2018: 528 · 2017: 353 · 2016: 119 · 2015: 10
- FWCI
- 487.97
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Transactions on Robotics (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Dirección General de Investigación of Spain (DPI2012-32168)
- Ministerio de Educación Scholarship (FPU13/04175)
- Gobierno de Aragón Scholarship (B121/13)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
- Physical Sciences › Earth and Planetary Sciences › Geology › 3D Surveying and Cultural Heritage
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Keywords
- ORB-SLAM, monocular SLAM, SLAM, feature-based SLAM, real-time SLAM, loop closure, relocalization, survival of the fittest, keyframe selection, automatic initialization, indoor and outdoor environments
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.