VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator
Open accessThe DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Abstract
One camera and one low-cost inertial measurement unit (IMU) form a monocular visual-inertial system (VINS), which is the minimum sensor suite (in size, weight, and power) for the metric six degrees-of-freedom (DOF) state estimation. In this paper, we present VINS-Mono: a robust and versatile monocular visual-inertial state estimator. Our approach starts with a robust procedure for estimator initialization. A tightly coupled, nonlinear optimization-based method is used to obtain highly accurate visual-inertial odometry by fusing preintegrated IMU measurements and feature observations. A loop detection module, in combination with our tightly coupled formulation, enables relocalization with minimum computation. We additionally perform 4-DOF pose graph optimization to enforce the global consistency. Furthermore, the proposed system can reuse a map by saving and loading it in an efficient way. The current and previous maps can be merged together by the global pose graph optimization. We validate the performance of our system on public datasets and real-world experiments and compare against other state-of-the-art algorithms. We also perform an onboard closed-loop autonomous flight on the microaerial-vehicle platform and port the algorithm to an iOS-based demonstration. We highlight that the proposed work is a reliable, complete, and versatile system that is applicable for different applications that require high accuracy in localization. We open source our implementations for both PCs (https://github.com/HKUST-Aerial-Robotics/VINS-Mono) and iOS mobile devices (https://github.com/HKUST-Aerial-Robotics/VINS-Mobile).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In terms of vision-IMU-GPS fusion, VINS-Fusion has become a mainstream solution for large-scale, high-precision localization and is widely used in UAVs and mobile robots.”
From Multimodal fusion and vision–language models: A survey for robot vision (2026) · cites this paper as [151]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multiple View Geometry in Computer Vision
Hartley, R., & Zisserman, A. (2004) · doi:10.1017/cbo9780511811685 · Cited by 21,070
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897 · cited 3×
“Relative pose error [42] in MH_05_difficult.”
MethodInfluential(1981) · Cited by 11,963
Shi, J., & Tomasi (1994) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition CVPR-94 · doi:10.1109/cvpr.1994.323794 · Cited by 7,724 · cited 1×
“features are detected [32] to maintain a minimum number (100– 300) of features in each image.”
BackgroundRobust estimation of a location parameter
Huber, P. J. (1964) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177703732 · Cited by 7,228
ORB-SLAM: A Versatile and Accurate Monocular SLAM System
Mur-Artal, R., Montiel, J. M. M., & Tardos, J. D. (2015) · IEEE Transactions on Robotics · doi:10.1109/tro.2015.2463671 · Cited by 6,778 · cited 7×
“ORB-SLAM [4] is able to close loops and reuse the map, which takes advantage of Bag-of-World [6].”
BackgroundMethodInfluentialParallel Tracking and Mapping for Small AR Workspaces
Klein, G., & Murray, D. (2007) · 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2007.4538852 · Cited by 4,346
Bundle Adjustment — A Modern Synthesis
Triggs, B., McLauchlan, P. F., Hartley, R. I., & Fitzgibbon, A. W. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-44480-7_21 · Cited by 3,988 · cited 1×
“Finally, a global full bundle adjustment [36] is applied to minimize the total reprojection error of all feature observations.”
MethodA benchmark for the evaluation of RGB-D SLAM systems
Sturm, J., Engelhard, N., Endres, F., Burgard, W., & Cremers, D. (2012) · 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2012.6385773 · Cited by 3,976 · cited 3×
“TABLE I RMSE [43] IN EUROC DATASETS IN METERS”
BackgroundMethodInfluentialLSD-SLAM: Large-scale direct monocular SLAM
Engel, J., Schöps, T., & Cremers, D. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10605-2_54 · Cited by 3,851 · cited 3×
“Noticeable approaches include PTAM [1], SVO [2], LSD-SLAM [3], DSO [5], and ORB-SLAM [4].”
BackgroundMethodBRIEF: Binary Robust Independent Elementary Features
Calonder, M., Lepetit, V., Strecha, C., & Fua, P. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15561-1_56 · Cited by 3,597 · cited 1×
“In addition to the corner features that are used for the monocular VIO, 500 more corners are detected and described by the BRIEF descriptor [40].”
MethodEPnP: An Accurate O(n) Solution to the PnP Problem
Lepetit, V., Moreno-Noguer, F., & Fua, P. (2009) · International Journal of Computer Vision · doi:10.1007/s11263-008-0152-6 · Cited by 3,298
ORB-SLAM: A Versatile and Accurate Monocular SLAM System
Mur-Artal, R., Montiel, J. M. M., & Tardos, J. D. (2015) · Zaguan (Universidad de Zaragoza) · Cited by 3,153
Multiple view geometry in computer vision
Opower, H. (2002) · Optics and Lasers in Engineering · doi:10.1016/s0143-8166(01)00145-2 · Cited by 3,007
Engel, J., Koltun, V., & Cremers, D. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2658577 · Cited by 2,924
SVO: Fast semi-direct monocular visual odometry
Forster, C., Pizzoli, M., & Scaramuzza, D. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6906584 · Cited by 2,205 · cited 5×
“In [27], a re-initialization and failure recovery algorithm based on SVO [2] was proposed.”
BackgroundMethodInfluentialThe EuRoC micro aerial vehicle datasets
Burri, M., Nikolic, J., Gohl, P., Schneider, T., Rehder, J., Omari, S., Achtelik, M. W., & Siegwart, R. (2016) · The International Journal of Robotics Research · doi:10.1177/0278364915620033 · Cited by 2,066 · cited 1×
“1) VIO Comparison: We evaluate our proposed VINSMono using the EuRoC MAV visual-inertial datasets [41].”
MethodAn efficient solution to the five-point relative pose problem
Nister, D. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.17 · Cited by 2,009 · cited 1×
“two frames using the five-point algorithm [34].”
A Multi-State Constraint Kalman Filter for Vision-aided Inertial Navigation
Mourikis, A. I., & Roumeliotis, S. I. (2007) · Proceedings 2007 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2007.364024 · Cited by 1,951 · cited 4×
“A popular EKF based VIO approach is MSCKF [13], [14].”
MethodInfluentialBags of Binary Words for Fast Place Recognition in Image Sequences
Galvez-López, D., & Tardos, J. D. (2012) · IEEE Transactions on Robotics · doi:10.1109/tro.2012.2197158 · Cited by 1,913 · cited 3×
“ORB-SLAM [4] is able to close loops and reuse the map, which takes advantage of Bag-of-World [6].”
BackgroundMethodKeyframe-based visual–inertial odometry using nonlinear optimization
Leutenegger, S., Lynen, S., Bosse, M., Siegwart, R., & Furgale, P. (2015) · The International Journal of Robotics Research · doi:10.1177/0278364914554813 · Cited by 1,723 · cited 4×
“To achieve constant processing time, graph-based VIO methods [15], [17], [18] usually optimize over a bounded-size sliding window of recent states by marginalizing out past states and measurements.”
BackgroundMethodInfluentialOn-Manifold Preintegration for Real-Time Visual--Inertial Odometry
Forster, C., Carlone, L., Dellaert, F., & Scaramuzza, D. (2017) · IEEE Transactions on Robotics · doi:10.1109/tro.2016.2597321 · Cited by 1,502 · cited 5×
“We note that our current IMU preintegration procedure shares almost the same numerical results as [19] and [24], but using different derivations.”
MethodResultInfluentialiSAM2: Incremental smoothing and mapping using the Bayes tree
Kaess, M., Johannsson, H., Roberts, R., Ila, V., Leonard, J. J., & Dellaert, F. (2012) · The International Journal of Robotics Research · doi:10.1177/0278364911430419 · Cited by 1,362 · cited 2×
“Further on, tightly coupled visual-inertial algorithms are either based on the EKF [11]– [13] or graph optimization [14]–[19], where camera and IMU measurements are jointly optimized from the raw measurement level.”
MethodRobust visual inertial odometry using a direct EKF-based approach
Bloesch, M., Omari, S., Hutter, M., & Siegwart, R. (2015) · 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353389 · Cited by 917
High-precision, consistent EKF-based visual-inertial odometry
Li, M., & Mourikis, A. I. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913481251 · Cited by 813 · cited 1×
“Direct approaches [2], [3], [22] minimize photometric error, while indirect approaches [12], [15], [17] minimize the geometric displacement.”
BackgroundVisual-Inertial Monocular SLAM With Map Reuse
Mur-Artal, R., & Tardos, J. D. (2017) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2017.2653359 · Cited by 795
A robust and modular multi-sensor fusion approach applied to MAV navigation
Lynen, S., Achtelik, M. W., Weiss, S., Chli, M., & Siegwart, R. (2013) · 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2013.6696917 · Cited by 572 · cited 1×
“The simplest way to deal with visual and inertial measurements is loosely coupled sensor fusion [9], [10], where the IMU is treated as an independent module to assist the visual structure.”
MethodIMU Preintegration on Manifold for Efficient Visual-Inertial Maximum-a-Posteriori Estimation
Forster, C., Carlone, L., Dellaert, F., & Scaramuzza, D. (2015) · Robotics: Science and Systems XI · doi:10.15607/rss.2015.xi.006 · Cited by 499
Lupton, T., & Sukkarieh, S. (2012) · IEEE Transactions on Robotics · doi:10.1109/tro.2011.2170332 · Cited by 469 · cited 2×
“IMU Pre-integration was first proposed in [22], which parametrized rotation error in Euler angle.”
MethodSingle View Point Omnidirectional Camera Calibration from Planar Grids
Mei, C., & Rives, P. (2007) · Proceedings 2007 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2007.364084 · Cited by 441
Robust Visual Inertial Odometry Using a Direct EKF-Based Approach
Bloesch, M., Omari, S., Hutter, M., et al. (2015) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-a-010566547 · Cited by 424
Weiss, S., Achtelik, M. W., Lynen, S., Chli, M., & Siegwart, R. (2012) · 2012 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2012.6225147 · Cited by 417
A Benchmark Comparison of Monocular Visual-Inertial Odometry Algorithms for Flying Robots
Delmerico, J., & Scaramuzza, D. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460664 · Cited by 399 · cited 1×
“More benchmark comparisons can be found in [44], which shows a favorable performance of the proposed system comparing against other state-of-the-art algorithms.”
BackgroundScale Drift-Aware Large Scale Monocular SLAM
Strasdat, H., M. M. Montiel, J., & Davison, A. (2010) · Robotics: Science and Systems VI · doi:10.15607/rss.2010.vi.010 · Cited by 323 · cited 1×
“A 7-DOF [30] (position, orientation, and scale) pose graph optimization is followed loop detection.”
BackgroundScale Drift-Aware Large Scale Monocular SLAM
Strasdat, H., Montiel, J. M. M., & Davison, A. J. (2011) · Robotics · doi:10.7551/mitpress/9123.003.0014 · Cited by 320
Yang, Z., & Shen, S. (2017) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2016.2550621 · Cited by 274 · cited 3×
“To achieve constant processing time, graph-based VIO methods [15], [17], [18] usually optimize over a bounded-size sliding window of recent states by marginalizing out past states and measurements.”
BackgroundMethodSelf-citationSliding window filter with application to planetary landing
Sibley, G., Matthies, L., & Sukhatme, G. (2010) · Journal of Field Robotics · doi:10.1002/rob.20360 · Cited by 259 · cited 1×
“The marginalization is carried out using the Schur complement [39].”
MethodAutonomous aerial navigation using monocular visual‐inertial fusion
Lin, Y., Gao, F., Qin, T., Gao, W., Liu, T., Wu, W., Yang, Z., & Shen, S. (2018) · Journal of Field Robotics · doi:10.1002/rob.21732 · Cited by 237
Self-citationTightly-coupled monocular visual-inertial fusion for autonomous flight of rotorcraft MAVs
Shen, S., Michael, N., & Kumar, V. (2015) · 2015 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2015.7139939 · Cited by 223 · cited 6×
“Further on, tightly-coupled visual-inertial algorithms are either based on the EKF [13]–[15] or graph optimization [7], [8], [16], [17], where camera and IMU measurements are jointly optimized from the raw measurement level.”
BackgroundMethodInfluentialSelf-citation(2004) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.16.329_2 · Cited by 223
Direct visual-inertial odometry with stereo cameras
Usenko, V., Engel, J., Stuckler, J., & Cremers, D. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487335 · Cited by 219 · cited 1×
“Direct approaches [2], [3], [22] minimize photometric error, while indirect approaches [12], [15], [17] minimize the geometric displacement.”
BackgroundHeng, L., Li, B., & Pollefeys, M. (2013) · 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2013.6696592 · Cited by 178 · cited 1×
“We use MEI [45] model for this camera, calibrated by the toolkit [46].”
MethodRobust initialization of monocular visual-inertial estimation on aerial robots
Qin, T., & Shen, S. (2017) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206284 · Cited by 173
Self-citationClosed-Form Solution of Visual-Inertial Structure from Motion
Martinelli, A. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0647-7 · Cited by 148 · cited 1×
“A closed-form solution to the monocular visual-inertial initialization problem was introduced in [26].”
BackgroundA Square Root Inverse Filter for Efficient Vision-aided Inertial Navigation on Mobile Devices
Wu, K., Ahmed, A., Georgiou, G., & Roumeliotis, S. I. (2015) · Robotics: Science and Systems · doi:10.15607/rss.2015.xi.008 · Cited by 146 · cited 1×
“SR-ISWF [18], [19] is an extension of MSCKF.”
BackgroundMonocular Visual-Inertial State Estimation for Mobile Augmented Reality
Li, P., Qin, T., Hu, B. A., Zhu, F., & Shen, S. (2017) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar.2017.18 · Cited by 146
Self-citationSimultaneous State Initialization and Gyroscope Bias Calibration in Visual Inertial Aided Navigation
Kaiser, J., Martinelli, A., Fontana, F., & Scaramuzza, D. (2016) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2016.2521413 · Cited by 129 · cited 1×
“solution by adding a gyroscope bias calibration was proposed in [27].”
MethodFaessler, M., Fontana, F., Förster, C., & Scaramuzza, D. (2015) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2015.7139420 · Cited by 110
A comparative analysis of tightly-coupled monocular, binocular, and stereo VINS
Paul, M. K., Wu, K., Hesch, J. A., Nerurkar, E. D., & Roumeliotis, S. I. (2017) · IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2017.7989022 · Cited by 87 · cited 1×
“SR-ISWF [20], [21] is an extension of MSCKF.”
BackgroundRelocalization, Global Optimization and Map Merging for Monocular Visual-Inertial SLAM
Qin, T., Li, P., & Shen, S. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8460780 · Cited by 75
Self-citationInitialization-Free Monocular Visual-Inertial State Estimation with Application to Autonomous MAVs
Shen, S., Mulgaonkar, Y., Michael, N., & Kumar, V. R. (2015) · Springer tracts in advanced robotics · doi:10.1007/978-3-319-23778-7_15 · Cited by 45 · cited 1×
“A linear estimator initialization method that leverages relative rotations from short-term IMU pre-integration was proposed in [8], [24].”
MethodSelf-citationFörster, C., Carlone, L., Dellaert, F., & Scaramuzza, D. (2015) · SMARTech Repository (Georgia Institute of Technology) · Cited by 17
Spline-Based Initialization of Monocular Visual–Inertial State Estimators at High Altitude
Liu, T., & Shen, S. (2017) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2017.2724770 · Cited by 10 · cited 1×
“A detailed analysis of accelerometer bias calibration is presented in our previous work [34].”
MethodSelf-citation
Cited by
ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual–Inertial, and Multimap SLAM
Campos, C., Elvira, R., Rodriguez, J. J. G., M. Montiel, J. M., & D. Tardos, J. (2021) · IEEE Transactions on Robotics · doi:10.1109/tro.2021.3075644 · Cited by 4,274
LIO-SAM: Tightly-coupled Lidar Inertial Odometry via Smoothing and Mapping
Shan, T., Englot, B., Meyers, D., Wang, W., Ratti, C., & Rus, D. (2020) · 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341176 · Cited by 2,199
“Because LIOM uses the same initialization pipeline from [25], it inherits the same initialization sensitivity of visual-inertial SLAM and is not able to initialize properly using this dataset.”
MethodFAST-LIO2: Fast Direct LiDAR-Inertial Odometry
Xu, W., Cai, Y., He, D., Lin, J., & Zhang, F. (2022) · IEEE Transactions on Robotics · doi:10.1109/tro.2022.3141876 · Cited by 1,750
FAST-LIO: A Fast, Robust LiDAR-Inertial Odometry Package by Tightly-Coupled Iterated Kalman Filter
Xu, W., & Zhang, F. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3064227 · Cited by 1,127
“Visual (-inertial) odometry (VO), such as Stereo VO [1], [2] and Monocular VO [3], [4] are commonly used on mobile robots due to their lightweight and low-cost.”
Background
Metadata
- Authors
- Qin, T., Li, P., & Shen, S.
- Affiliations
- Hong Kong University of Science and Technology (HK)
- Venue
- IEEE Transactions on Robotics
- Published
- 2018-08
- Volume
- 34
- Issue
- 4
- Pages
- 1004-1020
- ISSN
- 1552-3098 (ISSN-L)
- 1941-0468
- OpenAlex
- W2745859992
- Cited by
- 4,669
- References
- 53
- Citations by year
- 2026: 575 · 2025: 856 · 2024: 789 · 2023: 729 · 2022: 571 · 2021: 469 · 2020: 357 · 2019: 248 · 2018: 73
- FWCI
- 233.33
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- IEEE Transactions on Robotics (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Hong Kong Research Grants Council Early Career Scheme (26201616)
- HKUST Proof-of-Concept (PCF.009.16/17)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
- Physical Sciences › Engineering › Aerospace Engineering › Inertial Sensor and Navigation
- Physical Sciences › Engineering › Aerospace Engineering › Aerospace Engineering and Control Systems
- Keywords
- loop detection, relocalization, pose graph optimization, autonomous flight
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.