VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator
Open accessThe DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Abstract
One camera and one low-cost inertial measurement unit (IMU) form a monocular visual-inertial system (VINS), which is the minimum sensor suite (in size, weight, and power) for the metric six degrees-of-freedom (DOF) state estimation. In this paper, we present VINS-Mono: a robust and versatile monocular visual-inertial state estimator. Our approach starts with a robust procedure for estimator initialization. A tightly coupled, nonlinear optimization-based method is used to obtain highly accurate visual-inertial odometry by fusing preintegrated IMU measurements and feature observations. A loop detection module, in combination with our tightly coupled formulation, enables relocalization with minimum computation. We additionally perform 4-DOF pose graph optimization to enforce the global consistency. Furthermore, the proposed system can reuse a map by saving and loading it in an efficient way. The current and previous maps can be merged together by the global pose graph optimization. We validate the performance of our system on public datasets and real-world experiments and compare against other state-of-the-art algorithms. We also perform an onboard closed-loop autonomous flight on the microaerial-vehicle platform and port the algorithm to an iOS-based demonstration. We highlight that the proposed work is a reliable, complete, and versatile system that is applicable for different applications that require high accuracy in localization. We open source our implementations for both PCs (https://github.com/HKUST-Aerial-Robotics/VINS-Mono) and iOS mobile devices (https://github.com/HKUST-Aerial-Robotics/VINS-Mobile).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In terms of vision-IMU-GPS fusion, VINS-Fusion has become a mainstream solution for large-scale, high-precision localization and is widely used in UAVs and mobile robots.”
From Multimodal fusion and vision–language models: A survey for robot vision (2026) · cites this paper as [151]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multiple View Geometry in Computer Vision
Hartley, R., & Zisserman, A. (2004) · doi:10.1017/cbo9780511811685 · Cited by 21,070
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897 · cited 3×
“Relative pose error [42] in MH_05_difficult.”
MethodInfluential(1981) · Cited by 11,963
Shi, J., & Tomasi (1994) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition CVPR-94 · doi:10.1109/cvpr.1994.323794 · Cited by 7,724 · cited 1×
“features are detected [32] to maintain a minimum number (100– 300) of features in each image.”
BackgroundRobust estimation of a location parameter
Huber, P. J. (1964) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177703732 · Cited by 7,228
ORB-SLAM: A Versatile and Accurate Monocular SLAM System
Mur-Artal, R., Montiel, J. M. M., & Tardos, J. D. (2015) · IEEE Transactions on Robotics · doi:10.1109/tro.2015.2463671 · Cited by 6,778 · cited 7×
“ORB-SLAM [4] is able to close loops and reuse the map, which takes advantage of Bag-of-World [6].”
BackgroundMethodInfluentialParallel Tracking and Mapping for Small AR Workspaces
Klein, G., & Murray, D. (2007) · 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2007.4538852 · Cited by 4,346
Bundle Adjustment — A Modern Synthesis
Triggs, B., McLauchlan, P. F., Hartley, R. I., & Fitzgibbon, A. W. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-44480-7_21 · Cited by 3,988 · cited 1×
“Finally, a global full bundle adjustment [36] is applied to minimize the total reprojection error of all feature observations.”
MethodA benchmark for the evaluation of RGB-D SLAM systems
Sturm, J., Engelhard, N., Endres, F., Burgard, W., & Cremers, D. (2012) · 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2012.6385773 · Cited by 3,976 · cited 3×
“TABLE I RMSE [43] IN EUROC DATASETS IN METERS”
BackgroundMethodInfluentialLSD-SLAM: Large-scale direct monocular SLAM
Engel, J., Schöps, T., & Cremers, D. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10605-2_54 · Cited by 3,851 · cited 3×
“Noticeable approaches include PTAM [1], SVO [2], LSD-SLAM [3], DSO [5], and ORB-SLAM [4].”
BackgroundMethod
Cited by
ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual–Inertial, and Multimap SLAM
Campos, C., Elvira, R., Rodriguez, J. J. G., M. Montiel, J. M., & D. Tardos, J. (2021) · IEEE Transactions on Robotics · doi:10.1109/tro.2021.3075644 · Cited by 4,274
LIO-SAM: Tightly-coupled Lidar Inertial Odometry via Smoothing and Mapping
Shan, T., Englot, B., Meyers, D., Wang, W., Ratti, C., & Rus, D. (2020) · 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341176 · Cited by 2,199
“Because LIOM uses the same initialization pipeline from [25], it inherits the same initialization sensitivity of visual-inertial SLAM and is not able to initialize properly using this dataset.”
MethodFAST-LIO2: Fast Direct LiDAR-Inertial Odometry
Xu, W., Cai, Y., He, D., Lin, J., & Zhang, F. (2022) · IEEE Transactions on Robotics · doi:10.1109/tro.2022.3141876 · Cited by 1,750
FAST-LIO: A Fast, Robust LiDAR-Inertial Odometry Package by Tightly-Coupled Iterated Kalman Filter
Xu, W., & Zhang, F. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3064227 · Cited by 1,127
“Visual (-inertial) odometry (VO), such as Stereo VO [1], [2] and Monocular VO [3], [4] are commonly used on mobile robots due to their lightweight and low-cost.”
BackgroundOpenVINS: A Research Platform for Visual-Inertial Estimation
Geneva, P., Eckenhoff, K., Lee, W., Yang, Y., & Huang, G. (2020) · 2020 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra40945.2020.9196524 · Cited by 680
“VINS-Fusion VIO [3] – Extension of the original VINSMono [42] sliding optimization-based method that leverages IMU preintegration which is then loosely coupled with a secondary pose-graph optimization.”
MethodA Survey on Aerial Swarm Robotics
Chung, S.-J., Paranjape, A. A., Dames, P., Shen, S., & Kumar, V. (2018) · IEEE Transactions on Robotics · doi:10.1109/tro.2018.2857475 · Cited by 672
“While dense representations can be directly used for autonomous navigation [186] or geographical reference, sparse representations are often only used for state estimation [187] or collaborative control of robotic agents.”
BackgroundSelf-citationA Tutorial on Quantitative Trajectory Evaluation for Visual(-Inertial) Odometry
Zhang, Z., & Scaramuzza, D. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593941 · Cited by 658
“We can see the “raw” estimation from VINS-Mono is in a different reference frame as the groundtruth, and therefore cannot be directly compared.”
MethodSwarm of micro flying robots in the wild
Zhou, X., Wen, X., Wang, Z., Gao, Y., Li, H., Wang, Q., Yang, T., Lu, H., Cao, Y., Xu, C., et al. (2022) · Science Robotics · doi:10.1126/scirobotics.abm5954 · Cited by 657
(2020) · doi:10.1109/icra40945.2020.9196885 · Cited by 633
“TABLE II: RMSE of state-of-the-art VIO pipelines (reported from [77] and [24]) compared to Kimera, on the EuRoC dataset.”
MethodResultInfluentialLvi-sam: Tightly-coupled lidar-visual-inertial odometry via smoothing and mapping
Shan, T., Englot, B., Ratti, C., & Rus, D. (2021) · 2021 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra48506.2021.9561996 · Cited by 624
“We adapt the processing pipeline from [7] for our VIS, which is shown in Figure 2.”
BackgroundMethodInfluentialTightly Coupled 3D Lidar Inertial Odometry and Mapping
Ye, H., Chen, Y., & Liu, M. (2019) · 2019 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2019.8793511 · Cited by 574
“Inspired by other visual-inertial works [10], [11], we design our method under tightly coupled lidar-IMU fusion.”
BackgroundMethodInfluentialCollaborative Multi-Robot Search and Rescue: Planning, Coordination, Perception, and Active Vision
Queralta, J. P., Taipalmaa, J., Can Pullinen, B., Sarker, V. K., Nguyen Gia, T., Tenhunen, H., Gabbouj, M., Raitoharju, J., & Westerlund, T. (2020) · IEEE Access · doi:10.1109/access.2020.3030190 · Cited by 526
“This is the case, for instance, of visual-inertial odometry with either monocular cameras [113], or multiple sensors [114].”
BackgroundThe TUM VI Benchmark for Evaluating Visual-Inertial Odometry
Schubert, D., Goll, T., Demmel, N., Usenko, V., Stuckler, J., & Cremers, D. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593419 · Cited by 473
“ROVIO is more prone to drift and diverges on several sequences, which might be explained by it’s use of a Kalman filter compared to computationally more demanding non-linear least squares optimization employed by OKVIS, VINS-Mono and BASALT.”
MethodInfluentialF-LOAM : Fast LiDAR Odometry and Mapping
Wang, H., Wang, C., Chen, C.-L., & Xie, L. (2021) · 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636655 · Cited by 416
“In additional, the visual SLAM such as VINS-MONO [29] is also compared.”
A Comprehensive Survey of Visual SLAM Algorithms
Macario Barros, A., Michel, M., Moline, Y., Corre, G., & Carrel, F. (2022) · Robotics · doi:10.3390/robotics11010024 · Cited by 429
“This is despite the fact that, since it only considers pose and velocity from the latest IMU states during the optimization process, this algorithm still demonstrated its suitability in embedded implementations [73].”
BackgroundD3VO: Deep Depth, Deep Pose and Deep Uncertainty for Monocular Visual Odometry
Yang, N., von Stumberg, L., Wang, R., & Cremers, D. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00136 · Cited by 438
“VIO methods [44, 56, 71, 72] dominate this benchmark by integrating IMU measurements to get a pose or motion prior and meanwhile estimating the absolute scale.”
BackgroundMethodEvents-To-Video: Bringing Modern Computer Vision to Event Cameras
Rebecq, H., Ranftl, R., Koltun, V., & Scaramuzza, D. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00398 · Cited by 420
“Here, we go one step further and directly apply an off-the-shelf VIO system (specifically, VINS-Mono [36], which is state-of-the-art [11]) to videos reconstructed from events using either our approach, MR, or HF, and evaluate against UltimateSLAM.”
BackgroundMethodInfluentialLin, J., & Zhang, F. (2022) · 2022 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra46639.2022.9811935 · Cited by 423
GVINS: Tightly Coupled GNSS–Visual–Inertial Fusion for Smooth and Consistent State Estimation
Cao, S., Lu, X., & Shen, S. (2022) · IEEE Transactions on Robotics · doi:10.1109/tro.2021.3133730 · Cited by 406
Self-citationA Benchmark Comparison of Monocular Visual-Inertial Odometry Algorithms for Flying Robots
Delmerico, J., & Scaramuzza, D. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460664 · Cited by 399
“• VINS-Mono [4] - a nonlinear-optimization-based sliding window estimator using pre-integrated IMU factors.”
MethodLINS: A Lidar-Inertial State Estimator for Robust and Efficient Navigation
Qin, C., Ye, H., Pranata, C. E., Han, J., Zhang, S., & Liu, M. (2020) · 2020 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra40945.2020.9197567 · Cited by 391
“Tightly-coupled approaches directly fuse lidar and inertial measurements through joint-optimization, which can be categorized into optimization based [16], [17] and extended Kalman filter (EKF) based [18], [15].”
BackgroundMethodVisual-Inertial Navigation: A Concise Review
Huang, G. (2019) · 2019 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2019.8793604 · Cited by 391
“Most have a two-thread system that optimizes a small window of “local” keyframes and features limiting drift in the short-term, while a background process optimizes a long-term sparse pose graph containing loopclosure constraints enforcing long-term consistency [31, 83, 99, 100].”
BackgroundMethodInfluentialA General Optimisation‐Based Framework for Global Pose Estimation With Multiple Sensors
Qin, T., Cao, S., Pan, J., & Shen, S. (2025) · IET Cyber-Systems and Robotics · doi:10.1049/csy2.70023 · Cited by 474
Self-citationFUEL: Fast UAV Exploration Using Incremental Frontier Structure and Hierarchical Planning
Zhou, B., Zhang, Y., Chen, X., & Shen, S. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3051563 · Cited by 351
“state estimation [36] and mapping modules [34] are also crucial to fullfil the real-world tasks.”
BackgroundMethodSelf-citationXiao, L., Wang, J., Qiu, X., Rong, Z., & Zou, X. (2019) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2019.03.012 · Cited by 348
A General Optimization-based Framework for Local Odometry Estimation with Multiple Sensors
Qin, T., Pan, J., Cao, S., & Shen, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.03638 · Cited by 279
“Hence, there are numerous research works fusing vision and IMU together, such as [6]–[12].”
BackgroundMethodInfluentialSelf-citationLDSO: Direct Sparse Odometry with Loop Closure
Gao, X., Wang, R., Demmel, N., & Cremers, D. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593376 · Cited by 327
PL-VIO: Tightly-Coupled Monocular Visual–Inertial Odometry Using Point and Line Features
He, Y., Zhao, J., Guo, Y., He, W., & Yuan, K. (2018) · Sensors · doi:10.3390/s18041159 · Cited by 330
“For quantitative evaluation, we compared our PL-VIO with three state-of-the-art monocular visual–inertial methods: ROVIO [17], OKVIS [18] in monocular mode, and VINS-Mono [32] without loop closure.”
MethodInfluentialContact-aided invariant extended Kalman filtering for robot state estimation
Hartley, R., Ghaffari, M., Eustice, R. M., & Grizzle, J. W. (2020) · The International Journal of Robotics Research · doi:10.1177/0278364919894385 · Cited by 321
“Section 12 itemizes additional sensor measurements that fit within the InEKF framework and describes the relation between the developed filter and landmark-based SLAM.”
MethodInfluentialA Review of Multi-Sensor Fusion SLAM Systems Based on 3D LIDAR
Xu, X., Zhang, L., Yang, J., Cao, C., Wang, W., Ran, Y., Tan, Z., & Luo, M. (2022) · Remote Sensing · doi:10.3390/rs14122835 · Cited by 302
RAPTOR: Robust and Perception-Aware Trajectory Replanning for Quadrotor Fast Flight
Zhou, B., Pan, J., Gao, F., & Shen, S. (2021) · IEEE Transactions on Robotics · doi:10.1109/tro.2021.3071527 · Cited by 308
Self-citationTowards High-Performance Solid-State-LiDAR-Inertial Odometry and Mapping
Li, K., Li, M., & Hanebeck, U. D. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3070251 · Cited by 289
“A dedicated introduction can be found in [22].”
BackgroundMethodR $^2$ LIVE: A Robust, Real-Time, LiDAR-Inertial-Visual Tightly-Coupled State Estimator and Mapping
Lin, J., Zheng, C., Xu, W., & Zhang, F. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3095515 · Cited by 293
M2DGR: A Multi-Sensor and Multi-Scenario SLAM Dataset for Ground Robots
Yin, J., Li, A., Li, T., Yu, W., & Zou, D. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3138527 · Cited by 299
“For example, ORB-SLAM3 [9] and VINS-Mono [7] integrate vision and IMU.”
BackgroundFactor graph optimization for GNSS/INS integration: A comparison with the extended Kalman filter
Wen, W., Pfeifer, T., Bai, X., & Hsu, L. (2021) · NAVIGATION · doi:10.1002/navi.421 · Cited by 259
“A team from Tsinghua University (Li et al., 2018) extended this line of research by studying TC GNSS-INS integration and obtained substantially better performance than that achieved with the EKF estimator.”
BackgroundMethodEfficient structure from motion for large-scale UAV images: A review and a comparison of SfM tools
Jiang, S., Jiang, C., & Jiang, W. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.04.016 · Cited by 286
Kimera: From SLAM to spatial perception with 3D dynamic scene graphs
Rosinol, A., Violette, A., Abate, M., Hughes, N., Chang, Y., Shi, J., Gupta, A., & Carlone, L. (2021) · The International Journal of Robotics Research · doi:10.1177/02783649211056674 · Cited by 271
“…OKVIS (Leutenegger et al. 2013), MSCKF (Mourikis and Roumeliotis 2007), ROVIO (Bloesch et al. 2015), VINSMono (Qin et al. 2018), and SVO-GTSAM (Forster et al. 2015) using the independently reported values in (Delmerico and Scaramuzza 2018) and the self-reported values in (Qin et al. 2018).”
MethodResultInfluentialDeep Drone Racing: From Simulation to Reality With Domain Randomization
Loquercio, A., Kaufmann, E., Ranftl, R., Dosovitskiy, A., Koltun, V., & Scaramuzza, D. (2020) · IEEE Transactions on Robotics · doi:10.1109/tro.2019.2942989 · Cited by 272
“Indeed, visual-inertial odometry (VIO) [4], [5] is subject to drift in”
BackgroundZhuang, Y., Sun, X., Li, Y., Huai, J., Hua, L., Yang, X., Cao, X., Zhang, P., Cao, Y., Qi, L., et al. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.01.025 · Cited by 262
MULLS: Versatile LiDAR SLAM via Multi-metric Linear Least Square
Pan, Y., Xiao, P., He, Y., Shao, Z., & Li, Z. (2021) · 2021 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra48506.2021.9561364 · Cited by 236
ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fields
Johari, M. M., Carta, C., & Fleuret, F. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01670 · Cited by 248
“Depending on the information source, visual SLAM divides into three main categories: visualonly [15–17, 41, 45, 66], visual-inertial [3, 28, 39, 42, 53, 69] and RGB-D [5, 14, 23, 44] SLAM.”
BackgroundFAST-LIVO: Fast and Tightly-coupled Sparse-Direct LiDAR-Inertial-Visual Odometry
Zheng, C., Zhu, Q., Xu, W., Liu, X., Guo, Q., & Zhang, F. (2022) · 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981107 · Cited by 242
“To address this issue, multi-sensor fusion [7]–[10] has drawn increasing recent attention to combine the advantages of different sensors and provide an effective pose estimation in sensor degraded environments, showing great potentials in robotic applications.”
BackgroundA review of visual SLAM methods for autonomous driving vehicles
Cheng, J., Zhang, L., Chen, Q., Hu, X., & Cai, J. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.104992 · Cited by 252
Schmuck, P., & Chli, M. (2019) · Journal of Field Robotics · doi:10.1002/rob.21854 · Cited by 253
“The last column shows the results of VINS‐mono (Qin et al., 2018), which allows estimating joint trajectories using its multisession functionality and sequentially running the datasets.”
MethodOnline Temporal Calibration for Monocular Visual-Inertial Systems
Qin, T., & Shen, S. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593603 · Cited by 231
Self-citationAslan, M. F., Durdu, A., Sabanci, K., Ropelewska, E., & Gültekin, S. S. (2022) · Applied Sciences · doi:10.3390/app12031047 · Cited by 233
“The methods used were multi-state constraint Kalman filter (MSCKF) [110], open keyframe-based visual-inertial SLAM (OKVIS) [111], robust visual-inertial odometry (ROVIO) [112], monocular visual-inertial system (VINS-Mono) [108], semi-direct visual odometry (SVO) [113] + multisensor fusion (MSF) [114], (SVO-MSF) [115]…”
Are We Ready for Autonomous Drone Racing? The UZH-FPV Drone Racing Dataset
Delmerico, J., Cieslewski, T., Rebecq, H., Faessler, M., & Scaramuzza, D. (2019) · 2019 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2019.8793887 · Cited by 235
“In this case, all of the algorithms (including Okvis [32] and VINSMono [31]) begin to drift on the second turn, and rapidly drift away from the ground truth trajectory.”
MethodAn integrated UGV-UAV system for construction site data collection
Asadi, K., Kalkunte Suresh, A., Ender, A., Gotad, S., Maniyar, S., Anand, S., Noghabaei, M., Han, K., Lobaton, E., & Wu, T. (2020) · Automation in Construction · doi:10.1016/j.autcon.2019.103068 · Cited by 232
Lic-fusion: Lidar-inertial-camera odometry
Zuo, X., Geneva, P., Lee, W., Liu, Y., & Huang, G. (2019) · 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8967746 · Cited by 222
“One popular solution is inertial navigation systems (INS) aided with a monocular camera, which has recently attracted significant attention [1], [2], [3], [4], [5], [6], in part because of their complimentary sensing modalities, low cost, and small size.”
BackgroundAn Overview on Visual SLAM: From Tradition to Semantic
Chen, W., Shang, G., Ji, A., Zhou, C., Wang, X., Xu, C., Li, Z., & Hu, K. (2022) · Remote Sensing · doi:10.3390/rs14133010 · Cited by 211
Super Odometry: IMU-centric LiDAR-Visual-Inertial Estimator for Challenging Environments
Zhao, S., Zhang, H., Wang, P., Nogueira, L., & Scherer, S. (2021) · 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9635862 · Cited by 200
“Therefore, we argue that both LiDAR-based [1]–[3], visual-based [4], [5] or LiDAR-visual-based [6], [7] SLAM methods are not the optimal choices in challenging environments.”
BackgroundMethodFAST-LIVO2: Fast, Direct LiDAR–Inertial–Visual Odometry
Zheng, C., Xu, W., Zou, Z., Hua, T., Yuan, C., He, D., Zhou, B., Liu, Z., Lin, J., Zhu, F., et al. (2025) · IEEE Transactions on Robotics · doi:10.1109/tro.2024.3502198 · Cited by 194
“Unlike feature-based methods [5], [6], [9], [10] which necessitate the Authorized licensed use limited to the terms of the applicable license agreement with IEEE.”
Raj, R., & Kos, A. (2022) · Applied Sciences · doi:10.3390/app12146951 · Cited by 186
NTU VIRAL: A visual-inertial-ranging-lidar dataset, from an aerial vehicle viewpoint
Nguyen, T.-M., Yuan, S., Cao, M., Lyu, Y., Nguyen, T. H., & Xie, L. (2022) · The International Journal of Robotics Research · doi:10.1177/02783649211052312 · Cited by 196
“We have test the calibration result using VINS-Mono, VINS-Fusion, OpenVINS, and we can obtain meaningful trajectories using the calibrated parameters.”
BackgroundMethodTeach-Repeat-Replan: A Complete and Robust System for Aggressive Flight in Complex Environments
Gao, F., Wang, L., Zhou, B., Zhou, X., Pan, J., & Shen, S. (2020) · IEEE Transactions on Robotics · doi:10.1109/tro.2020.2993215 · Cited by 188
“We use VINS [32], a robust visual-inertial odometry (VIO) framework, to localize the drone.”
MethodSelf-citationAre We Ready for Service Robots? The OpenLORIS-Scene Datasets for Lifelong SLAM
Shi, X., Li, D., Zhao, P., Tian, Q., Tian, Y., Long, Q., Zhu, C., Song, J., Qiao, F., Song, L., et al. (2020) · 2020 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra40945.2020.9196638 · Cited by 185
“Then ATE of each matched ORB_SLAM2 [16] (stereo fisheye) ORB_SLAM2 [16] (RGB-D) DS-SLAM [18] (RGB-D) DSO [17] (RGB) VINS-Mono [19] (RGB+IMU) VINS-Mono [19] (fisheye+IMU) InfiniTAMv2 [20] (RGB-D) ElasticFusion [ The percentage value on the top left of each scene is average Correct Rate (CR ε , φ as…”
BackgroundLi, J., Qin, H., Wang, J., & Li, J. (2022) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2021.3070508 · Cited by 181
“The simultaneous localization and mapping (SLAM) technology are the most up-to-date solutions for large-scale outdoor navigation [8], [9].”
BackgroundVILENS: Visual, Inertial, Lidar, and Leg Odometry for All-Terrain Legged Robots
Wisth, D., Camurri, M., & Fallon, M. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2022.3193788 · Cited by 178
“Outliers are rejected using a RANSAC-based fundamental matrix consistency check (similar to [43]).”
MethodBáča, T., Petrlík, M., Vrba, M., Spurný, V., Pěnička, R., Heřt, D., & Saska, M. (2021) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-021-01383-5 · Cited by 195
“, 3D visual and laser SLAMs [13], [14], which can be directly fused into the position and heading state of our filters.”
BackgroundSelective Sensor Fusion for Neural Visual-Inertial Odometry
Chen, C., Rosa, S., Miao, Y., Lu, C. X., Wu, W., Markham, A., & Trigoni, N. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01079 · Cited by 168
E-RAFT: Dense Optical Flow from Event Cameras
Gehrig, M., Millhausler, M., Gehrig, D., & Scaramuzza, D. (2021) · 2021 International Conference on 3D Vision (3DV) · doi:10.1109/3dv53792.2021.00030 · Cited by 168
“It serves as a fundamental building block for visual odometry [28] for robotics and AR/VR, autonomous driving [16], action recognition [31], high dynamic range (HDR) imaging [18], and computational videography [25].”
BackgroundDM-VIO: Delayed Marginalization Visual-Inertial Odometry
Stumberg, L. V., & Cremers, D. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3140129 · Cited by 171
Xu, H., Zhang, Y., Zhou, B., Wang, L., Yao, X., Meng, G., & Shen, S. (2022) · IEEE Transactions on Robotics · doi:10.1109/tro.2022.3182503 · Cited by 159
Self-citationDenoising IMU Gyroscopes with Deep Learning for Open-Loop Attitude Estimation
Brossard, M., Bonnabel, S., & Barrau, A. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.3003256 · Cited by 237
“We compare: VINS-Mono [7], a monocular VIO framework with notable performances on the EuRoC benchmark [28]; VINS-Mono (loop closure), which is the original VINSMono [7] reinforced with loop-closure ability; Open-VINS [6], a versatile filter-based visual-inertial estimator for which we choose the stereo configuration,…”
MethodUrbanLoco: A Full Sensor Suite Dataset for Mapping and Localization in Urban Scenes
Wen, W., Zhou, Y., Zhang, G., Fahandezh-Saadi, S., Bai, X., Zhan, W., Tomizuka, M., & Hsu, L.-T. (2020) · 2020 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra40945.2020.9196526 · Cited by 172
“Since VINS-MONO takes time for initialization, a rigid body transformation [28] was applied to the constructed map before evaluation.”
MethodInfluentialRobust Real-time UAV Replanning Using Guided Gradient-based Optimization and Topological Paths
Zhou, B., Gao, F., Pan, J., & Shen, S. (2020) · 2020 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra40945.2020.9196996 · Cited by 160
“The self-developed drone is localized by a robust visual-inertial state estimator [21].”
MethodSelf-citationGao, F., Wu, W., Gao, W., & Shen, S. (2019) · Journal of Field Robotics · doi:10.1002/rob.21842 · Cited by 165
Self-citationDXSLAM: A Robust and Efficient Visual SLAM System with Deep Features
Li, D., Shi, X., Long, Q., Liu, S., Yang, W., Wang, F., Wei, Q., & Qiao, F. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9340907 · Cited by 189
“[14], ORB-SLAM2 [15], VINS-Mono [16]) for their balanced effectiveness and efficiency.”
BackgroundAlphaPilot: Autonomous Drone Racing
Foehn, P., Brescianini, D., Kaufmann, E., Cieslewski, T., Gehrig, M., Muglikar, M., & Scaramuzza, D. (2020) · Autonomous Robots · doi:10.1007/s10514-021-10011-y · Cited by 203
AVP-SLAM: Semantic Visual Mapping and Localization for Autonomous Vehicles in the Parking Lot
Qin, T., Chen, T., Chen, Y., & Su, Q. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9340939 · Cited by 188
“Popular relative localization includes visual odometry [1, 2, 9]–[11], visual-inertial odometry [3]– [5, 12], Lidar odometry [6]–[8].”
BackgroundMethodSelf-citationKaufmann, E., Loquercio, A., Ranftl, R., Müller, M., Koltun, V., & Scaramuzza, D. (2020) · Robotics: Science and Systems · doi:10.15607/rss.2020.xvi.040 · Cited by 222
Decentralized Visual-Inertial-UWB Fusion for Relative State Estimation of Aerial Swarm
Xu, H., Wang, L., Zhang, Y., Qiu, K., & Shen, S. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9196944 · Cited by 185
“The tightly coupled VIO result 1https://github.com/pjrambo/VINS-Fusion-gpu is treated as one of the “measurements” to the second stage.”
BackgroundMethodInfluentialSelf-citationPerception and Navigation in Autonomous Systems in the Era of Learning: A Survey
Tang, Y. S., Zhao, C., Wang, J., Zhang, C., Sun, Q., Zheng, W. X., Du, W., Qian, F., & Kurths, J. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3167688 · Cited by 199
Stereo Vision-Based Semantic 3D Object and Ego-Motion Tracking for Autonomous Driving
Li, P., Qin, T., & Shen, S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01216-8_40 · Cited by 158
Self-citationStructVIO: Visual-Inertial Odometry With Structural Regularity of Man-Made Environments
Zou, D., Wu, Y., Pei, L., Ling, H., & Yu, W. (2019) · IEEE Transactions on Robotics · doi:10.1109/tro.2019.2915140 · Cited by 178
“However, most visual SLAM [1]–[3] or visual-inertial [4]–[6] systems prefer to use only point features.”
BackgroundMethodInfluentialVisual and Visual‐Inertial SLAM: State of the Art, Classification, and Experimental Benchmarking
Servières, M., Renaudin, V., Dupuis, A., & Antigny, N. (2021) · Journal of Sensors · doi:10.1155/2021/2054828 · Cited by 181
“Therefore, we added the results for Vins-Mono [74] and ORB-SLAM2 [76] without loop closure in Table 7.”
MethodInfluentialLi, X., Wang, X., Liao, J., Li, X., Li, S., & Lyu, H. (2021) · Satellite Navigation · doi:10.1186/s43020-020-00033-9 · Cited by 151
DynaVINS: A Visual-Inertial SLAM for Dynamic Environments
Song, S., Lim, H., Lee, A. J., & Myung, H. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3203231 · Cited by 184
“In the meanwhile, visual-inertial SLAM (VI-SLAM) frameworks [2], [3], [4], [5], [6] have been proposed by integrating an inertial measurement unit (IMU) into the visual SLAM.”
BackgroundMethodInfluentialAgilicious: Open-source and open-hardware agile quadrotor for vision-based flight
Foehn, P., Kaufmann, E., Romero, Á., Pěnička, R., Sun, S., Bauersfeld, L., Laengle, T., Cioffi, G., Song, Y., Loquercio, A., et al. (2022) · Science Robotics · doi:10.1126/scirobotics.abl6259 · Cited by 237
ICE-BA: Incremental, Consistent and Efficient Bundle Adjustment for Visual-Inertial SLAM
Liu, H., Chen, M., Zhang, G., Bao, H., & Bao, Y. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00211 · Cited by 170
“Previous methods either skip marginalization [26], or apply marginalization without resolving the conflict [28].”
BackgroundMethodAutonomous Drone Racing: A Survey
Hanover, D., Loquercio, A., Bauersfeld, L., Romero, Á., Pěnička, R., Song, Y., Cioffi, G., Kaufmann, E., & Scaramuzza, D. (2024) · IEEE Transactions on Robotics · doi:10.1109/tro.2024.3400838 · Cited by 232
“In [62], the authors propose VIMO which is a VIO algorithm that includes error terms on the drone transitional dynamics in a fixed-lag smoother-based backend [55].”
BackgroundMethodZubizarreta, J., Aguinaga, I., & Montiel, J. M. M. (2020) · IEEE Transactions on Robotics · doi:10.1109/tro.2020.2991614 · Cited by 145
“VINS-mono [11] uses a similar front-end to OKVIS but includes additional BRIEF features to perform loop closure.”
MethodDeep Learning for Inertial Positioning: A Survey
Chen, C., & Pan, X. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3381161 · Cited by 184
“When this learned inertial calibration model is incorporated into a visual-inertial odometry (VIO), it further improves localization performance and outperforms representative VIOs such as VINS-mono [9].”
BackgroundMethodGNSS/INS/LiDAR-SLAM Integrated Navigation System Based on Graph Optimization
Chang, L., Niu, X., Liu, T., Tang, J., & Qian, C. (2019) · Remote Sensing · doi:10.3390/rs11091009 · Cited by 150
“In the back-end, the GNSS position provides the absolute position constraint, while the IMU preintegration [9,23] is applied to increase the motion constraints, and the LiDAR-SLAM scan matching provides the relative pose constraints.”
BackgroundMethodInfluentialLi, T., Zhang, H., Gao, Z., Niu, X., & El‐Sheimy, N. (2019) · Remote Sensing · doi:10.3390/rs11060610 · Cited by 150
AQUALOC: An underwater dataset for visual–inertial–pressure localization
Ferrera, M., Creuze, V., Moras, J., & Trouvé-Peloux, P. (2019) · The International Journal of Robotics Research · doi:10.1177/0278364919883346 · Cited by 164
“Recent algorithms, relying on monocular cameras (Mur-Artal et al. (2015); Forster et al. (2017); Engel et al. (2018)) or on visual-inertial sensors (Leutenegger et al. (2015); MurArtal and Tardos (2017); Qin et al. (2018)), have shown impressive results, with centimetric localization accuracy.”
BackgroundMethodCheng, Y., Jiang, M., Zhu, J., & Liu, Y. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3067271 · Cited by 161
“[27] T. Qin, P. Li, and S. Shen, “VINS-MONO: A robust and versatile monocular visual-inertial state estimator,” IEEE Trans.”
MethodCVI-SLAM—Collaborative Visual-Inertial SLAM
Karrer, M., Schmuck, P., & Chli, M. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2837226 · Cited by 162
“In this work, we employ the strategy proposed in [6], which performs the initialization in three steps.”
MethodResultGuerra, W., Tal, E. A., Murali, V., Ryou, G., & Karaman, S. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8968116 · Cited by 187
“with the other team using a smoothing based technique [33]. The teams that chose to use a visual inertial odometry algorithm opted to use off-the-shelf solutions such as ROVIO [34], [35] or VINS-Mono [36] for state estimation. Planning: The most common methods used for planning involved visual servo using infrared bea…”
MethodLiDAR odometry survey: recent advancements and remaining challenges
Lee, D., Jung, M., Yang, W., & Kim, A. (2024) · Intelligent Service Robotics · doi:10.1007/s11370-024-00515-8 · Cited by 196
“Conversely, Jeon et al. [59] presented a survey specifically tailored for unmanned aerial vehicles (UAV), focusing on the performance of visual odometry algorithms when implemented on NVIDIA Jet-son platforms.”
Event-based Video Reconstruction Using Transformer
Weng, W., Zhang, Y., & Xiong, Z. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00256 · Cited by 180
“cn advantages of event cameras, an intuitive way is to convert event streams to video composed of sequential intensity frames, which serves as a bridge that connects the off-theshelf frame-based algorithms [12, 13, 11, 26, 42, 41, 44, 43] to event cameras.”
BackgroundRobust Odometry and Mapping for Multi-LiDAR Systems With Online Extrinsic Calibration
Jiao, J., Ye, H., Zhu, Y., & Liu, M. (2021) · IEEE Transactions on Robotics · doi:10.1109/tro.2021.3078287 · Cited by 171
Stereo Visual Inertial LiDAR Simultaneous Localization and Mapping
Shao, W., Vijayarangan, S., Li, C., & Kantor, G. A. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8968012 · Cited by 155
“Secondly, a more thoughtful marginalization that separates recent frame and keyframe could be implemented as in [29, 40].”
BackgroundInfluentialVision-based integrated mobile robotic system for real-time applications in construction
Asadi, K., Ramshankar, H., Pullagurla, H., Bhandare, A., Shanbhag, S., Mehta, P., Kundu, S., Han, K. K., Lobaton, E. J., & Wu, T. (2018) · Automation in Construction · doi:10.1016/j.autcon.2018.10.009 · Cited by 137
Survey and evaluation of monocular visual-inertial SLAM algorithms for augmented reality
Li, J., Yang, B., Danpeng, C., Wang, N., Guofeng, Z., & Bao, H. (2019) · Virtual Reality & Intelligent Hardware · doi:10.1016/j.vrih.2019.07.002 · Cited by 151
“VINS-Mono [37] is a robust visual-inertial SLAM system.”
BackgroundCamVox: A Low-cost and Accurate Lidar-assisted Visual SLAM System
Zhu, Y., Zheng, C., Yuan, C., Huang, X., & Hong, X. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561149 · Cited by 136
“Qin et al. proposed Visual-Inertial Monocular SLAM (VINS) [2], which is an excellent camera and IMU fusion system.”
BackgroundMethodInfluentialLOCUS: A Multi-Sensor Lidar-Centric Solution for High-Precision Odometry and 3D Mapping in Real-Time
Palieri, M., Morrell, B., Thakur, A., Ebadi, K., Nash, J., Chatterjee, A., Kanellakis, C., Carlone, L., Guaragnella, C., & Agha–mohammadi, A. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.3044864 · Cited by 168
“LIO-Mapping is a more recent LIO algorithm that combines the IMU pre-integration approach from VINSMono [28] with LOAM-type feature alignment.”
MethodRange-Focused Fusion of Camera-IMU-UWB for Accurate and Drift-Reduced Localization
Nguyen, T. H., Nguyen, T., & Xie, L. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3057838 · Cited by 137
“Due to length constraints, for the visual-inertial components interested readers are directed to VINS-Mono [1] for more details.”
BackgroundMethodInfluentialJarraya, I., Al-Batati, A. S., Kadri, M. B., Abdelkader, M., Ammar, A., Boulila, W., & Koubâa, A. (2025) · Satellite Navigation · doi:10.1186/s43020-025-00162-z · Cited by 133
“VINS-Mono, and its successor VINS-Fusion, are typically suited for indoor environments, where they excel in scenarios with rich visual features and controlled conditions.”
Influential
Metadata
- Authors
- Qin, T., Li, P., & Shen, S.
- Affiliations
- Hong Kong University of Science and Technology (HK)
- Venue
- IEEE Transactions on Robotics
- Published
- 2018-08
- Volume
- 34
- Issue
- 4
- Pages
- 1004-1020
- ISSN
- 1552-3098 (ISSN-L)
- 1941-0468
- OpenAlex
- W2745859992
- Cited by
- 4,669
- References
- 53
- Citations by year
- 2026: 575 · 2025: 856 · 2024: 789 · 2023: 729 · 2022: 571 · 2021: 469 · 2020: 357 · 2019: 248 · 2018: 73
- FWCI
- 233.33
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- IEEE Transactions on Robotics (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Hong Kong Research Grants Council Early Career Scheme (26201616)
- HKUST Proof-of-Concept (PCF.009.16/17)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
- Physical Sciences › Engineering › Aerospace Engineering › Inertial Sensor and Navigation
- Physical Sciences › Engineering › Aerospace Engineering › Aerospace Engineering and Control Systems
- Keywords
- loop detection, relocalization, pose graph optimization, autonomous flight
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.