VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator
Open accessThe DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Abstract
One camera and one low-cost inertial measurement unit (IMU) form a monocular visual-inertial system (VINS), which is the minimum sensor suite (in size, weight, and power) for the metric six degrees-of-freedom (DOF) state estimation. In this paper, we present VINS-Mono: a robust and versatile monocular visual-inertial state estimator. Our approach starts with a robust procedure for estimator initialization. A tightly coupled, nonlinear optimization-based method is used to obtain highly accurate visual-inertial odometry by fusing preintegrated IMU measurements and feature observations. A loop detection module, in combination with our tightly coupled formulation, enables relocalization with minimum computation. We additionally perform 4-DOF pose graph optimization to enforce the global consistency. Furthermore, the proposed system can reuse a map by saving and loading it in an efficient way. The current and previous maps can be merged together by the global pose graph optimization. We validate the performance of our system on public datasets and real-world experiments and compare against other state-of-the-art algorithms. We also perform an onboard closed-loop autonomous flight on the microaerial-vehicle platform and port the algorithm to an iOS-based demonstration. We highlight that the proposed work is a reliable, complete, and versatile system that is applicable for different applications that require high accuracy in localization. We open source our implementations for both PCs (https://github.com/HKUST-Aerial-Robotics/VINS-Mono) and iOS mobile devices (https://github.com/HKUST-Aerial-Robotics/VINS-Mobile).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In terms of vision-IMU-GPS fusion, VINS-Fusion has become a mainstream solution for large-scale, high-precision localization and is widely used in UAVs and mobile robots.”
From Multimodal fusion and vision–language models: A survey for robot vision (2026) · cites this paper as [151]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multiple View Geometry in Computer Vision
Hartley, R., & Zisserman, A. (2004) · doi:10.1017/cbo9780511811685 · Cited by 21,070
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897 · cited 3×
“Relative pose error [42] in MH_05_difficult.”
MethodInfluential(1981) · Cited by 11,963
Shi, J., & Tomasi (1994) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition CVPR-94 · doi:10.1109/cvpr.1994.323794 · Cited by 7,724 · cited 1×
“features are detected [32] to maintain a minimum number (100– 300) of features in each image.”
BackgroundRobust estimation of a location parameter
Huber, P. J. (1964) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177703732 · Cited by 7,228
ORB-SLAM: A Versatile and Accurate Monocular SLAM System
Mur-Artal, R., Montiel, J. M. M., & Tardos, J. D. (2015) · IEEE Transactions on Robotics · doi:10.1109/tro.2015.2463671 · Cited by 6,778 · cited 7×
“ORB-SLAM [4] is able to close loops and reuse the map, which takes advantage of Bag-of-World [6].”
BackgroundMethodInfluentialParallel Tracking and Mapping for Small AR Workspaces
Klein, G., & Murray, D. (2007) · 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2007.4538852 · Cited by 4,346
Bundle Adjustment — A Modern Synthesis
Triggs, B., McLauchlan, P. F., Hartley, R. I., & Fitzgibbon, A. W. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-44480-7_21 · Cited by 3,988 · cited 1×
“Finally, a global full bundle adjustment [36] is applied to minimize the total reprojection error of all feature observations.”
MethodA benchmark for the evaluation of RGB-D SLAM systems
Sturm, J., Engelhard, N., Endres, F., Burgard, W., & Cremers, D. (2012) · 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2012.6385773 · Cited by 3,976 · cited 3×
“TABLE I RMSE [43] IN EUROC DATASETS IN METERS”
BackgroundMethodInfluentialLSD-SLAM: Large-scale direct monocular SLAM
Engel, J., Schöps, T., & Cremers, D. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10605-2_54 · Cited by 3,851 · cited 3×
“Noticeable approaches include PTAM [1], SVO [2], LSD-SLAM [3], DSO [5], and ORB-SLAM [4].”
BackgroundMethod
Cited by
Items 101–200 of 1,001
A Light-Weight Semantic Map for Visual Localization towards Autonomous Driving
Qin, T., Zheng, Y., Chen, T., Chen, Y., & Su, Q. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561663 · Cited by 160
“Among these methods, corner feature points are used in [1, 4, 7, 8, 10].”
MethodSelf-citationCamera, LiDAR, and IMU Based Multi-Sensor Fusion SLAM: A Survey
Zhu, J., Li, H., & Zhang, T. (2023) · Tsinghua Science & Technology · doi:10.26599/tst.2023.9010010 · Cited by 163
Chen, C., Zhu, H. J., Li, M., & You, S. (2018) · Robotics · doi:10.3390/robotics7030045 · Cited by 146
Asadi, K., Ramshankar, H., Noghabaei, M., & Han, K. K. (2019) · Journal of Computing in Civil Engineering · doi:10.1061/(asce)cp.1943-5487.0000847 · Cited by 142
SVIn2: An Underwater SLAM System using Sonar, Visual, Inertial, and Depth Sensor
Rahman, S., Li, A. Q., & Rekleitis, I. M. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8967703 · Cited by 170
“6-9 show the trajectories from SVIn2, OKVIS, and VINS-Mono in the datasets just described.”
BackgroundMethodInfluentialMVDepthNet: Real-Time Multiview Depth Estimation Neural Network
Wang, K., & Shen, S. (2018) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2018.00037 · Cited by 157
Self-citationChen, C., Wang, B., Lu, C. X., Trigoni, N., & Markham, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.12567 · Cited by 207
“…algorithms being developed, for example, odometry estimation (including visual odometry [9], [10], [11], visual-inertial odometry [12], [13], [14], [15] and LIDAR odometry [16]), image-based localization [17], [18], place recognition [19], SLAM [10], [20], [21], and structure from motion (SfM)…”
BackgroundMethodSimultaneous Localization and Mapping (SLAM) for Autonomous Driving: Concept and Analysis
Zheng, S., Wang, J., Rizos, C., Ding, W., & El‐Mowafy, A. (2023) · Remote Sensing · doi:10.3390/rs15041156 · Cited by 160
“With an IMU, the attitudes, especially the heading, are observable [108].”
BackgroundA review of monocular visual odometry
He, M., Zhu, C., Huang, Q., Ren, B., & Liu, J. (2019) · The Visual Computer · doi:10.1007/s00371-019-01714-6 · Cited by 140
A Survey of FPGA-Based Robotic Computing
Wan, Z., Bo, Y., Li, T. Y., Tang, J., Zhu, Y., Wang, Y., Raychowdhury, A., & Liu, S. (2021) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2021.3071609 · Cited by 151
“Our localization module is based on Visual Inertial Odometry algorithms [171], [172], which fuses camera images, IMU and GPS samples to estimate the vehicle pose in the global map.”
MethodRecent developments and applications of simultaneous localization and mapping in agriculture
Ding, H., Zhang, B., Zhou, J. C., Yan, Y., Tian, G., & Gu, B. (2022) · Journal of Field Robotics · doi:10.1002/rob.22077 · Cited by 146
“T. Qin et al. (2018) presented a tightly coupled, nonlinear optimization‐based monocular visual‐inertial state estimator (VINS‐ Mono).”
BackgroundSTD: Stable Triangle Descriptor for 3D place recognition
Yuan, C., Lin, J., Zou, Z., Hong, X., & Zhang, F. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160413 · Cited by 176
Han, L., Lin, Y., Du, G., & Lian, S. (2019) · 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8968467 · Cited by 125
“In particular, the errors with traditional VINS are extremely worse than us.”
BackgroundMethodInfluentialIC-GVINS: A Robust, Real-Time, INS-Centric GNSS-Visual-Inertial Navigation System
Niu, X., Tang, H., Zhang, T., Fan, J. F., & Liu, J. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3224367 · Cited by 144
“VINS-Mono [6] adopts a sliding-window optimizer to achieve pose estimation, but their estimator relies more on high-frequency visual observations.”
BackgroundMethodInfluentialAdvances in intelligent and autonomous navigation systems for small UAS
Bijjahalli, S., Sabatini, R., & Gardi, A. (2020) · Progress in Aerospace Sciences · doi:10.1016/j.paerosci.2020.100617 · Cited by 123
An EKF Based Approach to Radar Inertial Odometry
Doer, C., & Trommer, G. F. (2020) · IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI) · doi:10.1109/mfi49285.2020.9235254 · Cited by 133
SGS-SLAM: Semantic Gaussian Splatting for Neural Dense SLAM
Li, M., Liu, S., Zhou, H., Zhu, G., Cheng, N., Deng, T., & Wang, H. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72751-1_10 · Cited by 236
“Semantic information is of great importance for SLAM systems [12, 27, 30, 38], which is a crucial requirement for applications in robotics and VR or AR fields.”
BackgroundAn Efficient B-Spline-Based Kinodynamic Replanning Framework for Quadrotors
Ding, W., Gao, W., Wang, K., & Shen, S. (2019) · IEEE Transactions on Robotics · doi:10.1109/tro.2019.2926390 · Cited by 141
“localization module is based on our Monocular Visual Inertial Navigation System (VINS-Mono) [44], and the mapping module is based on our monocular dense mapping method [45] and”
MethodSelf-citationSelfVIO: Self-supervised deep monocular Visual–Inertial Odometry and depth estimation
Almalıoğlu, Y., Turan, M., Saputra, M. R. U., de Gusmão, P. P. B., Markham, A., & Trigoni, N. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.03.005 · Cited by 148
UV-SLAM: Unconstrained Line-Based SLAM Using Vanishing Points for Structural Mapping
Lim, H., Jeon, J., & Myung, H. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3140816 · Cited by 134
Dynam-SLAM: An Accurate, Robust Stereo Visual-Inertial SLAM Method in Dynamic Environments
Yin, H., Li, S., Tao, Y., Guo, J., & Huang, B. (2022) · IEEE Transactions on Robotics · doi:10.1109/tro.2022.3199087 · Cited by 130
“Besides the VISLAM methods evaluated in Table II, we also test the related stereo VSLAM methods, including ORB-SLAM2 with stereo configuration (ORB2-Stereo) [11], VINS-Fusion with stereo configuration (VINS-Stereo) [14], and ORB-SLAM3 with stereo configuration (ORB3-Stereo) [55] in this experiment.”
BackgroundMethodInfluentialBoW3D: Bag of Words for Real-Time Loop Closing in 3D LiDAR SLAM
Cui, Y., Chen, X., Zhang, Y., Dong, J., Wu, Q., & Zhu, F. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3221336 · Cited by 140
“In the field of visual SLAM, many algorithms [1], [2], [3], [4], [5], [6], [7], [8] use image retrieval techniques.”
MethodIDOL: Inertial Deep Orientation-Estimation and Localization
Sun, S., Melamed, D., & Kitani, K. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i7.16763 · Cited by 113
Vision-Based Autonomous Landing for the UAV: A Review
Xin, L., Tang, Z., Gai, W., & Liu, H. (2022) · Aerospace · doi:10.3390/aerospace9110634 · Cited by 125
“Shen Shaoxie researched the fusion strategy of aircraft V-SLAM and IMU, and proposed the VINS-Mono algorithm and the MVDepthNet algorithm for monocular depth estimation [50,51], which can overcome the inherent characteristics and disadvantages of monocular V-SLAM.”
BackgroundA Review of Small UAV Navigation System Based on Multisource Sensor Fusion
Ye, X., Song, F., Zhang, Z., & Qing-hua, Z. (2023) · IEEE Sensors Journal · doi:10.1109/jsen.2023.3292427 · Cited by 132
“optimization (FGO) [7], [8] [9], [10], [11].”
Visual SLAM Integration With Semantic Segmentation and Deep Learning: A Review
Pu, H., Luo, J., Wang, G., Huang, T., Liu, H., & Luo, J. (2023) · IEEE Sensors Journal · doi:10.1109/jsen.2023.3306371 · Cited by 132
“There are currently several combinations of camera and IMU, such as Vins-mono [28], DM-VIO [29], SelfVIO [146], and external memory attention (EMA)-VIO [147], all of which involve both a camera and an IMU.”
BackgroundMethodWearable Travel Aid for Environment Perception and Navigation of Visually Impaired People
Bai, J., Liu, Z., Lin, Y., Li, Y., Lian, S., & Liu, D. (2019) · Electronics · doi:10.3390/electronics8060697 · Cited by 135
NeuroSLAM: a brain-inspired SLAM system for 3D environments
Yu, F., Shang, J., Hu, Y., & Milford, M. J. (2019) · Biological Cybernetics · doi:10.1007/s00422-019-00806-9 · Cited by 131
Joshi, B., Rahman, S., Kalaitzakis, M., Cain, B., Johnson, J. V., Xanthidis, M., Karapetyan, N., Hernandez, A., Li, A. Q., Vitzilaios, N. I., et al. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8968049 · Cited by 133
“Experiments with a custom-made sensor suite validated the proposed approach. j) VINS-Mono: VINS-Mono [30] estimates the state of a robot equipped with an IMU and monocular camera.”
BackgroundMethodInfluentialOV$^{2}$SLAM: A Fully Online and Versatile Visual SLAM for Real-Time Applications
Ferrera, M., Eudes, A., Moras, J., Sanfourche, M., & Besnerais, G. L. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3058069 · Cited by 132
Impact of the Earth Rotation Compensation on MEMS-IMU Preintegration of Factor Graph Optimization
Tang, H., Zhang, T., Niu, X., Fan, J. F., & Liu, J. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3192552 · Cited by 113
“The noise covariance strongly influences the MAP estimator because the inverse noise covariance (information matrix) is used to weight the factor in the FGO [18], [23].”
EPSILON: An Efficient Planning System for Automated Vehicles in Highly Interactive Environments
Ding, W., Zhang, L., Chen, J., & Shen, S. (2021) · IEEE Transactions on Robotics · doi:10.1109/tro.2021.3104254 · Cited by 141
Self-citationSVIn2: A multi-sensor fusion-based underwater SLAM system
Rahman, S., Li, A. Q., & Rekleitis, I. M. (2022) · The International Journal of Robotics Research · doi:10.1177/02783649221110259 · Cited by 143
“Vision is often combined with inertial measurements for improved accuracy and robustness in pose estimation, termed VisualInertial Odometry (VIO) or Visual-Inertial SLAM (VISLAM) (Leutenegger et al., 2015; Mourikis and Roumeliotis, 2007; Mur-Artal and Tardós, 2017; Qin et al., 2018; Sun et al., 2018).”
BackgroundMethodInfluentialCOVINS: Visual-Inertial SLAM for Centralized Collaboration
Schmuck, P., Ziegler, T., Karrer, M., Perraudin, J., & Chli, M. (2021) · IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) · doi:10.1109/ismar-adjunct54149.2021.00043 · Cited by 118
EVDodgeNet: Deep Dynamic Obstacle Dodging with Event Cameras
Sanket, N. J., Parameshwara, C. M., Singh, C. D., Kuruttukulam, A. V., Fermuller, C. M., Scaramuzza, D., & Aloimonos, Y. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9196877 · Cited by 119
“γ = ±[0, 5] γ = ±[6, 10] γ = ±[11, 15] γ = ±[16, 20] γ = ±[21, 25] γ = ±[0, 5] γ = ±[6, 10] γ = ±[11, 15] γ = ±[16, 20] γ = ±[21, 25]”
BackgroundVIRAL-Fusion: A Visual-Inertial-Ranging-Lidar Sensor Fusion Approach
Nguyen, T., Cao, M., Yuan, S., Lyu, Y., Nguyen, T. H., & Xie, L. (2021) · IEEE Transactions on Robotics · doi:10.1109/tro.2021.3094157 · Cited by 124
RGB-D Inertial Odometry for a Resource-Restricted Robot in Dynamic Environments
Liu, J., Li, X., Liu, Y., & Chen, H. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3191193 · Cited by 124
“The proposed SLAM system in this paper is extended based on VINS-Mono [2] and VINS-RGBD [25]; our framework is shown in Fig.”
Review of Navigation Methods for UAV-Based Parcel Delivery
Dissanayaka, D., Wanasinghe, T. R., Silva, O. D., Jayasiri, A., & Mann, G. K. I. (2023) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2022.3232025 · Cited by 133
“The most common vision-based navigation system is visual-inertial navigation, where vision sensors and IMU are integrated [26], [78], [79], [80], [81], [82], [83].”
BackgroundState of the Art in Vision-Based Localization Techniques for Autonomous Navigation Systems
Alkendi, Y., Seneviratne, L. D., & Zweiri, Y. (2021) · IEEE Access · doi:10.1109/access.2021.3082778 · Cited by 125
“In addition, Qin et al. [155] have proposed an optimization-based VIO approach using a monocular camera incorporating loop closure modules that ran concurrently in multithread mode to ensure reliability and to guarantee real-time operation.”
MethodPronto: A Multi-Sensor State Estimator for Legged Robots in Real-World Scenarios
Camurri, M., Ramezani, M., Nobili, S., & Fallon, M. F. (2020) · Frontiers in Robotics and AI · doi:10.3389/frobt.2020.00068 · Cited by 137
“This would allow the use of other VO algorithms, such as ORB-SLAM (Mur-Artal et al., 2015), SVO (Forster et al., 2017b), or VINS-Mono (Qin et al., 2018), to name a few.”
MethodMultimodal fusion and vision–language models: A survey for robot vision
Han, X., Chen, S., Fu, Z., Feng, Z., Fan, L., An, D., Wang, C., Guo, L., Meng, W., Zhang, X., et al. (2026) · Information Fusion · doi:10.1016/j.inffus.2025.103652 · Cited by 105
“Modality V-LOAM [150] LiDAR + RGB LVI-SAM [157] LiDAR + RGB LIC-Fusion [18] LiDAR + RGB + IMU LIC-Fusion 2.0 [152] LiDAR + RGB + IMU VINS-Fusion [158] RGB + IMU + GPS UVIO [153] RGB + IMU RD-VIO [6] Radar + RGB + IMU MM3DGS SLAM [154] RGB + IMU + Depth ConceptFusion [155] RGB + Audio Co-SLAM [156]…”
InfluentialDVL-SLAM: sparse depth enhanced direct visual-LiDAR SLAM
Shin, Y.-S., Park, Y. S., & Kim, A. (2019) · Autonomous Robots · doi:10.1007/s10514-019-09881-0 · Cited by 120
VECtor: A Versatile Event-Centric Benchmark for Multi-Sensor SLAM
Gao, L., Liang, Y., Yang, J., Wu, S., Wang, C., Chen, J., & Kneip, L. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3186770 · Cited by 135
“3) Validation on state-of-the-art algorithms: We validated our data sequences by applying ORB-SLAM3 [27] with regular stereo setting, ORB-SLAM3 with RGB-D setting, VINS-mono [28] with monocular-inertial setting, VINS-fusion with stereo-inertial setting, and LIO-SAM [29] with LiDAR-inertial setting.”
Milestones in Autonomous Driving and Intelligent Vehicles—Part II: Perception and Planning
Chen, L. F., Teng, S., Li, B., Na, X., Li, Y., Li, Z., Wang, J., Cao, D., Zheng, N., & Wang, F. (2023) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2023.3283021 · Cited by 122
Closed-form preintegration methods for graph-based visual–inertial navigation
Eckenhoff, K., Geneva, P., & Huang, G. P. (2019) · The International Journal of Robotics Research · doi:10.1177/0278364919835021 · Cited by 118
OriNet: Robust 3-D Orientation Estimation With a Single Particular IMU
Esfahani, M. A., Wang, H., Wu, K., & Yuan, S. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2959507 · Cited by 105
“As shown in Table V, the proposed method has achieved the least quaternion distance compared to others, and it beats the VINS-MONO by approximately 28%.”
InfluentialCollaborative visual SLAM for multiple agents:A brief survey
Zou, D., Tan, P., & Yu, W. (2019) · Virtual Reality & Intelligent Hardware · doi:10.1016/j.vrih.2019.09.002 · Cited by 99
Voxgraph: Globally Consistent, Volumetric Mapping Using Signed Distance Function Submaps
Reijgwart, V., Millane, A., Oleynikova, H., Siegwart, R., Cadena, C., & Nieto, J. I. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2953859 · Cited by 131
“In particular, we compare against LOAM [34] (LiDAR) and VINS-MONO [5] (visualinertial).”
BackgroundMethodGR-LOAM: LiDAR-based sensor fusion SLAM for ground robots on complex terrain
Su, Y., Wang, T., Shao, S., Yao, C., & Wang, Z. (2021) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2021.103759 · Cited by 109
MIMC-VINS: A Versatile and Resilient Multi-IMU Multi-Camera Visual-Inertial Navigation System
Eckenhoff, K., Geneva, P., & Huang, G. P. (2021) · IEEE Transactions on Robotics · doi:10.1109/tro.2021.3049445 · Cited by 114
Deep Learning for Visual Localization and Mapping: A Survey
Chen, C., Wang, B., Lu, C. X., Trigoni, N., & Markham, A. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3309809 · Cited by 97
“The problem of localization and mapping has been studied for decades, with a range of algorithms and systems being developed, for example, visual odometry (VO) [2], visual-inertial odometry (VIO) [3], image-based relocalization [4], place recognition [5], and SLAM [6].”
Cioffi, G., & Scaramuzza, D. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341697 · Cited by 118
“The inertial residuals ei are formulated using the IMU preintegration algorithm as proposed in [7], [17].”
InfluentialHong Kong UrbanNav: An Open-Source Multisensory Dataset for Benchmarking Urban Navigation Algorithms
Hsu, L., Huang, F., Ng, H., Zhang, G., Zhong, Y., Bai, X., & Wen, W. (2023) · NAVIGATION Journal of the Institute of Navigation · doi:10.33012/navi.602 · Cited by 125
Deep Neural Network Based Inertial Odometry Using Low-Cost Inertial Measurement Units
Chen, C., Lu, C. X., Wahlström, J., Markham, A., & Trigoni, N. (2019) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2019.2960780 · Cited by 106
“The effective fusion of inertial sensors and cameras can be achieved via extended kalman filtering (EKF) [13], or graph optimization [14], [15], [16], where the raw visual and inertial”
MethodDeepVideoMVS: Multi-View Stereo on Video with Recurrent Spatio-Temporal Fusion
Düzçeker, A., Galliani, S., Vogel, C., Speciale, P., Dusmanu, M., & Pollefeys, M. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01507 · Cited by 124
“Such pose information can, for instance, be obtained through visual-inertial odometry techniques [5, 37], which are readily available in mobile platforms (e.”
Run Your Visual-Inertial Odometry on NVIDIA Jetson: Benchmark Tests on a Micro Aerial Vehicle
Jeon, J., Jung, S., Lee, E. M., Choi, D., & Myung, H. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3075141 · Cited by 107
“We test three mono-VIO (VINS-Mono [16], ROVIO [17], and ALVIO [18]), two stereoVO (ORB-SLAM2 stereo [19] and VINS-Fusion w/o IMU [20]), and four stereo-VIO (VINS-Fusion w/ IMU [20], VINS-Fusion w/ GPU [21], Stereo-MSCKF [22], and Kimera [23]) algorithms and benchmark them on NVIDIA Jetson TX2, Xavier NX, and AGX Xavie…”
Vision-assisted BIM reconstruction from 3D LiDAR point clouds for MEP scenes
Wang, B., Wang, Q., Cheng, J. C. P., Song, C., & Yin, C. (2021) · Automation in Construction · doi:10.1016/j.autcon.2021.103997 · Cited by 116
Edge-SLAM: Edge-Assisted Visual Simultaneous Localization and Mapping
Ali, A. J. B., Kouroshli, M., Semenova, S., Hashemifar, Z. S., Ko, S. Y., & Dantu, K. (2022) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3561972 · Cited by 116
“For example, to apply Edge-SLAM architecture to VINS-Mono [54], we can map VINS’s Measurement Preprocessing and Initialization module to Edge-SLAM’s Tracking module on the mobile device.”
MethodSNI-SLAM: Semantic Neural Implicit SLAM
Zhu, S., Wang, G., Blum, H., Liu, J., Song, L., Pollefeys, M., & Wang, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02000 · Cited by 173
“Visual odometry [2, 6, 7, 25, 32] and real-time dense mapping [5, 9, 12, 33, 44] are capable of localization and scene reconstruction.”
BackgroundRGBD-Inertial Trajectory Estimation and Mapping for Ground Robots
Shan, Z., Li, R., & Schwertfeger, S. (2019) · Sensors · doi:10.3390/s19102251 · Cited by 108
“This significantly limits its application and thus many open source VIO or SLAM systems [15,17] only make use of the integrated fisheye camera and IMU sensor.”
BackgroundMethodInfluentialGNSS/IMU/ODO/LiDAR-SLAM Integrated Navigation System Using IMU/ODO Pre-Integration
Chang, L., Niu, X., & Liu, T. (2020) · Sensors · doi:10.3390/s20174702 · Cited by 103
PLF-VINS: Real-Time Monocular Visual-Inertial SLAM With Point-Line Fusion and Parallel-Line Fusion
Lee, J., & Park, S.-Y. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3095518 · Cited by 103
“It also provides comparison data for the latest algorithms (S-MSCKF [22], [30], [31], ROVIO [19], [20], OKVIS [21], VINS-mono [1], and PL-VINS [2]).”
BackgroundMethodInfluentialZhang, Y., Shi, P., & Li, J. (2024) · The Photogrammetric Record · doi:10.1111/phor.12497 · Cited by 121
Robocentric visual–inertial odometry
Huai, Z., & Huang, G. P. (2019) · The International Journal of Robotics Research · doi:10.1177/0278364919853361 · Cited by 123
“, 2009; Li and Mourikis, 2013a) in comparison with the batch optimization-based approaches whose relinearization incurs higher amount of computation (e.g., Leutenegger et al., 2015; Qin et al., 2018), they may become inconsistent, primarily due to the fact that the EKF linearized system has different observability pro…”
InfluentialAitken, J. M., Evans, M. H., Worley, R., Edwards, S., Zhang, R., Dodd, T. J., Mihaylova, L. S., & Anderson, S. (2021) · IEEE Access · doi:10.1109/access.2021.3115981 · Cited by 116
“Recent popular VIO systems include MSCKF [107], ROVIO [108], VINS-Mono [109] and Vi-DSO [110].”
MethodMAVBench: Micro Aerial Vehicle Benchmarking
Boroujerdian, B., Genc, H., Krishnan, S., Cui, W., Faust, A., & Reddi, V. J. (2018) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2018.00077 · Cited by 111
Intermittent GPS-aided VIO: Online Initialization and Calibration
Lee, W., Eckenhoff, K., Geneva, P., & Huang, G. P. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9197029 · Cited by 112
“Of many possible sensor deployments, cameras and inertial measurement units (IMUs) – which measure linear accelerations and angular velocities of the moving robot – are commonly used for 3D navigation [1] in both indoor and outdoor environments, as they are low-cost yet provide high-quality ego-motion estimation [2]–[…”
BackgroundRadarSLAM: A robust simultaneous localization and mapping system for all weather conditions
Hong, Z., Pétillot, Y., Wallace, A. M., & Wang, S. (2022) · The International Journal of Robotics Research · doi:10.1177/02783649221080483 · Cited by 127
“There are some attempts to address this challenge in the context of place recognition (Săftescu et al. (2020), Gadd et al.”
BackgroundHilti-Oxford Dataset: A Millimeter-Accurate Benchmark for Simultaneous Localization and Mapping
Zhang, L., Helmberger, M., Fu, L. F. T., Wisth, D., Camurri, M., Scaramuzza, D., & Fallon, M. F. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3226077 · Cited by 109
“Based on [18], [21] 3 3 3(2) Filter 3 7 3 7 7 22.”
A review of visual SLAM for robotics: evolution, properties, and future applications
Al-Tawil, B., Hempel, T., Abdelrahman, A. A., & Al-Hamadi, A. K. (2024) · Frontiers in Robotics and AI · doi:10.3389/frobt.2024.1347985 · Cited by 126
“It can handle large, complex environments and is quickly adaptable to work with multiple cameras or laser rangefinders (Li et al., 2018; Peter et al., 2023).”
PL-VINS: Real-Time Monocular Visual-Inertial SLAM with Point and Line FeaturesPreprint
Fu, Q., Wang, J., Yu, H., Ali, I., Guo, F., He, Y., & Zhang, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.07462 · Cited by 159
“In this subsection, we discuss the real-time of PL-VINS by comparing it to optimization-based Monocular VINS methods: PL-VIO [23] and VINS-Mono [1].”
BackgroundMethodInfluentialVIR-SLAM: visual, inertial, and ranging SLAM for single and multi-robot systems
Cao, Y., & Beltrame, G. (2021) · Autonomous Robots · doi:10.1007/s10514-021-09992-7 · Cited by 105
Bo, Y., Hu, W., Xu, L., Tang, J., Liu, S., & Zhu, Y. (2020) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro50266.2020.00089 · Cited by 112
“While it is possible to use advanced algorithms to correct the cumulative errors [80], [81], those algorithms tend to be compute-intensive.”
Autonomous Quadrotor Flight Despite Rotor Failure With Onboard Vision Sensors: Frames vs. Events
Sun, S., Cioffi, G., de Visser, C. C., & Scaramuzza, D. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.3048875 · Cited by 98
Yan, Y., Zhang, B., Zhou, J. C., Zhang, Y., & Liu, X. (2022) · Agronomy · doi:10.3390/agronomy12081740 · Cited by 110
GNSS-denied UAV indoor navigation with UWB incorporated visual inertial odometry
Lin, H., & Zhan, J.-R. (2022) · Measurement · doi:10.1016/j.measurement.2022.112256 · Cited by 105
AirSLAM: An Efficient and Illumination-Robust Point-Line Visual SLAM System
Xu, K., Hao, Y., Yuan, S., Wang, C., & Xie, L. (2025) · IEEE Transactions on Robotics · doi:10.1109/tro.2025.3539171 · Cited by 142
“Weskipthedetailsof3-Dpoint processinginoursystemastheyaresimilartootherpoint-based VOandSLAMsystems[4],[74].”
Associating Uncertainty to Extended Poses for on Lie Group IMU Preintegration With Rotating Earth
Brossard, M., Barrau, A., Chauchat, P., & Bonnabel, S. (2021) · IEEE Transactions on Robotics · doi:10.1109/tro.2021.3100156 · Cited by 88
Edge Robotics: Edge-Computing-Accelerated Multirobot Simultaneous Localization and Mapping
Huang, P., Zeng, L., Chen, X., Huang, L., Zhou, Z., & Yu, S. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3146461 · Cited by 103
Robust Legged Robot State Estimation Using Factor Graph Optimization
Wisth, D., Camurri, M., & Fallon, M. F. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2933768 · Cited by 87
“To demonstrate that our approach builds upon a stand-alone VINS system, we evaluated it on a portion of the EuRoC benchmark dataset [13] and compared it to several state-of-the-art VINS algorithms including OKVIS [14], ROVIO [20], and VINS-Mono [16].”
MethodInfluentialKeyframe‐based thermal–inertial odometry
Khattak, S., Papachristos, C., & Alexis, K. (2019) · Journal of Field Robotics · doi:10.1002/rob.21932 · Cited by 101
DeepTIO: A Deep Thermal-Inertial Odometry With Visual Hallucination
Saputra, M. R. U., de Gusmão, P. P. B., Lu, C. X., Almalıoğlu, Y., Rosa, S., Chen, C., Wahlström, J., Wang, W., Markham, A., & Trigoni, N. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2969170 · Cited by 104
“Instead, we utilize VINS-Mono (visual-inertial SLAM) [37] for the comparison with the expectation that DeepTIO at least can be as accurate as visual-inertial system.”
MethodIntegrated Inertial-LiDAR-Based Map Matching Localization for Varying Environments
Xia, X., Bhatt, N. P., Khajepour, A., & Hashemi, E. (2023) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2023.3298892 · Cited by 91
“In [29], the visual odometry and INS are combined to estimate the pose of the vehicle.”
BackgroundRobust and Efficient Trajectory Planning for Formation Flight in Dense Environments
Quan, L., Yin, L., Zhang, T., Wang, M., Wang, R., Zhong, S., Zhou, X., Cao, Y., Xu, C., & Gao, F. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2023.3301295 · Cited by 92
“We use VIO [34] to estimate each robot’s pose with respect to its start frame, and we recover the transformations related to the start frames with only anonymous bearing measurements in our previous work [35].”
MethodHa, S., Yeon, J., & Yu, H. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72764-1_11 · Cited by 165
ORBSLAM-Atlas: a robust and accurate multi-map system
Elvira, R., Tardós, J. D., & Montiel, J. M. M. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8967572 · Cited by 85
“We also report the global multi-session map after processing the five Machine Hall datasets (MH 01 to MH 05) sequentially for ORBSLAM-Atlas and VINS-Mono.”
MethodInfluentialLi, S., Li, X., Wang, H., Zhou, Y., & Shen, Z. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.09.018 · Cited by 93
Goal-Guided Transformer-Enabled Reinforcement Learning for Efficient Autonomous Navigation
Huang, W., Zhou, Y., He, X., & Lv, C. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3312453 · Cited by 106
“For this purpose, we have implemented the VINS-Fusion framework [48], which has been proven to demonstrate commendable performance within indoor settings.”
MethodInertial-Only Optimization for Visual-Inertial Initialization
Campos, C., Montiel, J. M. M., & Tardós, J. D. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9197334 · Cited by 84
“To avoid that problem, some techniques neglect accelerometer bias during the initialization assuming a zero value [7], while others wait for a long time to”
InfluentialTightly coupled integrated navigation system via factor graph for UAV indoor localization
Yang, S. S., & Hsu, L. (2020) · Aerospace Science and Technology · doi:10.1016/j.ast.2020.106370 · Cited by 89
A Comparison of Modern General-Purpose Visual SLAM Approaches
Merzlyakov, A., & Macenski, S. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636615 · Cited by 98
“ORB-SLAM3 [2] SLAM X X X X X X X X Sep 2020 OpenVSLAM [3] SLAM X X X X X X X Active1 RTABMap [4] SLAM - X X X X X X Active Kimera [6] VIO/SLAM X2 X2 - X X Active VINS-Fusion [7], [8] VIO X2 X X X X X X Oct 2019 SVO [9], [10] VO X X X X - May 2017 DSO [11] VO X X X - Dec 2018 LSD-SLAM [12] SLAM X X X X Dec 2014 PL-SLAM…”
BackgroundXu, H., Liu, P., Chen, X., & Shen, S. (2024) · IEEE Transactions on Robotics · doi:10.1109/tro.2024.3422003 · Cited by 120
“Σ is the Mahalanobis norm, B is the set of IMU factors, r B is the residual of the IMU measurement factor, L is the set of visual measurements, and r L is the visual measurement residual, r B and r L are defined in [12]; (cid”
BackgroundMethodInfluentialSelf-citationReal-time Scalable Dense Surfel Mapping
Wang, K., Gao, F., & Shen, S. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8794101 · Cited by 95
“MVDepthNet [24] is used to estimate monocular depth maps and VINS-MONO is used to track the camera motion.”
BackgroundSelf-citationLi, J., Yang, B., Chen, C., & Habib, A. F. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.10.009 · Cited by 88
PLGSLAM: Progressive Neural Scene Represenation with Local to Global Bundle Adjustment
Deng, T., Shen, G., Qin, T., Wang, J., Zhao, W., Wang, J., Wang, D., & Chen, W. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01859 · Cited by 94
“Traditional visual SLAM algorithms [9, 19, 24, 34, 35] estimate accurate camera poses and use sparse point clouds as the map representation.”
Self-citationLION: Lidar-Inertial Observability-Aware Navigator for Vision-Denied Environments
Tagliabue, A., Tordesillas, J., Cai, X., Santamaria‐Navarro, À., How, J. P., Carlone, L., & Agha–mohammadi, A. (2021) · Springer proceedings in advanced robotics · doi:10.1007/978-3-030-71151-1_34 · Cited by 86
Tao, X., Zhu, B., Xuan, S., Zhao, J. W., Jiang, H., Du, J., & Deng, W. (2021) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2021.3139006 · Cited by 96
“…according to the linear expansion [22]: After obtaining the pre-integration of the i -th frame, the pre-integration of the i + 1-th frame was iteratively obtained by the mid-point method [15]: where From the above equations, we could obtain the IMU pre-integration values at consecutive moments.”
BackgroundMethodInfluentialUnsuperPoint: End-to-end Unsupervised Interest Point Detector and DescriptorPreprint
Christiansen, P., Kragh, M. F., Brodskiy, Y., & Karstoft, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.04011 · Cited by 107
“…adjustment enables large-scale applications (long sequence recordings in large scenes) [21, 22], correction of maps based on loop closure [23], and fusion with odometry sensors such as GPS [24] or as in Visual-Inertial SLAM [25, 26], where an IMU is used to reduce drift and improve localization.”
SLAM Overview: From Single Sensor to Heterogeneous Fusion
Chen, W., Zhou, C., Shang, G., Wang, X., Li, Z., Xu, C., & Hu, K. (2022) · Remote Sensing · doi:10.3390/rs14236033 · Cited by 91
DN-SLAM: A Visual SLAM With ORB Features and NeRF Mapping in Dynamic Environments
Ruan, C., Zang, Q., Zhang, K., & Huang, K. (2023) · IEEE Sensors Journal · doi:10.1109/jsen.2023.3345877 · Cited by 85
“Traditional visual-based SLAM systems [4], [5] rely on the assumption of a static environment.”
Background
Metadata
- Authors
- Qin, T., Li, P., & Shen, S.
- Affiliations
- Hong Kong University of Science and Technology (HK)
- Venue
- IEEE Transactions on Robotics
- Published
- 2018-08
- Volume
- 34
- Issue
- 4
- Pages
- 1004-1020
- ISSN
- 1552-3098 (ISSN-L)
- 1941-0468
- OpenAlex
- W2745859992
- Cited by
- 4,669
- References
- 53
- Citations by year
- 2026: 575 · 2025: 856 · 2024: 789 · 2023: 729 · 2022: 571 · 2021: 469 · 2020: 357 · 2019: 248 · 2018: 73
- FWCI
- 233.33
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- IEEE Transactions on Robotics (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Hong Kong Research Grants Council Early Career Scheme (26201616)
- HKUST Proof-of-Concept (PCF.009.16/17)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
- Physical Sciences › Engineering › Aerospace Engineering › Inertial Sensor and Navigation
- Physical Sciences › Engineering › Aerospace Engineering › Aerospace Engineering and Control Systems
- Keywords
- loop detection, relocalization, pose graph optimization, autonomous flight
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.