VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator
Open accessThe DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Abstract
One camera and one low-cost inertial measurement unit (IMU) form a monocular visual-inertial system (VINS), which is the minimum sensor suite (in size, weight, and power) for the metric six degrees-of-freedom (DOF) state estimation. In this paper, we present VINS-Mono: a robust and versatile monocular visual-inertial state estimator. Our approach starts with a robust procedure for estimator initialization. A tightly coupled, nonlinear optimization-based method is used to obtain highly accurate visual-inertial odometry by fusing preintegrated IMU measurements and feature observations. A loop detection module, in combination with our tightly coupled formulation, enables relocalization with minimum computation. We additionally perform 4-DOF pose graph optimization to enforce the global consistency. Furthermore, the proposed system can reuse a map by saving and loading it in an efficient way. The current and previous maps can be merged together by the global pose graph optimization. We validate the performance of our system on public datasets and real-world experiments and compare against other state-of-the-art algorithms. We also perform an onboard closed-loop autonomous flight on the microaerial-vehicle platform and port the algorithm to an iOS-based demonstration. We highlight that the proposed work is a reliable, complete, and versatile system that is applicable for different applications that require high accuracy in localization. We open source our implementations for both PCs (https://github.com/HKUST-Aerial-Robotics/VINS-Mono) and iOS mobile devices (https://github.com/HKUST-Aerial-Robotics/VINS-Mobile).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In terms of vision-IMU-GPS fusion, VINS-Fusion has become a mainstream solution for large-scale, high-precision localization and is widely used in UAVs and mobile robots.”
From Multimodal fusion and vision–language models: A survey for robot vision (2026) · cites this paper as [151]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multiple View Geometry in Computer Vision
Hartley, R., & Zisserman, A. (2004) · doi:10.1017/cbo9780511811685 · Cited by 21,070
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897 · cited 3×
“Relative pose error [42] in MH_05_difficult.”
MethodInfluential(1981) · Cited by 11,963
Shi, J., & Tomasi (1994) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition CVPR-94 · doi:10.1109/cvpr.1994.323794 · Cited by 7,724 · cited 1×
“features are detected [32] to maintain a minimum number (100– 300) of features in each image.”
BackgroundRobust estimation of a location parameter
Huber, P. J. (1964) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177703732 · Cited by 7,228
ORB-SLAM: A Versatile and Accurate Monocular SLAM System
Mur-Artal, R., Montiel, J. M. M., & Tardos, J. D. (2015) · IEEE Transactions on Robotics · doi:10.1109/tro.2015.2463671 · Cited by 6,778 · cited 7×
“ORB-SLAM [4] is able to close loops and reuse the map, which takes advantage of Bag-of-World [6].”
BackgroundMethodInfluentialParallel Tracking and Mapping for Small AR Workspaces
Klein, G., & Murray, D. (2007) · 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2007.4538852 · Cited by 4,346
Bundle Adjustment — A Modern Synthesis
Triggs, B., McLauchlan, P. F., Hartley, R. I., & Fitzgibbon, A. W. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-44480-7_21 · Cited by 3,988 · cited 1×
“Finally, a global full bundle adjustment [36] is applied to minimize the total reprojection error of all feature observations.”
MethodA benchmark for the evaluation of RGB-D SLAM systems
Sturm, J., Engelhard, N., Endres, F., Burgard, W., & Cremers, D. (2012) · 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2012.6385773 · Cited by 3,976 · cited 3×
“TABLE I RMSE [43] IN EUROC DATASETS IN METERS”
BackgroundMethodInfluentialLSD-SLAM: Large-scale direct monocular SLAM
Engel, J., Schöps, T., & Cremers, D. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10605-2_54 · Cited by 3,851 · cited 3×
“Noticeable approaches include PTAM [1], SVO [2], LSD-SLAM [3], DSO [5], and ORB-SLAM [4].”
BackgroundMethod
Cited by
Items 501–600 of 1,001
An Onboard Vision-Based System for Autonomous Landing of a Low-Cost Quadrotor on a Novel Landing Pad
Liu, X., Zhang, S., Tian, J., & Liu, L. (2019) · Sensors · doi:10.3390/s19214703 · Cited by 41
“[20] and [21] presented a monocular visual–inertial system (VINS-Mono) for the 6DOF state estimation of UAVs, in which only a monocular camera and a low-cost inertial measurement unit were utilized.”
MethodRolling-Shutter Modelling for Direct Visual-Inertial Odometry
Schubert, D., Demmel, N., von Stumberg, L., Usenko, V., & Cremers, D. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8968539 · Cited by 46
“A full visual-inertial SLAM system is given by VINS-Mono [18], which is also based on non-linear optimization.”
Integrated moment-based LGMD and deep reinforcement learning for UAV obstacle avoidance
He, L., Aouf, N., Whidborne, J. F., & Song, B. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9197152 · Cited by 44
“Visual Simultaneous Localization And Mapping (VSLAM) is a promising technique to obtain reliable environment awareness, and it can be applied with only monocular vision, e.g. ORB-SLAM [9], or monocular vision combined with IMU information, e.g. VINS-Mono [10], [11].”
MethodTowards automating construction tasks: Large‐scale object mapping, segmentation, and manipulation
Mascaro, R., Wermelinger, M., Hutter, M., & Chli, M. (2020) · Journal of Field Robotics · doi:10.1002/rob.22007 · Cited by 51
“The trajectory of the VI ‐ Sensor's left camera is estimated online using the VINS ‐ Mono SLAM system (Qin et al., 2018).”
MethodA Comparison of Graph Optimization Approaches for Pose Estimation in SLAM
Jurić, A., Kendes, F., Marković, I., & Petrovic, I. K. (2021) · International Convention on Information and Communication Technology, Electronics and Microelectronics · doi:10.23919/mipro52101.2021.9596721 · Cited by 50
“OKVIS ( [19], [20]) and VINS [21] use Ceres to optimize nonlinear problems defined as graphs.”
MethodMedUCC: Medium-Driven Underwater Camera Calibration for Refractive 3-D Reconstruction
Gu, C., Cong, Y., Sun, G., Gao, Y., Tang, X., Zhang, T., & Fan, B. (2021) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2021.3132146 · Cited by 41
Li, X., Li, S., Li, S., Zhou, Y., Sun, M., Xu, Q., & Xu, Z. (2022) · GPS Solutions · doi:10.1007/s10291-022-01306-3 · Cited by 44
“In a typical visual method, the positions of the features are included in the state vector and estimated together with camera poses (Mur-Artal and Tardós 2017; Qin et al. 2018).”
MethodLLIO: Lightweight Learned Inertial Odometer
Wang, Y., Kuang, J., Niu, X., & Liu, J. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3214087 · Cited by 50
“The VINS [7], [8] can achieve high accuracy positioning over a long period through combined vision and inertial measures.”
BackgroundGCLO: Ground Constrained LiDAR Odometry with Low-drifts for GPS-denied Indoor Environments
Wei, X., Lv, J., Sun, J., Dong, E., & Pu, S. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9812336 · Cited by 46
Tightly-coupled GNSS-aided Visual-Inertial Localization
Lee, W., Geneva, P., Yang, Y., & Huang, G. P. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9811362 · Cited by 46
“OpenVINS [14] and VINS-Mono [47] 2 https://github.com/HKUST-Aerial-Robotics/GVINS-Dataset”
A Semantic Slam-Based Dense Mapping Approach for Large-Scale Dynamic Outdoor Environment
Yang, L., & Wang, L. (2022) · Measurement · doi:10.1016/j.measurement.2022.112001 · Cited by 40
RI-LIO: Reflectivity Image Assisted Tightly-Coupled LiDAR-Inertial Odometry
Zhang, Y., Tian, Y., Wang, W., Yang, G., Li, Z., Jing, F., & Tan, M. H. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3243528 · Cited by 40
“, ORB-SLAM [1], VINS-Mono [2]) methods inapplicable.”
MethodLearning-Based Visual-Strain Fusion for Eye-in-Hand Continuum Robot Pose Estimation and Control
Wang, X., Dai, J., Tong, H., Wang, K., Fang, G., Xie, X., Liu, Y., Au, K. W. S., & Kwok, K. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2023.3240556 · Cited by 38
“The FBG fiber can be calibrated offline as a position or orientation sensing device and integrated with a monocular camera to compose a visual-FBG soft-robot SLAM framework, similar to the VINS SLAM [15].”
Coco-LIC: Continuous-Time Tightly-Coupled LiDAR-Inertial-Camera Odometry Using Non-Uniform B-Spline
Lang, X., Chen, C., Tang, K., Ma, Y., Lv, J., Liu, Y., & Zuo, X. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3315542 · Cited by 56
“We test our LICO (Coco-LIC) on both challenging datasets and large-scale datasets, comparing it against four LIC methods: LVI-SAM [3], R3LIVE [9], FAST-LIVO [10], CLIC [11] and a LIO system FAST-LIO2 [42], as well as a VIO system VINS-Mono [12].”
BackgroundMethodZhong, S., Zhao, Y., Ge, L., Shan, Z., & Ma, F. (2023) · Automotive Innovation · doi:10.1007/s42154-023-00230-7 · Cited by 38
“Kang et al. [6] developed a visual-inertial system (VINS) framework [7] with tightly coupled vehicle dynamics, which can obtain accurate measurement results from VINS based on the vehicle model.”
MethodWen, T., Fang, Y., Lu, B., Zhang, X., & Tang, C. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3355778 · Cited by 49
“Based on the extrinsic parameter T b l between the LiDAR and IMU, the pose is rotated to the IMU frame: According to [24], we can obtain the translation, velocity, and between two time consecutive frames by IMU pre-integration.”
MethodEnvironment Driven Underwater Camera-IMU Calibration for Monocular Visual-Inertial SLAM
Gu, C., Cong, Y., & Sun, G. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8793577 · Cited by 40
“Specifically, we set camera frame c0 as the reference coordinate frame for SfM [9].”
BackgroundMethodInfluentialA Survey of Simultaneous Localization and Mapping.
Huang, B., Zhao, J., & Liu, J. (2019) · Cited by 53
Alternating Minimization Based Trajectory Generation for Quadrotor Aggressive Flight
Wang, Z., Zhou, X., Xu, C., Chu, J., & Gao, F. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.3003871 · Cited by 38
“The pose of our quadrotor is obtained through a robust visual-inertial state estimator [24].”
MethodSimultaneous Hand–Eye/Robot–World/Camera–IMU Calibration
Wu, J., Wang, M., Jiang, Y., Yi, B., Fan, R., & Liu, M. (2021) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2021.3103995 · Cited by 40
“For highly dynamical visual servoing tasks, the IMU also helps to gap the low-rate data sampling of the camera and the robotic manipulator [27].”
BackgroundKachurka, V., Rault, B., Muñoz, F. I. I., Roussel, D., Bonardi, F., Didier, J.-Y., Hadj-Abdelkader, H., Bouchafa, S., Alliez, P., & Robin, M. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3101121 · Cited by 43
“To fullfill the characteristics described above two families emerge as popular choices: ORB-SLAM [42], ORB-SLAM2 [42] and more particularly its visual-inertial successors VI-ORB-SLAM [43] and ORB-SLAM3 [44] as well as VINS-Mono [28] and its successor VINS-Fusion [8].”
Covariance Estimation for Pose Graph Optimization in Visual-Inertial Navigation Systems
Shi, P., Zhu, Z., Sun, S., Rong, Z., Zhao, X., & Tan, M. H. (2023) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2023.3263837 · Cited by 40
“We follow the work in [12] and formulate the pose graph optimization problem as follows: where p , ψ are the position and yaw angle of the relevant frame.”
BackgroundMethodInfluentialEdge-Based Monocular Thermal-Inertial Odometry in Visually Degraded Environments
Wang, Y., Chen, H., Liu, Y., & Zhang, S. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3246381 · Cited by 37
“The sensor suit consisting of a monocular camera and IMU, which provides complementary information, is the minimum solution for recovering the metric six degrees-of-freedom (DOF) [1].”
BackgroundMethodInfluentialWang, H., Huang, Y., Zhang, G., & Rong, Y. (2023) · Optics & Laser Technology · doi:10.1016/j.optlastec.2023.109346 · Cited by 38
Underwater 3D Scanning System for Cultural Heritage Documentation
Bräuer-Burchardt, C., Munkelt, C., Bleier, M., Heinze, M., Gebhart, I., Kühmstedt, P., & Notni, G. (2023) · Remote Sensing · doi:10.3390/rs15071864 · Cited by 37
VIO-DualProNet: Visual-inertial odometry with learning based process noise covariance
Solodar, D., & Klein, I. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.108466 · Cited by 42
“Among these sensor combinations, Visual-Inertial Odometry(VIO) [12], [13] stands out as a preferred approach for many applications due to its light weight and low power consumption.”
BackgroundKlenk, S., Motzet, M., Koestler, L., & Cremers, D. (2024) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv62453.2024.00036 · Cited by 69
Nam, D. V., Danh, P. T., Park, C. H., & Kim, G.-W. (2024) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2024.109607 · Cited by 44
Lightweight hybrid visual-inertial odometry with closed-form zero velocity update
Xiaochen, Q. I. U., Zhang, H., & Fu, W. (2020) · Chinese Journal of Aeronautics · doi:10.1016/j.cja.2020.03.008 · Cited by 41
Seed: A Segmentation-Based Egocentric 3D Point Cloud Descriptor for Loop Closure Detection
Fan, Y., He, Y., & Tan, U.-X. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341517 · Cited by 37
“For example, the similarity between different places captured by camera can be calculated by means of the state-of-art method, bag-of-words (e.g. [1], [2]), and it has shown great success in real-world applications.”
MethodAccurate and Robust Scale Recovery for Monocular Visual Odometry Based on Plane Geometry
Tian, R., Zhang, Y., Zhu, D., Liang, S., Coleman, S., & Kerr, D. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561215 · Cited by 37
“The key of scale recovery is to integrate absolute reference information, such as the gravity orientation from IMU [7] or the depth measured by Lidar [8], [9].”
BackgroundULSD: Unified line segment detection across pinhole, fisheye, and spherical cameras
Li, H., Yu, H., Wang, J., Yang, W. T., Yu, L., & Scherer, S. (2021) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2021.06.004 · Cited by 43
PLD-VINS: RGBD visual-inertial SLAM with point and line features
Zhu, Y., Jin, R., Lou, T.-S., & Zhao, L.-Y. (2021) · Aerospace Science and Technology · doi:10.1016/j.ast.2021.107185 · Cited by 34
An End-to-End UAV Simulation Platform for Visual SLAM and Navigation
Chen, S., Zhou, W., Yang, A., Chen, H., Li, B., & Wen, C. (2022) · Aerospace · doi:10.3390/aerospace9020048 · Cited by 46
“Researchers have integrated IMU information [12] or predefined the object pattern [13,14] of the environment to eliminate this problem.”
BackgroundVisual attention prediction improves performance of autonomous drone racing agents
Pfeiffer, C., Wengeler, S., Loquercio, A., & Scaramuzza, D. (2022) · PLoS ONE · doi:10.1371/journal.pone.0264471 · Cited by 42
“We use a re-implementation of feature tracks from the VINS-Mono package [42] in Python.”
Intelligent Fusion Structure for Wi-Fi/BLE/QR/MEMS Sensor-Based Indoor Localization
Yu, Y., Zhang, Y., Chen, L., & Chen, R. (2023) · Remote Sensing · doi:10.3390/rs15051202 · Cited by 37
PyPose: A Library for Robot Learning with Physics-based Optimization
Wang, C., Gao, D., Xu, K., Geng, J., Hu, Y., Qiu, Y., Li, B., Yang, F., Moon, B. G., Pandey, A., et al. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02109 · Cited by 72
“IMU preintegration [25] is one of the most popular strategies for many inertial navigation systems, e.g., VIO [50], LIO [77], and multi-sensor fusion [76].”
BackgroundGuan, W., & Lu, P. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981970 · Cited by 47
“as Visual Inertial Odometry (VIO), have gained significant research interest and progress [1] [2].”
BackgroundMethodInfluentialCong, P., Li, J., Liu, J., Xiao, Y., & Zhang, X. (2024) · Sensors · doi:10.3390/s24072102 · Cited by 40
“Moreover, many excellent visual SLAM systems have been proposed, including orientated FAST and rotated BRIEF (ORB)-SLAM1-3 [8–10], visual-inertial system (VINS)-Mono [11], large-scale direct (LSD)-SLAM [12], directed sparse odometry (DSO) [13], and parallel tracking and mapping (PTAM) [14].”
Automated reality capture for indoor inspection using BIM and a multi-sensor quadruped robot
Chen, Z., Song, C., Wang, B., Tao, X., Zhang, X., Lin, F., & Cheng, J. C. P. (2024) · Automation in Construction · doi:10.1016/j.autcon.2024.105930 · Cited by 48
VINS-Vehicle: A Tightly-Coupled Vehicle Dynamics Extension to Visual-Inertial State Estimator
Kang, R., Xiong, L., Xu, M., Zhao, J., & Zhang, P. (2019) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2019.8916940 · Cited by 40
“The state-of-art open-source solution VINS-Mono1, is a robust and versatile SLAM system with not only the tightly coupled VIO, but also the relocalization and global optimization.”
BackgroundMethodInfluentialVision-Aided Localization For Ground Robots
Zhang, M., Chen, Y., & Li, M. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8968521 · Cited by 39
“On the other hand, pose prediction using IMU is performed similar to other work on camera-IMU localization [9] [10] 3, and thus we omit the details.”
BackgroundMethodInfluentialJin, L., Zhang, H., & Ye, C. (2020) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2020.2997606 · Cited by 41
“The Jacobians of eij with respect to pose variables Ψi, Ψj and inverse depth λ are defined in [15], and the Jacobians with respect to CIP ζi and ζi are given by”
BackgroundInfluentialOnline IMU Intrinsic Calibration: Is It Necessary?
Yang, Y., Geneva, P., Zuo, X., & Huang, G. P. (2020) · Robotics: Science and Systems · doi:10.15607/rss.2020.xvi.026 · Cited by 45
“Many efficient and robust VINS algorithms have been developed in recent years (e.g., [20, 14, 4, 21, 6, 3, 9]).”
BackgroundLSTM and Filter Based Comparison Analysis for Indoor Global Localization in UAVs
Yusefi, A., Durdu, A., Aslan, M. F., & Sungur, C. (2021) · IEEE Access · doi:10.1109/access.2021.3049896 · Cited by 37
“The traditional methods include SVOMSF [95], MSCKF [96], OKVIS [97], ROVIO [98], VINSMONO [99], VINSMONO + LC [100], SVOGTSAM [101], ORBSLAM2 [12], STCM-SLAM [102] and learning based are SelfVIO [103], Kimera [104] and methods proposed by Baldini et al. [94] and Li and Steven [105].”
MethodBalancing the Budget: Feature Selection and Tracking for Multi-Camera Visual-Inertial Odometry
Zhang, L., Wisth, D., Camurri, M., & Fallon, M. F. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3137910 · Cited by 36
“In recent years, optimization based methods such as VINS-Mono [9], ORB-SLAM3 [10], and OKVIS [11] have become popular due to their ability to optimize a trajectory of poses.”
Zhang, H., Xia, X., Nitsch, M., & Abel, D. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3189824 · Cited by 36
EMA-VIO: Deep Visual–Inertial Odometry With External Memory Attention
Tu, Z., Chen, C., Pan, X., Liu, R., Cui, J., & Mao, J. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3208200 · Cited by 36
“We first evaluated our proposed EMA-VIO on the KITTI dataset, and compare the pose results of our EMA-VIO with two traditional VIO methods (i.e., VINS-Mono [1], OKVIS [30]) and two learning based pose estimation methods (i.e. VINet [4] and [12]).”
InfluentialAslan, M. F., Durdu, A., & Sabancı, K. (2022) · Measurement · doi:10.1016/j.measurement.2022.111030 · Cited by 40
Camera-Sonar Combination for Improved Underwater Localization and Mapping
Cardaillac, A., & Ludvigsen, M. (2023) · IEEE Access · doi:10.1109/access.2023.3329834 · Cited by 40
“To improve the results a second camera, a depth camera or an IMU can be added [5], [6], [7].”
BackgroundHerrera-Granda, E. P., Torres, J. C., & Peluffo-Ordóñez, D. H. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e37356 · Cited by 49
CPL-SLAM: Centralized Collaborative Multirobot Visual-Inertial SLAM Using Point-and-Line Features
Liu, X., Wen, S., Liu, H., & Yu, F. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3548958 · Cited by 35
“We compared our method against multisession SLAM systems (such as VINS-Mono [39] and ORB-SLAM3 [40]) and advanced centralized SLAM systems (such as CCM-SLAM [4], CVIDS [41], COVINS(-”
Real-Time Information-Theoretic Exploration with Gaussian Mixture Model Maps
Tabib, W., Goel, K., Yao, J., Dabhi, M., Boirum, C., & Michael, N. (2019) · Robotics: Science and Systems · doi:10.15607/rss.2019.xv.061 · Cited by 35
“1) Visual-Inertial Navigation and Control: State estimates are computed from IMU and downward facing camera observations via VINS-Mono [33], a tightly-coupled visual-inertial odometry framework that jointly optimizes vehicle motion, feature locations, camera time delay, and IMU biases over a sliding window of monocula…”
MethodInfluentialVersaVIS—An Open Versatile Multi-Camera Visual-Inertial Sensor Suite
Tschopp, F., Riner, M., Fehr, M., Bernreiter, L., Furrer, F., Novković, T., Pfrunder, A., Cadena, C., Siegwart, R., & Nieto, J. I. (2020) · Sensors · doi:10.3390/s20051439 · Cited by 45
Nam, D. V., & Kim, G.-W. (2020) · Sensors · doi:10.3390/s20102922 · Cited by 37
“VINS-Fusion VIO[13]: A modern optimization-based solution is an extended version of VINS-mono [14].”
BackgroundUnsupervised Monocular Visual-inertial Odometry Network
Peng, W., Hua, G., Huang, W., Meng, F., & Liu, H. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/325 · Cited by 36
“The evaluation of odometry is carried out among traditional VO methods VISO-M [Geiger et al. , 2011] (monocular version), VISO-S [Geiger et al. , 2011] (stereo version), ORB-SLAM2 [Mur-Artal and Tard ´ os, 2017], VIO methods VINS-Mono [Qin et al. , 2018], OKVIS [Leutenegger et al. , 2013], self-supervised VIO methods…”
InfluentialRoad Profile Estimation Using a 3D Sensor and Intelligent Vehicle
Ni, T., Li, W., Zhao, D., & Kong, Z. (2020) · Sensors · doi:10.3390/s20133676 · Cited by 35
“Qin [11] presented a visual-inertial navigation system that used nonlinear analysis and graph optimization technology to obtain accurate and robust pose estimation.”
MethodWen, W., Bai, X., Zhang, G., Chen, S., Yuan, F., & Hsu, L. (2020) · IEEE Access · doi:10.1109/access.2020.3006210 · Cited by 36
“The detail of the VINS can be found in [15].”
BackgroundMethodInfluentialATVIO: Attention Guided Visual-Inertial Odometry
Liu, L., Li, G., & Li, T. H. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413912 · Cited by 35
A Point-Line VIO System With Novel Feature Hybrids and With Novel Line Predicting-Matching
Wei, H., Tang, F., Xu, Z., Zhang, C., & Wu, Y. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3113987 · Cited by 40
VID-Fusion: Robust Visual-Inertial-Dynamics Odometry for Accurate External Force Estimation
Ding, Z., Yang, T., Zhang, K., Xu, C., & Gao, F. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9560898 · Cited by 36
VIP-SLAM: An Efficient Tightly-Coupled RGB-D Visual Inertial Planar SLAM
Chen, D., Wang, S., Xie, W., Zhai, S., Wang, N., Bao, H., & Zhang, G. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9812354 · Cited by 42
TM3Loc: Tightly-Coupled Monocular Map Matching for High Precision Vehicle Localization
Wen, T., Jiang, K., Wijaya, B., Li, H., Yang, M., & Yang, D. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3176914 · Cited by 35
“Its initialization strategy employs a simplified Structure-from-Motion (SfM) process used in [52].”
MethodA UAV-Based Aircraft Surface Defect Inspection System via External Constraints and Deep Learning
Liu, Y., Dong, J., Li, Y., Gong, X., & Wang, J. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3198713 · Cited by 36
“A classical VIO method, i.e., VINS-Mono [13], is then reviewed, which achieves the state-of-the-art performance on estimating postures of a UAV in real time.”
BackgroundMethodInfluentialInvariant Extended Kalman Filtering for Tightly Coupled LiDAR-Inertial Odometry and Mapping
Shi, P., Zhu, Z., Sun, S., Zhao, X., & Tan, M. H. (2023) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2022.3233363 · Cited by 41
“Moreover, a lack of direct depth measurements in vision-based SLAM [1], [2], [3] leads to maintaining a 3-”
BackgroundUAV‐based simultaneous localization and mapping in outdoor environments: A systematic scoping review
Wang, K., Kooistra, L., Pan, R., Wang, W., & Valente, J. R. P. (2024) · Journal of Field Robotics · doi:10.1002/rob.22325 · Cited by 45
“Previous studies in visual SLAM, such as monocular visual ‐ inertial system (VINS ‐ Mono; Qin et al., 2018) and VINS ‐ Fusion (Qin et al., 2019), have reported that inertial sensors provide high ‐ frequency information about the motion of robot or sensor, which can be used to improve the accuracy…”
MethodAdaptive VIO: Deep Visual-Inertial Odometry with Online Continual Learning
Pan, Y., Zhou, W., Cao, Y., & Zha, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01706 · Cited by 48
“Then, the preintegration until i + 1 th IMU frame can be expressed in the following form[24]: where ai, wi are acceleration and angular velocity mea surements of i th IMU frame, after subtracting the network predicted bias ba, b 9, respectively.”
BackgroundMethodInfluentialSwarm-LIO2: Decentralized Efficient LiDAR-Inertial Odometry for Aerial Swarm Systems
Zhu, F., Ren, Y., Yin, L., Kong, F., Liu, Q., Xue, R., Liu, W., Cai, Y., Lu, G., Li, H., et al. (2024) · IEEE Transactions on Robotics · doi:10.1109/tro.2024.3522155 · Cited by 66
VinsFusion-Line: Binocular Vision Inertial Navigation Real-Time SLAM System Based on Line Features
Yang, G., Jiang, Y., Wang, S., & Chen, K. (2025) · Cybernetics & Systems · doi:10.1080/01969722.2025.2606002 · Cited by 42
“As in Figure 7, traditional visual-inertial odometry solutions that rely on point features, such as Vins-Mono.”
InfluentialVehicle Pose and Shape Estimation Through Multiple Monocular Vision
Ding, W., Li, S., Zhang, G., Lei, X., & Qian, H. (2018) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio.2018.8665155 · Cited by 36
“In fact, mobile robots usually conduct using on-board methods called simultaneous localization and mapping (SLAM) [8], [9], [10].”
MethodLearning to Film From Professional Human Motion Videos
Huang, C. X., Lin, D. C.-E., Yang, Z., Kong, Y., Chen, P., Yang, X. Y., & Cheng, K.-T. T. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00437 · Cited by 49
“It is feasible to obtain camera motions via visual-inertial navigation on a real camera drone platform equipped with inertial sensors [41]; however, it is impossible to derive absolute camera motions directly from training videos which do not contain inertial sensor data collected from the internet.”
BackgroundGSLAM: A General SLAM Framework and Benchmark
Zhao, Y., Xu, S., Bu, S., Jiang, H., & Han, P. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00120 · Cited by 41
“OKVIS [45], VINS [56] use Ceres for graph optimization with IMU factors and sliding window is used to control the computation complex.”
InfluentialDeep Learning for Underwater Visual Odometry Estimation
Teixeira, B., Silva, H. M., Matos, A. C., & Silva, E. (2020) · IEEE Access · doi:10.1109/access.2020.2978406 · Cited by 41
“Despite tight camera intrinsic and camera to IMU extrinsic calibration, VINS-mono [90] was not able to generate a sequence estimate for any of our dataset test sequences, especially because the visual component prevented robust initialization due to low parallax and rather low feature environments.”
MethodJao, C.-S., Wang, Y., & Shkel, A. M. (2020) · IEEE/ION Position Location and Navigation Symposium · doi:10.1109/plans46316.2020.9109993 · Cited by 34
Tightly-coupled ultra-wideband-aided monocular visual SLAM with degenerate anchor configurations
Nguyen, T. H., Nguyen, T., & Xie, L. (2020) · Autonomous Robots · doi:10.1007/s10514-020-09944-7 · Cited by 37
An Adaptive Visual Dynamic-SLAM Method Based on Fusing the Semantic Information
Jiao, J., Wang, C., Li, N., Deng, Z., & Xu, W. D. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3051691 · Cited by 36
“sensors and have relatively good results, such as VINS [1], 22 LSD-SLAM [3], ORB-SLAM2 [6].”
BackgroundCalib-Net: Calibrating the Low-Cost IMU via Deep Convolutional Neural Network
Li, R., Fu, C., Yi, W., & Yi, X. (2022) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.772583 · Cited by 46
“Aiming at the visual-inertial navigation system, Qin and Shen (2018) presented an online calibration method to optimize model parameters dynamically, and proposed VINS-mono system (Qin et al., 2018) which is one of the state-of-the-art visual-inertial systems.”
MethodEfficient image-based indoor localization with MEMS aid on the mobile device
Shu, M., Chen, G., & Zhang, Z. (2022) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2022.01.010 · Cited by 35
PLJ-SLAM: Monocular Visual SLAM With Points, Lines, and Junctions of Coplanar Lines
Ren, G., Cao, Z., Liu, X., Tan, M. H., & Yu, J. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3185122 · Cited by 35
Gu, S., Dai, C., Mao, F., & Fang, W. (2022) · Remote Sensing · doi:10.3390/rs14174337 · Cited by 36
UWB-VIO Fusion for Accurate and Robust Relative Localization of Round Robotic Teams
Zheng, S., Li, Z., Liu, Y., Zhang, H., Zheng, P., Liang, X., Li, Y., Bu, X., & Zou, X. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3208354 · Cited by 34
“Compared with the single robot localization, which is well-addressed through approaches such as visual-inertial odometry (VIO) [2], [3], the problem of multi-robot co-localization is much more complex, requiring not only the ego-motion poses of each robot, but also the relative poses between robots.”
BackgroundUnmanned Aerial Vehicle Mediated Drug Delivery for First Aid
Sheng, T., Jin, R., Yang, C., Qiu, K., Wang, M., Shi, J., Zhang, J., Gao, Y., Wu, Q., Zhou, X., et al. (2022) · Advanced Materials · doi:10.1002/adma.202208648 · Cited by 38
Rail Vehicle Localization and Mapping With LiDAR-Vision-Inertial-GNSS Fusion
Wang, Y., Song, W., Lou, Y., Zhang, Y., Huang, F., Tu, Z., & Liang, Q. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3190093 · Cited by 36
Factor graph-based high-precision visual positioning for agricultural robots with fiducial markers
Zhang, W., Gong, L., Huang, S., Wu, S., & Liu, C. (2022) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2022.107295 · Cited by 34
A Robust INS/USBL/DVL Integrated Navigation Algorithm Using Graph Optimization
Li, P., Liu, Y., Yan, T., Yang, S., & Li, R. (2023) · Sensors · doi:10.3390/s23020916 · Cited by 33
Self-citationDevelopment of an Indoor Delivery Mobile Robot for a Multi-Floor Environment
Kim, T., Kang, G., Lee, D., & Shim, D. H. (2024) · IEEE Access · doi:10.1109/access.2024.3381489 · Cited by 42
“Examples include visual inertial odometry and LiDAR inertial odometry [14], [15].”
Integration of Sonar and Visual–Inertial Systems for SLAM in Underwater Environments
Zhang, J., Han, F., Han, D., Yang, J., Zhao, W., & Li, H. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3384301 · Cited by 40
“Meeting monocular visual SLAM initialization requirements in complex underwater environments can be challenging [13].”
BackgroundMethodTowards End-to-end Learning of Visual Inertial Odometry with an EKF
Li, C., & Waslander, S. L. (2020) · Canadian Conference on Computer and Robot Vision · doi:10.1109/crv50864.2020.00033 · Cited by 38
“…[3] to the best of our ability for comparison, shown in Figure 4; • Proposed : our proposed method of training VIO with a robo-centric EKF end-to-end; We also sought to compare with tightly-coupled VIO meth-ods such as [12], and [2], however, their open-sourced code do not work well with KITTI.”
MethodCo-Planar Parametrization for Stereo-SLAM and Visual-Inertial Odometry
Li, X., Li, Y., Örnek, E. P., Lin, J., & Tombari, F. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.3027230 · Cited by 39
“In sequence MH 05 , we observe a 26% improvement compared to the second best performing algorithm (Mesh-VIO), and in sequence V 103 , a 15% improvement and 35% improvement compared to VINS-MONO and Mesh-VIO, respectively.”
BackgroundMethodInfluentialAn Augmented Reality Interaction Interface for Autonomous Drone
Liu, C., & Shen, S. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341037 · Cited by 40
“VINS-Fusion [11], a robust and accurate multi-sensor state estimator, is used for self-localization.”
MethodSelf-citationRP-VIO: Robust Plane-based Visual-Inertial Odometry for Dynamic Environments
Ram, K., Kharyal, C., Harithas, S. S., & Krishna, K. M. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636522 · Cited by 39
“While our proposed method is general enough to be integrated into any VIO or SLAM system, in this work we build upon VINS-Mono [12].”
BackgroundMethodInfluentialDynamic RGB-D SLAM Based on Static Probability and Observation Number
Liu, Y., Wu, Y., & Pan, W. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3089228 · Cited by 34
A Comparison of Three Measurement Models for the Wheel-Mounted MEMS IMU-Based Dead Reckoning System
Wu, Y., Niu, X., & Kuang, J. (2021) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2021.3102409 · Cited by 36
“, camera and light detection and ranging (LiDAR) [4]–[8].”
BackgroundPan, N., Zhang, R., Yang, T., Cui, C., Xu, C., & Gao, F. (2021) · IET Cyber-Systems and Robotics · doi:10.1049/csy2.12033 · Cited by 40
Tightly-Coupled Visual-Inertial-Pressure Fusion Using Forward and Backward IMU Preintegration
Hu, C., Zhu, S., Liang, Y., & Song, W. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3177847 · Cited by 39
Li, Q., Xie, F., Zhao, J., Xu, B. H., Yang, J., Liu, X., & Suo, H. (2022) · Remote Sensing · doi:10.3390/rs14153720 · Cited by 37
Dai, K., Xie, T., Wang, K., Jiang, Z., Li, R., & Zhao, L. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.110094 · Cited by 35
“LOCAL feature matching is a vital component in several visual applications, such as Simultaneous Localization and Mapping (SLAM) [1]–[3] and Structure-from-Motion (SFM) [4], [5].”
MethodULL-SLAM: underwater low-light enhancement for the front-end of visual SLAM
Xin, Z., Wang, Z., Yu, Z., & Zheng, B. (2023) · Frontiers in Marine Science · doi:10.3389/fmars.2023.1133881 · Cited by 35
“VINS Qin et al. (2018); Qin and Shen (2018) proposed a general monocular fusion framework containing IMU information.”
BackgroundZhang, Y., Sun, H. X., Zhang, F., Zhang, B., Tao, S., Li, H., Qi, K., Zhang, S., Ninomiya, S., & Mu, Y. (2023) · Agronomy · doi:10.3390/agronomy13082158 · Cited by 37
“Hence, the measured gyroscope value comprises the true value ω t , white noise n ω , and bias b ω [27–29].”
BackgroundA Real-Time, Robust, and Versatile Visual-SLAM Framework Based on Deep Learning Networks
Zhang, X., Dong, H., Zhang, H., Zhu, X., Li, S., & Deng, B. (2025) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2025.3527618 · Cited by 56
“…EuRoC dataset tests , we selected several SOTA SLAM methods as contrast objects, including traditional visual-inertial SLAM methods like DFP-SLAM [15], ST-VIO [27], VINS-Mono [14], ORB-SLAM3 [16], the hybrid SLAM algorithm SP-Loop [9], and the SOTA end-to-end deep learning SLAM system DVI-SLAM [7].”
Metadata
- Authors
- Qin, T., Li, P., & Shen, S.
- Affiliations
- Hong Kong University of Science and Technology (HK)
- Venue
- IEEE Transactions on Robotics
- Published
- 2018-08
- Volume
- 34
- Issue
- 4
- Pages
- 1004-1020
- ISSN
- 1552-3098 (ISSN-L)
- 1941-0468
- OpenAlex
- W2745859992
- Cited by
- 4,669
- References
- 53
- Citations by year
- 2026: 575 · 2025: 856 · 2024: 789 · 2023: 729 · 2022: 571 · 2021: 469 · 2020: 357 · 2019: 248 · 2018: 73
- FWCI
- 233.33
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- IEEE Transactions on Robotics (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Hong Kong Research Grants Council Early Career Scheme (26201616)
- HKUST Proof-of-Concept (PCF.009.16/17)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
- Physical Sciences › Engineering › Aerospace Engineering › Inertial Sensor and Navigation
- Physical Sciences › Engineering › Aerospace Engineering › Aerospace Engineering and Control Systems
- Keywords
- loop detection, relocalization, pose graph optimization, autonomous flight
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.