VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator
Open accessThe DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Abstract
One camera and one low-cost inertial measurement unit (IMU) form a monocular visual-inertial system (VINS), which is the minimum sensor suite (in size, weight, and power) for the metric six degrees-of-freedom (DOF) state estimation. In this paper, we present VINS-Mono: a robust and versatile monocular visual-inertial state estimator. Our approach starts with a robust procedure for estimator initialization. A tightly coupled, nonlinear optimization-based method is used to obtain highly accurate visual-inertial odometry by fusing preintegrated IMU measurements and feature observations. A loop detection module, in combination with our tightly coupled formulation, enables relocalization with minimum computation. We additionally perform 4-DOF pose graph optimization to enforce the global consistency. Furthermore, the proposed system can reuse a map by saving and loading it in an efficient way. The current and previous maps can be merged together by the global pose graph optimization. We validate the performance of our system on public datasets and real-world experiments and compare against other state-of-the-art algorithms. We also perform an onboard closed-loop autonomous flight on the microaerial-vehicle platform and port the algorithm to an iOS-based demonstration. We highlight that the proposed work is a reliable, complete, and versatile system that is applicable for different applications that require high accuracy in localization. We open source our implementations for both PCs (https://github.com/HKUST-Aerial-Robotics/VINS-Mono) and iOS mobile devices (https://github.com/HKUST-Aerial-Robotics/VINS-Mobile).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In terms of vision-IMU-GPS fusion, VINS-Fusion has become a mainstream solution for large-scale, high-precision localization and is widely used in UAVs and mobile robots.”
From Multimodal fusion and vision–language models: A survey for robot vision (2026) · cites this paper as [151]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multiple View Geometry in Computer Vision
Hartley, R., & Zisserman, A. (2004) · doi:10.1017/cbo9780511811685 · Cited by 21,070
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897 · cited 3×
“Relative pose error [42] in MH_05_difficult.”
MethodInfluential(1981) · Cited by 11,963
Shi, J., & Tomasi (1994) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition CVPR-94 · doi:10.1109/cvpr.1994.323794 · Cited by 7,724 · cited 1×
“features are detected [32] to maintain a minimum number (100– 300) of features in each image.”
BackgroundRobust estimation of a location parameter
Huber, P. J. (1964) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177703732 · Cited by 7,228
ORB-SLAM: A Versatile and Accurate Monocular SLAM System
Mur-Artal, R., Montiel, J. M. M., & Tardos, J. D. (2015) · IEEE Transactions on Robotics · doi:10.1109/tro.2015.2463671 · Cited by 6,778 · cited 7×
“ORB-SLAM [4] is able to close loops and reuse the map, which takes advantage of Bag-of-World [6].”
BackgroundMethodInfluentialParallel Tracking and Mapping for Small AR Workspaces
Klein, G., & Murray, D. (2007) · 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2007.4538852 · Cited by 4,346
Bundle Adjustment — A Modern Synthesis
Triggs, B., McLauchlan, P. F., Hartley, R. I., & Fitzgibbon, A. W. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-44480-7_21 · Cited by 3,988 · cited 1×
“Finally, a global full bundle adjustment [36] is applied to minimize the total reprojection error of all feature observations.”
MethodA benchmark for the evaluation of RGB-D SLAM systems
Sturm, J., Engelhard, N., Endres, F., Burgard, W., & Cremers, D. (2012) · 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2012.6385773 · Cited by 3,976 · cited 3×
“TABLE I RMSE [43] IN EUROC DATASETS IN METERS”
BackgroundMethodInfluentialLSD-SLAM: Large-scale direct monocular SLAM
Engel, J., Schöps, T., & Cremers, D. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10605-2_54 · Cited by 3,851 · cited 3×
“Noticeable approaches include PTAM [1], SVO [2], LSD-SLAM [3], DSO [5], and ORB-SLAM [4].”
BackgroundMethod
Cited by
Items 301–400 of 1,001
Tightly Coupled Integration of GNSS/UWB/VIO for Reliable and Seamless Positioning
Liu, T., Li, B., Chen, G., Yang, L., Qiao, J., & Chen, W. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3314836 · Cited by 68
“Although many well-developed VIO systems have been created [36], [37], [38], [39], they typically perform INS propagation and relative pose estimation within a local frame, posing difficulties in directly integrating with absolute measurements for global positioning.”
BackgroundLvio-Fusion: A Self-adaptive Multi-sensor Fusion SLAM Framework Using Actor-critic Method
Jia, Y., Luo, H., Zhao, F., Jiang, G., Li, Y., Yan, J., Jiang, Z., & Wang, Z. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9635905 · Cited by 71
“And [7], [8] introduce various formulas that integrate visual and inertial data and implement more efficient tightly coupled systems.”
BackgroundMethodMulti-Agent Autonomy: Advancements and Challenges in Subterranean Exploration
Ohradzansky, M. T., Rush, E. R., Riley, D. G., Mills, A. B., Ahmad, S., McGuire, S., Biggie, H., Harlow, K., Miles, M. J., Frew, E. W., et al. (2022) · Field Robotics · doi:10.55417/fr.2022035 · Cited by 77
Xue, G., Wei, J., Li, R., & Cheng, J. (2022) · Sensors · doi:10.3390/s22020520 · Cited by 66
Vision-guided unmanned aerial system for rapid multiple-type damage detection and localization
Jiang, S., Cheng, Y., & Zhang, J. (2022) · Structural Health Monitoring · doi:10.1177/14759217221084878 · Cited by 65
“According to the used technique, diagnostic methods can be divided into: destructive technique when maximum load or fatigue test of samples are performed(9,10); and non-destructive technique when the state of the structure is evaluated without causing damage to it.(11,12) Due to this advantage, the nondestructive tech…”
D-LIOM: Tightly-Coupled Direct LiDAR-Inertial Odometry and Mapping
Wang, Z., Zhang, L., Shen, Y., & Zhou, Y. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3168423 · Cited by 75
“’s work [30] designed for Visual-Inertial SLAM, in this part, we present a method to initialize a LiDAR-Inertial system when the carrier is moving.”
MethodSorbo, A. D., Zampetti, F., Visaggio, C. A., Penta, M. D., & Panichella, S. (2023) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3564821 · Cited by 66
“The state estimation step enables navigation and autonomous driving of UAVs [143].”
BackgroundGao, C., Wang, X., Wang, R., Zhao, Z., Zhai, Y., Chen, X., & Chen, B. M. (2023) · Automation in Construction · doi:10.1016/j.autcon.2023.104753 · Cited by 68
iADA*-RL: Anytime Graph-Based Path Planning with Deep Reinforcement Learning for an Autonomous UAV
Maw, A. A., Tyan, M., Nguyễn, T. A., & Lee, J.-W. (2021) · Applied Sciences · doi:10.3390/app11093948 · Cited by 69
“García, J.; Molina, J.M. Simulation in real conditions of navigation and obstacle avoidance with PX4/Gazebo platform.”
MethodView Path Planning via Online Multiview Stereo for 3-D Modeling of Large-Scale Structures
Song, S., Kim, D., & Choi, S. (2021) · IEEE Transactions on Robotics · doi:10.1109/tro.2021.3083197 · Cited by 68
UAV Vision Aided INS/Odometer Integration for Land Vehicle Autonomous Navigation
Dong, J., Ren, X., Han, S., & Luo, S. (2022) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2022.3151729 · Cited by 59
Song, B., Yuan, X., Ying, Z., Yang, B., Song, Y. H., & Zhou, F. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3280533 · Cited by 69
“In the experiments, we thoroughly compared the proposed method with classical static SLAM algorithms (such as VINS-Mono [29], ORB-SLAM2 [5], and DSO [36]), the semantic dynamic SLAM system DS-SLAM [8], and the visual–inertial fusion SLAM system Dynamic_VINS [37].”
MethodToward Autonomous Bridge Inspection: A framework and experimental results
Jung, S., Song, S., Kim, S., Park, J. H., Her, J., Roh, K., & Myung, H. (2019) · International Conference on Ubiquitous Robots (UR) · doi:10.1109/urai.2019.8768677 · Cited by 61
The UMA-VI dataset: Visual–inertial odometry in low-textured and dynamic illumination environments
Zuñiga-Noël, D., Jaenal, A., Gomez-Ojeda, R., & González-Jiménez, J. (2020) · The International Journal of Robotics Research · doi:10.1177/0278364920938439 · Cited by 74
Legged Robot State Estimation With Dynamic Contact Event Information
Kim, J.-H., Hong, S., Ji, G., Jeon, S.-H., Hwangbo, J., Oh, J.-H., & Park, H.-W. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3093876 · Cited by 74
“Successful implementation of both types of sensors in the robotics field was done in various ways [2]–[12], and most of them can be classified as full smoother [3], [5], [9], fixed-lag smoother (or sliding-window filter) [2], [7], [10]–[12], and filter [4].”
MethodAssistive Delivery Robot Application for Real-World Postal Services
Lee, D., Kang, G., Kim, B., & Shim, D. H. (2021) · IEEE Access · doi:10.1109/access.2021.3120618 · Cited by 67
IMU Data Processing For Inertial Aided Navigation: A Recurrent Neural Network Based Approach
Zhang, M., Zhang, M., Chen, Y., & Li, M. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561172 · Cited by 69
“Results of VINS are the reported ones in [30].”
InfluentialJiang, H., Li, T., Song, D., & Shi, C. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3154054 · Cited by 60
P$^{3}$-VINS: Tightly-Coupled PPP/INS/Visual SLAM Based on Optimization Approach
Li, T., Pei, L., Xiang, Y., Yu, W., & Truong, T. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3180441 · Cited by 61
BIM-supported scan and flight planning for fully autonomous LiDAR-carrying UAVs
Song, C., Chen, Z., Wang, K., Luo, H., & Cheng, J. C. P. (2022) · Automation in Construction · doi:10.1016/j.autcon.2022.104533 · Cited by 63
Zheng, Z., Lin, S., & Yang, C. (2024) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2024.3363744 · Cited by 65
“In the 21st century, visual and visual-inertial SLAM (VI-SLAM) gradually matured, giving rise to excellent open-source algorithms like DTAM [1], LSD-SLAM [2], ORB-SLAM3 [3], MSCKF [4], VINS-mono [5], etc.”
BackgroundContact-Aided Invariant Extended Kalman Filtering for Legged Robot State Estimation
Hartley, R., Jadidi, M. G., Grizzle, J. W., & Eustice, R. M. (2018) · Robotics: Science and Systems · doi:10.15607/rss.2018.xiv.050 · Cited by 69
“alking on uneven terrains and as a basis for high-level motion planning. Although there have been many recent advancements in visual-inertial-odometry and simultaneous localization and mapping (SLAM) [66,48,38], these algorithms often rely on visual data for pose estimation. This means that the observer (and ultimatel…”
BackgroundRedesigning SLAM for Arbitrary Multi-Camera Systems
Kuo, J., Muglikar, M., Zhang, Z., & Scaramuzza, D. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9197553 · Cited by 69
“This criterion in used in [8], [10], [11], and [14].”
MethodAslan, M. F., Durdu, A., Yusefi, A., & Yılmaz, A. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.09.001 · Cited by 63
Xu, Z., Xiu, Y., Zhan, X., Chen, B., & Shimada, K. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160638 · Cited by 56
Wen, S., Tao, S., Liu, X., Babiarz, A., & Yu, F. R. (2024) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2024.3396858 · Cited by 73
“At the same time, we compared it with other state-of-the-art SLAM systems DynaVINS [26], ORB-SLAM3 [1], VINS-Fusion [27], and DynaSLAM [7].”
MethodResultComparison of modern open-source Visual SLAM approaches
Sharafutdinov, D., Griguletskii, M., Kopanev, P., Kurenkov, M., Ferrer, G., Бурков, А. В., Gonnochenko, A., & Tsetserukou, D. (2023) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-023-01812-7 · Cited by 63
“VINS-Mono (Qin et al., 2018) and VINS-Fusion are graph-based VIO approaches.”
MethodElastic Tracker: A Spatio-temporal Trajectory Planner for Flexible Aerial Tracking
Ji, J., Pan, N., Xu, C., & Gao, F. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9811688 · Cited by 75
Visual Semantic Localization based on HD Map for Autonomous Vehicles in Urban Scenarios
Wang, H., Xue, C., Zhou, Y., Wen, F., & Zhang, H. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561459 · Cited by 67
RNIN-VIO: Robust Neural Inertial Navigation Aided Visual-Inertial Odometry in Challenging Scenes
Chen, D., Wang, N., Xu, R., Xie, W., Bao, H., & Zhang, G. (2021) · 2021 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) · doi:10.1109/ismar52148.2021.00043 · Cited by 48
“For motion initialization, we refer to this work [27].”
BackgroundMethodInfluentialFast ORB-SLAM Without Keypoint Descriptors
Fu, Q., Yu, H., Wang, X., Yang, Z., He, Y., Zhang, H., & Mian, A. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3136710 · Cited by 64
“Similar works with an IMU include [30]–[32].”
Vision-Based Learning for Drones: A Survey
Xiao, J., Zhang, R., Zhang, Y., & Feroskhan, M. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3564184 · Cited by 83
“Cameras can provide positioning for drone navigation in GPS-denied environments via visual inertial odometry (VIO) [43], [44], [45] and visual simultaneous localization and mapping systems (V-SLAMs) [35], [46], [47].”
Observability-Aware Self-Calibration of Visual and Inertial Sensors for Ego-Motion Estimation
Schneider, T., Li, M., Cadena, C., Nieto, J. I., & Siegwart, R. (2019) · IEEE Sensors Journal · doi:10.1109/jsen.2019.2893809 · Cited by 60
“Newer frameworks e.g. from Qin et al. [6] or Schneider et al. [7] also incorporate online localization/loop-closures to further reduce the drift or in certain cases even eliminate it completely.”
Lidar/UWB Fusion Based SLAM With Anti-Degeneration Capability
Zhou, H., Yao, Z. Q., & Lu, M. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.3045767 · Cited by 56
MILIOM: Tightly Coupled Multi-Input Lidar-Inertia Odometry and Mapping
Nguyen, T.-M., Yuan, S., Cao, M., Lyu, Y., Nguyen, T. H., & Xie, L. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3080633 · Cited by 58
Li, X., Yu, H., Wang, X., Li, S., Zhou, Y., & Chang, H. (2023) · IEEE Sensors Journal · doi:10.1109/jsen.2023.3278723 · Cited by 57
“In the optimization-based algorithm, we have to repropagate IMU measurements between two consecutive frames as soon as the system state is adjusted, which is computationally demanding [30].”
MethodLTA‐OM: Long‐term association LiDAR–IMU odometry and mapping
Zou, Z., Yuan, C., Xu, W. D., Li, H., Zhou, S., Xue, K., & Zhang, F. (2024) · Journal of Field Robotics · doi:10.1002/rob.22337 · Cited by 60
“A SLAM system can estimate the trajectory of a moving platform and the map of the surrounding environment (e.g., Figure 1) in real ‐ time by processing the data from Light Detection and Rangings (LiDARs) (Xu et al., 2022; Zhang & Singh, 2014) or cameras (Mur ‐ Artal et al., 2015; Qin et al., 2018).”
PPP ambiguity resolution based on factor graph optimization
Xiao, G., Yang, C., Wei, H., Xiao, Z., Zhou, P., Li, P. L., Dai, Q., Zhang, B., & Yu, C. (2024) · GPS Solutions · doi:10.1007/s10291-024-01715-6 · Cited by 58
“The applicability of FGO has been proven efficient for Camera/LiDAR/IMU data processing with various open-sourced libraries (Qin et al. 2018; Shan et al. 2020).”
Self-citationTightly-Coupled Visual-Inertial Localization and 3-D Rigid-Body Target Tracking
Eckenhoff, K., Yang, Y., Geneva, P., & Huang, G. P. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2896472 · Cited by 64
“The recent development of IMU preintegration has allowed for even more efficient batch-based solutions [4], [12]–[14].”
BackgroundAutonomous navigation of MAVs in unknown cluttered environments
Campos‐Macías, L., Aldana‐López, R., de la Guardia, R., Parra‐Vilchis, J. I., & Gómez‐Gutiérrez, D. (2020) · Journal of Field Robotics · doi:10.1002/rob.21959 · Cited by 56
“Existing visual inertial odometry techniques, such as [17] [18], are adequate for navigation as drift can be expected to be low at least within the local planning area around the robot.”
BackgroundExperimental Comparison of Visual-Aided Odometry Methods for Rail Vehicles
Tschopp, F., Schneider, T., Palmer, A. W., Nourani‐Vatani, N., Cadena, C., Siegwart, R., & Nieto, J. I. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2897169 · Cited by 54
“[9] proposes a VIO algorithm based on indirect tightly coupled non-linear optimization.”
MethodPIRVS: An Advanced Visual-Inertial SLAM System with Flexible Sensor Fusion and Hardware Co-Design
Zhang, Z., Liu, S., Tsai, G., Hu, H., Chu, C.-C., & Zheng, F. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8460672 · Cited by 62
Monocular Localization with Vector HD Map (MLVHM): A Low-Cost Method for Commercial IVs
Xiao, Z., Yang, D., Wen, T., Jiang, K., & Yan, R. (2020) · Sensors · doi:10.3390/s20071870 · Cited by 63
Range-Visual-Inertial Odometry: Scale Observability Without Excitation
Delaune, J., Bayard, D. S., & Brockers, R. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3058918 · Cited by 60
“Some solutions use image feature coordinates for measurements [10], [12], [13] while others use image intensity values [11], [14].”
MethodA Survey of Simultaneous Localization and Mapping with an Envision in 6G Wireless Networks
Huang, B., Zhao, J., Luo, S., & Liu, J. (2021) · Journal of Global Positioning Systems · doi:10.5081/jgps.17.1.94 · Cited by 75
VS-Net: Voting with Segmentation for Visual Localization
Huang, Z., Zhou, H., Li, Y., Yang, B., Xu, Y., Zhou, X., Bao, H., Zhang, G., & Li, H. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00604 · Cited by 68
“Localization [58, 44, 40] is a pivotal technique in many real-world applications, such as Augmented Reality (AR), Virtual Reality (VR), robotics, etc.”
MethodUnmanned aerial vehicle navigation in underground structure inspection: A review
Zhang, R., Hao, G., Zhang, K., & Li, Z. (2023) · Geological Journal · doi:10.1002/gj.4763 · Cited by 57
“Famous algorithms include Vins-Mono (Qin et al., 2018), Vins-Fusion,”
EqVIO: An Equivariant Filter for Visual-Inertial Odometry
van Goor, P., & Mahony, R. E. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2023.3289587 · Cited by 81
GICI-LIB: A GNSS/INS/Camera Integrated Navigation Library
Chi, C., Zhang, X., Liu, J., Sun, Y., Zhang, Z., & Zhan, X. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3324825 · Cited by 62
“UnlikeGNSS,thestateestimationproblem forvisualnavigationcanbecategorizedaseitherfilter-based methods[17],[18]oroptimization-basedmethods[19],[20], [21].”
Incremental Visual-Inertial 3D Mesh Generation with Structural Regularities
Rosinol, A., Sattler, T., Pollefeys, M., & Carlone, L. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8794456 · Cited by 68
“We observe a 19% improvement compared to the next best performing algorithm (SVO-GTSAM) in dataset V1 01, and a 26% improvement in dataset V1 02 compared to ROVIO and VINS-MONO, which achieve the next best results.”
MethodIntegrated Motion Planner for Real-time Aerial Videography with a Drone in a Dense Environment
Jeon, B. F., Lee, Y.-W., & Kim, H. J. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9196703 · Cited by 67
“Video filming has been one of the most popular applications of unmanned aerial vehicles equipped with vision sensors, utilizing their maneuverability and technologies such visual odometry [1] and mapping [2], [3].”
Wi-drone: wi-fi-based 6-DoF tracking for indoor drone flight control
Chi, G., Yang, Z., Xu, J., Wu, C., Zhang, J., Liang, J., & Liu, Y. (2022) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3498361.3538936 · Cited by 67
“We compare Wi-Drone with several related systems, which can be divided into three categories: • Visual-inertial-basedposetrackingsystem , VINS-Mono [29],which leverages both the monocular camera and IMU for accurate drone 6-DoF pose tracking and has already been embedded in today’s drone flight…”
BackgroundMethodInfluentialImproving RGB-D SLAM accuracy in dynamic environments based on semantic and geometric constraints
Wang, X., Zheng, S., Lin, X., & Zhu, F. (2023) · Measurement · doi:10.1016/j.measurement.2023.113084 · Cited by 58
MARS-LVIG dataset: A multi-sensor aerial robots SLAM dataset for LiDAR-visual-inertial-GNSS fusion
Li, H., Zou, Y., Chen, N., Lin, J., Liu, X., Xu, W. D., Zheng, C., Li, R., He, D., Kong, F., et al. (2024) · The International Journal of Robotics Research · doi:10.1177/02783649241227968 · Cited by 59
“Furthermore, the combination of LiDAR, camera, and IMU has distinct advantages in handling continuous movements during mobile mapping and can build high-accuracy, high-resolution, and full RGB-colored 3D models of the traveled environment (Lin and Zhang, 2022; Zheng et al., 2022; Qin et al., 2018).”
Optimal Time Allocation for Quadrotor Trajectory Generation
Gao, F., Wu, W., Pan, J., Zhou, B., & Shen, S. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593579 · Cited by 52
“2) Outdoor Test: We use visual-inertial fusion [18] with the minimum sensing suite: one camera and one IMU, for pose feedback in outdoor experiments.”
MethodSelf-citationMagicVO: An End-to-End Hybrid CNN and Bi-LSTM Method for Monocular Visual Odometry
Jiao, J., Jiao, J., Mo, Y., Liu, W., & Deng, Z. (2019) · IEEE Access · doi:10.1109/access.2019.2926350 · Cited by 58
“In addition, VINS-Mono is a VO algorithm designed for drones [10].”
MethodMulti-Camera Visual-Inertial Navigation with Online Intrinsic and Extrinsic Calibration
Eckenhoff, K., Geneva, P., Bloecker, J., & Huang, G. P. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8793886 · Cited by 63
“In comparison to the stateof-the-art VINS [1, 8, 9, 14], we not only online calibrate all spatial and temporal calibration parameters between the used sensors but also jointly estimate the intrinsics for each camera, allowing for online refinement of these parameters.”
BackgroundMulti-user augmented reality with communication efficient and spatially consistent virtual objects
Ran, X., Slocum, C., Tsai, Y.-Z., Apicharttrisorn, K., Gorlatova, M. A., & Chen, J. (2020) · ACM International Conference on emerging Networking EXperiments and Technologies (CoNEXT) · doi:10.1145/3386367.3431312 · Cited by 54
“This is done on top of the default keyframe selection already performed by SLAM frameworks such as ORB-SLAM2 [38] or VINS [41].”
BackgroundMethodInfluentialVisibility-aware Trajectory Optimization with Application to Aerial Tracking
Wang, Q., Gao, Y., Ji, J., Xu, C., & Gao, F. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636753 · Cited by 51
“Real-world experiments are presented on the same quadrotor platform of [17], which is localized by a robust visualinertial state estimator [18].”
MethodEfficient Deep Visual and Inertial Odometry with Adaptive Visual Modality Selection
Yang, M., Chen, Y., & Kim, H.-S. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19839-7_14 · Cited by 77
A Factor Graph Optimization Method for High-Precision IMU-Based Navigation System
Lyu, P., Wang, B., Lai, J., Bai, S., Liu, M., & Yu, W. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3291779 · Cited by 51
“Inspired by [10], this article also employs a sliding window with a marginalization algorithm to deal with the state of historical moments.”
MethodInfluentialA Comprehensive Review of Humanoid Robots
Sheng, Q., Zhou, Z., Li, J., Mi, X., Xiang, P., Chen, Z., Xu, H., Jia, S., Wu, X., Cui, Y., et al. (2025) · SmartBot · doi:10.1002/smb2.12008 · Cited by 70
Radar Inertial Odometry With Online Calibration
Doer, C., & Trommer, G. F. (2020) · European Navigation Conference (ENC) · doi:10.23919/enc48637.2020.9317343 · Cited by 57
“Therefore, the application of camera based approaches like Visual Inertial Odometry (VIO) [3, 4] or Li-dar based approaches [5] cannot be used.”
MethodHigh Speed and High Dynamic Range Video with an Event Camera
Rebecq, H., Ranftl, R., Koltun, V., & Scaramuzza, D. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2963386 · Cited by 50
“Second, exploiting the sparsity of the TABLE 4 Mean Translation Error (in Meters) on the Sequences from [38] Inputs Ours E+I U.SLAM E+I U.SLAM E+F+I HF E+I MR E+I VINS-Mono F+I shapes_translation 0.18 0.32 0.17 failed 2.00 0.93 poster_translation 0.05 0.09 0.06 0.49 0.15 failed boxes_translation 0.15 0.81 0.26 0.70 0.…”
BackgroundMethodInfluentialOptimal Time Difference-Based TDCP-GPS/IMU Navigation Using Graph Optimization
Lyu, P., Bai, S., Lai, J., Wang, B., Sun, X., & Huang, K. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3125990 · Cited by 50
A Novel INS/USBL Integrated Navigation Scheme via Factor Graph Optimization
Zhang, L., Hsu, L., & Zhang, T. (2022) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2022.3177739 · Cited by 50
“According to the Jacobian matrix and covariance matrix, the pre-integration measurements with respect to bias can be computed as follows [15].”
BackgroundMethodInfluentialSwarm-LIO: Decentralized Swarm LiDAR-inertial Odometry
Zhu, F., Ren, Y., Kong, F., Wu, H., Liang, S., Chen, N., Xu, W., & Zhang, F. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10161355 · Cited by 69
Resilient Multi-Sensor UAV Navigation with a Hybrid Federated Fusion Architecture
Negru, S. A., Geragersian, P., Petrunin, I. V., & Guo, W. (2024) · Sensors · doi:10.3390/s24030981 · Cited by 55
“The paper implements a VINS-mono [49] algorithm that gathers real data from a monocular camera mounted on a UAV pointing downward.”
MethodVisual-Odometric Localization and Mapping for Ground Vehicles Using SE(2)-XYZ Constraints
Fan, Z., & Liu, Y. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8793928 · Cited by 51
“State-of-the-art VINS methods include [9] [10] [11], among which [9] uses nonlinear optimization to performing visual inertial estimation, and [10] [11] added the functionality of loop closure and map reuse.”
MethodUncertainty Estimation for Data-Driven Visual Odometry
Costante, G., & Mancini, M. (2020) · IEEE Transactions on Robotics · doi:10.1109/tro.2020.3001674 · Cited by 57
“The growing interest toward autonomous driving platforms and micro aerial vehicles (MAVs) and the associated need for reliable and safe systems has increased the demand for more robust solutions for VO, or, more in general, for the SLAM problem [1]–[3].”
BackgroundLim, H., Yeon, S., Ryu, S., Lee, Y., Kim, Y., Yun, J.-S., Jung, E., Lee, D., & Myung, H. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9812018 · Cited by 67
Sensors and Sensor Fusion Methodologies for Indoor Odometry: A Review
Yang, M., Sun, X. S., Jia, F., Rushworth, A. G. A., Dong, X., Zhang, S., Fang, Z., Yang, G., & Liu, B. (2022) · Polymers · doi:10.3390/polym14102019 · Cited by 55
Online Self-Calibration for Visual-Inertial Navigation: Models, Analysis, and Degeneracy
Yang, Y., Geneva, P., Zuo, X., & Huang, G. P. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2023.3275878 · Cited by 74
“Note that OpenVINS [10] 4 and VINS-Mono [13] assume good IMU intrinsic calibration and thus are unable to work well on the uncalibrated raw datasets.”
BackgroundMethodAGRI-SLAM: a real-time stereo visual SLAM for agricultural environment
Islam, R., Habibullah, H., & Hossain, T. (2023) · Autonomous Robots · doi:10.1007/s10514-023-10110-y · Cited by 55
“The approximate CPU and RAM utilization are presented in Table 7 according to different datasets and different tested methods (Mur-Artal&Tardós, 2017;Gomez et al., 2017;Qin et al., 2018).”
BackgroundMethodInfluentialA Survey of Visual SLAM Methods
Sahili, A. R., Hassan, S. A., Sakhrieh, S., Mounsef, J., Maalouf, N., Arain, B., & Taha, T. (2023) · IEEE Access · doi:10.1109/access.2023.3341489 · Cited by 63
Edge-Assisted Epipolar Transformer for Industrial Scene Reconstruction
Tong, W., Guan, X., Zhang, M., Li, P., Ma, J., Wu, E. Q., & Zhu, L. (2024) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2023.3330704 · Cited by 59
“With the development of high-quality imaging sensors [13] and the powerful feature extraction ability of deep neural network [14], [15], [16], [17], the performance of monocular depth estimation [18], stereo matching [19], [20], [21] and MVS [22], [23] has made remarkable progress.”
Self-citationDevelopment and trends of chicken farming robots in chicken farming tasks: A review
Yang, D., Cui, D., & Ying, Y. B. (2024) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2024.108916 · Cited by 56
Graph-based adaptive weighted fusion SLAM using multimodal data in complex underground spaces
Lin, X., Yang, X., Yao, W., Wang, X., Ma, X., & Ma, B. (2024) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2024.08.007 · Cited by 53
Survey on path and view planning for UAVs
Zhou, X., Yi, Z., Liu, Y., Huang, K., & Huang, H. F. (2020) · Virtual Reality & Intelligent Hardware · doi:10.1016/j.vrih.2019.12.004 · Cited by 51
“Qin et al. [29] demonstrated that the combination of inertial measurement unit (IMU) data and RGB images could increase the accuracy of reconstructed points significantly.”
BackgroundGraph-Based Thermal–Inertial SLAM With Probabilistic Neural Networks
Saputra, M. R. U., Lu, C. X., de Gusmão, P. P. B., Wang, B., Markham, A., & Trigoni, N. (2021) · IEEE Transactions on Robotics · doi:10.1109/tro.2021.3120036 · Cited by 62
Huai, J., Lin, Y., Zhuang, Y., Toth, C. K., & Chen, D. (2022) · IEEE Transactions on Robotics · doi:10.1109/tro.2022.3172474 · Cited by 56
“For comparison, OKVIS [11], VINS-Mono [32], and OpenVINS [10] were used.”
BackgroundMethodInfluentialRSO-SLAM: A Robust Semantic Visual SLAM With Optical Flow in Complex Dynamic Environments
Qin, L., Wu, C. W., Chen, Z., Kong, X., Lv, Z., & Zhao, Z. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3402241 · Cited by 59
“Classic visual odometry methods based on optical flow residuals, such as DSO [1] and VINS [36], often implicitly mitigate the influence of dynamic objects during the optimization process.”
MethodDeng, T., Wang, Y., Xie, H., Wang, H., Guo, R., Wang, J., Wang, D., & Chen, W. (2025) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2025.3541064 · Cited by 55
“Some sparse mapping methods [1], [24], [25], which are then proposed that use manipulated keypoint for tracking, mapping, relocalization, and loop closing.”
Tightly-Coupled Aided Inertial Navigation with Point and Plane Features
Yang, Y., Geneva, P., Zuo, X., Eckenhoff, K., Liu, Y., & Huang, G. P. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8794078 · Cited by 55
“, optical or event cameras [1, 2, 3, 4, 5, 6, 7], imaging sonars [8, 9] and LiDAR [10]) will be fused to improve the estimation consistency and accuracy.”
ShareAR: Communication-Efficient Multi-User Mobile Augmented Reality
Ran, X., Slocum, C., Gorlatova, M. A., & Chen, J. (2019) · ACM Workshop on Hot Topics in Networks (HotNets) · doi:10.1145/3365609.3365867 · Cited by 51
“Therefore, we propose extending an existing open-source single-user AR system [26] with multi-user functionality (which we call ShareAR) and use it to measure the performance tradeoffs, which can help provide guidelines on which architecture to use for a given AR application, environmental context, and network conditi…”
MethodThermal-Inertial Odometry for Autonomous Flight Throughout the Night
Delaune, J. H., Hewitt, R. A., Lytle, L., Sorice, C., Thakker, R., & Matthies, L. H. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8968238 · Cited by 60
“In either case, indirect approaches optimize on feature coordinates [8], [10] while direct ones optimize on image intensity values [9], [11].”
BackgroundAn Online Initialization and Self-Calibration Method for Stereo Visual-Inertial Odometry
Huang, W., Liu, H., & Wan, W. (2020) · IEEE Transactions on Robotics · doi:10.1109/tro.2019.2959161 · Cited by 52
“mance, the proposed method was compared with the VINSMono [19],which exhibits high performance on several datasets.”
MethodInfluentialRobust and Autonomous Stereo Visual-Inertial Navigation for Non-Holonomic Mobile Robots
Chae, H.-W., Choi, J., & Song, J.-B. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.3004163 · Cited by 55
“VINS-Fusion, which was developed in a follow-up study to VINS-Mono [3], exhibited RMS errors of 4.9 and 3.64 m in the x and y directions, respectively, which is similar to that of KAVIN.”
ResultInfluentialAn Outline of Multi-Sensor Fusion Methods for Mobile Agents Indoor Navigation
Qu, Y., Yang, M., Zhang, J., Xie, W., Qiang, B., & Chen, J. (2021) · Sensors · doi:10.3390/s21051605 · Cited by 57
HybVIO: Pushing the Limits of Real-time Visual-inertial Odometry
Seiskari, O., Rantalankila, P., Kannala, J., Ylilammi, J., Rahtu, E., & Solin, A. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00036 · Cited by 56
“We compared our approach to the current-state-of-the-art [5, 24, 28, 41, 42] in three academic benchmarks.”
ResultFlexible and Resource-Efficient Multi-Robot Collaborative Visual-Inertial-Range Localization
Nguyen, T. H., Nguyen, T., & Xie, L. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3136286 · Cited by 47
Li, X., Li, S., Zhou, Y., Shen, Z., Wang, X., Li, X., & Wen, W. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3201694 · Cited by 55
“Currently, substantial research efforts have been devoted to various VINS estimators, such as VINS-Mono [14], MSCKF [15] and ORB-SLAM3 [16], which could achieve impressive performance in the local pose estimation.”
BackgroundA Real-Time Stereo Visual-Inertial SLAM System Based on Point-and-Line Features
Liu, X., Wen, S., & Zhang, H. (2023) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2022.3233721 · Cited by 51
“…frame, we can obtain where α kk + 1 , β kk + 1 and γ kk + 1 are the preintegration value betwwen the k th frame and the ⎡ In the proposed method, we assume that the change of bias is small, so the method in VINS-Mono [3] can be used to perform a first-order Taylor approximation of α , β , and γ .”
MethodInfluentialQuatro++: Robust global registration exploiting ground segmentation for loop closing in LiDAR SLAM
Lim, H., Kim, B., Kim, D., Lee, E. M., & Myung, H. (2023) · The International Journal of Robotics Research · doi:10.1177/02783649231207654 · Cited by 67
“In general, the graph-based SLAM mainly consists of three parts (Thrun and Montemerlo 2006; Grisetti et al. 2010; Qin et al. 2018; Shan et al. 2020): a) odometry, which estimates relative pose between the consecutive frames, b) loop detection, which achieves data association between two…”
BackgroundA Quadrotor With an Origami-Inspired Protective Mechanism
Shu, J., & Chirarattananon, P. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2929978 · Cited by 47
“Following the advances in flight dynamics and control [1], planning and localization [2], [3], etc.”
BackgroundAn Efficient Schmidt-EKF for 3D Visual-Inertial SLAM
Geneva, P., Maley, J., & Huang, G. P. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01238 · Cited by 55
“To date, various algorithms are available for VINS problems including visual-inertial (VI)-SLAM [19, 45] and visual-inertial odometry (VIO) [30, 29, 22], such as the extended Kalman filter (EKF) [30, 20, 14, 22, 17, 16, 50, 37], unscented Kalman filter (UKF) [10, 4], and batch or slidingwindow optimization methods [46…”
InfluentialChoi, J., & Myung, H. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341682 · Cited by 60
“VINS-mono [8] is used as a comparison algorithm.”
LodoNet: A Deep Neural Network with 2D Keypoint Matching for 3D LiDAR Odometry Estimation
Zheng, C., Lyu, Y., Li, M., & Zhang, Z. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413771 · Cited by 64
“(LiDAR). Camera is first selected for odometry estimation because it is cost efficient and there exist well-studied image feature extractors to support. However, camera based methods such as VINS-Mono[22], DVSO[35], and GANVO[1] highly subject to the accuracy of camera calibration, and it is difficult to transfer from…”
MethodLeveraging Planar Regularities for Point Line Visual-Inertial Odometry
Li, X., He, Y., Lin, J., & Liu, X. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341278 · Cited by 54
“To assess the advantages of our proposed approach, we compared our method with OKVIS with monocular mode [3], VINS-Mono [2] without loop closure, PL-VIO [10], PPVIO [8].”
BackgroundMethodInfluentialUniVIO: Unified Direct and Feature-Based Underwater Stereo Visual-Inertial Odometry
Miao, R., Qian, J., Yang, S. S., Ying, R., & Liu, P. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3136259 · Cited by 58
“On the other hand, the nonlinear optimization-based methods optimize sensor states and pose within the selective keyframes , such as open keyframe-based visual-inertial SLAM (OKVIS) [28], VI-ORB-SLAM [29], ORB-SLAM3 [30], monocular visual-inertial system (VINS-Mono) [31], and VINS-Fusion [32].”
MethodInfluential
Metadata
- Authors
- Qin, T., Li, P., & Shen, S.
- Affiliations
- Hong Kong University of Science and Technology (HK)
- Venue
- IEEE Transactions on Robotics
- Published
- 2018-08
- Volume
- 34
- Issue
- 4
- Pages
- 1004-1020
- ISSN
- 1552-3098 (ISSN-L)
- 1941-0468
- OpenAlex
- W2745859992
- Cited by
- 4,669
- References
- 53
- Citations by year
- 2026: 575 · 2025: 856 · 2024: 789 · 2023: 729 · 2022: 571 · 2021: 469 · 2020: 357 · 2019: 248 · 2018: 73
- FWCI
- 233.33
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- IEEE Transactions on Robotics (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Hong Kong Research Grants Council Early Career Scheme (26201616)
- HKUST Proof-of-Concept (PCF.009.16/17)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
- Physical Sciences › Engineering › Aerospace Engineering › Inertial Sensor and Navigation
- Physical Sciences › Engineering › Aerospace Engineering › Aerospace Engineering and Control Systems
- Keywords
- loop detection, relocalization, pose graph optimization, autonomous flight
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.