On-Manifold Preintegration for Real-Time Visual--Inertial Odometry
Open accessThe DOI matches its Crossref record; 83 of the 83 references it cites were found in a registry or an index.
Abstract
Current approaches for visual-inertial odometry (VIO) are able to attain highly accurate state estimation via nonlinear optimization. However, real-time optimization quickly becomes infeasible as the trajectory grows over time; this problem is further emphasized by the fact that inertial measurements come at high rate, hence, leading to the fast growth of the number of variables in the optimization. In this paper, we address this issue by preintegrating inertial measurements between selected keyframes into single relative motion constraints. Our first contribution is a preintegration theory that properly addresses the manifold structure of the rotation group. We formally discuss the generative measurement model as well as the nature of the rotation noise and derive the expression for the maximum a posteriori state estimator. Our theoretical development enables the computation of all necessary Jacobians for the optimization and a posteriori bias correction in analytic form. The second contribution is to show that the preintegrated inertial measurement unit model can be seamlessly integrated into a visual-inertial pipeline under the unifying framework of factor graphs. This enables the application of incremental-smoothing algorithms and the use of a structureless model for visual measurements, which avoids optimizing over the 3-D points, further accelerating the computation. We perform an extensive evaluation of our monocular VIO pipeline on real and simulated datasets. The results confirm that our modeling effort leads to an accurate state estimation in real time, outperforming state-of-the-art approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multiple View Geometry in Computer Vision
Hartley, R., & Zisserman, A. (2004) · doi:10.1017/cbo9780511811685 · Cited by 21,070
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897 · cited 2×
“We use the relative error metrics proposed in [68] to obtain error statistics.”
MethodEstimation with Applications to Tracking and Navigation: Theory, Algorithms and Software
Bar‐Shalom, Y., Li, X. ‐., & Kirubarajan, T. (2002) · doi:10.1002/0471221279 · Cited by 6,782
A Mathematical Introduction to Robotic Manipulation
Murray, R. M., Li, Z., & Sastry, S. S. (2017) · CRC Press eBooks · doi:10.1201/9781315136370 · Cited by 6,694 · cited 1×
“For this purpose, we introduce the following kinematic model [49], [53]:”
MethodFactor graphs and the sum-product algorithm
Kschischang, F. R., Frey, B. J., & Loeliger, H.-A. (2001) · IEEE Transactions on Information Theory · doi:10.1109/18.910572 · Cited by 6,486 · cited 1×
“This naturally leads to the well known factor graph representation, a class of bipartite graphical models that can be used to represent such factored densities [51], [52].”
BackgroundParallel Tracking and Mapping for Small AR Workspaces
Klein, G., & Murray, D. (2007) · 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2007.4538852 · Cited by 4,346 · cited 1×
“A breakthrough has been the development of incremental smoothing techniques (iSAM [36], iSAM2 [3]), which leverage the expressiveness of factor graphs to maintain sparsity and to identify and update only the typically small subset of variables affected by a new measurement.”
MethodMonoSLAM: Real-time single camera SLAM
Davison, A. J., Reid, I. D., Molton, N. D., & Stasse, O. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1049 · Cited by 3,959 · cited 1×
“The complexity of the EKF grows quadratically in the number of estimated landmarks, therefore, a small number of landmarks (in the order of 20) are typically tracked to allow real-time operation [10–12].”
BackgroundMatrix Analysis and Applied Linear Algebra
Meyer, C. (2000) · doi:10.1137/1.9780898719512 · Cited by 3,565 · cited 1×
“Any basis El ∈ R2nl×2nl−3 of the null space of El satisfies the following relation [71]:”
BackgroundMatrix analysis and applied linear algebra
(2001) · Choice Reviews Online · doi:10.5860/choice.38-5065 · Cited by 3,300
Stochastic models, estimation, and control
(1982) · Mathematics in Science and Engineering · doi:10.1016/s0076-5392(08)x6186-7 · Cited by 3,229
Cited by
Items 101–200 of 1,000
Li, J., Yang, B., Chen, C., & Habib, A. F. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.10.009 · Cited by 88
Exploring Event Camera-Based Odometry for Planetary Robots
Mahlknecht, F., Gehrig, D., Nash, J., Rockenbauer, F. M., Morrell, B. J., Delaune, J. H., & Scaramuzza, D. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3187826 · Cited by 102
Self-citationZhang, Z., Zhao, J., Huang, C., & Li, L. (2022) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2022.3173662 · Cited by 83
“An alternative approach for sensor fusion is the recently developed factor graph optimization (FGO) [14], [22], [23].”
MethodReal-Time Visual–Inertial SLAM Based on Adaptive Keyframe Selection for Mobile AR Applications
Piao, J.-C., & Kim, S. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2913324 · Cited by 83
“The IMU preintegration [15] method is used to solve the computational complexity problem of the visual–inertial SLAM based on optimization method, where the integration is repeated when the bias estimate changed.”
MethodASRO-DIO: Active Subspace Random Optimization Based Depth Inertial Odometry
Zhang, J., Tang, Y., Wang, H., & Xu, K. (2022) · IEEE Transactions on Robotics · doi:10.1109/tro.2022.3208503 · Cited by 88
“2) IMU Measurement Residual: Sharing the same insight with the primary INS works [12], [15], we perform IMU measurement residual minimization.”
MethodEKF-Based Visual Inertial Navigation Using Sliding Window Nonlinear Optimization
Heo, S., Cha, J., & Park, C. G. (2018) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2018.2866637 · Cited by 77
“The formulation of the visual measurement is similar to that of the MSCKF, except that its noise is modeled on the state manifold [19].”
BackgroundMethodInfluentialVisual-Inertial Odometry with Point and Line Features
Yang, Y., Geneva, P., Eckenhoff, K., & Huang, G. P. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8967905 · Cited by 79
“He et al. [10] used IMU preintegration [16] to design a batch-optimization based visual-inertial SLAM with point and line features, where line features are represented in Pl¨ucker coordinates [17].”
MethodFrom SLAM to Situational Awareness: Challenges and Survey
Bavle, H., Sánchez-López, J. L., Cimarelli, C., Tourani, A., & Voos, H. (2023) · Sensors · doi:10.3390/s23104849 · Cited by 108
“Methods such as OKVIS [149], SVO-Multi [150], VINS-mono [151], SVO+GTSAM [152], VIDSO [153], BASALT [154] are among the most outstanding examples.”
MethodA Lightweight and Accurate Localization Algorithm Using Multiple Inertial Measurement Units
Zhang, M., Xu, X., Chen, Y., & Li, M. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2969146 · Cited by 73
“As a result, there are a variety of algorithms proposed in recently years on visual-inertial localization, ranging from estimator design [9], [21], camera cost functions [23], [24], efficiency and accuracy optimization [7], [8], sensor calibration [3], [4], and so on.”
BackgroundMethodTrifo-VIO: Robust and Efficient Stereo Visual Inertial Odometry Using Points and Lines
Zheng, F., Tsai, G., Zhang, Z., Liu, S., Chu, C.-C., & Hu, H. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8594354 · Cited by 75
Huang, W., & Liu, H. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8460206 · Cited by 78
“The details of the Jacobians can be found in [23].”
Background4D Radar-Based Pose Graph SLAM With Ego-Velocity Pre-Integration Factor
Li, X., Zhang, H., & Chen, W. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3292574 · Cited by 84
“Inspired by the pre-integration of IMU measurements in [20], we propose an ego-velocity pre-integration method.”
MethodEfficient and Consistent Bundle Adjustment on Lidar Point Clouds
Liu, Z., Liu, X., & Zhang, F. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2023.3311671 · Cited by 88
Unscented Kalman Filter on Lie Groups for Visual Inertial Odometry
Brossard, M., Bonnabel, S., & Barrau, A. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593627 · Cited by 80
Liu, X., Wen, W., & Hsu, L. (2023) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2023.3323648 · Cited by 82
VIMO: Simultaneous Visual Inertial Model-Based Odometry and Force Estimation
Nisar, B., Foehn, P., Falanga, D., & Scaramuzza, D. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2918689 · Cited by 76
“To avoid this computationally expensive repropagation, we will adopt the solution proposed in [16], and explained in Sec.”
BackgroundMethodInfluentialSelf-citationAn Intensity-Augmented LiDAR-Inertial SLAM for Solid-State LiDARs in Degenerated Environments
Li, H., Tian, B., Shen, H., & Lu, J. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3190060 · Cited by 65
Switch-SLAM: Switching-Based LiDAR-Inertial-Visual SLAM for Degenerate Environments
Lee, J., Komatsu, R., Shinozaki, M., Kitajima, T., Asama, H., An, Q., & Yamashita, A. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3421792 · Cited by 79
LiDAR, IMU, and camera fusion for simultaneous localization and mapping: a systematic review
Fan, Z., Zhang, L., Wang, X., Shen, Y., & Deng, F. Y. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11187-w · Cited by 110
On the Importance of Uncertainty Representation in Active SLAM
Rodríguez-Arévalo, M. L., Neira, J., & Castellanos, J. A. (2018) · IEEE Transactions on Robotics · doi:10.1109/tro.2018.2808902 · Cited by 67
“Equivalent representations on the Lie group SE(3) have also been considered in recent works [8]–[12] where transformations are represented by 4 × 4 matrices.”
BackgroundDrift-Free Inertial Sensor-Based Joint Kinematics for Long-Term Arbitrary Movements
Weygers, I., Kok, M., Vroey, H. D., Verbeerst, T., Versteyhe, M., Hallez, H., & Claeys, K. (2020) · IEEE Sensors Journal · doi:10.1109/jsen.2020.2982459 · Cited by 74
Edge-Assisted Multi-Robot Visual-Inertial SLAM With Efficient Communication
Liu, X., Wen, S., Zhao, J., Qiu, T. Z., & Zhang, H. (2024) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2024.3376427 · Cited by 76
“Formulate the IMU preintegration on a manifold [62], The rotation increment ∆˜R ij , velocity increment ∆˜v ij and position increment ∆˜p ij between the i th and the j th frame can be expressed as: With the benefit of IMU assisted pose estimation, we can accurately predict the position of keypoints…”
Zhang, M., Zuo, X., Chen, Y., Liu, Y., & Li, M. (2021) · IEEE Transactions on Robotics · doi:10.1109/tro.2020.3043970 · Cited by 75
“For marginalization details please refer to [14], [32].”
BackgroundInfluentialXiong, L., Kang, R., Zhao, J., Zhang, P., Xu, M., Ju, R., Ye, C., & Feng, T. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3107873 · Cited by 68
RD-VIO: Robust visual-inertial odometry for mobile augmented reality in dynamic environments
Li, J., Pan, X., Huang, G., Zhang, Z., Wang, N., Bao, H., & Zhang, G. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3353263 · Cited by 62
“At the same time, we have q IMU , p IMU predicted by applying pre-integration from frame i − 1 to frame i .”
MethodKayhani, N., Zhao, W., McCabe, B. Y., & Schoellig, A. P. (2022) · Automation in Construction · doi:10.1016/j.autcon.2021.104112 · Cited by 67
“For more information and quantitative performance comparisons between these two approaches, please refer to [73]; and (3) On-site tag placement may be subject to installation errors in practice.”
BackgroundContinuous-Time Vs. Discrete-Time Vision-Based SLAM: A Comparative Study
Cioffi, G., Cieslewski, T., & Scaramuzza, D. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3143303 · Cited by 75
“Similarly, ad-hoc solutions are needed to avoid adding a new state to the estimation problem every time a new measurement is available [4].”
BackgroundMethodInfluentialSelf-citation3D Forest Mapping Using A Low-Cost UAV Laser Scanning System: Investigation and Comparison
Li, J., Yang, B., Cong, Y., Cao, L., Fu, X., & Dong, Z. (2019) · Remote Sensing · doi:10.3390/rs11060717 · Cited by 61
“In addition, an IMU pre-integration technique [25,26] is adopted to overcome t re-pr pagation of he IMU measurements when states cha ge in optimization steps.”
BackgroundMethodInfluentialOxIOD: The Dataset for Deep Inertial OdometryPreprint
Chen, C., Zhao, P., Lu, C. X., Wang, W., Markham, A., & Trigoni, N. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.07491 · Cited by 104
“One of the common solutions is to combine IMU with a visual sensor to construct visual-inertial odometry (VIO) [7] [2] [8], showing extremely good performance in tracking mobile robots, drones, and smart phones.”
MethodEnhancing navigation performance through visual-inertial odometry in GNSS-degraded environment
Liao, J., Li, X., Wang, X., Li, S., & Wang, H. (2021) · GPS Solutions · doi:10.1007/s10291-020-01056-0 · Cited by 62
Development, integration, and field evaluation of an autonomous citrus‐harvesting robot
Yin, H., Sun, Q., Ren, X., Guo, J., Yang, Y., Wei, Y., Huang, B., Chai, X., & Zhong, M. (2023) · Journal of Field Robotics · doi:10.1002/rob.22178 · Cited by 61
“The preintegration constraints of IMU are obtained through the median integration method (Forster et al., 2017).”
MethodA direct visual servoing‐based framework for the 2016 IROS Autonomous Drone Racing Challenge
Jung, S., Cho, S., Lee, D., Lee, H., & Shim, D. H. (2017) · Journal of Field Robotics · doi:10.1002/rob.21743 · Cited by 63
D-LIOM: Tightly-Coupled Direct LiDAR-Inertial Odometry and Mapping
Wang, Z., Zhang, L., Shen, Y., & Zhou, Y. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3168423 · Cited by 75
“’s conclusion [28], the Jacobian J bω has the form,”
BackgroundMethodA Mathematical Framework for IMU Error Propagation with Applications to Preintegration
Bonnabel, S., & Barrau, A. (2020) · HAL · Cited by 59
P$^{3}$-VINS: Tightly-Coupled PPP/INS/Visual SLAM Based on Optimization Approach
Li, T., Pei, L., Xiang, Y., Yu, W., & Truong, T. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3180441 · Cited by 61
Hybrid Contact Preintegration for Visual-Inertial-Contact State Estimation Using Factor Graphs
Hartley, R., Jadidi, M. G., Gan, L., Huang, J.-K., Grizzle, J. W., & Eustice, R. M. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593801 · Cited by 70
“The factor graph smoothing framework [3]–[6] offers suitable machineries for building such systems in which real-time performance is achieved by exploiting the sparse structure of the Simultaneous Localization and Mapping (SLAM) problem [7], [8].”
MethodInfluentialContact-Aided Invariant Extended Kalman Filtering for Legged Robot State Estimation
Hartley, R., Jadidi, M. G., Grizzle, J. W., & Eustice, R. M. (2018) · Robotics: Science and Systems · doi:10.15607/rss.2018.xiv.050 · Cited by 69
“As with typical aided inertial navigation, we wish to estimate the orientation, velocity, and position of the IMU (body) in the world frame [24, 18, 30].”
Suleiman, A., Zhang, Z., Carlone, L., Karaman, S., & Sze, V. (2018) · Symposium on VLSI Circuits · doi:10.1109/vlsic.2018.8502279 · Cited by 57
Self-citationUnmanned Aerial Sensor Placement for Cluttered Environments
Farinha, A. T., Zufferey, R., Zheng, P., Armanini, S. F., & Kovač, M. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.3015459 · Cited by 61
“Vision based systems are particularly attractive, among which, visual inertial odometry (VIO) is a well developed technique [26].”
BackgroundMILIOM: Tightly Coupled Multi-Input Lidar-Inertia Odometry and Mapping
Nguyen, T.-M., Yuan, S., Cao, M., Lyu, Y., Nguyen, T. H., & Xie, L. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3080633 · Cited by 58
“Besides, to the best of our knowledge, few works have satisfactorily investigated the tight coupling of IMU preintegration factors with lidar factors in the literature, despite its extensive applications in visual-inertial systems [10]–[14].”
ROSEFusion: random optimization for online dense reconstruction under fast camera motion
Zhang, J., Zhu, C., Zheng, L., & Xu, K. (2021) · ACM Transactions on Graphics · doi:10.1145/3450626.3459676 · Cited by 463
Legged Robot State Estimation With Dynamic Contact Event Information
Kim, J.-H., Hong, S., Ji, G., Jeon, S.-H., Hwangbo, J., Oh, J.-H., & Park, H.-W. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3093876 · Cited by 74
“Throughout the derivation of residual function and covariance matrices, some of useful equations of Lie algebra are used which is well explained in [5]: Exp(φ+ δφ) ≈ Exp(φ)Exp(Jr(φ)δφ) (9)”
MethodInfluentialIMU Data Processing For Inertial Aided Navigation: A Recurrent Neural Network Based Approach
Zhang, M., Zhang, M., Chen, Y., & Li, M. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561172 · Cited by 69
“Our design also aligns well with the closed-form solutions that use ∆γ, ∆β, and ∆q for later sensor fusion [1], [28].”
Dong, X., Hu, G., Gao, B., Zhong, Y., & Wei, R. (2024) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2024.3353286 · Cited by 77
“Based on (4) and (6), the residual of the IMU factor node can be further written as [32] where r represents the residual of vehicle position, velocity, and attitude, r b ∼ stands for the residual of IMU zero bias, and Log ( · ) represents the vectorized logarithm map.”
BackgroundLegged Robot State-Estimation Through Combined Forward Kinematic and Preintegrated Contact Factors
Hartley, R., Mangelson, J., Gan, L., Ghaffari, M., Walls, J. M., Eustice, R. M., & Grizzle, J. W. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8460748 · Cited by 76
Incremental Visual-Inertial 3D Mesh Generation with Structural Regularities
Rosinol, A., Sattler, T., Pollefeys, M., & Carlone, L. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8794456 · Cited by 68
“We observe a 19% improvement compared to the next best performing algorithm (SVO-GTSAM) in dataset V1 01, and a 26% improvement in dataset V1 02 compared to ROVIO and VINS-MONO, which achieve the next best results.”
MethodSelf-citationAslan, M. F., Durdu, A., Yusefi, A., & Yılmaz, A. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.09.001 · Cited by 63
Guo, S., & Gallego, G. (2024) · IEEE Transactions on Robotics · doi:10.1109/tro.2024.3378443 · Cited by 85
“4(b)], would guarantee a fixed rate of angular velocity estimates, but accuracy would be unstable (a slow-moving camera would produce few events per packet, which would not be enough to reliably estimate motion).”
BackgroundDistributed stereo vision‐based 6D localization and mapping for multi‐robot teams
Schuster, M. J., Schmid, K., Brand, C., & Beetz, M. (2018) · Journal of Field Robotics · doi:10.1002/rob.21812 · Cited by 64
“To remove initial conditions for VINS systems and to reduce the effect of nonlinearities in the estimation process, Forster, Carlone, Dellaert and Scaramuzza (2017) and Lupton and Sukkarieh (2012) use IMU data preintegration.”
MethodRange-Visual-Inertial Odometry: Scale Observability Without Excitation
Delaune, J., Bayard, D. S., & Brockers, R. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3058918 · Cited by 60
“Some solutions use image feature coordinates for measurements [10], [12], [13] while others use image intensity values [11], [14].”
Deep IMU Bias Inference for Robust Visual-Inertial Odometry With Factor Graphs
Buchanan, R., Agrawal, V., Camurri, M., Dellaert, F., & Fallon, M. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3222956 · Cited by 54
“VIO is effective so long as visual features are available because they constrain the drift of IMU integration [5] and estimate the biases.”
InfluentialSelf-citationComparison of modern open-source Visual SLAM approaches
Sharafutdinov, D., Griguletskii, M., Kopanev, P., Kurenkov, M., Ferrer, G., Бурков, А. В., Gonnochenko, A., & Tsetserukou, D. (2023) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-023-01812-7 · Cited by 63
SLAM integrated mobile mapping system in complex urban environments
Li, S., Li, G., Wang, L., & Qin, Y. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.05.012 · Cited by 54
Graph-based Multi-sensor Fusion for Consistent Localization of Autonomous Construction Robots
Nubert, J., Khattak, S., & Hutter, M. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9812386 · Cited by 51
Traj-LO: In Defense of LiDAR-Only Odometry Using an Effective Continuous-Time Trajectory
Zheng, X., & Zhu, J. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3352360 · Cited by 69
Dense Planar-Inertial SLAM with Structural Constraints
Hsiao, M., Westman, E., & Kaess, M. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8461094 · Cited by 56
“To achieve both consistency and efficiency, we first apply the onmanifold IMU preintegration method [9] to combine all the IMU measurements between two sparsely selected frames”
BackgroundMethodInfluentialTang, S., & Kumar, V. (2018) · Annual Review of Control Robotics and Autonomous Systems · doi:10.1146/annurev-control-060117-105149 · Cited by 64
The Geometry of Navigation Problems
Barrau, A., & Bonnabel, S. (2022) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2022.3144328 · Cited by 80
“Attitude, velocity, and position of the robot are denoted byRn ∈ SO(3), vn ∈ R(3), and pn ∈ R(3), while preintegrated inertial factors [29] are denoted by Ωn ∈ SO(3), an ∈ R(3), an ∈ R(3).”
BackgroundInfluentialRobust visual-based localization and mapping for underwater vehicles: A survey
Ding, S., Zhang, T., Lei, M., Chai, H., & Jia, F. (2024) · Ocean Engineering · doi:10.1016/j.oceaneng.2024.119274 · Cited by 53
A multi-sensor fusion approach for maritime autonomous surface ships berthing navigation perception
Lu, H., Zhang, Y., Zhang, C., Niu, Y., Wang, Z., & Zhang, H. (2024) · Ocean Engineering · doi:10.1016/j.oceaneng.2024.119965 · Cited by 53
Semi-direct monocular visual and visual-inertial SLAM with loop closure detection
Li, S., Zhang, T., Gao, X., Wang, D., & Xian, Y. (2018) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2018.11.009 · Cited by 49
Tightly-Coupled Aided Inertial Navigation with Point and Plane Features
Yang, Y., Geneva, P., Zuo, X., Eckenhoff, K., Liu, Y., & Huang, G. P. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8794078 · Cited by 55
“, optical or event cameras [1, 2, 3, 4, 5, 6, 7], imaging sonars [8, 9] and LiDAR [10]) will be fused to improve the estimation consistency and accuracy.”
Visual-Odometric Localization and Mapping for Ground Vehicles Using SE(2)-XYZ Constraints
Fan, Z., & Liu, Y. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8793928 · Cited by 51
“Log(R) := θ is the rotation vector corresponding to rotation matrix; inversely there is R = Exp(θ) [8] [20].”
BackgroundMethodInfluentialUncertainty Estimation for Data-Driven Visual Odometry
Costante, G., & Mancini, M. (2020) · IEEE Transactions on Robotics · doi:10.1109/tro.2020.3001674 · Cited by 57
A Novel INS/USBL Integrated Navigation Scheme via Factor Graph Optimization
Zhang, L., Hsu, L., & Zhang, T. (2022) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2022.3177739 · Cited by 50
“With the introduction of the preintegration model [20], an inertial measurement unit (IMU) has been integrated into many navigation applications based on FGO.”
MethodA Factor Graph Optimization Method for High-Precision IMU-Based Navigation System
Lyu, P., Wang, B., Lai, J., Bai, S., Liu, M., & Yu, W. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3291779 · Cited by 51
“Forster et al. [19] and [20] addressed the manifold structure of the rotation group and offered a more formal treatment of the rotation noise, which promoted the development of the IMU preintegration theory.”
BackgroundReal-Time Constrained Nonlinear Model Predictive Control on SO(3) for Dynamic Legged Locomotion
Hong, S., Kim, J.-H., & Park, H.-W. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341447 · Cited by 49
“In the process of derivation, we will use the first-order approximation for the exponential and logarithm adopted from [12], [18],”
MethodInfluentialAn Online Initialization and Self-Calibration Method for Stereo Visual-Inertial Odometry
Huang, W., Liu, H., & Wan, W. (2020) · IEEE Transactions on Robotics · doi:10.1109/tro.2019.2959161 · Cited by 52
“The details of Jg(·) and J a (·) can be found in [53].”
BackgroundMethodBa, K.-X., Ma, G.-L., Yu, B., Jin, Z.-G., Huang, Z.-P., Zhang, J.-X., & Kong, X.-D. (2020) · International Journal of Control, Automation and Systems · doi:10.1007/s12555-019-0151-0 · Cited by 47
A Deep Reinforcement Learning Approach for Active SLAM
Placed, J. A., & Castellanos, J. A. (2020) · Applied Sciences · doi:10.3390/app10238386 · Cited by 61
“Following a reduced-order notation of [40], the state of the system at time k is given by the tuple: xk = (Rk, pk) (A1)”
MethodSensors and Sensor Fusion Methodologies for Indoor Odometry: A Review
Yang, M., Sun, X. S., Jia, F., Rushworth, A. G. A., Dong, X., Zhang, S., Fang, Z., Yang, G., & Liu, B. (2022) · Polymers · doi:10.3390/polym14102019 · Cited by 55
Improving SLAM Techniques with Integrated Multi-Sensor Fusion for 3D Reconstruction
Cai, Y., Ou, Y., & Qin, T. (2024) · Sensors · doi:10.3390/s24072033 · Cited by 56
“Our present IMU preintegration approach yields numerical outcomes that are largely consistent with those reported in References [39,40], albeit through distinct mathematical derivations.”
ResultGLIM: 3D range-inertial localization and mapping with GPU-accelerated scan matching factors
Koide, K., Yokozuka, M., Oishi, S., & Banno, A. (2024) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2024.104750 · Cited by 57
“In the context of visual SLAM, it has been shown that the optimization-based approach outperforms the filtering-based approach in terms of accuracy because it re-linearizes past measurements [27], [28].”
BackgroundMethodUnscented Kalman Filtering for Simultaneous Estimation of Attitude and Gyroscope Bias
Kang, D., Jang, C., & Park, F. C. (2019) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2019.2891776 · Cited by 49
“E STIMATING an object’s orientation, or attitude, from an inertial measurement unit (IMU) attached to the object arises in applications ranging from vehicle and robot navigation [1]–[3] to human pose tracking [4].”
Continuous-Time Visual-Inertial Odometry for Event Cameras
Mueggler, E., Gallego, G., Rebecq, H., & Scaramuzza, D. (2019) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-175988 · Cited by 46
Self-citationHybVIO: Pushing the Limits of Real-time Visual-inertial Odometry
Seiskari, O., Rantalankila, P., Kannala, J., Ylilammi, J., Rahtu, E., & Solin, A. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00036 · Cited by 56
“2 is extremely simple compared to the intricate mechanisms in [5] and [6]; we do not use the First–Estimate Jacobian methodology [11], nor model orientations as probability distributions on the SO(3) manifold [10].”
MethodRobust Inertial-Aided Underwater Localization Based on Imaging Sonar Keyframes
Xu, Y., Zheng, R., Zhang, S., & Liu, M. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3156980 · Cited by 56
“Consider an IMU kinematic model as follows [29], [30]: where p W and v W are the position and velocity in the world frame W , respectively.”
MethodUniVIO: Unified Direct and Feature-Based Underwater Stereo Visual-Inertial Odometry
Miao, R., Qian, J., Yang, S. S., Ying, R., & Liu, P. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3136259 · Cited by 58
“Later, VI-ORB-SLAM fused IMU information with visual information under ORB-SLAM scheme based on IMU prein-tegration [33] was presented by Mur-Artal and Tardós [29].”
MethodContinuous-Time Fixed-Lag Smoothing for LiDAR-Inertial-Camera SLAM
Lv, J., Lang, X., Xu, J., Wang, M., Liu, Y., & Zuo, X. (2023) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2023.3241398 · Cited by 57
“IMU measurement: Regarding the measurement processing for different sensor modalities, filter-based methods usually use IMU measurements to propagate system states, and optimization-based methods widely adopt preintegration [34] technique which integrates high-rate IMU data into a lowrate preintegration factor; contin…”
Online Self-Calibration for Visual-Inertial Navigation: Models, Analysis, and Degeneracy
Yang, Y., Geneva, P., Zuo, X., & Huang, G. P. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2023.3275878 · Cited by 74
“where exp(·) is the SO(3) matrix exponential [12].”
BackgroundMethodInfluentialAvoiding Degeneracy for Monocular Visual SLAM with Point and Line Features
Lim, H., Kim, Y., Jung, K., Hu, S., & Myung, H. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9560911 · Cited by 58
“Because this algorithm has roots in VINS-Mono, IMU measurements use the pre-integration method [26]; optimization uses twoway marginalization with Schur complement [27]; and point feature manipulation uses optical-flow, triangulation, and reprojection error.”
MethodPLC-VIO: Visual–Inertial Odometry Based on Point-Line Constraints
Liu, Z., Shi, D., Li, R., Qin, W., Zhang, Y., & Ren, X. (2021) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2021.3077026 · Cited by 49
“For VIO, though the direc-based method has faster processing speed and good accuracy performance [23], [36], most VIO algorithms in the literature are based on the feature-based method because of its robustness and maturity.”
MethodInfluentialSTEP: State Estimator for Legged Robots Using a Preintegrated Foot Velocity Factor
Kim, Y., Yu, B., Lee, E. M., Kim, J.-H., Park, H.-W., & Myung, H. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3150844 · Cited by 55
“The uncertainty in SO(3) is modeled by defining a noise distribution in the tangent space, its Lie algebra so(3), and then mapping it to SO(3) through the exponential map [7], [10], which will be explained in the following section.”
BackgroundResultInfluentialA comprehensive overview of dynamic visual SLAM and deep learning: concepts, methods and challenges
Beghdadi, A., & Mallem, M. (2022) · Machine Vision and Applications · doi:10.1007/s00138-022-01306-w · Cited by 56
Ge, Y., Zhang, L., Wu, Y., & Hu, D. (2024) · IEEE Transactions on Robotics · doi:10.1109/tro.2024.3366815 · Cited by 52
AQUA-SLAM: Tightly Coupled Underwater Acoustic-Visual-Inertial SLAM With Sensor Calibration
Xu, S., Zhang, K., & Wang, S. (2025) · IEEE Transactions on Robotics · doi:10.1109/tro.2025.3554396 · Cited by 46
Rösmann, C., Makarow, A., & Bertram, T. (2021) · European Control Conference (ECC) · doi:10.23919/ecc54610.2021.9654872 · Cited by 49
Monocular Visual-Inertial-Wheel Odometry Using Low-Grade IMU in Urban Areas
Jung, J. H., Cha, J., Chung, J. Y., Kim, T. I., Seo, M. H., Park, S. Y., Yeo, J. Y., & Park, C. G. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3018167 · Cited by 46
Hu, C. J., Huang, P. S., & Wang, W. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3328367 · Cited by 42
GNSS/Multisensor Fusion Using Continuous-Time Factor Graph Optimization for Robust Localization
Zhang, H., Chen, C.-C., Vallery, H., & Barfoot, T. D. (2024) · IEEE Transactions on Robotics · doi:10.1109/tro.2024.3443699 · Cited by 66
“We implement the GP-WNOJ motion model as between-state factors, similar to [45].”
BackgroundMethodLinear observed systems on groups
Barrau, A., & Bonnabel, S. (2019) · Systems & Control Letters · doi:10.1016/j.sysconle.2019.05.005 · Cited by 42
“The preintegration method of inertial measurements currently enjoys much popularity in robotics, see [9] and related papers.”
BackgroundMethodDVIO: An Optimization-Based Tightly Coupled Direct Visual-Inertial Odometry
Jiang, J., Yuan, J., Zhang, X., & Zhang, X. (2020) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2020.3036243 · Cited by 47
“And the effect of outliers can be alleviated by discarding the outlier as a posteriori [5].”
BackgroundMethodInfluentialContinuous-time Radar-inertial Odometry for Automotive Radars
Ng, Y. Z., Choi, B., Tan, R. T., & Heng, L. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636014 · Cited by 51
“There are a few existing works on LiDAR-inertial odometry [9, 21, 20] and many more existing works on visualinertial odometry [15, 14, 18, 5, 16, 19].”
Information Sparsification in Visual-Inertial Odometry
Hsiung, J., Hsiao, M., Westman, E., Valencia, R., & Kaess, M. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8594007 · Cited by 54
“We follow the IMU preintegration method [14] to generate the relative IMU measurement.”
MethodCharacterizing the Uncertainty of Jointly Distributed Poses in the Lie Algebra
Mangelson, J. G., Ghaffari, M., Vasudevan, R., & Eustice, R. M. (2020) · IEEE Transactions on Robotics · doi:10.1109/tro.2020.2994457 · Cited by 63
“However, while recent years have seen an increase in use of Lie-algebra-based methods for uncertainty propagation [30]–[32], existing methods assume that individual measurements are independent [1], which may not be the case when the underlying pose estimates are derived from a SLAM solution.”
BackgroundKassas, Z. M., Closas, P., & Gross, J. N. (2019) · IEEE Aerospace and Electronic Systems Magazine · doi:10.1109/maes.2019.2906971 · Cited by 43
“Much alternative navigation advances have been largely centered on the use of visual-inertial [1], 3-D lidar, and simultaneous localization and mapping (SLAM) [2].”
BackgroundA Fast and Robust Algorithm for Orientation Estimation Using Inertial Sensors
Kok, M., & Schon, T. B. (2019) · IEEE Signal Processing Letters · doi:10.1109/lsp.2019.2943995 · Cited by 43
“within the field of robotics [17]–[21].”
MethodObservability Analysis of IMU Intrinsic Parameters in Stereo Visual–Inertial Odometry
Jung, J. H., Heo, S., & Park, C. G. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.2985174 · Cited by 45
“On the other hand, while most of the research studies (see [3], [5], [8], [9]) have focused on a monocular system, binocular measurements could yield significant advantages owing to its stereo baseline—this conveys actual scale information from image coordinates to the real metric.”
BackgroundYang, B., Li, J., & Zhang, H. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3101322 · Cited by 50
Underwater Visual Acoustic SLAM with Extrinsic Calibration
Xu, S., Łuczyński, T., Willners, J. S., Hong, Z., Zhang, K., Pétillot, Y., & Wang, S. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636258 · Cited by 40
“The optimization of the camera poses is performed in the tangent space as proposed in [12].”
Method
Metadata
- Authors
- Forster, C., Carlone, L., Dellaert, F., & Scaramuzza, D.
- Affiliations
- Massachusetts Institute of Technology (US)
- Georgia Institute of Technology (US)
- University of Zurich (CH)
- Venue
- IEEE Transactions on Robotics
- Published
- 2017-02
- Volume
- 33
- Issue
- 1
- Pages
- 1-21
- ISSN
- 1552-3098 (ISSN-L)
- 1941-0468
- OpenAlex
- W2482726005
- Cited by
- 1,502
- References
- 83
- Citations by year
- 2026: 156 · 2025: 179 · 2024: 234 · 2023: 193 · 2022: 180 · 2021: 174 · 2020: 134 · 2019: 129 · 2018: 88 · 2017: 32
- FWCI
- 102.35
- Type
- journal article
- Language
- en
- Open access
- green
- www.zora.uzh.ch
- Licence
- Locations
- IEEE Transactions on Robotics (publishedVersion)
- Zurich Open Repository and Archive (University of Zurich) (acceptedVersion, other-oa)
- arXiv (Cornell University) (submittedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion, cc-by-nc-nd)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion, other-oa)
- arXiv (Cornell University)
- Zurich Open Repository and Archive (University of Zurich)
- Funders
- Swiss National Foundation (200021-143607)
- National Center of Competence in Research Robotics (NCCR)
- University of Zurich
- National Science Foundation (11115678)
- United States Department of Agriculture (USDA)
- National Institute of Food and Agriculture (GEOW-2014-09160)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
- Physical Sciences › Engineering › Aerospace Engineering › Inertial Sensor and Navigation
- Physical Sciences › Computer Science › Artificial Intelligence › Target Tracking and Data Fusion in Sensor Networks
- Keywords
- visual-inertial odometry, inertial measurement unit, factor graphs, maximum a posteriori estimation, bias correction, real-time state estimation, keyframe selection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.