On-Manifold Preintegration for Real-Time Visual--Inertial Odometry
Open accessThe DOI matches its Crossref record; 83 of the 83 references it cites were found in a registry or an index.
Abstract
Current approaches for visual-inertial odometry (VIO) are able to attain highly accurate state estimation via nonlinear optimization. However, real-time optimization quickly becomes infeasible as the trajectory grows over time; this problem is further emphasized by the fact that inertial measurements come at high rate, hence, leading to the fast growth of the number of variables in the optimization. In this paper, we address this issue by preintegrating inertial measurements between selected keyframes into single relative motion constraints. Our first contribution is a preintegration theory that properly addresses the manifold structure of the rotation group. We formally discuss the generative measurement model as well as the nature of the rotation noise and derive the expression for the maximum a posteriori state estimator. Our theoretical development enables the computation of all necessary Jacobians for the optimization and a posteriori bias correction in analytic form. The second contribution is to show that the preintegrated inertial measurement unit model can be seamlessly integrated into a visual-inertial pipeline under the unifying framework of factor graphs. This enables the application of incremental-smoothing algorithms and the use of a structureless model for visual measurements, which avoids optimizing over the 3-D points, further accelerating the computation. We perform an extensive evaluation of our monocular VIO pipeline on real and simulated datasets. The results confirm that our modeling effort leads to an accurate state estimation in real time, outperforming state-of-the-art approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multiple View Geometry in Computer Vision
Hartley, R., & Zisserman, A. (2004) · doi:10.1017/cbo9780511811685 · Cited by 21,070
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897 · cited 2×
“We use the relative error metrics proposed in [68] to obtain error statistics.”
MethodEstimation with Applications to Tracking and Navigation: Theory, Algorithms and Software
Bar‐Shalom, Y., Li, X. ‐., & Kirubarajan, T. (2002) · doi:10.1002/0471221279 · Cited by 6,782
A Mathematical Introduction to Robotic Manipulation
Murray, R. M., Li, Z., & Sastry, S. S. (2017) · CRC Press eBooks · doi:10.1201/9781315136370 · Cited by 6,694 · cited 1×
“For this purpose, we introduce the following kinematic model [49], [53]:”
MethodFactor graphs and the sum-product algorithm
Kschischang, F. R., Frey, B. J., & Loeliger, H.-A. (2001) · IEEE Transactions on Information Theory · doi:10.1109/18.910572 · Cited by 6,486 · cited 1×
“This naturally leads to the well known factor graph representation, a class of bipartite graphical models that can be used to represent such factored densities [51], [52].”
BackgroundParallel Tracking and Mapping for Small AR Workspaces
Klein, G., & Murray, D. (2007) · 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2007.4538852 · Cited by 4,346 · cited 1×
“A breakthrough has been the development of incremental smoothing techniques (iSAM [36], iSAM2 [3]), which leverage the expressiveness of factor graphs to maintain sparsity and to identify and update only the typically small subset of variables affected by a new measurement.”
MethodMonoSLAM: Real-time single camera SLAM
Davison, A. J., Reid, I. D., Molton, N. D., & Stasse, O. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1049 · Cited by 3,959 · cited 1×
“The complexity of the EKF grows quadratically in the number of estimated landmarks, therefore, a small number of landmarks (in the order of 20) are typically tracked to allow real-time operation [10–12].”
BackgroundMatrix Analysis and Applied Linear Algebra
Meyer, C. (2000) · doi:10.1137/1.9780898719512 · Cited by 3,565 · cited 1×
“Any basis El ∈ R2nl×2nl−3 of the null space of El satisfies the following relation [71]:”
BackgroundMatrix analysis and applied linear algebra
(2001) · Choice Reviews Online · doi:10.5860/choice.38-5065 · Cited by 3,300
Stochastic models, estimation, and control
(1982) · Mathematics in Science and Engineering · doi:10.1016/s0076-5392(08)x6186-7 · Cited by 3,229
Cited by
Items 701–800 of 1,000
Multi-camera Visual-Inertial Simultaneous Localization and Mapping for Autonomous Valet Parking
Abate, M., Schwartz, A., Wong, X. I., Luo, W., Littman, R., Klinger, M. S., Kuhnert, L., Blue, D. W., & Carlone, L. (2024) · Springer proceedings in advanced robotics · doi:10.1007/978-3-031-63596-0_51 · Cited by 7
Self-citationG-Loc: Tightly-Coupled Graph Localization With Prior Topo-Metric Information
Montano-Oliván, L., Placed, J. A., Montano, L., & Lázaro, M. T. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3457383 · Cited by 9
“We use the method proposed in [34] to define the relative increments between frames and the preintegrated measurement model, i.e., Δ ˜ R ij , Δ˜ v ij and Δ˜ p ij (see [34] for details).”
BackgroundMethodEquivariant IMU Preintegration with Biases:a Galilean Group Approach
Delama, G., Fornasier, A., Mahony, R., & Weiss, S. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3511424 · Cited by 7
“A thorough comparison with existing IMU preintegration methodologies is presented.”
InfluentialTightly-Coupled Factor Graph Formulation For Radar-Inertial Odometry
Michalczyk, J., Quell, J., Steidle, F., Muller, M. G., & Weiß, S. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10801945 · Cited by 7
“We use the factor formulated in [24].”
A Survey on the Main Techniques Adopted in Indoor and Outdoor Localization
Stefanoni, M., Kovács, I., Šarčević, P., & Odry, Á. (2025) · Electronics · doi:10.3390/electronics14102069 · Cited by 16
“These systems are particularly useful for GPS-denied indoor environments, offering an accurate and drift-resilient pose estimation without external infrastructures [125].”
LVID-SLAM: A Lightweight Visual-Inertial SLAM for Dynamic Scenes Based on Semantic Information
Wang, S., Hu, Q., Zhang, X., Li, W., Wang, Y., & Zheng, E. (2025) · Sensors · doi:10.3390/s25134117 · Cited by 9
“The definitions of short-term rotation, velocity, and position increments are from [37], as shown below: Figure 4.”
SIPS: Unsupervised Succinct Interest Points.
Cieslewski, T., & Scaramuzza, D. (2018) · Cited by 7
Self-citationTightly Coupled Semantic RGB-D Inertial Odometry for Accurate Long-Term Localization and Mapping
Patel, N., Khorrami, F., Krishnamurthy, P., & Tzes, A. P. (2019) · International Conference on Advanced Robotics (ICAR) · doi:10.1109/icar46387.2019.8981658 · Cited by 8
“ment are fused during frame to frame pose optimization and local bundle adjustments similar to [24].”
BackgroundMethodLiu, H., Wang, J., Feng, J., & Wang, X. (2020) · Journal of Navigation · doi:10.1017/s0373463320000582 · Cited by 7
“The IMU pre-integration method in this section is based on the research of Forster (Forster et al., 2017), and the derivation process is as follows.”
MethodZhang, P., Xiong, L., Yu, Z., Kang, R., Xu, M., & Zeng, D. (2020) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv47402.2020.9304639 · Cited by 7
Multi-Robot Joint Visual-Inertial Localization and 3-D Moving Object Tracking
Zhu, P., & Ren, W. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341393 · Cited by 9
“The single Pengxiang Zhu and Wei Ren are with the Department of Electrical and Computer Engineering, University of California, Riverside, CA 92521, USA (pzhu008@ucr.edu, ren@ee.ucr.edu) . robot VINS problem has been studied extensively in recent years [3]–[7].”
BackgroundSemi-dense visual-inertial odometry and mapping for computationally constrained platforms
Liu, W., Mohta, K., Loianno, G., Daniilidis, K., & Kumar, V. R. (2021) · Autonomous Robots · doi:10.1007/s10514-021-10002-z · Cited by 5
“The sparsity of the tracked features can be freely adjusted (Engel et al. 2018), and optimizing for photometric error is also less computationally expensive than frame-to-frame feature matching (Forster et al. 2017b).”
BackgroundMethodInfluentialSelf-Supervised Depth Completion for Active Stereo
Warburg, F., Hernandez-Juarez, D., Tarrio, J., Vakhitov, A., Bonde, U., & Alcantarilla, P. F. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3145512 · Cited by 8
Spatiotemporal Visibility- Driven Visual-Inertial SLAM for Remote Rover With Transmission Delay
Xie, H., Chen, W., & Wang, J. (2021) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2021.3122831 · Cited by 7
A Bio-Inspired Multi-Sensor System for Robust Orientation and Position Estimation
Xie, J., He, X., Mao, J., Zhang, L., Guo-liang, H., Zhou, W., & Hu, X. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9635932 · Cited by 7
“In order to avoid the repeated IMU reintegration and correct IMU bias in VIO, [21] developed an efficient technique called IMU pre-integration.”
MethodInvariant Smoothing with low process noise
Chauchat, P., Bonnabel, S., & Barrau, A. (2022) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc51059.2022.9993071 · Cited by 7
“In the case of a sliding window of size 50 (bottom chart), [25] converges to the IS and GTSAM estimates, since they share the same cost function.”
InfluentialHybrid Visual Inertial Odometry for Robust Underwater Estimation
Joshi, B., Bandara, C. T., Poulakakis, I., Tanner, H. G., & Rekleitis, I. M. (2023) · MTS/IEEE OCEANS Conference (OCEANS) · doi:10.23919/oceans52994.2023.10336994 · Cited by 14
“An IMU preintegration technique similar to [40] is employed to propagate IMU measurements between frames.”
MethodObstacle detection and obstacle-surmounting planning for a wheel-legged robot based on Lidar
Wang, R., Wang, S., Xue, J., Chen, Z., & Si, J. (2024) · Robotic Intelligence and Automation · doi:10.1108/ria-12-2022-0275 · Cited by 7
Wang, F., Zhao, L., Xu, Z., Liang, H., & Zhang, Q. (2024) · Measurement Science and Technology · doi:10.1088/1361-6501/ad71e7 · Cited by 7
Unscented Kalman Filtering on Lie Groups for Fusion of IMU and Monocular Vision
Brossard, M., Bonnabel, S., & Barrau, A. (2017) · HAL · Cited by 7
Temporal delay estimation of sparse direct visual inertial odometry for mobile robots
Cen, R., Zhang, X., Tao, Y., Xue, F., & Zhang, Y. (2020) · Journal of the Franklin Institute · doi:10.1016/j.jfranklin.2019.11.075 · Cited by 7
Research on improving LIO-SAM based on Intensity Scan Context
Wang, C., Zhang, G., & Zhang, M. (2021) · Journal of Physics Conference Series · doi:10.1088/1742-6596/1827/1/012193 · Cited by 7
“Then applying the pre-integration method proposed in [8], the motion transformation between time i and j can be obtained.”
MethodA dual-mode automatic switching feature points matching algorithm fusing IMU data
Guan, Q., Wei, G., Wang, Y., & Liu, Y. (2021) · Measurement · doi:10.1016/j.measurement.2021.110043 · Cited by 7
Chen, Z., Li, Q., Li, J., Zhang, D., Yu, J., Yin, Y., Lv, S., & Liang, A. (2022) · Remote Sensing · doi:10.3390/rs14061365 · Cited by 7
“Recently, the IMU pre-integration model proposed by [31,32] improved the accuracy and efficiency of IMULiDAR fusion.”
MethodA low-cost visual inertial odometry for mobile vehicle based on double stage Kalman filter
Cen, R., Jiang, T., Tan, Y., Su, X., & Xue, F. (2022) · Signal Processing · doi:10.1016/j.sigpro.2022.108537 · Cited by 7
Liu, K. (2022) · IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems · doi:10.1109/cyber55403.2022.9907651 · Cited by 15
“The optimization can be simplified into an iterative Kalman filter [25].”
MethodAccuracy enhancement for the front-end tracking algorithm of RGB-D SLAM
Hu, F., Cheng, J., Bao, Y., & He, Y. (2019) · Intelligent Service Robotics · doi:10.1007/s11370-019-00299-2 · Cited by 7
SelectFusion: A Generic Framework to Selectively Learn Multisensory Fusion.Preprint
Chen, C., Rosa, S., Lu, C. X., Trigoni, N., & Markham, A. (2019) · arXiv (Cornell University) · Cited by 10
VE-LIOM: A Versatile and Efficient LiDAR-Inertial Odometry and Mapping System
Gao, Y., & Zhao, L. (2024) · Remote Sensing · doi:10.3390/rs16152772 · Cited by 9
DMSA - Dense Multi Scan Adjustment for LiDAR Inertial Odometry and Global Optimization
Skuddis, D., & Norbert Haala, A. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610818 · Cited by 8
“To support the subsequent optimization, IMU measurements are preintegrated as proposed in [29] between two control poses.”
MethodSquare-Root Inverse Filter-based GNSS-Visual-Inertial Navigation
Hu, J. H., Lang, X., Zhang, F., Mao, Y., & Huang, G. P. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611666 · Cited by 10
“Assuming the inertial state at time step i and the GNSS measurement at time step k , the following constraints hold through IMU integration: where γ I k I i , β I k I i and α I k I i are the pre-integration terms [36].”
BackgroundWang, X., Zhang, Z., & Li, L. (2025) · Applied Soft Computing · doi:10.1016/j.asoc.2025.112809 · Cited by 7
Qiu, L., Zhu, M. C., Jiang, Y., Teng, H., & Park, J. (2025) · International Journal of Transportation Science and Technology · doi:10.1016/j.ijtst.2025.02.008 · Cited by 13
Wei, J., Song, M. H., & Yuan, Y. (2025) · Remote Sensing · doi:10.3390/rs17071136 · Cited by 10
LiLoc: Lifelong Localization Using Adaptive Submap Joining and Egocentric Factor Graph
Fang, Y., Li, Y., Qian, K., Tombari, F., Wang, Y., & Lee, G. H. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11127560 · Cited by 8
“C. Egocentric Factor Graph (EFG) 1) IMU Preintegration Factor: We use the IMU preintegration technique [20] to efficiently incorporate IMU constraints into the factor graph G b .”
Adham, M., Li, Y., Mahmoud, M., Mansour, A., & Chen, W. (2026) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2026.03.046 · Cited by 6
Localization for Autonomous Vehicles in Underground Mines
Nielsen, K. (2023) · Linköping studies in science and technology. Dissertations · doi:10.3384/9789180751681 · Cited by 9
Pose estimation of an aerial construction robot based on motion and dynamic constraints
Yu, Z., Jiang, X., & Liu, Y. (2023) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2023.104591 · Cited by 6
Decentralized state estimation: An approach using pseudomeasurements and preintegration
Cossette, C. C., Shalaby, M., Saussié, D., & Forbes, J. R. (2024) · The International Journal of Robotics Research · doi:10.1177/02783649241230993 · Cited by 6
“Pre-integration is best known from the visual-inertial odometry literature (Lupton and Sukkarieh (2012); Forster et al. (2017)), where the same concept, adapted for relative pose estimation is introduced by Shalaby et al. (2023).”
BackgroundMethodInfluentialZhang, Y., Chu, L., Mao, Y., Yu, X., Wang, J., & Guo, C. (2024) · Sensors · doi:10.3390/s24103079 · Cited by 8
“…effective IMU pre-integration techniques are widely employed in optimization-based tightly coupled visual–inertial odometry (VIO) methods [4,5,12], as well as in [7,13,14], where manifolds are used instead of Euler angles to parameterize the rotation group for enhanced computational efficiency.”
MethodLESS-Map: Lightweight and Evolving Semantic Map in Parking Lots for Long-term Self-Localization
Liu, M., Tang, X., Qian, Y., Chen, J., & Li, L. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610168 · Cited by 9
“Additionally, we leverage IMU preintegration [27] to further refine the results of odometry.”
MethodKim, S. K., Kim, C., & Jo, K. (2024) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2024.3446038 · Cited by 6
UL-VIO: Ultra-Lightweight Visual-Inertial Odometry with Noise Robust Test-Time Adaptation
Park, J., Chun, S. Y., & Seok, M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73036-8_24 · Cited by 7
“Estimating one’s ego-motion from camera images and inertial measurement unit (IMU) data sequences [11, 25], VIO is a crucial component in the autonomous navigation pipeline [33,37,40].”
Integration of the Velodyne LiDAR Sensor and Pixhawk for Indoor 3D Mapping
Ramadhania, N., Cahyadi, M. N., Asfihani, T., & Suhandri, H. F. (2024) · IOP Conference Series Earth and Environmental Science · doi:10.1088/1755-1315/1418/1/012025 · Cited by 7
“The point cloud displayed in the image is of good quality and meets the LoD 3 criteria with quite high architectural detail and good measurement accuracy [15,22].”
Oelerich, T., Beck, F., Hartl-Nesic, C., & Kugi, A. (2025) · The International Journal of Robotics Research · doi:10.1177/02783649241309354 · Cited by 6
Sliding window filter based unknown object pose estimation
Song, J. (2017) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2017.8296761 · Cited by 6
“However, filtering methods are structureless, which cannot explore the current full information [24].”
BackgroundA Hybrid Sliding Window Optimizer for Tightly-Coupled Vision-Aided Inertial Navigation System
Jiang, J., Niu, X., Guo, R., & Liu, J. (2019) · Sensors · doi:10.3390/s19153418 · Cited by 6
“[23,24] and further improved in other studies [8,25,26].”
ResultEVDodgeNet: Deep Dynamic Obstacle Dodging with Event Cameras
Sanket, N. J., Parameshwara, C. M., Singh, C. D., Kuruttukulam, A. V., Fermuller, C. M., Scaramuzza, D., & Aloimonos, Y. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9196877 · Cited by 119
“me (top) and respective segmentation obtained from our network (down). TABLE I QUANTITATIVE EVALUATION OF DIFFERENT METHODS FOR HOMOGRAPHY ESTIMATION. Method (Loss) RMSE i in px. RMSEo in px. =[0;5] =[6;10] =[11;15] =[16;20] =[21;25] =[0;5] =[6;10] =[11;15] =[16;20] =[21;25] Identity 3.92 0.83 11.40 0.70 18.43 0.70 25…”
InfluentialSelf-citationCooperative Visual-Inertial Odometry: Analysis of Singularities, Degeneracies and Minimal Cases
Martinelli, A. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2965063 · Cited by 8
“Recently, this sensor fusion problem has been successfully addressed by using optimization-based approaches [3]–[10].”
MethodVIMO: A Visual-Inertial-Magnetic Navigation System Based on Non-Linear Optimization
Wang, J., Li, L., Yu, H., Gui, X., & Li, Z. (2020) · Sensors · doi:10.3390/s20164386 · Cited by 6
“To make a virtue of escalated computation due to the addition of inertial measurements, reference [22] proposes what is called the IMU preintegration technique that integrates on manifold a segment of measurements between two time points with the Jacobian matrices maintained for correction.”
MethodYuan, D. Z., Yong-yuan, Q., Wu, Z., & Shen, X. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3096271 · Cited by 6
Robust SRIF-based LiDAR-IMU Localization for Autonomous Vehicles
Li, K., Ouyang, Z., Hu, L., Hao, D., & Kneip, L. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561218 · Cited by 7
“The IMU pre-integration and LiDAR motion compensation follows the standard, pre-integration approach on the SO ( 3 ) manifold as proposed in [10] and [9].”
MethodFast Attitude Estimation System for Unmanned Ground Vehicle Based on Vision/Inertial Fusion
Fan, Z., Yang, P., Mei, C., Zhu, Q., & Luo, X. (2021) · Machines · doi:10.3390/machines9100241 · Cited by 6
“This theory provides a mature theoretical basis for inertial navigation to incrementally output navigation information and makes it possible for adding into the optimization framework [15].”
BackgroundA Resilient Method for Visual–Inertial Fusion Based on Covariance Tuning
Li, K., Li, J., Wang, A., Luo, H., Li, X., & Yang, Z. (2022) · Sensors · doi:10.3390/s22249836 · Cited by 6
Tightly-Coupled GNSS-LiDAR-Inertial State Estimator for Mapping and Autonomous Driving
Gil, H., Lee, D., Song, G., Ahn, S., & Kim, A. (2023) · The Journal of Korea Robotics Society · doi:10.7746/jkros.2023.18.1.072 · Cited by 7
Feng, L.-Y., Zhang, X., Peng, X., & Zhuang, M. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-15597-2 · Cited by 6
Ho, H.-Y., Ng, H., Leung, Y.-T., Wen, W., Hsu, L., & Luo, Y. (2023) · The international archives of the photogrammetry, remote sensing and spatial information sciences/International archives of the photogrammetry, remote sensing and spatial information sciences · doi:10.5194/isprs-archives-xlviii-1-w1-2023-175-2023 · Cited by 6
“, 2015)(Zhang & Scaramuzza, 2018) (Forster et al., 2017) (Han et al.”
BackgroundMethodInfluentialA Moving Target Tracking System of Quadrotors with Visual-Inertial Localization
Lin, Z., Xu, W., & Wang, W. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10161323 · Cited by 6
“Following the theory proposed in [22], [27], we pre-integrate consecutive IMU measurements between two keyframes and represent the relative position, orientation, and velocity of two keyframes as ∆pi,i+1, ∆Ri,i+1 and ∆vi,i+1.”
MethodQu, H., Zhang, L., Hu, X., He, X., Pan, X., & Chen, C. (2023) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2023.3342803 · Cited by 6
“For instance, [15] uses IMU pre-integration to fuse the IMU raw data and optimizes the re-projection loss using matching feature points and point clouds.”
MethodOptimizing AUV Navigation Using Factor Graphs with Side-Scan Sonar Integration
Zhang, L., Gao, Y., & Guan, L. (2024) · Journal of Marine Science and Engineering · doi:10.3390/jmse12020313 · Cited by 6
ROAMER: Robust Offroad Autonomy using Multimodal State Estimation with Radar Velocity Integration
Nissov, M., Khattak, S., Edlund, J. A., Padgett, C. W., Alexis, K., & Spieler, P. (2024) · IEEE Aerospace Conference (AERO) · doi:10.1109/aero58975.2024.10521170 · Cited by 9
“…[25] creates a node in the graph for each IMU measurement, connected with a pre-integrated IMU factor with the residuals and covariance as described in [32]: where e ∆ W R I , e ∆ W v WI , and e ∆ W p I are the residuals, of the IMU factor, with respect to the orientation, velocity, and position.”
BackgroundLiDAR-Inertial 3D SLAM with Plane Constraint for Multi-story Building
Zhang, J., Su, Y., Zhang, C., Jin, J., Wu, J., Xiong, R., & Zhu, Q. (2024) · IEEE Workshop on Advanced Robotics and its Social Impacts (ARSO) · doi:10.1109/arso60199.2024.10557752 · Cited by 7
“Let t i and t j be the starting time and ending time of a raw LiDAR scan ˜ S i , respectively, so the pre-integration measurements ∆ p ij , ∆ v ij , ∆ q ij of IMU from time t i to t j are computed as: Readers can refer to [17] for the detailed derivation of Eq.”
MethodZhou, Y., Jiang, Q., Duan, J., Jin, M., Fu, H., & Xu, X. (2024) · Frontiers in Plant Science · doi:10.3389/fpls.2024.1369501 · Cited by 6
“We employ the method outlined in the literature Forster et al. (2016) to compute the relative motion between two instants, denoted as S R , S V , and S P , and integrate these values into the state estimation.”
MethodA Buddy Temporal-Spatial Calibration Method for Airborne Sensors in Multi-UAV Systems
Xu, X., Li, C., Zhuge, S., Zhao, Z., Yang, X., Khoo, B. C., Srigrarom, S. S., Lin, B., & Zhang, X. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3421189 · Cited by 6
A lightweight and scalable visual-inertial motion capture system using fiducial markers
He, G., Zhong, S., & Guo, J. (2019) · Autonomous Robots · doi:10.1007/s10514-019-09834-7 · Cited by 6
“We use the recently proposed IMU preintegration technique Forster et al. (2017) to further aid high-rate performance.”
BackgroundMethodConsistent Covariance Pre-Integration for Invariant Filters with Delayed Measurements
Allak, E., Fornasier, A., & Weiß, S. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9340833 · Cited by 6
“The pre-integration of inertial measurements leads to considerable complexity reduction and increased robustness in non-linear optimization [6], [7].”
BackgroundWang, S., Ravankar, A. A., Ravankar, A. A., Emaru, T., & Kobayashi, Y. (2021) · IEEE/SICE International Symposium on System Integration (SII) · doi:10.1109/ieeeconf49454.2021.9382659 · Cited by 6
“…residual of the IMU measure ments m t between adjacent frame is given as: e T e T e T T e T ep , eB , ev , eba , % where | e j , e j , e ^ , e^ , e T } are the pre-integration terms of IMU calculated in the non-inertial reference frame of gravity, whose derivation on manifold are referred in [25].”
BackgroundGao, H., Wei, T., & Li, S. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3112590 · Cited by 6
“After intrinsic calibration of the IMU using the method proposed in [11], the motion between any two consecutive time frames can be obtained by an efficient technique called IMU preintegration [7].”
BackgroundMethodA Multisensor-based Tightly Coupled Integrated Navigation System
Sun, H., Jin, Y., Fu, M., He, J., Liu, H., & Zhang, W. (2022) · International Symposium on Autonomous Systems (ISAS) · doi:10.1109/isas55863.2022.9757320 · Cited by 7
“The factor of preintegrated IMU factor is defined as where According to [17], we use the retraction strategy to re-parameterize the above equation after each Gauss-Newton iteration, but when the linearization point changes, there is no need to recalculate the integral between the two key frames…”
MethodTowards Privacy-Preserving Ego-Motion Estimation Using an Extremely Low-Resolution Camera
Shariati, A., Holz, C., & Sinha, S. N. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2967307 · Cited by 6
“These methods are often categorized as either direct [44], [37], [34], indirect [31], [36], [39], or a hybrid [35], [32], [33], [42].”
MethodContinuous Preintegration Theory for Graph-based Visual-Inertial Navigation.Preprint
Eckenhoff, K., Geneva, P., & Huang, G. P. (2018) · arXiv (Cornell University) · Cited by 6
Gallo, E., & Barrientos, A. (2023) · Aerospace · doi:10.3390/aerospace10080708 · Cited by 12
“…keyframe visual inertial SLAM (OKVIS) [56,57], the robust visual inertial odometry (ROVIO) [58], the monocular visual inertial navigation system (VINS-Mono) [59], SVO combined with multisensor fusion (MSF) [33,34,60,61], and SVO combined with incremental smoothing and mapping (iSAM) [33,34,62,63].”
BackgroundW-VSLAM: A Visual Mapping Algorithm for Indoor Inspection Robots
Luo, D., Huang, Y., Huang, X., Miao, M., & Gao, X. (2024) · Sensors · doi:10.3390/s24175662 · Cited by 5
“Therefore, the concept of pre-integration is employed [25], as shown in Figure 4, to construct constraints between frames of visual information using pre-integrated encoder data.”
MethodCai, Q., Yang, Q., Tu, Y., & Niu, H. (2025) · Measurement Science and Technology · doi:10.1088/1361-6501/adc8c6 · Cited by 6
“Forster et al [25, 26] further studied inertial pre-integration, and successfully applied this theory to Georgia Tech Smoothing and Mapping (GTSAM), a factor graph fusion framework based on Bayesian trees, to improve the computation speed of GOA.”
Tightly coupled GNSS RTK-LiDAR-inertial system for consistent urban navigation
Liu, J., Qin, F. Q., Chi, C., Zhang, X., Zhang, Z., Sun, Y., & Zhan, X. (2025) · Measurement · doi:10.1016/j.measurement.2025.117671 · Cited by 11
Wang, Q., Li, W., Nie, L., Liu, W., & Jiang, H. (2025) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2025.3575067 · Cited by 5
“Visual SLAM [4], [5] utilizes cameras to perceive the environment and compute the robot’s motion trajectory by analyzing variations in feature points across successive image frames, and thus builds a three-dimensional representation of the underlying environment [6], [7].”
RIEKF-based resilient interactive fusion algorithm for cooperative navigation
Song, F., Zeng, Q., Zhang, R., Xiaohu, Z., Zhou, H., & Ye, X. (2025) · Measurement Science and Technology · doi:10.1088/1361-6501/ade32e · Cited by 5
Stereo Direct Sparse Visual–Inertial Odometry with Efficient Second-Order Minimization
Fu, C., & Lu, J. (2025) · Sensors · doi:10.3390/s25154852 · Cited by 5
“Meanwhile, IMU measurements are preintegrated following the on-manifold model [20] to compute the initial gravity direction and provide motion constraints by averaging up to 40 accelerometer measurements, yielding a reliable estimate even under high acceleration.”
Vial, P., Pi, R., Palomeras, N., & Carreras, M. (2025) · Journal of Ocean Engineering and Science · doi:10.1016/j.joes.2025.08.010 · Cited by 7
Cascaded transformer-LSTM architecture for urban canyon navigation with factor graph optimization
Zhang, H., Luo, W., Peng, M., Kong, J., Liu, L., Yao, Y., Xu, C., Tang, F., & Pan, J. (2026) · GPS Solutions · doi:10.1007/s10291-025-02010-8 · Cited by 6
“Recent studies have explored Factor Graph Optimization (FGO) as an alternative framework for sensor fusion, formulating navigation as a nonlinear least-squares problem on a graph structure (Tang et al. 2021; Forster et al. 2016).”
Unified robot and inertial sensor self-calibration
Ferguson, J. M., Ertop, T. E., Herrell, S. D., & Webster, R. J., III (2023) · Robotica · doi:10.1017/s0263574723000012 · Cited by 5
“While most applications of IMUs in robotics are limited to visual-inertial navigation and mobile robots [31–37], some researchers have instead attempted to use IMU data with stationary robots.”
BackgroundGRVINS: Tightly Coupled GNSS-Range-Visual-Inertial System
Lu, B.-X., Tsai, Y.-C., & Tseng, K.-S. (2024) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-023-02033-8 · Cited by 6
“Thus, the researchers in [10] adopt the IMU pre-integration approach to aggregate multiple inertial measurements into a single one.”
DFF-VIO: A General Dynamic Feature Fused Monocular Visual-Inertial Odometry
Luo, N., Hu, Z., Ding, Y., Li, J., Zhao, H., Liu, G., & Wang, Q. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3482573 · Cited by 5
“…and ( · ) b denotes the body coordinate system, which is identical to is the first-order approximation of the preintegrated term γ b k b k + 1 [43] with respect to the gyroscope bias [15]. q c 0 b k + 1 and q c 0 b k are rotations described by quaternions, respectively representing the…”
InfluentialHan, J., Beyer, L. L., Cavalheiro, G. V., & Karaman, S. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10801527 · Cited by 8
“ˆ t n and σ an,p are the vectorized representation of the pose and aleatoric uncertainty of the position, respectively. f w utilizes a CNN to process high-dimensional image data.”
Underwater Rotation MEMS-IMU/DVL Integrated Navigation Based on IFB-FGO
Zhou, H., Ye, X., & Liu, H. (2025) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2025.3526128 · Cited by 5
“The reason is that the east gyro bias is almost unobservable and thus cannot be effectively estimated in regular static SINS.”
Huang, K., Liu, D., Sisi Zlatanova, B., Lu, Y., Wang, Y., Chen, T., Sun, Y., Wang, C., Bonilla, D., & Shi, W. (2025) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2025.104422 · Cited by 5
Graph-Optimized Encoder–IMU Fusion for Robust Pipeline Robot Localization in Confined Spaces
Mao, J., Song, W., Liang, H., Xia, F., & Zhang, C. (2025) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2025.3563029 · Cited by 6
RTK-LIO: Tightly Coupled RTK/LiDAR/Inertial Navigation System Based on Optimization Approach
Wang, R., Zhang, Y., Li, T., Wang, C., Wu, Q., Pei, L., & Zhang, W. (2025) · IEEE Sensors Journal · doi:10.1109/jsen.2025.3574472 · Cited by 8
“The IMU preintegration [30] method is used to calculate the relative body motion between two time steps, providing high-precision relative constraints between consecutive pose nodes b k and b k + 1 within the sliding window.”
A Radio-Inertial Localization and Tracking System with BLE Beacons Prior Maps
Jadidi, M., Patel, M., Miró, J. V., Dissanayake, G., Biehl, J. T., & Girgensohn, A. (2018) · UTS ePRESS (University of Technology Sydney) · Cited by 5
Visual-Marker-Inertial Fusion Localization System Using Sliding Window Optimization
Zhang, M., Han, S., Liu, X., Wang, S., Han, L., & Zhao, J. (2021) · Chinese Control and Decision Conference (CCDC) · doi:10.1109/ccdc52312.2021.9602344 · Cited by 5
Comparison of Power Consumption of Modern SLAM Methods on Various Datasets
Yanık, Ö. F., & Ilgın, H. A. (2021) · International Conference on Technological Advancements and Innovations (ICTAI) · doi:10.1109/ictai53825.2021.9673342 · Cited by 5
Generalized n-Dimensional Rigid Registration: Theory and Applications
Wu, J., Wang, M., Fourati, H., Li, H., Zhu, Y., Zhang, C., Jiang, Y., Hu, X., & Liu, M. (2022) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2022.3168938 · Cited by 5
“For each visual measurement, the visual-inertial state estimator computes the state estimation along with its covariance by the IMU preintegration [60].”
MethodMa, X. (2022) · Wireless Communications and Mobile Computing · doi:10.1155/2022/2181512 · Cited by 5
RetractedIMU-Assisted Online Video Background Identification
Rong, J.-X., Zhang, L., Huang, H., & Zhang, F. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3183442 · Cited by 5
Integrating Point and Line Features for Visual-Inertial Initialization
Liu, H., Qiu, J., & Huang, W. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9811641 · Cited by 7
Square-Root Extended Information Filter for Visual-Inertial Odometry for Planetary Landing
Givens, M. W., & McMahon, J. W. (2022) · Journal of Guidance Control and Dynamics · doi:10.2514/1.g006849 · Cited by 6
M-LIO: Multi-lidar, multi-IMU odometry with sensor dropout tolerance
Das, S., Mahabadi, N., Fallon, M. F., & Chatterjee, S. (2023) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv55152.2023.10186548 · Cited by 5
“The residual has the form (with a derivation taken from [20]):”
BackgroundMethodInfluentialA Monocular Visual Positioning Method With Scale Information Using a Single Image Sensor
Jia, S., Ji, J., Shen, Q., Wang, Q., Zhang, X., & Zheng, H. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2023.3347517 · Cited by 5
“J g ( · ) and J a ( · ) describe how the changes in bias estimation cause the changes in measurement values [14]. b g denotes the gyroscope bias, b a denotes the acceleration bias, and W g denotes the gravity. b g and ¯ b m a remain unchanged during the integration process, and they can be…”
Zhang, B., Yao, W., Wang, Y., Li, P., Shao, X., & Sun, G. (2024) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2024.3372028 · Cited by 6
“As mentioned in [26], to avoid recomputing the rotation matrix R B j , position p B j , and velocity v B j , the relative preintegration measurements with updated bias are defined as: where Δ t represents the time difference between consecutive IMU measurements. exp ( · ) denotes the exponential map…”
Zhao, 郭. G., Ze, 杨. Y., Yongjie, 任. R., Yanbiao, 孙. S., & Jigui, 邾. Z. (2024) · Acta Optica Sinica · doi:10.3788/aos240611 · Cited by 5
Metadata
- Authors
- Forster, C., Carlone, L., Dellaert, F., & Scaramuzza, D.
- Affiliations
- Massachusetts Institute of Technology (US)
- Georgia Institute of Technology (US)
- University of Zurich (CH)
- Venue
- IEEE Transactions on Robotics
- Published
- 2017-02
- Volume
- 33
- Issue
- 1
- Pages
- 1-21
- ISSN
- 1552-3098 (ISSN-L)
- 1941-0468
- OpenAlex
- W2482726005
- Cited by
- 1,502
- References
- 83
- Citations by year
- 2026: 156 · 2025: 179 · 2024: 234 · 2023: 193 · 2022: 180 · 2021: 174 · 2020: 134 · 2019: 129 · 2018: 88 · 2017: 32
- FWCI
- 102.35
- Type
- journal article
- Language
- en
- Open access
- green
- www.zora.uzh.ch
- Licence
- Locations
- IEEE Transactions on Robotics (publishedVersion)
- Zurich Open Repository and Archive (University of Zurich) (acceptedVersion, other-oa)
- arXiv (Cornell University) (submittedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion, cc-by-nc-nd)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion, other-oa)
- arXiv (Cornell University)
- Zurich Open Repository and Archive (University of Zurich)
- Funders
- Swiss National Foundation (200021-143607)
- National Center of Competence in Research Robotics (NCCR)
- University of Zurich
- National Science Foundation (11115678)
- United States Department of Agriculture (USDA)
- National Institute of Food and Agriculture (GEOW-2014-09160)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
- Physical Sciences › Engineering › Aerospace Engineering › Inertial Sensor and Navigation
- Physical Sciences › Computer Science › Artificial Intelligence › Target Tracking and Data Fusion in Sensor Networks
- Keywords
- visual-inertial odometry, inertial measurement unit, factor graphs, maximum a posteriori estimation, bias correction, real-time state estimation, keyframe selection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.