On-Manifold Preintegration for Real-Time Visual--Inertial Odometry
Open accessThe DOI matches its Crossref record; 83 of the 83 references it cites were found in a registry or an index.
Abstract
Current approaches for visual-inertial odometry (VIO) are able to attain highly accurate state estimation via nonlinear optimization. However, real-time optimization quickly becomes infeasible as the trajectory grows over time; this problem is further emphasized by the fact that inertial measurements come at high rate, hence, leading to the fast growth of the number of variables in the optimization. In this paper, we address this issue by preintegrating inertial measurements between selected keyframes into single relative motion constraints. Our first contribution is a preintegration theory that properly addresses the manifold structure of the rotation group. We formally discuss the generative measurement model as well as the nature of the rotation noise and derive the expression for the maximum a posteriori state estimator. Our theoretical development enables the computation of all necessary Jacobians for the optimization and a posteriori bias correction in analytic form. The second contribution is to show that the preintegrated inertial measurement unit model can be seamlessly integrated into a visual-inertial pipeline under the unifying framework of factor graphs. This enables the application of incremental-smoothing algorithms and the use of a structureless model for visual measurements, which avoids optimizing over the 3-D points, further accelerating the computation. We perform an extensive evaluation of our monocular VIO pipeline on real and simulated datasets. The results confirm that our modeling effort leads to an accurate state estimation in real time, outperforming state-of-the-art approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multiple View Geometry in Computer Vision
Hartley, R., & Zisserman, A. (2004) · doi:10.1017/cbo9780511811685 · Cited by 21,070
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897 · cited 2×
“We use the relative error metrics proposed in [68] to obtain error statistics.”
MethodEstimation with Applications to Tracking and Navigation: Theory, Algorithms and Software
Bar‐Shalom, Y., Li, X. ‐., & Kirubarajan, T. (2002) · doi:10.1002/0471221279 · Cited by 6,782
A Mathematical Introduction to Robotic Manipulation
Murray, R. M., Li, Z., & Sastry, S. S. (2017) · CRC Press eBooks · doi:10.1201/9781315136370 · Cited by 6,694 · cited 1×
“For this purpose, we introduce the following kinematic model [49], [53]:”
MethodFactor graphs and the sum-product algorithm
Kschischang, F. R., Frey, B. J., & Loeliger, H.-A. (2001) · IEEE Transactions on Information Theory · doi:10.1109/18.910572 · Cited by 6,486 · cited 1×
“This naturally leads to the well known factor graph representation, a class of bipartite graphical models that can be used to represent such factored densities [51], [52].”
BackgroundParallel Tracking and Mapping for Small AR Workspaces
Klein, G., & Murray, D. (2007) · 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2007.4538852 · Cited by 4,346 · cited 1×
“A breakthrough has been the development of incremental smoothing techniques (iSAM [36], iSAM2 [3]), which leverage the expressiveness of factor graphs to maintain sparsity and to identify and update only the typically small subset of variables affected by a new measurement.”
MethodMonoSLAM: Real-time single camera SLAM
Davison, A. J., Reid, I. D., Molton, N. D., & Stasse, O. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1049 · Cited by 3,959 · cited 1×
“The complexity of the EKF grows quadratically in the number of estimated landmarks, therefore, a small number of landmarks (in the order of 20) are typically tracked to allow real-time operation [10–12].”
BackgroundMatrix Analysis and Applied Linear Algebra
Meyer, C. (2000) · doi:10.1137/1.9780898719512 · Cited by 3,565 · cited 1×
“Any basis El ∈ R2nl×2nl−3 of the null space of El satisfies the following relation [71]:”
BackgroundMatrix analysis and applied linear algebra
(2001) · Choice Reviews Online · doi:10.5860/choice.38-5065 · Cited by 3,300
Stochastic models, estimation, and control
(1982) · Mathematics in Science and Engineering · doi:10.1016/s0076-5392(08)x6186-7 · Cited by 3,229
Cited by
Items 501–600 of 1,000
3D SLAM based on NDT matching and ground constraints for ground robots in complex environments
Jiang, Y. H., Wang, T., Shao, S., & Wang, L. (2022) · Industrial Robot the international journal of robotics research and application · doi:10.1108/ir-05-2022-0128 · Cited by 15
HDVIO: Improving Localization and Disturbance Estimation with Hybrid Dynamics VIO
Cioffi, G., Bauersfeld, L., & Scaramuzza, D. (2023) · Robotics: Science and Systems · doi:10.15607/rss.2023.xix.071 · Cited by 20
Self-citationRobust indoor/outdoor navigation through magneto-visual-inertial optimization-based estimation
Caruso, D., Eudes, A., Sanfourche, M., Vissière, D., & Besnerais, G. L. (2017) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206304 · Cited by 18
Heading Reference-Assisted Pose Estimation for Ground Vehicles
Wang, H., Jiang, R., Zhang, H., & Ge, S. S. (2018) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2018.2828078 · Cited by 14
“In [16], a preintegration scheme of inertial measurement between keyframes has been proposed, where fused measurement model and error propagation expression have been derived such that the optimization could be achieved directly on-manifold.”
MethodRGB-D Inertial Odometry for Indoor Robot via Keyframe-based Nonlinear Optimization
Yang, L., Liu, H., Zhu, X., Jiang, J., & Liang, B. (2018) · IEEE International Conference on Mechatronics and Automation (ICMA) · doi:10.1109/icma.2018.8484687 · Cited by 15
“Interested readers can read [5], [6], [9].”
BackgroundMethodYuan, C., Lai, J., Lyu, P., Shi, P., Zhao, W., & Huang, K. (2018) · Micromachines · doi:10.3390/mi9120626 · Cited by 16
“Recently tightly-coupled stereo VIO systems mainly use a filtering-based [15] or optimization-based [16] approach.”
MethodJoint optimization based on direct sparse stereo visual-inertial odometry
Wen, S., Zhao, Y., Zhang, H., Lam, H., & Manfredi, L. (2020) · Autonomous Robots · doi:10.1007/s10514-019-09897-6 · Cited by 14
Chen, L. J., Henawy, J., Koçer, B. B., & Seet, G. (2019) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw.2019.00024 · Cited by 15
“The pre-integration scheme has been extended in [35] for IMUs, on the manifold SO(3).”
BackgroundYin, P., Wang, D., Du, S., Ying, S., Gao, Y., & Zheng, N. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9340857 · Cited by 14
“It is not the computational optimal according to [15].”
BackgroundContinuous-Time Visual-Inertial Trajectory Estimation with Event Cameras.Preprint
Mueggler, E., Gallego, G., Rebecq, H., & Scaramuzza, D. (2017) · arXiv (Cornell University) · Cited by 14
Self-citationDong, X., Wang, Z., Liu, F., Li, S., Fei, F., Li, D., & Tu, Z. (2022) · Drones · doi:10.3390/drones6040090 · Cited by 13
“Meanwhile, as it has relatively low computation efficiency for some microcontroller, an IMU pre-integration algorithm [35] is suggested in the forward-calibration step.”
BackgroundPositioning of Quadruped Robot Based on Tightly Coupled LiDAR Vision Inertial Odometer
Gao, F., Tang, W., Huang, J., & Chen, H. (2022) · Remote Sensing · doi:10.3390/rs14122945 · Cited by 13
Dai, B., Gentil, C. L., & Vidal‐Calleja, T. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981249 · Cited by 16
“The approach relies on the interpolation of preintegrated measurements [18] to align the events and relies on FAST corners [8] to recover tracks.”
MethodAmarasinghe, C. K., Rathnaweera, A., & Maithripala, S. (2023) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-023-07906-6 · Cited by 13
“…following relation for the difference of the positions. s ( [27], it is probable to constraint velocities for two consecutive keyframes, Also from [27], change of position due to acceleration and gyroscope bias terms can be derived respectively as Resulting bias term and the g W term from (22)…”
InfluentialMap aided visual-inertial fusion localization method for autonomous driving vehicles
Cheng, J. T., Zhang, L., Chen, Q., Hu, X., & Cai, J. (2023) · Measurement · doi:10.1016/j.measurement.2023.113432 · Cited by 15
DMLL: Differential-Map-Aided LiDAR-Based Localization
Wu, Y., Zhao, C., & Lyu, Y. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3324349 · Cited by 14
“…problem can be transformed into a nonlinear least-squares problem to solve as where current frame is the N th frame, and r B ( · ) , r L ( · ) , and r M ( · ) represent the residuals corresponding to IMU preintegration factors [34], LiDAR odometry factors, and map-matching factors, respectively.”
BackgroundTight Fusion of Events and Inertial Measurements for Direct Velocity Estimation
Xu, W., Peng, X., & Kneip, L. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2023.3333108 · Cited by 18
“Furthermore, the authors in [19] and [20] have introduced IMU preintegration terms, thus avoiding repeated integrations during optimization.”
BackgroundSemantic Map-Based Visual Localization With Consistency Guarantee
Fu, M., Lü, X., Jin, Y., Zhang, W., Prakapovich, R., & Sychou, U. (2023) · IEEE Sensors Journal · doi:10.1109/jsen.2023.3335964 · Cited by 13
“The invariant EKF (InEKF) methodology is generated by utilizing the properties of the invariant tangent vector field in matrix Lie group theory [27], [28], [29] and originally introduced in [25].”
MethodDynam-LVIO: A Dynamic-Object-Aware LiDAR Visual Inertial Odometry in Dynamic Urban Environments
Shi, J., Wang, W., Qi, M., Li, X., & Ye, Y. (2024) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2024.3395320 · Cited by 16
“For notational convenience, the same version of the “vectorized” exponential and logarithm map as presented in [42] is adopted to describe the relationship between SO ( 3 ) and so ( 3 ) where φ is the rotation vector, and φ ∈ so ( 3 ) , Exp ( φ ) ∈ SO ( 3 ) .”
MethodAdvanced Autonomous Navigation Technologies for UAVs: Challenges and Opportunities
Senhaji-Mouhaddib, I., Bouzakri, S., & Lagrat, I. (2024) · International Conference on Innovative Research in Applied Science, Engineering and Technology (IRASET) · doi:10.1109/iraset60544.2024.10548645 · Cited by 15
Torres, M. A. V., Braun, A., & Borrmann, A. (2024) · Construction Robotics · doi:10.1007/s41693-024-00126-w · Cited by 21
“In particular, we leverage the MDC implementation in Direct LiDAR Inertial Odometry (DLIO) (Chen et al. 2023), which, inspired by Forster et al. (2016), generates continuous-time trajectories.”
Zhang, C., Gu, S., Li, X., Deng, J., & Jin, S. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3486556 · Cited by 15
“Toalign the timestamp of IMU data with that of image frames and construct the data observations of IMU, Forster et al. [33] derived the preintegration expression of IMU on manifold space.”
Autonomous Tail-Sitter Flights in Unknown Environments
Lu, G., Ren, Y., Zhu, F., Li, H., Xue, R., Cai, Y., Lyu, X., & Zhang, F. (2025) · IEEE Transactions on Robotics · doi:10.1109/tro.2025.3526102 · Cited by 21
Okawara, T., Koide, K., Oishi, S., Yokozuka, M., Banno, A., Uno, K., & Yoshida, K. (2025) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2025.104929 · Cited by 14
“The error 𝑒 IMU ( 𝒙 𝑖 , 𝒙 𝑗 ) between consecutive frame states 𝒙 𝑖 and 𝒙 𝑗 is finally defined as follows: More details are given in [6].”
Legged Robot State Estimation with Invariant Extended Kalman Filter Using Neural Measurement Network
Youm, D., Oh, H., Choi, S., Kim, H., Jeon, S.-H., & Hwangbo, J. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11127971 · Cited by 25
Robust and Efficient Visual-Inertial Odometry with Multi-plane Priors
Li, J., Yang, B., Huang, K., Zhang, G., & Bao, H. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-31726-3_24 · Cited by 16
“The IMU measurements are pre-integrated into relative motion constraints using the method introduced in [7].”
MethodAn Improved Monocular Visual-Inertial Navigation System
Sun, T., Liu, Y. K., Wang, Y., & Xiao, Z. (2020) · IEEE Sensors Journal · doi:10.1109/jsen.2020.3022783 · Cited by 14
“Explicit Jacobians for such term could be obtained from [8].”
BackgroundMethodRobust Mono Visual-Inertial Odometry Using Sparse Optical Flow With Edge Detection
Zeng, Q., Gao, C., Chen, Z., Jin, Y. Q., & Kan, Y. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3070603 · Cited by 13
Wei, Y., Li, H., & Lu, M. (2021) · GPS Solutions · doi:10.1007/s10291-021-01128-9 · Cited by 13
“As introduced in the first section, we utilize the pre-integration technique proposed by Forster et al. (2017) for the interleaved integration of the IMU measurements.”
MethodWang, Z., Li, X., Zhang, X., Bai, Y., & Zheng, C. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3119289 · Cited by 13
Extrinsic Calibration and Verification of Multiple Non-overlapping Field of View Lidar Sensors
Das, S., Mahabadi, N., Djikic, A., Nassir, C., Chatterjee, S., & Fallon, M. F. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9811704 · Cited by 13
“However, instead of using a feature-based configuration, our configuration fused ICPbased point cloud matching [31] with IMU pre-integration using GTSAM [32], [33] to estimate the motion of the individual lidars and to correct for motion distortion effects.”
MethodVIDO: A Robust and Consistent Monocular Visual-Inertial-Depth Odometry
Gao, Y., Yuan, J., Jiang, J., Sun, Q., & Zhang, X. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3226719 · Cited by 15
“The covariance of VIS from preintegrated IMU measurements in (5) is similar to that from visual observations The Jacobian of where (32) with Jacobians J a and J ω describe how the preintegrated result changes due to the changes in the bias estimates [44].”
Background3DMNDT: 3D Multi-View Registration Method Based on the Normal Distributions Transform
Zhu, J.-H., Wang, D., Mu, J., Lu, H.-M., Tian, Z., & Li, Z. (2021) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2022.3225679 · Cited by 8
“Accordingly, we turn to utilize retraction technique [41].”
MethodRange–Visual–Inertial Odometry with Coarse-to-Fine Image Registration Fusion for UAV Localization
Hao, Y., He, M., Liu, Y., Liu, J., & Meng, Z. (2023) · Drones · doi:10.3390/drones7080540 · Cited by 22
“Meanwhile, the IMU measurements between two consecutive frames undergo preintegration [41].”
BackgroundA Radio-Inertial Localization and Tracking System with BLE Beacons Prior Maps
Jadidi, M. G., Patel, M., Miro, J. V., Dissanayake, G., Biehl, J. T., & Girgensohn, A. (2018) · International Conference on Indoor Positioning and Indoor Navigation · doi:10.1109/ipin.2018.8533827 · Cited by 17
“varying IMU bias using incremental Smoothing And Mapping (iSAM) [14], [15], [16] and IMU-preintegration technique [2] (Back-end); and develop the entire radio-inertial localization and tracking framework and show that by a closed-loop architecture, Figure 2, the overall system performance can be”
BackgroundMethodInfluentialReal-time Indoor Scene Reconstruction with RGBD and Inertial Input
Zhu, Z., Xu, F., Yan, C. C., Hao, X., Ji, X., Zhang, Y., & Dai, Q. (2019) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2019.00010 · Cited by 13
Forward and Backward Visual Fusion Approach to Motion Estimation with High Robustness and Low Cost
Wang, K., Huang, X., Chen, J., Cao, C., Xiong, Z., & Chen, L. F. (2019) · Remote Sensing · doi:10.3390/rs11182139 · Cited by 13
Liu, Y., Li, Z., Zheng, S., Cai, P., & Zou, X. (2022) · Micromachines · doi:10.3390/mi13040602 · Cited by 16
“Through the pre-integration [35,36], the following motion constraints can be constructed:”
BackgroundMethodShen, J., & Hong, D. W. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9811926 · Cited by 16
Learning-Aided Inertial Odometry With Nonlinear State Estimator on Manifold
Jin, Y., Zhang, W., Sun, H., & Yu, L. J. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3273391 · Cited by 15
“On the one hand, we demonstrate the ability of pure IMU odometry by comparison, and on the other hand, the core idea of our method is also similar to the fusion odometry (VIO), that is, relying on the learned pseudo-measurement”
BackgroundMethodInfluentialFast and Robust Semidirect Monocular Visual-Inertial Odometry for UAV
Zeng, Q., Yu, H., Ji, X., Tao, X., & Hu, Y. (2023) · IEEE Sensors Journal · doi:10.1109/jsen.2023.3309907 · Cited by 13
“The loosely coupled VIO framework proposed in [11] transforms the VIO problem into a low-dimensional linear state estimation problem, which uses SVO as the VIO front end and incremental smoothing and mapping 2 (iSAM2) [12] as the back end for online factor graph optimization to obtain the estimated…”
MethodVehicle-Motion-Constraint-Based Visual-Inertial-Odometer Fusion With Online Extrinsic Calibration
Zhao, H., Ji, X., & Wei, D. (2023) · IEEE Sensors Journal · doi:10.1109/jsen.2023.3319345 · Cited by 16
“First of all, we collect several visual frames in a sliding window W to limit the computation cost and do preintegration with initial IMU bias as [30].”
MethodLanegger, C., Pantic, M., Bähnemann, R., Siegwart, R., & Ott, L. (2023) · Autonomous Robots · doi:10.1007/s10514-023-10141-5 · Cited by 12
“Hu and Jing (2018) recently developed a passive Gough-Stewart structure by replacing the actuated legs with passive springs for vibration isolation.”
BackgroundRobust factor graph optimisation method for shipborne GNSS/INS integrated navigation system
Hu, Y. C., Li, H. L., & Liu, W. (2023) · IET Radar Sonar & Navigation · doi:10.1049/rsn2.12521 · Cited by 12
LIO-PPF: Fast LiDAR-Inertial Odometry via Incremental Plane Pre-Fitting and Skeleton Tracking
Chen, X., Wu, P., Li, G., & Li, T. H. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10341524 · Cited by 12
“Please refer to [28] for detailed derivations of Eqs.”
BackgroundAn adaptive grouping sonar-inertial odometry for underwater navigation
Dong, Z., Yan, W., Cui, R., Lei, L., & He, Y. (2024) · Ocean Engineering · doi:10.1016/j.oceaneng.2024.116688 · Cited by 12
Guan, Z., Xiong, Z., & Fan, M. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642213 · Cited by 18
“Specifically, the guidance should instruct users to move in certain directions and tap the touchscreen when they reach the target button.”
BackgroundMethodZhou, Y., Li, X., Li, S., Wang, X., Feng, S., & Tan, Y. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3400156 · Cited by 20
“2) IMU preintegration factor: where ∆˜ p b k b k +1 , ∆˜ v b k b k +1 , ∆ ˜ R b k b k +1 are the IMU pre-integration terms [31], g w is the gravity vector, ∆ t k is the time interval.”
BackgroundLiang, Z., Wang, K., Zhang, J., & Zhang, F. (2024) · Journal of Marine Science and Engineering · doi:10.3390/jmse12071170 · Cited by 12
A Consistent Parallel Estimation Framework for Visual-Inertial SLAM
Huai, Z., & Huang, G. P. (2024) · IEEE Transactions on Robotics · doi:10.1109/tro.2024.3433868 · Cited by 19
Accurate IMU Preintegration Using Switched Linear Systems For Autonomous Systems
Henawy, J., Li, Z., Yau, W., Seet, G., & Wan, K. W. (2019) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2019.8917537 · Cited by 12
“Experimental results show that the proposed model outperforms the classical model in [19].”
BackgroundMethodInfluentialVisual-inertial teach and repeat
Nitsche, M., Pessacg, F., & Civera, J. (2020) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2020.103577 · Cited by 12
Tawiah, T. A.-Q. (2020) · International Journal of Advanced Robotic Systems · doi:10.1177/1729881420972278 · Cited by 16
“VO problems may be formulated as nonlinear least square problems.(30,31) For a general VI system, the state parameters are Xi (Pi, Ri, Vi, b a i , b g i ), where i is the time index; Pi ]R 3 is the position of the system in world coordinates; Ri is the rotation matrix; Vi]R 3 is the velocity; b g i and b a i the gyros…”
BackgroundMethodInfluential3D Curve Creation on and Around Physical Objects With Mobile AR
Ye, H., Kwan, K. C., & Fu, H. (2021) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2020.3049006 · Cited by 14
“The state-of-the-art motion tracking techniques such as COM [17] and VIO [16], [23], [24], [25] often achieve robust tracking by fusing the visual information and the IMU data.”
MethodA nonlinear optimization-based monocular dense mapping system of visual-inertial odometry
Fan, C., Hou, J., & Yu, L. (2021) · Measurement · doi:10.1016/j.measurement.2021.109533 · Cited by 13
Daun, K., Schnaubelt, M., Kohlbrecher, S., & von Stryk, O. (2021) · IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR) · doi:10.1109/ssrr53300.2021.9597690 · Cited by 15
“LIO-SAM [1] applies the LOAM registration scheme in a smoothing and mapping context, which fuses preintegrated IMU measurements [10] and lidar registration jointly in a pose graph framework.”
MethodInvariant Cubature Kalman Filtering-Based Visual-Inertial Odometry for Robot Pose Estimation
Sang, X., Li, J., Yuan, Z., Yu, X., Zhang, J., Zhang, J., & Yang, P. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3214293 · Cited by 12
“The probability distributions on SE ( 3 ) , and their role in control and estimation, have been well studied in recent years [11], [12], [13], [14], [15].”
BackgroundStereo Visual Inertial SLAM Algorithm Fusing Point and Line Features
Xue, X., & Lv, X. (2022) · China Automation Congress (CAC) · doi:10.1109/cac57257.2022.10055743 · Cited by 12
Li, M., Hu, K., Liu, Y., Hu, E., Tang, C., Zhu, H. J., & Zhou, G. (2023) · Remote Sensing · doi:10.3390/rs15215093 · Cited by 14
Zhou, W., Pan, Y., Liu, J., Wang, T., & Zha, H. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3386448 · Cited by 14
Joint on-manifold self-calibration of odometry model and sensor extrinsics using pre-integration
Deray, J., Solà, J., & Andrade‐Cetto, J. (2019) · European Conference on Mobile Robots · doi:10.1109/ecmr.2019.8870942 · Cited by 12
“The pre-integration theory developed for the IMU sensor [8, 9] deals with the problem of producing motion factors for a factor graph from the aggregation of hundreds of motion measurements.”
BackgroundMethodIntegrated Autonomous Relative Navigation Method Based on Vision and IMU Data Fusion
Liu, W., Wu, S., Wen, Y., & Wu, X. (2020) · IEEE Access · doi:10.1109/access.2020.2978154 · Cited by 12
“In reference [26], a pre-integration theory was proposed, to process the structure of rotation group, and prove that the pre-integration inertial measurement unit model can be seamlessly integrated into the vision inertial measurements under the unified frame of factor graph.”
MethodUnsupervised Balanced Covariance Learning for Visual-Inertial Sensor Fusion
Kim, Y., Yoon, S., Kim, S., & Kim, A. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3051571 · Cited by 12
“As the conventional method [21] gives nearly constant covariances for all the measurements regardless of error, their average log-likelihood shows poor results.”
MethodInfluentialWOLF: A Modular Estimation Framework for Robotics Based on Factor Graphs
Solà, J., Vallvé, J., Casals, J., Deray, J., Fourmy, M., Atchuthan, D., Murtra, A. C., & Andrade‐Cetto, J. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3151404 · Cited by 12
A Survey of Simultaneous Localization and Mapping with an Envision in 6G Wireless Networks
Huang, B., Zhao, J., Luo, S., & Liu, J. (2021) · Journal of Global Positioning Systems · doi:10.5081/jgps.17.1.94 · Cited by 75
Zhang, C., Liu, Y., Wang, F., Xia, Y., & Zhang, W. (2018) · Sensors · doi:10.3390/s18114036 · Cited by 13
“Forster et al. proposed an on-manifold based pre-integration technique for VIO state estimation in Reference [23].”
MethodAn Invariant-EKF VINS Algorithm for Improving ConsistencyPreprint
Zhang, T. L., Wu, K., Su, D., Huang, S., & Dissanayake, G. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.07920 · Cited by 18
“Although there has been recent progress in the development of optimization based algorithms [1][2], the extended Kalman filter (EKF) based solutions are still extensively used (e.”
BackgroundMethodRoadMap: A Light-Weight Semantic Map for Visual Localization towards Autonomous DrivingPreprint
Qin, T., Zheng, Y., Chen, T., Chen, Y., & Su, Q. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.02527 · Cited by 12
“Popular approaches include camera-only methods [1]–[5] and visual-inertial methods [6]–[9].”
MethodFAST-LIO2: Fast Direct LiDAR-inertial OdometryPreprint
Xu, W. D., Cai, Y., He, D., Lin, J., & Zhang, F. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.06829 · Cited by 12
SPINS: A structure priors aided inertial navigation system
Lyu, Y., Nguyen, T., Liu, L., Cao, M., Yuan, S., Nguyen, T. H., & Xie, L. (2023) · Journal of Field Robotics · doi:10.1002/rob.22161 · Cited by 13
“The IMU measurement between time step m and m + 1 is obtained by integrating high‐frequency raw IMU measurements continuously with the technique called IMU preintegration (Forster et al., 2017), and Σm is the corresponding measurement covariance.”
Global Visual–Inertial Localization for Autonomous Vehicles with Pre-Built Map
Hao, Y., Liu, J., Liu, Y., Liu, X., Meng, Z., & Xing, F. (2023) · Sensors · doi:10.3390/s23094510 · Cited by 13
“Moreover, the linearization errors can cause the filter to be inconsistent [18].”
BackgroundMethodOu, F., Li, Y., Li, N., Zhou, J., Zhang, W., & Miao, Z. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3369657 · Cited by 12
“Since each step of the preintegration has utilized the IMU bias, refer to [46], to make a first-order linearization model of preintegration to bias, which can be utilized to correct preintegration.”
MethodUncertainty‐aware LiDAR‐based localization for outdoor mobile robots
Park, G., & Chung, W. (2024) · Journal of Field Robotics · doi:10.1002/rob.22392 · Cited by 14
A Factor Graph Optimization-Based In-Motion Alignment Method for INS/DVL Integration
Zhang, L., Zhang, T., & Wei, H. (2024) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2024.3443870 · Cited by 11
Factor Graph Optimization for Flexibly Modeled INS/GPS Navigation in Graphical State-Space
Zhou, Z., Zhao, S., Zhang, C., Wu, J., & Huang, B. (2024) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2024.3449990 · Cited by 12
LL-VI SLAM: enhanced visual-inertial SLAM for low-light environments
Ma, T., Li, L., Du, F., Shu, J., & Li, C. (2024) · Measurement Science and Technology · doi:10.1088/1361-6501/ad9627 · Cited by 11
“This technique was first introduced in the manifold space by Lupton et al [41] and Forster et al [42], who simplified the integration process through first-order bias approximation, significantly alleviated the computational burden in complex systems such as SLAM.”
A New Underwater All Source Positioning and Navigation(ASPN) Algorithm Based on Factor Graph
Si, S., Zhang, Y., Luo, L., & Nin, L. (2019) · Chinese Control and Decision Conference (CCDC) · doi:10.1109/ccdc.2019.8832700 · Cited by 11
“Then apply IMU preintegration to the underwater ASPN system to solve the problem of the high output frequency of the IMU[6].”
MethodVehicle Odometry with Camera-Lidar-IMU Information Fusion and Factor-Graph Optimization
Peng, W., Ao, Y., He, J., & Wang, P. (2021) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-021-01329-x · Cited by 12
Li, Y., Yang, S., Xiu, X., & Miao, Z. (2022) · Sensors · doi:10.3390/s22197637 · Cited by 12
“IMU Preintegration Factor To avoid the repeated integration problem after the linearization point changes, the literature [28] proposed a preintegration method to integrate the motion state in the interval.”
MethodSoliman, A., Bonardi, F., Sidibé, D., & Bouchafa, S. (2022) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-022-01753-7 · Cited by 14
Dor, M., Driver, T., Getzandanner, K. M., & Tsiotras, P. (2024) · The International Journal of Robotics Research · doi:10.1177/02783649241234367 · Cited by 22
Visual inertial odometry using coupled nonlinear optimization
Hong, E., & Lim, J. (2017) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206610 · Cited by 16
“[10], [18] proposed a factor graph optimization framework using the pre-integrated IMU model that improved this disadvantage.”
MethodOptimization-Based, Simplified Stereo Visual-Inertial Odometry With High-Accuracy Initialization
Yang, G., Zhao, L., Mao, J., & Liu, X. (2019) · IEEE Access · doi:10.1109/access.2019.2902295 · Cited by 12
“Therefore, the error of IMU states can be defined as es = [1rT ,1aT ,1vT ,1bT ]T and each element in this vector follows zero-mean Gaussian distribution according to theory in [27].”
BackgroundON RAW INERTIAL MEASUREMENTS IN DYNAMIC NETWORKS
Cucci, D. A., & Škaloud, J. (2019) · ISPRS annals of the photogrammetry, remote sensing and spatial information sciences · doi:10.5194/isprs-annals-iv-2-w5-549-2019 · Cited by 20
“IMU pre-integration is well known in robotics literature: it was first introduced in (Lupton and Sukkarieh, 2009, Lupton and Sukkarieh, 2012) and it is now at the core of modern visual-inertial systems, e.g., (Forster et al., 2017).”
BackgroundMethodEvents-To-Video: Bringing Modern Computer Vision to Event Cameras
Rebecq, H., Ranftl, R., Koltun, V., & Scaramuzza, D. (2019) · Zurich Open Repository and Archive (University of Zurich) · doi:10.48550/arxiv.1904.08298 · Cited by 11
“Because of its importance in augmented/virtual reality and mobile robotics, VIO has been extensively studied in the last decade and is relatively mature today [28, 23, 6, 13, 36].”
BackgroundSelf-citationA Robust Multi-Stereo Visual-Inertial Odometry Pipeline
Jaekel, J., Mangelson, J. G., Scherer, S., & Kaess, M. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341604 · Cited by 20
“Measurements associated with each frame consist of relative and marginalized IMU measurements [5, 11] between consecutive poses, as well as stereo projection factors which connect a pose and a”
BackgroundRobust Single Rotation AveragingPreprint
Lee, S. H., & Civera, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.00732 · Cited by 11
“The two representations are related by Rodrigues formula, and we denote the corresponding mapping between them by Exp ( · ) and Log ( · ) [5]: The geodesic distance between two rotations d ∠ ( R 1 , R 2 ) is obtained by substituting R 1 R 2 into (3).”
LiDAR-odometry based UAV pose estimation in young forest environment
Ouattara, I., Korhonen, V. T., & Visala, A. (2022) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2022.11.121 · Cited by 10
“But reading these data at sufficiently high rate can overwhelm the FCU and have a negative impact on its primary function, which is to stabilize and control the motion of the vehicle.”
A Real-Time Factor-Graph-Optimized Pedestrian Navigation Method
Yuan, C., Lai, J., Lyu, P., Liu, R., & Zhu, J. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3283594 · Cited by 12
“A preintegration method based on the special orthogonal group in manifold [12] was recently proposed, which integrates inertial measurements on a relative coordinate and ensures that each inertial factor is independent of the others.”
MethodChen, S., Li, X., Huang, G., Zhang, Q., & Wang, S. (2023) · IEEE Sensors Journal · doi:10.1109/jsen.2023.3317575 · Cited by 11
“The preintegrated measurements (cid:49) v ij , (cid:49) p ij , and (cid:49) R ij between times i and j are calculated using We refer the reader to the description from [23] for a detailed derivation of the above (cid:49) v , (cid:49) p , and (cid:49) R due to space limitations.”
MethodIMU Augment Tightly Coupled Lidar-Visual-Inertial Odometry for Agricultural Environments
Hoang, Q. H., & Kim, G.-W. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3440728 · Cited by 12
We, T., Huang, A., Liu, E., Wu, J., & Zhang, R. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3472470 · Cited by 10
激光雷达同时定位与建图中的局部几何信息表征与不确定度分析探究
Kai, 黄. H., Junqiao, 赵. Z., & Tiantian, 冯. F. (2025) · Chinese Journal of Lasers · doi:10.3788/cjl241023 · Cited by 10
VIA-SLAM: An Underwater Visual–Inertial–Acoustic SLAM With Integrated DVL
Huang, H., Liu, Z., Zhang, L., Wang, D., & Wang, J. (2025) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2025.3571157 · Cited by 13
“To avoid reintegrating the measurement results, we follow the IMU preintegration theory to introduce the incremental forms ∆ R ij , ∆ v ij , and ∆ p ij [32], which only require computing the changes between frames i and j”
Plane-Aided Visual-Inertial Odometry for 6-DOF Pose Estimation of a Robotic Navigation Aid
Zhang, H., & Ye, C. (2020) · IEEE Access · doi:10.1109/access.2020.2994299 · Cited by 10
“The computation of o r 2 for the prior factor and s r 2 i , i + 1 for the IMU factors F I follows Forster’s VIO method [25].”
BackgroundMethodInfluentialA Hyperhemispherical Grid Filter for Orientation Estimation
Pfaff, F., Li, K., & Hanebeck, U. D. (2020) · International Conference on Information Fusion (FUSION) · doi:10.23919/fusion45008.2020.9190611 · Cited by 10
“While such approaches have been applied successfully even for challenging scenarios involving SE(3) poses, such as visual-inertial odometry [4], they are”
BackgroundThree-Dimensional Mapping of Indoor and Outdoor Environment Using LIO-SAM
Warku, H. T., Ko, N. Y., Yeom, H. G., & Choi, W. (2021) · International Conference on Control, Automation and Systems (ICCAS) · doi:10.23919/iccas52745.2021.9649820 · Cited by 11
High-precision Calibration of Camera and IMU on Manipulator for Bio-inspired Robotic System
Zhang, Y., Liang, W. G., Zhang, S., Yuan, X., Xia, X., Tan, J., & Pang, Z. (2022) · Journal of Bionic Engineering · doi:10.1007/s42235-022-00163-7 · Cited by 10
“J r is the right Jacobian of rotation that relates the additive increments of angular velocity in the tangent space [26].”
BackgroundMethodZhou, C., Sun, Q., Wang, K., Li, J., & Zhang, X. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3189815 · Cited by 10
“Similar to the on-manifold technique pioneered by [34], problem (12) is optimized iteratively in a lift-regularize-solve-retract fashion.”
BackgroundMethodProprioceptive State Estimation of Legged Robots with Kinematic Chain Modeling
Agrawal, V., Bertrand, S., Griffin, R. J., & Dellaert, F. (2022) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/humanoids53995.2022.10000099 · Cited by 14
Self-citation
Metadata
- Authors
- Forster, C., Carlone, L., Dellaert, F., & Scaramuzza, D.
- Affiliations
- Massachusetts Institute of Technology (US)
- Georgia Institute of Technology (US)
- University of Zurich (CH)
- Venue
- IEEE Transactions on Robotics
- Published
- 2017-02
- Volume
- 33
- Issue
- 1
- Pages
- 1-21
- ISSN
- 1552-3098 (ISSN-L)
- 1941-0468
- OpenAlex
- W2482726005
- Cited by
- 1,502
- References
- 83
- Citations by year
- 2026: 156 · 2025: 179 · 2024: 234 · 2023: 193 · 2022: 180 · 2021: 174 · 2020: 134 · 2019: 129 · 2018: 88 · 2017: 32
- FWCI
- 102.35
- Type
- journal article
- Language
- en
- Open access
- green
- www.zora.uzh.ch
- Licence
- Locations
- IEEE Transactions on Robotics (publishedVersion)
- Zurich Open Repository and Archive (University of Zurich) (acceptedVersion, other-oa)
- arXiv (Cornell University) (submittedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion, cc-by-nc-nd)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion, other-oa)
- arXiv (Cornell University)
- Zurich Open Repository and Archive (University of Zurich)
- Funders
- Swiss National Foundation (200021-143607)
- National Center of Competence in Research Robotics (NCCR)
- University of Zurich
- National Science Foundation (11115678)
- United States Department of Agriculture (USDA)
- National Institute of Food and Agriculture (GEOW-2014-09160)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
- Physical Sciences › Engineering › Aerospace Engineering › Inertial Sensor and Navigation
- Physical Sciences › Computer Science › Artificial Intelligence › Target Tracking and Data Fusion in Sensor Networks
- Keywords
- visual-inertial odometry, inertial measurement unit, factor graphs, maximum a posteriori estimation, bias correction, real-time state estimation, keyframe selection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.