On-Manifold Preintegration for Real-Time Visual--Inertial Odometry
Open accessThe DOI matches its Crossref record; 83 of the 83 references it cites were found in a registry or an index.
Abstract
Current approaches for visual-inertial odometry (VIO) are able to attain highly accurate state estimation via nonlinear optimization. However, real-time optimization quickly becomes infeasible as the trajectory grows over time; this problem is further emphasized by the fact that inertial measurements come at high rate, hence, leading to the fast growth of the number of variables in the optimization. In this paper, we address this issue by preintegrating inertial measurements between selected keyframes into single relative motion constraints. Our first contribution is a preintegration theory that properly addresses the manifold structure of the rotation group. We formally discuss the generative measurement model as well as the nature of the rotation noise and derive the expression for the maximum a posteriori state estimator. Our theoretical development enables the computation of all necessary Jacobians for the optimization and a posteriori bias correction in analytic form. The second contribution is to show that the preintegrated inertial measurement unit model can be seamlessly integrated into a visual-inertial pipeline under the unifying framework of factor graphs. This enables the application of incremental-smoothing algorithms and the use of a structureless model for visual measurements, which avoids optimizing over the 3-D points, further accelerating the computation. We perform an extensive evaluation of our monocular VIO pipeline on real and simulated datasets. The results confirm that our modeling effort leads to an accurate state estimation in real time, outperforming state-of-the-art approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multiple View Geometry in Computer Vision
Hartley, R., & Zisserman, A. (2004) · doi:10.1017/cbo9780511811685 · Cited by 21,070
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897 · cited 2×
“We use the relative error metrics proposed in [68] to obtain error statistics.”
MethodEstimation with Applications to Tracking and Navigation: Theory, Algorithms and Software
Bar‐Shalom, Y., Li, X. ‐., & Kirubarajan, T. (2002) · doi:10.1002/0471221279 · Cited by 6,782
A Mathematical Introduction to Robotic Manipulation
Murray, R. M., Li, Z., & Sastry, S. S. (2017) · CRC Press eBooks · doi:10.1201/9781315136370 · Cited by 6,694 · cited 1×
“For this purpose, we introduce the following kinematic model [49], [53]:”
MethodFactor graphs and the sum-product algorithm
Kschischang, F. R., Frey, B. J., & Loeliger, H.-A. (2001) · IEEE Transactions on Information Theory · doi:10.1109/18.910572 · Cited by 6,486 · cited 1×
“This naturally leads to the well known factor graph representation, a class of bipartite graphical models that can be used to represent such factored densities [51], [52].”
BackgroundParallel Tracking and Mapping for Small AR Workspaces
Klein, G., & Murray, D. (2007) · 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2007.4538852 · Cited by 4,346 · cited 1×
“A breakthrough has been the development of incremental smoothing techniques (iSAM [36], iSAM2 [3]), which leverage the expressiveness of factor graphs to maintain sparsity and to identify and update only the typically small subset of variables affected by a new measurement.”
MethodMonoSLAM: Real-time single camera SLAM
Davison, A. J., Reid, I. D., Molton, N. D., & Stasse, O. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1049 · Cited by 3,959 · cited 1×
“The complexity of the EKF grows quadratically in the number of estimated landmarks, therefore, a small number of landmarks (in the order of 20) are typically tracked to allow real-time operation [10–12].”
BackgroundMatrix Analysis and Applied Linear Algebra
Meyer, C. (2000) · doi:10.1137/1.9780898719512 · Cited by 3,565 · cited 1×
“Any basis El ∈ R2nl×2nl−3 of the null space of El satisfies the following relation [71]:”
BackgroundMatrix analysis and applied linear algebra
(2001) · Choice Reviews Online · doi:10.5860/choice.38-5065 · Cited by 3,300
Stochastic models, estimation, and control
(1982) · Mathematics in Science and Engineering · doi:10.1016/s0076-5392(08)x6186-7 · Cited by 3,229
Cited by
Items 801–900 of 1,000
Open-Structure: Structural Benchmark Dataset for SLAM Algorithms
Li, Y., Guo, Z. Z., Yang, Z. H., Sun, Y., Zhao, L., & Tombari, F. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3487071 · Cited by 8
“Index Terms —Data sets for slam, localization, mapping.”
BackgroundDrift-Free Visual SLAM Using Digital Twins
Merat, R., Cioffi, G., Bauersfeld, L., & Scaramuzza, D. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3518840 · Cited by 16
Self-citationGu, Y., Liu, Z., & Zou, T. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10802731 · Cited by 10
“On the other hand, smoothing methods estimate robot states by maximizing the likelihood of all sensor data within a probabilistic graphical model framework [4], [12]– [14].”
Application of 3D point cloud and visual-inertial data fusion in Robot dog autonomous navigation
Zou, H., Zhou, C., Li, H., Wang, X., & Wang, Y. (2025) · PLoS ONE · doi:10.1371/journal.pone.0317371 · Cited by 5
“The IMU measurement model is expressed as shown in Eq (2) [20].”
Xiang, Z., Wang, Q., Huang, R., Jin, S., Nie, X., & Zhou, J. X. (2025) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2025.3546606 · Cited by 6
Direct Visual-Inertial Odometry and Mapping for Unmanned Vehicle
Xu, W., & Choi, D. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-50832-0_58 · Cited by 5
A Fast Stereo Visual-Inertial Odometry for MAVs
Bi, Y., Lai, S., & Chen, B. M. (2018) · International Conference on Control and Automation · doi:10.1109/icca.2018.8444257 · Cited by 5
“We follow the formulation in [19] to integrate IMU data between two frames.”
MethodVIMO: Simultaneous Visual Inertial Model-Based Odometry and Force Estimation
Nisar, B., Foehn, P., Falanga, D., & Scaramuzza, D. (2019) · Robotics: Science and Systems · doi:10.15607/rss.2019.xv.082 · Cited by 9
Self-citationRobust non-Gaussian semantic simultaneous localization and mapping
Doherty, K. (2019) · Open Access Server of the Woods Hole Scientific Community (Woods Hole Scientific Community) · doi:10.1575/1912/24859 · Cited by 5
“[18]) we can obtain that the distribution of the pose T = h(xt−1,xt) can be written in terms of the measurement T̃ as:”
MethodA Robust Pavement Mapping System Based on Normal-Constrained Stereo Visual Odometry
Huang, H., Fan, R., Zhu, Y., Liu, M., & Pitas, I. (2019) · IEEE International Conference on Imaging Systems and Techniques (IST) · doi:10.1109/ist48021.2019.9010439 · Cited by 5
“[23] proposed a pre-integration strategy to bootstrap visual-inertial odometry, while Qin et al.”
Feng, M., Jiang, P., Liu, Y., & Wang, J. (2020) · Journal of Physics Conference Series · doi:10.1088/1742-6596/1544/1/012047 · Cited by 5
Automatic wall slant angle map generation using 3D point clouds
Kim, J., Yun, S., Jung, M., Kim, A., & Cho, Y. (2021) · ETRI Journal · doi:10.4218/etrij.2021-0053 · Cited by 5
“LiDAR inertial odometry via smoothing and mapping (LIO-SAM) proposed in Shan et al. [9] combines LiDAR SLAM with IMU preintegration factor [10] to complete the egocentric LiDAR-inertial state estimator.”
MethodAn Iterative-Optimization-Based Calibration Framework for VIO With Limited Prior Conditions
Wei, H., Zhang, T., & Zhu, Y. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3112060 · Cited by 5
“Based on the derive of preintegration, the rotation matrix R W B , velocity v W B , and position p W B of the IMU can be obtained by integrating the IMU measurements over this interval : The details of the Jacobians can be found in [24].”
BackgroundMethodMarkov Parallel Tracking and Mapping for Probabilistic SLAM
Huai, Z., & Huang, G. P. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561238 · Cited by 7
“…computational complexity, the filtering and the fixed-lag smoothing methods are proposed, which focus on the estimation over only a bounded-size, sliding window of recent states by marginalizing out the past states and measurements (e.g., [10], [11], [12], [13], [14], [15], [16], [17]).”
BackgroundDVIO: Depth-Aided Visual Inertial Odometry for RGBD Sensors
Tyagi, A., Liang, Y., Wang, S., & Bai, D. (2021) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar52148.2021.00034 · Cited by 5
RIA-CSM: A Real-Time Impact-Aware Correlative Scan Matching Using Heterogeneous Multi-Core SoC
Bao, M., Wang, K., Li, R., Ma, B., & Fan, Z. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3146283 · Cited by 5
Deep 6-DOF Head Motion Prediction for Latency in Lightweight Augmented Reality Glasses
Yoon, S., Lim, H. J., Kim, J. H., Lee, H., Kim, Y.-T., & Sull, S. (2022) · International Conference on Consumer Electronics · doi:10.1109/icce53296.2022.9730327 · Cited by 10
Improvement and Experimental Evaluation Based on ORB-SLAM-VI Algorithm
Wang, R., Wu, G., & Deng, Y. (2022) · International Conference on Artificial Intelligence and Big Data (ICAIBD) · doi:10.1109/icaibd55127.2022.9820290 · Cited by 5
Visual-Inertial Odometry aided by Speed and Steering Angle Measurements
Serov, A., Clemens, J., & Schill, K. (2022) · International Conference on Information Fusion (FUSION) · doi:10.23919/fusion49751.2022.9841243 · Cited by 5
Vision-Based Terrain Relative Navigation on High Altitude Balloon and Sub-Orbital Rocket
Maggio, D. R., Mario, C., Streetman, B. J., Steiner, T. J., & Carlone, L. (2023) · AIAA SciTech Forum · doi:10.2514/6.2023-0875 · Cited by 6
“IBAL could additionally be combined with a nonlinear estimator such as an Extended Kalman Filter (EKF) or a fixed-lag smoother through either a loosely coupled approach using IBAL’s pose estimate or a tightly-coupled approach using landmark matches [2].”
MethodSelf-citationInertial preintegration for VI‐SLAM by the screw motion theory
Bessaad, N., Qi-lian, B., Zhao, J., Benoudina, N., Sun, S., & Zhang, X. (2023) · Journal of Field Robotics · doi:10.1002/rob.22212 · Cited by 5
“This derivation is comparable to the work of Forster in (Forster et al., 2016) but with richer information coded within the gyros bias Jacobians that accounts for the screwmotions’ nature.”
MethodInfluentialOwlFusion: Depth-Only Onboard Real-Time 3D Reconstruction of Scalable Scenes for Fast-Moving MAV
Gou, G., Wang, X., Sui, H., Wang, S., Zhang, H., & Li, J. (2023) · Drones · doi:10.3390/drones7060358 · Cited by 5
A ZUPT Aided Initialization Procedure for Tightly-coupled Lidar Inertial Odometry based SLAM System
Gui, L., Zeng, C., Dauchert, S. A., Luo, J., & Wang, X. (2023) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-023-01886-3 · Cited by 6
“We follow the IMU preintegration method proposed in [13] to obtain the relative platform motion between two LiDAR frames.”
BackgroundMethodTan, C. S. (2023) · International Journal of Software Science and Computational Intelligence · doi:10.4018/ijssci.333628 · Cited by 6
Joint On-Manifold Gravity and Accelerometer Intrinsics Estimation for Inertially Aligned Mapping
Nemiroff, R., Chen, K., & Lopez, B. T. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10342424 · Cited by 5
“Additionally, [8] is unique in that it employs a popular fixed-lag trajectory optimization method based on IMU pre-integration [17], but explicitly allows freedom of the local map’s orientation; the gravity-informed orientations are then added as constraints to the global pose graph.”
MethodManifold Geometry with Fast Automatic Derivatives and Coordinate Frame Semantics Checking in C++
Koppel, L., & Waslander, S. L. (2018) · Canadian Conference on Computer and Robot Vision · doi:10.1109/crv.2018.00027 · Cited by 5
A method for UAV multi-sensor fusion 3D-localization under degraded or denied GPS situation
Bulunseechart, T., & Smithmaitrie, P. (2018) · Journal of Unmanned Vehicle Systems · doi:10.1139/juvs-2018-0007 · Cited by 5
Graph optimization Based Long-distance GPS/IMU Integrated Navigation
Xiao-jie, G., Zhang, F., Xu, J., Yuan, Q. D., Ma, H., Liu, X., & Li, Z. (2019) · Chinese Control Conference (CCC) · doi:10.23919/chicc.2019.8866115 · Cited by 5
Research on ORB-SLAM Autonomous Navigation Algorithm
Xu, C. L., Qu, D., Wu, C., Li, Z., Di, P., Song, J., & Tian, D. (2019) · IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems · doi:10.1109/cyber46603.2019.9066712 · Cited by 5
“The application of pre-integration algorithm [6] also brings forward a new idea of tight coupling of visual inertial derivative data information.”
BackgroundHe, Y.-Q., Dai, B., Xu, W.-L., Yang, L.-Y., & Gu, F. (2020) · Scientia Sinica Informationis · doi:10.1360/ssi-2019-0237 · Cited by 1
Accurate Visual-Inertial SLAM by Feature Re-identification
Peng, X., Liu, Z., Wang, Q., Kim, Y.-T., Jeon, M. J., & Lee, H. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636186 · Cited by 5
“For IMU term E i,i+1, prior term E prior t0 and relative constraint E rel i , please refer to [11] and [37] for details.”
Rosinol, A., Rebecq, H., Horstschaefer, T., & Scaramuzza, D. (2017) · arXiv (Cornell University) · Cited by 5
Self-citationLiDAR and Inertial Fusion for Pose Estimation by Non-linear OptimizationPreprint
Ye, H., & Liu, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.07104 · Cited by 11
“As described in [4], [15], [16], the above three states can be written as functions of acceleration bias b a I and gyro biases b g I .”
FAST-LIO2: Fast Direct LiDAR-Inertial OdometryPreprint
Xu, W. D., Lin, J., He, D., & Zhang, F. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4675561 · Cited by 7
In-P3VINS: Tightly-Coupled PPP/INS/Visual SLAM Based on Invariant Optimization Approach
Li, T., Hua, T., Fu, M., Zhang, W., Pei, L., Yu, W., & Truong, T. (2025) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2025.3545405 · Cited by 5
LiDAR-inertial Odometry based on extended Kalman filter
Akai, N., & Nakao, T. (2025) · Advanced Robotics · doi:10.1080/01691864.2025.2483216 · Cited by 4
“In LIO-EKF, prediction is performed using IMU preintegration [14], and measurements for the update phase are derived from scan matching results between LiDAR and local map point clouds.”
Qiuping, L., Tian, 夏. X., Hong, 梅. M., & Jia, 李. L. (2025) · Chinese Journal of Lasers · doi:10.3788/cjl250661 · Cited by 4
Kang, J. (2025) · Sensors · doi:10.3390/s25196050 · Cited by 9
“VINS-Mono [13] is an optimization-based approach that employs IMU pre-integration [24] and uses a sliding window to maintain robust pose estimation performance.”
UNO: Unified Self‐Supervised Monocular Odometry for Platform‐Agnostic Deployment
Zhao, W., Niu, Y., Wang, Y., Deng, T., Yuan, S., Wang, Z., Guo, R., & Wang, J. (2025) · CAAI Transactions on Intelligence Technology · doi:10.1049/cit2.70095 · Cited by 7
DynoSAM: Open-Source Smoothing and Mapping Framework for Dynamic SLAM
Morris, J., Wang, Y., Kliniewski, M., & Ila, V. (2025) · IEEE Transactions on Robotics · doi:10.1109/tro.2025.3641813 · Cited by 17
Benchmarking Egocentric Visual-Inertial SLAM at City Scale
Krishnan, A., Liu, S., Sarlin, P.-E., Gentilhomme, O., Caruso, D., Monge, M., Newcombe, R. A., Engel, J. J., & Pollefeys, M. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.02338 · Cited by 23
“(1)), b) the error between measured and triangulated CPs, as well as c) feature reprojection errors and d) inertial pre-integration constraints typically used in VI-SLAM [24].”
An Extrinsic Calibration Method between LiDAR and GNSS/INS for Autonomous Driving
Pi, J., Yan, G., Wang, C., Cai, X., & Shi, B. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610541 · Cited by 14
Robust Ground Constrained SLAM for Mobile Robot With Sparse-Channel LiDAR
Wang, S., Cao, F., Wang, T., Shao, S., & Liu, L. (2024) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2024.3451137 · Cited by 4
A novel online time calibration framework via double-stage EKF for visual-inertial odometry
Li, S., Nie, J., Guo, C., Yang, Y., & Mei, L. (2024) · Robotica · doi:10.1017/s0263574724001589 · Cited by 4
Incorporating control inputs in continuous-time Gaussian process state estimation for robotics
Lilge, S., & Barfoot, T. D. (2025) · Robotica · doi:10.1017/s0263574725000116 · Cited by 11
“We show that considering control inputs is particularly useful when the available measurement data is sparse.”
A Robust and Efficient Visual-Inertial Initialization With Probabilistic Normal Epipolar Constraint
Mu, C., Feng, D., Zheng, Q., & Zhuang, Y. (2025) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2025.3544522 · Cited by 4
“The effect of the gyroscope bias b g on the rotation pre-integration γ b i b j can be expressed as a first-order Taylor approximation: where b g denotes the Jacobian of the derivative of γ b i b j with respect to b g .”
Multi-Contact Inertial Parameters Estimation and Localization in Legged Robots
Martinez, S., Griffin, R. J., & Mastalli, C. (2025) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2025.3550845 · Cited by 6
“To harness its advantages in robotics, it is crucial to solve these large and challenging optimization problems efficiently.”
Multi-Feature Nonlinear Optimization Motion Estimation Based on RGB-D and Inertial Fusion
Zhao, X., Miao, C., & Zhang, H. (2020) · Sensors · doi:10.3390/s20174666 · Cited by 4
“[8] proposed an open keyframe visual-inertial SLAM (OKVIS) based on a nonlinear optimization framework, which uses IMU pre-integration [9] to avoid repeated IMU integration and the first-in-last-out sliding window method for bounding computation to handle all measurements.”
BackgroundMethodRobust visual-inertial odometry with point and line features for blade inspection UAV
Ma, Y., Wang, S., Yu, D., & Zhu, K. (2021) · Industrial Robot the international journal of robotics research and application · doi:10.1108/ir-01-2020-0009 · Cited by 4
A Robust Lidar-Inertial Localization System Based on Outlier Removal
Wang, X., Ding, D., & Fu, W. (2021) · China Automation Congress (CAC) · doi:10.1109/cac53003.2021.9727833 · Cited by 4
“More details about pre-integration can be found in [15].”
BackgroundA Tight Filtering and Smoothing Fusion Method With Feature Tracking for LiDAR Odometry
Liang, S., Cao, Z., Yu, J., Tan, M. H., & Wang, S. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3178614 · Cited by 5
“Odometry methods are divided into two types according to the number of poses involved in the pose optimization [14], [15], where filtering methods optimize the latest pose and smoothing methods optimize a window of the latest poses (fixed-lag smoothing) or complete history of poses (full smoothing).”
MethodFDO-Calibr: visual-aided IMU calibration based on frequency-domain optimization
Liu, Y., Li, Z., Xiao, L., Zheng, S., Cai, P., Zhang, H., Zheng, P., & Zou, X. (2022) · Measurement Science and Technology · doi:10.1088/1361-6501/acadfb · Cited by 4
“Unlike the IMU-preintegration method [36], the frequency-domain information can be made full use of by obtaining the visual and inertial motion information.”
IMU preintegration for 2D SLAM problems using Lie Groups
Geer, I., Vallvé, J., & Solà, J. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981876 · Cited by 4
“Incorporating IMU to these systems was possible thanks to the preintegration methods pioneered by Lupton [1], and improved later by Forster [2] with the use of Lie theory for the rotational part SO(3).”
BackgroundMethodInfluentialFrom sparse SLAM to dense mapping for UAV autonomous navigation
Habib, Y., Papadakis, P., Fagette, A., Barz, C. L., Gonçalves, T., & Buche, C. (2023) · SPIE Geospatial Informatics · doi:10.1117/12.2663706 · Cited by 5
A Closed Stockyard UAV Intelligent Inventory System
Qiu, Z., Lin, D., Lv, J., Sun, Z., & Zheng, Z. (2023) · Journal of Physics Conference Series · doi:10.1088/1742-6596/2513/1/012010 · Cited by 5
Resilient Terrain Navigation with a 5 DOF Metal Detector Drone
Pfreundschuh, P., Bähnemann, R., Kazik, T., Mantel, T., Siegwart, R., & Andersson, O. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10161253 · Cited by 4
“Pre-integrated IMU factors summarize the IMU measurements between two nodes into a single factor [24].”
BackgroundFast Extrinsic Calibration for Multiple Inertial Measurement Units in Visual-Inertial System
Yu, Y., Liu, Y., Fu, F., He, S., Zhu, D., Wang, L., Zhang, X., & Li, J. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10161187 · Cited by 13
“IMU, as a proprioceptive sensor, outputs high-frequency measurements but suffers from pose drift in long-term integration [1]–[6], [8].”
BackgroundTian, Y., Liu, F., Liu, H., Liu, Y., Suwoyo, H., Jin, T., Li, L., & Wang, J. (2023) · Advanced Intelligent Systems · doi:10.1002/aisy.202300138 · Cited by 9
GVIM: GNSS/Visual/IMU/Map Integration Via Sliding Window Factor Graph Optimization in Urban Canyons
Bai, X., & Hsu, L. (2023) · Proceedings of the Satellite Division's International Technical Meeting (Online)/Proceedings of the Satellite Division's International Technical Meeting (CD-ROM) · doi:10.33012/2023.19458 · Cited by 4
Cloud and Edge Computing for Connected and Automated Vehicles
Zhu, Q., Bo, Y., Wang, Z., Tang, J., Chen, Q. A., Li, Z., Liu, X., Luo, Y., & Tu, L. (2023) · Foundations and Trends® in Electronic Design Automation · doi:10.1561/1000000058 · Cited by 9
LiDAR-Inertial SLAM with Efficiently Extracted Planes
Chen, C., Wu, H., Ma, Y., Lv, J., Li, L., & Liu, Y. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10342325 · Cited by 4
“We construct a factor graph consisting of IMU pre-integration factors [22], LiDAR odometry factors, and explicit plane factors within the sliding window (Sliding Window Odometry in Fig.”
BackgroundMethodConsistent Fusion of Correlated Pose Estimates on Matrix Lie Groups
Zarei, M., & Chhabra, R. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3405795 · Cited by 4
DY-LIO: Tightly Coupled LiDAR-Inertial Odometry for Dynamic Environments
Zou, J., Chen, H., Shao, L., Bao, H., Tang, H., Xiang, J., & Liu, J. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3414661 · Cited by 4
“1) IMU Preintegration: Forster et al. [33] proposed the well-known IMU preintegration.”
BackgroundLi, M., Zhang, H., Shen, T., Zhou, Z., & Zhou, Z. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3418334 · Cited by 4
“1 shows that the tightly coupled VINS realizes the time alignment between the two sensors through IMU preintegration [39].”
BackgroundWang, H., Hong, X., Qin, L., Shi, C. L., & Wu, G. (2024) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2024.109177 · Cited by 4
From Underground Mines to Offices: A Versatile and Robust Framework for Range-Inertial SLAM
Montano-Oliván, L., Placed, J. A., Montano, L., & Lázaro, M. T. (2024) · Iberian Robotics Conference (ROBOT) · doi:10.1109/robot61475.2024.10796903 · Cited by 4
“The motion model proposed in [27] in which the measurement noises are isolated is used to efficiently integrate raw measurements between LiDAR frames, therefore constraining their relative pose, velocity and bias variation.”
MethodYang, P., Wen, W., Bai, S., & Hsu, L. (2025) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2025.3589556 · Cited by 8
EIP-VIO: Edge-Induced Points Based Monocular Visual-Inertial Odometry
Hao, L., Li, H., Cheng, J. T., & Zhang, Q. (2019) · International Conference on Ubiquitous Computing and Communications (IUCC) · doi:10.1109/iucc/dsci/smartcns.2019.00095 · Cited by 4
“(1) above to calculate the preintegration, given a bias update b ← b̄ + δb, the state increment of the pre-integration can be updated directly by following equation [20]:”
BackgroundMethodInfluentialA Stereo-Based Visual-Inertial Odometry for SLAM
Li, Y., & Lang, S. (2019) · Chinese Automation Congress · doi:10.1109/cac48633.2019.8997432 · Cited by 4
“[12] Forster C, Carlone L, Dellaert F, et al.”
BackgroundZhang, X., Liu, Q., Zheng, B., Wang, H., & Wang, Q. (2020) · International Journal of Advanced Robotic Systems · doi:10.1177/1729881420977669 · Cited by 4
“Due to the decrease of the matching rate of feature points, the tracking thread often has a large drift or even causes failures on the loop detection and the back-end optimization process, which may finally result in instability or even collapse of the whole V-SLAM system.(11) Aiming at the above problems, this articl…”
MethodAdaptive Multi-Sensor Information Fusion For Autonomous Urban Air Mobility Operations
Stepanyan, V., Lombaerts, T., Shish, K. H., & Cramer, N. (2021) · AIAA SciTech Forum · doi:10.2514/6.2021-1115 · Cited by 4
Smooth Mesh Estimation from Depth Data using Non-Smooth Convex Optimization
Rosinol, A., & Carlone, L. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636222 · Cited by 6
Self-citationA Real-Time Visual-Inertial Monocular Odometry by Fusing Point and Line Features
Li, C., Yan, L., & Xia, Y. (2021) · Chinese Control Conference (CCC) · doi:10.23919/ccc52363.2021.9550555 · Cited by 4
“IMU measurement between two frames is obtained by pre-integration [7].”
BackgroundSelfTune: Metrically Scaled Monocular Depth Estimation through Self-Supervised Learning
Choi, J., Jung, D., Lee, Y., Kim, D.-H., Manocha, D., & Lee, D. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9811639 · Cited by 8
FastFusion: Real-Time Indoor Scene Reconstruction with Fast Sensor Motion
Zhu, Z., Xu, Z., Chen, R., Wang, T., Wang, C., Yan, C. C., & Xu, F. (2022) · Remote Sensing · doi:10.3390/rs14153551 · Cited by 5
LVI-ExC: A Target-free LiDAR-Visual-Inertial Extrinsic Calibration Framework
Wang, Z., Zhang, L., Shen, Y., & Zhou, Y. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3547878 · Cited by 6
“Since both the LiDAR-IMU and camera-IMUinitializationshavecloseconnectionswithIMUpre-integration, webrieflyintroduceithereinadvance.”
Zhao, H., Ji, X., Wei, D., & Zhang, J. (2022) · International Conference on Indoor Positioning and Indoor Navigation · doi:10.1109/ipin54987.2022.9918125 · Cited by 5
“We follow the [28] and [29] to conduct the IMU pre-integration residual jacobian and that corresponding to newly constructed residual is presented in the appendix.”
MethodMid360-based Lidar and IMU Tightly-coupled Odometry and Mapping
Zeng, S., Zhang, Z., Zhang, L., Liu, H., Du, Z., & Liu, M. (2022) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio55434.2022.10011701 · Cited by 4
“which is tightly coupled with IMU pre-integration factor [13] [14] on the basis of LOAM.”
BackgroundAdaptive Robust Invariant Extended Kalman filtering for Biped Robot
Gao, C., Xie, Y. H., Zhu, S., Huang, G., Kong, L., Xie, A., Gu, J. J., Zhang, D., Shao, J., & Qian, H. (2022) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio55434.2022.10011668 · Cited by 4
“Some research institutions directly use camera and radar data to build environmental maps [3], [4], [5], or used motion capture system to obtain the state of robot [6], [7], however, this method has strong limitations, because external sensing sensors are prone to link interference and unreliable, for example, the mea…”
BackgroundImplementation of a New-Optimized ROS-Based SLAM for Mobile Robot
Khnissi, K., Jabeur, C. B., & Seddik, H. (2022) · IEEE Information Technologies & Smart Industrial Systems (ITSIS) · doi:10.1109/itsis56166.2022.10118394 · Cited by 4
Yanık, Ö. F., & Ilgın, H. A. (2023) · Communications Faculty of Sciences University of Ankara Series A2-A3 Physical Sciences and Engineering · doi:10.33769/aupse.1195379 · Cited by 4
Dynamic Environments and Robust SLAM: Optimizing Sensor Fusion and Semantics for Wheeled Robots
Mahmoud, J., & Penkovskiy, A. (2023) · Conference of Open Innovations Association (FRUCT) · doi:10.23919/fruct58615.2023.10143050 · Cited by 4
“2) The odometric edge: Inspired by the work on preinte-grated IMU on SE(3) by [25], se2lam have formulated the preintegration of encoder’s measurements on SE(2).”
MethodL-C*: Visual-inertial Loose Coupling for Resilient and Lightweight Direct Visual Localization
Oishi, S., Koide, K., Yokozuka, M., & Banno, A. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10161443 · Cited by 4
“Notably, IMU preintegration [18] can be used as an alternative to odometry, which constrains the relative motion using only IMU data.”
MethodXu, J., Li, R., Huang, S. B., Zhao, X., Qiu, S., Chen, Z., & Zhao, L. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3320753 · Cited by 4
“The IMU preintegration method, as introduced by Forster et al. [24], is employed to transform measurements taken between two time stamps i and j ( i < j ) into a single generalized observation, ultimately generating a constraint between the corresponding states where Exp ( − φ i ) = Exp ( φ i ) 1 .”
MethodEnhancing LiDAR Performance: Robust De-Skewing Exclusively Relying on Range Measurements
Salem, O., Giacomini, E., Brizi, L., Giammarino, L. D., & Grisetti, G. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-47546-7_21 · Cited by 4
“Shan et al. [8] includes the states of IMU in the factor-graph, updating IMU biases through the optimization process, adapting a well-known computer vision work [3] to the LiDAR case.”
Magnetic Navigation Using Attitude-Invariant Magnetic Field Information for Loop Closure Detection
Pavlasek, N., Cossette, C. C., Roy-Guay, D., & Forbes, J. R. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10342466 · Cited by 9
“IMU preintegration is used to assimilate the rate gyro and magnetometer frequencies [23].”
MethodConfidence analysis of feature points for visual‐inertial odometry of urban vehicles
Lee, C., & Yoon, K. (2019) · IET Intelligent Transport Systems · doi:10.1049/iet-its.2018.5196 · Cited by 4
Online Self-Calibration Initialization for Multi-Camera Visual-Inertial SLAM
Liu, Y., Wang, F., Zhang, W., Zhang, C., & Xia, Y. (2018) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio.2018.8665294 · Cited by 4
Visual-Inertial Teach & Repeat for Aerial Robot Navigation
Nitsche, M., Pessacg, F., & Civera, J. (2019) · European Conference on Mobile Robots · doi:10.1109/ecmr.2019.8870926 · Cited by 6
“Inertial Residuals: We use the preintegrated residuals of [15], adapted to estimate relative motions.”
BackgroundMethodA Bi-Invariant Statistical Model Parametrized by Mean and Covariance on Rigid Motions
Chevallier, E., & Guigui, N. (2020) · Entropy · doi:10.3390/e22040432 · Cited by 4
“To do so, we construct wrapped densities on SE(n) similar to the densities defined in [11, 5, 6, 7, 9, 10, 8] on Riemannian manifolds.”
MethodHaptic Sequential Monte Carlo Localization for Quadrupedal Locomotion in Vision-Denied Scenarios
Buchanan, R., Camurri, M., & Fallon, M. F. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341128 · Cited by 5
“1uncertainties for the rotation manifold are maintained in the Lie tangent space, as in [15] Since p (xk|z0:k) is normally unknown, the state xk is typically sampled from p ( xk|xk−1 ) , yielding:”
BackgroundDual Quaternion Sample Reduction for SE(2) Estimation
Li, K., Pfaff, F., & Hanebeck, U. D. (2020) · International Conference on Information Fusion (FUSION) · doi:10.23919/fusion45008.2020.9190388 · Cited by 5
“Due to the underlying nonlinear group structure, stochastic modeling of uncertain SE(2) states is usually done in a locally linearized space using Gaussian distributions [6].”
BackgroundA fast initialization method of Visual-Inertial Odometry based on monocular camera
Huang, L., Pan, S., Wang, S., Zeng, P., & Ye, F. (2018) · Ubiquitous Positioning, Indoor Navigation, and Location Based Service · doi:10.1109/upinlbs.2018.8559929 · Cited by 4
“We use IMU preintegration described in [13]:”
BackgroundOptimization for RGB-D SLAM Based on Plane Geometrical Constraint
Huang, N., Chen, J., & Miao, Y. (2019) · IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) · doi:10.1109/ismar-adjunct.2019.00-19 · Cited by 4
Online Self-calibration of Camera-IMU External Parameters and IMU Initialization for Stereo VI-SLAM
Peng, J., Zhong, X., Peng, X., & Li, Y. (2020) · Chinese Control Conference (CCC) · doi:10.23919/ccc50068.2020.9189226 · Cited by 4
An Observer Design for Visual Simultaneous Localisation and Mapping with Output Equivariance
van Goor, P., Mahony, R. E., Hamel, T., & Trumpf, J. (2020) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2020.12.2438 · Cited by 4
Adaptive Continuous Visual Odometry from RGB-D ImagesPreprint
Lin, T.-Y., Clark, W., Eustice, R. M., Grizzle, J. W., Bloch, A. M., & Ghaffari, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.00713 · Cited by 4
A Unified Method for Solving Inverse, Forward, and Hybrid Manipulator Dynamics using Factor GraphsPreprint
Xie, M., & Dellaert, F. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.10065 · Cited by 7
“Factor graphs have been successfully applied in other areas of robotics, such as SLAM [35, 34, 15, 22], state estimation in hu-manoids [31], and (kinematic) motion planning [16, 47, 44].”
MethodSelf-citationHuang, W., Liu, H., & Wan, W. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.05534 · Cited by 7
“The details of the Jacobians can be found in [36].”
Preintegrated IMU Features For Efficient Deep Inertial Odometry.Preprint
Khorrambakht, R., Damirchi, H., & Taghirad, H. D. (2020) · arXiv (Cornell University) · Cited by 4
Metadata
- Authors
- Forster, C., Carlone, L., Dellaert, F., & Scaramuzza, D.
- Affiliations
- Massachusetts Institute of Technology (US)
- Georgia Institute of Technology (US)
- University of Zurich (CH)
- Venue
- IEEE Transactions on Robotics
- Published
- 2017-02
- Volume
- 33
- Issue
- 1
- Pages
- 1-21
- ISSN
- 1552-3098 (ISSN-L)
- 1941-0468
- OpenAlex
- W2482726005
- Cited by
- 1,502
- References
- 83
- Citations by year
- 2026: 156 · 2025: 179 · 2024: 234 · 2023: 193 · 2022: 180 · 2021: 174 · 2020: 134 · 2019: 129 · 2018: 88 · 2017: 32
- FWCI
- 102.35
- Type
- journal article
- Language
- en
- Open access
- green
- www.zora.uzh.ch
- Licence
- Locations
- IEEE Transactions on Robotics (publishedVersion)
- Zurich Open Repository and Archive (University of Zurich) (acceptedVersion, other-oa)
- arXiv (Cornell University) (submittedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion, cc-by-nc-nd)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion, other-oa)
- arXiv (Cornell University)
- Zurich Open Repository and Archive (University of Zurich)
- Funders
- Swiss National Foundation (200021-143607)
- National Center of Competence in Research Robotics (NCCR)
- University of Zurich
- National Science Foundation (11115678)
- United States Department of Agriculture (USDA)
- National Institute of Food and Agriculture (GEOW-2014-09160)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
- Physical Sciences › Engineering › Aerospace Engineering › Inertial Sensor and Navigation
- Physical Sciences › Computer Science › Artificial Intelligence › Target Tracking and Data Fusion in Sensor Networks
- Keywords
- visual-inertial odometry, inertial measurement unit, factor graphs, maximum a posteriori estimation, bias correction, real-time state estimation, keyframe selection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.