On-Manifold Preintegration for Real-Time Visual--Inertial Odometry
Open accessThe DOI matches its Crossref record; 83 of the 83 references it cites were found in a registry or an index.
Abstract
Current approaches for visual-inertial odometry (VIO) are able to attain highly accurate state estimation via nonlinear optimization. However, real-time optimization quickly becomes infeasible as the trajectory grows over time; this problem is further emphasized by the fact that inertial measurements come at high rate, hence, leading to the fast growth of the number of variables in the optimization. In this paper, we address this issue by preintegrating inertial measurements between selected keyframes into single relative motion constraints. Our first contribution is a preintegration theory that properly addresses the manifold structure of the rotation group. We formally discuss the generative measurement model as well as the nature of the rotation noise and derive the expression for the maximum a posteriori state estimator. Our theoretical development enables the computation of all necessary Jacobians for the optimization and a posteriori bias correction in analytic form. The second contribution is to show that the preintegrated inertial measurement unit model can be seamlessly integrated into a visual-inertial pipeline under the unifying framework of factor graphs. This enables the application of incremental-smoothing algorithms and the use of a structureless model for visual measurements, which avoids optimizing over the 3-D points, further accelerating the computation. We perform an extensive evaluation of our monocular VIO pipeline on real and simulated datasets. The results confirm that our modeling effort leads to an accurate state estimation in real time, outperforming state-of-the-art approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multiple View Geometry in Computer Vision
Hartley, R., & Zisserman, A. (2004) · doi:10.1017/cbo9780511811685 · Cited by 21,070
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897 · cited 2×
“We use the relative error metrics proposed in [68] to obtain error statistics.”
MethodEstimation with Applications to Tracking and Navigation: Theory, Algorithms and Software
Bar‐Shalom, Y., Li, X. ‐., & Kirubarajan, T. (2002) · doi:10.1002/0471221279 · Cited by 6,782
A Mathematical Introduction to Robotic Manipulation
Murray, R. M., Li, Z., & Sastry, S. S. (2017) · CRC Press eBooks · doi:10.1201/9781315136370 · Cited by 6,694 · cited 1×
“For this purpose, we introduce the following kinematic model [49], [53]:”
MethodFactor graphs and the sum-product algorithm
Kschischang, F. R., Frey, B. J., & Loeliger, H.-A. (2001) · IEEE Transactions on Information Theory · doi:10.1109/18.910572 · Cited by 6,486 · cited 1×
“This naturally leads to the well known factor graph representation, a class of bipartite graphical models that can be used to represent such factored densities [51], [52].”
BackgroundParallel Tracking and Mapping for Small AR Workspaces
Klein, G., & Murray, D. (2007) · 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2007.4538852 · Cited by 4,346 · cited 1×
“A breakthrough has been the development of incremental smoothing techniques (iSAM [36], iSAM2 [3]), which leverage the expressiveness of factor graphs to maintain sparsity and to identify and update only the typically small subset of variables affected by a new measurement.”
MethodMonoSLAM: Real-time single camera SLAM
Davison, A. J., Reid, I. D., Molton, N. D., & Stasse, O. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1049 · Cited by 3,959 · cited 1×
“The complexity of the EKF grows quadratically in the number of estimated landmarks, therefore, a small number of landmarks (in the order of 20) are typically tracked to allow real-time operation [10–12].”
BackgroundMatrix Analysis and Applied Linear Algebra
Meyer, C. (2000) · doi:10.1137/1.9780898719512 · Cited by 3,565 · cited 1×
“Any basis El ∈ R2nl×2nl−3 of the null space of El satisfies the following relation [71]:”
BackgroundMatrix analysis and applied linear algebra
(2001) · Choice Reviews Online · doi:10.5860/choice.38-5065 · Cited by 3,300
Stochastic models, estimation, and control
(1982) · Mathematics in Science and Engineering · doi:10.1016/s0076-5392(08)x6186-7 · Cited by 3,229
Cited by
Items 301–400 of 1,000
Ouyang, M., Cao, Z., Guan, P., Li, Z., Zhou, C., & Yu, J. (2021) · IEEE Sensors Letters · doi:10.1109/lsens.2021.3057088 · Cited by 26
“By adopting the method in [10], these gyroscope measurements are integrated to get the relative rotation transformation Rk1k2 from k1 to k2, as well as preintegration measurement covariance Gk1k2 .”
BackgroundMethodInfluentialGround Encoding: Learned Factor Graph-based Models for Localizing Ground Penetrating Radar
Baikovitz, A., Sodhi, P., Dille, M. N., & Kaess, M. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636764 · Cited by 36
“IMU preintegrated factor: For incorporating IMU measurements in the graph, we use the IMU preintegration factor proposed in [29].”
BackgroundMethodGR-Fusion: Multi-sensor Fusion SLAM for Ground Robots with High Robustness and Low Drift
Wang, T., Su, Y., Shao, S., Yao, C., & Wang, Z. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636232 · Cited by 37
Improved state estimation of a robot end-effector using laser tracker and inertial sensor fusion
Cvitanic, T., Melkote, S. N., & Balakirsky, S. B. (2022) · CIRP journal of manufacturing science and technology · doi:10.1016/j.cirpj.2022.03.011 · Cited by 26
Kim, D., Shin, S., & Kweon, I. S. (2017) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2017.2773515 · Cited by 29
Lv, X., He, Z., Yang, Y., Nie, J., Dong, Z., Wang, S., & Gao, M. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3451996 · Cited by 31
“To solve the above reintegration issue, Forster et al. put forward a method called pre-integration [23].”
Contact Forces Preintegration for Estimation in Legged Robotics using Factor Graphs
Fourmy, M., Flayols, T., Léziart, P., Mansard, N., & Solà, J. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561037 · Cited by 25
“It was initially developed to deal with IMU measurements [12], [13].”
BackgroundInfluentialBai, X., Wen, W., & Hsu, L. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3126010 · Cited by 28
“Therefore, the IMU preintegration technique [31] is employed to integrate the several measurements into a single factor between two consecutive frames of b k and b k + 1 .”
MethodReduction of GNSS-Denied inertial navigation errors for fixed wing autonomous unmanned air vehicles
Gallo, E., & Barrientos, A. (2021) · Aerospace Science and Technology · doi:10.1016/j.ast.2021.107237 · Cited by 34
Zhang, J., Wen, W., Huang, F., Wang, Y., Chen, X., & Hsu, L. (2022) · Applied Sciences · doi:10.3390/app12105193 · Cited by 32
“As receiving the 3D point clouds and the IMU ego-motion measurements, the LiDAR factor and IMU factor are constructed via scan-matching [43] and IMU pre-integration [44] respectively, and then jointly optimized in the sliding window based local FGO.”
MethodRobust Depth-Aided RGBD-Inertial Odometry for Indoor Localization
Zhao, X., Li, Q., Wang, C., Dou, H., & Liu, B. (2023) · Measurement · doi:10.1016/j.measurement.2023.112487 · Cited by 26
Adaptive Keyframe Generation based LiDAR Inertial Odometry for Complex Underground Environments
Kim, B., Jung, C., Shim, D. H., & Agha–mohammadi, A. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10161207 · Cited by 33
“In addition, many LiDAR Inertial Odometry (LIO) methods tightly coupled with an IMU have been proposed by using the IMU pre-integration method [9].”
BackgroundMethodInfluentialGNSS‐stereo‐inertial SLAM for arable farming
Cremona, J., Civera, J., Kofman, E., & Pire, T. (2023) · Journal of Field Robotics · doi:10.1002/rob.22232 · Cited by 33
“(2017) use a mixture of tightly-coupled and loosely-coupled techniques for the fusion of visual and GPS measurements.”
Invariant Smoother for Legged Robot State Estimation With Dynamic Contact Event Information
Yoon, Z., Kim, J.-H., & Park, H.-W. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2023.3328202 · Cited by 44
Monocular Visual-Inertial SLAM: Continuous Preintegration and Reliable Initialization
Liu, Y., Chen, Z., Zheng, W., Wang, H., & Liu, J. (2017) · Sensors · doi:10.3390/s17112613 · Cited by 26
“In this paper, we present a visual-inertial navigation system (VINS) that combines the visual SLAM approach and IMU preintegration technique [33,38] beyond the framework of ORB-SLAM [23] and PTAM [7].”
BackgroundMethodInfluentialGuaranteed Performance Nonlinear Observer for Simultaneous Localization and Mapping
Hashim, H. A. (2020) · IEEE Control Systems Letters · doi:10.1109/lcsys.2020.3000266 · Cited by 26
“As a result, manifolds and the inheritance of the Lie group of SE(3) in the SLAM problem was studied [12], [13].”
BackgroundUnit dual quaternion‐based pose optimisation for visual runway observations
Brambley, G., & Kim, J. (2020) · IET Cyber-Systems and Robotics · doi:10.1049/iet-csr.2020.0029 · Cited by 26
Li, M., Guo, C. G., & Yu, H. (2021) · International Journal of Advanced Robotic Systems · doi:10.1177/17298814211011035 · Cited by 27
LiDAR-Visual-Inertial Odometry Based on Optimized Visual Point-Line Features
He, X., Gao, W., Sheng, C., Zhang, Z., Pan, S., Duan, L., Zhang, H., & Lu, X. (2022) · Remote Sensing · doi:10.3390/rs14030622 · Cited by 24
“The theoretical basis of the direct method-based VIO is the assumption of constant grayscale [7,8].”
MethodSong, J., Li, W., & Zhu, X. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3334979 · Cited by 27
Multi-robot Relative Pose Estimation and IMU Preintegration Using Passive UWB Transceivers
Shalaby, M., Cossette, C. C., Ny, J. L., & Forbes, J. R. (2024) · IEEE Transactions on Robotics · doi:10.1109/tro.2024.3370027 · Cited by 24
“In [27], [28], scattering theory is used to send precomputed matrices between two robots rather than individual IMU measurements, in a manner similar to the concept of preintegration [1], [29].”
MethodVision-Based Tracking Control of Quadrotor With Backstepping Sliding Mode Control
Zhao, B., Tang, Y. S., Wu, C., & Du, W. (2018) · IEEE Access · doi:10.1109/access.2018.2882241 · Cited by 24
“Although [19] illustrates the application on multi-camera system, here we only consider one camera mounted on the quadrotor.”
BackgroundMethodRahman, S., Li, A. Q., & Rekleitis, I. M. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8967697 · Cited by 32
“The IMU error term es combines all accelerometer and gyroscope measurements by IMU preintegration [34] between successive camera measurements”
MethodGaussian Process Preintegration for Inertial-Aided State Estimation
Gentil, C. L., Vidal‐Calleja, T., & Huang, S. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2970940 · Cited by 34
“The high performance of this algorithm has been made possible with the extension of the preintegration theory to rotation manifold [14], [15], instead of the Euler angles representation used in [1].”
BackgroundMethodWang, Z., Yang, K., Shi, H., Li, P., Gao, F., Bai, J. Y., & Wang, K. (2023) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2023.3324495 · Cited by 32
“(13): where r B ˆ z b k b k + 1 , χ and r C (cid:0) ˆ z j l , χ (cid:1) are the IMU measurement residual [53] and the camera measurement residual, respectively. r p and H p represent prior information.”
BackgroundAlamdari, A. G., Zade, F. A., & Ebrahimkhanlou, A. (2025) · Sensors · doi:10.3390/s25030712 · Cited by 37
RaI-SLAM: Radar-Inertial SLAM for Autonomous Vehicles
Herraez, D. C., Zeller, M., Wang, D., Behley, J., Heidingsfeld, M., & Stachniss, C. (2025) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2025.3557296 · Cited by 23
“Several approaches leverage inertial measurement units (IMUs) [11] as they are economic high-frequency sensors accurate in short periods of time [13], but considered alone, they drift substantially.”
InfluentialST-VIO: Visual Inertial Odometry Combined with Image Segmentation and Tracking
Zhang, C., Chen, L., & Yuan, S. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.2989877 · Cited by 28
“We follow our previous continuous-time quaternion-based derivation of IMU preintegration [19] and include the handling of IMU biases as [20] and [21].”
MethodRobots’ State Estimation and Observability Analysis Based on Statistical Motion Models
Xu, W. D., He, D., Cai, Y., & Zhang, F. (2022) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2021.3133080 · Cited by 25
“In existing methods for robotic states’ estimation, such as GPS/IMU navigation [20], visual IMU navigation and online calibration [14], [22], and LiDAR/IMU navigation [23], the acceleration and angular velocity are solved from the IMU measurements and are then substituted into kinematics model to form a system “driven…”
BackgroundMethodTightly-Coupled Multi-Sensor Fusion for Localization with LiDAR Feature Maps
Pan, L., Ji, K., & Zhao, J. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561547 · Cited by 24
“Moreover, the pre-integration method [24] is used to obtain the pre-integrated variables ∆ p , ∆ v , and ∆ q , which represent increments of displacement, velocity, and rotation, respectively.”
BackgroundMethodVisual-Inertial SLAM with Tightly-Coupled Dropout-Tolerant GPS Fusion
Boche, S., Zuo, X., Schaefer, S., & Leutenegger, S. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981134 · Cited by 33
“Further note that the covariance of x̂ can be also computed conditioned on the given x and the IMU pre-integtration covariance Σx [16] via linear error propagation.”
BackgroundMethodInfluentialZhang, Z., Song, Y., Huang, S., Xiong, R., & Wang, Y. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2023.3272847 · Cited by 29
“To reduce the optimization variables, preintegration [18] is proposed as a factor between the two keyframes.”
Advances in sensing and processing methods for three-dimensional robot vision
He, Y. H., & Chen, S. (2018) · International Journal of Advanced Robotic Systems · doi:10.1177/1729881418760623 · Cited by 23
Stereo Visual-Inertial SLAM With Points and Lines
Liu, Y., Yang, D., Li, J., Gu, Y., Pi, J., & Zhang, X. (2018) · IEEE Access · doi:10.1109/access.2018.2880689 · Cited by 24
“The IMU-related Jacobians Jb are described in [8].”
BackgroundMethodInfluentialBuchanan, R., Bednarek, J., Camurri, M., Nowicki, M., Walas, K., & Fallon, M. F. (2021) · Autonomous Robots · doi:10.1007/s10514-021-10013-w · Cited by 25
Faitli, T., Hyyppä, E., Hyyti, H., Hakala, T., Kaartinen, H., Kukko, A., Muhojoki, J., & Hyyppa, J. M. (2024) · Remote Sensing · doi:10.3390/rs16173292 · Cited by 31
“In order to remove the motion distortion, we first estimate the trajectory during the scan by integrating the available IMU measurements as described in [45].”
PLE-SLAM: A Visual-Inertial SLAM Based on Point-Line Features and Efficient IMU Initialization
He, J., Li, M., Wang, Y., & Wang, H. (2025) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3523039 · Cited by 30
“Therefore, we follow the approach in [36] and give a formula that directly calculates the preintegration when the bias changes : where δ b = [ δ b g δ b a ] T is the change of IMU bias.”
Online Temporal Calibration Based on Modified Projection Model for Visual-Inertial Odometry
Liu, Y., & Meng, Z. (2019) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2019.2951863 · Cited by 26
Jo, H., & Kim, E. (2020) · IEEE Access · doi:10.1109/access.2020.2988464 · Cited by 22
“First, j -th particle at time t is sampled from the motion model as where u t ∈ SE ( 3 ) denotes the pose difference obtained using wheel odometry and δ ∈ R 6 [39].”
BackgroundMethodHuang, W., Wan, W., & Liu, H. (2021) · Sensors · doi:10.3390/s21082673 · Cited by 25
“[54] using a manifold in SO(3) to avoid singularity.”
MethodA Novel Feature Points Tracking Algorithm in Terms of IMU-Aided Information Fusion
Guan, Q., Wei, G., Wang, L., & Song, Y. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.3024079 · Cited by 23
“stages of the predictor are based on preintegration theory, this article is quite different from the original work of preintegration [23].”
BackgroundSung, C., Jeon, S., Lim, H., & Myung, H. (2021) · Intelligent Service Robotics · doi:10.1007/s11370-021-00395-2 · Cited by 24
“Deskewing First, the IMU pre-integration method [32], which generates the IMU factor, is used to deskew point Fig.”
MethodHe, X., Pan, S., Gao, W., & Lu, X. (2022) · Remote Sensing · doi:10.3390/rs14092104 · Cited by 26
“Pan, Y.; Xiao, P.; He, Y.; Shao, Z.; Li, Z. MULLS: Versatile LiDAR SLAM via Multi-metric Linear Least Square.”
BackgroundMethodInfluentialHierarchical Estimation-Based LiDAR Odometry With Scan-to-Map Matching and Fixed-Lag Smoothing
Liang, S., Cao, Z., Wang, C., & Yu, J. (2022) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2022.3173665 · Cited by 24
“where Exp(·) : R(3) → SO3 is capitalized exponential map [15].”
BackgroundInfluentialZhang, L., Wen, W., Hsu, L., & Zhang, T. (2023) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2023.3282623 · Cited by 22
REAL-TIME AND POST-PROCESSED GEOREFERENCING FOR HYPERPSPECTRAL DRONE REMOTE SENSING
de Oliveira, R. A., Khoramshahi, E., Suomalainen, J. M., Hakala, T., Viljanen, N., & Honkavaara, E. (2018) · The international archives of the photogrammetry, remote sensing and spatial information sciences/International archives of the photogrammetry, remote sensing and spatial information sciences · doi:10.5194/isprs-archives-xlii-2-789-2018 · Cited by 34
“The accuracy and robustness of the estimations can be improved with information from inertial sensors and GNSS (Forster et al., 2017).”
BackgroundVisual-Inertial Odometry with Robust Initialization and Online Scale Estimation
Hong, E., & Lim, J. (2018) · Sensors · doi:10.3390/s18124287 · Cited by 23
“We directly compared the RMSE results with OKVIS [5], ROVIO [43], VINS-Mono [17], SVO+MSF [44,45] and SVO+GTSAM [46] using [31].”
ResultOptimization-based legged odometry and sensor fusion for legged robot continuous localization
Belter, D., & Nowicki, M. (2018) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2018.10.013 · Cited by 23
Bai, X., Wen, W., & Hsu, L. (2020) · Remote Sensing · doi:10.3390/rs12101686 · Cited by 24
Probabilistic Spatial Distribution Prior Based Attentional Keypoints Matching Network
Zhao, X., Liu, J., Wu, X., Chen, W., Guo, F., & Li, Z. G. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3068761 · Cited by 23
“To obtain an accurate prior motion, IMU measurements have been widely used in recent SLAM systems to constrain the pose optimization problem [31], [32], [60]–[62].”
MethodZhang, C., Chen, M.-S., Wang, G.-Q., Lin, Y. C., Li, K., Wu, M., Li, Z., & Wang, Q. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3431102 · Cited by 23
“…a proportional manner described as follows : 3) IMU and Encoder Pre-Integration: As the sampling frequencies of the IMU (300 Hz) and encoder (100 Hz) are greater than those of the LiDAR (10 Hz), we apply a pre-integration approach to take several measurements between consecutive LiDAR sweeps [27].”
MethodHong, Y., Ma, R., Li, C., Shao, C., Huang, J., Zeng, Y., & Chen, Y. (2024) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2024.109487 · Cited by 23
Probabilistic Degeneracy Detection for Point-to-Plane Error Minimization
Hatleskog, J., & Alexis, K. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3484153 · Cited by 26
“The repeated walls in the maps of [14], [19] stem from degeneracy-induced drift.”
Visual-Inertial-Acoustic Sensor Fusion for Accurate Autonomous Localization of Underwater Vehicles
Huang, Y., Li, P., Ma, S., Yan, S., Tan, M. H., Yu, J., & Wu, Z. (2024) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2024.3488077 · Cited by 22
“We adopt the IMU preintegration described in [34].”
Embodied AI with Foundation Models for Mobile Service Robots: A Systematic Review
Lisondra, M., Benhabib, B., & Nejat, G. (2026) · Robotics · doi:10.3390/robotics15030055 · Cited by 44
“This challenge is critical for mobile service robots, which must translate diverse, user-issued commands into continuous, context-aware actions while adapting to unpredictable spatial layouts, and real-time task demands.”
Improved IMU Preintegration with Gravity Change and Earth Rotation for Optimization-Based GNSS/VINS
Jiang, J., Niu, X., & Liu, J. (2020) · Remote Sensing · doi:10.3390/rs12183048 · Cited by 22
“In [29,30], the attitude is parametrized by the specific rotation group SO (3), in order to avoid the singularity and carefully cope with uncertainty propagation of the preintegrated IMU measurements.”
BackgroundVisual-Inertial RGB-D SLAM With Encoders for a Differential Wheeled Robot
Zhu, Z., Kaizu, Y., Furuhashi, K., & Imou, K. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3101370 · Cited by 21
“Compared to [17], we propose a novel encoder model, which permits error between the real motion and the suggested model.”
InfluentialRobust Multispectral Visual-Inertial Navigation With Visual Odometry Failure Recovery
Beauvisage, A., Ahıska, K., & Aouf, N. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3090675 · Cited by 22
UVIP: Robust UWB aided Visual-Inertial Positioning System for Complex Indoor Environments
Yang, B., Li, J., & Zhang, H. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561208 · Cited by 23
Online Visual-Inertial Extrinsic Calibration Utilizing GNSS Measurements for Vehicle Applications
Zhou, Y., Li, S., Xia, C., Shen, Z., Wang, X., & Li, X. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3144409 · Cited by 22
Information-Theoretic Online Multi-Camera Extrinsic Calibration
Dexheimer, E., Peluse, P., Chen, J., Pritts, J., & Kaess, M. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3145061 · Cited by 28
“Stereo reprojection factors and IMU preintegration factors [29] are added to a fixed-lag smoother inspired by the backend of [30].”
Efficient and adaptive lidar–visual–inertial odometry for agricultural unmanned ground vehicle
Zhao, Z., Zhang, Y., Long, L., Lu, Z., & Shi, J. (2022) · International Journal of Advanced Robotic Systems · doi:10.1177/17298806221094925 · Cited by 22
Zhang, J., Zhu, C., Zheng, L., & Xu, K. (2021) · ACM Transactions on Graphics · doi:10.1145/3476576.3476604 · Cited by 21
Gravity-constrained point cloud registration
Kubelka, V., Vaidis, M., & Pomerleau, F. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981916 · Cited by 21
“[2] improved the IMU preintegration technique, originally proposed by Lupton et al.”
Robust Visual-Inertial Odometry Based on a Kalman Filter and Factor Graph
Wang, Z., Pang, B. J., Song, Y. H., Yuan, X., Xu, Q., & Li, Y. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3258526 · Cited by 24
“See [22] for the detailed definition of the covariance During optimization, the direction and scale factor of gravity are defined in [9, Sec II-B].”
Background3D Vision Aided GNSS Real-Time Kinematic Positioning for Autonomous Systems in Urban Canyons
Wen, W., Bai, X., & Hsu, L. (2023) · NAVIGATION Journal of the Institute of Navigation · doi:10.33012/navi.590 · Cited by 31
“Similar to the findings presented by Qin et al. (2018), the IMU pre-integration technique (Forster et al., 2016 ) was employed to integrate several measurements (inertial measurements between time intervals t t t k (cid:31) [ , ). χ Because the IMU pre-integration employed in this study is…”
A Rotation-Translation-Decoupled Solution for Robust and Efficient Visual-Inertial Initialization
He, Y., Xu, B., Ouyang, Z., & Li, H. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00078 · Cited by 36
Development of vision–based SLAM: from traditional methods to multimodal fusion
Zheng, Z., Su, K., Lin, S., Fu, Z., & Yang, C. (2024) · Robotic Intelligence and Automation · doi:10.1108/ria-10-2023-0142 · Cited by 29
Revisiting Visual-Inertial Structure-From-Motion for Odometry and SLAM Initialization
Evangelidis, G., & Mičušík, B. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3057564 · Cited by 27
“The gyroscope bias bg is inserted into the model in a nonlinear way [9].”
MethodHybrid-VINS: Underwater Tightly Coupled Hybrid Visual Inertial Dense SLAM for AUV
Ou, Y., Fan, J., Zhou, C., Zhang, P., & Hou, Z. (2024) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2024.3440515 · Cited by 20
Research on an orchard row centreline multipoint autonomous navigation method based on LiDAR
Zhenyu, C., Hanjie, D., Gao, Y., Changyuan, Z., Wang, X., & Wei, Z. (2024) · Artificial Intelligence in Agriculture · doi:10.1016/j.aiia.2024.12.003 · Cited by 64
Geometry-driven Deterministic Sampling for Nonlinear Bingham Filtering
Li, K., Frisch, D., Noack, B., & Hanebeck, U. D. (2019) · European Control Conference (ECC) · doi:10.23919/ecc.2019.8796102 · Cited by 21
“As the distribution is inherently defined on S, Bingham-based filtering algorithms no longer require local linearization of the manifold [14].”
MethodLMVI-SLAM: Robust Low-Light Monocular Visual-Inertial Simultaneous Localization and Mapping
Hao, L., Li, H., Zhang, Q., Hu, X., & Cheng, J. T. (2019) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio49542.2019.8961635 · Cited by 25
“The IMU residual model EIMU (i, j) refers to [7].”
BackgroundInfluentialConsistent Right-Invariant Fixed-Lag Smoother with Application to Visual Inertial SLAM
Huai, J., Lin, Y., Zhuang, Y., & Shi, M. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i7.16758 · Cited by 23
Radar-Inertial State Estimation and Obstacle Detection for Micro-Aerial Vehicles in Dense Fog
Kramer, A., & Heckman, C. (2021) · Springer proceedings in advanced robotics · doi:10.1007/978-3-030-71151-1_1 · Cited by 27
LLOL: Low-Latency Odometry for Spinning Lidars
Qu, C., Shivakumar, S. S., Liu, W., & Taylor, C. J. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9811605 · Cited by 29
Photometric Visual-Inertial Navigation With Uncertainty-Aware Ensembles
Jung, J. H., Choe, Y., & Park, C. G. (2022) · IEEE Transactions on Robotics · doi:10.1109/tro.2021.3139964 · Cited by 26
An Enhanced Hybrid Visual–Inertial Odometry System for Indoor Mobile Robot
Liu, Y., Zhao, C., & Ren, M. (2022) · Sensors · doi:10.3390/s22082930 · Cited by 26
“IMU Dynamic Model and Pre-Integration A six-axis IMU can measure acceleration and angular velocity of the body frame with respect to the inertial frame through a 3-axis gyroscope and a 3-axis accelerometer, respectively [17].”
MethodA Global ArUco-Based Lidar Navigation System for UAV Navigation in GNSS-Denied Environments
Qiu, Z., Lin, D., Jin, R., Lv, J., & Zheng, Z. (2022) · Aerospace · doi:10.3390/aerospace9080456 · Cited by 20
Peng, R., Wang, Z., & Lu, P. (2023) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2023.3257166 · Cited by 20
“T WV is a homogeneous matrix that describes the transformation from W to V , and the matrix can be obtained from external devices, such as VICON [35], VIO [36], etc. Similarly, T VB decided by the mechanical design from the CAD drawing, describes the transformation from V to B .”
REAL-TIME LIDAR-INERTIAL POSITIONING AND MAPPING FOR FORESTRY AUTOMATION
Faitli, T., Hakala, T., Kaartinen, H., Hyyppa, J. M., & Kukko, A. (2023) · The international archives of the photogrammetry, remote sensing and spatial information sciences/International archives of the photogrammetry, remote sensing and spatial information sciences · doi:10.5194/isprs-archives-xlviii-1-w1-2023-145-2023 · Cited by 22
“It takes in a lidar factor generated as described in Section 2.2 and a preintegrated IMU factor (Forster et al., 2017).”
InfluentialVision-IMU multi-sensor fusion semantic topological map based on RatSLAM
Liu, X., Wen, S., Pan, Z., Xu, C., Hu, J., & Meng, H. (2023) · Measurement · doi:10.1016/j.measurement.2023.113335 · Cited by 21
Long, B., Goodin, S., Kachergis, G., Marchman, V. A., Radwan, S. F., Sparks, R. Z., Xiang, V., Zhuang, C., Hsu, O., Newman, B., et al. (2023) · Behavior Research Methods · doi:10.3758/s13428-023-02206-1 · Cited by 33
VIEW: Visual-Inertial External Wrench Estimator for Legged Robot
Kang, J., Kim, H., & Kim, K.-S. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3322646 · Cited by 26
“These studies have become more active with the emergence of preintegration theory [23], which tightly fuses high-frequencysensordata.”
BackgroundBucci, A., Ridolfi, A., & Allotta, B. (2024) · Journal of Field Robotics · doi:10.1002/rob.22375 · Cited by 24
“This approach can lead to reduced robustness against outlier data (Forster et al., 2016).”
A Modular Optimization Framework for Localization and Mapping
Blanco, J. (2019) · Robotics: Science and Systems · doi:10.15607/rss.2019.xv.043 · Cited by 24
“The foundations of least-squares minimization, Gauss-Newton or Levenberg-Marquartd algorithms, are well-known and explained elsewhere [36, 27], as they are their extensions, by means of Lie group “retrac-tions”, to non-Euclidean state spaces [17].”
MethodRobust Stereo Visual-Inertial Odometry Using Nonlinear Optimization
Ma, S., Bai, X., Wang, Y., & Fang, R. M. (2019) · Sensors · doi:10.3390/s19173747 · Cited by 22
“[15] suggested a VI-SLAM system based on their original ORB-SLAM, which originated from the pre-integration ideas of Forster [18].”
MethodSnake-SLAM: Efficient Global Visual Inertial SLAM using Decoupled Nonlinear Optimization
Rückert, D., & Stamminger, M. (2021) · International Conference on Unmanned Aircraft Systems (ICUAS) · doi:10.1109/icuas51884.2021.9476760 · Cited by 22
On the Comparison of Gauge Freedom Handling in Optimization-Based Visual-Inertial State Estimation
Zhang, Z., Gallego, G., & Scaramuzza, D. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2833152 · Cited by 27
“, initial values are provided by a front-end, such as [5]).”
BackgroundInfluentialSelf-citationLi, X., Chang, H., Wang, X., Li, S., Zhou, Y., & Yu, H. (2023) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2023.3331587 · Cited by 20
Kühne, J., Magno, M., & Benini, L. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3406948 · Cited by 33
“As a computationally affordable method, preintegration of IMU measurements is often used to reach a prediction rate above 100 Hz [7], [8].”
VINGS-Mono: Visual-Inertial Gaussian Splatting Monocular SLAM in Large Scenes
Wu, K., Zhang, Z., Tie, M., Ai, Z., Gan, Z., & Ding, W. (2025) · IEEE Transactions on Robotics · doi:10.1109/tro.2025.3613536 · Cited by 45
Dense point cloud map construction based on stereo VINS for mobile vehicles
Wen, S., Liu, X., Zhang, H., Sun, F., Sheng, M., & Fan, S. (2021) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2021.06.009 · Cited by 19
Wu, D., Zhong, X., Peng, X., Hu, H., & Liu, Q. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3205687 · Cited by 22
“The IMU pre-integration module integrates inertial data between the previous frame and current frame to obtain pre-integration measurement (i.e., relative position, velocity, and rotation) and their uncertainties accord-426 ing to the algorithm in [39].”
MethodA SLAM Method Based on Multi-Robot Cooperation for Pipeline Environments Underground
Lu, D., Zhang, Y., Gong, Z., & Wu, T. (2022) · Sustainability · doi:10.3390/su142012995 · Cited by 22
Xu, B., Zhang, S., Kuang, K., & Li, X. (2023) · GPS Solutions · doi:10.1007/s10291-023-01396-7 · Cited by 24
“̃ 𝐚 ∧ is the skew symmetric matrix of ̃ 𝐚 (Forster et al. 2017).”
Learning Type-2 Fuzzy Logic for Factor Graph Based-Robust Pose Estimation With Multi-Sensor Fusion
Nam, D. V., & Kim, G.-W. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3234595 · Cited by 20
Real-Time 3D Mapping in Complex Environments Using a Spinning Actuated LiDAR System
Yan, L., Dai, J., Zhao, Y., & Chen, C. (2023) · Remote Sensing · doi:10.3390/rs15040963 · Cited by 20
“More details about the on-manifold IMU pre-integration can be found in [33].”
BackgroundNR5G-SAM: A SLAM Framework for Field Robot Applications Based on 5G New Radio
Karfakis, P. T., Couceiro, M. S., & Portugal, D. (2023) · Sensors · doi:10.3390/s23115354 · Cited by 27
“This includes the position, velocity, and orientation, known as the IMU preintegration (see [81]), described by the following set of equations:”
BackgroundMethodAccurate Initial State Estimation in a Monocular Visual–Inertial SLAM System
Mu, X., Chen, J., Zhou, Z., Leng, Z., & Fan, L. (2018) · Sensors · doi:10.3390/s18020506 · Cited by 20
“To avoid this problem, we use the IMU pre-integration technique that is first proposed in [35] and is further extended to the manifold structure in [26].”
BackgroundMethodInfluential
Metadata
- Authors
- Forster, C., Carlone, L., Dellaert, F., & Scaramuzza, D.
- Affiliations
- Massachusetts Institute of Technology (US)
- Georgia Institute of Technology (US)
- University of Zurich (CH)
- Venue
- IEEE Transactions on Robotics
- Published
- 2017-02
- Volume
- 33
- Issue
- 1
- Pages
- 1-21
- ISSN
- 1552-3098 (ISSN-L)
- 1941-0468
- OpenAlex
- W2482726005
- Cited by
- 1,502
- References
- 83
- Citations by year
- 2026: 156 · 2025: 179 · 2024: 234 · 2023: 193 · 2022: 180 · 2021: 174 · 2020: 134 · 2019: 129 · 2018: 88 · 2017: 32
- FWCI
- 102.35
- Type
- journal article
- Language
- en
- Open access
- green
- www.zora.uzh.ch
- Licence
- Locations
- IEEE Transactions on Robotics (publishedVersion)
- Zurich Open Repository and Archive (University of Zurich) (acceptedVersion, other-oa)
- arXiv (Cornell University) (submittedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion, cc-by-nc-nd)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion, other-oa)
- arXiv (Cornell University)
- Zurich Open Repository and Archive (University of Zurich)
- Funders
- Swiss National Foundation (200021-143607)
- National Center of Competence in Research Robotics (NCCR)
- University of Zurich
- National Science Foundation (11115678)
- United States Department of Agriculture (USDA)
- National Institute of Food and Agriculture (GEOW-2014-09160)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
- Physical Sciences › Engineering › Aerospace Engineering › Inertial Sensor and Navigation
- Physical Sciences › Computer Science › Artificial Intelligence › Target Tracking and Data Fusion in Sensor Networks
- Keywords
- visual-inertial odometry, inertial measurement unit, factor graphs, maximum a posteriori estimation, bias correction, real-time state estimation, keyframe selection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.