The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Iterated extended Kalman filter based visual-inertial odometry using direct photometric feedback
Open accessAbstract
This paper presents a visual-inertial odometry framework that tightly fuses inertial measurements with visual data from one or more cameras, by means of an iterated extended Kalman filter. By employing image patches as landmark descriptors, a photometric error is derived, which is directly integrated as an innovation term in the filter update step. Consequently, the data association is an inherent part of the estimation process and no additional feature extraction or matching processes are required. Furthermore, it enables the tracking of noncorner-shaped features, such as lines, and thereby increases the set of possible landmarks. The filter state is formulated in a fully robocentric fashion, which reduces errors related to nonlinearities. This also includes partitioning of a landmark’s location estimate into a bearing vector and distance and thereby allows an undelayed initialization of landmarks. Overall, this results in a compact approach, which exhibits a high level of robustness with respect to low scene texture and motion blur. Furthermore, there is no time-consuming initialization procedure and pose estimates are available starting at the second image frame. We test the filter on different real datasets and compare it with other state-of-the-art visual-inertial frameworks. Experimental results show that robust localization with high accuracy can be achieved with this filter-based framework.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“While numerous datasets aimed at vision-aided odometry exist [39], [40], [41], [42], [43], [44], few heterogeneous datasets of sizes suitable for deep learning applications on RGB-D data are available.”
From Unsupervised Deep Visual-Inertial Odometry with Online Error Correction for RGB-D Imagery (2020) · cites this paper as [40]
Citations
Cites
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897
(1981) · Cited by 11,963
Shi, J., & Tomasi (1994) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition CVPR-94 · doi:10.1109/cvpr.1994.323794 · Cited by 7,724 · cited 4×
“If we minimize the squared error terms for a multilevel patch, we obtain a patch alignment algorithm which is very similar to the well-known Kanade-Lucas-Tomasi (KLT) feature tracker (Lucas and Kanade (1981); Shi and Tomasi (1994)).”
MethodInfluentialProceedings of the 19th International Joint Conference on Artificial Intelligence
Pujol, J. M., Delgado, J., Ramon Sangüesa, A., & Flache, A. (2005) · International Joint Conference on Artificial Intelligence · Cited by 5,771
Machine Learning for High-Speed Corner Detection
Rosten, E., & Drummond, T. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_34 · Cited by 4,555
LSD-SLAM: Large-scale direct monocular SLAM
Engel, J., Schöps, T., & Cremers, D. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10605-2_54 · Cited by 3,851
SVO: Fast semi-direct monocular visual odometry
Forster, C., Pizzoli, M., & Scaramuzza, D. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6906584 · Cited by 2,205
The EuRoC micro aerial vehicle datasets
Burri, M., Nikolic, J., Gohl, P., Schneider, T., Rehder, J., Omari, S., Achtelik, M., & Siegwart, R. (2016) · The International Journal of Robotics Research · doi:10.1177/0278364915620033 · Cited by 2,086
Self-citationA Multi-State Constraint Kalman Filter for Vision-aided Inertial Navigation
Mourikis, A. I., & Roumeliotis, S. I. (2007) · Proceedings 2007 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2007.364024 · Cited by 1,951
2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition
(2001) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2001.990916 · Cited by 1,884
Research works printed but not linked: 1
- Bloesch M, 2016, arXiv
Cited by
Sorted by citations
Items 401–477 of 477
Tabrizi, H. B., & Crick, C. (2023) · International Conference on Computational Science and Computational Intelligence (CSCI) · doi:10.1109/csci62032.2023.00235 · Cited by 1
PCVPC: Perception Constrained Visual Predictive Control For Agile QuadrotorsPreprint
Qin, C., & Liu, H. H. T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.11063 · Cited by 1
The Kalman Filter: Unveiling Precision in Dynamic System TrackingPreprint
Salman, M. (2023) · doi:10.31219/osf.io/p9es6 · Cited by 1
SLAM for Direct optimization based Visual-Inertial Fusion
Schwaab, M., Brohammer, E., & Manoli, Y. (2018) · DGON Inertial Sensors and Systems (ISS) · doi:10.1109/inertialsensors.2018.8577196
Szklarski, J., Ziemiecki, C., Szałtys, J., & Ostrowski, M. (2019) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-13273-6_37
Electromagnetic Near-Field based Pose Estimation for Autonomous Systems
Gietler, H., Ammari, H. M., & Zangl, H. (2019) · SAM Research Report
Localization Correction Using Road Signs
Przewodowski, A., & Osório, F. S. (2019) · Latin American Robotics Symposium, Brazilian Symposium on Robotics and Workshop on Robotics in Education (LARS/SBR/WRE) · doi:10.1109/lars-sbr-wre48964.2019.00022
Ruiz, D. V., Vidal, L. A., & Todt, E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.11656
A Visual-Inertial Vehicle Navigation System Based Line Feature
Guang, X., Gao, Y., Liu, P., Li, G., Li, N., & Leung, H. (2020) · International Conference on Artificial Intelligence and Electromechanical Automation (AIEA) · doi:10.1109/aiea51086.2020.00015
Akgün, O., Atik, K. C., Erdem, M., Kaymaz, M., Yamak, B., & Üre, N. K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.06410
A Monocular Visual-Inertial Odometry Based on Hybrid Residuals
Lai, Z., Gui, J.-J., Xu, D., Dong, H., & Deng, B.-S. (2020) · IEEE International Conference on Systems, Man and Cybernetics · doi:10.1109/smc42975.2020.9283418
Multi-Modal Neural Feature Fusion for Pose Estimation and Scene Perception of Intelligent Vehicle
Zhou, A., Li, Z., Pu, J., Yu, J., Wei, R., & Dong, Z. (2021) · SAE technical papers on CD-ROM/SAE technical paper series · doi:10.4271/2021-01-0188
Toward Consistent Drift-free Visual Inertial Localization on Keyframe Based MapPreprint
Zhang, Z., Jiao, Y., Huang, S., Wang, Y., & Xiong, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.11312
Robust Vision-Aided Self-Localization of Mobile Robots
Lindgren, K. (2020) · ResearchWorks at the University of Washington (University of Washington)
A Hybrid Approach Combining LSTM Networks and Kinematic Rules for Vehicle Velocity Estimation
Chen, H., Huang, W., & Lv, C. (2022) · SAE technical papers on CD-ROM/SAE technical paper series · doi:10.4271/2022-01-0157
Autonomous Aerial Mapping and its Applications for Emergency Response
Border, R., & Gammell, J. D. (2022) · doi:10.1109/cps-er56134.2022.00010
Fusion VIO: An Extendable Sensor Fusion Framework for Unmaned Vehicles
Guo, R., Hu, M., Chang, S., & Zhao, J. (2022) · Architecture Engineering and Science · doi:10.32629/aes.v3i2.894
Liu, X., Jiang, R., Chen, B., & Ge, S. S. (2022) · Wiley eBooks · doi:10.1002/9781119876045.ref
An Initialization Method for Monocular Visual-Inertial Odometry Based on Uncertainty State
Fu, P., Li, S., Yu, T., Zhu, X., Yao, W., & Chen, X. (2022) · International Conference on Communications, Information System and Computer Engineering (CISCE) · doi:10.1109/cisce55963.2022.9851127
A Monocular Visual Inertial Odometer Based on Weighted Median Pre-Integration
Yan, X., Ding, R., Luo, Q., Ju, C., & Wu, D. (2022) · Global Reliability and Prognostics and Health Management Conference (PHM) · doi:10.1109/phm-yantai55411.2022.9942113
Tagawa, N., Tarashima, S., Yoshida, S., Kawamura, K., Tada, M., & Arai, H. (2020) · The Journal of The Institute of Image Information and Television Engineers · doi:10.3169/itej.74.93
An Indoor Real-Time Visualization Exploration Unmanned Aerial Vehicle
Bu, N., Xu, G., Xiao, J., & Ge, J. (2023) · Journal of Physics Conference Series · doi:10.1088/1742-6596/2477/1/012105
Off-road environment Localization of unmanned vehicles based on Visual-InertialPreprint
Li, J., Firkat, E., Zhu, B., Zhu, J., & Hamdulla, A. (2023) · Research Square · doi:10.21203/rs.3.rs-3080448/v1
Underwater visual-inertial odometer based on artificial markers and natural feature points
Wang, B., Liu, Y., & Fan, H. (2023) · International Conference on Automation Control, Algorithm and Intelligent Bionics (ACAIB) · doi:10.1117/12.2686369
(2023) · International Research Journal of Modernization in Engineering Technology and Science · doi:10.56726/irjmets46491
Monocular Visual SLAM with Robust and Efficient Line Features
Long, L., & Yang, J. (2023) · Chinese Control and Decision Conference (CCDC) · doi:10.1109/ccdc58219.2023.10326558
Combined Binocular Vision and IMU Navigation Algorithm Based on Nonlinear Optimization
Lu, Y., Sun, F., & Zhang, X. (2023) · Chinese Control and Decision Conference (CCDC) · doi:10.1109/ccdc58219.2023.10326647
Bodie, K., Brunner, M., & Allenspach, M. (2023) · Springer tracts in advanced robotics · doi:10.1007/978-3-031-45497-4_5
Bodie, K., Brunner, M., & Allenspach, M. (2023) · Springer tracts in advanced robotics · doi:10.1007/978-3-031-45497-4_6
Point Cloud Map creation based on data Fusion of Lidar and IMU
Zhao, Y., Yang, J., Liang, Y., Wang, W., & Guo, L. (2023) · CAA International Conference on Vehicular Control and Intelligence (CVCI) · doi:10.1109/cvci59596.2023.10397410
An Environment-Adaptive Stereo Vision Inertial Odometer
Zhou, Z. S., Shi, Y., Li, Y., & Yang, S. (2023) · International Conference on Electrical, Mechanical and Computer Engineering (ICEMCE) · doi:10.1109/icemce60359.2023.10490974
A Robust and Efficient Visual-Inertial SLAM for Vision-Degraded Environments
Zhao, X., Gao, Z. Y., Wang, J., Lin, Z., Zhou, Z., & Huang, Y. (2024) · International Conference on Control and Automation · doi:10.1109/icca62789.2024.10591868
Asıl, U., & Nasibov, E. N. (2024) · Research Square · doi:10.21203/rs.3.rs-4935014/v1
A collaborative SLAM method for dual payload-carrying UAVs in denied environments
Rao, J., Liu, N., Chen, J., Liu, M., Lei, J., & Giernacki, W. (2024) · Machine Vision and Applications · doi:10.1007/s00138-024-01614-3
Error-State Kalman Filter Based RGBD Direct Depth-Inertial Odometry and Mapping
Han, L. B., Jiang, X., Zhou, Y., & Vong, C. (2025) · Springer eBooks · doi:10.1007/978-981-96-1108-9_5
Wang, Z., Han, F., Ping, Z., & Huang, W. (2024) · China Automation Congress (CAC) · doi:10.1109/cac63892.2024.10865085
Multi-camera Visual Odometry for Motion-Constrained Environments
Wang, Y., Ji, J., Liu, Y., Cai, Z., & Zhao, J. (2025) · Lecture notes in electrical engineering · doi:10.1007/978-981-96-2240-5_4
Transformer Based Visual Inertial Odometry
Fei, S., Li, J., Li, L., Liang, J., Hu, J., Zhang, D., & Han, J. (2025) · Lecture notes in electrical engineering · doi:10.1007/978-981-96-2264-1_54
Positioning Algorithm with Tightly Coupled Wheel Odometry and VIO in Off-Road Environments
魏, 鸿. (2025) · Software Engineering and Applications · doi:10.12677/sea.2025.142027
Robust thermal–inertial SLAM with online photometric calibration and point-edge flow tracking
Hou, P., Chen, J., Shao, Y., Chen, X., & Zhang, X. (2025) · Measurement Science and Technology · doi:10.1088/1361-6501/adf3d8
Novel Orb Slam System for Robot Navigation in Real-Time
Chakraborty, S., Verma, A., Hartman, A., & Ho, N. T. (2025) · International Conference on Multimodal Interaction · doi:10.1109/icmi65310.2025.11141249 · Cited by 1
Embodied visuomotor representation
Burner, L., Fermuller, C. M., & Aloimonos, Y. (2025) · npj Robotics · doi:10.1038/s44182-025-00047-y
Id-Vio: an Illumination-Robust Visual-Inertial Odometry for Dynamic Scenarios
Wei, W., Tao, F., Liu, S., Liu, X., Li, J., Hu, Y., & Zhou, Y. (2025) · International Symposium on Intelligent Robotics and Systems (ISoIRS) · doi:10.1109/isoirs65690.2025.11167955
Song, J., Richard, A., & Olivares-Méndez, M. A. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11246589
RXVINS: Robust XFeat-Aided Visual-Inertial SLAM in Tunnels
Shi, X., Zhang, H., & Luo, X. (2025) · International Symposium on Intelligent Robotics and Systems (ISoIRS) · doi:10.1109/isoirs65690.2025.11168071
Robust Visual-Inertial Odometry with Pedestrian Dead Reckoning Under Vision-Degraded Conditions
Park, S., Lee, H., & Park, C. G. (2025) · Proceedings of IEEE Sensors/Proceedings of IEEE Sensors ... · doi:10.1109/sensors59705.2025.11331271
Givens, M. W., & McMahon, J. W. (2026) · Journal of Guidance Control and Dynamics · doi:10.2514/1.g008783
Shestakov, A. L., & Tsiopliakis, N. I. (2026) · Bulletin of the South Ural State University Ser Computer Technologies Automatic Control & Radioelectronics · doi:10.14529/ctcr260104
Gu, F., Ji, K., Dou, J., Zhao, H., Li, Y., & Long, X. (2026) · IEEE Sensors Journal · doi:10.1109/jsen.2026.3666303
Development of an Autonomous UAV for Multi-Modal Mapping of Underground Mines
Escobar, L., Akhihiero, D., Gross, J. N., & Pereira, G. A. S. (2026) · Robotics · doi:10.3390/robotics15030063
A continual evolving Visual-Inertial Odometry for drones in flight
Zhou, Y., Wei, W., Li, R., Liu, X., & Li, J. (2026) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2026.03.039
Dual Pose-Graph Semantic Localization for Vision-Based Autonomous Drone Racing
Pérez-Saura, D., Fernández-Cortizas, M., Gaona, A. J., & Campoy, P. (2026) · IEEE International Workshop on Metrology for AeroSpace (MetroAeroSpace) · doi:10.1109/metroaerospace69299.2026.11646645
Sun, Y., Su, R., & Duan, H. (2026) · Biomimetics · doi:10.3390/biomimetics11040283
Kang, J., Choe, J., Kong, D., Yoon, B., Cho, J., & Lee, D. (2026) · IEEE Transactions on Robotics · doi:10.1109/tro.2026.3686255
Radar-Inertial Odometry for Low-Speed Driving
Diener, L., Kalkkuhl, J. C., & Enzweiler, M. (2026) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2026.3686644
Yue, S., Mao, J., He, X., Lv, Y., Du, X., & Luo, X. (2025) · China Automation Congress (CAC) · doi:10.1109/cac67268.2025.11487778
Xiao, J., Qiu, H., Zhou, Y., Wang, R., & Liu, P. (2026) · Drones · doi:10.3390/drones10050346
Small-Error Linearized S-MSCKF With Loop-Closure-Triggered Global Reference Frame Redefinition
Ma, Z., Li, T., Gao, X., He, D., Wang, Y., Yu, W., & Truong, T. (2026) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2026.3694351
FOCUS: A Failure-Tolerant Visual-Inertial Odometry Using Contextual Understanding and Sensor Fusion
Nazeer, N., Leier, M., Reinsalu, U., & Tepljakov, A. (2026) · International Conference on Mechatronics and Robotics Engineering (ICMRE) · doi:10.1109/icmre69538.2026.11533894
Hao, Z., & Wu, H. B. (2026) · Sensors · doi:10.3390/s26113470
ESKF-g2o-SLAM: A Stereo Visual–Inertial SLAM with ORB Features and ESKF-Based VIO
Cai, Y., Jing, W., Ren, J., Bai, H., Li, S., Sun, Y., & Xie, M. (2026) · Electronics · doi:10.3390/electronics15122599
Dilmi, W., Saif, A. A., Ferik, S. E., Al‐Dhaifallah, M., & Brahmi, B. (2026) · International Multi-Conference on Systems, Signals & Devices (SSD) · doi:10.1109/ssd69655.2026.11559067
OdoTest: An Automated Testing Approach for Odometry Systems
Zhou, J., Cheng, M., Tang, S., Guo, A., Xie, X., Xue, Y., & Zhang, L. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3808128
Fast Block Kalman Filter For Visual-Inertial Navigation
Tsiopliakis, N. I. (2026) · Gyroscopy and Navigation · doi:10.1134/s2075108726700112
Tightly-coupled radar-visual-inertial odometry
Nissov, M., Singh, M., & Alexis, K. (2026) · European Journal of Control · doi:10.1016/j.ejcon.2026.101601
Consistency-Enhanced Tightly Coupled Visual-Inertial Odometry via Bounded Double Window Optimization
Hong, E., Cho, B., & Noh, D. (2026) · International Conference on Ubiquitous Robots (UR) · doi:10.1109/ur69537.2026.11626745
Fang, Y., Lu, L., Xu, J., & Gao, W. (2026) · Journal of Field Robotics · doi:10.1002/rob.70328
AUTONOMOUS ROBOTIC EXPLORATION AND ARTIFACT LOCALIZATION IN SUBTERRANEAN ENVIRONMENTS
Bagot, K., Karakusak, M. Z., & Kivrak, H. (2026) · Konya Journal of Engineering Sciences · doi:10.36306/konjes.1766861
A Sensor-Centric Survey of SLAM and Odometry for GPS-Denied EnvironmentsPreprint
Geladaris, A., & Polygerinos, P. (2026) · Research Square · doi:10.21203/rs.3.rs-10409860/v1
Son, D., Choi, J., Kim, J., Joo, K.-J., & Kuc, T. (2026) · Applied Sciences · doi:10.3390/app162010164
RetiGlue-SLAM: A Robust Visual SLAM System Designed for Low-Light and Complex Environments
Li, Y., Liang, X., Guo, G., Su, P., & An, Q. (2026) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi15100468
Metadata
- Authors
- Bloesch, M., Burri, M., Omari, S., Hutter, M., & Siegwart, R.
- Affiliations
- ETH Zurich (CH)
- Corresponding author
- Bloesch, Michael
- Venue
- The International Journal of Robotics Research
- Publisher
- SAGE Publications
- Published
- 2017-09
- Volume
- 36
- Issue
- 10
- Pages
- 1053-1072
- ISSN
- 0278-3649 (ISSN-L)
- 1741-3176
- OpenAlex
- W2754177129
- Cited by
- 485
- References
- 37
- Citations by year
- 2026: 30 · 2025: 53 · 2024: 53 · 2023: 64 · 2022: 69 · 2021: 68 · 2020: 51 · 2019: 68 · 2018: 29
- FWCI
- 37.21
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Locations
- The International Journal of Robotics Research (publishedVersion)
- Repository for Publications and Research Data (ETH Zurich) (submittedVersion, other-oa)
- ETH Zürich Research Collection
- The International Journal of Robotics Research
- Funders
- National Science Foundation
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (149427, 200021)
- National Centre of Competence in Research Robotics
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
- Physical Sciences › Engineering › Aerospace Engineering › Inertial Sensor and Navigation
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Vision and Imaging
- Keywords
- visual-inertial odometry, iterated extended Kalman filter, photometric errors, data association, landmark initialization, motion blur robustness, pose estimation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
