The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Iterated extended Kalman filter based visual-inertial odometry using direct photometric feedback
Open accessAbstract
This paper presents a visual-inertial odometry framework that tightly fuses inertial measurements with visual data from one or more cameras, by means of an iterated extended Kalman filter. By employing image patches as landmark descriptors, a photometric error is derived, which is directly integrated as an innovation term in the filter update step. Consequently, the data association is an inherent part of the estimation process and no additional feature extraction or matching processes are required. Furthermore, it enables the tracking of noncorner-shaped features, such as lines, and thereby increases the set of possible landmarks. The filter state is formulated in a fully robocentric fashion, which reduces errors related to nonlinearities. This also includes partitioning of a landmark’s location estimate into a bearing vector and distance and thereby allows an undelayed initialization of landmarks. Overall, this results in a compact approach, which exhibits a high level of robustness with respect to low scene texture and motion blur. Furthermore, there is no time-consuming initialization procedure and pose estimates are available starting at the second image frame. We test the filter on different real datasets and compare it with other state-of-the-art visual-inertial frameworks. Experimental results show that robust localization with high accuracy can be achieved with this filter-based framework.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“While numerous datasets aimed at vision-aided odometry exist [39], [40], [41], [42], [43], [44], few heterogeneous datasets of sizes suitable for deep learning applications on RGB-D data are available.”
From Unsupervised Deep Visual-Inertial Odometry with Online Error Correction for RGB-D Imagery (2020) · cites this paper as [40]
Citations
Cites
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897
(1981) · Cited by 11,963
Shi, J., & Tomasi (1994) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition CVPR-94 · doi:10.1109/cvpr.1994.323794 · Cited by 7,724 · cited 4×
“If we minimize the squared error terms for a multilevel patch, we obtain a patch alignment algorithm which is very similar to the well-known Kanade-Lucas-Tomasi (KLT) feature tracker (Lucas and Kanade (1981); Shi and Tomasi (1994)).”
MethodInfluentialProceedings of the 19th International Joint Conference on Artificial Intelligence
Pujol, J. M., Delgado, J., Ramon Sangüesa, A., & Flache, A. (2005) · International Joint Conference on Artificial Intelligence · Cited by 5,771
Machine Learning for High-Speed Corner Detection
Rosten, E., & Drummond, T. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_34 · Cited by 4,555
LSD-SLAM: Large-scale direct monocular SLAM
Engel, J., Schöps, T., & Cremers, D. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10605-2_54 · Cited by 3,851
SVO: Fast semi-direct monocular visual odometry
Forster, C., Pizzoli, M., & Scaramuzza, D. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6906584 · Cited by 2,205
The EuRoC micro aerial vehicle datasets
Burri, M., Nikolic, J., Gohl, P., Schneider, T., Rehder, J., Omari, S., Achtelik, M., & Siegwart, R. (2016) · The International Journal of Robotics Research · doi:10.1177/0278364915620033 · Cited by 2,086
Self-citationA Multi-State Constraint Kalman Filter for Vision-aided Inertial Navigation
Mourikis, A. I., & Roumeliotis, S. I. (2007) · Proceedings 2007 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2007.364024 · Cited by 1,951
2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition
(2001) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2001.990916 · Cited by 1,884
Real-time simultaneous localisation and mapping with a single camera
Davison (2003) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2003.1238654 · Cited by 1,749
Keyframe-based visual–inertial odometry using nonlinear optimization
Leutenegger, S., Lynen, S., Bosse, M. C., Siegwart, R., & Furgale, P. (2014) · The International Journal of Robotics Research · doi:10.1177/0278364914554813 · Cited by 1,718
Self-citationOn-Manifold Preintegration for Real-Time Visual--Inertial Odometry
Forster, C., Carlone, L., Dellaert, F., & Scaramuzza, D. (2017) · IEEE Transactions on Robotics · doi:10.1109/tro.2016.2597321 · Cited by 1,502
Robust visual inertial odometry using a direct EKF-based approach
Bloesch, M., Omari, S., Hutter, M., & Siegwart, R. (2015) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353389 · Cited by 934
Self-citationHigh-precision, consistent EKF-based visual-inertial odometry
Li, M., & Mourikis, A. I. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913481251 · Cited by 813
Visual-Inertial Sensor Fusion: Localization, Mapping and Sensor-to-Sensor Self-calibration
Kelly, J. W., & Sukhatme, G. S. (2010) · The International Journal of Robotics Research · doi:10.1177/0278364910382802 · Cited by 537
The iterated Kalman filter update as a Gauss-Newton method
Bell, B. M., & Cathey, F. W. (1993) · IEEE Transactions on Automatic Control · doi:10.1109/9.250476 · Cited by 510
Real-time monocular SLAM: Why filter?
Strasdat, H., Montiel, J. M. M., & Davison, A. J. (2010) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2010.5509636 · Cited by 485
Visual-inertial navigation, mapping and localization: A scalable real-time causal approach
Jones, E., & Soatto, S. (2011) · The International Journal of Robotics Research · doi:10.1177/0278364910388963 · Cited by 436
Unified Inverse Depth Parametrization for Monocular SLAM
Montiel, J., Civera, J., & Davison, A. (2006) · Robotics: Science and Systems II · doi:10.15607/rss.2006.ii.011 · Cited by 377
A counter example to the theory of simultaneous localization and map building
Julier, S. J., & Uhlmann, J. K. (2002) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2001.933280 · Cited by 321
Hertzberg, C., Wagner, R., Frese, U., & Schröder, L. (2011) · Information Fusion · doi:10.1016/j.inffus.2011.08.003 · Cited by 290
Get Out of My Lab: Large-scale, Real-Time Visual-Inertial Localization
Lynen, S., Sattler, T., Bosse, M., Hesch, J., Pollefeys, M., & Siegwart, R. (2015) · Robotics: Science and Systems XI · doi:10.15607/rss.2015.xi.037 · Cited by 243 · cited 1×
“However, all odometry frameworks inherently suffer from drift and, if the primary goal is localization accuracy, a back-end framework doing global mapping, re-localization and loop closure will be indispensable (e.g. Lynen et al. (2015)).”
BackgroundSelf-citationLimits to the consistency of EKF-based SLAM
Castellanos, J. A., Neira, J., & Tardós, J. D. (2004) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)32063-3 · Cited by 243
Monocular Vision for Long‐term Micro Aerial Vehicle State Estimation: A Compendium
Weiß, S., Achtelik, M., Lynen, S., Achtelik, M. C., Kneip, L., Chli, M., & Siegwart, R. (2013) · Journal of Field Robotics · doi:10.1002/rob.21466 · Cited by 235
Self-citationDirect visual-inertial odometry with stereo cameras
Usenko, V., Engel, J. J., Stückler, J., & Cremers, D. (2016) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2016.7487335 · Cited by 225
Analysis and improvement of the consistency of extended Kalman filter based SLAM
Huang, G. P., Mourikis, A. I., & Roumeliotis, S. I. (2008) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2008.4543252 · Cited by 222
Impact of Landmark Parametrization on Monocular EKF-SLAM with Points and Lines
Solà, J., Vidal‐Calleja, T., Civera, J., & Montiel, J. M. M. (2011) · International Journal of Computer Vision · doi:10.1007/s11263-011-0492-5 · Cited by 149
An Efficient Direct Approach to Visual SLAM
Silveira, G., Malis, E., & Rives, P. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.2004829 · Cited by 143
State estimation for legged robots on unstable and slippery terrain
Bloesch, M., Gehring, C., Fankhauser, P., Hutter, M., Hoepflinger, M. A., & Siegwart, R. (2013) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2013.6697236 · Cited by 136
Self-citationStereo-vision-based navigation of a six-legged walking robot in unknown rough terrain
Stelzer, A., Hirschmüller, H., & Görner, M. (2012) · The International Journal of Robotics Research · doi:10.1177/0278364911435161 · Cited by 121
Locally Planar Patch Features for Real-Time Structure from Motion
Molton, N., Davison, A. J., & Reid, I. D. (2004) · British Machine Vision Conference (BMVC) · doi:10.5244/c.18.90 · Cited by 119
1-point RANSAC for EKF-based Structure from Motion
Civera, J., Grasa, Ó. G., Davison, A. J., & Montiel, J. M. M. (2009) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2009.5354410 · Cited by 119
A semi-direct approach to structure from motion
Jin, H., Favaro, P., & Soatto, S. (2003) · The Visual Computer · doi:10.1007/s00371-003-0202-6 · Cited by 96
Semi-direct EKF-based monocular visual-inertial odometry
Tanskanen, P., Nägeli, T., Pollefeys, M., & Hilliges, O. (2015) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7354242 · Cited by 51
Real-time pose estimation of a dynamic quadruped in GPS-denied environments for 24-hour operation
Ma, J., Bajracharya, M., Susca, S., Matthies, L. H., & Malchano, M. (2015) · The International Journal of Robotics Research · doi:10.1177/0278364915587333 · Cited by 45
Initialization-Free Monocular Visual-Inertial State Estimation with Application to Autonomous MAVs
Shen, S., Mulgaonkar, Y., Michael, N., & Kumar, V. R. (2015) · Springer tracts in advanced robotics · doi:10.1007/978-3-319-23778-7_15 · Cited by 40
Research works printed but not linked: 1
- Bloesch M, 2016, arXiv
Cited by
Sorted by citations
ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual–Inertial, and Multimap SLAM
Campos, C., Elvira, R., Rodríguez, J. J. G., Montiel, J. M. M., & Tardos, J. D. (2021) · IEEE Transactions on Robotics · doi:10.1109/tro.2021.3075644 · Cited by 4,676
FAST-LIO: A Fast, Robust LiDAR-Inertial Odometry Package by Tightly-Coupled Iterated Kalman Filter
Xu, W. D., & Zhang, F. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3064227 · Cited by 1,159
2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Joshi, B., Rahman, S., Kalaitzakis, M., Cain, B., Johnson, J. V., Xanthidis, M., Karapetyan, N., Hernandez, A., Li, A. Q., Vitzilaios, N. I., et al. (2019) · doi:10.1109/iros40897.2019 · Cited by 1,091
OpenVINS: A Research Platform for Visual-Inertial Estimation
Geneva, P., Eckenhoff, K., Lee, W., Yang, Y., & Huang, G. P. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9196524 · Cited by 711
The TUM VI Benchmark for Evaluating Visual-Inertial Odometry
Schubert, D., Goll, T., Demmel, N., Usenko, V., Stückler, J., & Cremers, D. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593419 · Cited by 497
Metadata
- Authors
- Bloesch, M., Burri, M., Omari, S., Hutter, M., & Siegwart, R.
- Affiliations
- ETH Zurich (CH)
- Corresponding author
- Bloesch, Michael
- Venue
- The International Journal of Robotics Research
- Publisher
- SAGE Publications
- Published
- 2017-09
- Volume
- 36
- Issue
- 10
- Pages
- 1053-1072
- ISSN
- 0278-3649 (ISSN-L)
- 1741-3176
- OpenAlex
- W2754177129
- Cited by
- 485
- References
- 37
- Citations by year
- 2026: 30 · 2025: 53 · 2024: 53 · 2023: 64 · 2022: 69 · 2021: 68 · 2020: 51 · 2019: 68 · 2018: 29
- FWCI
- 37.21
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Locations
- The International Journal of Robotics Research (publishedVersion)
- Repository for Publications and Research Data (ETH Zurich) (submittedVersion, other-oa)
- ETH Zürich Research Collection
- The International Journal of Robotics Research
- Funders
- National Science Foundation
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (149427, 200021)
- National Centre of Competence in Research Robotics
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
- Physical Sciences › Engineering › Aerospace Engineering › Inertial Sensor and Navigation
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Vision and Imaging
- Keywords
- visual-inertial odometry, iterated extended Kalman filter, photometric errors, data association, landmark initialization, motion blur robustness, pose estimation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
