Depth enhanced visual-inertial odometry based on Multi-State Constraint Kalman Filter
Abstract
There have been increasing demands for developing robotic system combining camera and inertial measurement unit in navigation task, due to their low-cost, lightweight and complementary properties. In this paper, we present a Visual Inertial Odometry (VIO) system which can utilize sparse depth to estimate 6D pose in GPS-denied and unstructured environments. The system is based on Multi-State Constraint Kalman Filter (MSCKF), which benefits from low computation load when compared to optimization-based method, especially on resource-constrained platform. Features are enhanced with depth information forming 3D landmark position measurements in space, which reduces uncertainty of position estimate. And we derivate measurement model to access compatibility with both 2D and 3D measurements. In experiments, we evaluate the performance of the system in different in-flight scenarios, both cluttered room and industry environment. The results suggest that the estimator is consistent, substantially improves the accuracy compared with original monocular-based MSKCF and achieves competitive accuracy with other research.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
MSCKF approaches are typically less accurate than optimization-based approaches.
“While its complexity is linear in the number of features being used for egomotion estimation and it was generally more robust compared to optimization-based approaches (as has been recently reported in [22]), MSCKF approaches are typically less accurate in comparison.”
From Unsupervised Deep Visual-Inertial Odometry with Online Error Correction for RGB-D Imagery (2020) · cites this paper as [22]
Cites
ORB: An efficient alternative to SIFT or SURF
Rublee, E., Rabaud, V., Konolige, K., & Bradski, G. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126544 · Cited by 11,037 · see citing works
MonoSLAM: Real-time single camera SLAM
Davison, A. J., Reid, I. D., Molton, N. D., & Stasse, O. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1049 · Cited by 3,959 · see citing works
The EuRoC micro aerial vehicle datasets
Burri, M., Nikolic, J., Gohl, P., Schneider, T., Rehder, J., Omari, S., Achtelik, M., & Siegwart, R. (2016) · The International Journal of Robotics Research · doi:10.1177/0278364915620033 · Cited by 2,086 · see citing works
A Multi-State Constraint Kalman Filter for Vision-aided Inertial Navigation
Mourikis, A. I., & Roumeliotis, S. I. (2007) · Proceedings 2007 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2007.364024 · Cited by 1,951 · see citing works
Keyframe-based visual–inertial odometry using nonlinear optimization
Leutenegger, S., Lynen, S., Bosse, M. C., Siegwart, R., & Furgale, P. (2014) · The International Journal of Robotics Research · doi:10.1177/0278364914554813 · Cited by 1,718 · see citing works
Robust visual inertial odometry using a direct EKF-based approach
Bloesch, M., Omari, S., Hutter, M., & Siegwart, R. (2015) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353389 · Cited by 934 · see citing works
High-precision, consistent EKF-based visual-inertial odometry
Li, M., & Mourikis, A. I. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913481251 · Cited by 813 · see citing works
Visual-Inertial Sensor Fusion: Localization, Mapping and Sensor-to-Sensor Self-calibration
Kelly, J. W., & Sukhatme, G. S. (2010) · The International Journal of Robotics Research · doi:10.1177/0278364910382802 · Cited by 537 · see citing works
Visual-inertial navigation, mapping and localization: A scalable real-time causal approach
Jones, E., & Soatto, S. (2011) · The International Journal of Robotics Research · doi:10.1177/0278364910388963 · Cited by 431 · see citing works
Robust Visual Inertial Odometry Using a Direct EKF-Based Approach
Bloesch, M., Omari, S., Hutter, M., et al. (2015) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-a-010566547 · Cited by 424 · see citing works
Unified Inverse Depth Parametrization for Monocular SLAM
Montiel, J., Civera, J., & Davison, A. (2006) · Robotics: Science and Systems II · doi:10.15607/rss.2006.ii.011 · Cited by 377 · see citing works
Real-time metric state estimation for modular vision-inertial systems
Weiß, S., & Siegwart, R. (2011) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2011.5979982 · Cited by 221 · see citing works
Real-time depth enhanced monocular odometry
Zhang, J., Kaess, M., & Singh, S. (2014) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2014.6943269 · Cited by 145 · see citing works
Vision based navigation for micro helicopters
Weiß, S. (2012) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-a-007344020 · Cited by 101 · see citing works
3-D motion estimation and online temporal calibration for camera-IMU systems
Li, M., & Mourikis, A. I. (2013) · IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2013.6631398 · Cited by 98 · see citing works
Combined Visual and Inertial Navigation for an Unmanned Aerial Vehicle
Kelly, J. W., Saripalli, S., & Sukhatme, G. S. (2008) · Springer tracts in advanced robotics · doi:10.1007/978-3-540-75404-6_24 · Cited by 76 · see citing works
Clement, L., Peretroukhin, V., Lambert, J., & Kelly, J. W. (2015) · Canadian Conference on Computer and Robot Vision · doi:10.1109/crv.2015.11 · Cited by 41 · see citing works
Visual-Inertial Odometry on Resource-Constrained Systems
Li, M. (2014) · eScholarship (California Digital Library) · Cited by 33 · see citing works
Merging Gaussian Distributions for Object Localization in Multi-Robot Systems
Stroupe, A. W., MARTIN, M. C., & Balch, T. R. (2007) · Springer eBooks · doi:10.1007/3-540-45118-8_35 · Cited by 23 · see citing works
Visual-inertial odometry with depth sensing using a multi-state constraint Kalman filter
Galfond, M. (2014) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 4 · see citing works
High rate-localization for high-speed all-terrain robots
Roussillon, C., & Lacroix, S. (2012) · doi:10.1109/ccca.2012.6417929 · Cited by 3 · see citing works
Stereo-inertial pose estimation and online sensors extrinsic calibration
Pang, F., & Wang, T. (2016) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio.2016.7866519 · Cited by 1 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Unsupervised Deep Visual-Inertial Odometry with Online Error Correction for RGB-D Imagery
Shamwell, E. J., Lindgren, K., Leung, S., & Nothwang, W. D. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2909895 · Cited by 86 · see citing works
Shamwell, E. J., Leung, S., & Nothwang, W. D. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593573 · Cited by 41 · see citing works
- Authors
- Pang, F., Chen, Z., Pu, L., & Wang, T.
- Affiliations
- Beihang University (CN)
- Venue
- 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
- Publisher
- IEEE
- Published
- 2017-09
- Pages
- 1761-1767
- ISSN
- 2153-0858 (ISSN-L)
- OpenAlex
- W2773206443
- Cited by
- 8
- References
- 22
- Citations by year
- 2022: 1 · 2021: 1 · 2020: 1 · 2019: 2 · 2018: 3
- FWCI
- 2.87
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (publishedVersion)
- Topics
- Physical Sciences › Engineering › Aerospace Engineering › Robotics and Sensor-Based Localization
- Physical Sciences › Engineering › Aerospace Engineering › Inertial Sensor and Navigation
- Physical Sciences › Computer Science › Artificial Intelligence › Target Tracking and Data Fusion in Sensor Networks
- Keywords
- visual-inertial odometry, multi-state constraint Kalman filter, depth information, 6D pose estimation, GPS-denied navigation, monocular camera, inertial measurement unit, resource-constrained platforms
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review