The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Robust Stereo Visual Inertial Odometry for Fast Autonomous Flight
Open accessAbstract
In recent years, vision-aided inertial odometry for state estimation has matured significantly. However, we still encounter challenges in terms of improving the computational efficiency and robustness of the underlying algorithms for applications in autonomous flight with microaerial vehicles, in which it is difficult to use high-quality sensors and powerful processors because of constraints on size and weight. In this letter, we present a filter-based stereo visual inertial odometry that uses the multistate constraint Kalman filter. Previous work on the stereo visual inertial odometry has resulted in solutions that are computationally expensive. We demonstrate that our stereo multistate constraint Kalman filter (S-MSCKF) is comparable to state-of-the-art monocular solutions in terms of computational cost, while providing significantly greater robustness. We evaluate our S-MSCKF algorithm and compare it with state-of-the-art methods including OKVIS, ROVIO, and VINS-MONO on both the EuRoC dataset and our own experimental datasets demonstrating fast autonomous flight with a maximum speed of 17.5 m/s in indoor and outdoor environments. Our implementation of the S-MSCKF is available at https://github.com/KumarRobotics/msckf_vio.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Combined Corner and Edge Detector
Harris, C., & Stephens, M. (1988) · Procedings of the Alvey Vision Conference 1988 · doi:10.5244/c.2.23 · Cited by 12,901 · cited 1×
“Between OKVIS and VINSMONO, OKVIS has more CPU usage mainly because it uses Harris corner detector [35] and BRISK [36] descriptor for both temporal and stereo matching.”
Method(1981) · Cited by 11,963
ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras
Mur-Artal, R., & Tardos, J. D. (2017) · IEEE Transactions on Robotics · doi:10.1109/tro.2017.2705103 · Cited by 6,898
LSD-SLAM: Large-scale direct monocular SLAM
Engel, J., Schöps, T., & Cremers, D. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10605-2_54 · Cited by 3,851 · cited 1×
“There is extensive literature on visual odometry, ranging from pure vision-based methods [8]–[12], loosely-coupled VIO solutions [13], [14], to the recently more popular tightlycoupled VIO solutions [1], [4], [5], [15]–[20] which will be the major focus of this paper.”
BackgroundBRISK: Binary Robust invariant scalable keypoints
Leutenegger, S., Chli, M., & Siegwart, R. Y. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126542 · Cited by 3,450
Engel, J., Koltun, V., & Cremers, D. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2658577 · Cited by 2,924
SVO: Fast semi-direct monocular visual odometry
Forster, C., Pizzoli, M., & Scaramuzza, D. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6906584 · Cited by 2,205
The EuRoC micro aerial vehicle datasets
Burri, M., Nikolic, J., Gohl, P., Schneider, T., Rehder, J., Omari, S., Achtelik, M. W., & Siegwart, R. (2016) · The International Journal of Robotics Research · doi:10.1177/0278364915620033 · Cited by 2,066
A Multi-State Constraint Kalman Filter for Vision-aided Inertial Navigation
Mourikis, A. I., & Roumeliotis, S. I. (2007) · Proceedings 2007 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2007.364024 · Cited by 1,951
Keyframe-based visual–inertial odometry using nonlinear optimization
Leutenegger, S., Lynen, S., Bosse, M., Siegwart, R., & Furgale, P. (2015) · The International Journal of Robotics Research · doi:10.1177/0278364914554813 · Cited by 1,723
iSAM2: Incremental smoothing and mapping using the Bayes tree
Kaess, M., Johannsson, H., Roberts, R., Ila, V., Leonard, J. J., & Dellaert, F. (2012) · The International Journal of Robotics Research · doi:10.1177/0278364911430419 · Cited by 1,362
StereoScan: Dense 3d reconstruction in real-time
Geiger, A., Ziegler, J., & Stiller, C. (2011) · 2011 IEEE Intelligent Vehicles Symposium (IV) · doi:10.1109/ivs.2011.5940405 · Cited by 1,089
Robust visual inertial odometry using a direct EKF-based approach
Bloesch, M., Omari, S., Hutter, M., & Siegwart, R. (2015) · 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353389 · Cited by 917
High-precision, consistent EKF-based visual-inertial odometry
Li, M., & Mourikis, A. I. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913481251 · Cited by 813 · cited 1×
“As has been shown in [2], [23], the EKF-based VIO for 6-DOF motion estimation has four unobservable directions corresponding to global position and rotation along the gravity axis, i.”
BackgroundVisual-Inertial Sensor Fusion: Localization, Mapping and Sensor-to-Sensor Self-calibration
Kelly, J., & Sukhatme, G. S. (2011) · The International Journal of Robotics Research · doi:10.1177/0278364910382802 · Cited by 536
IMU Preintegration on Manifold for Efficient Visual-Inertial Maximum-a-Posteriori Estimation
Forster, C., Carlone, L., Dellaert, F., & Scaramuzza, D. (2015) · Robotics: Science and Systems XI · doi:10.15607/rss.2015.xi.006 · Cited by 499
Trajković, M., & Hedley, M. (1998) · Image and Vision Computing · doi:10.1016/s0262-8856(97)00056-5 · Cited by 498
Lupton, T., & Sukkarieh, S. (2012) · IEEE Transactions on Robotics · doi:10.1109/tro.2011.2170332 · Cited by 469
Weiss, S., Achtelik, M. W., Lynen, S., Chli, M., & Siegwart, R. (2012) · 2012 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2012.6225147 · Cited by 417
Visual odometry based on stereo image sequences with RANSAC-based outlier rejection scheme
Kitt, B., Geiger, A., & Lategahn, H. (2010) · 2010 IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2010.5548123 · Cited by 405
Yang, Z., & Shen, S. (2017) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2016.2550621 · Cited by 274
Observability-based Rules for Designing Consistent EKF SLAM Estimators
Huang, G. P., Mourikis, A. I., & Roumeliotis, S. I. (2010) · The International Journal of Robotics Research · doi:10.1177/0278364909353640 · Cited by 272
A synchronized visual-inertial sensor system with FPGA pre-processing for accurate real-time SLAM
Nikolic, J., Rehder, J., Burri, M., Gohl, P., Leutenegger, S., Furgale, P. T., & Siegwart, R. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6906892 · Cited by 270
Consistency Analysis and Improvement of Vision-aided Inertial Navigation
Hesch, J. A., Kottas, D. G., Bowman, S. L., & Roumeliotis, S. I. (2014) · IEEE Transactions on Robotics · doi:10.1109/tro.2013.2277549 · Cited by 266
Robocentric map joining: Improving the consistency of EKF-SLAM
Castellanos, J. A., Martinez-Cantin, R., Tardós, J. D., & Neira, J. (2007) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2006.06.005 · Cited by 221
Direct visual-inertial odometry with stereo cameras
Usenko, V., Engel, J., Stuckler, J., & Cremers, D. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487335 · Cited by 219
Shen, S., Mulgaonkar, Y., Michael, N., & Kumar, V. (2014) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2014.6907588 · Cited by 190
Self-citationA Square Root Inverse Filter for Efficient Vision-aided Inertial Navigation on Mobile Devices
Wu, K., Ahmed, A., Georgiou, G., & Roumeliotis, S. I. (2015) · Robotics: Science and Systems · doi:10.15607/rss.2015.xi.008 · Cited by 146
A comparative analysis of tightly-coupled monocular, binocular, and stereo VINS
Paul, M. K., Wu, K., Hesch, J. A., Nerurkar, E. D., & Roumeliotis, S. I. (2017) · IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2017.7989022 · Cited by 87
Optimization-Based Estimator Design for Vision-Aided Inertial Navigation
Li, M., & Mourikis, A. I. (2012) · Robotics: Science and Systems · doi:10.15607/rss.2012.viii.031 · Cited by 53
Initialization-Free Monocular Visual-Inertial State Estimation with Application to Autonomous MAVs
Shen, S., Mulgaonkar, Y., Michael, N., & Kumar, V. R. (2015) · Springer tracts in advanced robotics · doi:10.1007/978-3-319-23778-7_15 · Cited by 45
Self-citationRobust inference for visual-inertial sensor fusion
Tsotsos, K., Chiuso, A., & Soatto, S. (2015) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2015.7139924 · Cited by 31
Photometric patch-based visual-inertial odometry
Zheng, X., Moratto, Z., Li, M., & Mourikis, A. I. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989372 · Cited by 31
Cited by
FAST-LIO: A Fast, Robust LiDAR-Inertial Odometry Package by Tightly-Coupled Iterated Kalman Filter
Xu, W., & Zhang, F. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3064227 · Cited by 1,127
Labbé, M., & Michaud, F. (2019) · Journal of Field Robotics · doi:10.1002/rob.21831 · Cited by 989
OpenVINS: A Research Platform for Visual-Inertial Estimation
Geneva, P., Eckenhoff, K., Lee, W., Yang, Y., & Huang, G. (2020) · 2020 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra40945.2020.9196524 · Cited by 680
Swarm of micro flying robots in the wild
Zhou, X., Wen, X., Wang, Z., Gao, Y., Li, H., Wang, Q., Yang, T., Lu, H., Cao, Y., Xu, C., et al. (2022) · Science Robotics · doi:10.1126/scirobotics.abm5954 · Cited by 657
Metadata
- Authors
- Sun, K., Mohta, K., Pfrommer, B., Watterson, M., Liu, S., Mulgaonkar, Y., Taylor, C. J., & Kumar, V.
- Venue
- IEEE Robotics and Automation Letters
- Published
- 2018-04
- Volume
- 3
- Issue
- 2
- Pages
- 965-972
- ISSN
- 2377-3766 (ISSN-L)
- 2377-3774
- OpenAlex
- W2962987986
- Cited by
- 539
- References
- 33
- FWCI
- 40.87
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.