A robust and modular multi-sensor fusion approach applied to MAV navigation
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
It has been long known that fusing information from multiple sensors for robot navigation results in increased robustness and accuracy. However, accurate calibration of the sensor ensemble prior to deployment in the field as well as coping with sensor outages, different measurement rates and delays, render multi-sensor fusion a challenge. As a result, most often, systems do not exploit all the sensor information available in exchange for simplicity. For example, on a mission requiring transition of the robot from indoors to outdoors, it is the norm to ignore the Global Positioning System (GPS) signals which become freely available once outdoors and instead, rely only on sensor feeds (e.g., vision and laser) continuously available throughout the mission. Naturally, this comes at the expense of robustness and accuracy in real deployment. This paper presents a generic framework, dubbed MultiSensor-Fusion Extended Kalman Filter (MSF-EKF), able to process delayed, relative and absolute measurements from a theoretically unlimited number of different sensors and sensor types, while allowing self-calibration of the sensor-suite online. The modularity of MSF-EKF allows seamless handling of additional/lost sensor signals during operation while employing a state buffering scheme augmented with Iterated EKF (IEKF) updates to allow for efficient re-linearization of the prediction to get near optimal linearization points for both absolute and relative state updates. We demonstrate our approach in outdoor navigation experiments using a Micro Aerial Vehicle (MAV) equipped with a GPS receiver as well as visual, inertial, and pressure sensors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fischler, M. A., & Bolles, R. C. (1981) · Communications of the ACM · doi:10.1145/358669.358692 · Cited by 25,893
Multiple View Geometry in Computer Vision
Hartley, R., & Zisserman, A. (2004) · doi:10.1017/cbo9780511811685 · Cited by 21,070
A Multi-State Constraint Kalman Filter for Vision-aided Inertial Navigation
Mourikis, A. I., & Roumeliotis, S. I. (2007) · Proceedings 2007 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2007.364024 · Cited by 1,951
High-precision, consistent EKF-based visual-inertial odometry
Li, M., & Mourikis, A. I. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913481251 · Cited by 813 · cited 1×
“While showing unmatched accuracy and consistency [5], [9] they are commonly designed for a particular sensor setup with limited modularity.”
BackgroundMirzaei, F. M., & Roumeliotis, S. I. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.2004486 · Cited by 442
Weiss, S., Achtelik, M. W., Lynen, S., Chli, M., & Siegwart, R. (2012) · 2012 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2012.6225147 · Cited by 417
Self-citationAutonomous multi-floor indoor navigation with a computationally constrained MAV
Shen, S., Michael, N., & Kumar, V. (2011) · 2011 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2011.5980357 · Cited by 357
GPS‐denied Indoor and Outdoor Monocular Vision Aided Navigation and Control of Unmanned Aircraft
Chowdhary, G., Johnson, E. N., Magree, D., Wu, A., & Shein, A. (2013) · Journal of Field Robotics · doi:10.1002/rob.21454 · Cited by 178
Vision-Based State Estimation and Trajectory Control Towards High-Speed Flight with a Quadrotor
Shen, S., Mulgaonkar, Y., Michael, N., & Kumar, V. (2013) · Robotics: Science and Systems IX · doi:10.15607/rss.2013.ix.032 · Cited by 165
Factor graph based incremental smoothing in inertial navigation systems
Indelman, V., Williams, S. R., Kaess, M., & Dellaert, F. (2012) · SMARTech Repository (Georgia Institute of Technology) · Cited by 135
Vision based navigation for micro helicopters
Weiß, S. (2012) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-a-007344020 · Cited by 118
Vision-based state estimation for autonomous rotorcraft MAVs in complex environments
Shen, S., Mulgaonkar, Y., Michael, N., & Kumar, V. (2013) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2013.6630808 · Cited by 109
Mourikis, A. I., Roumeliotis, S. I., & Burdick, J. W. (2007) · IEEE Transactions on Robotics · doi:10.1109/tro.2007.900610 · Cited by 75
Towards Consistent Vision-Aided Inertial Navigation
Hesch, J. A., Kottas, D. G., Bowman, S. L., & Roumeliotis, S. I. (2013) · Springer tracts in advanced robotics · doi:10.1007/978-3-642-36279-8_34 · Cited by 71
Factor graph based incremental smoothing in inertial navigation systems
Indelman, Williams, Kaess, & Dellaert (2012) · Cited by 66
Visual tracking for Augmented Reality
Klopschitz, M., Schall, G., Schmalstieg, D., & Reitmayr, G. (2010) · International Conference on Indoor Positioning and Indoor Navigation · doi:10.1109/ipin.2010.5648274 · Cited by 39
Cited by
VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator
Qin, T., Li, P., & Shen, S. (2018) · IEEE Transactions on Robotics · doi:10.1109/tro.2018.2853729 · Cited by 4,669
“The simplest way to deal with visual and inertial measurements is loosely coupled sensor fusion [9], [10], where the IMU is treated as an independent module to assist the visual structure.”
MethodLIO-SAM: Tightly-coupled Lidar Inertial Odometry via Smoothing and Mapping
Shan, T., Englot, B., Meyers, D., Wang, W., Ratti, C., & Rus, D. (2020) · 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341176 · Cited by 2,199
SVO: Fast semi-direct monocular visual odometry
Forster, C., Pizzoli, M., & Scaramuzza, D. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6906584 · Cited by 2,205
Keyframe-based visual–inertial odometry using nonlinear optimization
Leutenegger, S., Lynen, S., Bosse, M., Siegwart, R., & Furgale, P. (2015) · The International Journal of Robotics Research · doi:10.1177/0278364914554813 · Cited by 1,723
Self-citationReceding Horizon "Next-Best-View" Planner for 3D Exploration
Bircher, A., Kamel, M., Alexis, K., Oleynikova, H., & Siegwart, R. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487281 · Cited by 633
Self-citation
Metadata
- Authors
- Lynen, S., Achtelik, M. W., Weiss, S., Chli, M., & Siegwart, R.
- Venue
- 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems
- Publisher
- IEEE
- Published
- 2013-11
- Pages
- 3923-3929
- OpenAlex
- W2127752689
- Cited by
- 572
- References
- 16
- FWCI
- 27.14
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.