The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Real-time onboard visual-inertial state estimation and self-calibration of MAVs in unknown environments
Open accessAbstract
The combination of visual and inertial sensors has proved to be very popular in robot navigation and, in particular, Micro Aerial Vehicle (MAV) navigation due the flexibility in weight, power consumption and low cost it offers. At the same time, coping with the big latency between inertial and visual measurements and processing images in real-time impose great research challenges. Most modern MAV navigation systems avoid to explicitly tackle this by employing a ground station for off-board processing. In this paper, we propose a navigation algorithm for MAVs equipped with a single camera and an Inertial Measurement Unit (IMU) which is able to run onboard and in real-time. The main focus here is on the proposed speed-estimation module which converts the camera into a metric body-speed sensor using IMU data within an EKF framework. We show how this module can be used for full self-calibration of the sensor suite in real-time. The module is then used both during initialization and as a fall-back solution at tracking failures of a keyframe-based VSLAM module. The latter is based on an existing high-performance algorithm, extended such that it achieves scalable 6DoF pose estimation at constant complexity. Fast onboard speed control is ensured by sole reliance on the optical flow of at least two features in two consecutive camera frames and the corresponding IMU readings. Our nonlinear observability analysis and our real experiments demonstrate that this approach can be used to control a MAV in speed, while we also show results of operation at 40Hz on an onboard Atom computer 1.6 GHz.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Parallel Tracking and Mapping for Small AR Workspaces
Klein, G., & Murray, D. (2007) · 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2007.4538852 · Cited by 4,346
MonoSLAM: Real-time single camera SLAM
Davison, A. J., Reid, I. D., Molton, N. D., & Stasse, O. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1049 · Cited by 3,959
An Invitation to 3-D Vision: From Images to Geometric Models
Ma, Y., Soatto, S., Koseck, J., & Sastry, S. (2003) · Cited by 846
An invitation to 3‐d vision: from images to geometric models
Holmgren, D. E. (2004) · The Photogrammetric Record · doi:10.1111/j.0031-868x.2004.295_2.x · Cited by 558
Visual-Inertial Sensor Fusion: Localization, Mapping and Sensor-to-Sensor Self-calibration
Kelly, J., & Sukhatme, G. S. (2011) · The International Journal of Robotics Research · doi:10.1177/0278364910382802 · Cited by 536
Mirzaei, F. M., & Roumeliotis, S. I. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.2004486 · Cited by 442
Autonomous multi-floor indoor navigation with a computationally constrained MAV
Shen, S., Michael, N., & Kumar, V. (2011) · 2011 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2011.5980357 · Cited by 357
Onboard IMU and monocular vision based control for MAVs in unknown in- and outdoor environments
Achtelik, M., Achtelik, M., Weiss, S., & Siegwart, R. (2011) · 2011 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2011.5980343 · Cited by 295
Self-citationImproving vision-based control using efficient second-order minimization techniques
Malis, E. (2004) · IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004 · doi:10.1109/robot.2004.1308092 · Cited by 266
Real-time metric state estimation for modular vision-inertial systems
Weiss, S., & Siegwart, R. (2011) · 2011 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2011.5979982 · Cited by 216
Self-citationAirborne simultaneous localisation and map building
Kim, J., & Sukkarieh, S. (2004) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2003.1241629 · Cited by 148
Martinelli, A. (2011) · IEEE Transactions on Robotics · doi:10.1109/tro.2011.2109210 · Cited by 74
A terrain-following control approach for a VTOL Unmanned Aerial Vehicle using average optical flow
Hérissé, B., Hamel, T., Mahony, R. E., & Russotto, F.-X. (2010) · Autonomous Robots · doi:10.1007/s10514-010-9208-x · Cited by 55
Monocular Simultaneous Localisation and Mapping
Eade, E. (2008) · Cited by 28
Cited by
VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator
Qin, T., Li, P., & Shen, S. (2018) · IEEE Transactions on Robotics · doi:10.1109/tro.2018.2853729 · Cited by 4,669
Keyframe-based visual–inertial odometry using nonlinear optimization
Leutenegger, S., Lynen, S., Bosse, M., Siegwart, R., & Furgale, P. (2015) · The International Journal of Robotics Research · doi:10.1177/0278364914554813 · Cited by 1,723
Self-citationHigh-precision, consistent EKF-based visual-inertial odometry
Li, M., & Mourikis, A. I. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913481251 · Cited by 813
A robust and modular multi-sensor fusion approach applied to MAV navigation
Lynen, S., Achtelik, M. W., Weiss, S., Chli, M., & Siegwart, R. (2013) · 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2013.6696917 · Cited by 572
Self-citationRobust Stereo Visual Inertial Odometry for Fast Autonomous Flight
Sun, K., Mohta, K., Pfrommer, B., Watterson, M., Liu, S., Mulgaonkar, Y., Taylor, C. J., & Kumar, V. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2793349 · Cited by 539
Metadata
- Authors
- Weiss, S., Achtelik, M. W., Lynen, S., Chli, M., & Siegwart, R.
- Venue
- 2012 IEEE International Conference on Robotics and Automation
- Publisher
- IEEE
- Published
- 2012-05
- Pages
- 957-964
- ISSN
- 1050-4729 (ISSN-L)
- OpenAlex
- W2049750053
- Cited by
- 417
- References
- 14
- FWCI
- 72.88
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.