The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Ultimate SLAM? Combining Events, Images, and IMU for Robust Visual SLAM in HDR and High-Speed Scenarios
Open accessAbstract
Event cameras are bioinspired vision sensors that output pixel-level brightness changes instead of standard intensity frames. These cameras do not suffer from motion blur and have a very high dynamic range, which enables them to provide reliable visual information during high-speed motions or in scenes characterized by high dynamic range. However, event cameras output only little information when the amount of motion is limited, such as in the case of almost still motion. Conversely, standard cameras provide instant and rich information about the environment most of the time (in low-speed and good lighting scenarios), but they fail severely in case of fast motions, or difficult lighting such as high dynamic range or low light scenes. In this letter, we present the first state estimation pipeline that leverages the complementary advantages of these two sensors by fusing in a tightly coupled manner events, standard frames, and inertial measurements. We show on the publicly available Event Camera Dataset that our hybrid pipeline leads to an accuracy improvement of 130% over event-only pipelines, and 85% over standard-frames-only visual-inertial systems, while still being computationally tractable. Furthermore, we use our pipeline to demonstrate-to the best of our knowledge-the first autonomous quadrotor flight using an event camera for state estimation, unlocking flight scenarios that were not reachable with traditional visual-inertial odometry, such as low-light environments and high dynamic range scenes. Videos of the experiments: http://rpg.ifi.uzh.ch/ultimateslam.html.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897
Machine Learning for High-Speed Corner Detection
Rosten, E., & Drummond, T. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_34 · Cited by 4,555
A 128$\times$128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision Sensor
Lichtsteiner, P., Posch, C., & Delbruck, T. (2008) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2007.914337 · Cited by 2,485
A Multi-State Constraint Kalman Filter for Vision-aided Inertial Navigation
Mourikis, A. I., & Roumeliotis, S. I. (2007) · Proceedings 2007 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2007.364024 · Cited by 1,951
Keyframe-based visual–inertial odometry using nonlinear optimization
Leutenegger, S., Lynen, S., Bosse, M., Siegwart, R., & Furgale, P. (2015) · The International Journal of Robotics Research · doi:10.1177/0278364914554813 · Cited by 1,723
On-Manifold Preintegration for Real-Time Visual--Inertial Odometry
Forster, C., Carlone, L., Dellaert, F., & Scaramuzza, D. (2017) · IEEE Transactions on Robotics · doi:10.1109/tro.2016.2597321 · Cited by 1,502 · cited 4×
“A recent approach in this category was proposed by [3].”
BackgroundMethodInfluentialSelf-citationA 240 × 180 130 dB 3 µs Latency Global Shutter Spatiotemporal Vision Sensor
Brandli, C., Berner, R., Yang, M., Liu, S.-C., & Delbruck, T. (2014) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2014.2342715 · Cited by 1,144
Unified temporal and spatial calibration for multi-sensor systems
Furgale, P., Rehder, J., & Siegwart, R. (2013) · 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2013.6696514 · Cited by 807
Mueggler, E., Rebecq, H., Gallego, G., Delbruck, T., & Scaramuzza, D. (2017) · The International Journal of Robotics Research · doi:10.1177/0278364917691115 · Cited by 606
Self-citationReal-Time 3D Reconstruction and 6-DoF Tracking with an Event Camera
Kim, H., Leutenegger, S., & Davison, A. J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_21 · Cited by 438
Visual-inertial navigation, mapping and localization: A scalable real-time causal approach
Jones, E. S., & Soatto, S. (2011) · The International Journal of Robotics Research · doi:10.1177/0278364910388963 · Cited by 435
EVO: A Geometric Approach to Event-Based 6-DOF Parallel Tracking and Mapping in Real Time
Rebecq, H., Horstschaefer, T., Gallego, G., & Scaramuzza, D. (2017) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2016.2645143 · Cited by 410
Self-citationPIXHAWK: A micro aerial vehicle design for autonomous flight using onboard computer vision
Meier, L., Tanskanen, P., Heng, L., Lee, G. H., Fraundorfer, F., & Pollefeys, M. (2012) · Autonomous Robots · doi:10.1007/s10514-012-9281-4 · Cited by 391
Simultaneous Optical Flow and Intensity Estimation from an Event Camera
Bardow, P., Davison, A. J., & Leutenegger, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.102 · Cited by 295
Event-based, 6-DOF pose tracking for high-speed maneuvers
Mueggler, E., Huber, B., & Scaramuzza, D. (2014) · 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2014.6942940 · Cited by 258
Self-citationEvent-Based Visual Inertial Odometry
Zhu, A. Z., Atanasov, N., & Daniilidis, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.616 · Cited by 249
Autonomous, Vision‐based Flight and Live Dense 3D Mapping with a Quadrotor Micro Aerial Vehicle
Faessler, M., Fontana, F., Forster, C., Mueggler, E., Pizzoli, M., & Scaramuzza, D. (2016) · Journal of Field Robotics · doi:10.1002/rob.21581 · Cited by 247
Self-citationSimultaneous Mosaicing and Tracking with an Event Camera
Kim, H., Handa, A., Benosman, R., Ieng, S.-H., & Davison, A. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.26 · Cited by 247
Low-latency visual odometry using event-based feature tracks
Kueng, B., Mueggler, E., Gallego, G., & Scaramuzza, D. (2016) · 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7758089 · Cited by 196
Self-citationAccurate Angular Velocity Estimation With an Event Camera
Gallego, G., & Scaramuzza, D. (2017) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2016.2647639 · Cited by 183
Self-citationInteracting maps for fast visual interpretation
Cook, M., Gugelmann, L., Jug, F., Krautz, C., & Steger, A. (2011) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2011.6033299 · Cited by 162
Event-based 3D SLAM with a depth-augmented dynamic vision sensor
Weikersdorfer, D., Adrian, D. B., Cremers, D., & Conradt, J. (2014) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2014.6906882 · Cited by 159
Simultaneous Localization and Mapping for Event-Based Vision Systems
Weikersdorfer, D., Hoffmann, R., & Conradt, J. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39402-7_14 · Cited by 137
Low-latency event-based visual odometry
Censi, A., & Scaramuzza, D. (2014) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2014.6906931 · Cited by 132
Self-citationReal-time panoramic tracking for event cameras
Reinbacher, C., Munda, G., & Pock, T. (2017) · IEEE International Conference on Computational Photography (ICCP) · doi:10.1109/iccphot.2017.7951488 · Cited by 78
Real-Time Intensity-Image Reconstruction for Event Cameras Using Manifold Regularisation
Reinbacher, C., Graber, G., & Pock, T. (2016) · British Machine Vision Conference (BMVC) · doi:10.5244/c.30.9 · Cited by 65
Cited by
Gallego, G., Delbruck, T., Orchard, G., Bartolozzi, C., Taba, B., Censi, A., Leutenegger, S., Davison, A. J., Conradt, J., Daniilidis, K., et al. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3008413 · Cited by 2,566
Self-citationDeep Learning With Spiking Neurons: Opportunities and Challenges
Pfeiffer, M., & Pfeil, T. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00774 · Cited by 766
Computer Vision for Autonomous Vehicles: Problems, Datasets and State of the Art
Janai, J., Güney, F., Behl, A., & Geiger, A. (2020) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000079 · Cited by 643
Gallego, G., Delbrück, T., Orchard, G., Bartolozzi, C., Taba, B., Censi, A., Leutenegger, S., Davison, A. J., Conradt, J., Daniilidis, K., et al. (2020) · Zurich Open Repository and Archive (University of Zurich) · doi:10.3929/ethz-b-000521357 · Cited by 591
Self-citationEvents-To-Video: Bringing Modern Computer Vision to Event Cameras
Rebecq, H., Ranftl, R., Koltun, V., & Scaramuzza, D. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00398 · Cited by 420
Self-citation
Metadata
- Authors
- Vidal, A. R., Rebecq, H., Horstschaefer, T., & Scaramuzza, D.
- Venue
- IEEE Robotics and Automation Letters
- Published
- 2018-04
- Volume
- 3
- Issue
- 2
- Pages
- 994-1001
- ISSN
- 2377-3766 (ISSN-L)
- 2377-3774
- OpenAlex
- W2783185291
- Cited by
- 541
- References
- 26
- FWCI
- 37.23
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.