The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Continuous-Time Visual-Inertial Odometry for Event Cameras
Open accessAbstract
Event cameras are bioinspired vision sensors that output pixel-level brightness changes instead of standard intensity frames. They offer significant advantages over standard cameras, namely a very high dynamic range, no motion blur, and a latency in the order of microseconds. However, due to the fundamentally different structure of the sensor's output, new algorithms that exploit the high temporal resolution and the asynchronous nature of the sensor are required. Recent work has shown that a continuous-time representation of the event camera pose can deal with the high temporal resolution and asynchronous nature of this sensor in a principled way. In this paper, we leverage such a continuous-time representation to perform visual-inertial odometry with an event camera. This representation allows direct integration of the asynchronous events with microsecond accuracy and the inertial measurements at high frequency. The event camera trajectory is approximated by a smooth curve in the space of rigid-body motions using cubic splines. This formulation significantly reduces the number of variables in trajectory estimation problems. We evaluate our method on real data from several scenes and compare the results against ground truth from a motion-capture system. We show that our method provides improved accuracy over the result of a state-of-the-art visual odometry method for event cameras. We also show that both the map orientation and scale can be recovered accurately by fusing events and inertial data. To the best of our knowledge, this is the first work on visual-inertial fusion with event cameras using a continuous-time framework.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Combined Corner and Edge Detector
Harris, C., & Stephens, M. (1988) · Procedings of the Alvey Vision Conference 1988 · doi:10.5244/c.2.23 · Cited by 12,901 · cited 1×
“These methods operate by processing small groups of events from which features (such as Harris [29] or FAST [30], [31]) can be tracked and fed into standard geometric VIO algorithms (MSCKF [32], OKVIS [33], optimization with preintegrated IMU factors [34]).”
MethodMachine Learning for High-Speed Corner Detection
Rosten, E., & Drummond, T. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_34 · Cited by 4,555
A 128$\times$128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision Sensor
Lichtsteiner, P., Posch, C., & Delbruck, T. (2008) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2007.914337 · Cited by 2,485
A Multi-State Constraint Kalman Filter for Vision-aided Inertial Navigation
Mourikis, A. I., & Roumeliotis, S. I. (2007) · Proceedings 2007 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2007.364024 · Cited by 1,951
On-Manifold Preintegration for Real-Time Visual--Inertial Odometry
Forster, C., Carlone, L., Dellaert, F., & Scaramuzza, D. (2017) · IEEE Transactions on Robotics · doi:10.1109/tro.2016.2597321 · Cited by 1,502 · cited 1×
“These methods operate by processing small groups of events from which features (such as Harris [29] or FAST [30], [31]) can be tracked and fed into standard geometric VIO algorithms (MSCKF [32], OKVIS [33], optimization with preintegrated IMU factors [34]).”
MethodSelf-citationA Spline-Based Trajectory Representation for Sensor Fusion and Rolling Shutter Cameras
Patron-Perez, A., Lovegrove, S., & Sibley, G. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0811-3 · Cited by 104 · cited 9×
“has been applied to camera-IMU fusion [5], [7], rolling-shutter cameras [5], actuated lidar [9], and RGB-D rolling-shutter cameras [10].”
BackgroundMethodInfluentialA hybrid SLAM representation for dynamic marine environments
Bibby, C., & Reid, I. (2010) · 2010 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2010.5509262 · Cited by 53 · cited 2×
“The continuous-time framework was also motivated to allow data fusion of multiple sensors working at different rates and to enable increased temporal resolution [6].”
BackgroundContinuous-Time Trajectory Estimation for Event-based Vision Sensors
Mueggler, E., Gallego, G., & Scaramuzza, D. (2015) · Robotics: Science and Systems XI · doi:10.15607/rss.2015.xi.036 · Cited by 49
Self-citationA hierarchical wavelet decomposition for continuous-time SLAM
Anderson, S., Dellaert, F., & Barfoot, T. D. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6906884 · Cited by 44
Cited by
Gallego, G., Delbruck, T., Orchard, G., Bartolozzi, C., Taba, B., Censi, A., Leutenegger, S., Davison, A. J., Conradt, J., Daniilidis, K., et al. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3008413 · Cited by 2,566
Self-citationGallego, G., Delbrück, T., Orchard, G., Bartolozzi, C., Taba, B., Censi, A., Leutenegger, S., Davison, A. J., Conradt, J., Daniilidis, K., et al. (2020) · Zurich Open Repository and Archive (University of Zurich) · doi:10.3929/ethz-b-000521357 · Cited by 591
Self-citationPast, Present, and Future of Aerial Robotic Manipulators
Ollero, A., Tognon, M., Suarez, A., Lee, D., & Franchi, A. (2022) · IEEE Transactions on Robotics · doi:10.1109/tro.2021.3084395 · Cited by 498
Visual-Inertial Navigation: A Concise Review
Huang, G. (2019) · 2019 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2019.8793604 · Cited by 391
Metadata
- Authors
- Mueggler, E., Gallego, G., Rebecq, H., & Scaramuzza, D.
- Venue
- IEEE Transactions on Robotics
- Published
- 2018-12
- Volume
- 34
- Issue
- 6
- Pages
- 1425-1440
- ISSN
- 1552-3098 (ISSN-L)
- 1941-0468
- OpenAlex
- W2950380208
- Cited by
- 193
- References
- 9
- FWCI
- 9.31
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.