The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
All eyes, no IMU: learning flight attitude from vision alone
Abstract
Vision is an essential part of attitude control for many flying animals, some of which have no dedicated sense of gravity. Flying robots, on the other hand, typically depend heavily on accelerometers and gyroscopes for attitude stabilization. In this work, we present the first vision-only approach to flight control for use in generic environments. We show that a quadrotor drone equipped with a downward-facing event camera can estimate its attitude and rotation rate from just the event stream, enabling flight control without inertial sensors. Our approach uses a small recurrent convolutional neural network trained through supervised learning. Real-world flight tests demonstrate that our combination of event camera and low-latency neural network is capable of replacing the inertial measurement unit in a traditional flight control loop. Furthermore, we investigate the network’s generalization across different environments, and the impact of memory and different fields of view. While networks with memory and access to horizon-like visual cues achieve best performance, variants with a narrower field of view achieve better relative generalization. Our work showcases vision-only flight control as a promising candidate for enabling autonomous, insect-scale flying robots.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Robot Operating System 2: Design, architecture, and uses in the wild
Macenski, S., Foote, T., Gerkey, B., Lalancette, C., & Woodall, W. (2022) · Science Robotics · doi:10.1126/scirobotics.abm6074 · Cited by 1,585
Research works printed but not linked: 23
- Mahony, R., Hamel, T. & Pflimlin, J.-M. Nonlinear complementary filters on the special orthogonal group. IEEE Trans. Autom. Control 53, 1203–1218 (2008). · DOI · Paper page
- Taylor, G. K. & Krapp, H. G. Sensory systems and flight stability: what do insects measure and why? In Advances in Insect Physiology, vol. 34 of Insect Mechanics and Control, 231–316 (Academic Press, 2007). · DOI · Paper page
- Srinivasan, M. V., Moore, R. J. D., Thurrowgood, S., Soccol, D. & Bland, D. From biology to engineering: Insect vision and applications to robotics. In Frontiers in Sensing, 19–39 (Springer, 2012). · DOI
- de Croon, G. C. H. E. et al. Accommodating unobservability to control flight attitude with optic flow. Nature 610, 485–490 (2022). · DOI
- Yu, Z. et al. TinySense: a lighter weight and more power-efficient avionics system for flying insect-scale robots. In IEEE International Conference on Robotics and Automation (ICRA) (IEEE, 2025). · DOI
- Ettinger, S. M., Nechyba, M. C., Ifju, P. G. & Waszak, M. Vision-guided flight stability and control for micro air vehicles. Adv. Robot. 17, 617–640 (2003). · DOI
- Mondragón, I. F., Olivares-Méndez, M. A., Campoy, P., Martínez, C. & Mejias, L. Unmanned aerial vehicles UAVs attitude, height, motion estimation and control using visual systems. Autonomous Robots 29, 17–34 (2010). · DOI
- Bazin, J.-C., Kweon, I., Demonceaux, C. & Vasseur, P. UAV Attitude estimation by vanishing points in catadioptric images. In 2008 IEEE International Conference on Robotics and Automation, 2743–2749 (IEEE, 2008). · DOI
- Shabayek, A. E. R., Demonceaux, C., Morel, O. & Fofi, D. Vision based UAV attitude estimation: progress and insights. J. Intell. Robotic Syst. 65, 295–308 (2012). · DOI
- Gallego, G. et al. Event-based vision: a survey. In IEEE Transactions on Pattern Analysis and Machine Intelligence (IEEE, 2020).
- Gallego, G. & Scaramuzza, D. Accurate angular velocity estimation with an event camera. IEEE Robot. Autom. Lett. 2, 632–639 (2017). · DOI
- Gehrig, M., Shrestha, S. B., Mouritzen, D. & Scaramuzza, D. Event-based angular velocity regression with spiking networks. In 2020 IEEE International Conference on Robotics and Automation, 4195–4202 (IEEE, 2020). · DOI
- Greatorex, H., Mastella, M., Cotteret, M., Richter, O. & Chicca, E. Event-based vision for egomotion estimation using precise event timing. Preprint at https://arxiv.org/abs/2501.11554 (2025). · arXiv
- Da Costa, D. R., Vasseur, P. & Morbidi, F. Gyrevento: event-based omnidirectional visual gyroscope in a Manhattan world. In IEEE Robotics and Automation Letters 1–8 (IEEE, 2025). · DOI
- Geles, I., Bauersfeld, L., Romero, A., Xing, J. & Scaramuzza, D. Demonstrating agile flight from pixels without state estimation. In Robotics: Science and Systems XX, Vol. 20 (RSSF, 2024). · DOI
- Xing, J., Romero, A., Bauersfeld, L. & Scaramuzza, D. Bootstrapping Reinforcement Learning with Imitation for Vision-Based Agile Flight. In 8th Annual Conference on Robot Learning (PMLR, 2024).
- Romero, A., Shenai, A., Geles, I., Aljalbout, E. & Scaramuzza, D. Dream to Fly: Model-Based Reinforcement Learning for Vision-Based Drone Flight. Preprint at https://arxiv.org/abs/2501.14377 (2025). · arXiv
- Paredes-Vallés, F. et al. Fully neuromorphic vision and control for autonomous drone flight. Sci. Robot. 9, eadi0591 (2024). · DOI
- Stroobants, S., De Wagter, C. & de Croon, G. C. H. E. Neuromorphic attitude estimation and control. IEEE Robot. Autom. Lett. 10, 4858–4865 (2025). · DOI
- Mueggler, E., Rebecq, H., Gallego, G., Delbruck, T. & Scaramuzza, D. The event-camera dataset and simulator: event-based data for pose estimation, visual odometry, and SLAM. Int. J. Robot. Res. 36, 142–149 (2017). · DOI · Paper page
- Richter, O. et al. Speck: a smart event-based vision sensor with a low latency 327K neuron convolutional neuronal network processing pipeline. Preprint at https://arxiv.org/abs/2304.06793 (2024) · arXiv
- Gallego, G., Rebecq, H. & Scaramuzza, D. A Unifying Contrast Maximization Framework for Event Cameras, With Applications to Motion, Depth, and Optical Flow Estimation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 3867–3876 (IEEE, 2018). · DOI · Paper page
- Clevert, D.-A., Unterthiner, T. & Hochreiter, S. Fast and accurate deep network learning by exponential linear units (ELUs). In International Conference on Learning Representations 1511.07289 (ICLR, 2016).
Metadata
- Authors
- Hagenaars, J. J., Stroobants, S., Bohté, S. M., & de Croon, G. C. H. E.
- Venue
- npj Robotics
- Published
- 2026-03-17
- Volume
- 4
- Issue
- 1
- ISSN
- 2731-4278
- Cited by
- 1
- References
- 1
- Language
- en
- Licence
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Funders
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (NWA.1292.19.298)
- Air Force Office of Scientific Research (FA8655-20-1-7044)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
