The DOI matches its Crossref record, with a small difference in title or year; 230 of the 232 references it cites were found in a registry or an index.
Event-Based Vision: A Survey
Open accessAbstract
Event cameras are bio-inspired sensors that differ from conventional frame cameras: Instead of capturing images at a fixed rate, they asynchronously measure per-pixel brightness changes, and output a stream of events that encode the time, location and sign of the brightness changes. Event cameras offer attractive properties compared to traditional cameras: high temporal resolution (in the order of μs), very high dynamic range (140 dB versus 60 dB), low power consumption, and high pixel bandwidth (on the order of kHz) resulting in reduced motion blur. Hence, event cameras have a large potential for robotics and computer vision in challenging scenarios for traditional cameras, such as low-latency, high speed, and high dynamic range. However, novel methods are required to process the unconventional output of these sensors in order to unlock their potential. This paper provides a comprehensive overview of the emerging field of event-based vision, with a focus on the applications and the algorithms developed to unlock the outstanding properties of event cameras. We present event cameras from their working principle, the actual sensors that are available and the tasks that they have been used for, from low-level vision (feature detection and tracking, optic flow, etc.) to high-level vision (reconstruction, segmentation, recognition). We also discuss the techniques developed to process events, including learning-based techniques, as well as specialized processors for these novel sensors, such as spiking neural networks. Additionally, we highlight the challenges that remain to be tackled and the opportunities that lie ahead in the search for a more efficient, bio-inspired way for machines to perceive and interact with the world.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“new computer vision algorithms are needed to process the unconventional output of neuromorphic sensors to unlock their potential (Gallego et al., 2022; Sanchez-Garcia et al., 2022).”
From Towards a Smart Bionic Eye : AI-powered artificial vision for the treatment of incurable blindness (2022) · cites this paper as Gallego et al., 2022
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Items 201–230 of 230
Event-driven embodied system for feature extraction and object recognition in robotic applications
Wiesmann, G., Schraml, S., Litzenberger, M., Belbachir, A. N., Hofstätter, M., & Bartolozzi, C. (2012) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2012.6238898 · Cited by 26
Self-citationComparison of Periodic and Event-Based Sampling for Linear State Estimation
Wang, B., & Fu, M. (2014) · IFAC Proceedings Volumes · doi:10.3182/20140824-6-za-1003.00247 · Cited by 24
Cooperative SLAM on small mobile robots
Waniek, N., Biedermann, J., & Conradt, J. (2015) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio.2015.7419035 · Cited by 24
Self-citationContext-aware event-driven stereo matching
Zou, D., Guo, P. Y., Wang, Q., Wang, X., Shao, G., Shi, F., Li, J., & Park, P.-K. J. (2016) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2016.7532523 · Cited by 24
A Novel HDR Depth Camera for Real-Time 3D 360° Panoramic Vision
Belbachir, A. N., Schraml, S., Mayerhofer, M., & Hofstätter, M. (2014) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2014.69 · Cited by 23
Kogler, J., Eibensteiner, F., Humenberger, M., Sulzbachner, C., Gelautz, M., & Scharinger, J. (2014) · Journal of Electronic Imaging · doi:10.1117/1.jei.23.4.043011 · Cited by 21
Event-based stereo matching using semiglobal matching
Xie, Z., Zhang, J., & Wang, P. (2018) · International Journal of Advanced Robotic Systems · doi:10.1177/1729881417752759 · Cited by 21
A Review of Bioinspired Vision Sensors and Their Applications
Cho, D., & Lee, T.-J. (2015) · Sensors and Materials · doi:10.18494/sam.2015.1083 · Cited by 18
Cooperative and asynchronous stereo vision for dynamic vision sensors
Piatkowska, E., Belbachir, A. N., & Gelautz, M. (2014) · Measurement Science and Technology · doi:10.1088/0957-0233/25/5/055108 · Cited by 17
Modeling orientation selectivity using a neuromorphic multi-chip system
Chicca, E., Lichtsteiner, P., Delbrück, T., Indiveri, G., & Douglas, R. J. (2006) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2006.1692815 · Cited by 17
Robust Dense Depth Maps Generations from Sparse DVS Stereos
Zou, D., Shi, F., Liu, W., Li, J., Wang, Q., Park, P.-K. J., & Ryu, H. E. (2017) · British Machine Vision Conference (BMVC) · doi:10.5244/c.31.39 · Cited by 17
Spike time based unsupervised learning of receptive fields for event-driven vision
Akolkar, H., Panzeri, S., & Bartolozzi, C. (2015) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2015.7139786 · Cited by 16
Self-citationMueller, E., Censi, A., & Frazzoli, E. (2015) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2015.7402002 · Cited by 15
Self-citationClassification of Spatiotemporal Events Based on Random Forest
Li, H., Li, G., & Shi, L. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-49685-6_13 · Cited by 15
Stabilization of linear continuous-time systems using neuromorphic vision sensors
Singh, P., Yong, S. Z., Grégoire, J., Censi, A., & Frazzoli, E. (2016) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2016.7798722 · Cited by 15
Self-citationAccelerated frame-free time-encoded multi-step imaging
Orchard, G., Matolin, D., Lagorce, X., Benosman, R. B., & Posch, C. (2014) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2014.6865716 · Cited by 11
Self-citationCross-Modal Learning Filters for RGB-Neuromorphic Wormhole Learning
Zanardi, A., Aumiller, A. J., Zilly, J., Censi, A., & Frazzoli, E. (2019) · Robotics: Science and Systems · doi:10.15607/rss.2019.xv.045 · Cited by 11
Self-citationMilde, M. B., Neil, D., Aimar, A., Delbrück, T., & Indiveri, G. (2017) · Zurich Open Repository and Archive (University of Zurich) · doi:10.48550/arxiv.1711.04713 · Cited by 11
Efficient neuromorphic optomotor heading regulation
Censi, A. (2015) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.1109/acc.2015.7171931 · Cited by 10
Self-citationAn AER temporal contrast vision sensor
Lichtsteiner, P. (2006) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-a-005279479 · Cited by 10
Fun with Asynchronous Vision Sensors and Processing
Delbrück, T. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33863-2_52 · Cited by 9
Analysis of Encoding Degradation in Spiking Sensors Due to Spike Delay Variation
Yang, M., Liu, S., & Delbrück, T. (2016) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2016.2613503 · Cited by 9
Vergence control with a neuromorphic iCub
Vasco, V., Glover, A., Tirupachuri, Y., Solari, F., Chessa, M., & Bartolozzi, C. (2016) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/humanoids.2016.7803355 · Cited by 9
Self-citationNeuromorphic networks on the SpiNNaker platform
Haessig, G., Galluppi, F., Lagorce, X., & Benosman, R. B. (2019) · IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS) · doi:10.1109/aicas.2019.8771512 · Cited by 7
Efficient high speed signal estimation with neuromorphic vision sensors
Mueller, E., Censi, A., & Frazzoli, E. (2015) · International Conference on Event-based Control, Communication, and Signal Processing · doi:10.1109/ebccsp.2015.7300672 · Cited by 6
Self-citationATIS + SpiNNaker: a Fully Event-based Visual Tracking DemonstrationPreprint
Glover, A., Stokes, A. B., Furber, S. B., & Bartolozzi, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.01320 · Cited by 6
Self-citationDeep Neural Networks and Hardware Systems for Event-driven Data
Neil, D. (2017) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000168865 · Cited by 5
Bio-inspired optic flow detection using neuromorphic hardware
Richter, C., Röhrbein, F., & Conradt, J. (2014) · mediaTUM (Technical University of Munich) · doi:10.12751/nncn.bc2014.0032 · Cited by 4
Self-citationNozaki, Y., & Delbrück, T. (2018) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2018.2841205 · Cited by 3
CED: Color Event Camera Dataset
Scheerlinck, C., Rebecq, H., Stoffregen, T., Barnes, N. M., Mahony, R. E., & Scaramuzza, D. (2019) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00215
Self-citation
Flagged first, then by citations
2 of the 232 references couldn’t be matched to a known paper.
Research works printed but not linked: 7
- Delbruck, Neuromorphic vision sensing and processing, 7
- Lichtsteiner, 64 x 64 event-driven logarithmic temporal derivative silicon retina, 157
- Delbruck, V2E: From video frames to realistic DVS event camera streams, arXiv:2006.07722v1 · arXiv
- Berner, A 240x180 10mw 12$\mu$μs latency sparse-output vision sensor for mobile applications, C186
- Binas, DDD17: End-to-end DAVIS driving dataset, 1
- Szeliski, 2010, Computer Vision: Algorithms and Applications
- Kahneman, 2011, Thinking, Fast and Slow
Cited by
Sorted by citations
A Survey of Autonomous Driving: Common Practices and Emerging Technologies
Yurtsever, E., Lambert, J., Carballo, A., & Takeda, K. (2020) · IEEE Access · doi:10.1109/access.2020.2983149 · Cited by 1,889
Training Spiking Neural Networks Using Lessons From Deep Learning
Eshraghian, J. K., Ward, M., Neftci, E., Wang, X., Lenz, G., Dwivedi, G., Bennamoun, M., Jeong, D. S., & Lu, W. D. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2023.3308088 · Cited by 1,106
Advancing Neuromorphic Computing With Loihi: A Survey of Results and Outlook
Davies, M., Wild, A., Orchard, G., Sandamirskaya, Y., Guerra, G. A. F., Joshi, P., Plank, P., & Risbud, S. R. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3067593 · Cited by 767
Self-citationPerception and sensing for autonomous vehicles under adverse weather conditions: A survey
Zhang, Y., Carballo, A., Yang, H., & Takeda, K. (2023) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2022.12.021 · Cited by 715
DSEC: A Stereo Event Camera Dataset for Driving Scenarios
Gehrig, M., Aarents, W., Gehrig, D., & Scaramuzza, D. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3068942 · Cited by 493
Self-citation
Metadata
- Authors
- Gallego, G., Delbruck, T., Orchard, G., Bartolozzi, C., Taba, B., Censi, A., Leutenegger, S., Davison, A. J., Conradt, J., Daniilidis, K., & Scaramuzza, D.
- Affiliations
- Einstein Center Digital Future (DE)
- Intel (United States) (US)
- Italian Institute of Technology (IT)
- IBM (United States) (US)
- ETH Zurich (CH)
- Imperial College London (GB)
- University of Pennsylvania (US)
- University of Zurich (CH)
- ORCID
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2022-01-01
- Volume
- 44
- Issue
- 1
- Pages
- 154-180
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W3040838455
- Cited by
- 2,566
- References
- 232
- Citations by year
- 2026: 553 · 2025: 648 · 2024: 510 · 2023: 363 · 2022: 258
- FWCI
- 17.31
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion, cc-by)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion, cc-by-nc-nd)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion, other-oa)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion, cc-by)
- arXiv (Cornell University)
- Funders
- SNSF-ERC
- Swiss National Science Foundation
- National Center of Competence in Research Robotics
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Vision and Imaging
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Physical Sciences › Engineering › Electrical and Electronic Engineering › CCD and CMOS Imaging Sensors
- Keywords
- event cameras, event-based vision, bio-inspired sensors, high dynamic range, high temporal resolution, event processing, optical flow, 3D reconstruction, image segmentation, object recognition, spiking neural networks, low-power vision, robot vision
- MeSH terms
- Algorithms, Robotics, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
