Event-Based Visual Flow
The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
This paper introduces a new methodology to compute dense visual flow using the precise timings of spikes from an asynchronous event-based retina. Biological retinas, and their artificial counterparts, are totally asynchronous and data-driven and rely on a paradigm of light acquisition radically different from most of the currently used frame-grabber technologies. This paper introduces a framework to estimate visual flow from the local properties of events' spatiotemporal space. We will show that precise visual flow orientation and amplitude can be estimated using a local differential approach on the surface defined by coactive events. Experimental results are presented; they show the method adequacy with high data sparseness and temporal resolution of event-based acquisition that allows the computation of motion flow with microsecond accuracy and at very low computational cost.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1981) · Cited by 11,963
Horn, B. K. P., & Schunck, B. G. (1981) · Artificial Intelligence · doi:10.1016/0004-3702(81)90024-2 · Cited by 10,312
Shi, J., & Tomasi (1994) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition CVPR-94 · doi:10.1109/cvpr.1994.323794 · Cited by 7,724 · cited 1×
“It relies on a preprocessing of incoming images to select features [34] on which the motion visual motion flow is then estimated.”
MethodHorn, B. K., & Schunck, B. G. (1981) · SPIE Proceedings · doi:10.1117/12.965761 · Cited by 7,394
Performance of optical flow techniques
Barron, J. L., Fleet, D. J., & Beauchemin, S. S. (1994) · International Journal of Computer Vision · doi:10.1007/bf01420984 · Cited by 4,305 · cited 1×
“It is usually computed sparsely on high salient points.”
BackgroundA 128$\times$128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision Sensor
Lichtsteiner, P., Posch, C., & Delbruck, T. (2008) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2007.914337 · Cited by 2,485
Determination of displacements using an improved digital correlation method
Sutton, M., Wolters, W., Peters, W., Ranson, W., & McNeill, Sr. (1983) · Image and Vision Computing · doi:10.1016/0262-8856(83)90064-1 · Cited by 1,927
A computational framework and an algorithm for the measurement of visual motion
Anandan, P. (1989) · International Journal of Computer Vision · doi:10.1007/bf00158167 · Cited by 1,073
Bialek, W., Rieke, F., de Ruyter van Steveninck, R. R., & Warland, D. (1991) · Science · doi:10.1126/science.2063199 · Cited by 992
Posch, C., Matolin, D., & Wohlgenannt, R. (2011) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2010.2085952 · Cited by 793
Cited by
Gallego, G., Delbruck, T., Orchard, G., Bartolozzi, C., Taba, B., Censi, A., Leutenegger, S., Davison, A. J., Conradt, J., Daniilidis, K., et al. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3008413 · Cited by 2,566
Self-citationA 240 × 180 130 dB 3 µs Latency Global Shutter Spatiotemporal Vision Sensor
Brandli, C., Berner, R., Yang, M., Liu, S.-C., & Delbruck, T. (2014) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2014.2342715 · Cited by 1,144
Deep Learning With Spiking Neurons: Opportunities and Challenges
Pfeiffer, M., & Pfeil, T. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00774 · Cited by 766
Mueggler, E., Rebecq, H., Gallego, G., Delbruck, T., & Scaramuzza, D. (2017) · The International Journal of Robotics Research · doi:10.1177/0278364917691115 · Cited by 606
Gallego, G., Delbrück, T., Orchard, G., Bartolozzi, C., Taba, B., Censi, A., Leutenegger, S., Davison, A. J., Conradt, J., Daniilidis, K., et al. (2020) · Zurich Open Repository and Archive (University of Zurich) · doi:10.3929/ethz-b-000521357 · Cited by 591
Self-citationUnsupervised Event-Based Learning of Optical Flow, Depth, and Egomotion
Zhu, A. Z., Yuan, L., Chaney, K., & Daniilidis, K. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00108 · Cited by 571
EV-FlowNet: Self-Supervised Optical Flow Estimation for Event-based Cameras
Zhu, A., Yuan, L., Chaney, K., & Daniilidis, K. (2018) · Robotics: Science and Systems XIV · doi:10.15607/rss.2018.xiv.062 · Cited by 470
Events-To-Video: Bringing Modern Computer Vision to Event Cameras
Rebecq, H., Ranftl, R., Koltun, V., & Scaramuzza, D. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00398 · Cited by 420
End-to-End Learning of Representations for Asynchronous Event-Based Data
Gehrig, D., Loquercio, A., Derpanis, K., & Scaramuzza, D. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00573 · Cited by 386
Fast Optical Flow Using Dense Inverse Search
Kroeger, T., Timofte, R., Dai, D., & Van Gool, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_29 · Cited by 351
Gallego, G., Rebecq, H., & Scaramuzza, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00407 · Cited by 341
Chen, G., Cao, H., Conradt, J., Tang, H., Rohrbein, F., & Knoll, A. (2020) · IEEE Signal Processing Magazine · doi:10.1109/msp.2020.2985815 · Cited by 304
Simultaneous Optical Flow and Intensity Estimation from an Event Camera
Bardow, P., Davison, A. J., & Leutenegger, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.102 · Cited by 295
EMVS: Event-Based Multi-View Stereo—3D Reconstruction with an Event Camera in Real-Time
Rebecq, H., Gallego, G., Mueggler, E., & Scaramuzza, D. (2018) · International Journal of Computer Vision · doi:10.1007/s11263-017-1050-6 · Cited by 278
Gallego, G., Rebecq, H., & Scaramuzza, D. (2018) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-176051 · Cited by 271
Exploring Neuromorphic Computing Based on Spiking Neural Networks: Algorithms to Hardware
Rathi, N., Chakraborty, I., Kosta, A., Sengupta, A., Ankit, A., Panda, P., & Roy, K. (2023) · ACM Computing Surveys · doi:10.1145/3571155 · Cited by 267
Event-based, 6-DOF pose tracking for high-speed maneuvers
Mueggler, E., Huber, B., & Scaramuzza, D. (2014) · 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2014.6942940 · Cited by 258
Real-Time Intensity-Image Reconstruction for Event Cameras Using Manifold Regularisation
Munda, G., Reinbacher, C., & Pock, T. (2018) · International Journal of Computer Vision · doi:10.1007/s11263-018-1106-2 · Cited by 181
Direct face detection and video reconstruction from event cameras
Miyatani, Y., Barua, S., & Veeraraghavan, A. (2016) · 2016 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2016.7477561 · Cited by 133
Event-driven Re-Id: A New Benchmark and Method Towards Privacy-Preserving Person Re-Identification
Ahmad, S., Scarpellini, G., Morerio, P., & Bue, A. D. (2022) · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw54805.2022.00052 · Cited by 54
Continuous-Time Trajectory Estimation for Event-based Vision Sensors
Mueggler, E., Gallego, G., & Scaramuzza, D. (2015) · Robotics: Science and Systems XI · doi:10.15607/rss.2015.xi.036 · Cited by 49
High Speed and High Dynamic Range Video with an Event Camera
Rebecq, H., Ranftl, R., Koltun, V., & Scaramuzza, D. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2963386 · Cited by 50
“of algorithms have been specifically tailored to leverage event data, either processing the event stream in an eventby-event fashion [7], [8], [9], [10], [11], [12], or by building”
Method
Metadata
- Authors
- Benosman, R., Clercq, C., Lagorce, X., Ieng, S.-H., & Bartolozzi, C.
- Venue
- IEEE Transactions on Neural Networks and Learning Systems
- Published
- 2014-02
- Volume
- 25
- Issue
- 2
- Pages
- 407-417
- ISSN
- 2162-237X (ISSN-L)
- 2162-2388
- OpenAlex
- W1975697167
- Cited by
- 419
- References
- 33
- FWCI
- 17.84
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.