The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Mapping from Frame-Driven to Frame-Free Event-Driven Vision Systems by Low-Rate Rate Coding and Coincidence Processing--Application to Feedforward ConvNets
Open accessAbstract
Event-driven visual sensors have attracted interest from a number of different research communities. They provide visual information in quite a different way from conventional video systems consisting of sequences of still images rendered at a given "frame rate." Event-driven vision sensors take inspiration from biology. Each pixel sends out an event (spike) when it senses something meaningful is happening, without any notion of a frame. A special type of event-driven sensor is the so-called dynamic vision sensor (DVS) where each pixel computes relative changes of light or "temporal contrast." The sensor output consists of a continuous flow of pixel events that represent the moving objects in the scene. Pixel events become available with microsecond delays with respect to "reality." These events can be processed "as they flow" by a cascade of event (convolution) processors. As a result, input and output event flows are practically coincident in time, and objects can be recognized as soon as the sensor provides enough meaningful events. In this paper, we present a methodology for mapping from a properly trained neural network in a conventional frame-driven representation to an event-driven representation. The method is illustrated by studying event-driven convolutional neural networks (ConvNet) trained to recognize rotating human silhouettes or high speed poker card symbols. The event-driven ConvNet is fed with recordings obtained from a real DVS camera. The event-driven ConvNet is simulated with a dedicated event-driven simulator and consists of a number of event-driven processing modules, the characteristics of which are obtained from individually manufactured hardware modules.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Backpropagation Applied to Handwritten Zip Code Recognition
LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.4.541 · Cited by 11,891
Spiking Neuron Models: Single Neurons, Populations, Plasticity
Gerstner, W., & Kistler, W. M. (2002) · Cambridge University Press eBooks · doi:10.1017/cbo9780511815706 · Cited by 3,080
A 128$\times$128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision Sensor
Lichtsteiner, P., Posch, C., & Delbruck, T. (2008) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2007.914337 · Cited by 2,485
Spiking Neuron Models: Single Neurons, Populations, Plasticity
Wulfram Gerstner, B., & Kistler, W. M. (2002) · Cited by 2,028
Error-backpropagation in temporally encoded networks of spiking neurons
Bohte, S. M., Kok, J. N., & La Poutré, H. (2002) · Neurocomputing · doi:10.1016/s0925-2312(01)00658-0 · Cited by 1,021
Overview of the SpiNNaker System Architecture
Furber, S. B., Lester, D. R., Plana, L. A., Garside, J. D., Painkras, E., Temple, S., & Brown, A. D. (2013) · IEEE Transactions on Computers · doi:10.1109/tc.2012.142 · Cited by 645
Ponulak, F., & Kasiński, A. (2010) · Neural Computation · doi:10.1162/neco.2009.11-08-901 · Cited by 573
Convolutional face finder: a neural architecture for fast and robust face detection
Garcia, C., & Delakis, M. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.97 · Cited by 547
SpiNNaker: A 1-W 18-Core System-on-Chip for Massively-Parallel Neural Network Simulation
Painkras, E., Plana, L. A., Garside, J., Temple, S., Galluppi, F., Patterson, C., Lester, D. R., Brown, A. D., & Furber, S. B. (2013) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2013.2259038 · Cited by 530
NeuFlow: A runtime reconfigurable dataflow processor for vision
Farabet, C., Martini, B., Corda, B., Akselrod, P., Culurciello, E., & LeCun, Y. (2011) · CVPR 2011 WORKSHOPS · doi:10.1109/cvprw.2011.5981829 · Cited by 369
A biomorphic digital image sensor
Culurciello, E., Etienne-Cummings, R., & Boahen, K. A. (2003) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2002.807412 · Cited by 367
Competitive STDP-Based Spike Pattern Learning
Masquelier, T., Guyonneau, R., & Thorpe, S. J. (2009) · Neural Computation · doi:10.1162/neco.2008.06-08-804 · Cited by 340
Serrano-Gotarredona, T., & Linares-Barranco, B. (2013) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2012.2230553 · Cited by 334
Self-citationSerrano-Gotarredona, R., Oster, M., Lichtsteiner, P., Linares-Barranco, A., Paz-Vicente, R., Gomez-Rodriguez, F., Camunas-Mesa, L., Berner, R., Rivas-Perez, M., Delbruck, T., et al. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2009.2023653 · Cited by 325
Self-citationA 128 X 128 120db 30mw asynchronous vision sensor that responds to relative intensity change
Lichtsteiner, P., Posch, C., & Delbruck, T. (2006) · 2006 IEEE International Solid State Circuits Conference - Digest of Technical Papers · doi:10.1109/isscc.2006.1696265 · Cited by 311
Original approach for the localisation of objects in images
Vaillant, R. (1994) · IEE Proceedings - Vision, Image, and Signal Processing · doi:10.1049/ip-vis:19941301 · Cited by 280
Large-scale privacy protection in Google Street View
Frome, A., Cheung, G., Abdulkader, A., Zennaro, M., Wu, B., Bissacco, A., Adam, H., Neven, H., & Vincent, L. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459413 · Cited by 244
Hardware accelerated convolutional neural networks for synthetic vision systems
Farabet, C., Martini, B., Akselrod, P., Talay, S., LeCun, Y., & Culurciello, E. (2010) · Proceedings of 2010 IEEE International Symposium on Circuits and Systems · doi:10.1109/iscas.2010.5537908 · Cited by 231
Synergistic Face Detection and Pose Estimation with Energy-Based Models
Osadchy, M., Le Cun, Y., & Miller, M. L. (2006) · Lecture Notes in Computer Science · doi:10.1007/11957959_10 · Cited by 209
A 3.6 $\mu$s Latency Asynchronous Frame-Free Event-Driven Dynamic-Vision-Sensor
Lenero-Bardallo, J. A., Serrano-Gotarredona, T., & Linares-Barranco, B. (2011) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2011.2118490 · Cited by 202
Self-citationFast sensory motor control based on event-based hybrid neuromorphic-procedural system
Delbrück, T., & Lichtsteiner, P. (2007) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2007.378038 · Cited by 138
Chicca, E., Whatley, A., Lichtsteiner, P., Dante, V., Delbrück, T., Giudice, P. D., Douglas, R. J., & Indiveri, G. (2007) · IEEE Transactions on Circuits and Systems I Fundamental Theory and Applications · doi:10.1109/tcsi.2007.893509 · Cited by 134
Optic Nerve Signals in a Neuromorphic Chip I: Outer and Inner Retina Models
Zaghloul, K. A., & Boahen, K. A. (2004) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2003.821039 · Cited by 131
Posch, C., Matolin, D., & Wohlgenannt, R. (2010) · Digest of technical papers/Digest of technical papers - IEEE International Solid-State Circuits Conference · doi:10.1109/isscc.2010.5433973 · Cited by 119
An Event-Driven Multi-Kernel Convolution Processor Module for Event-Driven Vision Sensors
Camuñas-Mesa, L. A., Zamarreño-Ramos, C., Linares-Barranco, A., Acosta, A. J., Serrano‐Gotarredona, T., & Linares-Barranco, B. (2011) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2011.2167409 · Cited by 116
Self-citationA Spatial Contrast Retina With On-Chip Calibration for Neuromorphic Spike-Based AER Vision Systems
Costas-Santos, J., Serrano‐Gotarredona, T., Serrano-Gotarredona, R., & Linares-Barranco, B. (2007) · IEEE Transactions on Circuits and Systems I Fundamental Theory and Applications · doi:10.1109/tcsi.2007.900179 · Cited by 113
Self-citationOptic Nerve Signals in a Neuromorphic Chip II: Testing and Results
Zaghloul, K. A., & Boahen, K. A. (2004) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2003.821040 · Cited by 112
Zamarreño-Ramos, C., Linares-Barranco, A., Serrano‐Gotarredona, T., & Linares-Barranco, B. (2012) · IEEE Transactions on Biomedical Circuits and Systems · doi:10.1109/tbcas.2012.2195725 · Cited by 107
Self-citationNeurotech for Neuroscience: Unifying Concepts, Organizing Principles, and Emerging Tools
Silver, R., Boahen, K. A., Grillner, S. E., Kopell, N., & Olsen, K. L. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.3575-07.2007 · Cited by 106
Farabet, C., Paz, R., Pérez‐Carrasco, J. A., Zamarreño-Ramos, C., Linares-Barranco, A., LeCun, Y., Culurciello, E., Serrano‐Gotarredona, T., & Linares-Barranco, B. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00032 · Cited by 74
Self-citationFace Detection Using GPU-Based Convolutional Neural Networks
Nasse, F., Thurau, C., & Fink, G. A. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-03767-2_10 · Cited by 71
An integrated optical transient sensor
Kramer, J. (2002) · IEEE Transactions on Circuits and Systems II Analog and Digital Signal Processing · doi:10.1109/tcsii.2002.807270 · Cited by 65
Camuñas-Mesa, L. A., Acosta, A. J., Zamarreño-Ramos, C., Serrano‐Gotarredona, T., & Linares-Barranco, B. (2010) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2010.2078851 · Cited by 56
Self-citationScalable event routing in hierarchical neural array architecture with global synaptic connectivity
Joshi, S., Deiss, S., Arnold, M., Park, J., Yu, T., & Cauwenberghs, G. (2010) · International Workshop on Cellular Nanoscale Networks and their Applications (CNNA) · doi:10.1109/cnna.2010.5430296 · Cited by 43
Lenero-Bardallo, J. A., Serrano‐Gotarredona, T., & Linares-Barranco, B. (2010) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2010.2046971 · Cited by 41
Self-citationA foveated AER imager chip [address event representation]
Azadmehr, M., Abrahamsen, J. P., & Hafliger, P. D. (2005) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2005.1465196 · Cited by 33
On the AER convolution processors for FPGA
Linares-Barranco, A., Paz-Vicente, R., Gómez-Rodríguez, F., Jimenez, A., Rivas, M., Jiménez, G., & Civit, A. (2010) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2010.5537577 · Cited by 26
Zamarreño-Ramos, C., Serrano‐Gotarredona, T., & Linares-Barranco, B. (2011) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2011.2151070 · Cited by 18
Self-citationOptimally combining a cascade of classifiers
Chellapilla, K., Shilman, M., & Simard, P. (2006) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.643669 · Cited by 17
Zamarreño-Ramos, C., Serrano‐Gotarredona, T., & Linares-Barranco, B. (2012) · IEEE Transactions on Biomedical Circuits and Systems · doi:10.1109/tbcas.2012.2186136 · Cited by 14
Self-citationOn scalable spiking convnet hardware for cortex-like visual sensory processing systems
Camuñas-Mesa, L. A., Pérez‐Carrasco, J. A., Zamarreño-Ramos, C., et al. (2010) · doi:10.1109/iscas.2010.5537918 · Cited by 9
Cited by
Gallego, G., Delbruck, T., Orchard, G., Bartolozzi, C., Taba, B., Censi, A., Leutenegger, S., Davison, A. J., Conradt, J., Daniilidis, K., et al. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3008413 · Cited by 2,566
Spatio-Temporal Backpropagation for Training High-Performance Spiking Neural Networks
Wu, Y., Deng, L., Li, G., Zhu, J., & Shi, L. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00331 · Cited by 1,196
Rueckauer, B., Lungu, I.-A., Hu, Y., Pfeiffer, M., & Liu, S.-C. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00682 · Cited by 1,072
Fast-classifying, high-accuracy spiking deep networks through weight and threshold balancing
Diehl, P. U., Neil, D., Binas, J., Cook, M., Liu, S.-C., & Pfeiffer, M. (2015) · 2015 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2015.7280696 · Cited by 991
Training Spiking Neural Networks Using Lessons From Deep Learning
Eshraghian, J. K., Ward, M., Neftci, E. O., Wang, X., Lenz, G., Dwivedi, G., Bennamoun, M., Jeong, D. S., & Lu, W. D. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2023.3308088 · Cited by 782
Metadata
- Authors
- Perez-Carrasco, J. A., Zhao, B., Serrano, C., Acha, B., Serrano-Gotarredona, T., Chen, S., & Linares-Barranco, B.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2013-11
- Volume
- 35
- Issue
- 11
- Pages
- 2706-2719
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W1963689209
- Cited by
- 324
- References
- 42
- FWCI
- 9.59
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.