The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
HFirst: A Temporal Approach to Object Recognition
Open accessAbstract
This paper introduces a spiking hierarchical model for object recognition which utilizes the precise timing information inherently present in the output of biologically inspired asynchronous address event representation (AER) vision sensors. The asynchronous nature of these systems frees computation and communication from the rigid predetermined timing enforced by system clocks in conventional systems. Freedom from rigid timing constraints opens the possibility of using true timing to our advantage in computation. We show not only how timing can be used in object recognition, but also how it can in fact simplify computation. Specifically, we rely on a simple temporal-winner-take-all rather than more computationally intensive synchronous operations typically used in biologically inspired neural networks for object recognition. This approach to visual computation represents a major paradigm shift from conventional clocked systems and can find application in other sensory modalities and computational tasks. We showcase effectiveness of the approach by achieving the highest reported accuracy to date (97.5% ± 3.5%) for a previously published four class card pip recognition task and an accuracy of 84.9% ± 1.9% for a new more difficult 36 class character recognition task.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neural networks for pattern recognition
(1994) · Choice Reviews Online · doi:10.5860/choice.31-5500 · Cited by 18,538
Neural Networks for Pattern Recognition
Bishop, C. M. (1995) · doi:10.1093/oso/9780198538493.001.0001 · Cited by 12,287
A million spiking-neuron integrated circuit with a scalable communication network and interface
Merolla, P. A., Arthur, J. V., Alvarez-Icaza, R., Cassidy, A. S., Sawada, J., Akopyan, F., Jackson, B. L., Imam, N., Guo, C., Nakamura, Y., et al. (2014) · Science · doi:10.1126/science.1254642 · Cited by 4,147
Hierarchical models of object recognition in cortex
Riesenhuber, M., & Poggio, T. (1999) · Nature Neuroscience · doi:10.1038/14819 · Cited by 3,309
Which Model to Use for Cortical Spiking Neurons?
Izhikevich, E. M. (2004) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.832719 · Cited by 2,542
A 128$\times$128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision Sensor
Lichtsteiner, P., Posch, C., & Delbruck, T. (2008) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2007.914337 · Cited by 2,485
Self-citationWhat is the best multi-stage architecture for object recognition?
Jarrett, K., Kavukcuoglu, K., Ranzato, M. A., & LeCun, Y. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459469 · Cited by 2,153
Robust Object Recognition with Cortex-Like Mechanisms
Serre, T., Wolf, L., Bileschi, S., Riesenhuber, M., & Poggio, T. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.56 · Cited by 1,667
Practical neural network recipes in C
Masters, T. D. (1993) · Cited by 1,636
Neurogrid: A Mixed-Analog-Digital Multichip System for Large-Scale Neural Simulations
Benjamin, B. V., Gao, P., McQuinn, E., Choudhary, S., Chandrasekaran, A. R., Bussat, J.-M., Alvarez-Icaza, R., Arthur, J. V., Merolla, P. A., & Boahen, K. (2014) · Proceedings of the IEEE · doi:10.1109/jproc.2014.2313565 · Cited by 1,266
Image processing with neural networks—a review
Egmont-Petersen, M., de Ridder, D., & Handels, H. (2002) · Pattern Recognition · doi:10.1016/s0031-3203(01)00178-9 · Cited by 1,186
A feedforward architecture accounts for rapid categorization
Serre, T., Oliva, A., & Poggio, T. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0700622104 · Cited by 918
Posch, C., Matolin, D., & Wohlgenannt, R. (2011) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2010.2085952 · Cited by 793
Self-citationPyNN: a common interface for neuronal network simulators
Davison, A. P. (2008) · Frontiers in Neuroinformatics · doi:10.3389/neuro.11.011.2008 · Cited by 607
The Brain Activity Map Project and the Challenge of Functional Connectomics
Alivisatos, A. P., Chun, M., Church, G. M., Greenspan, R. J., Roukes, M. L., & Yuste, R. (2012) · Neuron · doi:10.1016/j.neuron.2012.06.006 · Cited by 558
Unsupervised Learning of Visual Features through Spike Timing Dependent Plasticity
Masquelier, T., & Thorpe, S. J. (2007) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0030031 · Cited by 548
Neural Engineering: Computation, Representation, and Dynamics in Neurobiological Systems
(2004) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.826381 · Cited by 543
SpiNNaker: A 1-W 18-Core System-on-Chip for Massively-Parallel Neural Network Simulation
Painkras, E., Plana, L. A., Garside, J., Temple, S., Galluppi, F., Patterson, C., Lester, D. R., Brown, A. D., & Furber, S. B. (2013) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2013.2259038 · Cited by 530
Brian: a simulator for spiking neural networks in Python
Goodman, D. (2008) · Frontiers in Neuroinformatics · doi:10.3389/neuro.11.005.2008 · Cited by 518
Neural engineering: Computation, representation, and dynamics in neurobiological systems
(2003) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(03)90181-7 · Cited by 399
A biomorphic digital image sensor
Culurciello, E., Etienne-Cummings, R., & Boahen, K. A. (2003) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2002.807412 · Cited by 367
Self-citationLiu, S.-C., & Delbruck, T. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.03.007 · Cited by 362
Latency: another potential code for feature binding in striate cortex
Gawne, T. J., Kjaer, T. W., & Richmond, B. J. (1996) · Journal of Neurophysiology · doi:10.1152/jn.1996.76.2.1356 · Cited by 357
Serrano-Gotarredona, T., & Linares-Barranco, B. (2013) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2012.2230553 · Cited by 334
Serrano-Gotarredona, R., Oster, M., Lichtsteiner, P., Linares-Barranco, A., Paz-Vicente, R., Gomez-Rodriguez, F., Camunas-Mesa, L., Berner, R., Rivas-Perez, M., Delbruck, T., et al. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2009.2023653 · Cited by 325
Perez-Carrasco, J. A., Zhao, B., Serrano, C., Acha, B., Serrano-Gotarredona, T., Chen, S., & Linares-Barranco, B. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.71 · Cited by 324
An Analog VLSI System for Stereoscopic Vision
Mahowald, M. (1994) · Springer eBooks · doi:10.1007/978-1-4615-2724-4 · Cited by 258
Shallow vs. Deep Sum-Product Networks
Delalleau, O., & Bengio, Y. (2011) · neural information processing systems · Cited by 254
Activity-driven, event-based vision sensors
Delbruck, T., Linares-Barranco, B., Culurciello, E., & Posch, C. (2010) · Proceedings of 2010 IEEE International Symposium on Circuits and Systems · doi:10.1109/iscas.2010.5537149 · Cited by 251
Self-citationHardware accelerated convolutional neural networks for synthetic vision systems
Farabet, C., Martini, B., Akselrod, P., Talay, S., LeCun, Y., & Culurciello, E. (2010) · Proceedings of 2010 IEEE International Symposium on Circuits and Systems · doi:10.1109/iscas.2010.5537908 · Cited by 231
Asynchronous frameless event-based optical flow
Benosman, R., Ieng, S.-H., Clercq, C., Bartolozzi, C., & Srinivasan, M. (2012) · Neural Networks · doi:10.1016/j.neunet.2011.11.001 · Cited by 228
Self-citationDynamically Reconfigurable Silicon Array of Spiking Neurons With Conductance-Based Synapses
Vogelstein, R. J., Mallik, U., Vogelstein, J. T., & Cauwenberghs, G. (2007) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2006.883007 · Cited by 220
Asynchronous Event-Based Binocular Stereo Matching
Rogister, P., Benosman, R., Ieng, S.-H., Lichtsteiner, P., & Delbruck, T. (2012) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2011.2180025 · Cited by 165
Self-citationIntroducing the Human Brain Project
Markram, H., Meier, K., Lippert, T., Grillner, S. E., Frackowiak, R. S. J., Dehaene, S., Knoll, A., Sompolinsky, H., Verstreken, K., DeFelipe, J., et al. (2011) · Procedia Computer Science · doi:10.1016/j.procs.2011.12.015 · Cited by 157
Fast sensory motor control based on event-based hybrid neuromorphic-procedural system
Delbrück, T., & Lichtsteiner, P. (2007) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2007.378038 · Cited by 138
Optic Nerve Signals in a Neuromorphic Chip I: Outer and Inner Retina Models
Zaghloul, K. A., & Boahen, K. A. (2004) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2003.821039 · Cited by 131
Probabilistic synaptic weighting in a reconfigurable network of VLSI integrate-and-fire neurons
Goldberg, D. H., Cauwenberghs, G., & Andreou, A. G. (2001) · Neural Networks · doi:10.1016/s0893-6080(01)00057-0 · Cited by 118
Poggio, T., & Serre, T. (2006) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 106
A Multichip Neuromorphic System for Spike-Based Visual Information Processing
Vogelstein, R. J., Mallik, U., Culurciello, E., Cauwenberghs, G., & Etienne‐Cummings, R. (2007) · Neural Computation · doi:10.1162/neco.2007.19.9.2281 · Cited by 75
Self-citationAsynchronous Event-Based Hebbian Epipolar Geometry
Benosman, R. B., Ieng, S.-H., Rogister, P., & Posch, C. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2011.2167239 · Cited by 58
Self-citationEfficient Feedforward Categorization of Objects and Human Postures with Address-Event Image Sensors
Chen, S., Akselrod, P., Zhao, B., Pérez‐Carrasco, J. A., Linares-Barranco, B., & Culurciello, E. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.120 · Cited by 55
Bioinspired Visual Motion Estimation
Orchard, G., & Etienne‐Cummings, R. (2014) · Proceedings of the IEEE · doi:10.1109/jproc.2014.2346763 · Cited by 42
Self-citationComplex Spike-Event Pattern of Transient on-off Retinal Ganglion Cells
Greschner, M., Thiel, A., Kretzberg, J., & Ammermüller, J. (2006) · Journal of Neurophysiology · doi:10.1152/jn.01131.2005 · Cited by 38
Fast Neuromimetic Object Recognition Using FPGA Outperforms GPU Implementations
Orchard, G., Martin, J. G., Vogelstein, R. J., & Etienne‐Cummings, R. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2253563 · Cited by 32
Self-citationA spatio-temporal clustering method using real-time motion analysis on event-based 3D vision
Schraml, S., & Belbachir, A. N. (2010) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2010.5543810 · Cited by 30
Park, J., Yu, T., Maier, C., Joshi, S., & Cauwenberghs, G. (2012) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2012.6272133 · Cited by 26
Folowosele, F. O., Vogelstein, R. J., & Etienne‐Cummings, R. (2011) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2012.2183409 · Cited by 22
Self-citation
Cited by
Gallego, G., Delbruck, T., Orchard, G., Bartolozzi, C., Taba, B., Censi, A., Leutenegger, S., Davison, A. J., Conradt, J., Daniilidis, K., et al. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3008413 · Cited by 2,566
Self-citationTowards spike-based machine intelligence with neuromorphic computing
Roy, K., Jaiswal, A., & Panda, P. (2019) · Nature · doi:10.1038/s41586-019-1677-2 · Cited by 2,190
Rueckauer, B., Lungu, I.-A., Hu, Y., Pfeiffer, M., & Liu, S.-C. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00682 · Cited by 1,072
Converting Static Image Datasets to Spiking Neuromorphic Datasets Using Saccades
Orchard, G., Jayawant, A., Cohen, G. K., & Thakor, N. (2015) · Frontiers in Neuroscience · doi:10.3389/fnins.2015.00437 · Cited by 882
Self-citationDeep Learning With Spiking Neurons: Opportunities and Challenges
Pfeiffer, M., & Pfeil, T. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00774 · Cited by 766
Metadata
- Authors
- Orchard, G., Meyer, C., Etienne-Cummings, R., Posch, C., Thakor, N., & Benosman, R.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2015-10-01
- Volume
- 37
- Issue
- 10
- Pages
- 2028-2040
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W2020096355
- Cited by
- 312
- References
- 47
- FWCI
- 9.46
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.