The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Conversion of Continuous-Valued Deep Networks to Efficient Event-Driven Networks for Image Classification
Open accessAbstract
neural networks (SNNs) can potentially offer an efficient way of doing inference because the neurons in the networks are sparsely activated and computations are event-driven. Previous work showed that simple continuous-valued deep Convolutional Neural Networks (CNNs) can be converted into accurate spiking equivalents. These networks did not include certain common operations such as max-pooling, softmax, batch-normalization and Inception-modules. This paper presents spiking equivalents of these operations therefore allowing conversion of nearly arbitrary CNN architectures. We show conversion of popular CNN architectures, including VGG-16 and Inception-v3, into SNNs that produce the best results reported to date on MNIST, CIFAR-10 and the challenging ImageNet dataset. SNNs can trade off classification error rate against the number of available operations whereas deep continuous-valued neural networks require a fixed number of operations to achieve their classification error rate. From the examples of LeNet for MNIST and BinaryNet for CIFAR-10, we show that with an increase in error rate of a few percentage points, the SNNs can achieve more than 2x reductions in operations compared to the original CNNs. This highlights the potential of SNNs in particular when deployed on power-efficient neuromorphic spiking neuron chips, for use in embedded applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 4×
“…event-based benchmark datasets are rare (Hu et al., 2016; Rueckauer and Delbruck, 2016), conventional frame-based image databases such as MNIST (LeCun et al., 1998) or CIFAR (Krizhevsky, 2009) have been used to evaluate the classification error rate of the converted SNN. Previous methods (Cao…”
MethodInfluentialGoing deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
Advances in Neural Information Processing Systems 25
Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653
A million spiking-neuron integrated circuit with a scalable communication network and interface
Merolla, P. A., Arthur, J. V., Alvarez-Icaza, R., Cassidy, A. S., Sawada, J., Akopyan, F., Jackson, B. L., Imam, N., Guo, C., Nakamura, Y., et al. (2014) · Science · doi:10.1126/science.1254642 · Cited by 4,147
Eyeriss: An Energy-Efficient Reconfigurable Accelerator for Deep Convolutional Neural Networks
Chen, Y.-H., Krishna, T., Emer, J. S., & Sze, V. (2017) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2016.2616357 · Cited by 3,247
Advances in Neural Information Processing Systems 20
Bonilla, E. V., Chai, K. M. A., & Williams, C. K. I. (2008) · neural information processing systems · Cited by 2,846
Advances in Neural Information Processing Systems 27 (NIPS 2014)
Zhong, M., Goddard, N., & Sutton, C. A. (2014) · Cited by 2,636
BinaryConnect: Training Deep Neural Networks with binary weights during propagations
Courbariaux, M., Bengio, Y., & David, J.-P. (2015) · arXiv · doi:10.48550/arxiv.1511.00363 · Cited by 2,180
Courbariaux, M., Hubara, I., Soudry, D., El-Yaniv, R., & Bengio, Y. (2016) · arXiv · doi:10.48550/arxiv.1602.02830 · Cited by 2,106
1.1 Computing's energy problem (and what we can do about it)
Horowitz, M. (2014) · 2014 IEEE International Solid-State Circuits Conference Digest of Technical Papers (ISSCC) · doi:10.1109/isscc.2014.6757323 · Cited by 2,069
Furber, S. B., Galluppi, F., Temple, S., & Plana, L. A. (2014) · Proceedings of the IEEE · doi:10.1109/jproc.2014.2304638 · Cited by 1,350
Neurogrid: A Mixed-Analog-Digital Multichip System for Large-Scale Neural Simulations
Benjamin, B. V., Gao, P., McQuinn, E., Choudhary, S., Chandrasekaran, A. R., Bussat, J.-M., Alvarez-Icaza, R., Arthur, J. V., Merolla, P. A., & Boahen, K. (2014) · Proceedings of the IEEE · doi:10.1109/jproc.2014.2313565 · Cited by 1,266
Fast-classifying, high-accuracy spiking deep networks through weight and threshold balancing
Diehl, P. U., Neil, D., Binas, J., Cook, M., Liu, S.-C., & Pfeiffer, M. (2015) · 2015 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2015.7280696 · Cited by 991
Self-citationTraining Deep Spiking Neural Networks Using Backpropagation
Lee, J. H., Delbruck, T., & Pfeiffer, M. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00508 · Cited by 976
Self-citationProceedings Of The International Joint Conference On Neural Networks 2003
(2003) · Proceedings of the International Joint Conference on Neural Networks, 2003. · doi:10.1109/ijcnn.2003.1223944 · Cited by 950
Spiking Deep Convolutional Neural Networks for Energy-Efficient Object Recognition
Cao, Y., Chen, Y., & Khosla, D. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-014-0788-3 · Cited by 917
ImageNet classification with deep convolutional neural networks
Krizhevsky (2012) · Medical Entomology and Zoology · Cited by 799
Convolutional networks for fast, energy-efficient neuromorphic computing
Esser, S. K., Merolla, P. A., Arthur, J. V., Cassidy, A. S., Appuswamy, R., Andreopoulos, A., Berg, D. J., McKinstry, J. L., Melano, T., Barch, D. R., et al. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1604850113 · Cited by 781
Unsupervised Learning of Visual Features through Spike Timing Dependent Plasticity
Masquelier, T., & Thorpe, S. J. (2007) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0030031 · Cited by 548
Retinomorphic Event-Based Vision Sensors: Bioinspired Cameras With Spiking Output
Posch, C., Serrano-Gotarredona, T., Linares-Barranco, B., & Delbruck, T. (2014) · Proceedings of the IEEE · doi:10.1109/jproc.2014.2346153 · Cited by 471
Real-time classification and sensor fusion with a spiking deep belief network
O'Connor, P., Neil, D., Liu, S.-C., Delbruck, T., & Pfeiffer, M. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00178 · Cited by 408
Self-citationProceedings Of The 2003 IEEE International Symposium On Circuits And systems
(2003) · ISCAS 2003 International Symposium on Circuits and Systems · doi:10.1109/iscas.2003.1206140 · Cited by 404
Perez-Carrasco, J. A., Zhao, B., Serrano, C., Acha, B., Serrano-Gotarredona, T., Chen, S., & Linares-Barranco, B. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.71 · Cited by 324
HFirst: A Temporal Approach to Object Recognition
Orchard, G., Meyer, C., Etienne-Cummings, R., Posch, C., Thakor, N., & Benosman, R. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2392947 · Cited by 312
A 240 G-ops/s Mobile Coprocessor for Deep Neural Networks
Gokhale, V., Jin, J., Dundar, A., Martini, B., & Culurciello, E. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2014.106 · Cited by 300
Backpropagation for energy-efficient neuromorphic computing
Esser, S. K., Appuswamy, R., Merolla, P. A., Arthur, J. V., & Modha, D. S. (2015) · neural information processing systems · Cited by 281
Minitaur, an Event-Driven FPGA-Based Spiking Network Accelerator
Neil, D., & Liu, S.-C. (2014) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2013.2294916 · Cited by 268
Self-citationCassidy, A. S., Merolla, P., Arthur, J. V., Esser, S. K., Jackson, B., Alvarez-Icaza, R., Datta, P., Sawada, J., Wong, T. M., Feldman, V., et al. (2013) · The 2013 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2013.6707077 · Cited by 237
Event-driven contrastive divergence for spiking neuromorphic systems
Neftci, E., Das, S., Pedroni, B., Kreutz-Delgado, K., & Cauwenberghs, G. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00272 · Cited by 214
Event‐Based Neuromorphic Systems
Liu, S., Delbruck, T., Indiveri, G., Whatley, A., & Douglas, R. (2015) · Wiley eBooks · doi:10.1002/9781118927601 · Cited by 196
Self-citationTraining Spiking Deep Networks for Neuromorphic HardwarePreprint
Hunsberger, E., & Eliasmith, C. (2016) · arXiv (Cornell University) · doi:10.13140/rg.2.2.10967.06566 · Cited by 185
Theory and Tools for the Conversion of Analog to Spiking Convolutional Neural NetworksPreprint
Rueckauer, B., Lungu, I.-A., Hu, Y., & Pfeiffer, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.04052 · Cited by 149
Self-citationStromatias, E., Soto, M., Serrano‐Gotarredona, T., & Linares-Barranco, B. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00350 · Cited by 136
DVS Benchmark Datasets for Object Tracking, Action Recognition, and Object Recognition
Hu, Y., Liu, H., Pfeiffer, M., & Delbrück, T. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00405 · Cited by 133
Self-citationRueckauer, B., & Delbrück, T. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00176 · Cited by 128
Self-citationStromatias, E., Neil, D., Galluppi, F., Pfeiffer, M., Liu, S., & Furber, S. B. (2015) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2015.7280625 · Cited by 119
Self-citation(2009) · Cited by 107
TrueHappiness: Neuromorphic emotion recognition on TrueNorth
Diehl, P. U., Pedroni, B. U., Cassidy, A. S., Merolla, P. A., Neftci, E., & Zarrella, G. (2016) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2016.7727758 · Cited by 83
Neil, D., Pfeiffer, M., & Liu, S. (2016) · ACM Symposium on Applied Computing · doi:10.1145/2851613.2851724 · Cited by 80
Self-citationFarabet, C., Paz, R., Pérez‐Carrasco, J. A., Zamarreño-Ramos, C., Linares-Barranco, A., LeCun, Y., Culurciello, E., Serrano‐Gotarredona, T., & Linares-Barranco, B. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00032 · Cited by 74
Fast and Efficient Asynchronous Neural Computation with Adapting Spiking Neural NetworksPreprint
Zambrano, D., & Bohté, S. M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.02053 · Cited by 63
Fast classification using sparsely active spiking networks
Mostafa, H., Pedroni, B. U., Sheik, S., & Cauwenberghs, G. (2017) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2017.8050527 · Cited by 61
ConvNets experiments on SpiNNaker
Serrano‐Gotarredona, T., Linares-Barranco, B., Galluppi, F., Plana, L. A., & Furber, S. B. (2015) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2015.7169169 · Cited by 38
Event-driven deep neural network hardware system for sensor fusion
Kiselev, I., Neil, D., & Liu, S. (2016) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2016.7539099 · Cited by 23
Self-citationMapping Generative Models onto a Network of Digital Spiking Neurons
Pedroni, B. U., Das, S., Arthur, J. V., Merolla, P. A., Jackson, B. L., Modha, D. S., Kreutz-Delgado, K., & Cauwenberghs, G. (2016) · IEEE Transactions on Biomedical Circuits and Systems · doi:10.1109/tbcas.2016.2539352 · Cited by 20
Cited by
Gallego, G., Delbruck, T., Orchard, G., Bartolozzi, C., Taba, B., Censi, A., Leutenegger, S., Davison, A. J., Conradt, J., Daniilidis, K., et al. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3008413 · Cited by 2,566
Towards spike-based machine intelligence with neuromorphic computing
Roy, K., Jaiswal, A., & Panda, P. (2019) · Nature · doi:10.1038/s41586-019-1677-2 · Cited by 2,190
Deep learning in spiking neural networks
Tavanaei, A., Ghodrati, M., Kheradpisheh, S. R., Masquelier, T., & Maida, A. (2019) · Neural Networks · doi:10.1016/j.neunet.2018.12.002 · Cited by 1,386
Going Deeper in Spiking Neural Networks: VGG and Residual Architectures
Sengupta, A., Ye, Y., Wang, R., Liu, C., & Roy, K. (2019) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.00095 · Cited by 1,211
Opportunities for neuromorphic computing algorithms and applications
Schuman, C. D., Kulkarni, S. R., Parsa, M., Mitchell, J. P., Date, P., & Kay, B. (2022) · Nature Computational Science · doi:10.1038/s43588-021-00184-y · Cited by 1,117
“,44,46 .”
Metadata
- Authors
- Rueckauer, B., Lungu, I.-A., Hu, Y., Pfeiffer, M., & Liu, S.-C.
- Venue
- Frontiers in Neuroscience
- Publisher
- Frontiers Media SA
- Published
- 2017-12-07
- Volume
- 11
- Pages
- 682-682
- ISSN
- 1662-453X (ISSN-L)
- OpenAlex
- W2775079417
- Cited by
- 1,072
- References
- 52
- FWCI
- 20.70
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.