The DOI matches its Crossref record; 76 of the 76 references it cites were found in a registry or an index.
A reconfigurable on-line learning spiking neuromorphic processor comprising 256 neurons and 128K synapses
Open accessAbstract
Implementing compact, low-power artificial neural processing systems with real-time on-line learning abilities is still an open challenge. In this paper we present a full-custom mixed-signal VLSI device with neuromorphic learning circuits that emulate the biophysics of real spiking neurons and dynamic synapses for exploring the properties of computational neuroscience models and for building brain-inspired computing systems. The proposed architecture allows the on-chip configuration of a wide range of network connectivities, including recurrent and deep networks, with short-term and long-term plasticity. The device comprises 128 K analog synapse and 256 neuron circuits with biologically plausible dynamics and bi-stable spike-based plasticity mechanisms that endow it with on-line learning abilities. In addition to the analog circuits, the device comprises also asynchronous digital logic circuits for setting different synapse and neuron properties as well as different network configurations. This prototype device, fabricated using a 180 nm 1P6M CMOS process, occupies an area of 51.4 mm(2), and consumes approximately 4 mW for typical experiments, for example involving attractor networks. Here we describe the details of the overall architecture and of the individual circuits and present experimental results that showcase its potential. By supporting a wide range of cortical-like computational modules comprising plasticity mechanisms, this device will enable the realization of intelligent autonomous systems with on-line learning capabilities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Simple model of spiking neurons
Izhikevich, E. M. (2003) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2003.820440 · Cited by 4,828
A million spiking-neuron integrated circuit with a scalable communication network and interface
Merolla, P. A., Arthur, J. V., Alvarez-Icaza, R., Cassidy, A. S., Sawada, J., Akopyan, F., Jackson, B. L., Imam, N., Guo, C., Nakamura, Y., et al. (2014) · Science · doi:10.1126/science.1254642 · Cited by 4,147
Maass, W., Natschläger, T., & Markram, H. (2002) · Neural Computation · doi:10.1162/089976602760407955 · Cited by 4,025 · cited 2×
“An other alternative could consist in interconnecting the neurons in the hidden layer to form a Liquid State Machine (LSM) (Maass et al., 2002).”
BackgroundSparse coding with an overcomplete basis set: A strategy employed by V1?
Olshausen, B. A., & Field, D. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00169-7 · Cited by 3,642
Learning Hierarchical Features for Scene Labeling
Farabet, C., Couprie, C., Najman, L., & LeCun, Y. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.231 · Cited by 2,620
Synaptic plasticity: taming the beast
Abbott, L. F., & Nelson, S. B. (2000) · Nature Neuroscience · doi:10.1038/81453 · Cited by 2,263 · cited 1×
“Many models of Spike-Timing Dependent Plasticity (STDP) have been proposed in the computational neuroscience literature (Abbott and Nelson, 2000; Markram et al., 2012).”
BackgroundModeling Brain Function: The World of Attractor Neural Networks
Amit, D. J. (1989) · Cambridge University Press eBooks · doi:10.1017/cbo9780511623257 · Cited by 2,227
Neuromorphic Silicon Neuron Circuits
Indiveri, G., Linares-Barranco, B., Hamilton, T. J., Schaik, A. V., Etienne-Cummings, R., Delbruck, T., Liu, S.-C., Dudek, P., Häfliger, P., Renaud, S., et al. (2011) · Frontiers in Neuroscience · doi:10.3389/fnins.2011.00073 · Cited by 1,821
Self-citationAcoustic Modeling Using Deep Belief Networks
Mohamed, A.-R., Dahl, G. E., & Hinton, G. (2012) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2011.2109382 · Cited by 1,727
Building high-level features using large scale unsupervised learning
Le, Q. V. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639343 · Cited by 1,695
Furber, S. B., Galluppi, F., Temple, S., & Plana, L. A. (2014) · Proceedings of the IEEE · doi:10.1109/jproc.2014.2304638 · Cited by 1,350
Adaptive Exponential Integrate-and-Fire Model as an Effective Description of Neuronal Activity
Brette, R., & Gerstner, W. (2005) · Journal of Neurophysiology · doi:10.1152/jn.00686.2005 · Cited by 1,277
Neurogrid: A Mixed-Analog-Digital Multichip System for Large-Scale Neural Simulations
Benjamin, B. V., Gao, P., McQuinn, E., Choudhary, S., Chandrasekaran, A. R., Bussat, J.-M., Alvarez-Icaza, R., Arthur, J. V., Merolla, P. A., & Boahen, K. (2014) · Proceedings of the IEEE · doi:10.1109/jproc.2014.2313565 · Cited by 1,266
Indiveri, G., Chicca, E., & Douglas, R. (2006) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2005.860850 · Cited by 1,009
Self-citationSynaptic basis of cortical persistent activity: the importance of NMDA receptors to working memory
Wang, X.-J. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-21-09587.1999 · Cited by 859 · cited 1×
“We implemented the hardware attractor networks following the theories and methods proposed in Amit (1992); Wang (1999); Amit and Mongillo (2003); Del Giudice et al. (2003); Giulioni et al. (2012).”
MethodBuilding high-level features using large scale unsupervised learning
Ranzato, M., Monga, R., Devin, M., Chen, K., Corrado, G. S., Dean, J., Le, Q. V., & Ng, A. Y. (2012) · International Conference on Machine Learning · Cited by 823
Point-to-point connectivity between neuromorphic chips using address events
Boahen, K. A. (2000) · IEEE Transactions on Circuits and Systems II: Analog and Digital Signal Processing · doi:10.1109/82.842110 · Cited by 654
Neuromorphic Electronic Circuits for Building Autonomous Cognitive Systems
Chicca, E., Stefanini, F., Bartolozzi, C., & Indiveri, G. (2014) · Proceedings of the IEEE · doi:10.1109/jproc.2014.2313954 · Cited by 552
Self-citationBoosting: foundations and algorithms
(2012) · Choice Reviews Online · doi:10.5860/choice.50-2112 · Cited by 505
Mahowald, M., & Douglas, R. (1991) · Nature · doi:10.1038/354515a0 · Cited by 490
Real-time classification and sensor fusion with a spiking deep belief network
O'Connor, P., Neil, D., Liu, S.-C., Delbruck, T., & Pfeiffer, M. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00178 · Cited by 408
Synaptic Dynamics in Analog VLSI
Bartolozzi, C., & Indiveri, G. (2007) · Neural Computation · doi:10.1162/neco.2007.19.10.2581 · Cited by 377
Self-citationLearning Real-World Stimuli in a Neural Network with Spike-Driven Synaptic Dynamics
Brader, J. M., Senn, W., & Fusi, S. (2007) · Neural Computation · doi:10.1162/neco.2007.19.11.2881 · Cited by 371
Spike-Timing-Dependent Plasticity: A Comprehensive Overview
Markram, H., Gerstner, W., & Sjöström, P. J. (2012) · Frontiers in Synaptic Neuroscience · doi:10.3389/fnsyn.2012.00002 · Cited by 369
Liu, S.-C., & Delbruck, T. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.03.007 · Cited by 362
Modeling Brain Function: The World of Attractor Neural Networks
de Callataÿ, A. (1990) · Trends in Neurosciences · doi:10.1016/0166-2236(90)90155-4 · Cited by 359
Competitive STDP-Based Spike Pattern Learning
Masquelier, T., Guyonneau, R., & Thorpe, S. J. (2009) · Neural Computation · doi:10.1162/neco.2008.06-08-804 · Cited by 340
Minitaur, an Event-Driven FPGA-Based Spiking Network Accelerator
Neil, D., & Liu, S.-C. (2014) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2013.2294916 · Cited by 268
Douglas, R., Mahowald, M., & Mead, C. (1995) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.18.030195.001351 · Cited by 252
Boosting: Foundations and Algorithms
Schapire, R. E. (2013) · Kybernetes · doi:10.1108/03684921311295547 · Cited by 231
Analog VLSI: Circuits and Principles
Liu, S., Delbrück, T., Kramer, J., et al. (2002) · Cited by 228
Robotic goalie with 3 ms reaction time at 4% CPU load using event-based dynamic vision sensor
Delbruck, T., & Lang, M. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00223 · Cited by 215
The Sparseness of Mixed Selectivity Neurons Controls the Generalization–Discrimination Trade-Off
Barak, O., Rigotti, M., & Fusi, S. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.2753-12.2013 · Cited by 207
On the design and characterization of femtoampere current-mode circuits
Linares-Barranco, B., & Serrano-Gotarredona, T. (2003) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2003.814415 · Cited by 190
A Pulse-Coded Communications Infrastructure for Neuromorphic Systems
Deiss, S. R., Douglas, R. J., & Whatley, A. M. (1998) · Pulsed Neural Networks · doi:10.7551/mitpress/5704.003.0011 · Cited by 168
A bio-physically inspired silicon neuron
Farquhar, E. D., & Hasler, P. E. (2005) · IEEE Transactions on Circuits and Systems I Fundamental Theory and Applications · doi:10.1109/tcsi.2004.842871 · Cited by 155
Synthesizing cognition in neuromorphic electronic systems
Neftci, E., Binas, J., Rutishauser, U., Chicca, E., Indiveri, G., & Douglas, R. J. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1212083110 · Cited by 154
Self-citationOptic Nerve Signals in a Neuromorphic Chip I: Outer and Inner Retina Models
Zaghloul, K. A., & Boahen, K. A. (2004) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2003.821039 · Cited by 131
Optic Nerve Signals in a Neuromorphic Chip II: Testing and Results
Zaghloul, K. A., & Boahen, K. A. (2004) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2003.821040 · Cited by 126
Suppression of the magnocellular pathway during saccades
Ross, J., Burr, D. C., & Morrone, M. C. (1996) · Behavioural Brain Research · doi:10.1016/0166-4328(96)00012-5 · Cited by 120
A Spatial Contrast Retina With On-Chip Calibration for Neuromorphic Spike-Based AER Vision Systems
Costas-Santos, J., Serrano‐Gotarredona, T., Serrano-Gotarredona, R., & Linares-Barranco, B. (2007) · IEEE Transactions on Circuits and Systems I Fundamental Theory and Applications · doi:10.1109/tcsi.2007.900179 · Cited by 113
Questions about STDP as a General Model of Synaptic Plasticity
Lisman, J. E., & Spruston, N. (2010) · Frontiers in Synaptic Neuroscience · doi:10.3389/fnsyn.2010.00140 · Cited by 110
(2009) · Cited by 107
A neuromorphic network for generic multivariate data classification
Schmuker, M., Pfeil, T., & Nawrot, M. P. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1303053111 · Cited by 106
Brüderle, D., Petrovici, M. A., Vogginger, B., Ehrlich, M., Pfeil, T., Millner, S., Grübl, A., Wendt, K., Müller, E., Schwartz, M.-O., et al. (2011) · Biological Cybernetics · doi:10.1007/s00422-011-0435-9 · Cited by 101
Brüderle, D., Petrovici, M. A., Vogginger, B., Ehrlich, M., Pfeil, T., Millner, S., Grübl, A., Wendt, K., Müller, E., Schwartz, M.-O., et al. (2011) · Cited by 92
State-Dependent Computation Using Coupled Recurrent Networks
Rutishauser, U., & Douglas, R. J. (2008) · Neural Computation · doi:10.1162/neco.2008.03-08-734 · Cited by 86
Giudice, P. D., Fusi, S., & Mattia, M. (2003) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2004.01.021 · Cited by 86
VLSI Implementation of a Bio-Inspired Olfactory Spiking Neural Network
Hsieh, H.-Y., & Tang, K. (2012) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2012.2195329 · Cited by 84
Spike-Driven Synaptic Dynamics Generating Working Memory States
Amit, D. J., & Mongillo, G. (2003) · Neural Computation · doi:10.1162/089976603321192086 · Cited by 79
Memory Retention and Spike-Timing-Dependent Plasticity
Billings, G. O., & van Rossum, M. C. W. (2009) · Journal of Neurophysiology · doi:10.1152/jn.91007.2008 · Cited by 73
On Real-Time AER 2-D Convolutions Hardware for Neuromorphic Spike-Based Cortical Processing
Serrano-Gotarredona, R., Serrano‐Gotarredona, T., Acosta, A. J., Serrano, C., Pérez‐Carrasco, J. A., Linares-Barranco, B., Linares-Barranco, A., Jiménez, G., & Civit, A. (2008) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2000163 · Cited by 71
Petrovici, M. A., Vogginger, B., Müller, P. F., Breitwieser, O., Lundqvist, M., Muller, L., Ehrlich, M., Alain Destexhe, A., Lansner, A., Schüffny, R., et al. (2014) · PLoS ONE · doi:10.1371/journal.pone.0108590 · Cited by 69
A log-domain implementation of the Izhikevich neuron model
André, V. S., Jin, C. T., McEwan, A. L., & Hamilton, T. J. (2010) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2010.5537564 · Cited by 68
65k-neuron integrate-and-fire array transceiver with address-event reconfigurable synaptic routing
Yu, T., Park, J., Joshi, S., Maier, C., & Cauwenberghs, G. (2012) · IEEE Biomedical Circuits and Systems Conference (BioCAS) · doi:10.1109/biocas.2012.6418479 · Cited by 56
Attractor concretion as a mechanism for the formation of context representations
Rigotti, M., Rubin, D. B. D., Morrison, S. E., Salzman, C. D., & Fusi, S. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.01.047 · Cited by 56
Modeling Short-Term Synaptic Depression in Silicon
Boegerhausen, M., Suter, P., & Liu, S. (2003) · Neural Computation · doi:10.1162/089976603762552942 · Cited by 56
Robust Working Memory in an Asynchronously Spiking Neural Network Realized with Neuromorphic VLSI
Giulioni, M., Camilleri, P., Mattia, M., Dante, V., Braun, J., & Giudice, P. D. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2011.00149 · Cited by 55
Rasche, C., & Hahnloser, R. H. R. (2001) · Biological Cybernetics · doi:10.1007/s004220170004 · Cited by 53
Beyond spike timing: the role of nonlinear plasticity and unreliable synapses
Senn, W. (2002) · Biological Cybernetics · doi:10.1007/s00422-002-0350-1 · Cited by 50
32-bit Configurable bias current generator with sub-off-current capability
Delbrück, T., Berner, R., Lichtsteiner, P., & Dualibe, C. (2010) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2010.5537475 · Cited by 45
Neuron Array With Plastic Synapses and Programmable Dendrites
Ramakrishnan, S., Wunderlich, R. B., Hasler, J., & George, S. (2013) · IEEE Transactions on Biomedical Circuits and Systems · doi:10.1109/tbcas.2013.2282616 · Cited by 44
Thermodynamically Equivalent Silicon Models of Voltage-Dependent Ion Channels
Hynna, K. M., & Boahen, K. A. (2007) · Neural Computation · doi:10.1162/neco.2007.19.2.327 · Cited by 44
Senn, W., & Fusi, S. (2005) · Neural Computation · doi:10.1162/0899766054615644 · Cited by 43
Modeling brain function: the world of attractor neural networks
Amit, D. J. (1989) · CERN Document Server (European Organization for Nuclear Research) · Cited by 37
A VLSI network of spiking neurons with plastic fully configurable “stop-learning” synapses
Giulioni, M., Camilleri, P., Dante, V., Badoni, D., Indiveri, G., Braun, J., & Giudice, P. D. (2008) · IEEE International Conference on Electronics, Circuits and Systems (ICECS) · doi:10.1109/icecs.2008.4674944 · Cited by 34
Self-citationExploiting device mismatch in neuromorphic VLSI systems to implement axonal delays
Sheik, S., Chicca, E., & Indiveri, G. (2012) · 2022 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2012.6252636 · Cited by 33
Self-citationAnalog VLSI Circuits for Short-Term Dynamic Synapses
Liu, S. (2003) · EURASIP Journal on Advances in Signal Processing · doi:10.1155/s1110865703302094 · Cited by 30
Spatio-temporal Spike Pattern Classification in Neuromorphic Systems
Sheik, S., Pfeiffer, M., Stefanini, F., & Indiveri, G. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39802-5_23 · Cited by 28
Self-citationEmergent Auditory Feature Tuning in a Real-Time Neuromorphic VLSI System
Sheik, S., Coath, M., Indiveri, G., Denham, S. L., Wennekers, T., & Chicca, E. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00017 · Cited by 25
Self-citationRovere, G., Qiao, N., Bartolozzi, C., & Indiveri, G. (2014) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2014.6865574 · Cited by 19
Self-citationA Simple Derivation of a Bound on the Perceptron Margin Using Singular Value Decomposition
Barak, O., & Rigotti, M. (2011) · Neural Computation · doi:10.1162/neco_a_00152 · Cited by 14
Neuron array with plastic synapses and programmable dendrites
Ramakrishnan, S., Wunderlich, R. B., & Hasler, P. E. (2012) · IEEE Biomedical Circuits and Systems Conference (BioCAS) · doi:10.1109/biocas.2012.6418412 · Cited by 13
Stochastic Synapse with Short-Term Depression for Silicon Neurons
Xu, P., Horiuchi, T. K., Sarje, A., & Abshire, P. (2007) · IEEE Biomedical Circuits and Systems Conference (BioCAS) · doi:10.1109/biocas.2007.4463318 · Cited by 4
Cited by
Loihi: A Neuromorphic Manycore Processor with On-Chip Learning
Davies, M., Srinivasa, N., Lin, T.-H., Chinya, G., Cao, Y., Choday, S. H., Dimou, G., Joshi, P., Imam, N., Jain, S., et al. (2018) · IEEE Micro · doi:10.1109/mm.2018.112130359 · Cited by 3,897
Memory devices and applications for in-memory computing
Sebastian, A., Le Gallo, M., Khaddam-Aljameh, R., & Eleftheriou, E. (2020) · Nature Nanotechnology · doi:10.1038/s41565-020-0655-z · Cited by 2,289
Towards spike-based machine intelligence with neuromorphic computing
Roy, K., Jaiswal, A., & Panda, P. (2019) · Nature · doi:10.1038/s41586-019-1677-2 · Cited by 2,190
A bioinspired flexible organic artificial afferent nerve
Kim, Y., Chortos, A., Xu, W., Liu, Y., Oh, J. Y., Son, D., Kang, J., Foudeh, A. M., Zhu, C., Lee, Y., et al. (2018) · Science · doi:10.1126/science.aao0098 · Cited by 1,466
Neuromorphic computing using non-volatile memory
Burr, G. W., Shelby, R. M., Sebastian, A., Kim, S., Kim, S., Sidler, S., Virwani, K., Ishii, M., Narayanan, P., Fumarola, A., et al. (2017) · Advances in Physics: X · doi:10.1080/23746149.2016.1259585 · Cited by 1,107
Metadata
- Authors
- Qiao, N., Mostafa, H., Corradi, F., Osswald, M., Stefanini, F., Sumislawska, D., & Indiveri, G.
- Venue
- Frontiers in Neuroscience
- Publisher
- Frontiers Media SA
- Published
- 2015-04-29
- Volume
- 9
- Pages
- 141-141
- ISSN
- 1662-453X (ISSN-L)
- OpenAlex
- W1975398991
- Cited by
- 698
- References
- 76
- FWCI
- 26.62
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.