High-Performance Mixed-Signal Neurocomputing With Nanoscale Floating-Gate Memory Cell Arrays
The DOI matches its Crossref record; 34 of the 38 references it cites were found in a registry or an index.
Abstract
Potential advantages of analog- and mixed-signal nanoelectronic circuits, based on floating-gate devices with adjustable conductance, for neuromorphic computing had been realized long time ago. However, practical realizations of this approach suffered from using rudimentary floating-gate cells of relatively large area. Here, we report a prototype $28\times28$ binary-input, ten-output, three-layer neuromorphic network based on arrays of highly optimized embedded nonvolatile floating-gate cells, redesigned from a commercial 180-nm nor flash memory. All active blocks of the circuit, including 101 780 floating-gate cells, have a total area below 1 mm2. The network has shown a 94.7% classification fidelity on the common Modified National Institute of Standards and Technology benchmark, close to the 96.2% obtained in simulation. The classification of one pattern takes a sub-1- $\mu \text{s}$ time and a sub-20-nJ energy-both numbers much better than in the best reported digital implementations of the same task. Estimates show that a straightforward optimization of the hardware and its transfer to the already available 55-nm technology may increase this advantage to more than $10^{2}\times $ in speed and $10^{4}\times $ in energy efficiency.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“An alternative memory element for VMM operation is the flash memory cell80,81”
From Hardware implementation of memristor-based artificial neural networks (2024) · cites this paper as [81]
In the citing paper
“In Flash-based VMM, each memory element contribute a different amount to the current in each column of the crossbar depending on the voltage applied to the input or crossbar row and matrix element are stored as charge on the floating gate81 (i.e., multiplication) and all the currents in a column are instantaneously summed (i.e., accumulation) by Kirchhoff’s currents law.”
From Hardware implementation of memristor-based artificial neural networks (2024) · cites this paper as [81]
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
A million spiking-neuron integrated circuit with a scalable communication network and interface
Merolla, P. A., Arthur, J. V., Alvarez-Icaza, R., Cassidy, A. S., Sawada, J., Akopyan, F., Jackson, B. L., Imam, N., Guo, C., Nakamura, Y., et al. (2014) · Science · doi:10.1126/science.1254642 · Cited by 4,147
Eyeriss: An Energy-Efficient Reconfigurable Accelerator for Deep Convolutional Neural Networks
Chen, Y.-H., Krishna, T., Emer, J. S., & Sze, V. (2017) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2016.2616357 · Cited by 3,247
Training and operation of an integrated neuromorphic network based on metal-oxide memristors
Prezioso, M., Merrikh-Bayat, F., Hoskins, B. D., Adam, G. C., Likharev, K. K., & Strukov, D. B. (2015) · Nature · doi:10.1038/nature14441 · Cited by 3,001
Self-citationAnalog VLSI and Neural Systems
Mead, C. (1989) · CaltechAUTHORS (California Institute of Technology) · Cited by 2,776
BinaryConnect: Training Deep Neural Networks with binary weights during propagations
Courbariaux, M., Bengio, Y., & David, J.-P. (2015) · arXiv · doi:10.48550/arxiv.1511.00363 · Cited by 2,180
Neuromorphic Silicon Neuron Circuits
Indiveri, G., Linares-Barranco, B., Hamilton, T. J., Schaik, A. V., Etienne-Cummings, R., Delbruck, T., Liu, S.-C., Dudek, P., Häfliger, P., Renaud, S., et al. (2011) · Frontiers in Neuroscience · doi:10.3389/fnins.2011.00073 · Cited by 1,821
14.5 Eyeriss: An energy-efficient reconfigurable accelerator for deep convolutional neural networks
Chen, Y.-H., Krishna, T., Emer, J., & Sze, V. (2016) · 2016 IEEE International Solid-State Circuits Conference (ISSCC) · doi:10.1109/isscc.2016.7418007 · Cited by 713
Raoux, S. (2009) · Annual Review of Materials Research · doi:10.1146/annurev-matsci-082908-145405 · Cited by 439
Finding a roadmap to achieve large neuromorphic hardware systems
Hasler, J., & Marr, B. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00118 · Cited by 392
A single-transistor silicon synapse
Diorio, C., Hasler, P., Minch, A., & Mead, C. A. (1996) · IEEE Transactions on Electron Devices · doi:10.1109/16.543035 · Cited by 360
Backpropagation for energy-efficient neuromorphic computing
Esser, S. K., Appuswamy, R., Merolla, P. A., Arthur, J. V., & Modha, D. S. (2015) · neural information processing systems · Cited by 281
3-D Memristor Crossbars for Analog and Neuromorphic Computing Applications
Adam, G. C., Hoskins, B. D., Prezioso, M., Merrikh-Bayat, F., Chakrabarti, B., & Strukov, D. B. (2017) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2016.2630925 · Cited by 234
Self-citationFerroelectric and multiferroic tunnel junctions
Tsymbal, E. Y., Gruverman, A., Garcia, V., Bibes, M., & Barthélémy, A. (2012) · MRS Bulletin · doi:10.1557/mrs.2011.358 · Cited by 215
Kim, S., Ishii, M., Lewis, S., Perri, T., BrightSky, M., Kim, W., Jordan, R., Burr, G. W., Sosa, N., Ray, A., et al. (2015) · 2015 IEEE International Electron Devices Meeting (IEDM) · doi:10.1109/iedm.2015.7409716 · Cited by 194
RRAM-based synapse for neuromorphic system with pattern recognition function
Park, S., Kim, H., Choo, M., Noh, J., Sheri, A., Jung, S., Seo, K., Park, J., Kim, S., Lee, W., et al. (2012) · 2012 International Electron Devices Meeting · doi:10.1109/iedm.2012.6479016 · Cited by 191
A Programmable and Configurable Mixed-Mode FPAA SoC
George, S., Kim, S., Shah, S., Hasler, J., Collins, M., Adil, F., Wunderlich, R., Nease, S., & Ramakrishnan, S. (2016) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2015.2504119 · Cited by 159
Resistive switching phenomena in thin films: Materials, devices, and applications
Strukov, D. B., & Kohlstedt, H. (2012) · MRS Bulletin · doi:10.1557/mrs.2012.2 · Cited by 158
Self-citationMetal oxide memories based on thermochemical and valence change mechanisms
Yang, J. J., Inoue, I. H., Mikolajick, T., & Hwang, C. S. (2012) · MRS Bulletin · doi:10.1557/mrs.2011.356 · Cited by 139
A 1 TOPS/W Analog Deep Machine-Learning Engine With Floating-Gate Storage in 0.13 µm CMOS
Lu, J., Young, S., Arel, I., & Holleman, J. (2015) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2014.2356197 · Cited by 122
CrossNets: Neuromorphic Hybrid CMOS/Nanoelectronic Networks
Likharev, K. K. (2011) · Science of Advanced Materials · doi:10.1166/sam.2011.1177 · Cited by 115
Self-citationElectrochemical metallization cells—blending nanoionics into nanoelectronics?
Lu, W., Jeong, D. S., Kozicki, M., & Waser, R. (2012) · MRS Bulletin · doi:10.1557/mrs.2012.5 · Cited by 113
Raoux, S., Ielmini, D., Wuttig, M., & Karpov, I. V. (2012) · MRS Bulletin · doi:10.1557/mrs.2011.357 · Cited by 108
A Highly Dense, Low Power, Programmable Analog Vector-Matrix Multiplier: The FPAA Implementation
Schlottmann, C. R., & Hasler, P. E. (2011) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2011.2165755 · Cited by 106
Temperature-insensitive analog vector-by-matrix multiplier based on 55 nm NOR flash memory cells
Guo, X., Bayat, F. M., Prezioso, M., Chen, Y., Nguyen, B., Do, N., & Strukov, D. B. (2017) · 2017 IEEE Custom Integrated Circuits Conference (CICC) · doi:10.1109/cicc.2017.7993628 · Cited by 77
Self-citation24.2 A 2.5GHz 7.7TOPS/W switched-capacitor matrix multiplier with co-designed local memory in 40nm
Lee, E. H., & Wong, S. S. (2016) · 2016 IEEE International Solid-State Circuits Conference (ISSCC) · doi:10.1109/isscc.2016.7418085 · Cited by 56
Supervised Learning Using Spike-Timing-Dependent Plasticity of Memristive Synapses
Nishitani, Y., Kaneko, Y., & Ueda, M. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2399491 · Cited by 53
Redesigning commercial floating-gate memory for analog computing applications
Bayat, F. M., Guo, X., Om'mani, H. A., Do, N., Likharev, K. K., & Strukov, D. B. (2015) · 2015 IEEE International Symposium on Circuits and Systems (ISCAS) · doi:10.1109/iscas.2015.7169048 · Cited by 47
Self-citationModel-based high-precision tuning of NOR flash memory cells for analog computing applications
Bayat, F. M., Guo, X., Klachko, M., Do, N., Likharev, K., & Strukov, D. (2016) · 2016 74th Annual Device Research Conference (DRC) · doi:10.1109/drc.2016.7548449 · Cited by 36
Self-citationPassive charge redistribution digital‐to‐analogue multiplier
Bankman, D. J., & Murmann, B. (2015) · Electronics Letters · doi:10.1049/el.2014.3995 · Cited by 18
Nanoelectronic neurocomputing: Status and prospects
Ceze, L., Hasler, J., Likharev, K. K., Seo, J.-S., Sherwood, T., Strukov, D. B., Xie, Y., & Yu, S. (2016) · Conference digest · doi:10.1109/drc.2016.7548506 · Cited by 15
Self-citationMerrikh-Bayat, F., Prezioso, M., Chakrabarti, B., Kataeva, I., & Strukov, D. B. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.04465 · Cited by 8
Self-citationMeasurement of finite-precision effects in handwriting- and speech-recognition algorithms
Säckinger, E. (1997) · Lecture notes in computer science · doi:10.1007/bfb0020318 · Cited by 6
Quantized Neural Networks: Training Neural Networks with Low Precision Weights and Activations
Hubara, I., Courbariaux, M., Soudry, D., El-Yaniv, R., & Bengio, Y. (2016) · arXiv · doi:10.48550/arxiv.1609.07061
Research works printed but not linked: 2
- lee, 2016, A 2.5 GHz 7.7 TOPS/W switched-capacitor matrix multiplier with co-designed local memory in 40 nm, IEEE Int Solid-State Circuits Conf (ISSCC) Dig Tech Papers, 418
- 2017, Superflash Technology Overview
Cited by
Memory devices and applications for in-memory computing
Sebastian, A., Le Gallo, M., Khaddam-Aljameh, R., & Eleftheriou, E. (2020) · Nature Nanotechnology · doi:10.1038/s41565-020-0655-z · Cited by 2,289
Towards spike-based machine intelligence with neuromorphic computing
Roy, K., Jaiswal, A., & Panda, P. (2019) · Nature · doi:10.1038/s41586-019-1677-2 · Cited by 2,190
“Another class of non-volatile devices that allows tunable non-volatile resistance is a floating-gate transistor; such devices are being actively explored for synaptic storage 112–114 .”
BackgroundMemristive crossbar arrays for brain-inspired computing
Xia, Q., & Yang, J. J. (2019) · Nature Materials · doi:10.1038/s41563-019-0291-x · Cited by 1,800
Two-dimensional materials for next-generation computing technologies
Liu, C., Chen, H., Wang, S., Liu, Q., Jiang, Y.-G., Zhang, D. W., Liu, M., & Zhou, P. (2020) · Nature Nanotechnology · doi:10.1038/s41565-020-0724-3 · Cited by 1,045
A crossbar array of magnetoresistive memory devices for in-memory computing
Jung, S., Lee, H., Myung, S., Kim, H., Yoon, S. K., Kwon, S.-W., Ju, Y., Kim, M., Yi, W., Han, S., et al. (2022) · Nature · doi:10.1038/s41586-021-04196-6 · Cited by 644
Metadata
- Authors
- Merrikh-Bayat, F., Guo, X., Klachko, M., Prezioso, M., Likharev, K. K., & Strukov, D. B.
- Affiliations
- University of California, Santa Barbara (US)
- Stony Brook University (US)
- Venue
- IEEE Transactions on Neural Networks and Learning Systems
- Published
- 2018-10
- Volume
- 29
- Issue
- 10
- Pages
- 4782-4790
- ISSN
- 2162-237X (ISSN-L)
- 2162-2388
- OpenAlex
- W2778345336
- Cited by
- 167
- References
- 38
- Citations by year
- 2026: 9 · 2025: 16 · 2024: 17 · 2023: 21 · 2022: 28 · 2021: 21 · 2020: 26 · 2019: 22 · 2018: 7
- FWCI
- 6.25
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Neural Networks and Learning Systems (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Defense Advanced Research Projects Agency (HR0011-13-C-0051UPSIDE)
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Analog and Mixed-Signal Circuit Design
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Low-power high-performance VLSI design
- Keywords
- neuromorphic computing, floating gate memory, mixed-signal circuits, non-volatile memory, analog neural networks, energy-efficient classification, low-power electronics, NOR flash memory, MNIST classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.