Dot-product engine for neuromorphic computing: programming 1T1M crossbar to accelerate matrix-vector multiplication
The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
Vector-matrix multiplication dominates the computation time and energy for many workloads, particularly neural network algorithms and linear transforms (e.g, the Discrete Fourier Transform). Utilizing the natural current accumulation feature of memristor crossbar, we developed the Dot-Product Engine (DPE) as a high density, high power efficiency accelerator for approximate matrix-vector multiplication. We firstly invented a conversion algorithm to map arbitrary matrix values appropriately to memristor conductances in a realistic crossbar array, accounting for device physics and circuit issues to reduce computational errors. The accurate device resistance programming in large arrays is enabled by close-loop pulse tuning and access transistors. To validate our approach, we simulated and benchmarked one of the state-of-the-art neural networks for pattern recognition on the DPEs. The result shows no accuracy degradation compared to software approach (99 % pattern recognition accuracy for MNIST data set) with only 4 Bit DAC/ADC requirement, while the DPE can achieve a speed-efficiency product of 1,000× to 10,000× compared to a custom digital ASIC.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Nanoscale Memristor Device as Synapse in Neuromorphic Systems
Jo, S. H., Chang, T., Ebong, I., Bhadviya, B. B., Mazumder, P., & Lu, W. (2010) · Nano Letters · doi:10.1021/nl904092h · Cited by 4,174 · cited 2×
“For analog computing applications, memristors are desired to have stable, continuous linear conductance states for representing matrix values [13].”
BackgroundMemristive devices for computing
Yang, J. J., Strukov, D. B., & Stewart, D. R. (2013) · Nature Nanotechnology · doi:10.1038/nnano.2012.240 · Cited by 3,885 · cited 2×
“An ideal nanoscale memristor crossbar array can naturally carry out vector-matrix multiplication–a computationally expensive task for many important applications–in a single constant time step [2].”
BackgroundSelf-citationTraining and operation of an integrated neuromorphic network based on metal-oxide memristors
Prezioso, M., Merrikh-Bayat, F., Hoskins, B. D., Adam, G. C., Likharev, K. K., & Strukov, D. B. (2015) · Nature · doi:10.1038/nature14441 · Cited by 3,001 · cited 3×
“Some researchers use hardware training schemes to minimize errors [6, 7, 8, 9].”
BackgroundWong, H.-S. P., Lee, H.-Y., Yu, S., Chen, Y.-S., Wu, Y., Chen, P.-S., Lee, B., Chen, F. T., & Tsai, M.-J. (2012) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2190369 · Cited by 2,757
High precision tuning of state for memristive devices by adaptable variation-tolerant algorithm
Alibart, F., Gao, L., Hoskins, B. D., & Strukov, D. B. (2012) · Nanotechnology · doi:10.1088/0957-4484/23/7/075201 · Cited by 557 · cited 1×
“After the conversion, we use close-loop tuning scheme [16]to program memristors to the desired conductance values.”
MethodLearning a Nonlinear Embedding by Preserving Class Neighbourhood Structure
Salakhutdinov, R., & Hinton, G. E. (2007) · International Conference on Artificial Intelligence and Statistics · Cited by 440
Memristor Crossbar-Based Neuromorphic Computing System: A Case Study
Hu, M., Li, H., Chen, Y., Wu, Q., Rose, G. S., & Linderman, R. W. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2296777 · Cited by 414
Self-citationUnderstanding the efficiency of GPU algorithms for matrix-matrix multiplication
Fatahalian, K., Sugerman, J., & Hanrahan, P. (2004) · Proceedings of the ACM SIGGRAPH/EUROGRAPHICS conference on Graphics hardware · doi:10.1145/1058129.1058148 · Cited by 309
Endurance/Retention Trade-off on $\hbox{HfO}_{2}/\hbox{Metal}$ Cap 1T1R Bipolar RRAM
Chen, Y. Y., Goux, L., Clima, S., Govoreanu, B., Degraeve, R., Kar, G. S., Fantini, A., Groeseneken, G., Wouters, D. J., & Jurczak, M. (2013) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2013.2241064 · Cited by 271
Sheu, S.-S., Chang, M.-F., Lin, K.-F., Wu, C.-W., Chen, Y.-S., Chiu, P.-F., Kuo, C.-C., Yang, Y.-S., Chiang, P.-C., Lin, W.-P., et al. (2011) · 2011 IEEE International Solid-State Circuits Conference · doi:10.1109/isscc.2011.5746281 · Cited by 246
Cited by
Towards spike-based machine intelligence with neuromorphic computing
Roy, K., Jaiswal, A., & Panda, P. (2019) · Nature · doi:10.1038/s41586-019-1677-2 · Cited by 2,190
The future of electronics based on memristive systems
Zidan, M. A., Strachan, J. P., & Lu, W. D. (2018) · Nature Electronics · doi:10.1038/s41928-017-0006-8 · Cited by 2,138
Self-citationParallel convolutional processing using an integrated photonic tensor core
Feldmann, J., Youngblood, N., Karpov, M., Gehring, H., Li, X., Stappers, M., Le Gallo, M., Fu, X., Lukashchuk, A., Raja, A. S., et al. (2021) · Nature · doi:10.1038/s41586-020-03070-1 · Cited by 1,900
“Moreover, they are plagued by the same limitations of electronic addressing 20 , with additional challenges in the manufacturing and implementation due to issues with device variability 21,22 , cyclability 23 and drift 24,25 .”
BackgroundISAAC: a convolutional neural network accelerator with in-situ analog arithmetic in crossbars
Shafiee, A., Nag, A., Muralimanohar, N., Balasubramonian, R., Strachan, J. P., Hu, M., Williams, R. S., & Srikumar, V. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001139 · Cited by 1,536
Self-citationNeuro-Inspired Computing With Emerging Nonvolatile Memorys
Yu, S. (2018) · Proceedings of the IEEE · doi:10.1109/jproc.2018.2790840 · Cited by 1,170
“[99] developed a 64 × 64 TiOx-based 1T1R array with 6-b (64 levels) offline training and a single-layer perceptron for MNIST image recognition.”
MethodEquivalent-accuracy accelerated neural-network training using analogue memory
Ambrogio, S., Narayanan, P., Tsai, H., Shelby, R. M., Boybat, I., di Nolfo, C., Sidler, S., Giordano, M., Bodini, M., Farinha, N. C. P., et al. (2018) · Nature · doi:10.1038/s41586-018-0180-5 · Cited by 1,151
Neuro-inspired computing chips
Zhang, W., Gao, B., Tang, J., Yao, P., Yu, S., Chang, M.-F., Yoo, H.-J., Qian, H., & Wu, H. (2020) · Nature Electronics · doi:10.1038/s41928-020-0435-7 · Cited by 892
PipeLayer: A Pipelined ReRAM-Based Accelerator for Deep Learning
Song, L., Qian, X., Li, H., & Chen, Y. (2017) · 2017 IEEE International Symposium on High Performance Computer Architecture (HPCA) · doi:10.1109/hpca.2017.55 · Cited by 833
ISAAC: A Convolutional Neural Network Accelerator with In-Situ Analog Arithmetic in Crossbars
Shafiee, A., Nag, A., Muralimanohar, N., Balasubramonian, R., Strachan, J. P., Hu, M., Williams, R. S., & Srikumar, V. (2016) · 2016 ACM/IEEE 43rd Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca.2016.12 · Cited by 775
Self-citationChaotic dynamics in nanoscale NbO2 Mott memristors for analogue computing
Kumar, S., Strachan, J. P., & Williams, R. S. (2017) · Nature · doi:10.1038/nature23307 · Cited by 617
Self-citationAn artificial nociceptor based on a diffusive memristor
Yoon, J. H., Wang, Z., Kim, K. M., Wu, H., Ravichandran, V., Xia, Q., Hwang, C. S., & Yang, J. J. (2018) · Nature Communications · doi:10.1038/s41467-017-02572-3 · Cited by 519
Self-citationHardware implementation of memristor-based artificial neural networks
Aguirre, F., Sebastian, A., Le Gallo, M., Song, W., Wang, T., Yang, J. J., Lu, W., Chang, M.-F., Ielmini, D., Yang, Y., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-45670-9 · Cited by 564
“The weight update process is implemented by applying voltage or current pulses to the memristors (block 13 and 14), following the Write-Verify (or Close Loop Tunning) 194 – 196 , or the Write-without-Verify (or Open Loop Tunning) 103,107,197,198 .”
Self-citationMixed-precision in-memory computing
Le Gallo, M., Sebastian, A., Mathis, R., Manica, M., Giefers, H., Tuma, T., Bekas, C., Curioni, A., & Eleftheriou, E. (2018) · Nature Electronics · doi:10.1038/s41928-018-0054-8 · Cited by 485
Recent advances in convolutional neural network acceleration
Zhang, Q., Zhang, M., Chen, T., Sun, Z., Ma, Y., & Yu, B. (2019) · Neurocomputing · doi:10.1016/j.neucom.2018.09.038 · Cited by 434
PUMA: A Programmable Ultra-efficient Memristor-based Accelerator for Machine Learning Inference
Ankit, A., Hajj, I. E., Chalamalasetti, S. R., Ndu, G., Foltin, M., Williams, R. S., Faraboschi, P., Hwu, W.-M. W., Strachan, J. P., Roy, K., et al. (2019) · Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3297858.3304049 · Cited by 424
Self-citationCai, F., Kumar, S., Van Vaerenbergh, T., Sheng, X., Liu, R., Li, C., Liu, Z., Foltin, M., Yu, S., Xia, Q., et al. (2020) · Nature Electronics · doi:10.1038/s41928-020-0436-6 · Cited by 393
Self-citationIn-memory computing on a photonic platform
Ríos, C., Youngblood, N., Cheng, Z., Le Gallo, M., Pernice, W. H. P., Wright, C. D., Sebastian, A., & Bhaskaran, H. (2019) · Science Advances · doi:10.1126/sciadv.aau5759 · Cited by 391
Reinforcement learning with analogue memristor arrays
Wang, Z., Li, C., Song, W., Rao, M., Belkin, D., Li, Y., Yan, P., Jiang, H., Lin, P., Hu, M., et al. (2019) · Nature Electronics · doi:10.1038/s41928-019-0221-6 · Cited by 370
Self-citationA Survey of Accelerator Architectures for Deep Neural Networks
Chen, Y., Xie, Y., Song, L., Chen, F., & Tang, T. (2020) · Engineering · doi:10.1016/j.eng.2020.01.007 · Cited by 370
A Survey of Neuromorphic Computing and Neural Networks in Hardware
Schuman, C. D., Potok, T. E., Patton, R. M., Birdwell, J. D., Dean, M. E., Rose, G. S., & Plank, J. S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.06963 · Cited by 352
Towards Oxide Electronics: a Roadmap
Coll, M., Fontcuberta, J., Althammer, M., Bibes, M., Boschker, H., Calleja, A., Cheng, G., Cuoco, M., Dittmann, R., Dkhil, B., et al. (2019) · Applied Surface Science · doi:10.1016/j.apsusc.2019.03.312 · Cited by 314
In situ training of feed-forward and recurrent convolutional memristor networks
Wang, Z., Li, C., Lin, P., Rao, M., Nie, Y., Song, W., Qiu, Q., Li, Y., Yan, P., Strachan, J. P., et al. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0089-1 · Cited by 307
Self-citationGraphR: Accelerating Graph Processing Using ReRAM
Song, L., Zhuo, Y., Qian, X., Li, H., & Chen, Y. (2018) · 2018 IEEE International Symposium on High Performance Computer Architecture (HPCA) · doi:10.1109/hpca.2018.00052 · Cited by 295
Reconfigurable halide perovskite nanocrystal memristors for neuromorphic computing
John, R. A., Demirağ, Y., Shynkarenko, Y., Berezovska, Y., Ohannessian, N., Payvand, M., Zeng, P., Bodnarchuk, M. I., Krumeich, F., Kara, G., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-29727-1 · Cited by 292
Solving matrix equations in one step with cross-point resistive arrays
Sun, Z., Pedretti, G., Ambrosi, E., Bricalli, A., Wang, W., & Ielmini, D. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1815682116 · Cited by 269
A general memristor-based partial differential equation solver
Zidan, M. A., Jeong, Y., Lee, J., Chen, B., Huang, S., Kushner, M. J., & Lu, W. D. (2018) · Nature Electronics · doi:10.1038/s41928-018-0100-6 · Cited by 261
Rescuing Memristor-based Neuromorphic Design with High Defects
Liu, C., Hu, M., Strachan, J. P., & Li, H. (. (2017) · Proceedings of the 54th Annual Design Automation Conference 2017 · doi:10.1145/3061639.3062310 · Cited by 257
Self-citationAccelerator-friendly neural-network training: Learning variations and defects in RRAM crossbar
Chen, L., Li, J., Chen, Y., Deng, Q., Shen, J., Liang, X., & Jiang, L. (2017) · Design, Automation & Test in Europe Conference & Exhibition (DATE), 2017 · doi:10.23919/date.2017.7926952 · Cited by 245
“A software-based solution is proposed in [2] to mitigate the variation on memristor device.”
BackgroundMethodInfluentialPerspective: A review on memristive hardware for neuromorphic computation
Sung, C., Hwang, H., & Yoo, I. K. (2018) · Journal of Applied Physics · doi:10.1063/1.5037835 · Cited by 217
Marinella, M. J., Agarwal, S., Hsia, A., Richter, I., Jacobs-Gedrim, R., Niroula, J., Plimpton, S. J., Ipek, E., & James, C. D. (2018) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2018.2796379 · Cited by 183
Stuck-at Fault Tolerance in RRAM Computing Systems
Xia, L., Huangfu, W., Tang, T., Yin, X., Chakrabarty, K., Xie, Y., Wang, Y., & Yang, H. (2018) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2017.2776980 · Cited by 177
“, RRAM-based dot-product operator [4], [20], RRAM-based fully-connected Neural Networks (NN) [21], [22], and RRAM-based convolutional neural networks [15], [23].”
Chakraborty, I., Ali, M., Ankit, A., Jain, S., Roy, S., Sridharan, S., Agrawal, A., Raghunathan, A., & Roy, K. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2020.3003007 · Cited by 140
“On the other hand, one-transistor–one-memristive (1T-1R) device crossbars have exhibited MVM computations with fewer errors [88], [89], in comparison to 1S-1R crossbars.”
BackgroundMethodInfluentialThree-Dimensional nand Flash for Vector–Matrix Multiplication
Wang, P., Xu, F., Wang, B., Gao, B., Wu, H., Qian, H., & Yu, S. (2019) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2018.2882194 · Cited by 132
Mixed-Precision Deep Learning Based on Computational Memory
Nandakumar, S. R., Le Gallo, M., Piveteau, C., Joshi, V., Mariani, G., Boybat, I., Karunaratne, G., Khaddam-Aljameh, R., Egger, U., Petropoulos, A., et al. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.00406 · Cited by 120
On the Accuracy of Analog Neural Network Inference Accelerators
Xiao, T. P., Feinberg, B., Bennett, C. H., Prabhakar, V., Saxena, P., Agrawal, V., Agarwal, S., & Marinella, M. J. (2022) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2022.3214409 · Cited by 76
An Energy-Efficient Digital ReRAM-Crossbar-Based CNN With Bitwise Parallelism
Ni, L., Liu, Z., Yu, H., & Joshi, R. V. (2017) · IEEE Journal on Exploratory Solid-State Computational Devices and Circuits · doi:10.1109/jxcdc.2017.2697910 · Cited by 74
Mao, R., Wen, B., Kazemi, A., Zhao, Y., Laguna, A. F., Lin, R., Wong, N., Niemier, M., Hu, X. S., Sheng, X., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-33629-7 · Cited by 71
Self-citationAnalog/Mixed-Signal Hardware Error Modeling for Deep Learning Inference
Rekhi, A. S., Zimmer, B., Nedovic, N., Liu, N., Venkatesan, R., Wang, M., Khailany, B., Dally, W. J., & Gray, C. T. (2019) · Proceedings of the 56th Annual Design Automation Conference 2019 · doi:10.1145/3316781.3317770 · Cited by 67
AI hardware acceleration with analog memory: Microarchitectures for low energy at high speed
Chang, H.-Y., Narayanan, P., Lewis, S. C., Farinha, N. C. P., Hosokawa, K., Mackin, C., Tsai, H., Ambrogio, S., Chen, A., & Burr, G. W. (2019) · IBM Journal of Research and Development · doi:10.1147/jrd.2019.2934050 · Cited by 62
Stuck-at-Fault Tolerant Schemes for Memristor Crossbar Array-Based Neural Networks
Yeo, I., Chu, M., Gi, S.-G., Hwang, H., & Lee, B.-G. (2019) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2019.2914460 · Cited by 55
A Compact Model of Analog RRAM With Device and Array Nonideal Effects for Neuromorphic Systems
Liao, Y., Gao, B., Xu, F., Yao, P., Chen, J., Zhang, W., Tang, J., Wu, H., & Qian, H. (2020) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2020.2975314 · Cited by 53
Bavandpour, M., Sahay, S., Mahmoodi, M. R., & Strukov, D. B. (2021) · Neuromorphic Computing and Engineering · doi:10.1088/2634-4386/ac0775 · Cited by 45
Brain-inspired computing systems: a systematic literature review
Zolfagharinejad, M., Alegre-Ibarra, U., Chen, T., Kinge, S., & van der Wiel, W. G. (2024) · The European Physical Journal B · doi:10.1140/epjb/s10051-024-00703-6 · Cited by 39
Aguirre, F. L., Pazos, S. M., Palumbo, F., Sune, J., & Miranda, E. (2020) · IEEE Access · doi:10.1109/access.2020.3035638 · Cited by 36
“…only positive weights, so that In the next step, the conductance matrices G M and G M (6 and 7) to be mapped into the CPAs are calculated by the linear transformation [20], [74]: where [ G min , G max ] is a selected conductance range for a linear computation in matrix-vector calculations.”
MethodPhase-Change Memory Models for Deep Learning Training and Inference
Nandakumar, S. R., Boybat, I., Joshi, V., Piveteau, C., Le Gallo, M., Rajendran, B., Sebastian, A., & Eleftheriou, E. (2019) · 2019 26th IEEE International Conference on Electronics, Circuits and Systems (ICECS) · doi:10.1109/icecs46596.2019.8964852 · Cited by 34
Aguirre, F. L., Gomez, N. M., Pazos, S. M., Palumbo, F., Suñé, J., & Miranda, E. (2021) · Journal of Low Power Electronics and Applications · doi:10.3390/jlpea11010009 · Cited by 14
“culated by the linear transformation [52]:”
Chen, Q., Han, T., Tang, M., Zhang, Z., Zheng, X., & Liu, G. (2020) · Micromachines · doi:10.3390/mi11040427 · Cited by 9
Gonugondla, S. K., Patil, A. D., & Shanbhag, N. R. (2020) · IEEE/ACM ICCAD · doi:10.1145/3400302.3415642 · Cited by 6
Metadata
- Authors
- Hu, M., Strachan, J. P., Li, Z., Grafals, E. M., Davila, N., Graves, C., Lam, S., Ge, N., Yang, J. J., & Williams, R. S.
- Venue
- Proceedings of the 53rd Annual Design Automation Conference
- Publisher
- ACM
- Published
- 2016-06-05
- Pages
- 1-6
- ISSN
- 0738-100X (ISSN-L)
- OpenAlex
- W2399958287
- Cited by
- 686
- References
- 18
- FWCI
- 99.88
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.