The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Dot-product engine for neuromorphic computing: programming 1T1M crossbar to accelerate matrix-vector multiplication
Abstract
Vector-matrix multiplication dominates the computation time and energy for many workloads, particularly neural network algorithms and linear transforms (e.g, the Discrete Fourier Transform). Utilizing the natural current accumulation feature of memristor crossbar, we developed the Dot-Product Engine (DPE) as a high density, high power efficiency accelerator for approximate matrix-vector multiplication. We firstly invented a conversion algorithm to map arbitrary matrix values appropriately to memristor conductances in a realistic crossbar array, accounting for device physics and circuit issues to reduce computational errors. The accurate device resistance programming in large arrays is enabled by close-loop pulse tuning and access transistors. To validate our approach, we simulated and benchmarked one of the state-of-the-art neural networks for pattern recognition on the DPEs. The result shows no accuracy degradation compared to software approach (99 % pattern recognition accuracy for MNIST data set) with only 4 Bit DAC/ADC requirement, while the DPE can achieve a speed-efficiency product of 1,000× to 10,000× compared to a custom digital ASIC.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Nanoscale Memristor Device as Synapse in Neuromorphic Systems
Jo, S. H., Chang, T., Ebong, I., Bhadviya, B. B., Mazumder, P., & Lu, W. (2010) · Nano Letters · doi:10.1021/nl904092h · Cited by 4,174 · cited 2×
“For analog computing applications, memristors are desired to have stable, continuous linear conductance states for representing matrix values [13].”
BackgroundMemristive devices for computing
Yang, J. J., Strukov, D. B., & Stewart, D. R. (2013) · Nature Nanotechnology · doi:10.1038/nnano.2012.240 · Cited by 3,885
Self-citationTraining and operation of an integrated neuromorphic network based on metal-oxide memristors
Prezioso, M., Merrikh-Bayat, F., Hoskins, B. D., Adam, G. C., Likharev, K. K., & Strukov, D. B. (2015) · Nature · doi:10.1038/nature14441 · Cited by 3,001 · cited 3×
“Some researchers use hardware training schemes to minimize errors [6, 7, 8, 9].”
BackgroundWong, H.-S. P., Lee, H.-Y., Yu, S., Chen, Y.-S., Wu, Y., Chen, P.-S., Lee, B., Chen, F. T., & Tsai, M.-J. (2012) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2190369 · Cited by 2,757
High precision tuning of state for memristive devices by adaptable variation-tolerant algorithm
Alibart, F., Gao, L., Hoskins, B. D., & Strukov, D. B. (2012) · Nanotechnology · doi:10.1088/0957-4484/23/7/075201 · Cited by 557 · cited 1×
“After the conversion, we use close-loop tuning scheme [16]to program memristors to the desired conductance values.”
MethodLearning a Nonlinear Embedding by Preserving Class Neighbourhood Structure
Salakhutdinov, R., & Hinton, G. E. (2007) · International Conference on Artificial Intelligence and Statistics · Cited by 440
Memristor Crossbar-Based Neuromorphic Computing System: A Case Study
Hu, M., Li, H., Chen, Y., Wu, Q., Rose, G. S., & Linderman, R. W. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2296777 · Cited by 414
Self-citationUnderstanding the efficiency of GPU algorithms for matrix-matrix multiplication
Fatahalian, K., Sugerman, J., & Hanrahan, P. (2004) · Proceedings of the ACM SIGGRAPH/EUROGRAPHICS conference on Graphics hardware · doi:10.1145/1058129.1058148 · Cited by 309
Endurance/Retention Trade-off on $\hbox{HfO}_{2}/\hbox{Metal}$ Cap 1T1R Bipolar RRAM
Chen, Y. Y., Goux, L., Clima, S., Govoreanu, B., Degraeve, R., Kar, G. S., Fantini, A., Groeseneken, G., Wouters, D. J., & Jurczak, M. (2013) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2013.2241064 · Cited by 271
Sheu, S.-S., Chang, M.-F., Lin, K.-F., Wu, C.-W., Chen, Y.-S., Chiu, P.-F., Kuo, C.-C., Yang, Y.-S., Chiang, P.-C., Lin, W.-P., et al. (2011) · 2011 IEEE International Solid-State Circuits Conference · doi:10.1109/isscc.2011.5746281 · Cited by 246
Burr, G. W., Shelby, R. M., di Nolfo, C., Jang, J. W., Shenoy, R. S., Narayanan, P., Virwani, K., Giacometti, E. U., Kurdi, B., & Hwang, H. (2014) · 2014 IEEE International Electron Devices Meeting · doi:10.1109/iedm.2014.7047135 · Cited by 208
Vortex: variation-aware training for memristor X-bar
Liu, B., Li, H., Chen, Y., Li, X., Wu, Q., & Huang, T. (2015) · Proceedings of the 52nd Annual Design Automation Conference · doi:10.1145/2744769.2744930 · Cited by 197
Hardware realization of BSB recall function using memristor crossbar arrays
Hu, M., Li, H., Wu, Q., & Rose, G. S. (2012) · Proceedings of the 49th Annual Design Automation Conference · doi:10.1145/2228360.2228448 · Cited by 187
Self-citationTechnological Exploration of RRAM Crossbar Array for Matrix-Vector Multiplication
Xia, L., Gu, P., Li, B., Tang, T., Yin, X., Huangfu, W., Yu, S., Cao, Y., Wang, Y., & Yang, H. (2016) · Journal of Computer Science and Technology · doi:10.1007/s11390-016-1608-8 · Cited by 183
Random telegraph noise and resistance switching analysis of oxide based resistive memory
Choi, S., Yang, Y., & Lu, W. D. (2013) · Nanoscale · doi:10.1039/c3nr05016e · Cited by 136
Data Clustering using Memristor Networks
Choi, S., Sheridan, P., & Lu, W. D. (2015) · Scientific Reports · doi:10.1038/srep10492 · Cited by 132
Technological exploration of RRAM crossbar array for matrix-vector multiplication
Gu, P., Li, B., Tang, T., Yu, S., Cao, Y. K., Wang, Y., & Yang, H. (2015) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/aspdac.2015.7058989 · Cited by 81
Mapping weight matrix of a neural network’s layer onto memristor crossbar
Tarkov, M. S. (2015) · Optical Memory and Neural Networks · doi:10.3103/s1060992x15020125 · Cited by 18
Cited by
Towards spike-based machine intelligence with neuromorphic computing
Roy, K., Jaiswal, A., & Panda, P. (2019) · Nature · doi:10.1038/s41586-019-1677-2 · Cited by 2,190
The future of electronics based on memristive systems
Zidan, M. A., Strachan, J. P., & Lu, W. D. (2018) · Nature Electronics · doi:10.1038/s41928-017-0006-8 · Cited by 2,138
Self-citationParallel convolutional processing using an integrated photonic tensor core
Feldmann, J., Youngblood, N., Karpov, M., Gehring, H., Li, X., Stappers, M., Le Gallo, M., Fu, X., Lukashchuk, A., Raja, A. S., et al. (2021) · Nature · doi:10.1038/s41586-020-03070-1 · Cited by 1,900
“Moreover, they are plagued by the same limitations of electronic addressing 20 , with additional challenges in the manufacturing and implementation due to issues with device variability 21,22 , cyclability 23 and drift 24,25 .”
BackgroundISAAC: a convolutional neural network accelerator with in-situ analog arithmetic in crossbars
Shafiee, A., Nag, A., Muralimanohar, N., Balasubramonian, R., Strachan, J. P., Hu, M., Williams, R. S., & Srikumar, V. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001139 · Cited by 1,536
Self-citationNeuro-Inspired Computing With Emerging Nonvolatile Memorys
Yu, S. (2018) · Proceedings of the IEEE · doi:10.1109/jproc.2018.2790840 · Cited by 1,170
“[99] developed a 64 × 64 TiOx-based 1T1R array with 6-b (64 levels) offline training and a single-layer perceptron for MNIST image recognition.”
Method
Metadata
- Authors
- Hu, M., Strachan, J. P., Li, Z., Grafals, E. M., Davila, N., Graves, C., Lam, S., Ge, N., Yang, J. J., & Williams, R. S.
- Venue
- Proceedings of the 53rd Annual Design Automation Conference
- Publisher
- ACM
- Published
- 2016-06-05
- Pages
- 1-6
- ISSN
- 0738-100X (ISSN-L)
- OpenAlex
- W2399958287
- Cited by
- 686
- References
- 18
- FWCI
- 99.88
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.