Dot-product engine as computing memory to accelerate machine learning algorithms
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Currently, intense work is underway to develop memristor crossbar arrays for high density, nonvolatile memory applications. However, another capability of memristor crossbars - natural dot-product operation for vectors and matrices - holds even greater potential for next-generation computing, including accelerators, neuromorphic computing, and heterogeneous computing. In this paper, we present a dot-product engine (DPE) based on memristor crossbars optimized for dense matrix computation, which is dominated in most machine learning algorithms. We explored multiple methods to enhance DPE's dot-product computing accuracy. Moreover, instead of training crossbars, we try to directly use existing software-trained weight matrices on DPEs so no heroic effort is needed to innovate learning algorithms for new hardware. Our results show that computations utilizing DPEs can achieve 1000 ~ 10000 times better speed-efficiency product comparing to a state-of-art ASIC [1]. And machine learning algorithm utilizing DPEs can easily achieve software-level accuracy on testing. Both experimental demonstrations and data-calibrated circuit simulations are presented to demonstrate the realistic implementation of a memristor crossbar DPE.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Memristive devices for computing
Yang, J. J., Strukov, D. B., & Stewart, D. R. (2013) · Nature Nanotechnology · doi:10.1038/nnano.2012.240 · Cited by 3,885 · cited 1×
“However, by using a memristor crossbar array matrix computation can be performed in a highly parallel way and consuming very low power, reducing scaling from O(n2) to O(1)[3]: by applying a vector of voltage signals to the rows of a memristor crossbar, multiplication by each memristor element’s conductance is carried…”
MethodTraining and operation of an integrated neuromorphic network based on metal-oxide memristors
Prezioso, M., Merrikh-Bayat, F., Hoskins, B. D., Adam, G. C., Likharev, K. K., & Strukov, D. B. (2015) · Nature · doi:10.1038/nature14441 · Cited by 3,001 · cited 1×
“Some researchers use hardware training schemes to minimize computing error [8][9][10][11].”
BackgroundHigh precision tuning of state for memristive devices by adaptable variation-tolerant algorithm
Alibart, F., Gao, L., Hoskins, B. D., & Strukov, D. B. (2012) · Nanotechnology · doi:10.1088/0957-4484/23/7/075201 · Cited by 557 · cited 1×
“Feedback approaches can lead to nearly arbitrarily high accuracy of the memristor states with the cost of increased programming time [16].”
BackgroundVortex: variation-aware training for memristor X-bar
Liu, B., Li, H., Chen, Y., Li, X., Wu, Q., & Huang, T. (2015) · Proceedings of the 52nd Annual Design Automation Conference · doi:10.1145/2744769.2744930 · Cited by 197
Cited by
Memristive crossbar arrays for brain-inspired computing
Xia, Q., & Yang, J. J. (2019) · Nature Materials · doi:10.1038/s41563-019-0291-x · Cited by 1,800
Efficient and self-adaptive in-situ learning in multilayer memristor neural networks
Li, C., Belkin, D., Li, Y., Yan, P., Hu, M., Ge, N., Jiang, H., Montgomery, E., Lin, P., Wang, Z., et al. (2018) · Nature Communications · doi:10.1038/s41467-018-04484-2 · Cited by 931
“4: d The simulation of a larger network constructed on a larger memristor crossbar (1024 × 512) with experimental parameters (e.g., 11% defect rate) could achieve accuracy above 97%, which suggests a large memristor network could narrow the accuracy performance gap from the conventional CMOS hardware.”
MethodInfluentialSelf-citationBayat, F. M., Prezioso, M., Chakrabarti, B., Nili, H., Kataeva, I., & Strukov, D. (2018) · Nature Communications · doi:10.1038/s41467-018-04482-4 · Cited by 377
Jang, J., Gi, S., Yeo, I., Choi, S., Jang, S., Ham, S., Lee, B., & Wang, G. (2022) · Advanced Science · doi:10.1002/advs.202201117 · Cited by 68
Nonideality‐Aware Training for Accurate and Robust Low‐Power Memristive Neural Networks
Joksas, D., Wang, E., Barmpatsalos, N., Ng, W. H., Kenyon, A. J., Constantinides, G. A., & Mehonic, A. (2022) · Advanced Science · doi:10.1002/advs.202105784 · Cited by 39
“For general applications, mapping or redundancy schemes can be used to mitigate the effects of faulty-devices [27] or line resistance [28].”
BackgroundMemristor-based perceptron classifier: Increasing complexity and coping with imperfect hardware
Bayat, F. M., Prezioso, M., Chakrabarti, B., Kataeva, I., & Strukov, D. (2017) · 2017 IEEE/ACM International Conference on Computer-Aided Design (ICCAD) · doi:10.1109/iccad.2017.8203825 · Cited by 29
Metadata
- Authors
- Hu, M., Strachan, J. P., Li, Z., Stanley, R., & Williams
- Venue
- 2016 17th International Symposium on Quality Electronic Design (ISQED)
- Publisher
- IEEE
- Published
- 2016-03
- Pages
- 374-379
- OpenAlex
- W2402807508
- Cited by
- 50
- References
- 4
- FWCI
- 8.48
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.