CoChat

FPSA: A Full System Stack Solution for Reconfigurable ReRAM-based NN Accelerator Architecture

Open access
Ji, Yu, Zhang, Youyang, Xie, Xinfeng, Li, Shuangchen, Wang, Peiqi, Hu, Xing, Zhang, Youhui, Xie, Yuan · 2019 · Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems
Cited by 63

The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.

Abstract

Neural Network (NN) accelerators with emerging ReRAM (resistive random access memory) technologies have been investigated as one of the promising solutions to address the memory wall challenge, due to the unique capability of processing-in-memory within ReRAM-crossbar-based processing elements (PEs). However, the high efficiency and high density advantages of ReRAM have not been fully utilized due to the huge communication demands among PEs and the overhead of peripheral circuits. In this paper, we propose a full system stack solution, composed of a reconfigurable architecture design, Field Programmable Synapse Array (FPSA) and its software system including neural synthesizer, temporal-to-spatial mapper, and placement & routing. We highly leverage the software system to make the hardware design compact and efficient. To satisfy the high-performance communication demand, we optimize it with a reconfigurable routing architecture and the placement & routing tool. To improve the computational density, we greatly simplify the PE circuit with the spiking schema and then adopt neural synthesizer to enable the high density computation-resources to support different kinds of NN operations. In addition, we provide spiking memory blocks (SMBs) and configurable logic blocks (CLBs) in hardware and leverage the temporal-to-spatial mapper to utilize them to balance the storage and computation requirements of NN. Owing to the end-to-end software system, we can efficiently deploy existing deep neural networks to FPSA. Evaluations show that, compared to one of state-of-the-art ReRAM-based NN accelerators, PRIME, the computational density of FPSA improves by 31x; for representative NNs, its inference performance can achieve up to 1000x speedup.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3297858.3304048

Cites

11 of 11 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 11 references

Research works printed but not linked: 36

  1. 10.5555/3026877.3026899 · doi:10.5555/3026877.3026899 · Paper page
  2. 10.1109/TNNLS.2012.2204770 · DOI · Paper page
  3. 10.1109/ISCA.2016.11 · DOI · Paper page
  4. 10.5555/3045390.3045410 · doi:10.5555/3045390.3045410
  5. 10.1145/2541940.2541967 · DOI · Paper page
  6. Tianqi Chen, Mu Li, Yutian Li, Min Lin, Naiyan Wang, Minjie Wang, Tianjun Xiao, Bing Xu, Chiyuan Zhang, and Zheng Zhang. 2015. MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems. CoRR, Vol. abs/1512.01274 (2015). arxiv: 1512.01274 http://arxiv.org/abs/1512.01274 · arXiv
  7. 10.1109/ISCA.2016.40 · DOI · Paper page
  8. 10.1109/MICRO.2014.58 · DOI · Paper page
  9. 10.1109/ISCA.2016.13 · DOI · Paper page
  10. 10.1109/NANOARCH.2011.5941476 · DOI
  11. 10.1109/TCAD.2012.2185930 · DOI · Paper page
  12. 10.1145/2749469.2750389 · DOI · Paper page
  13. Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep Residual Learning for Image Recognition. In 2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016, Las Vegas, NV, USA, June 27--30, 2016. IEEE Computer Society, 770--778.
  14. 10.1145/2897937.2898010 · DOI · Paper page
  15. Giacomo Indiveri, Bernabé Linares-Barranco, Robert A. Legenstein, George Deligeorgis, and Themistoklis Prodromakis. 2013. Integration of nanoscale memristor synapses in neuromorphic computing architectures. CoRR, Vol. abs/1302.7007 (2013). arxiv: 1302.7007 http://arxiv.org/abs/1302.7007 · arXiv
  16. 10.1145/3173162.3173205 · DOI
  17. 10.5555/3195638.3195663 · doi:10.5555/3195638.3195663
  18. Sung Hyun Jo, Ting Chang, Idongesit Ebong, Bhavitavya B Bhadviya, Pinaki Mazumder, and Wei Lu. 2010. Nanoscale memristor device as synapse in neuromorphic systems. Nano letters, Vol. 10, 4 (2010), 1297--1301.
  19. 10.1109/ISCA.2016.41 · DOI · Paper page
  20. 10.1109/TCSI.2011.2161360 · DOI · Paper page
  21. 10.5555/2999134.2999257 · doi:10.5555/2999134.2999257
  22. 10.1145/3173162.3173176 · DOI · Paper page
  23. Yann LeCun et almbox. 2015. LeNet-5, convolutional neural networks. URL: http://yann.lecun.com/exdb/lenet (2015), 20.
  24. 10.1109/ISCA.2016.31 · DOI · Paper page
  25. 10.1145/2694344.2694358 · DOI · Paper page
  26. 10.1145/2744769.2744900 · DOI · Paper page
  27. 10.1016/j.mejo.2014.04.014 · DOI
  28. Adam Paszke Sam Gross Soumith Chintala Gregory Chanan Edward Yang Zachary DeVito Zeming Lin Alban Desmaison Luca Antiga and Adam Lerer. 2017. Automatic differentiation in PyTorch. In NIPS-W.
  29. 10.1109/ISCA.2016.32 · DOI · Paper page
  30. Karen Simonyan and Andrew Zisserman. 2014. Very Deep Convolutional Networks for Large-Scale Image Recognition. CoRR, Vol. abs/1409.1556 (2014). arxiv: 1409.1556 http://arxiv.org/abs/1409.1556 · arXiv
  31. Linghao Song, Xuehai Qian, Hai Li, and Yiran Chen. 2017. PipeLayer: A Pipelined ReRAM-Based Accelerator for Deep Learning. In 2017 IEEE International Symposium on High Performance Computer Architecture, HPCA 2017, Austin, TX, USA, February 4--8, 2017. IEEE Computer Society, 541--552.
  32. 10.5555/2969033.2969173 · doi:10.5555/2969033.2969173
  33. 10.1109/CVPR.2015.7298594 · DOI · Paper page
  34. 10.1109/IVSW.2016.7566607 · DOI
  35. 10.1109/ISCAS.2010.5537010 · DOI
  36. 10.1007/s11390-016-1608-8 · DOI · Paper page

Cited by

See all 63

Metadata

Authors
Ji, Y., Zhang, Y., Xie, X., Li, S., Wang, P., Hu, X., Zhang, Y., & Xie, Y.
Venue
Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems
Publisher
ACM
Published
2019-04-04
Pages
733-747
OpenAlex
W2913431662
Cited by
63
References
11
FWCI
16.64
Type
conference paper
Language
en
Open access
bronze
Funders
NSF (1500848 1719160 1725447 and 1730309)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: FPSA: A Full System Stack Solution for Reconfigurable ReRAM-based NN Accelerator Architecture. https://app.cochat.ai/papers/10.1145/3297858.3304048
The paper
Ji, Y., Zhang, Y., Xie, X., Li, S., Wang, P., Hu, X., Zhang, Y., & Xie, Y. (2019). FPSA: A Full System Stack Solution for Reconfigurable ReRAM-based NN Accelerator Architecture. Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems. https://doi.org/10.1145/3297858.3304048

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.