FPSA: A Full System Stack Solution for Reconfigurable ReRAM-based NN Accelerator Architecture
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Neural Network (NN) accelerators with emerging ReRAM (resistive random access memory) technologies have been investigated as one of the promising solutions to address the memory wall challenge, due to the unique capability of processing-in-memory within ReRAM-crossbar-based processing elements (PEs). However, the high efficiency and high density advantages of ReRAM have not been fully utilized due to the huge communication demands among PEs and the overhead of peripheral circuits. In this paper, we propose a full system stack solution, composed of a reconfigurable architecture design, Field Programmable Synapse Array (FPSA) and its software system including neural synthesizer, temporal-to-spatial mapper, and placement & routing. We highly leverage the software system to make the hardware design compact and efficient. To satisfy the high-performance communication demand, we optimize it with a reconfigurable routing architecture and the placement & routing tool. To improve the computational density, we greatly simplify the PE circuit with the spiking schema and then adopt neural synthesizer to enable the high density computation-resources to support different kinds of NN operations. In addition, we provide spiking memory blocks (SMBs) and configurable logic blocks (CLBs) in hardware and leverage the temporal-to-spatial mapper to utilize them to balance the storage and computation requirements of NN. Owing to the end-to-end software system, we can efficiently deploy existing deep neural networks to FPSA. Evaluations show that, compared to one of state-of-the-art ReRAM-based NN accelerators, PRIME, the computational density of FPSA improves by 31x; for representative NNs, its inference performance can achieve up to 1000x speedup.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
In-Datacenter Performance Analysis of a Tensor Processing Unit
Jouppi, N. P., Young, C., Patil, N., Patterson, D., Agrawal, G., Bajwa, R., Bates, S., Bhatia, S., Boden, N., Borchers, A., et al. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080246 · Cited by 4,537 · cited 1×
“Thus, there are a lot of NN accelerators [3, 5, 7, 8, 13, 15, 22, 23, 30, 32, 38] based on mature digital circuits to speedup NN computations.”
BackgroundTraining and operation of an integrated neuromorphic network based on metal-oxide memristors
Prezioso, M., Merrikh-Bayat, F., Hoskins, B. D., Adam, G. C., Likharev, K. K., & Strukov, D. B. (2015) · Nature · doi:10.1038/nature14441 · Cited by 3,001 · cited 1×
“To further increase the performance and eliminate other problems such asmemory wall, quite a few studies on ReRAM based NN accelerators and neuromorphic hardware [2, 9, 18, 21, 24, 33, 36, 37, 39, 41, 44] have also been proposed.”
BackgroundEyeriss: a spatial architecture for energy-efficient dataflow for convolutional neural networks
Chen, Y.-H., Emer, J., & Sze, V. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001177 · Cited by 1,182 · cited 3×
“For example, Eyeriss [7] achieves 35 frame/s throughput and 115.”
BackgroundEIE: Efficient Inference Engine on Compressed Deep Neural Network
Han, S., Liu, X., Mao, H., Pu, J., Pedram, A., Horowitz, M. A., & Dally, W. J. (2016) · 2016 ACM/IEEE 43rd Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca.2016.30 · Cited by 1,077
Experimental demonstration of associative memory with memristive neural networks
Pershin, Y. V., & Di Ventra, M. (2010) · Neural Networks · doi:10.1016/j.neunet.2010.05.001 · Cited by 1,041
Face classification using electronic synapses
Yao, P., Wu, H., Gao, B., Eryilmaz, S. B., Huang, X., Zhang, W., Zhang, Q., Deng, N., Shi, L., Wong, H.-S. P., et al. (2017) · Nature Communications · doi:10.1038/ncomms15199 · Cited by 909 · cited 2×
“The variation data is derived from real fabricated ReRAM cells [49].”
BackgroundMethodISAAC: A Convolutional Neural Network Accelerator with In-Situ Analog Arithmetic in Crossbars
Shafiee, A., Nag, A., Muralimanohar, N., Balasubramonian, R., Strachan, J. P., Hu, M., Williams, R. S., & Srikumar, V. (2016) · 2016 ACM/IEEE 43rd Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca.2016.12 · Cited by 775
Memristor−CMOS Hybrid Integrated Circuits for Reconfigurable Logic
Xia, Q., Robinett, W., Cumbie, M. W., Banerjee, N., Cardinali, T. J., Yang, J. J., Wu, W., Li, X., Tong, W. M., Strukov, D. B., et al. (2009) · Nano Letters · doi:10.1021/nl901874j · Cited by 671
Memristor-based neural networks
Thomas, A. (2013) · Journal of Physics D: Applied Physics · doi:10.1088/0022-3727/46/9/093001 · Cited by 471 · cited 1×
“To further increase the performance and eliminate other problems such as memory wall , quite a few studies on ReRAM based NN accelerators and neuromorphic hardware [2, 9, 18, 21, 24, 33, 36, 37, 39, 41, 44] have also been proposed.”
Background
Research works printed but not linked: 36
- 10.5555/3026877.3026899 · doi:10.5555/3026877.3026899 · Paper page
- 10.1109/TNNLS.2012.2204770 · DOI · Paper page
- 10.1109/ISCA.2016.11 · DOI · Paper page
- 10.5555/3045390.3045410 · doi:10.5555/3045390.3045410
- 10.1145/2541940.2541967 · DOI · Paper page
- Tianqi Chen, Mu Li, Yutian Li, Min Lin, Naiyan Wang, Minjie Wang, Tianjun Xiao, Bing Xu, Chiyuan Zhang, and Zheng Zhang. 2015. MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems. CoRR, Vol. abs/1512.01274 (2015). arxiv: 1512.01274 http://arxiv.org/abs/1512.01274 · arXiv
- 10.1109/ISCA.2016.40 · DOI · Paper page
- 10.1109/MICRO.2014.58 · DOI · Paper page
- 10.1109/ISCA.2016.13 · DOI · Paper page
- 10.1109/NANOARCH.2011.5941476 · DOI
- 10.1109/TCAD.2012.2185930 · DOI · Paper page
- 10.1145/2749469.2750389 · DOI · Paper page
- Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep Residual Learning for Image Recognition. In 2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016, Las Vegas, NV, USA, June 27--30, 2016. IEEE Computer Society, 770--778.
- 10.1145/2897937.2898010 · DOI · Paper page
- Giacomo Indiveri, Bernabé Linares-Barranco, Robert A. Legenstein, George Deligeorgis, and Themistoklis Prodromakis. 2013. Integration of nanoscale memristor synapses in neuromorphic computing architectures. CoRR, Vol. abs/1302.7007 (2013). arxiv: 1302.7007 http://arxiv.org/abs/1302.7007 · arXiv
- 10.1145/3173162.3173205 · DOI
- 10.5555/3195638.3195663 · doi:10.5555/3195638.3195663
- Sung Hyun Jo, Ting Chang, Idongesit Ebong, Bhavitavya B Bhadviya, Pinaki Mazumder, and Wei Lu. 2010. Nanoscale memristor device as synapse in neuromorphic systems. Nano letters, Vol. 10, 4 (2010), 1297--1301.
- 10.1109/ISCA.2016.41 · DOI · Paper page
- 10.1109/TCSI.2011.2161360 · DOI · Paper page
- 10.5555/2999134.2999257 · doi:10.5555/2999134.2999257
- 10.1145/3173162.3173176 · DOI · Paper page
- Yann LeCun et almbox. 2015. LeNet-5, convolutional neural networks. URL: http://yann.lecun.com/exdb/lenet (2015), 20.
- 10.1109/ISCA.2016.31 · DOI · Paper page
- 10.1145/2694344.2694358 · DOI · Paper page
- 10.1145/2744769.2744900 · DOI · Paper page
- 10.1016/j.mejo.2014.04.014 · DOI
- Adam Paszke Sam Gross Soumith Chintala Gregory Chanan Edward Yang Zachary DeVito Zeming Lin Alban Desmaison Luca Antiga and Adam Lerer. 2017. Automatic differentiation in PyTorch. In NIPS-W.
- 10.1109/ISCA.2016.32 · DOI · Paper page
- Karen Simonyan and Andrew Zisserman. 2014. Very Deep Convolutional Networks for Large-Scale Image Recognition. CoRR, Vol. abs/1409.1556 (2014). arxiv: 1409.1556 http://arxiv.org/abs/1409.1556 · arXiv
- Linghao Song, Xuehai Qian, Hai Li, and Yiran Chen. 2017. PipeLayer: A Pipelined ReRAM-Based Accelerator for Deep Learning. In 2017 IEEE International Symposium on High Performance Computer Architecture, HPCA 2017, Austin, TX, USA, February 4--8, 2017. IEEE Computer Society, 541--552.
- 10.5555/2969033.2969173 · doi:10.5555/2969033.2969173
- 10.1109/CVPR.2015.7298594 · DOI · Paper page
- 10.1109/IVSW.2016.7566607 · DOI
- 10.1109/ISCAS.2010.5537010 · DOI
- 10.1007/s11390-016-1608-8 · DOI · Paper page
Cited by
A compute-in-memory chip based on resistive random-access memory
Wan, W., Kubendran, R., Schaefer, C., Eryilmaz, S. B., Zhang, W., Wu, D., Deiss, S., Raina, P., Qian, H., Gao, B., et al. (2022) · Nature · doi:10.1038/s41586-022-04992-8 · Cited by 943
Neuro-inspired computing chips
Zhang, W., Gao, B., Tang, J., Yao, P., Yu, S., Chang, M.-F., Yoo, H.-J., Qian, H., & Wu, H. (2020) · Nature Electronics · doi:10.1038/s41928-020-0435-7 · Cited by 892
SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning
Wang, H., Zhang, Z., & Han, S. (2021) · 2021 IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca51647.2021.00018 · Cited by 427
“There have been various domain-specific FPGA and ASIC accelerators proposed for neural networks [31]- [44].”
BackgroundNAS4RRAM: neural network architecture search for inference on RRAM-based accelerators
Yuan, Z., Liu, J., Li, X., Yan, L., Chen, H., Wu, B., Yang, Y., & Sun, G. (2021) · Science China Information Sciences · doi:10.1007/s11432-020-3245-7 · Cited by 30
Metadata
- Authors
- Ji, Y., Zhang, Y., Xie, X., Li, S., Wang, P., Hu, X., Zhang, Y., & Xie, Y.
- Venue
- Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems
- Publisher
- ACM
- Published
- 2019-04-04
- Pages
- 733-747
- OpenAlex
- W2913431662
- Cited by
- 63
- References
- 11
- FWCI
- 16.64
- Type
- conference paper
- Language
- en
- Open access
- bronze
- Funders
- NSF (1500848 1719160 1725447 and 1730309)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: FPSA: A Full System Stack Solution for Reconfigurable ReRAM-based NN Accelerator Architecture. https://app.cochat.ai/papers/10.1145/3297858.3304048
- The paper
- Ji, Y., Zhang, Y., Xie, X., Li, S., Wang, P., Hu, X., Zhang, Y., & Xie, Y. (2019). FPSA: A Full System Stack Solution for Reconfigurable ReRAM-based NN Accelerator Architecture. Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems. https://doi.org/10.1145/3297858.3304048
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.