CoChat
Sign Up
PreprintCited by 10Advanced Memory and Neural ComputingParallel Computing and Optimization TechniquesInterconnection Networks and Systems

The DOI matches its DataCite record; 5 of the 5 references it cites were found in a registry or an index.

5 Parallel Prism: A topology for pipelined implementations of convolutional neural networks using computational memory

Open access
Dazzi, Martino, Sebastian, Abu, Francese, Pier Andrea, Parnell, Thomas, Benini, Luca, Eleftheriou, Evangelos·2019·arXiv
DOI 10.48550/arxiv.1906.03474arXiv 1906.03474
Open this paper in CoChat — free accountOpen PDF

Abstract

In-memory computing is an emerging computing paradigm that could enable deeplearning inference at significantly higher energy efficiency and reduced latency. The essential idea is to map the synaptic weights corresponding to each layer to one or more computational memory (CM) cores. During inference, these cores perform the associated matrix-vector multiply operations in place with O(1) time complexity, thus obviating the need to move the synaptic weights to an additional processing unit. Moreover, this architecture could enable the execution of these networks in a highly pipelined fashion. However, a key challenge is to design an efficient communication fabric for the CM cores. Here, we present one such communication fabric based on a graph topology that is well suited for the widely successful convolutional neural networks (CNNs). We show that this communication fabric facilitates the pipelined execution of all state of-the-art CNNs by proving the existence of a homomorphism between one graph representation of these networks and the proposed graph topology. We then present a quantitative comparison with established communication topologies and show that our proposed topology achieves the lowest bandwidth requirements per communication channel. Finally, we present a concrete example of mapping ResNet-32 onto an array of CM cores.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1906.03474

Cites

5 of 5 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The ResNet-32 implementation with 5PP can result in potentially 2× improvement in pipeline stage latency with similar bandwidth requirements compared with a standard 2D-mesh.

    “the ResNet-32 implementation with 5PP can result in potentially 2× improvement in pipeline stage latency with similar bandwidth requirements compared with a standard 2D-mesh.”

    From Accurate deep neural network inference using computational phase-change memory (2020) · cites this paper as [48]

    The Quantitative Evaluation (p. 7) says that 5PP avoids pipeline stalls while 2D meshes stall for ResNet-32, supporting a latency advantage. It compares bandwidth requirements in Figure 7b, but the available text does not establish a 2× ResNet-32 latency improvement or similar bandwidth requirements for ResNet-32 and a 2D mesh. (LLM, conf=0.82)

    Experimental — accuracy not yet measured

  • The proposed 5PP topology allows the mapping of all the primary connectivities of state-of-the-art neural networks, including ResNet, DenseNet and Inception-style networks.

    “The proposed 5PP topology allows the mapping of all the primary connectivities of state-of-the-art neural networks, including ResNet, DenseNet and Inception-style networks48.”

    From Accurate deep neural network inference using computational phase-change memory (2020) · cites this paper as [48]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Flagged first, then by citations

Research works printed but not linked: 16

  1. [1][1] G. W. Burr et al. Neuromorphic computing using non-volatile memory. Advances in Physics: X , 2(1):89-124, 2017. -
  2. [2][2] C. Farabet, B. Martini, B. Corda, P. Akselrod, E. Culurciello, and Y. LeCun. NeuFlow: A runtime reconfigurable dataflow processor for vision. In CVPR Workshops , pages 109-116, 2011. -
  3. [3][3] B. Fleischer, S. Shukla, M. Ziegler, J. Silberman, J. Oh, V. Srinivasan, J. Choi, S. Mueller, A. Agrawal, T. Babinsky, et al. A scalable multi-teraOPS deep learning processor core for AI training and inference. In Proceedings of the IEEE Symposium on VLSI Circuits , pages 35-36. IEEE, 2018. -
  4. [5][5] P. Hell and J. Nešetˇ ril. On the complexity of H-coloring. Journal of Combinatorial Theory, Series B , 48(1):92-110, 1990. -
  5. [6][6] M. Hu, C. E. Graves, C. Li, Y. Li, N. Ge, E. Montgomery, N. Davila, H. Jiang, R. S. Williams, J. J. Yang, et al. Memristor-based analog computation and neural network classification with a dot product engine. Advanced Materials , 30(9):1705914, 2018. -
  6. [7][7] G. Huang, Z. Liu, L. Van Der Maaten, and K. Q. Weinberger. Densely connected convolutional networks. In Proceedings of the IEEE conference on computer vision and pattern recognition , pages 4700-4708, 2017. -
  7. [8][8] D. Ielmini and H.-S. P. Wong. In-memory computing with resistive switching devices. Nature Electronics , 1(6):333, 2018. -
  8. [9][9] N. P. Jouppi, C. Young, N. Patil, D. Patterson, G. Agrawal, R. Bajwa, S. Bates, S. Bhatia, N. Boden, A. Borchers, et al. In-datacenter performance analysis of a tensor processing unit. In Proceedings of the 44th Annual International Symposium on Computer Architecture , pages 1-12. ACM, 2017. -
  9. [11][11] W. Lu, G. Yan, J. Li, S. Gong, Y. Han, and X. Li. Flexflow: A flexible dataflow accelerator architecture for convolutional neural networks. In 2017 IEEE International Symposium on High Performance Computer Architecture (HPCA) , pages 553-564. IEEE, 2017. -
  10. [12][12] M. Prezioso, F. Merrikh-Bayat, B. Hoskins, G. C. Adam, K. K. Likharev, and D. B. Strukov. Training and operation of an integrated neuromorphic network based on metal-oxide memristors. Nature , 521(7550):61, 2015. -
  11. [13][13] E. Sacco, P. A. Francese, M. Brändli, C. Menolfi, T. Morf, A. Cevrero, I. Ozkaya, M. Kossel, L. Kull, D. Luu, et al. A 5Gb/s 7.1 fj/b/mm 8 × multi-drop on-chip 10mm data link in 14nm FinFET CMOS SOI at 0.5 v. In 2017 Symposium on VLSI Circuits , pages C54-C55. IEEE, 2017. -
  12. [14][14] D. Sanchez, G. Michelogiannakis, and C. Kozyrakis. An analysis of on-chip interconnection networks for large-scale chip multiprocessors. ACM Transactions on Architecture and Code Optimization (TACO) , 7(1):4, 2010. -
  13. [15][15] A. Sebastian, I. Boybat, M. Dazzi, I. Giannopoulos, et al. Computational memory-based inference and training of deep neural networks. In Proceedings of the IEEE Symposium on VLSI Circuits , 2019. -
  14. [16][16] A. Shafiee, A. Nag, N. Muralimanohar, R. Balasubramonian, J. P. Strachan, M. Hu, R. S. Williams, and V. Srikumar. ISAAC: A convolutional neural network accelerator with in-situ analog arithmetic in crossbars. ACM SIGARCH Computer Architecture News , 44(3):14-26, 2016. -
  15. [17][17] N. Wang, J. Choi, D. Brand, C.-Y. Chen, and K. Gopalakrishnan. Training deep neural networks with 8-bit floating point numbers. In Advances in neural information processing systems , pages 7675-7684, 2018. -
  16. [18][18] Q. Xia and J. J. Yang. Memristive crossbar arrays for brain-inspired computing. Nature materials , 18(4):309, 2019.

Cited by

Sorted by citations

Metadata

Authors
Dazzi, M., Sebastian, A., Francese, P. A., Parnell, T., Benini, L., & Eleftheriou, E.
Affiliations
  • ETH Zurich (CH)
  • IBM Research - Zurich (CH)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2019
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.1906.03474
arXiv
1906.03474
OpenAlex
W2948865776
Cited by
10
References
5
Citations by year
2025: 1 · 2023: 1 · 2021: 3 · 2020: 5
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
  • Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques
  • Physical Sciences › Computer Science › Computer Networks and Communications › Interconnection Networks and Systems
Keywords
in-memory computing, convolutional neural networks, graph topology, communication fabrics, graph homomorphisms, matrix-vector multiplication, bandwidth requirements, energy efficiency

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review