A 0.32–128 TOPS, Scalable Multi-Chip-Module-Based Deep Neural Network Inference Accelerator With Ground-Referenced Signaling in 16 nm
The DOI matches its Crossref record; 26 of the 29 references it cites were found in a registry or an index.
Abstract
Custom accelerators improve the energy efficiency, area efficiency, and performance of deep neural network (DNN) inference. This article presents a scalable DNN accelerator consisting of 36 chips connected in a mesh network on a multi-chip-module (MCM) using ground-referenced signaling (GRS). While previous accelerators fabricated on a single monolithic chip are optimal for specific network sizes, the proposed architecture enables flexible scaling for efficient inference on a wide range of DNNs, from mobile to data center domains. Communication energy is minimized with large on-chip distributed weight storage and a hierarchical network-on-chip and network-on-package, and inference energy is minimized through extensive data reuse. The 16-nm prototype achieves 1.29-TOPS/mm2 area efficiency, 0.11 pJ/op (9.5 TOPS/W) energy efficiency, 4.01-TOPS peak performance for a one-chip system, and 127.8 peak TOPS and 1903 images/s ResNet-50 batch-1 inference for a 36-chip system.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“such scaling will enable NeuRRAM to deliver higher energy and area efficiency than today’s state-of-the-art edge inference accelerators58–61.”
From A compute-in-memory chip based on resistive random-access memory (2022) · cites this paper as [59]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018) · arXiv · doi:10.48550/arxiv.1802.02611 · Cited by 20,063
Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_49 · Cited by 20,054
In-Datacenter Performance Analysis of a Tensor Processing Unit
Jouppi, N. P., Young, C., Patil, N., Patterson, D., Agrawal, G., Bajwa, R., Bates, S., Bhatia, S., Boden, N., Borchers, A., et al. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080246 · Cited by 4,537 · cited 1×
“Duetothedeterministic structure of DNNs, fixed-function accelerators have the potential to further improve area effi-ciency, energy efficiency, and performance relative to CPUs and GPUs [6]–[12].”
BackgroundEyeriss: An Energy-Efficient Reconfigurable Accelerator for Deep Convolutional Neural Networks
Chen, Y.-H., Krishna, T., Emer, J. S., & Sze, V. (2017) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2016.2616357 · Cited by 3,247
Self-citationEnd to End Learning for Self-Driving Cars
Bojarski, M., Del Testa, D., Dworakowski, D., Firner, B., Flepp, B., Goyal, P., Jackel, L. D., Monfort, M., Muller, U., Zhang, J., et al. (2016) · arXiv · doi:10.48550/arxiv.1604.07316 · Cited by 3,198
EIE: efficient inference engine on compressed deep neural network
Han, S., Liu, X., Mao, H., Pu, J., Pedram, A., Horowitz, M. A., & Dally, W. J. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001163 · Cited by 1,937
Self-citationMoons, B., Uytterhoeven, R., Dehaene, W., & Verhelst, M. (2017) · 2017 IEEE International Solid-State Circuits Conference (ISSCC) · doi:10.1109/isscc.2017.7870353 · Cited by 479
Simba: Scaling Deep-Learning Inference with Multi-Chip-Module-Based Architecture
Shao, Y. S., Clemons, J., Venkatesan, R., Zimmer, B., Fojtik, M., Jiang, N., Keller, B., Klinefelter, A., Pinckney, N., Raina, P., et al. (2019) · Proceedings of the 52nd Annual IEEE/ACM International Symposium on Microarchitecture · doi:10.1145/3352460.3358302 · Cited by 406
Self-citationLee, J., Kim, C., Kang, S., Shin, D., Kim, S., & Yoo, H.-J. (2018) · 2018 IEEE International Solid - State Circuits Conference - (ISSCC) · doi:10.1109/isscc.2018.8310262 · Cited by 303
Asanović, K., Avizienis, R. R., Bachrach, J. R., Beamer, S., Celio, C., Cook, H. M., Dabbelt, D., Izraelevitz, A. M., Karandikar, S., Keller, B., et al. (2016) · UC Berkeley · Cited by 186
Self-citationSong, J., Cho, Y., Park, J.-S., Jang, J.-W., Lee, S., Song, J.-H., Lee, J.-G., & Kang, I. (2019) · 2019 IEEE International Solid- State Circuits Conference - (ISSCC) · doi:10.1109/isscc.2019.8662476 · Cited by 139
MAGNet: A Modular Accelerator Generator for Neural Networks
Venkatesan, R., Shao, Y. S., Wang, M., Clemons, J., Dai, S., Fojtik, M., Keller, B., Klinefelter, A., Pinckney, N., Raina, P., et al. (2019) · 2019 IEEE/ACM International Conference on Computer-Aided Design (ICCAD) · doi:10.1109/iccad45719.2019.8942127 · Cited by 138
Self-citationYuan, Z., Yue, J., Yang, H., Wang, Z., Li, J., Yang, Y., Guo, Q., Li, X., Chang, M.-F., Yang, H., et al. (2018) · 2018 IEEE Symposium on VLSI Circuits · doi:10.1109/vlsic.2018.8502404 · Cited by 117
A methodology for correct-by-construction latency insensitive design
Carloni, L. P., McMillan, K. L., Saldanha, A., & Sangiovanni-Vincentelli, A. L. (2003) · International Conference on Computer Aided Design · doi:10.1109/iccad.1999.810667 · Cited by 110
Multidestination message passing in wormhole k-ary n-cube networks with base routing conformed paths
Panda, D. K., Singal, S., & Kesavan, R. (1999) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/71.744844 · Cited by 97
‘Zeppelin’: An SoC for multichip architectures
Beck, N., White, S., Paraschou, M., & Naffziger, S. (2018) · Digest of technical papers/Digest of technical papers - IEEE International Solid-State Circuits Conference · doi:10.1109/isscc.2018.8310173 · Cited by 88
Poulton, J. W., Wilson, J. M., Turner, W. J., Zimmer, B., Chen, X., Kudva, S. S., Song, S., Tell, S. G., Nedovic, N. M., Zhao, W., et al. (2018) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2018.2875092 · Cited by 73
Self-citationZimmer, B., Venkatesan, R., Shao, Y. S., Clemons, J., Fojtik, M., Jiang, N., Keller, B., Klinefelter, A., Pinckney, N., Raina, P., et al. (2019) · 2019 Symposium on VLSI Circuits · doi:10.23919/vlsic.2019.8778056 · Cited by 52
Self-citationA modular digital VLSI flow for high-productivity SoC design
Khailany, B., Khmer, E., Venkatesan, R., Clemons, J., Emer, J., Fojtik, M. R., Klinefelter, A., Pellauer, M., Pinckney, N., Shao, Y. S., et al. (2018) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1145/3195970.3199846 · Cited by 38
Self-citationLeveraging latency-insensitivity to ease multiple FPGA design
Fleming, K. E., Adler, M., Pellauer, M., Parashar, A., Mithal, A., & Emer, J. (2012) · ACM/SIGDA International Symposium on Field-Programmable Gate Arrays (FPGA) · doi:10.1145/2145694.2145725 · Cited by 35
Self-citationA Pausible Bisynchronous FIFO for GALS Systems
Keller, B., Fojtik, M. R., & Khailany, B. (2015) · Proceedings of the International Symposium on Advanced Research in Asynchronous Circuits and Systems · doi:10.1109/async.2015.9 · Cited by 25
Self-citationINVITED: A Modular Digital VLSI Flow for High-Productivity SoC Design
Khailany, B., Krimer, E., Venkatesan, R., Clemons, J., Emer, J., Fojtik, M. R., Klinefelter, A., Pellauer, M., Pinckney, N., Shao, Y. S., et al. (2018) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1109/dac.2018.8465897 · Cited by 24
Self-citationA Fine-Grained GALS SoC with Pausible Adaptive Clocking in 16 nm FinFET
Fojtik, M. R., Keller, B., Klinefelter, A., Pinckney, N., Tell, S. G., Zimmer, B., Raja, T., Zhou, K., Dally, W. J., & Khailany, B. (2019) · IEEE International Symposium on Asynchronous Circuits and Systems (ASYNC) · doi:10.1109/async.2019.00012 · Cited by 14
Self-citation
Research works printed but not linked: 3
- saban, 2012, Xilinx Stacked Silicon Interconnect Technology Delivers Breakthrough FPGA Capacity Bandwidth and Power Efficiency
- 2017, AMBA AXI and ACE Protocol Specification AXI3 AXI4 AXI5 ACE and ACE5
- 2019, MATCH
Cited by
A compute-in-memory chip based on resistive random-access memory
Wan, W., Kubendran, R., Schaefer, C., Eryilmaz, S. B., Zhang, W., Wu, D., Deiss, S., Raina, P., Qian, H., Gao, B., et al. (2022) · Nature · doi:10.1038/s41586-022-04992-8 · Cited by 943
Self-citationMemristive technologies for data storage, computation, encryption, and radio-frequency communication
Lanza, M., Sebastian, A., Lu, W. D., Le Gallo, M., Chang, M.-F., Akinwande, D., Puglisi, F. M., Alshareef, H. N., Liu, M., & Roldan, J. B. (2022) · Science · doi:10.1126/science.abj9979 · Cited by 708
“Reference (57) (133) (41) (59) (86) (134) (135)”
Mixed-Signal Computing for Deep Neural Network Inference
Murmann, B. (2021) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2020.3020286 · Cited by 160
“Beyond B = 8, the estimate exceeds 200 fJ/MAC, which is also reachable with purely digital implementations [27].”
BackgroundMethodInfluentialA Survey on Deep Learning Hardware Accelerators for Heterogeneous HPC Platforms
Silvano, C., Ielmini, D., Ferrandi, F., Fiorin, L., Curzel, S., Benini, L., Conti, F., Garofalo, A., Zambelli, C., Calore, E., et al. (2025) · ACM Computing Surveys · doi:10.1145/3729215 · Cited by 262
“Finally, as a representative chiplet-based DNN hardware accelerator, we report Simba [182, 227].”
PIMCA: A Programmable In-Memory Computing Accelerator for Energy-Efficient DNN Inference
Zhang, B., Yin, S., Kim, M., Saikia, J., Kwon, S., Myung, S., Kim, H., Kim, S. J., Seo, J.-S., & Seok, M. (2022) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2022.3211290 · Cited by 80
“To tackle these challenges, recently, a number of digital DNN hardware accelerators have been proposed [5], [6], [7], [8].”
Background
Metadata
- Authors
- Zimmer, B., Venkatesan, R., Shao, Y. S., Clemons, J., Fojtik, M., Jiang, N., Keller, B., Klinefelter, A., Pinckney, N., Raina, P., Tell, S. G., Zhang, Y., Dally, W. J., Emer, J. S., Gray, C. T., Keckler, S. W., & Khailany, B.
- Affiliations
- Nvidia (United States) (US)
- University of California, Berkeley (US)
- Stanford University (US)
- ORCID
- Venue
- IEEE Journal of Solid-State Circuits
- Published
- 2020-04
- Volume
- 55
- Issue
- 4
- Pages
- 920-932
- ISSN
- 0018-9200 (ISSN-L)
- 1558-173X
- OpenAlex
- W2999356938
- Semantic Scholar
- fe261bfd9d74f97268b3a9d9b700fdf5340ef434
- Cited by
- 122
- References
- 29
- Citations by year
- 2026: 15 · 2025: 25 · 2024: 16 · 2023: 28 · 2022: 20 · 2021: 15 · 2020: 3
- FWCI
- 6.42
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Journal of Solid-State Circuits (publishedVersion)
- Funders
- U.S. Government through the DARPA CRAFT Program
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Networks and Communications › Interconnection Networks and Systems
- Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques
- Keywords
- multichip modules, network-on-chip, data reuse, energy efficiency, area efficiency, 16nm CMOS
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.