EIE: efficient inference engine on compressed deep neural network
The DOI matches its Crossref record; the references it cites are not checked yet.
Abstract
State-of-the-art deep neural networks (DNNs) have hundreds of millions of connections and are both computationally and memory intensive, making them difficult to deploy on embedded systems with limited hardware resources and power budgets. While custom hardware helps the computation, fetching weights from DRAM is two orders of magnitude more expensive than ALU operations, and dominates the required power. Previously proposed 'Deep Compression' makes it possible to fit large DNNs (AlexNet and VGGNet) fully in on-chip SRAM. This compression is achieved by pruning the redundant connections and having multiple connections share the same weight. We propose an energy efficient inference engine (EIE) that performs inference on this compressed network model and accelerates the resulting sparse matrix-vector multiplication with weight sharing. Going from DRAM to SRAM gives EIE 120× energy saving; Exploiting sparsity saves 10×; Weight sharing gives 8×; Skipping zero activations from ReLU saves another 3×. Evaluated on nine DNN benchmarks, EIE is 189× and 13× faster when compared to CPU and GPU implementations of the same DNN without compression. EIE has a processing power of 102 GOPS working directly on a compressed network, corresponding to 3 TOPS on an uncompressed network, and processes FC layers of AlexNet at 1.88×10 4 frames/sec with a power dissipation of only 600mW. It is 24,000× and 3,400× more energy efficient than a CPU and GPU respectively. Compared with DaDianNao, EIE has 2…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
The citation lists haven’t been fetched yet
References 48 · Cited by 1,937
Metadata
- Authors
- Han, S., Liu, X., Mao, H., Pu, J., Pedram, A., Horowitz, M. A., & Dally, W. J.
- Affiliations
- Stanford University (US)
- Venue
- ACM SIGARCH Computer Architecture News
- Published
- 2016-06-18
- Volume
- 44
- Issue
- 3
- Pages
- 243-254
- ISSN
- 0163-5964 (ISSN-L)
- OpenAlex
- W2285660444
- Cited by
- 1,937
- References
- 48
- Citations by year
- 2026: 44 · 2025: 97 · 2024: 118 · 2023: 148 · 2022: 181 · 2021: 293 · 2020: 341 · 2019: 282 · 2018: 280 · 2017: 123 · 2016: 28
- FWCI
- 161.31
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM SIGARCH Computer Architecture News (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Keywords
- deep neural network inference, model compression, parameter sharing, sparse matrix-vector multiplication, embedded systems, connection pruning, hardware accelerators, AlexNet, VGG, power dissipation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: EIE: efficient inference engine on compressed deep neural network. https://app.cochat.ai/papers/10.1145/3007787.3001163
- The paper
- Han, S., Liu, X., Mao, H., Pu, J., Pedram, A., Horowitz, M. A., & Dally, W. J. (2016). EIE: efficient inference engine on compressed deep neural network. ACM SIGARCH Computer Architecture News. https://doi.org/10.1145/3007787.3001163
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.