Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 317 of the 334 references it cites were found in a registry or an index, and 1 are not checked yet.

Model Compression and Hardware Acceleration for Neural Networks: A Comprehensive Survey

Deng, By Lei, Li, Guoqi, Han, Song, Shi, Luping, Xie, Yuan · 2020 · Proceedings of the IEEE

Abstract

Domain-specific hardware is becoming a promising topic in the backdrop of improvement slow down for general-purpose processors due to the foreseeable end of Moore's Law. Machine learning, especially deep neural networks (DNNs), has become the most dazzling domain witnessing successful applications in a wide spectrum of artificial intelligence (AI) tasks. The incomparable accuracy of DNNs is achieved by paying the cost of hungry memory consumption and high computational complexity, which greatly impedes their deployment in embedded systems. Therefore, the DNN compression concept was naturally proposed and widely used for memory saving and compute acceleration. In the past few years, a tremendous number of compression techniques have sprung up to pursue a satisfactory tradeoff between processing efficiency and application accuracy. Recently, this wave has spread to the design of neural network accelerators for gaining extremely high performance. However, the amount of related works is incredibly huge and the reported approaches are quite divergent. This research chaos motivates us to provide a comprehensive survey on the recent advances toward the goal of efficient compression and execution of DNNs without significantly compromising accuracy, involving both the high-level algorithms and their applications in hardware design. In this article, we review the mainstream compression approaches such as compact model, tensor decomposition, data quantization, and network sparsification…

Overview

Integrity signals

Registry

Crossref · 10.1109/jproc.2020.2976475

Cites

317 of 318 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 334 references

Research works printed but not linked: 2

  1. lin, 2013, Network in network, arXiv 1312 4400
  2. han, 2015, Learning both weights and connections for efficient neural network, Proc Adv Neural Inf Process Syst, 1135

Cited by

See all 1,002

Metadata

Authors
Deng, B. L., Li, G., Han, S., Shi, L., & Xie, Y.
Affiliations
  • Tsinghua University (CN)
  • Massachusetts Institute of Technology (US)
  • University of California, Santa Barbara (US)
Venue
Proceedings of the IEEE
Published
2020-04
Volume
108
Issue
4
Pages
485-532
ISSN
  • 0018-9219 (ISSN-L)
  • 1558-2256
OpenAlex
W3012561096
Cited by
996
References
334
Citations by year
2026: 131 · 2025: 171 · 2024: 193 · 2023: 174 · 2022: 152 · 2021: 142 · 2020: 31
FWCI
46.83
Type
journal article
Language
en
Open access
closed
Locations
  • Proceedings of the IEEE (publishedVersion)
  • Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
Funders
  • National Science Foundation (1725447)
  • Beijing Academy of Artificial Intelligence (BAAI), Tsinghua University Initiative Scientific Research Program
  • Institute for Guo Qiang, Tsinghua University
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques
  • Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
Keywords
neural network compression, neural network accelerators, deep neural network, data quantization, network sparsification, tensor decomposition, compact modeling, memory efficiency, embedded systems, hardware architecture

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Model Compression and Hardware Acceleration for Neural Networks: A Comprehensive Survey. https://app.cochat.ai/papers/10.1109/jproc.2020.2976475
The paper
Deng, B. L., Li, G., Han, S., Shi, L., & Xie, Y. (2020). Model Compression and Hardware Acceleration for Neural Networks: A Comprehensive Survey. Proceedings of the IEEE. https://doi.org/10.1109/jproc.2020.2976475

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.