CoChat

Fused-layer CNN accelerators

Alwani, Manoj, Chen, Han, Ferdman, Michael, Milder, Peter · 2016 · 2016 49th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO)

The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.

Abstract

Deep convolutional neural networks (CNNs) are rapidly becoming the dominant approach to computer vision and a major component of many other pervasive machine learning tasks, such as speech recognition, natural language processing, and fraud detection. As a result, accelerators for efficiently evaluating CNNs are rapidly growing in popularity. The conventional approaches to designing such CNN accelerators is to focus on creating accelerators to iteratively process the CNN layers. However, by processing each layer to completion, the accelerator designs must use off-chip memory to store intermediate data between layers, because the intermediate data are too large to fit on chip. In this work, we observe that a previously unexplored dimension exists in the design space of CNN accelerators that focuses on the dataflow across convolutional layers. We find that we are able to fuse the processing of multiple CNN layers by modifying the order in which the input data are brought on chip, enabling caching of intermediate data between the evaluation of adjacent CNN layers. We demonstrate the effectiveness of our approach by constructing a fused-layer CNN accelerator for the first five convolutional layers of the VGGNet-E network and comparing it to the state-of-the-art accelerator implemented on a Xilinx Virtex-7 FPGA. We find that, by using 362KB of on-chip storage, our fused-layer accelerator minimizes off-chip feature map data transfer, reducing the total transfer by 95%, from 77MB down to 3.6MB per image.

Overview

Integrity signals

Registry

Crossref · 10.1109/micro.2016.7783725

Cites

20 of 20 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 20 references

Cited by

Items 601–700 of 779

Metadata

Authors
Alwani, M., Chen, H., Ferdman, M., & Milder, P.
Affiliations
Stony Brook University (US)
Venue
2016 49th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO)
Publisher
IEEE
Published
2016-10
Pages
1-12
ISSN
1072-4451 (ISSN-L)
OpenAlex
W4249932213
Cited by
662
References
20
Citations by year
2026: 20 · 2025: 51 · 2024: 72 · 2023: 67 · 2022: 87 · 2021: 103 · 2020: 72 · 2019: 90 · 2018: 76 · 2017: 23 · 2016: 1
FWCI
21.98
Type
conference paper
Language
en
Open access
closed
Locations
IEEE/ACM International Symposium on Microarchitecture (MICRO) (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Hardware and Architecture › Embedded Systems Design Techniques
  • Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques
Keywords
CNN accelerator, layer fusion, data flow design, FPGA implementation, convolutional neural network inference

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.