CoChat

Accuracy vs. Efficiency: Achieving Both through FPGA-Implementation Aware Neural Architecture Search

Open access
Jiang, Weiwen, Zhang, Xinyi, Sha, Edwin H.-M., Yang, Lei, Zhuge, Qingfeng, Shi, Yiyu, Hu, Jingtong · 2019 · Proceedings of the 56th Annual Design Automation Conference 2019
Cited by 121

The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.

Abstract

A fundamental question lies in almost every application of deep neural networks: what is the optimal neural architecture given a specific data set? Recently, several Neural Architecture Search (NAS) frameworks have been developed that use reinforcement learning and evolutionary algorithm to search for the solution. However, most of them take a long time to find the optimal architecture due to the huge search space and the lengthy training process needed to evaluate each candidate. In addition, most of them aim at accuracy only and do not take into consideration the hardware that will be used to implement the architecture. This will potentially lead to excessive latencies beyond specifications, rendering the resulting architectures useless. To address both issues, in this paper we use Field Programmable Gate Arrays (FPGAs) as a vehicle to present a novel hardware-aware NAS framework, namely FNAS, which will provide an optimal neural architecture with latency guaranteed to meet the specification. In addition, with a performance abstraction model to analyze the latency of neural architectures without training, our framework can quickly prune architectures that do not satisfy the specification, leading to higher efficiency. Experimental results on common data set such as ImageNet show that in the cases where the state-of-the-art generates architectures with latencies 7.81× longer than the specification, those from FNAS can meet the specs with less than 1% accuracy loss. Moreover, FNAS also achieves up to 11.13× speedup for the search process. To the best of the authors' knowledge, this is the very first hardware aware NAS.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3316781.3317757

Cites

3 of 3 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 3 references

Research works printed but not linked: 14

  1. Bowen Baker etal 2016. Designing neural network architectures using reinforcement learning. arXiv preprint arXiv:1611.02167 (2016). Bowen Baker et al. 2016. Designing neural network architectures using reinforcement learning. arXiv preprint arXiv:1611.02167 (2016). · arXiv
  2. 10.1109/MM.2018.022071131 · DOI · Paper page
  3. 10.1109/ISCA.2018.00012 · DOI · Paper page
  4. Weiwen Jiang etal 2018. Heterogeneous FPGA-based Cost-Optimal Design for Timing-Constrained CNNs. IEEE TCAD (2018). Weiwen Jiang et al. 2018. Heterogeneous FPGA-based Cost-Optimal Design for Timing-Constrained CNNs. IEEE TCAD (2018). · DOI
  5. PYNQ., 2018, PYNQ: Python productivity for ZYNQ
  6. Esteban Real etal 2017. Large-scale evolution of image classifiers. arXiv preprint arXiv:1703.01041 (2017). Esteban Real et al. 2017. Large-scale evolution of image classifiers. arXiv preprint arXiv:1703.01041 (2017). · arXiv
  7. David J, Proc. of COGANN-92
  8. 10.1145/3079856.3080221 · DOI · Paper page
  9. 10.1145/3240765.3240856 · DOI
  10. Proc. of ICCV. 1388--1397
  11. Proc. of ISQED. IEEE, 437--440
  12. Lei Yang etal 2018. Optimal Application Mapping and Scheduling for Network-on-Chips with Computation in STT-RAM based Router. IEEE TC (2018). Lei Yang et al. 2018. Optimal Application Mapping and Scheduling for Network-on-Chips with Computation in STT-RAM based Router. IEEE TC (2018).
  13. 10.1145/2934583.2934644 · DOI · Paper page
  14. 10.1145/3240765.3240801 · DOI · Paper page

Cited by

See all 121

Metadata

Authors
Jiang, W., Zhang, X., Sha, E. H.-M., Yang, L., Zhuge, Q., Shi, Y., & Hu, J.
Venue
Proceedings of the 56th Annual Design Automation Conference 2019
Publisher
ACM
Published
2019-06-02
Pages
1-6
ISSN
0738-100X (ISSN-L)
OpenAlex
W2911884654
Cited by
121
References
3
FWCI
8.26
Type
conference paper
Language
en
Open access
bronze
Funders
  • National Science Foundation (CCF-1820537)
  • China Scholarship Council (201706050116, 201706050117)
  • National Natural Science Foundation of China (61472052)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Accuracy vs. Efficiency: Achieving Both through FPGA-Implementation Aware Neural Architecture Search. https://app.cochat.ai/papers/10.1145/3316781.3317757
The paper
Jiang, W., Zhang, X., Sha, E. H.-M., Yang, L., Zhuge, Q., Shi, Y., & Hu, J. (2019). Accuracy vs. Efficiency: Achieving Both through FPGA-Implementation Aware Neural Architecture Search. Proceedings of the 56th Annual Design Automation Conference 2019. https://doi.org/10.1145/3316781.3317757

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.