Accuracy vs. Efficiency: Achieving Both through FPGA-Implementation Aware Neural Architecture Search
Open accessThe DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
A fundamental question lies in almost every application of deep neural networks: what is the optimal neural architecture given a specific data set? Recently, several Neural Architecture Search (NAS) frameworks have been developed that use reinforcement learning and evolutionary algorithm to search for the solution. However, most of them take a long time to find the optimal architecture due to the huge search space and the lengthy training process needed to evaluate each candidate. In addition, most of them aim at accuracy only and do not take into consideration the hardware that will be used to implement the architecture. This will potentially lead to excessive latencies beyond specifications, rendering the resulting architectures useless. To address both issues, in this paper we use Field Programmable Gate Arrays (FPGAs) as a vehicle to present a novel hardware-aware NAS framework, namely FNAS, which will provide an optimal neural architecture with latency guaranteed to meet the specification. In addition, with a performance abstraction model to analyze the latency of neural architectures without training, our framework can quickly prune architectures that do not satisfy the specification, leading to higher efficiency. Experimental results on common data set such as ImageNet show that in the cases where the state-of-the-art generates architectures with latencies 7.81× longer than the specification, those from FNAS can meet the specs with less than 1% accuracy loss. Moreover, FNAS also achieves up to 11.13× speedup for the search process. To the best of the authors' knowledge, this is the very first hardware aware NAS.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning Transferable Architectures for Scalable Image Recognition
Zoph, B., Vasudevan, V., Shlens, J., & Le, Q. V. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00907 · Cited by 7,831
Neural Architecture Search with Reinforcement Learning
Zoph, B., & Le, Q. V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01578 · Cited by 3,974
Optimizing FPGA-based Accelerator Design for Deep Convolutional Neural Networks
Zhang, C., Li, P., Sun, G., Guan, Y., Xiao, B., & Cong, J. (2015) · Proceedings of the 2015 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays · doi:10.1145/2684746.2689060 · Cited by 2,158 · cited 7×
“With such vision, a series of works for implementing neural networks on FPGAs have been carried out [3, 4, 8, 9, 11, 13, 15].”
BackgroundMethodInfluential
Research works printed but not linked: 14
- Bowen Baker etal 2016. Designing neural network architectures using reinforcement learning. arXiv preprint arXiv:1611.02167 (2016). Bowen Baker et al. 2016. Designing neural network architectures using reinforcement learning. arXiv preprint arXiv:1611.02167 (2016). · arXiv
- 10.1109/MM.2018.022071131 · DOI · Paper page
- 10.1109/ISCA.2018.00012 · DOI · Paper page
- Weiwen Jiang etal 2018. Heterogeneous FPGA-based Cost-Optimal Design for Timing-Constrained CNNs. IEEE TCAD (2018). Weiwen Jiang et al. 2018. Heterogeneous FPGA-based Cost-Optimal Design for Timing-Constrained CNNs. IEEE TCAD (2018). · DOI
- PYNQ., 2018, PYNQ: Python productivity for ZYNQ
- Esteban Real etal 2017. Large-scale evolution of image classifiers. arXiv preprint arXiv:1703.01041 (2017). Esteban Real et al. 2017. Large-scale evolution of image classifiers. arXiv preprint arXiv:1703.01041 (2017). · arXiv
- David J, Proc. of COGANN-92
- 10.1145/3079856.3080221 · DOI · Paper page
- 10.1145/3240765.3240856 · DOI
- Proc. of ICCV. 1388--1397
- Proc. of ISQED. IEEE, 437--440
- Lei Yang etal 2018. Optimal Application Mapping and Scheduling for Network-on-Chips with Computation in STT-RAM based Router. IEEE TC (2018). Lei Yang et al. 2018. Optimal Application Mapping and Scheduling for Network-on-Chips with Computation in STT-RAM based Router. IEEE TC (2018).
- 10.1145/2934583.2934644 · DOI · Paper page
- 10.1145/3240765.3240801 · DOI · Paper page
Cited by
Once-for-All: Train One Network and Specialize it for Efficient Deployment
Cai, H., Gan, C., Wang, T., Zhang, Z., & Han, S. (2019) · arXiv · doi:10.48550/arxiv.1908.09791 · Cited by 845
Machine Learning for Microcontroller-Class Hardware: A Review
Saha, S. S., Sandha, S. S., & Srivastava, M. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3210773 · Cited by 253
Bringing ai to edge: from deep learning’s perspective
Liu, D., Kong, H., Luo, X., Liu, W., & Subramaniam, R. (2022) · Neurocomputing · doi:10.1016/j.neucom.2021.04.141 · Cited by 171
“Some research strives to have a hardware-aware NAS, like FNAS [204], which directly incorporates resource constraints during implementing DNNs on FPGAs.”
BackgroundMethodInfluentialNeural Architecture Search Survey: A Hardware Perspective
Chitty-Venkata, K. T., & Somani, A. K. (2023) · ACM Computing Surveys · doi:10.1145/3524500 · Cited by 106
“FNAS prunes networks that do not satisfy the constraints in the search space, thereby increasing the search efficiency by a factor of 11.13 × .”
MethodInfluentialDevice-Circuit-Architecture Co-Exploration for Computing-in-Memory Neural Accelerators
Jiang, W., Lou, Q., Yan, Z., Yang, L., Hu, J., Hu, X. S., & Shi, Y. (2021) · IEEE Transactions on Computers · doi:10.1109/tc.2020.2991575 · Cited by 96
Self-citation
Metadata
- Authors
- Jiang, W., Zhang, X., Sha, E. H.-M., Yang, L., Zhuge, Q., Shi, Y., & Hu, J.
- Venue
- Proceedings of the 56th Annual Design Automation Conference 2019
- Publisher
- ACM
- Published
- 2019-06-02
- Pages
- 1-6
- ISSN
- 0738-100X (ISSN-L)
- OpenAlex
- W2911884654
- Cited by
- 121
- References
- 3
- FWCI
- 8.26
- Type
- conference paper
- Language
- en
- Open access
- bronze
- Funders
- National Science Foundation (CCF-1820537)
- China Scholarship Council (201706050116, 201706050117)
- National Natural Science Foundation of China (61472052)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Accuracy vs. Efficiency: Achieving Both through FPGA-Implementation Aware Neural Architecture Search. https://app.cochat.ai/papers/10.1145/3316781.3317757
- The paper
- Jiang, W., Zhang, X., Sha, E. H.-M., Yang, L., Zhuge, Q., Shi, Y., & Hu, J. (2019). Accuracy vs. Efficiency: Achieving Both through FPGA-Implementation Aware Neural Architecture Search. Proceedings of the 56th Annual Design Automation Conference 2019. https://doi.org/10.1145/3316781.3317757
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.