Device-Circuit-Architecture Co-Exploration for Computing-in-Memory Neural Accelerators
Open accessThe DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
Co-exploration of neural architectures and hardware design is promising due to its capability to simultaneously optimize network accuracy and hardware efficiency. However, state-of-the-art neural architecture search algorithms for the co-exploration are dedicated for the conventional von-Neumann computing architecture, whose performance is heavily limited by the well-known memory wall. In this article, we are the first to bring the computing-in-memory architecture, which can easily transcend the memory wall, to interplay with the neural architecture search, aiming to find the most efficient neural architectures with high network accuracy and maximized hardware efficiency. Such a novel combination makes opportunities to boost performance, but also brings a bunch of challenges: The optimization space spans across multiple design layers from device type and circuit topology to neural architecture; and the presence of device variation may drastically degrade the neural network performance. To address these challenges, we propose a cross-layer exploration framework, namely NACIM, which jointly explores device, circuit and architecture design space and takes device variation into consideration to find the most robust neural architectures, coupled with the most efficient hardware design. Experimental results demonstrate that NACIM can find the robust neural network with 0.45 percent accuracy loss in the presence of device variation, compared with a 76.44 percent loss from the state-of-the-art NAS without consideration of variation; in addition, NACIM achieves an energy efficiency up to 16.3 TOPs/W, 3.17x higher than the state-of-the-art NAS.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The design parameters search can be performed using reinforcement learning264,266, evolutionary algorithms259,260,263,265, or differential methods261.”
From Hardware implementation of memristor-based artificial neural networks (2024) · cites this paper as [266]
In the citing paper
“Such optimization lies within the domain of hardware-aware neural architecture search, which optimizes the design parameters of the neural network considering hardware feedback261–264, or in some cases, searches for the optimum hardware parameters265,266.”
From Hardware implementation of memristor-based artificial neural networks (2024) · cites this paper as [266]
In the citing paper
“For example, an optimum crossbar size266, ADC/DAC resolution, and device precision265 can be searched along with the software-related parameters of the neural network.”
From Hardware implementation of memristor-based artificial neural networks (2024) · cites this paper as [266]
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
YOLOv3: An Incremental Improvement
Redmon, J., & Farhadi, A. (2018) · arXiv · doi:10.48550/arxiv.1804.02767 · Cited by 17,141
A Multi-Modal Distributed Real-Time IoT System for Urban Traffic Control (Invited Paper)
Khanam, Z., Achari, V. P. S., Boukhennoufa, I., Jindal, A., & Singh, A. K. (2024) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/oasics.ng-res.2024.2 · Cited by 14,040
Learning Transferable Architectures for Scalable Image Recognition
Zoph, B., Vasudevan, V., Shlens, J., & Le, Q. V. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00907 · Cited by 7,831
Efficient Processing of Deep Neural Networks: A Tutorial and Survey
Sze, V., Chen, Y.-H., Yang, T.-J., & Emer, J. S. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2761740 · Cited by 4,215 · cited 1×
“(i) CiM architecture can benefit from the fixed memory access pattern within neural network computation [26] to execute operations in place.”
BackgroundNeural Architecture Search with Reinforcement Learning
Zoph, B., & Le, Q. V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01578 · Cited by 3,974
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 3,416
MnasNet: Platform-Aware Neural Architecture Search for Mobile
Tan, M., Chen, B., Pang, R., Vasudevan, V., Sandler, M., Howard, A., & Le, Q. V. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00293 · Cited by 3,416 · cited 1×
“To address this deficiency, hardware-aware NAS [14], [15], [16], [17],”
BackgroundDARTS: Differentiable architecture search
Liu, H., Simonyan, K., & Yang, Y. (2018) · arXiv · doi:10.48550/arxiv.1806.09055 · Cited by 3,248
In-memory computing with resistive switching devices
Ielmini, D., & Wong, H.-S. P. (2018) · Nature Electronics · doi:10.1038/s41928-018-0092-2 · Cited by 2,298 · cited 1×
“Computing-in-memory (CiM) has been proved to be able to effectively transcend such a memory wall [25], and has been considered to be a promising candidate for neural network computations due to the incomparable architectural benefits.”
BackgroundISAAC: a convolutional neural network accelerator with in-situ analog arithmetic in crossbars
Shafiee, A., Nag, A., Muralimanohar, N., Balasubramonian, R., Strachan, J. P., Hu, M., Williams, R. S., & Srikumar, V. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001139 · Cited by 1,536
FBNet: Hardware-Aware Efficient ConvNet Design via Differentiable Neural Architecture Search
Wu, B., Keutzer, K., Dai, X., Zhang, P., Wang, Y., Sun, F., Wu, Y., Tian, Y., Vajda, P., & Jia, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01099 · Cited by 1,261
Chi, P., Li, S., Xu, C., Zhang, T., Zhao, J., Liu, Y., Wang, Y., & Xie, Y. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001140 · Cited by 1,231
A Dataset and a Technique for Generalized Nuclear Segmentation for Computational Pathology
Kumar, N., Verma, R., Sharma, S., Bhargava, S., Vahadane, A., & Sethi, A. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2677499 · Cited by 1,126
Auto-DeepLab: Hierarchical Neural Architecture Search for Semantic Image Segmentation
Liu, C., Chen, L.-C., Schroff, F., Adam, H., Hua, W., Yuille, A. L., & Fei-Fei, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00017 · Cited by 1,025
Simple statistical gradient-following algorithms for connectionist reinforcement learning
Williams, R. J. (1992) · Machine Learning · doi:10.1023/a:1022672621406 · Cited by 817
Chen, P.-Y., Peng, X., & Yu, S. (2018) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2018.2789723 · Cited by 652
Efficient Architecture Search by Network Transformation
Cai, H., Chen, T., Zhang, W., Yu, Y., & Wang, J. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11709 · Cited by 557
Object Classification Using CNN-Based Fusion of Vision and LIDAR in Autonomous Vehicle Environment
Gao, H., Cheng, B., Wang, J., Li, K., Zhao, J., & Li, D. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2822828 · Cited by 524
Large-Scale Evolution of Image Classifiers
Real, E., Moore, S., Selle, A. P., Saxena, S., Suematsu, Y. I. L., Tan, J., Le, Q. V., & Kurakin, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.01041 · Cited by 466
Scaling for edge inference of deep neural networks
Xu, X., Ding, Y., Hu, S. X., Niemier, M., Cong, J., Hu, Y., & Shi, Y. (2018) · Nature Electronics · doi:10.1038/s41928-018-0059-3 · Cited by 462 · cited 1×
“puting capacity of each device cell, quantization is essential to improve the hardware efficiency [30], [31], [32]; as such, quantization has to be automatically determined during the search process.”
BackgroundSelf-citationPeng, X., Huang, S., Luo, Y., Sun, X., & Yu, S. (2019) · 2019 IEEE International Electron Devices Meeting (IEDM) · doi:10.1109/iedm19573.2019.8993491 · Cited by 359
Biswas, A., & Chandrakasan, A. P. (2018) · 2018 IEEE International Solid - State Circuits Conference - (ISSCC) · doi:10.1109/isscc.2018.8310397 · Cited by 337
ChamNet: Towards Efficient Network Design Through Platform-Aware Model Adaptation
Dai, X., Zhang, P., Wu, B., Yin, H., Sun, F., Wang, Y., Dukhan, M., Hu, Y., Wu, Y., Jia, Y., et al. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01166 · Cited by 279 · cited 1×
“To address this deficiency, hardware-aware NAS [16], [17], [18], [19], [20], [21] has been proposed, in which the hardware specifications are considered during the search process.”
MethodProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware
Cai, H., Zhu, L., & Han, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.00332 · Cited by 267
FPGA/DNN Co-Design: An Efficient Design Methodology for IoT Intelligence on the Edge
Hao, C., Zhang, X., Li, Y., Huang, S., Xiong, J., Rupnow, K., Hwu, W.-M., & Chen, D. (2019) · Proceedings of the 56th Annual Design Automation Conference 2019 · doi:10.1145/3316781.3317829 · Cited by 182
Hardware/Software Co-Exploration of Neural Architectures
Jiang, W., Yang, L., Sha, E. H.-M., Zhuge, Q., Gu, S., Dasgupta, S., Shi, Y., & Hu, J. (2020) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2020.2986127 · Cited by 150
Self-citationMaking Memristive Neural Network Accelerators Reliable
Feinberg, B., Wang, S., & Ipek, E. (2018) · 2018 IEEE International Symposium on High Performance Computer Architecture (HPCA) · doi:10.1109/hpca.2018.00015 · Cited by 130
Accuracy vs. Efficiency: Achieving Both through FPGA-Implementation Aware Neural Architecture Search
Jiang, W., Zhang, X., Sha, E. H.-M., Yang, L., Zhuge, Q., Shi, Y., & Hu, J. (2019) · Proceedings of the 56th Annual Design Automation Conference 2019 · doi:10.1145/3316781.3317757 · Cited by 121
Self-citationQuantization of Fully Convolutional Networks for Accurate Biomedical Image Segmentation
Xu, X., Lu, Q. H., Yang, L., Hu, X. S., Chen, D. Z., Hu, Y. H., & Shi, Y. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00866 · Cited by 118
Self-citationZhang, J. J., Rangineni, K., Ghodsi, Z., & Garg, S. (2018) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1109/dac.2018.8465918 · Cited by 97
Investigation of statistical retention of filamentary analog RRAM for neuromophic computing
Zhao, M., Wu, H., Gao, B., Zhang, Q., Wu, W., Wang, S., Xi, Y., Wu, D., Deng, N., Yu, S., et al. (2017) · 2017 IEEE International Electron Devices Meeting (IEDM) · doi:10.1109/iedm.2017.8268522 · Cited by 95 · cited 5×
“The noise model of the device is from [34].”
BackgroundMethodInfluentialAchieving Super-Linear Speedup across Multi-FPGA for Real-Time DNN Inference
Jiang, W., Sha, E. H.-M., Zhang, X., Yang, L., Zhuge, Q., Shi, Y., & Hu, J. (2019) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3358192 · Cited by 80
Self-citationXu, X., Wang, T., Shi, Y., Yuan, H., Jia, Q., Huang, M., & Zhuang, J. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-32245-8_53 · Cited by 79
Self-citationOn Neural Architecture Search for Resource-Constrained Hardware PlatformsPreprint
Lu, Q. H., Jiang, W., Xu, X., Shi, Y., & Hu, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.00105 · Cited by 74
Self-citationAn In-Memory VLSI Architecture for Convolutional Neural Networks
Kang, M., Lim, S., Gonugondla, S. K., & Shanbhag, N. R. (2018) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2018.2829522 · Cited by 72
Reinforcement Learning for Architecture Search by Network TransformationPreprint
Cai, H., Chen, T., Zhang, W.-N., Yu, Y., & Wang, J. (2017) · arXiv.org · doi:10.48550/arxiv.1707.04873 · Cited by 68
An MRAM-Based Deep In-Memory Architecture for Deep Neural Networks
Patil, A. D., Hua, H., Gonugondla, S., Kang, M., & Shanbhag, N. R. (2019) · 2019 IEEE International Symposium on Circuits and Systems (ISCAS) · doi:10.1109/iscas.2019.8702206 · Cited by 49
Computing-in-Memory with SRAM and RRAM for Binary Neural Networks
Sun, X., Liu, R., Peng, X., & Yu, S. (2018) · IEEE International Conference on Solid-State and Integrated Circuit Technology · doi:10.1109/icsict.2018.8565811 · Cited by 47
Heterogeneous FPGA-Based Cost-Optimal Design for Timing-Constrained CNNs
Jiang, W., Sha, E. H. ‐., Zhuge, Q., Yang, L., Chen, X., & Hu, J. (2018) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2018.2857098 · Cited by 45
Self-citationVideo Action Recognition Via Neural Architecture Searching
Peng, W., Hong, X., & Zhao, G. (2019) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2019.8802919 · Cited by 43
Co-Exploring Neural Architecture and Network-on-Chip Design for Real-Time Artificial Intelligence
Yang, L., Jiang, W., Liu, W., Sha, E. H. ‐., Shi, Y., & Hu, J. (2020) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/asp-dac47756.2020.9045595 · Cited by 39
Self-citationFATE: fast and accurate timing error prediction framework for low power DNN accelerator design
Zhang, J. J., & Garg, S. (2018) · doi:10.1145/3240765.3240809 · Cited by 27
Zhang, B., Chen, L.-Y., & Verma, N. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683521 · Cited by 23
Zhang, J. J., Raj, P., Zarar, S., Ambardekar, A., & Garg, S. (2019) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3358178 · Cited by 21
Resource constrained cellular neural networks for real-time obstacle detection using FPGAs
Xu, X., Wang, T., Lu, Q. H., et al. (2018) · International Symposium on Quality Electronic Design (ISQED) · doi:10.1109/isqed.2018.8357326 · Cited by 16
Yang, L., Liu, W., Guan, N., et al. (2018) · IEEE Transactions on Computers · doi:10.1109/tc.2018.2864749 · Cited by 14
Self-citation
Cited by
Hardware implementation of memristor-based artificial neural networks
Aguirre, F., Sebastian, A., Le Gallo, M., Song, W., Wang, T., Yang, J. J., Lu, W., Chang, M.-F., Ielmini, D., Yang, Y., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-45670-9 · Cited by 564
“For example, an optimum crossbar size 266 , ADC/DAC resolution, and device precision 265 can be searched along with the software-related parametersoftheneuralnetwork.”
NAS4RRAM: neural network architecture search for inference on RRAM-based accelerators
Yuan, Z., Liu, J., Li, X., Yan, L., Chen, H., Wu, B., Yang, Y., & Sun, G. (2021) · Science China Information Sciences · doi:10.1007/s11432-020-3245-7 · Cited by 30
Yan, Z., Juan, D.-C., Hu, X. S., & Shi, Y. (2021) · Proceedings of the 26th Asia and South Pacific Design Automation Conference · doi:10.1145/3394885.3431635 · Cited by 18
Self-citationGibbon: Efficient Co-Exploration of NN Model and Processing-In-Memory Architecture
Sun, H., Wang, C., Zhu, Z., Ning, X., Dai, G., Yang, H., & Wang, Y. (2022) · 2022 Design, Automation & Test in Europe Conference & Exhibition (DATE) · doi:10.23919/date54114.2022.9774605 · Cited by 15
FLASH: F ast Neura l A rchitecture S earch with H ardware Optimization
Li, G., Mandal, S. K., Ogras, U. Y., & Marculescu, R. (2021) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3476994 · Cited by 15
Metadata
- Authors
- Jiang, W., Lou, Q., Yan, Z., Yang, L., Hu, J., Hu, X. S., & Shi, Y.
- Affiliations
- University of Notre Dame (US)
- University of Pittsburgh (US)
- Venue
- IEEE Transactions on Computers
- Published
- 2021-04-01
- Volume
- 70
- Issue
- 4
- Pages
- 595-605
- ISSN
- 0018-9340 (ISSN-L)
- 1557-9956
- 2326-3814
- OpenAlex
- W3022053993
- Cited by
- 96
- References
- 48
- Citations by year
- 2026: 7 · 2025: 8 · 2024: 22 · 2023: 18 · 2022: 11 · 2021: 20
- FWCI
- 5.06
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Computers (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (CNS-1822099, SPX-1919167, CNS-1629914, CCF-1820537)
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Low-power high-performance VLSI design
- Keywords
- in-memory computing, neural architecture search, neural network accelerators, memory wall, device variability, circuit topology, device selection, energy efficiency, robust neural networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.