YodaNN: An Architecture for Ultralow Power Binary-Weight CNN Acceleration
Open accessThe DOI matches its Crossref record; 58 of the 60 references it cites were found in a registry or an index.
Abstract
Convolutional neural networks (CNNs) have revolutionized the world of computer vision over the last few years, pushing image classification beyond human accuracy. The computational effort of today's CNNs requires power-hungry parallel processors or GP-GPUs. Recent developments in CNN accelerators for system-on-chip integration have reduced energy consumption significantly. Unfortunately, even these highly optimized devices are above the power envelope imposed by mobile and deeply embedded applications and face hard limitations caused by CNN weight I/O and storage. This prevents the adoption of CNNs in future ultralow power Internet of Things end-nodes for near-sensor analytics. Recent algorithmic and theoretical advancements enable competitive classification accuracy even when limiting CNNs to binary (+1/-1) weights during training. These new findings bring major optimization opportunities in the arithmetic core by removing the need for expensive multiplications, as well as reducing I/O bandwidth and storage. In this paper, we present an accelerator optimized for binary-weight CNNs that achieves 1.5 TOp/s at 1.2 V on a core area of only 1.33 million gate equivalent (MGE) or 1.9 mm2and with a power dissipation of 895 μW in UMC 65-nm technology at 0.6 V. Our accelerator significantly outperforms the state-of-the-art in terms of energy and area efficiency achieving 61.2 TOp/s/W@0.6 V and 1.1 TOp/s/MGE@1.2 V, respectively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“YodaNN50, a digital DNN inference accelerator for binary weight networks with ultra-low power budget, achieves 434.8 FPS in high throughput mode for a 9-layer CNN (BinaryConnect51) on CIFAR-10.”
From Accurate deep neural network inference using computational phase-change memory (2020) · cites this paper as [50]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357 · cited 1×
“On the other hand, sourcing out all CNN computation from IoT end-nodes to data servers is extremely challenging and power consuming, due to the large communication bandwidth required to transmit the data streams.”
BackgroundDeepFace: Closing the Gap to Human-Level Performance in Face Verification
Taigman, Y., Yang, M., Ranzato, M., & Wolf, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.220 · Cited by 6,542
Han, S., Mao, H., & Dally, W. J. (2015) · arXiv · doi:10.48550/arxiv.1510.00149 · Cited by 4,662
XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks
Rastegari, M., Ordonez, V., Redmon, J., & Farhadi, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_32 · Cited by 4,408
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1512.03385 · Cited by 4,196
Eyeriss: An Energy-Efficient Reconfigurable Accelerator for Deep Convolutional Neural Networks
Chen, Y.-H., Krishna, T., Emer, J. S., & Sze, V. (2017) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2016.2616357 · Cited by 3,247 · cited 3×
“For small filter sizes, they can be used to calculate several output channels in parallel or they can be switched-off [41].”
BackgroundMethodLearning Hierarchical Features for Scene Labeling
Farabet, C., Couprie, C., Najman, L., & LeCun, Y. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.231 · Cited by 2,620
Research works printed but not linked: 4
- [39] Movidius, 'Ins-03510-c1 datasheet,' 2014, datasheet of Myriad 2 Vision Processor. [Online]. Available: http://uploads.movidius.com/ 1441734401-Myriad-2-product-brief.pdf -
- [38] N. Jouppi. (2016) Google supercharges machine learning tasks with tpu custom chip. [Online]. Available: https://cloudplatform.googleblog.com/2016/05/ Google-supercharges-machine-learning-tasks-with-custom-chip. html -
- chintala, 2016, convnet-benchmarks
- [1] G. Lucas. (2016) Yoda. [Online]. Available: www. starwars.com/databank/yoda -
Cited by
Model Compression and Hardware Acceleration for Neural Networks: A Comprehensive Survey
Deng, B. L., Li, G., Han, S., Shi, L., & Xie, Y. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2020.2976475 · Cited by 996
“If only the weights are binarized/ternarized, the costly MAC operations can be reduced to simpler accumulations [274].”
BackgroundESPNetv2: A Light-Weight, Power Efficient, and General Purpose Convolutional Neural Network
Mehta, S., Rastegari, M., Shapiro, L., & Hajishirzi, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00941 · Cited by 551
“Low-bit representation: Another approach to improve inference of a pre-trained network is low-bit representation of network weights using quantization [1, 9, 20, 39, 47, 57, 64].”
Accurate deep neural network inference using computational phase-change memory
Joshi, V., Le Gallo, M., Haefeli, S., Boybat, I., Nandakumar, S. R., Piveteau, C., Dazzi, M., Rajendran, B., Sebastian, A., & Eleftheriou, E. (2020) · Nature Communications · doi:10.1038/s41467-020-16108-9 · Cited by 490
PUMA: A Programmable Ultra-efficient Memristor-based Accelerator for Machine Learning Inference
Ankit, A., Hajj, I. E., Chalamalasetti, S. R., Ndu, G., Foltin, M., Williams, R. S., Faraboschi, P., Hwu, W.-M. W., Strachan, J. P., Roy, K., et al. (2019) · Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3297858.3304049 · Cited by 424
“Many designs also support optimizations and features including weight pruning and exploiting sparsity [3, 4, 25, 32, 48, 84, 89, 119], reducing precision [8, 62], stochastic computing [65, 90], layer fusing [6], meeting QoS/QoR requirements [108], graph tuning [56], and reconfigurable interconnects [68].”
BackgroundAccurate deep neural network inference using computational phase-change memory
Joshi, V., Gallo, M. L., Haefeli, S., Boybat, I., Nandakumar, S. R., Piveteau, C., Dazzi, M., Rajendran, B., Sebastian, A., & Eleftheriou, E. S. (2020) · RePEc: Research Papers in Economics · doi:10.3929/ethz-b-000416797 · Cited by 379
TinyML Meets IoT: A Comprehensive Survey
Dutta, D. L., & Bharali, S. (2021) · Internet of Things · doi:10.1016/j.iot.2021.100461 · Cited by 328
FP-BNN: Binarized neural network on FPGA
Liang, S., Yin, S., Liu, L., Luk, W., & Wei, S. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.09.046 · Cited by 298
Biswas, D., Everson, L., Liu, M., Panwar, M., Verhoef, B.-E., Patki, S., Kim, C. H., Acharyya, A., Van Hoof, C., Konijnenburg, M., et al. (2019) · IEEE Transactions on Biomedical Circuits and Systems · doi:10.1109/tbcas.2019.2892297 · Cited by 288
PULP-NN: accelerating quantized neural networks on parallel ultra-low-power RISC-V processors
Garofalo, A., Rusci, M., Conti, F., Rossi, D., & Benini, L. (2019) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2019.0155 · Cited by 223
Self-citationA Survey on Efficient Convolutional Neural Networks and Hardware Acceleration
Ghimire, D., Kil, D., & Kim, S.-H. (2022) · Electronics · doi:10.3390/electronics11060945 · Cited by 198
Frenkel, C., Legat, J.-D., & Bol, D. (2019) · IEEE Transactions on Biomedical Circuits and Systems · doi:10.1109/tbcas.2019.2928793 · Cited by 183
Transfer learning for sEMG hand gestures recognition using convolutional neural networks
Cote-Allard, U., Fall, C. L., Campeau-Lecours, A., Gosselin, C., Laviolette, F., & Gosselin, B. (2017) · 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC) · doi:10.1109/smc.2017.8122854 · Cited by 175
XNOR Neural Engine: A Hardware Accelerator IP for 21.6-fJ/op Binary Neural Network Inference
Conti, F., Schiavone, P. D., & Benini, L. (2018) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2018.2857019 · Cited by 170
Self-citationDeep Neural Network Approximation for Custom Hardware: Where We've Been, Where We're Going
Wang, E., Davis, J. J., Zhao, R., Ng, H.-C., Niu, X., Luk, W., Cheung, P. Y. K., & Constantinides, G. A. (2020) · ACM Computing Surveys · doi:10.1145/3309551 · Cited by 166
Wang, X., Magno, M., Cavigelli, L., & Benini, L. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2976702 · Cited by 162
“The most promising approaches to improve the performance of ultra-low-power processors are parallelism, low-power fixed-function hardware accelerators [32], [33], memory access optimization [34], and near-threshold technology [35], [36].”
BackgroundSelf-citationSHARP: A Short-Word Hierarchical Accelerator for Robust and Practical Fully Homomorphic Encryption
Kim, J., Kim, S., Choi, J., Park, J., Kim, D., & Ahn, J. H. (2023) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1145/3579371.3589053 · Cited by 162
24.4 Sandwich-RAM: An Energy-Efficient In-Memory BWN Architecture with Pulse-Width Modulation
Yang, J., Kong, Y., Wang, Z., Liu, Y., Wang, B., Yin, S., & Shi, L. (2019) · 2019 IEEE International Solid- State Circuits Conference - (ISSCC) · doi:10.1109/isscc.2019.8662435 · Cited by 161
“A conventional digital implementation, which is composed of separate feature/weight memories and a multiply-and-accumulate (MAC) unit, requires large amounts of data to be moved [3].”
BackgroundDevice and materials requirements for neuromorphic computing
Islam, R., Li, H., Chen, P.-Y., Wan, W., Chen, H.-Y., Gao, B., Wu, H., Yu, S., Saraswat, K., & Philip Wong, H.-S. (2019) · Journal of Physics D: Applied Physics · doi:10.1088/1361-6463/aaf784 · Cited by 158
SC-DCNN: Highly-Scalable Deep Convolutional Neural Network using Stochastic Computing
Ren, A., Li, Z., Ding, C., Qiu, Q., Wang, Y., Li, J., Qian, X., & Yuan, B. (2017) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3037697.3037746 · Cited by 155
A survey on hardware accelerators: Taxonomy, trends, challenges, and perspectives
Peccerillo, B., Mannino, M., Mondelli, A., & Bartolini, S. (2022) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2022.102561 · Cited by 151
Memristor devices for neural networks
Jeong, H., & Shi, L. (2019) · Journal of Physics D: Applied Physics · doi:10.1088/1361-6463/aae223 · Cited by 147
An IoT Endpoint System-on-Chip for Secure and Energy-Efficient Near-Sensor Analytics
Conti, F., Schilling, R., Schiavone, P. D., Pullini, A., Rossi, D., Gürkaynak, F. K., Muehlberghuber, M., Gautschi, M., Loi, I., Haugou, G., et al. (2017) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2017.2698019 · Cited by 147
Self-citationComprehensive SNN Compression Using ADMM Optimization and Activity Regularization
Deng, L., Wu, Y., Hu, Y., Liang, L., Li, G., Hu, X., Ding, Y., Li, P., & Xie, Y. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3109064 · Cited by 136
MRIMA: An MRAM-Based In-Memory Accelerator
Angizi, S., He, Z., Awad, A., & Fan, D. (2019) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2019.2907886 · Cited by 132
Energy Consumption Prediction Using Machine Learning; A ReviewPreprint
Mosavi, A. H., & Bahmani, A. (2019) · Preprints.org · doi:10.20944/preprints201903.0131.v1 · Cited by 125
On the Resilience of RTL NN Accelerators: Fault Characterization and Mitigation
Salami, B., Ünsal, O., & Kestelman, A. C. (2018) · International Symposium on Computer Architecture and High Performance Computing (SBAC-PAD) · doi:10.1109/cahpc.2018.8645906 · Cited by 114
A Review of Artificial Intelligence in Embedded Systems
Zhang, Z., & Li, J. (2023) · Micromachines · doi:10.3390/mi14050897 · Cited by 114
Dave, S., Baghdadi, R., Nowatzki, T., Avancha, S., Shrivastava, A., & Li, B. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3098483 · Cited by 111
Accelerating CNN Inference on ASICs: A Survey
Moolchandani, D., Kumar, A., & Sarangi, S. R. (2020) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2020.101887 · Cited by 110
Koppula, S., Orosa, L., Yağlıkçı, A. G., Azizi, R., Shahroodi, T., Kanellopoulos, K., & Mutlu, O. (2019) · Proceedings of the 52nd Annual IEEE/ACM International Symposium on Microarchitecture · doi:10.1145/3352460.3358280 · Cited by 104
Jafari, A., Ganesan, A., Thalisetty, C. S. K., Sivasubramanian, V., Oates, T., & Mohsenin, T. (2018) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2018.2848647 · Cited by 103
Moons, B., Bankman, D., Yang, L., Murmann, B., & Verhelst, M. (2018) · 2018 IEEE Custom Integrated Circuits Conference (CICC) · doi:10.1109/cicc.2018.8357071 · Cited by 103
CMP-PIM: an energy-efficient comparator-based processing-in-memory neural network accelerator
Angizi, S., He, Z., Rakin, A. S., & Fan, D. (2018) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1145/3195970.3196009 · Cited by 103
A Scalable Near-Memory Architecture for Training Deep Neural Networks on Large In-Memory Datasets
Schuiki, F., Schaffner, M., Gürkaynak, F. K., & Benini, L. (2018) · IEEE Transactions on Computers · doi:10.1109/tc.2018.2876312 · Cited by 87
Self-citationA Distributed and Parallel Accelerator Design for 3-D Acoustic Imaging on FPGA-Based Systems
Zhao, D., Mao, W., Chen, P., Hu, Y., Liang, H., Dang, Y., Liang, R., & Guo, X. (2023) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2023.3340128 · Cited by 83
The High-Dimensional Geometry of Binary Neural NetworksPreprint
Anderson, A. G., & Berg, C. P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.07199 · Cited by 82
SC-DCNN: Highly-Scalable Deep Convolutional Neural Network using Stochastic Computing
Ren, A., Li, Z., Ding, C., Qiu, Q., Wang, Y., Li, J., Qian, X., & Yuan, B. (2017) · ACM SIGPLAN Notices · doi:10.1145/3093336.3037746 · Cited by 81
Quantization Backdoors to Deep Learning Commercial Frameworks
Ma, H., Qiu, H., Gao, Y., Zhang, Z., Abuadbba, A., Xue, M., Fu, A., Zhang, J., Al-Sarawi, S. F., & Abbott, D. (2023) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2023.3271956 · Cited by 79
XpulpNN: Accelerating Quantized Neural Networks on RISC-V Processors Through ISA Extensions
Garofalo, A., Tagliavini, G., Conti, F., Rossi, D., & Benini, L. (2020) · 2020 Design, Automation & Test in Europe Conference & Exhibition (DATE) · doi:10.23919/date48585.2020.9116529 · Cited by 78
Self-citationStrategies to Improve the Accuracy of Memristor-Based Convolutional Neural Networks
Pan, W.-Q., Chen, J., Kuang, R., Li, Y., He, Y.-H., Feng, G.-R., Duan, N., Chang, T.-C., & Miao, X.-S. (2020) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2019.2963323 · Cited by 76
IMCE: Energy-efficient bit-wise in-memory convolution engine for deep neural network
Angizi, S., He, Z., Parveen, F., & Fan, D. (2018) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/aspdac.2018.8297291 · Cited by 75
PUMA: A Programmable Ultra-efficient Memristor-based Accelerator for Machine Learning InferencePreprint
Ankit, A., Hajj, I. E., Chalamalasetti, S. R., Ndu, G., Foltín, M., Williams, R. S., Faraboschi, P., Hwu, W., Strachan, J. P., Roy, K., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.10351 · Cited by 73
Real-Time Detection of Hogweed: UAV Platform Empowered by Deep Learning
Menshchikov, A., Shadrin, D., Prutyanov, V., Lopatkin, D., Sosnin, S., Tsykunov, E., Iakovlev, E., & Somov, A. (2021) · IEEE Transactions on Computers · doi:10.1109/tc.2021.3059819 · Cited by 73
Neuromorphic Computing Using NAND Flash Memory Architecture With Pulse Width Modulation Scheme
Lee, S., & Lee, J. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.571292 · Cited by 73
Smartphone-based real-time object recognition architecture for portable and constrained systems
Martinez‐Alpiste, I., Golcarenarenji, G., Wang, Q., & Calero, J. M. A. (2021) · Journal of Real-Time Image Processing · doi:10.1007/s11554-021-01164-1 · Cited by 70
Garofalo, A., Tagliavini, G., Conti, F., Benini, L., & Rossi, D. (2021) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2021.3072337 · Cited by 68
Self-citationAn Experimental Study of Reduced-Voltage Operation in Modern FPGAs for Neural Network Acceleration
Salami, B., Onural, E. B., Yüksel, İ. E., Koç, F., Ergin, O., Kestelman, A. C., Ünsal, O., Sarbazi‐Azad, H., & Mutlu, O. (2020) · International Conference on Dependable Systems & Networks/Proceedings · doi:10.1109/dsn48063.2020.00032 · Cited by 67
Comprehensive Evaluation of Supply Voltage Underscaling in FPGA on-Chip Memories
Salami, B., Ünsal, O., & Kestelman, A. C. (2018) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2018.00064 · Cited by 66
DiCENet: Dimension-Wise Convolutions for Efficient Networks
Mehta, S., Hajishirzi, H., & Rastegari, M. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3041871 · Cited by 64
Mr.BiQ: Post-Training Non-Uniform Quantization based on Minimizing the Reconstruction Error
Jeon, Y., Lee, C., Cho, E., & Ro, Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01201 · Cited by 63
Butterfly Transform: An Efficient FFT Based Neural Architecture Design
Alizadeh, K., Prabhu, A., Farhadi, A., & Rastegari, M. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01204 · Cited by 62
An Ultra-Low Power TinyML System for Real-Time Visual Processing at Edge
Xu, K., Zhang, H., Li, Y., Zhang, Y., Lai, R., & Liu, Y. (2023) · IEEE Transactions on Circuits & Systems II Express Briefs · doi:10.1109/tcsii.2023.3239044 · Cited by 62
Reconfigurable Field-Effect Transistor as a Synaptic Device for XNOR Binary Neural Network
Bae, J., Kim, H., Kwon, D., Lim, S., Lee, S., Park, B., & Lee, J. (2019) · IEEE Electron Device Letters · doi:10.1109/led.2019.2898448 · Cited by 61
Energy Efficient In-Memory Binary Deep Neural Network Accelerator with Dual-Mode SOT-MRAM
Fan, D., & Angizi, S. (2017) · IEEE International Conference on Computer Design: VLSI in Computers and Processors (ICCD) · doi:10.1109/iccd.2017.107 · Cited by 60
Yin, S., Ouyang, P., Yang, J., Lu, T., Li, X., Liu, L., & Wei, S. (2018) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2018.2881913 · Cited by 60
RegHD: Robust and Efficient Regression in Hyper-Dimensional Learning System
Hernández-Cano, A., Zhuo, C., Yin, X., & Imani, M. (2021) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1109/dac18074.2021.9586284 · Cited by 62
XNORBIN: A 95 TOp/s/W hardware accelerator for binary convolutional neural networks
Bahou, A. A., Karunaratne, G., Andri, R., Cavigelli, L., & Benini, L. (2018) · IEEE Symposium in Low-Power and High-Speed Chips (COOL CHIPS) · doi:10.1109/coolchips.2018.8373076 · Cited by 59
Self-citationeCNN: A Block-Based and Highly-Parallel CNN Accelerator for Edge Inference
Huang, C.-T., Ding, Y.-C., Wang, H.-C., Weng, C.-W., Lin, K.-P., Wang, L.-W., & Chen, L.-D. (2019) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1145/3352460.3358263 · Cited by 59
Reggiani, E., Pappalardo, A., Doblas, M., Moretó, M., Olivieri, M., Ünsal, O., & Cristal, A. (2023) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca56546.2023.10071076 · Cited by 56
Optimally Scheduling CNN Convolutions for Efficient Memory AccessPreprint
Stoutchinin, A., Conti, F., & Benini, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.01492 · Cited by 56
Self-citationZheng, S., Ouyang, P., Song, D., Li, X., Liu, L., Wei, S., & Yin, S. (2019) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2019.2942092 · Cited by 55
Wang, C.-C., Chiu, C., & Chang, J.-Y. (2022) · Journal of Signal Processing Systems · doi:10.1007/s11265-022-01808-w · Cited by 53
Garofalo, A., Rusci, M., Conti, F., Rossi, D., & Benini, L. (2019) · IEEE International Conference on Electronics, Circuits and Systems (ICECS) · doi:10.1109/icecs46596.2019.8965067 · Cited by 53
Self-citationMemristive Quantized Neural Networks: A Novel Approach to Accelerate Deep Learning On-Chip
Zhang, Y., Cui, M., Shen, L., & Zeng, Z. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2019.2912205 · Cited by 50
SC-DCNN: Highly-Scalable Deep Convolutional Neural Network using Stochastic Computing
Ren, A., Li, Z., Ding, C., Qiu, Q., Wang, Y., Li, J., Qian, X., & Yuan, B. (2017) · ACM SIGOPS Operating Systems Review · doi:10.1145/3093315.3037746 · Cited by 50
XNORBIN: A 95 TOp/s/W Hardware Accelerator for Binary Convolutional Neural Networks
Bahou, A. A., Karunaratne, G., Andri, R., Cavigelli, L., & Benini, L. (2018) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000329926 · Cited by 49
Self-citationLiu, B., Qin, H., Gong, Y., Ge, W., Xia, M., & Shi, L. (2018) · IEEE Access · doi:10.1109/access.2018.2870273 · Cited by 49
Hardware-Software Co-Design for an Analog-Digital Accelerator for Machine Learning
Ambrosi, J., Ankit, A., Antunes, R., Chalamalasetti, S. R., Chatterjee, S., Hajj, I. E., Fachini, G. J. D. A., Faraboschi, P., Foltín, M., Huang, S., et al. (2018) · IEEE International Conference on Rebooting Computing (ICRC) · doi:10.1109/icrc.2018.8638612 · Cited by 48
FPGA Based Implementations of RNN and CNN: A Brief Analysis
Mahreen, Z., Usmani, A. R., Mehrban, S., & Hussain, M. (2019) · International Conference on Innovative Computing (ICIC) · doi:10.1109/icic48496.2019.8966676 · Cited by 48
Fasfous, N., Vemparala, M. R., Frickenstein, A., Frickenstein, L., Badawy, M., & Stechele, W. (2021) · IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum · doi:10.1109/ipdpsw52791.2021.00024 · Cited by 48
EBPC: Extended Bit-Plane Compression for Deep Neural Network Inference and Training Accelerators
Cavigelli, L., Rutishauser, G., & Benini, L. (2019) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2019.2950093 · Cited by 46
Self-citationEvent-triggered natural hazard monitoring with convolutional neural networks on the edge
Meyer, M., Farei-Campagna, T., Pasztor, A., Forno, R. D., Gsell, T., Faillettaz, J., Vieli, A., Weber, S., Beutel, J., & Thiele, L. (2019) · ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN) · doi:10.1145/3302506.3310390 · Cited by 45
Conti, F., Cavigelli, L., Paulin, G., Susmelj, I., & Benini, L. (2018) · 2018 IEEE Custom Integrated Circuits Conference (CICC) · doi:10.1109/cicc.2018.8357068 · Cited by 44
Self-citationGarifulla, M., Shin, J., Kim, C., Kim, W. H., Kim, H. J., Kim, J., & Hong, S. (2021) · Sensors · doi:10.3390/s22010219 · Cited by 42
Cladera, F., Bisulco, A., Kepple, D. R., Isler, V., & Lee, D. D. (2020) · Proceedings - International Conference on Image Processing · doi:10.1109/icip40778.2020.9191148 · Cited by 40
Koppula, S., Orosa, L., Yağlıkçı, A. G., Azizi, R., Shahroodi, T., Kanellopoulos, K., & Mutlu, O. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.05340 · Cited by 40
Unrolling Ternary Neural Networks
Tridgell, S., Kumm, M., Hardieck, M., Boland, D., Moss, D. J. M., Zipf, P., & Leong, P. H. W. (2019) · ACM Transactions on Reconfigurable Technology and Systems · doi:10.1145/3359983 · Cited by 40
Deep learning on microcontrollers: a study on deployment costs and challenges
Svoboda, F., Fernández-Marqués, J., Liberis, E., & Lane, N. D. (2022) · Workshop on Machine Learning and Systems (EuroMLSys) · doi:10.1145/3517207.3526978 · Cited by 40
SC-DCNN: Highly-Scalable Deep Convolutional Neural Network using Stochastic ComputingPreprint
Ren, A., Li, J., Li, Z., Ding, C., Qian, X., Qiu, Q., Yuan, B., & Wang, Y. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.05939 · Cited by 38
SHIELDeNN: Online Accelerated Framework for Fault-Tolerant Deep Neural Network Architectures
Khoshavi, N., Roohi, A., Broyles, C., Sargolzaei, S., Bi, Y., & Pan, D. Z. (2020) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1109/dac18072.2020.9218697 · Cited by 38
LP-BNN: Ultra-low-Latency BNN Inference with Layer Parallelism
Geng, T., Wang, T., Wu, C., Yang, C., Song, S. L., Li, A., & Herbordt, M. (2019) · IEEE International Conference on Application-specific Systems, Architectures and Processors (ASAP) · doi:10.1109/asap.2019.00-43 · Cited by 37
CMP-PIM: An Energy-Efficient Comparator-based Processing-In-Memory Neural Network Accelerator
Angizi, S., He, Z., Rakin, A. S., & Fan, D. (2018) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1109/dac.2018.8465860 · Cited by 37
A survey on CNN and RNN implementations
Hoffmann, J., Navarro, O., Kästner, F., Janßen, B., & Hübner, M. (2017) · Cited by 37
Vita, A. D., Russo, A., Pau, D. P., Benedetto, L. D., Rubino, A., & Licciardo, G. D. (2020) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2020.3011984 · Cited by 33
ULEEN: A Novel Architecture for Ultra-low-energy Edge Neural Networks
Susskind, Z., Arora, A., Miranda, I. D. S., Bacellar, A. T. L., Villon, L. A. Q., Katopodis, R. F., de Araújo, L. S., Dutra, D. L. C., Lima, P. M. V., França, F. M. G., et al. (2023) · ACM Transactions on Architecture and Code Optimization · doi:10.1145/3629522 · Cited by 33
A Unified Parallel CORDIC-Based Hardware Architecture for LSTM Network Acceleration
Mohamed, N. A., & Cavallaro, J. R. (2023) · IEEE Transactions on Computers · doi:10.1109/tc.2023.3268400 · Cited by 32
High-Efficiency Convolutional Ternary Neural Networks with Custom Adder Trees and Weight Compression
Prost-Boucle, A., Bourge, A., & Pétrot, F. (2018) · ACM Transactions on Reconfigurable Technology and Systems · doi:10.1145/3270764 · Cited by 32
Ma, X., Zhang, Y., Yuan, G., Ren, A., Li, Z., Han, J., Hu, J., & Wang, Y. (2018) · International Symposium on Quality Electronic Design (ISQED) · doi:10.1109/isqed.2018.8357306 · Cited by 31
FPGA-QNN: Quantized Neural Network Hardware Acceleration on FPGAs
Tasci, M., İstanbullu, A., Tümen, V., & Koşunalp, S. (2025) · Applied Sciences · doi:10.3390/app15020688 · Cited by 31
Armeniakos, G., Maras, A., Xydis, S., & Soudris, D. (2024) · doi:10.1145/3676536.3676840 · Cited by 31
Exploiting Parallelism for CNN Applications on 3D Stacked Processing-In-Memory Architecture
Wang, Y., Chen, W., Yang, J., & Li, T. (2018) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2018.2868062 · Cited by 29
ChewBaccaNN: A Flexible 223 TOPS/W BNN Accelerator
Andri, R., Karunaratne, G., Cavigelli, L., & Benini, L. (2021) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas51556.2021.9401214 · Cited by 29
Self-citationQReg: On Regularization Effects of QuantizationPreprint
AskariHemmat, M., Hemmat, R. A., Hoffman, A., Lazarevich, I. A., Saboori, E., Mastropietro, O., Sah, S., Savaria, Y., & David, J. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2206.12372 · Cited by 29
Deterministic conversion rule for CNNs to efficient spiking convolutional neural networks
Yang, X., Zhang, Z., Zhu, W., Yu, S., Liu, L., & Wu, N. (2020) · Science China Information Sciences · doi:10.1007/s11432-019-1468-0 · Cited by 28
StrassenNets: Deep Learning with a Multiplication BudgetPreprint
Tschannen, M., Khanna, A., & Anandkumar, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.03942 · Cited by 27
Xia, Z., Chen, J., Huang, Q., Luo, J., & Hu, J. (2020) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2020.3039346 · Cited by 27
DNN pruning and mapping on NoC-Based communication infrastructure
Mirmahaleh, S. Y. H., & Rahmani, A. M. (2019) · Microelectronics Journal · doi:10.1016/j.mejo.2019.104655 · Cited by 27
Towards Memory-Efficient Allocation of CNNs on Processing-in-Memory Architecture
Wang, Y., Chen, W., Yang, J., & Li, T. (2018) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2018.2791440 · Cited by 27
Frenkel, C., Legat, J.-D., & Bol, D. (2019) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2019.8702793 · Cited by 26
A Resource-Efficient Inference Accelerator for Binary Convolutional Neural Networks
Kim, T., & Shin, J. (2020) · IEEE Transactions on Circuits & Systems II Express Briefs · doi:10.1109/tcsii.2020.3010336 · Cited by 26
Metadata
- Authors
- Andri, R., Cavigelli, L., Rossi, D., & Benini, L.
- Affiliations
- ETH Zurich (CH)
- University of Bologna (IT)
- Venue
- IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
- Published
- 2018-01
- Volume
- 37
- Issue
- 1
- Pages
- 48-60
- ISSN
- 0278-0070 (ISSN-L)
- 1937-4151
- OpenAlex
- W2588598812
- Cited by
- 247
- References
- 60
- Citations by year
- 2026: 4 · 2025: 14 · 2024: 11 · 2023: 20 · 2022: 29 · 2021: 24 · 2020: 45 · 2019: 48 · 2018: 38
- FWCI
- 16.02
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Archivio istituzionale della ricerca (Alma Mater Studiorum Università di Bologna) (submittedVersion, other-oa)
- Repository for Publications and Research Data (ETH Zurich) (submittedVersion, other-oa)
- arXiv (Cornell University)
- ETH Zürich Research Collection
- Funders
- Swiss National Science Foundation (162524)
- (MicroLearn: Micropower Deep Learning)
- Armasuisse Science and Technology
- ERC MultiTherman Project (ERC-AdG-291125)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Low-power high-performance VLSI design
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Keywords
- CNN accelerator, ultra-low power, energy efficiency, area efficiency, 65 nm CMOS
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.