Eyeriss: An Energy-Efficient Reconfigurable Accelerator for Deep Convolutional Neural Networks
The DOI matches its Crossref record; 38 of the 42 references it cites were found in a registry or an index.
Abstract
Eyeriss is an accelerator for state-of-the-art deep convolutional neural networks (CNNs). It optimizes for the energy efficiency of the entire system, including the accelerator chip and off-chip DRAM, for various CNN shapes by reconfiguring the architecture. CNNs are widely used in modern AI systems but also bring challenges on throughput and energy efficiency to the underlying hardware. This is because its computation requires a large amount of data, creating significant data movement from on-chip and off-chip that is more energy-consuming than computation. Minimizing data movement energy cost for any CNN shape, therefore, is the key to high throughput and energy efficiency. Eyeriss achieves these goals by using a proposed processing dataflow, called row stationary (RS), on a spatial architecture with 168 processing elements. RS dataflow reconfigures the computation mapping of a given shape, which optimizes energy efficiency by maximally reusing data locally to reduce expensive data movement, such as DRAM accesses. Compression and data gating are also applied to further improve energy efficiency. Eyeriss processes the convolutional layers at 35 frames/s and 0.0029 DRAM access/multiply and accumulation (MAC) for AlexNet at 278 mW (batch size N = 4), and 0.7 frames/s and 0.0035 DRAM access/MAC for VGG-16 at 236 mW (N = 3).
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“such scaling will enable NeuRRAM to deliver higher energy and area efficiency than today’s state-of-the-art edge inference accelerators58–61.”
From A compute-in-memory chip based on resistive random-access memory (2022) · cites this paper as [58]
In the citing paper
“Some studies proposed to implement the argmax() function via hardware128–148, which could be beneficial to reduce the total transistor count and power consumption while at the same time increasing the throughput.”
From Hardware implementation of memristor-based artificial neural networks (2024) · cites this paper as [131]
In the citing paper
“Based on the analysis of the research, CoNNA is able to speed up at least 3.08 times and up to 14.1 times faster than the MIT Eyeriss Accelerator [20].”
From Embedded Intelligence on FPGA: Survey, Applications and Challenges (2021) · cites this paper as [20]
In the citing paper
“massively parallel processing architectures with distributed memory architectures, such as graphic processing units (GPUs) but also increasingly specialized chips for NN inference (e.g., [17]), have shown to be very energy efficient and capable of impressive computational throughput when fully utilized by concurrent algorithms [18].”
From An Introduction to Deep Learning for the Physical Layer (2017) · cites this paper as [17]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 1×
“Modern CNNs achieve their superior accuracy by building a very deep hierarchy of layers [2]–[5], [7], which transform the input image data into highly abstract representations called feature maps (fmaps).”
BackgroundVery Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148 · cited 7×
“We benchmark the chip performance using two publicly available and widely used CNNs: AlexNet [2] and VGG-16 [3].”
MethodInfluentialImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 1×
“[25] demonstrate a CNN processor and only report the theoretical peak throughput along with the power measured on a CNN for the MNIST data set [26], which has storage and computation requirements that are orders of magnitude lower than the state-of-the-art CNNs.”
MethodGoing deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380 · cited 2×
“We have demonstrated an 1000-class image classification task [27] using this system, and a live demo can be found in [29].”
BackgroundMethodRich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612 · cited 1×
“D EEP learning using convolutional neural networks (CNNs) [1] has achieved unprecedented accuracy on many modern AI applications [2]–[9].”
Background(2010) · International Conference on Machine Learning · Cited by 13,995
Research works printed but not linked: 2
- han, 2015, Learning both weights and connections for efficient neural network, Proc Adv Neural Inf Process Syst, 28, 1135
- chen, 2016, An 1000-Class Image Classification Task Performed by the Eyeriss-Integrated Deep Learning System
Cited by
Efficient Processing of Deep Neural Networks: A Tutorial and Survey
Sze, V., Chen, Y.-H., Yang, T.-J., & Emer, J. S. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2761740 · Cited by 4,215
Self-citationDeep learning with coherent nanophotonic circuits
Shen, Y., Harris, N. C., Skirlo, S., Prabhu, M., Baehr-Jones, T., Hochberg, M., Sun, X., Zhao, S., Larochelle, H., Englund, D., et al. (2017) · Nature Photonics · doi:10.1038/nphoton.2017.93 · Cited by 3,340
An Introduction to Deep Learning for the Physical Layer
O'Shea, T., & Hoydis, J. (2017) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2017.2758370 · Cited by 2,980
“, [17]), have shown to be very energy efficient and capable of impressive computational throughput when fully utilized by concurrent algorithms [18].”
BackgroundIn-memory computing with resistive switching devices
Ielmini, D., & Wong, H.-S. P. (2018) · Nature Electronics · doi:10.1038/s41928-018-0092-2 · Cited by 2,298
“Also, application-specific processors known as accelerators are designed to match the exact computing algorithms and data flow 5 .”
MethodFully hardware-implemented memristor convolutional neural network
Yao, P., Wu, H., Gao, B., Tang, J., Zhang, Q., Zhang, W., Yang, J. J., & Qian, H. (2020) · Nature · doi:10.1038/s41586-020-1942-4 · Cited by 2,179
“Such demand has led to the redesign of conventional computing systems to operate CNNs with higher performance and lower power consumption, ranging from general application platforms, such as graphics-processing units (GPUs) 13 , to application-specific accelerators 14,15 .”
BackgroundA State-of-the-Art Survey on Deep Learning Theory and Architectures
Alom, M. Z., Taha, T. M., Yakopcic, C., Westberg, S., Sidike, P., Nasrin, M. S., Hasan, M., Van Essen, B. C., Awwal, A. A. S., & Asari, V. K. (2019) · Electronics · doi:10.3390/electronics8030292 · Cited by 1,620
Deep Learning for IoT Big Data and Streaming Analytics: A Survey
Mohammadi, M., Al-Fuqaha, A., Sorour, S., & Guizani, M. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2844341 · Cited by 1,471
SLIM: Simultaneous Logic-in-Memory Computing Exploiting Bilayer Analog OxRAM Devices
Kingra, S. K., Parmar, V., Chang, C.-C., Hudec, B., Hou, T.-H., & Suri, M. (2020) · Scientific Reports · doi:10.1038/s41598-020-59121-0 · Cited by 1,439
Eyeriss: a spatial architecture for energy-efficient dataflow for convolutional neural networks
Chen, Y.-H., Emer, J., & Sze, V. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001177 · Cited by 1,182
“The RS dataflow is a key feature of the Eyeriss architecture, which has been implemented in a fabricated chip [41] (Fig.”
BackgroundMethodInfluentialSelf-citationNeuro-Inspired Computing With Emerging Nonvolatile Memorys
Yu, S. (2018) · Proceedings of the IEEE · doi:10.1109/jproc.2018.2790840 · Cited by 1,170
“The estimates [41], based on the experimentally measured parameters of the memory cells, showed that the transfer to the 55-nm technology, with some improvements of auxiliary CMOS circuits, will allow the implementation of much larger networks with a similar performance lead over the most prospective digital networks…”
BackgroundMethodEyeriss v2: A Flexible Accelerator for Emerging Deep Neural Networks on Mobile Devices
Chen, Y.-H., Yang, T.-J., Emer, J. S., & Sze, V. (2019) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2019.2910232 · Cited by 1,106
“Eyeriss v1 is the same design as the original Eyeriss [33], but with the storage capacity, number of PEs and data precision scaled to the same level as v1.”
BackgroundMethodInfluentialSelf-citationTowards artificial general intelligence with hybrid Tianjic chip architecture
Pei, J., Deng, L., Song, S., Zhao, M., Zhang, Y., Wu, S., Wang, G., Zou, Z., Wu, Z., He, W., et al. (2019) · Nature · doi:10.1038/s41586-019-1424-8 · Cited by 1,082
Rueckauer, B., Lungu, I.-A., Hu, Y., Pfeiffer, M., & Liu, S.-C. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00682 · Cited by 1,072
“…of SNNs on dedicated spiking hardware platforms like SpiNNaker or TrueNorth is left to future work, and will be necessary for estimating the real energy cost in comparison to the cost of implementing the original ANNs on custom ANN hardware accelerators like Eyeriss (Chen et al., 2017).”
MethodModel Compression and Hardware Acceleration for Neural Networks: A Comprehensive Survey
Deng, B. L., Li, G., Han, S., Shi, L., & Xie, Y. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2020.2976475 · Cited by 996
“[261] Y.”
BackgroundMethodInfluentialA compute-in-memory chip based on resistive random-access memory
Wan, W., Kubendran, R., Schaefer, C., Eryilmaz, S. B., Zhang, W., Wu, D., Deiss, S., Raina, P., Qian, H., Gao, B., et al. (2022) · Nature · doi:10.1038/s41586-022-04992-8 · Cited by 943
“Extended Data Table 2 shows that such scaling will enable NeuRRAM to deliver higher energy and area efficiency than today’s state-of-the-art edge inference accelerators 58–61 .”
BackgroundA Survey on Federated Learning for Resource-Constrained IoT Devices
Imteaj, A., Thakker, U., Wang, S., Li, J., & Amini, M. H. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3095077 · Cited by 774
Deep Learning for Electromyographic Hand Gesture Signal Classification Using Transfer Learning
Cote-Allard, U., Fall, C. L., Drouin, A., Campeau-Lecours, A., Gosselin, C., Glette, K., Laviolette, F., & Gosselin, B. (2019) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2019.2896269 · Cited by 738
Designing Energy-Efficient Convolutional Neural Networks Using Energy-Aware Pruning
Yang, T.-J., Chen, Y.-H., & Sze, V. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.643 · Cited by 732
“The hardware parameters used are similar to [22].”
MethodInfluentialSelf-citationA Survey of Neuromorphic Computing and Neural Networks in Hardware
Schuman, C. D., Potok, T. E., Patton, R. M., Birdwell, J. D., Dean, M. E., Rose, G. S., & Plank, J. S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.06963 · Cited by 352
Cnvlutin: ineffectual-neuron-free deep neural network computing
Albericio, J., Judd, P., Hetherington, T., Aamodt, T., Jerger, N. E., & Moshovos, A. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001138 · Cited by 614
“Eyeriss [45] is a low power, realtime DNN accelerator that exploits zero valued neurons by using run length coding for memory compression.”
NetAdapt: Platform-Aware Neural Network Adaptation for Mobile Applications
Yang, T.-J., Howard, A., Chen, B., Zhang, X., Go, A., Sandler, M., Sze, V., & Adam, H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01249-6_18 · Cited by 572
Self-citationAngel-Eye: A Complete Design Flow for Mapping CNN Onto Embedded FPGA
Guo, K., Sui, L., Qiu, J., Yu, J., Wang, J., Yao, S., Han, S., Wang, Y., & Yang, H. (2018) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2017.2705069 · Cited by 562
“ISSCC 2016 [30] 65nm ASIC 108KB yes dynamic no dynamic no”
BackgroundMethodEstimation of energy consumption in machine learning
García-Martín, E., Rodrigues, C. F., Riley, G., & Grahn, H. (2019) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2019.07.007 · Cited by 558
“While the authors provide an energy estimation model to map the neural network model to their specific architecture design, details of their optimization procedure are not provided [14].”
BackgroundBinary Neural Networks: A Survey
Qin, H., Gong, R., Liu, X., Bai, X., Song, J., & Sebe, N. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107281 · Cited by 546
Bit Fusion: Bit-Level Dynamically Composable Architecture for Accelerating Deep Neural Network
Sharma, H., Park, J., Suda, N., Lai, L., Chau, B., Kim, J. K., Chandra, V., & Esmaeilzadeh, H. (2018) · 2018 ACM/IEEE 45th Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca.2018.00069 · Cited by 543
“Eyeriss [1, 3] presents an optimized row-stationary dataflow for DNNs to improve efficiency.”
BackgroundInfluentialHardware implementation of memristor-based artificial neural networks
Aguirre, F., Sebastian, A., Le Gallo, M., Song, W., Wang, T., Yang, J. J., Lu, W., Chang, M.-F., Ielmini, D., Yang, Y., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-45670-9 · Cited by 564
SIGMA: A Sparse and Irregular GEMM Accelerator with Flexible Interconnects for DNN Training
Qin, E., Samajdar, A., Kwon, H., Nadella, V., Srinivasan, S., Das, D., Kaul, B., & Krishna, T. (2020) · 2020 IEEE International Symposium on High Performance Computer Architecture (HPCA) · doi:10.1109/hpca47549.2020.00015 · Cited by 487
“Bitmap has comparable overhead to RLC [10], [19], at sparse ratio of ∼30% to ∼70%.”
BackgroundMethodInfluentialSelf-citationFrom high-level deep neural models to FPGAs
Sharma, H., Park, J., Mahajan, D., Amaro, E., Kim, J. K., Shao, C., Mishra, A., & Esmaeilzadeh, H. (2016) · 2016 49th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2016.7783720 · Cited by 365
“[23, 43] develop an ASIC design with a 2D spatial array of PEs for Convolutional Neural Networks.”
MethodScaling for edge inference of deep neural networks
Xu, X., Ding, Y., Hu, S. X., Niemier, M., Cong, J., Hu, Y., & Shi, Y. (2018) · Nature Electronics · doi:10.1038/s41928-018-0059-3 · Cited by 462
Minerva: enabling low-power, highly-accurate deep neural network accelerators
Reagen, B., Whatmough, P., Adolf, R., Rama, S., Lee, H., Lee, S. K., Hernández-Lobato, J. M., Wei, G.-Y., & Brooks, D. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001165 · Cited by 446
“The reconfigurable CNN accelerator in [53] clock gates processing elements when activities are zero.”
BackgroundSharma, S. K., & Wang, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2916177 · Cited by 427
“ticular accelerators in the form of hardware and circuits with the objective of optimizing memory footprint [39] and energy efficiency [40] of DL models.”
BackgroundAccelerating Binarized Convolutional Neural Networks with Software-Programmable FPGAs
Zhao, R., Song, W., Zhang, W., Xing, T., Lin, J.-H., Srivastava, M., Gupta, R., & Zhang, Z. (2017) · Proceedings of the 2017 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays · doi:10.1145/3020078.3021741 · Cited by 429
“The Eyeriss paper [3] contains a comprehensive study of popular dataflows for spatial architectures and derive an optimal one.”
BackgroundRecent advances in convolutional neural network acceleration
Zhang, Q., Zhang, M., Chen, T., Sun, Z., Ma, Y., & Yu, B. (2019) · Neurocomputing · doi:10.1016/j.neucom.2018.09.038 · Cited by 434
A High-Throughput and Power-Efficient FPGA Implementation of YOLO CNN for Object Detection
Nguyen, D. T., Nguyen, T. N., Kim, H., & Lee, H.-J. (2019) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2019.2905242 · Cited by 435
XNOR-SRAM: In-Memory Computing SRAM Macro for Binary/Ternary Deep Neural Networks
Yin, S., Jiang, Z., Seo, J.-S., & Seok, M. (2020) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2019.2963616 · Cited by 429
“The arithmetic complexity reduction from the binary and ternary algorithms, however, makes row-by-row memory access dominating the speed and energy efficiency of DNN hardware [7].”
BackgroundHoefler, T., Alistarh, D., Ben-Nun, T., Dryden, N., & Peste, A. (2021) · ETH Zurich · doi:10.3929/ethz-b-000519202 · Cited by 423
Efficient Acceleration of Deep Learning Inference on Resource-Constrained Edge Devices: A Review
Shuvo, M. M. H., Islam, S. K., Cheng, J., & Morshed, B. I. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2022.3226481 · Cited by 436
“RLC for activation compression, PE data gating, and zero input detection are used in [250].”
BackgroundMethodResultInfluentialvDNN: Virtualized deep neural networks for scalable, memory-efficient neural network design
Rhu, M., Gimelshein, N., Clemons, J., Zulfiqar, A., & Keckler, S. W. (2016) · 2016 49th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2016.7783721 · Cited by 338
“While less directly related to vDNN, a variety of accelerator architectures have also been proposed for DNNs [20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 53].”
BackgroundBiswas, A., & Chandrakasan, A. P. (2019) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2018.2880918 · Cited by 414
“CNNs typically consist of a cascade of convolutional (CONV) and fully-connected (FC) layers (Fig.”
BackgroundMethodInfluentialAutomatic Modulation Classification: A Deep Learning Enabled Approach
Meng, F., Chen, P., Wu, L., & Wang, X. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2868698 · Cited by 413
“To obviate feature engineering, the deep learning method [21] is developing rapidly in recent years both in algorithm design and hardware implementation [22], and it can learn significantly more complex functions than a shallow one.”
MethodLinear programmable nanophotonic processors
Harris, N. C., Carolan, J., Bunandar, D., Prabhu, M., Hochberg, M., Baehr-Jones, T., Fanto, M. L., Smith, A. M., Tison, C. C., Alsing, P. M., et al. (2018) · Optica · doi:10.1364/optica.5.001623 · Cited by 396
Large-Scale Optical Neural Networks Based on Photoelectric Multiplication
Hamerly, R., Bernstein, L., Sludds, A., Soljačić, M., & Englund, D. (2019) · Physical Review X · doi:10.1103/physrevx.9.021032 · Cited by 388
“The time required to rearrange the image as a patch matrix is typically very small compared to the time to compute the GEMM [76] (and can be further reduced if necessary with network-on-chip architectures [77] or optical buffering [78]); therefore,”
BackgroundCompute-in-Memory Chips for Deep Learning: Recent Trends and Prospects
Yu, S., Jiang, H., Huang, S., Peng, X., & Lu, A. (2021) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2021.3092533 · Cited by 391
Holistic Network Virtualization and Pervasive Network Intelligence for 6G
Shen, X., Gao, J., Wu, W., Li, M., Zhou, C., & Zhuang, W. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3135829 · Cited by 392
Bayat, F. M., Prezioso, M., Chakrabarti, B., Nili, H., Kataeva, I., & Strukov, D. (2018) · Nature Communications · doi:10.1038/s41467-018-04482-4 · Cited by 377
“The breakthrough 3 was enabled not by any significant algorithm advance, but rather by the use of high performance graphics processors 4 , and the further progress is being fueled now by the development of even more powerful graphics processors and custom integrated circuits 5-7 .”
MethodReinforcement learning with analogue memristor arrays
Wang, Z., Li, C., Song, W., Rao, M., Belkin, D., Li, Y., Yan, P., Jiang, H., Lin, P., Hu, M., et al. (2019) · Nature Electronics · doi:10.1038/s41928-019-0221-6 · Cited by 370
A Survey of Accelerator Architectures for Deep Neural Networks
Chen, Y., Xie, Y., Song, L., Chen, F., & Tang, T. (2020) · Engineering · doi:10.1016/j.eng.2020.01.007 · Cited by 370
Self-citationHan, S., Shen, H., Philipose, M., Agarwal, S., Wolman, A., & Krishnamurthy, A. (2016) · Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/2906388.2906396 · Cited by 367
Stripes: Bit-serial deep neural network computing
Judd, P., Albericio, J., Hetherington, T., Aamodt, T. M., & Moshovos, A. (2016) · 2016 49th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2016.7783722 · Cited by 333
“Eyeriss [32] is a low power, real-time DNN accelerator that exploits zero valued neurons by using run length coding for memory compression and data gating zero neuron computations to save power.”
MethodSqueezeNext: Hardware-Aware Neural Network Design
Gholami, A., Kwon, K., Wu, B., Tai, Z., Yue, X., Jin, P., Zhao, S., & Keutzer, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00215 · Cited by 350
Optimizing the Convolution Operation to Accelerate Deep Neural Networks on FPGA
Ma, Y., Cao, Y., Vrudhula, S., & Seo, J.-S. (2018) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2018.2815603 · Cited by 343
“1) [Type-(A)] unroll loop-1, loop-2, loop-4 [11], [13], [17], [19]; 2) [Type-(B)] unroll loop-2, loop-4 [9], [14]; 3) [Type-(C)] unroll loop-1, loop-3 [7], [8], [21]; 4) [Type-(D)] unroll loop-3, loop-4 [15], [16], [18].”
Rethinking the performance comparison between SNNS and ANNS
Deng, L., Wu, Y., Hu, X., Liang, L., Ding, Y., Li, G., Zhao, G., Li, P., & Xie, Y. (2020) · Neural Networks · doi:10.1016/j.neunet.2019.09.005 · Cited by 343
UNPU: An Energy-Efficient Deep Neural Network Accelerator With Fully Variable Weight Bit Precision
Lee, J., Kim, C., Kang, S., Shin, D., Kim, S., & Yoo, H.-J. (2019) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2018.2865489 · Cited by 335
Training and Inference with Integers in Deep Neural Networks
Wu, S., Li, G., Chen, F., & Shi, L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.04680 · Cited by 306
“, 2016), as well as dedicated hardware for commercial solutions (Jouppi et al., 2017; Chen et al., 2017; Shi et al., 2015).”
BackgroundC3SRAM: An In-Memory-Computing SRAM Macro Based on Robust Capacitive Coupling Computing Mechanism
Jiang, Z., Yin, S., Seo, J.-S., & Seok, M. (2020) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2020.2992886 · Cited by 324
A 64-Tile 2.4-Mb In-Memory-Computing CNN Accelerator Employing Charge-Domain Compute
Valavi, H., Ramadge, P. J., Nestler, E., & Verma, N. (2019) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2019.2899730 · Cited by 328
Khalil, R. A., Saeed, N., Masood, M., Fard, Y. M., Alouini, M.-S., & Al-Naffouri, T. Y. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3051414 · Cited by 318
In situ training of feed-forward and recurrent convolutional memristor networks
Wang, Z., Li, C., Lin, P., Rao, M., Nie, Y., Song, W., Qiu, Q., Li, Y., Yan, P., Strachan, J. P., et al. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0089-1 · Cited by 307
AWB-GCN: A Graph Convolutional Network Accelerator with Runtime Workload Rebalancing
Geng, T., Li, A., Shi, R., Wu, C., Wang, T., Li, Y., Haghi, P., Tumeo, A., Che, S., Reinhardt, S., et al. (2020) · 2020 53rd Annual IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro50266.2020.00079 · Cited by 301
Understanding Reuse, Performance, and Hardware Cost of DNN Dataflow: A Data-Centric Approach
Kwon, H., Chatarasi, P., Pellauer, M., Parashar, A., Sarkar, V., & Krishna, T. (2019) · Proceedings of the 52nd Annual IEEE/ACM International Symposium on Microarchitecture · doi:10.1145/3352460.3358252 · Cited by 301
“We validated MAESTRO’s performance model against RTL simulations of two accelerators - MAERI [24] and Eyeriss [13] when running VGG16 and AlexNet respectively1.”
BackgroundMethodInfluentialSelf-citationPhotonic machine learning with on-chip diffractive optics
Fu, T., Zang, Y., Huang, Y., Du, Z., Huang, H., Hu, C., Chen, M., Yang, S., & Chen, H. (2023) · Nature Communications · doi:10.1038/s41467-022-35772-7 · Cited by 289
Intelligent Computing: The Latest Advances, Challenges, and Future
Zhu, S., Yu, T., Xu, T., Chen, H., Dustdar, S., Gigan, S., Gunduz, D., Hossain, E., Jin, Y., Lin, F., et al. (2023) · Intelligent Computing · doi:10.34133/icomputing.0006 · Cited by 290
Aimar, A., Mostafa, H., Calabrese, E., Rios-Navarro, A., Tapiador-Morales, R., Lungu, I.-A., Milde, M. B., Corradi, F., Linares-Barranco, A., Liu, S.-C., et al. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2852335 · Cited by 292
Maximizing CNN Accelerator Efficiency Through Resource Partitioning
Shen, Y., Ferdman, M., & Milder, P. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080221 · Cited by 284
“Eyeriss [6, 7] is a recent ASIC CNN accelerator that couples a compute grid with a NoC, enabling flexibility in scheduling CNN computation.”
BackgroundTowards edge computing in intelligent manufacturing: Past, present and future
Nain, G., Pattanaik, K. K., & Sharma, G. K. (2022) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2022.01.010 · Cited by 283
Computing Graph Neural Networks: A Survey from Algorithms to Accelerators
Abadal, S., Jain, A., Guirado, R., López-Alonso, J., & Alarcón, E. (2022) · ACM Computing Surveys · doi:10.1145/3477141 · Cited by 285
“The field exploded around 2016, when CNNs and RNNs were already well established.”
BackgroundInfluentialOrbital Edge Computing: Nanosatellite Constellations as a New Class of Computer System
Denby, B., & Lucia, B. (2020) · Proceedings of the Twenty-Fifth International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3373376.3378473 · Cited by 273
“Machine inference accelerators [14, 15, 24, 33] could significantly shorten full-coverage CNP pipeline depths, although some that rely on temporal data redundancy [10] may have limited benefit for devices capturing images at the GTFR. Intermittent computing [61] shares challenges with orbital edge…”
BackgroundThe Architectural Implications of Facebook's DNN-Based Personalized Recommendation
Gupta, U., Wu, C.-J., Wang, X., Naumov, M., Reagen, B., Brooks, D., Cottel, B., Hazelwood, K., Hempstead, M., Jia, B., et al. (2020) · 2020 IEEE International Symposium on High Performance Computer Architecture (HPCA) · doi:10.1109/hpca47549.2020.00047 · Cited by 273
“However, the resulting software and hardware solutions [13, 14, 27, 36, 44, 54] do not directly apply to production-scale recommendation workloads.”
BackgroundOptical neural networks: progress and challenges
Fu, T., Zhang, J., Sun, R., Huang, Y., Xu, W., Yang, S., Zhu, Z., & Chen, H. (2024) · Light: Science & Applications · doi:10.1038/s41377-024-01590-3 · Cited by 263
CMOS-integrated memristive non-volatile computing-in-memory for AI edge processors
Chen, W.-H., Dou, C., Li, K.-X., Lin, W.-Y., Li, P.-Y., Huang, J.-H., Wang, J.-H., Wei, W.-C., Xue, C.-X., Chiu, Y.-C., et al. (2019) · Nature Electronics · doi:10.1038/s41928-019-0288-0 · Cited by 276
Edge Intelligence: Empowering Intelligence to the Edge of Network
Xu, D., Li, T., Li, Y., Su, X., Tarkoma, S., Jiang, T., Crowcroft, J., & Hui, P. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3119950 · Cited by 272
Google Workloads for Consumer Devices: Mitigating Data Movement Bottlenecks
Boroumand, A., Ghose, S., Kim, Y., Ausavarungnirun, R., Shiu, E., Thakur, R., Kim, D., Kuusela, A., Knies, A., Ranganathan, P., et al. (2018) · Proceedings of the Twenty-Third International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3173162.3173177 · Cited by 273
“Several works [19, 36, 61, 81, 119] focus on accelerating inference.”
BackgroundMAERI: Enabling Flexible Dataflow Mapping over DNN Accelerators via Reconfigurable Interconnects
Kwon, H., Samajdar, A., & Krishna, T. (2018) · Proceedings of the Twenty-Third International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3173162.3173176 · Cited by 270
“This work also opens up exciting opportunities in compiler designs that can take arbitrary DNNs and map them efficiently over a Maeri-like fabric.”
BackgroundInfluentialSelf-citationHardware for machine learning: Challenges and opportunities
Sze, V., Chen, Y.-H., Emer, J., Suleiman, A., & Zhang, Z. (2017) · 2017 IEEE Custom Integrated Circuits Conference (CICC) · doi:10.1109/cicc.2017.7993626 · Cited by 193
Self-citationDeep Learning-Based Channel Estimation for Doubly Selective Fading Channels
Yang, Y., Gao, F., Ma, X., & Zhang, S. (2019) · IEEE Access · doi:10.1109/access.2019.2901066 · Cited by 264
C ir CNN: accelerating and compressing deep neural networks using block-circulant weight matrices
Ding, C., Liao, S., Wang, Y., Li, Z., Liu, N., Zhuo, Y., Wang, C., Qian, X., Bai, Y., Yuan, G., et al. (2017) · Proceedings of the 50th Annual IEEE/ACM International Symposium on Microarchitecture · doi:10.1145/3123939.3124552 · Cited by 176
“There are a number of recent tapeouts of hardware deep learning systems [23, 28–33].”
BackgroundMethodInfluentialBit-pragmatic deep neural network computing
Albericio, J., Delmás, A., Judd, P., Sharify, S., O'Leary, G., Genov, R., & Moshovos, A. (2017) · Proceedings of the 50th Annual IEEE/ACM International Symposium on Microarchitecture · doi:10.1145/3123939.3123982 · Cited by 216
“Given their breadth of application and high computational demand, DNNs are an attractive target for fixed-function accelerators [5, 6, 12].”
BackgroundMethodInfluentialA CNN Accelerator on FPGA Using Depthwise Separable Convolution
Bai, L., Zhao, Y., & Huang, X. (2018) · IEEE Transactions on Circuits and Systems II: Express Briefs · doi:10.1109/tcsii.2018.2865896 · Cited by 254
YodaNN: An Architecture for Ultralow Power Binary-Weight CNN Acceleration
Andri, R., Cavigelli, L., Rossi, D., & Benini, L. (2018) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2017.2682138 · Cited by 247
“For small filter sizes, they can be used to calculate several output channels in parallel or they can be switched-off [41].”
BackgroundMethodLiu, L., Zhu, J., Li, Z., Lu, Y., Deng, Y., Han, J., Yin, S., & Wei, S. (2020) · ACM Computing Surveys · doi:10.1145/3357375 · Cited by 244
“A DRAM-based PIM architecture that integrated an ALU array into the memory interface was proposed in Reference [150].”
BackgroundMethodInfluentialAccelergy: An Architecture-Level Energy Estimation Methodology for Accelerator Designs
Wu, Y. N., Emer, J. S., & Sze, V. (2019) · 2019 IEEE/ACM International Conference on Computer-Aided Design (ICCAD) · doi:10.1109/iccad45719.2019.8942149 · Cited by 241
“The primitive component estimators can range from technologydependent energy tables [1, 4, 16] to general-purpose estimation tools [2, 13, 14].”
BackgroundMethodInfluentialSelf-citationXNOR-RRAM: A scalable and parallel resistive synaptic architecture for binary neural networks
Sun, X., Yin, S., Peng, X., Liu, R., Seo, J.-S., & Yu, S. (2018) · 2018 Design, Automation & Test in Europe Conference & Exhibition (DATE) · doi:10.23919/date.2018.8342235 · Cited by 246
“In hardware accelerators of DNNs, SRAM is commonly utilized to store synaptic weights in CMOS ASIC designs [4].”
Method 3: Accelerating attention mechanisms in neural networks with approximation
Ham, T. J., Jung, S. J., Kim, S., Oh, Y. H., Park, Y., Song, Y., Park, J.-H., Lee, S., Park, K., Lee, J. W., et al. (2020) · 2020 IEEE International Symposium on High Performance Computer Architecture (HPCA) · doi:10.1109/hpca47549.2020.00035 · Cited by 242
“operations and maximize the throughput of NN processing, many prior works proposed various FPGA or ASIC based accelerators [1], [2], [3].”
BackgroundRecNMP: Accelerating Personalized Recommendation with Near-Memory Processing
Ke, L., Gupta, U., Cho, B. Y., Brooks, D., Chandra, V., Diril, U., Firoozshahian, A., Hazelwood, K., Jia, B., Lee, H.-H. S., et al. (2020) · 2020 ACM/IEEE 47th Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca45697.2020.00070 · Cited by 235
“patterns found in fully-connected (FC), convolution (CNN), and recurrent (RNN) neural networks [3], [6]–[8], [11], [12], [15], [17], [18], [24], [33], [36], [40], [47], [53]–[55], [57], [60], [68], [71]–[74], [76], [79], [82].”
MethodEvaluating the Energy Efficiency of Deep Convolutional Neural Networks on CPUs and GPUs
Li, D., Chen, X., Becchi, M., & Zong, Z. (2016) · 2016 IEEE International Conferences on Big Data and Cloud Computing (BDCloud), Social Computing and Networking (SocialCom), Sustainable Computing and Communications (SustainCom) (BDCloud-SocialCom-SustainCom) · doi:10.1109/bdcloud-socialcom-sustaincom.2016.76 · Cited by 236
Chasing Carbon: The Elusive Environmental Footprint of Computing
Gupta, U., Kim, Y. G., Lee, S., Tse, J., Lee, H.-H. S., Wei, G.-Y., Brooks, D., & Wu, C.-J. (2021) · 2021 IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca51647.2021.00076 · Cited by 221
Sanger: A Co-Design Framework for Enabling Sparse Attention using Reconfigurable Architecture
Lu, L., Jin, Y., Bi, H., Luo, Z., Li, P., Wang, T., & Liang, Y. (2021) · MICRO-54: 54th Annual IEEE/ACM International Symposium on Microarchitecture · doi:10.1145/3466752.3480125 · Cited by 223
“Architecture, modeling, optimization, and auto-generation techniques for dense DNN accelerators have been widely explored [6–8, 17, 28, 34, 35, 43, 61].”
MethodRecent advances in efficient computation of deep convolutional neural networks
Cheng, J., Wang, P.-S., Li, G., Hu, Q.-H., & Lu, H.-Q. (2018) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.1700789 · Cited by 230
“[94] used a pipelined FPGA cluster to realize acceleration, [7] presented an energy-efficient row stationary scheme to reduce data movements, and [102] attempted to reduce power consumption via low-rank approximation.”
MethodA Multi-Functional In-Memory Inference Processor Using a Standard 6T SRAM Array
Kang, M., Gonugondla, S. K., Patil, A., & Shanbhag, N. R. (2018) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2017.2782087 · Cited by 224
“Reusing data read from external memory (data reuse) [12], [13] is highly effective in saving energy as shown by DianNao [12] and Eyeriss [1], [14], but results in on-chip memory access still accounting for 35% to 45% of total energy, and does not address the energy and delay of SRAM reads.”
BackgroundMethodInfluentialA Programmable Heterogeneous Microprocessor Based on Bit-Scalable In-Memory Computing
Jia, H., Valavi, H., Tang, Y., Zhang, J., & Verma, N. (2020) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2020.2987714 · Cited by 224
Zhou, X., Du, Z., Guo, Q., Liu, S., Liu, C., Wang, C., Zhou, X., Li, L., Chen, T., & Chen, Y. (2018) · 2018 51st Annual IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2018.00011 · Cited by 214
Self-citationRecent progress in analog memory-based accelerators for deep learning
Tsai, H., Ambrogio, S., Narayanan, P., Shelby, R. M., & Burr, G. W. (2018) · Journal of Physics D: Applied Physics · doi:10.1088/1361-6463/aac8a5 · Cited by 225
Survey and Benchmarking of Machine Learning Accelerators
Reuther, A., Michaleas, P., Jones, M., Gadepally, V., Samsi, S., & Kepner, J. (2019) · 2019 IEEE High Performance Extreme Computing Conference (HPEC) · doi:10.1109/hpec.2019.8916327 · Cited by 175
“• MIT Eyeriss chip 〈Eyeriss〉 [7], [15], [16] is a research chip from Vivienne Sze’s group in MIT CSAIL.”
BackgroundCapra, M., Bussolino, B., Marchisio, A., Masera, G., Martina, M., & Shafique, M. (2020) · IEEE Access · doi:10.1109/access.2020.3039858 · Cited by 222
“Architecture Target device Compression Format Compressed Data Zero Skip Eyeriss [132] ASIC RLC A A Cnvlutin [222] ASIC CSR A A Cambricon-X [113] ASIC CIS-alike W W SCNN [223] ASIC CSC A+W A+W EIE [224] ASIC CSC W A+W NullHop [225] FPGA CIS W A+W SqueezeFlow [226] ASIC none none W ZeNA [227] ASIC none none A+W Huan et…”
BackgroundMethodExploring the Regularity of Sparse Structure in Convolutional Neural Networks
Mao, H., Han, S., Pool, J., Li, W., Liu, X., Wang, Y., & Dally, W. J. (2017) · arXiv · doi:10.48550/arxiv.1705.08922 · Cited by 219
“Though the sparse case has yet been studied, Eyeriss[20] deals with the dense case and treats 1-”
BackgroundMethodInfluentialA Survey of Stochastic Computing Neural Networks for Machine Learning Applications
Liu, Y., Liu, S., Wang, Y., Lombardi, F., & Han, J. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3009047 · Cited by 212
MAERI: Enabling Flexible Dataflow Mapping over DNN Accelerators via Reconfigurable Interconnects
Kwon, H., Samajdar, A., & Krishna, T. (2018) · ACM SIGPLAN Notices · doi:10.1145/3296957.3173176 · Cited by 217
Self-citationAmirsoleimani, A., Alibart, F., Yon, V., Xu, J., Pazhouhandeh, M. R., Ecoffey, S., Beilliard, Y., Genov, R., & Drouin, D. (2020) · Advanced Intelligent Systems · doi:10.1002/aisy.202000115 · Cited by 216
Chen, G. K., Kumar, R., Sumbul, H. E., Knag, P. C., & Krishnamurthy, R. K. (2019) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2018.2884901 · Cited by 214
Yin, S., Ouyang, P., Tang, S., Tu, F., Li, X., Zheng, S., Lu, T., Gu, J., Liu, L., & Wei, S. (2018) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2017.2778281 · Cited by 212
“By transforming fully connected (FC) layers into a unified representation of CONV layers, both the CONV and FC layers can be processed in TM-flow on the existing NN processors [13], [24].”
BackgroundMethod
Metadata
- Authors
- Chen, Y.-H., Krishna, T., Emer, J. S., & Sze, V.
- Affiliations
- Massachusetts Institute of Technology (US)
- Georgia Institute of Technology (US)
- Nvidia (United States) (US)
- Venue
- IEEE Journal of Solid-State Circuits
- Published
- 2017-01
- Volume
- 52
- Issue
- 1
- Pages
- 127-138
- ISSN
- 0018-9200 (ISSN-L)
- 1558-173X
- OpenAlex
- W2289252105
- Semantic Scholar
- ffdaa12ef011de9dbf43be46d45a3abcc8288965
- Cited by
- 3,247
- References
- 42
- Citations by year
- 2026: 218 · 2025: 313 · 2024: 294 · 2023: 373 · 2022: 365 · 2021: 450 · 2020: 427 · 2019: 354 · 2018: 302 · 2017: 118
- FWCI
- 182.12
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Journal of Solid-State Circuits (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Keywords
- reconfigurable accelerators, deep convolutional neural networks, energy efficiency, spatial architecture, data movement reduction, data compression, processing elements, AlexNet, VGG16, convolutional layers
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.