Eyeriss: An Energy-Efficient Reconfigurable Accelerator for Deep Convolutional Neural Networks
The DOI matches its Crossref record; 38 of the 42 references it cites were found in a registry or an index.
Abstract
Eyeriss is an accelerator for state-of-the-art deep convolutional neural networks (CNNs). It optimizes for the energy efficiency of the entire system, including the accelerator chip and off-chip DRAM, for various CNN shapes by reconfiguring the architecture. CNNs are widely used in modern AI systems but also bring challenges on throughput and energy efficiency to the underlying hardware. This is because its computation requires a large amount of data, creating significant data movement from on-chip and off-chip that is more energy-consuming than computation. Minimizing data movement energy cost for any CNN shape, therefore, is the key to high throughput and energy efficiency. Eyeriss achieves these goals by using a proposed processing dataflow, called row stationary (RS), on a spatial architecture with 168 processing elements. RS dataflow reconfigures the computation mapping of a given shape, which optimizes energy efficiency by maximally reusing data locally to reduce expensive data movement, such as DRAM accesses. Compression and data gating are also applied to further improve energy efficiency. Eyeriss processes the convolutional layers at 35 frames/s and 0.0029 DRAM access/multiply and accumulation (MAC) for AlexNet at 278 mW (batch size N = 4), and 0.7 frames/s and 0.0035 DRAM access/MAC for VGG-16 at 236 mW (N = 3).
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“such scaling will enable NeuRRAM to deliver higher energy and area efficiency than today’s state-of-the-art edge inference accelerators58–61.”
From A compute-in-memory chip based on resistive random-access memory (2022) · cites this paper as [58]
In the citing paper
“Some studies proposed to implement the argmax() function via hardware128–148, which could be beneficial to reduce the total transistor count and power consumption while at the same time increasing the throughput.”
From Hardware implementation of memristor-based artificial neural networks (2024) · cites this paper as [131]
In the citing paper
“Based on the analysis of the research, CoNNA is able to speed up at least 3.08 times and up to 14.1 times faster than the MIT Eyeriss Accelerator [20].”
From Embedded Intelligence on FPGA: Survey, Applications and Challenges (2021) · cites this paper as [20]
In the citing paper
“massively parallel processing architectures with distributed memory architectures, such as graphic processing units (GPUs) but also increasingly specialized chips for NN inference (e.g., [17]), have shown to be very energy efficient and capable of impressive computational throughput when fully utilized by concurrent algorithms [18].”
From An Introduction to Deep Learning for the Physical Layer (2017) · cites this paper as [17]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 1×
“Modern CNNs achieve their superior accuracy by building a very deep hierarchy of layers [2]–[5], [7], which transform the input image data into highly abstract representations called feature maps (fmaps).”
BackgroundVery Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148 · cited 7×
“We benchmark the chip performance using two publicly available and widely used CNNs: AlexNet [2] and VGG-16 [3].”
MethodInfluentialImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 1×
“[25] demonstrate a CNN processor and only report the theoretical peak throughput along with the power measured on a CNN for the MNIST data set [26], which has storage and computation requirements that are orders of magnitude lower than the state-of-the-art CNNs.”
MethodGoing deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380 · cited 2×
“We have demonstrated an 1000-class image classification task [27] using this system, and a live demo can be found in [29].”
BackgroundMethodRich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612 · cited 1×
“D EEP learning using convolutional neural networks (CNNs) [1] has achieved unprecedented accuracy on many modern AI applications [2]–[9].”
Background(2010) · International Conference on Machine Learning · Cited by 13,995
Research works printed but not linked: 2
- han, 2015, Learning both weights and connections for efficient neural network, Proc Adv Neural Inf Process Syst, 28, 1135
- chen, 2016, An 1000-Class Image Classification Task Performed by the Eyeriss-Integrated Deep Learning System
Cited by
Items 101–200 of 1,001
Hardware Implementation of Deep Network Accelerators Towards Healthcare and Biomedical Applications
Azghadi, M. R., Lammie, C., Eshraghian, J. K., Payvand, M., Donati, E., Linares-Barranco, B., & Indiveri, G. (2020) · IEEE Transactions on Biomedical Circuits and Systems · doi:10.1109/tbcas.2020.3036081 · Cited by 212
“Eyeriss [54] 12.”
BackgroundSCALE-Sim: Systolic CNN Accelerator Simulator
Samajdar, A., Zhu, Y., Whatmough, P. N., Mattina, M., & Krishna, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.02883 · Cited by 188
“As a result it is not surprising that many DNN accelerator designs [8], [9], [5] are based on systolic arrays.”
BackgroundMethodInfluentialSelf-citationMAESTRO: A Data-Centric Approach to Understand Reuse, Performance, and Hardware Cost of DNN Mappings
Kwon, H., Chatarasi, P., Sarkar, V., Krishna, T., Pellauer, M., & Parashar, A. (2020) · IEEE Micro · doi:10.1109/mm.2020.2985963 · Cited by 211
“We set the area and power constraint as 16 mm2 and 450 mW, which is the reported chip area and power of Eyeriss.6 We plot the entire design space we explored in Figure 4(c).”
BackgroundSelf-citationA method to estimate the energy consumption of deep neural networks
Yang, T.-J., Chen, Y.-H., Emer, J., & Sze, V. (2017) · 2017 51st Asilomar Conference on Signals, Systems, and Computers · doi:10.1109/acssc.2017.8335698 · Cited by 196
“We take the row-stationary dataflow [1], [2] as an example.”
BackgroundMethodSelf-citationTianjic: A Unified and Scalable Chip Bridging Spike-Based and Continuous Neural Computation
Deng, L., Wang, G., Li, G., Li, S., Liang, L., Zhu, M., Wu, Y., Yang, Z., Zou, Z., Pei, J., et al. (2020) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2020.2970709 · Cited by 201
Kim, H., Yoo, T., Kim, T. T.-H., & Kim, B. (2021) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2021.3061508 · Cited by 199
Exploring the Granularity of Sparsity in Convolutional Neural Networks
Mao, H., Han, S., Pool, J., Li, W., Liu, X., Wang, Y., & Dally, W. J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.241 · Cited by 198
“Recent custom hardware design for CNN also use 1-D convolution as the primitive operation[3].”
MethodMachine Learning With Neuromorphic Photonics
de Lima, T. F., Peng, H.-T., Tait, A. N., Nahmias, M. A., Miller, H. B., Shastri, B. J., & Prucnal, P. R. (2019) · Journal of Lightwave Technology · doi:10.1109/jlt.2019.2903474 · Cited by 200
In-memory Learning with Analog Resistive Switching Memory: A Review and Perspective
Xi, Y., Gao, B., Tang, J., Chen, A., Chang, M.-F., Hu, X. S., Spiegel, J. V. D., Qian, H., & Wu, H. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2020.3004543 · Cited by 196
“, MIT’s Eyeriss [9], [10] and a variety of other accelerators [11], [12]).”
BackgroundA Survey on Efficient Convolutional Neural Networks and Hardware Acceleration
Ghimire, D., Kil, D., & Kim, S.-H. (2022) · Electronics · doi:10.3390/electronics11060945 · Cited by 198
Guo, X., Bayat, F. M., Bavandpour, M., Klachko, M., Mahmoodi, M. R., Prezioso, M., Likharev, K. K., & Strukov, D. B. (2017) · 2017 IEEE International Electron Devices Meeting (IEDM) · doi:10.1109/iedm.2017.8268341 · Cited by 192
“AlexNet [13] single pattern classification: Digital circuits [12] Mixed-signal floating-gate circuits (estimates) GPU 28 nm ASIC 65 nm ESF1 180 nm ESF3 55 nm time (s) 1.”
BackgroundA 42pJ/decision 3.12TOPS/W robust in-memory machine learning classifier with on-chip training
Gonugondla, S. K., Kang, M., & Shanbhag, N. (2018) · 2018 IEEE International Solid - State Circuits Conference - (ISSCC) · doi:10.1109/isscc.2018.8310398 · Cited by 195
“Energy consumption of a digital architecture [1,2] to realize the 128-dimensional SVM algorithm of this work is estimated from their MAC energy, which shows a savings of greater than 7×, thereby demonstrating the suitability of this work for energyconstrained sensory applications.”
BackgroundMethodBankman, D., Yang, L., Moons, B., Verhelst, M., & Murmann, B. (2019) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2018.2869150 · Cited by 193
Capra, M., Bussolino, B., Marchisio, A., Shafique, M., Masera, G., & Martina, M. (2020) · Future Internet · doi:10.3390/fi12070113 · Cited by 195
“For instance, Eyeriss [63] is an RS accelerator.”
BackgroundDelocalized photonic deep learning on the internet’s edge
Sludds, A., Bandyopadhyay, S., Chen, Z., Zhong, Z., Cochrane, J., Bernstein, L., Bunandar, D., Dixon, P. B., Hamilton, S. A., Streshinsky, M., et al. (2022) · Science · doi:10.1126/science.abq8271 · Cited by 189
Asymptotic Soft Filter Pruning for Deep Convolutional Neural Networks
He, Y., Dong, X., Kang, G., Fu, Y., Yan, C., & Yang, Y. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2019.2933477 · Cited by 191
“[18] and Sze et al.”
Ham, T. J., Lee, Y., Seo, S. H., Kim, S., Choi, H., Jung, S. J., & Lee, J. W. (2021) · 2021 ACM/IEEE 48th Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca52012.2021.00060 · Cited by 192
1.1 Deep Learning Hardware: Past, Present, and Future
LeCun, Y. (2019) · 2019 IEEE International Solid- State Circuits Conference - (ISSCC) · doi:10.1109/isscc.2019.8662396 · Cited by 182
“accelerators, such as the Eyeriss project [23, 24] which exploits the”
ScaleDeep: A Scalable Compute Architecture for Learning and Evaluating Deep Networks
Venkataramani, S., Ranjan, A., Banerjee, S., Das, D., Avancha, S., Jagannathan, A., Durg, A., Nagaraj, D., Kaul, B., Dubey, P., et al. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080244 · Cited by 188
Sinangil, M. E., Erbagci, B., Naous, R., Akarvardar, K., Sun, D., Khwa, W.-S., Liao, H.-J., Wang, Y., & Chang, J. (2021) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2020.3031290 · Cited by 187
“Note that RBL[3] is connected to weights”
BackgroundInfluentialA Bi-layered Parallel Training Architecture for Large-Scale Convolutional Neural Networks
Chen, J., Li, K., Bilal, K., Zhou, X., Li, K., & Yu, P. S. (2019) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2018.2877359 · Cited by 185
“An energy-efficient reconfigurable accelerator was presented in [22] for deep CNN.”
MethodCompressing DMA Engine: Leveraging Activation Sparsity for Training Deep Neural Networks
Rhu, M., O'Connor, M., Chatterjee, N., Pool, J., Kwon, Y., & Keckler, S. W. (2018) · 2018 IEEE International Symposium on High Performance Computer Architecture (HPCA) · doi:10.1109/hpca.2018.00017 · Cited by 181
Prospects and applications of photonic neural networks
Huang, C., Sorger, V. J., Miscuglio, M., Al-Qadasi, M., Mukherjee, A., Lampe, L., Nichols, M., Tait, A. N., Ferreira de Lima, T., Marquez, B. A., et al. (2022) · Advances in Physics: X · doi:10.1080/23746149.2021.1981155 · Cited by 180
TANGRAM: Optimized Coarse-Grained Dataflow for Scalable NN Accelerators
Gao, M., Yang, X., Pu, J., Horowitz, M., & Kozyrakis, C. (2019) · Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3297858.3304014 · Cited by 178
Adaptive Extreme Edge Computing for Wearable Devices
Covi, E., Donati, E., Liang, X., Kappel, D., Heidari, H., Payvand, M., & Wang, W. (2021) · Frontiers in Neuroscience · doi:10.3389/fnins.2021.611300 · Cited by 177
“To solve this problem, ASIC accelerators try to reduce the complexity of the structure by making the system more application specific and using clock gating and specific hardware structure which matches best to the structure of the mapped neural network to reduce power consumption through less memory read and data acc…”
BackgroundTransfer learning for sEMG hand gestures recognition using convolutional neural networks
Cote-Allard, U., Fall, C. L., Campeau-Lecours, A., Gosselin, C., Laviolette, F., & Gosselin, B. (2017) · 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC) · doi:10.1109/smc.2017.8122854 · Cited by 175
“Eyeriss [4], YodaNN [5], Origami [6], Bang et al.”
BackgroundZhang, J. J., Gu, T., Basu, K., & Garg, S. (2018) · 2018 IEEE 36th VLSI Test Symposium (VTS) · doi:10.1109/vts.2018.8368656 · Cited by 173
DeepRecSys: A System for Optimizing End-To-End At-Scale Neural Recommendation Inference
Gupta, U., Hsia, S., Saraph, V., Wang, X., Reagen, B., Wei, G.-Y., Lee, H.-H. S., Brooks, D., & Wu, C.-J. (2020) · 2020 ACM/IEEE 47th Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca45697.2020.00084 · Cited by 173
“Building upon the performance bottlenecks, a variety of software and hardware solutions have been proposed to optimize traditional DNNs [13]–[15], [17], [48]–[68].”
BackgroundHardware Implementation of Deep Network Accelerators Towards Healthcare and Biomedical Applications
Azghadi, M. R., Lammie, C., Eshraghian, J. K., Payvand, M., Donati, E., Linares-Barranco, B., & Indiveri, G. (2020) · ResearchOnline - JCU (James Cook University) · doi:10.3929/ethz-b-000465927 · Cited by 176
Survey of Machine Learning Accelerators
Reuther, A., Michaleas, P., Jones, M., Gadepally, V., Samsi, S., & Kepner, J. (2020) · 2020 IEEE High Performance Extreme Computing Conference (HPEC) · doi:10.1109/hpec43674.2020.9286149 · Cited by 163
“• MIT Eyeriss chip 〈Eyeriss〉 [12], [37], [38] is a research chip from Vivienne Sze’s group in MIT CSAIL.”
BackgroundYin, S., Sun, X., Yu, S., & Seo, J.-S. (2020) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2020.3015178 · Cited by 171
“An RRAM macro with multi-level sense amplifiers in 55nm CMOS logic process was recently reported 30 , but a relatively low accuracy of 81.83% accuracy for CIFAR-10 dataset was achieved with binary/ternary precision, and only 9 WLs are asserted simultaneously in the 256×512 sub-array, which limits further parallelism.”
BackgroundMethodInfluentialFathom: reference workloads for modern deep learning methods
Adolf, R., Rama, S., Reagen, B., Wei, G.-Y., & Brooks, D. (2016) · 2016 IEEE International Symposium on Workload Characterization (IISWC) · doi:10.1109/iiswc.2016.7581275 · Cited by 169
“The architecture community has begun to respond in force: A host of new hardware designs have been proposed [10], [12], [24], [39], and several are beginning to transition into production [30], [38].”
BackgroundSun, X., & Yu, S. (2019) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2019.2933148 · Cited by 170
“To overcome these challenges, several CMOS ASIC on-chip solutions (e.g., MIT’s Eyeriss [1], KAIST’s UNPU [2]) have been developed to Manuscript received April 26, 2019; revised June 26, 2019; accepted July 29, 2019.”
BackgroundAHAR: Adaptive CNN for Energy-Efficient Human Activity Recognition in Low-Power Edge Devices
Rashid, N., Demirel, B. U., & Abdullah Al Faruque, M. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3140465 · Cited by 169
15.1 A Programmable Neural-Network Inference Accelerator Based on Scalable In-Memory Computing
Jia, H., Ozatay, M., Tang, Y., Valavi, H., Pathak, R., Lee, J., & Verma, N. (2021) · 2021 IEEE International Solid- State Circuits Conference (ISSCC) · doi:10.1109/isscc42613.2021.9365788 · Cited by 168
Bringing ai to edge: from deep learning’s perspective
Liu, D., Kong, H., Luo, X., Liu, W., & Subramaniam, R. (2022) · Neurocomputing · doi:10.1016/j.neucom.2021.04.141 · Cited by 171
High-Performance Mixed-Signal Neurocomputing With Nanoscale Floating-Gate Memory Cell Arrays
Merrikh-Bayat, F., Guo, X., Klachko, M., Prezioso, M., Likharev, K. K., & Strukov, D. B. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2778940 · Cited by 167
Accuracy-Guaranteed Collaborative DNN Inference in Industrial IoT via Deep Reinforcement Learning
Wu, W., Yang, P., Zhang, W., Zhou, C., & Shen, X. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.3017573 · Cited by 165
Review of Lightweight Deep Convolutional Neural Networks
Chen, F., Li, S., Han, J., Ren, F., & Yang, Z. (2024) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-023-10032-z · Cited by 164
“– General learning libraries [167] can be used for CNNs training and inference, such as in Caffe [163], MXNet [164], Tensorflow [156], TensorRT [166], PyTorch [157], etc., as shown in [83] and Eyeriss [173, 174].”
Deep Neural Network Approximation for Custom Hardware: Where We've Been, Where We're Going
Wang, E., Davis, J. J., Zhao, R., Ng, H.-C., Niu, X., Luk, W., Cheung, P. Y. K., & Constantinides, G. A. (2020) · ACM Computing Surveys · doi:10.1145/3309551 · Cited by 166
“Eyeriss, EIE and Laconic’s authors achieved benefits from pruning using similar strategies to those employed by Cnvlutin’s.”
BackgroundMethodInfluentialMapping Spiking Neural Networks to Neuromorphic Hardware
Balaji, A., Catthoor, F., Das, A., Wu, Y., Huynh, K., Dell'Anna, F. G., Indiveri, G., Krichmar, J. L., Dutt, N. D., & Schaafsma, S. (2020) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2019.2951493 · Cited by 159
High-Performance FPGA-Based CNN Accelerator With Block-Floating-Point Arithmetic
Lian, X., Liu, Z., Song, Z., Dai, J., Zhou, W., & Ji, X. (2019) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2019.2913958 · Cited by 162
Si, X., Chang, M.-F., Khwa, W.-S., Chen, J.-J., Li, J.-F., Sun, X., Liu, R., Yu, S., Yamauchi, H., & Li, Q. (2019) · IEEE Transactions on Circuits and Systems I: Regular Papers · doi:10.1109/tcsi.2019.2928043 · Cited by 160
Ando, K., Ueyoshi, K., Orimo, K., Yonekawa, H., Sato, S., Nakahara, H., Takamaeda-Yamazaki, S., Ikebe, M., Asai, T., Kuroda, T., et al. (2018) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2017.2778702 · Cited by 160
“The comparison of recent state-of-the-art CNN accelerators [5], [8], [9] with this paper (see Table II) is not”
BackgroundVerhelst, M., & Moons, B. (2017) · IEEE Solid-State Circuits Magazine · doi:10.1109/mssc.2017.2745818 · Cited by 158
“These functional units are each equipped with a very small SRAM (as in [14]) or even just registers (as in [9]) to store data locally and maximize data reuse within the array.”
BackgroundMethodBankman, D., Yang, L., Moons, B., Verhelst, M., & Murmann, B. (2018) · 2018 IEEE International Solid - State Circuits Conference - (ISSCC) · doi:10.1109/isscc.2018.8310264 · Cited by 157
“Larger CNN chips provide dataflow computing for high-complexity tasks (AlexNet) at mJ energy [2], but edge deployment remains a challenge due to off-chip DRAM access energy.”
BackgroundDevice and materials requirements for neuromorphic computing
Islam, R., Li, H., Chen, P.-Y., Wan, W., Chen, H.-Y., Gao, B., Wu, H., Yu, S., Saraswat, K., & Philip Wong, H.-S. (2019) · Journal of Physics D: Applied Physics · doi:10.1088/1361-6463/aaf784 · Cited by 158
“Most recently, Eyeriss combined these two strategies to further improve the data reuse, by efficiently compiling and mapping DNN parameters from DRAM into scratchpad SRAMs and local registers [7].”
BackgroundSi, X., Tu, Y.-N., Huang, W.-H., Su, J.-W., Lu, P.-J., Wang, J., Liu, T.-W., Wu, S.-Y., Liu, R., Chou, Y.-C., et al. (2021) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2021.3073254 · Cited by 161
Zhu, M., Zhang, T., Gu, Z., & Xie, Y. (2019) · Proceedings of the 52nd Annual IEEE/ACM International Symposium on Microarchitecture · doi:10.1145/3352460.3358269 · Cited by 153
Wang, H., Liu, R., Dorrance, R., Dasalukunte, D., Lake, D., & Carlton, B. R. (2023) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2022.3232601 · Cited by 171
Minimum energy quantized neural networks
Moons, B., Goetschalckx, K., Berckelaer, N. V., & Verhelst, M. (2017) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/acssc.2017.8335699 · Cited by 184
Yang, T.-H., Cheng, H.-Y., Yang, C.-L., Tseng, I.-C., Hu, H.-W., Chang, H.-S., & Li, H.-P. (2019) · Proceedings of the 46th International Symposium on Computer Architecture · doi:10.1145/3307650.3322271 · Cited by 153
“One primary concern is how to efficiently exploit sparsity, which is commonly done in digital CMOS-based accelerators to improve energy efficiency [1, 8, 16, 36, 49].”
BackgroundA Survey on Coarse-Grained Reconfigurable Architectures From a Performance Perspective
Podobas, A., Sano, K., & Matsuoka, S. (2020) · IEEE Access · doi:10.1109/access.2020.3012084 · Cited by 172
Benchmarking and Analyzing Deep Neural Network Training
Zhu, H., Akrout, M., Zheng, B., Pelegris, A., Jayarajan, A., Phanishayee, A., Schroeder, B., & Pekhimenko, G. G. (2018) · IEEE International Symposium on Workload Characterization · doi:10.1109/iiswc.2018.8573476 · Cited by 238
PREMA: A Predictive Multi-Task Scheduling Algorithm For Preemptible Neural Processing Units
Choi, Y., & Rhu, M. (2020) · 2020 IEEE International Symposium on High Performance Computer Architecture (HPCA) · doi:10.1109/hpca47549.2020.00027 · Cited by 142
“A common design practice in NPUs [2], [3], [22], [23], [29] is to utilize this deterministic dataflow to leverage tasklevel parallelism to overlap the compute phase and memory phase for maximum efficiency.”
BackgroundMethodInfluentialZigZag: Enlarging Joint Architecture-Mapping Design Space Exploration for DNN Accelerators
Mei, L., Houshmand, P., Jain, V., Giraldo, J. S. P., & Verhelst, M. (2021) · IEEE Transactions on Computers · doi:10.1109/tc.2021.3059962 · Cited by 248
A computing-in-memory macro based on three-dimensional resistive random-access memory
Huo, Q., Yang, Y., Wang, Y., Lei, D., Fu, X., Ren, Q., Xu, X., Luo, Q., Xing, G., Chen, C., et al. (2022) · Nature Electronics · doi:10.1038/s41928-022-00795-x · Cited by 159
“Artificial intelligence (AI) edge devices 7–9 based on the von Neumann architecture limit performance and energy efficiency due to the large amount of data transfer between processing and memory units.”
BackgroundRen, A., Zhang, T., Ye, S., Li, J., Xu, W., Qian, X., Lin, X., & Wang, Y. (2019) · Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3297858.3304076 · Cited by 150
“, 200× compared to on-chip SRAM [8, 21], and can thus easily dominate the whole system power consumption.”
BackgroundKo, J. H., Na, T., Amir, M. F., & Mukhopadhyay, S. (2018) · 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2018.8639121 · Cited by 153
Kung, H. T., McDanel, B., & Zhang, S. Q. (2019) · Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3297858.3304028 · Cited by 146
“These systems, such as the Google TPU [27], the ShiDianNao accelerators [17], and numerous other efforts, including [40], [10], [61], [68], [63], have achieved low power consumption and high throughput.”
BackgroundEfficient Hardware Architectures for Deep Convolutional Neural Network
Wang, J., Lin, J. T., & Wang, Z. (2017) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2017.2767204 · Cited by 166
A Survey of On-Device Machine Learning: An Algorithms and Learning Theory Perspective
Dhar, S., Guo, J., Liu, J., Tripathi, S., Kurup, U., & Shah, M. (2021) · ACM Transactions on Internet of Things · doi:10.1145/3450494 · Cited by 276
“This would result in a significant throughput bottleneck and cause orders of magnitude higher energy consumption [23].”
BackgroundInfluentialHeterogeneous Dataflow Accelerators for Multi-DNN Workloads
Kwon, H., Lai, L., Pellauer, M., Krishna, T., Chen, Y.-H., & Chandra, V. (2021) · 2021 IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca51647.2021.00016 · Cited by 144
Self-citationEnable Deep Learning on Mobile Devices: Methods, Systems, and Applications
Cai, H., Lin, J., Lin, Y., Liu, Z., Tang, H., Wang, H., Zhu, L., & Han, S. (2022) · ACM Transactions on Design Automation of Electronic Systems · doi:10.1145/3486618 · Cited by 195
IONN: Incremental Offloading of Neural Network Computations from Mobile Devices to Edge Servers
Jeong, H.-J., Lee, H.-J., Shin, C. H., & Moon, S.-M. (2018) · Proceedings of the ACM Symposium on Cloud Computing · doi:10.1145/3267809.3267828 · Cited by 143
“Some mobile devices may handle DNN computations with specialized hardware (e.g., GPU, ASIC) [25] [4], but this is not a general option for today’s low-powered, compact mobile devices (e.g., wearables or IoT devices).”
BackgroundA convolutional neural network for robotic arm guidance using sEMG based frequency-features
Cote Allard, U., Nougarou, F., Fall, C. L., Giguere, P., Gosselin, C., Laviolette, F., & Gosselin, B. (2016) · 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7759384 · Cited by 135
“Additionally, dedicated deep learning materials such as Eyeriss [16] are able to run CNNs with up to 60 millions parameters at 35 fps using only 278 mW.”
MethodChakraborty, I., Ali, M., Ankit, A., Jain, S., Roy, S., Sridharan, S., Agrawal, A., Raghunathan, A., & Roy, K. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2020.3003007 · Cited by 140
“[9] Y.”
A Survey on Deep Learning Hardware Accelerators for Heterogeneous HPC Platforms
Silvano, C., Ielmini, D., Ferrandi, F., Fiorin, L., Curzel, S., Benini, L., Conti, F., Garofalo, A., Zambelli, C., Calore, E., et al. (2025) · ACM Computing Surveys · doi:10.1145/3729215 · Cited by 262
“In particular, NPUs are designed to accommodate a reasonable amount of multiply/accumulate (MAC) units, which are the PEs devised in the convolutional and fully-connected layers of DNNs [29, 46].”
Resistive Memory-Based Analog Synapse: The Pursuit for Linear and Symmetric Weight Update
Woo, J., & Yu, S. (2018) · IEEE Nanotechnology Magazine · doi:10.1109/mnano.2018.2844902 · Cited by 137
“, eyeriss [2] and envision [3]) have been previously proposed to parallelize the computations on-chip; however, limitations still exist on memory footprint, in-memory computing, on-/off-chip communication, and online learning capabilities.”
BackgroundEfficient Hardware Architectures for Accelerating Deep Neural Networks: Survey
Pudi, D., Boppu, S., Manikandan, M. S., & Cenkeramaddi, L. R. (2022) · IEEE Access · doi:10.1109/access.2022.3229767 · Cited by 180
“Eyeriss DNN accelerator, adopted from [56].”
BackgroundMethodInfluentialSCNN: An Accelerator for Compressed-sparse Convolutional Neural NetworksPreprint
Parashar, A., Rhu, M., Mukkara, A., Puglielli, A., Venkatesan, R., Khailany, B., Emer, J., Keckler, S. W., & Dally, W. J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.04485 · Cited by 136
“Eyeriss [8] gates the multiplier when it sees an input activation of zero.”
BackgroundMethodSelf-citationChen, Z., Yu, Z., Jin, Q., He, Y., Wang, J., Lin, S., Li, D., Wang, Y., & Yang, K. (2021) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2021.3056447 · Cited by 148
Bong, K., Choi, S., Kim, C., Kang, S., Kim, Y., & Yoo, H. (2017) · Digest of technical papers/Digest of technical papers - IEEE International Solid-State Circuits Conference · doi:10.1109/isscc.2017.7870354 · Cited by 150
“However, previous CNN processors (CNNP) [2-3] consume too much power, resulting in 10 hours operation time with a 190mAh coin battery.”
BackgroundInfluentialALWANN: Automatic Layer-Wise Approximation of Deep Neural Network Accelerators without Retraining
Mrazek, V., Vasicek, Z., Sekanina, L., Hanif, M. A., & Shafique, M. (2019) · 2019 IEEE/ACM International Conference on Computer-Aided Design (ICCAD) · doi:10.1109/iccad45719.2019.8942068 · Cited by 128
The N3XT Approach to Energy-Efficient Abundant-Data Computing
Aly, M. M. S., Wu, T. F., Bartolo, A., Malviya, Y. H., Hwang, W., Hills, G., Markov, I. L., Wootters, M. K., Shulaker, M. M., Wong, H. ‐. P., et al. (2018) · Proceedings of the IEEE · doi:10.1109/jproc.2018.2882603 · Cited by 154
“Other components, such as the clock tree, are scaled from published 65-nm data [28].”
BackgroundMethodEdge Intelligence: Architectures, Challenges, and Applications
Xu, D., Li, T., Li, Y., Su, X., Tarkoma, S., Jiang, T., Crowcroft, J., & Hui, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.12172 · Cited by 120
Chang, J.-W., Kang, K.-W., & Kang, S. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2888898 · Cited by 136
Magnetic Domain Wall Based Synaptic and Activation Function Generator for Neuromorphic Accelerators
Siddiqui, S. A., Dutta, S., Tang, A. S., Liu, L., Ross, C. A., & Baldo, M. A. (2019) · Nano Letters · doi:10.1021/acs.nanolett.9b04200 · Cited by 144
Algorithm-Based Fault Tolerance for Convolutional Neural Networks
Zhao, K., Di, S., Li, S., Liang, X., Zhai, Y., Chen, J., Ouyang, K., Cappello, F., & Chen, Z. (2021) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2020.3043449 · Cited by 119
“We focus on the convolutional layers in CNN because they consume the major portion of the computation time [2, 7].”
SpinalFlow: An Architecture and Dataflow Tailored for Spiking Neural Networks
Narayanan, S., Taht, K., Balasubramonian, R., Giacomin, E., & Gaillardon, P. (2020) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1109/isca45697.2020.00038 · Cited by 154
“A number of ANN accelerator designs have been proposed in recent years [30], [53], [9], [6], [54].”
BackgroundA Variation-Tolerant In-Memory Machine Learning Classifier via On-Chip Training
Gonugondla, S. K., Kang, M., & Shanbhag, N. R. (2018) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2018.2867275 · Cited by 123
Zimmer, B., Venkatesan, R., Shao, Y. S., Clemons, J., Fojtik, M., Jiang, N., Keller, B., Klinefelter, A., Pinckney, N., Raina, P., et al. (2020) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2019.2960488 · Cited by 122
Self-citationFormat abstraction for sparse tensor algebra compilers
Chou, S., Kjølstad, F., & Amarasinghe, S. P. (2018) · Proceedings of the ACM on Programming Languages · doi:10.1145/3276493 · Cited by 146
“…our technique to support even more disparate tensor formats, including DOK and LIL as well as custom formats designed to take advantage of power-law structures in social graphs for graph analytics or specialized hardware accelerator capabilities for deep learning architectures [Chen et al. 2017].”
BackgroundMethodMultiple classifiers fusion and CNN feature extraction for handwritten digits recognition
Zhao, H., & Liu, H. (2019) · Granular Computing · doi:10.1007/s41066-019-00158-6 · Cited by 132
Xcel-RAM: Accelerating Binary Neural Networks in High-Throughput SRAM Compute Arrays
Agrawal, A., Jaiswal, A., Roy, D., Han, B., Srinivasan, G., Ankit, A., & Roy, K. (2019) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2019.2907488 · Cited by 132
“Hardware architectures that use highly sub-banked memory units feeding an array of multiply-accumulate processing elements have been presented in many works including [18], [19].”
BackgroundReconfigurable Neuromorphic Computing: Materials, Devices, and Integration
Xu, M., Chen, X., Guo, Y., Wang, Y., Qiu, D., Du, X., Cui, Y. L., Wang, X., & Xiong, J. (2023) · Advanced Materials · doi:10.1002/adma.202301063 · Cited by 130
Lu, Z., Cheng, R., Jin, Y., Tan, K. C., & Deb, K. (2023) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2022.3233364 · Cited by 147
Multichannel meta-imagers for accelerating machine vision
Zheng, H., Liu, Q., Kravchenko, I. I., Zhang, X., Huo, Y., & Valentine, J. G. (2024) · Nature Nanotechnology · doi:10.1038/s41565-023-01557-2 · Cited by 114
“A free-space optical computational, based on Fourier optics 17–20 , actually predates modern digital circuitry and allows for the highly parallel execution of convolution operations, which comprise a majority of floating-point operations in machine vision architectures 21,22 .”
InfluentialA Low-Power Speech Recognizer and Voice Activity Detector Using Deep Neural Networks
Price, M., Glass, J. R., & Chandrakasan, A. P. (2017) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2017.2752838 · Cited by 120
“mentations, primarily for computer vision [16].”
Nanoscale resistive switching devices for memory and computing applications
Lee, S. H., Zhu, X., & Lu, W. D. (2020) · Nano Research · doi:10.1007/s12274-020-2616-0 · Cited by 125
Characterizing the deployment of deep neural networks on commercial edge devices
Hadidi, R., Cao, J., Xie, Y., Asgari, B., Krishna, T., & Kim, H. (2019) · 2019 IEEE International Symposium on Workload Characterization (IISWC) · doi:10.1109/iiswc47752.2019.9041955 · Cited by 118
Self-citationNeural Architecture Search for Transformers: A Survey
Chitty-Venkata, K. T., Emani, M., Vishwanath, V., & Somani, A. K. (2022) · IEEE Access · doi:10.1109/access.2022.3212767 · Cited by 118
Scalable and Programmable Neural Network Inference Accelerator Based on In-Memory Computing
Jia, H., Ozatay, M., Tang, Y., Valavi, H., Pathak, R., Lee, J., & Verma, N. (2021) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2021.3119018 · Cited by 135
Artificial intelligence to diagnose meniscus tears on MRI
Roblot, V., Giret, Y., Bou Antoun, M., Morillot, C., Chassin, X., Cotten, A., Zerbib, J., & Fournier, L. (2019) · Diagnostic and Interventional Imaging · doi:10.1016/j.diii.2019.02.007 · Cited by 115
ConfuciuX: Autonomous Hardware Resource Assignment for DNN Accelerators using Reinforcement Learning
Kao, S.-C., Jeong, G., & Krishna, T. (2020) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro50266.2020.00058 · Cited by 150
“), Eyeriss-style [16] (-eye) (parallelizing Y and R dim.”
BackgroundMethodInfluentialSelf-citationReconfiguring the Imaging Pipeline for Computer Vision
Buckler, M., Jayasuriya, S., & Sampson, A. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.111 · Cited by 143
“Energy-efficient Deep Learning: Recent research has focused on dedicated ASICs for deep learning [9, 15, 21, 30, 35, 43] to reduce the cost of forward inference compared to a GPU or CPU.”
BackgroundChasing Carbon: The Elusive Environmental Footprint of Computing
Gupta, U., Kim, Y. G., Lee, S., Tse, J., Lee, H.-H. S., Wei, G.-Y., Brooks, D. M., & Wu, C.-J. (2022) · IEEE Micro · doi:10.1109/mm.2022.3163226 · Cited by 250
Ristretto: Hardware-Oriented Approximation of Convolutional Neural Networks
Gysel, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.06402 · Cited by 97
“As a case in point, we consider the mobile GPU implementation of AlexNet by Chen et al. (2016). When comparing the two GPU implementations, the mobile GPU’s throughput per power is only slightly better than that of the high-end GPU (15.”
BackgroundMethodInfluentialWang, Y., Zhang, C., Xie, Z., Guo, C., Liu, Y., & Leng, J. (2021) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1109/isca52012.2021.00088 · Cited by 144
Orbital Edge Computing: Machine Inference in Space
Denby, B., & Lucia, B. (2019) · IEEE Computer Architecture Letters · doi:10.1109/lca.2019.2907539 · Cited by 112
Metadata
- Authors
- Chen, Y.-H., Krishna, T., Emer, J. S., & Sze, V.
- Affiliations
- Massachusetts Institute of Technology (US)
- Georgia Institute of Technology (US)
- Nvidia (United States) (US)
- Venue
- IEEE Journal of Solid-State Circuits
- Published
- 2017-01
- Volume
- 52
- Issue
- 1
- Pages
- 127-138
- ISSN
- 0018-9200 (ISSN-L)
- 1558-173X
- OpenAlex
- W2289252105
- Semantic Scholar
- ffdaa12ef011de9dbf43be46d45a3abcc8288965
- Cited by
- 3,247
- References
- 42
- Citations by year
- 2026: 218 · 2025: 313 · 2024: 294 · 2023: 373 · 2022: 365 · 2021: 450 · 2020: 427 · 2019: 354 · 2018: 302 · 2017: 118
- FWCI
- 182.12
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Journal of Solid-State Circuits (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Keywords
- reconfigurable accelerators, deep convolutional neural networks, energy efficiency, spatial architecture, data movement reduction, data compression, processing elements, AlexNet, VGG16, convolutional layers
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.