A dynamically configurable coprocessor for convolutional neural networks
The DOI matches its Crossref record; 34 of the 36 references it cites were found in a registry or an index.
Abstract
Convolutional neural networks (CNN) applications range from recognition and reasoning (such as handwriting recognition, facial expression recognition and video surveillance) to intelligent text applications such as semantic text analysis and natural language processing applications. Two key observations drive the design of a new architecture for CNN. First, CNN workloads exhibit a widely varying mix of three types of parallelism: parallelism within a convolution operation, intra-output parallelism where multiple input sources (features) are combined to create a single output, and inter-output parallelism where multiple, independent outputs (features) are computed simultaneously. Workloads differ significantly across different CNN applications, and across different layers of a CNN. Second, the number of processing elements in an architecture continues to scale (as per Moore's law) much faster than off-chip memory bandwidth (or pin-count) of chips. Based on these two observations, we show that for a given number of processing elements and off-chip memory bandwidth, a new CNN hardware architecture that dynamically configures the hardware on-the-fly to match the specific mix of parallelism in a given workload gives the best throughput performance. Our CNN compiler automatically translates high abstraction network specification into a parallel microprogram (a sequence of low-level VLIW instructions) that is mapped, scheduled and executed by the coprocessor. Compared to a 2.3 GHz quad-core, dual socket Intel Xeon, 1.35 GHz C870 GPU, and a 200 MHz FPGA implementation, our 120 MHz dynamically configurable architecture is 4x to 8x faster. This is the first CNN architecture to achieve real-time video stream processing (25 to 30 frames per second) on a wide range of object detection and recognition tasks.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Another option is to use field programable gate arrays (FPGAs), which consume much less energy than GPUs while providing an intermediate computing efficiency between CPUs and GPUs13–17.”
From Hardware implementation of memristor-based artificial neural networks (2024) · cites this paper as [16]
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Neural Networks And Learning Machines
Haykin, S. (2010) · Cited by 7,534
A unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058 · cited 1×
“Feed-forward, multi-layer artificial neural networks like the Convolutional Neural Networks (CNN) [2][11][13][16][17][20][23] have found increasing use in several new applications because they have the potential to process vast amounts of labeled data to automatically learn and extract complex…”
BackgroundFace recognition: a convolutional neural-network approach
Lawrence, S., Giles, C. L., Tsoi, A. C., & Back, A. D. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.554195 · Cited by 3,092
Lee, H., Grosse, R., Ranganath, R., & Ng, A. Y. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553453 · Cited by 2,412
Object Recognition with Features Inspired by Visual Cortex
Serre, T., Wolf, L., & Poggio, T. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.254 · Cited by 821
Large-scale deep unsupervised learning using graphics processors
Raina, R., Madhavan, A., & Ng, A. Y. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553486 · Cited by 742 · cited 2×
“…to match the exact computational workload of any layer of a CNN. Note that by replacing the convolver primitive with a different functional unit, we can easily implement different feed-forward neural networks and classifiers such as HMAX [17][27], Deep Belief Networks [29][30] and HoG methods [28].”
MethodMulticlass Object Recognition with Sparse, Localized Features
Mutch, J., & Lowe, D. G. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.200 · Cited by 453
Fast support vector machine training and classification on graphics processors
Catanzaro, B., Sundaram, N., & Keutzer, K. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390170 · Cited by 372
Cited by
Efficient Processing of Deep Neural Networks: A Tutorial and Survey
Sze, V., Chen, Y.-H., Yang, T.-J., & Emer, J. S. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2761740 · Cited by 4,215
“Other weight stationary examples are found in [84]–[86], [88], [89].”
BackgroundEyeriss: An Energy-Efficient Reconfigurable Accelerator for Deep Convolutional Neural Networks
Chen, Y.-H., Krishna, T., Emer, J. S., & Sze, V. (2017) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2016.2616357 · Cited by 3,247
Optimizing FPGA-based Accelerator Design for Deep Convolutional Neural Networks
Zhang, C., Li, P., Sun, G., Guan, Y., Xiao, B., & Cong, J. (2015) · Proceedings of the 2015 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays · doi:10.1145/2684746.2689060 · Cited by 2,158
“Among these approaches, FPGA based accelerators have attracted more and more attention of researchers because they have advantages of good performance, high energy efficiency, fast development round, and capability of reconfiguration [1] [2] [3] [6] [12] [14].”
BackgroundMethodInfluentialDianNao: a small-footprint high-throughput accelerator for ubiquitous machine-learning
Chen, T., Du, Z., Sun, N., Wang, J., Wu, C., Chen, Y., & Temam, O. (2014) · Proceedings of the 19th international conference on Architectural support for programming languages and operating systems · doi:10.1145/2541940.2541967 · Cited by 1,297
Going Deeper with Embedded FPGA Platform for Convolutional Neural Network
Qiu, J., Wang, J., Yao, S., Guo, K., Li, B., Zhou, E., Yu, J., Tang, T., Xu, N., Song, S., et al. (2016) · Proceedings of the 2016 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays · doi:10.1145/2847263.2847265 · Cited by 1,252
In-Datacenter Performance Analysis of a Tensor Processing Unit
Jouppi, N. P., Young, C., Patil, N., Patterson, D., Agrawal, G., Bajwa, R., Bates, S., Bhatia, S., Boden, N., Borchers, A., et al. (2017) · ACM SIGARCH Computer Architecture News · doi:10.1145/3140659.3080246 · Cited by 1,240
Eyeriss: a spatial architecture for energy-efficient dataflow for convolutional neural networks
Chen, Y.-H., Emer, J., & Sze, V. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001177 · Cited by 1,182
“Many previous papers have proposed specialized CNN dataflows on various platforms, including GPU [14], FPGA [15] [16] [17] [18] [19] [20] [21], and ASIC [22] [23] [24] [25] [26].”
BackgroundA Survey of Neuromorphic Computing and Neural Networks in Hardware
Schuman, C. D., Potok, T. E., Patton, R. M., Birdwell, J. D., Dean, M. E., Rose, G. S., & Plank, J. S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.06963 · Cited by 352
ShiDianNao: shifting vision processing closer to the sensor
Du, Z., Fasthuber, R., Chen, T., Ienne, P., Li, L., Luo, T., Feng, X., Chen, Y., & Temam, O. (2015) · Proceedings of the 42nd Annual International Symposium on Computer Architecture · doi:10.1145/2749469.2750389 · Cited by 933
Cambricon-X: An accelerator for sparse neural networks
Zhang, S., Du, Z., Zhang, L., Lan, H., Liu, S., Li, L., Guo, Q., Chen, T., & Chen, Y. (2016) · 2016 49th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2016.7783723 · Cited by 603
Eyeriss: A Spatial Architecture for Energy-Efficient Dataflow for Convolutional Neural Networks
Chen, Y.-H., Emer, J., & Sze, V. (2016) · 2016 ACM/IEEE 43rd Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca.2016.40 · Cited by 534
Alwani, M., Chen, H., Ferdman, M., & Milder, P. (2016) · 2016 49th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2016.7783725 · Cited by 662
“and adapting hardware accelerators for CNNs [7] such as GPUs [3], FPGAs [13], [19], [10], [1], and ASICs [2].”
MethodProject Adam: building an efficient and scalable deep learning training system
Chilimbi, T. M., Suzue, Y., Apacible, J., & Kalyanaraman, K. (2014) · Operating Systems Design and Implementation · doi:10.5555/2685048.2685094 · Cited by 550
Understanding error propagation in deep learning neural network (DNN) accelerators and applications
Li, G., Hari, S. K. S., Sullivan, M., Tsai, T., Pattabiraman, K., Emer, J., & Keckler, S. W. (2017) · Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis · doi:10.1145/3126908.3126964 · Cited by 492
Angel-Eye: A Complete Design Flow for Mapping CNN Onto Embedded FPGA
Guo, K., Sui, L., Qiu, J., Yu, J., Wang, J., Yao, S., Han, S., Wang, Y., & Yang, H. (2018) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2017.2705069 · Cited by 562
Hardware implementation of memristor-based artificial neural networks
Aguirre, F., Sebastian, A., Le Gallo, M., Song, W., Wang, T., Yang, J. J., Lu, W., Chang, M.-F., Ielmini, D., Yang, Y., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-45670-9 · Cited by 564
A Configurable Cloud-Scale DNN Processor for Real-Time AI
Fowers, J., Ovtcharov, K., Papamichael, M., Massengill, T., Liu, M., Lo, D., Alkalay, S., Haselman, M., Adams, L., Ghandi, M., et al. (2018) · 2018 ACM/IEEE 45th Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca.2018.00012 · Cited by 520
Throughput-Optimized OpenCL-based FPGA Accelerator for Large-Scale Convolutional Neural Networks
Suda, N., Chandra, V., Dasika, G., Mohanty, A., Ma, Y., Vrudhula, S., Seo, J.-S., & Cao, Y. (2016) · Proceedings of the 2016 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays · doi:10.1145/2847263.2847276 · Cited by 553
FPGA-Based Accelerators of Deep Learning Networks for Learning and Classification: A Review
Shawahna, A., Sait, S. M., & El-Maleh, A. (2019) · IEEE Access · doi:10.1109/access.2018.2890150 · Cited by 496
Edge Machine Learning for AI-Enabled IoT Devices: A Review
Merenda, M., Porcaro, C., & Iero, D. (2020) · Sensors · doi:10.3390/s20092533 · Cited by 523
Scaling for edge inference of deep neural networks
Xu, X., Ding, Y., Hu, S. X., Niemier, M., Cong, J., Hu, Y., & Shi, Y. (2018) · Nature Electronics · doi:10.1038/s41928-018-0059-3 · Cited by 462
Recent advances in convolutional neural network acceleration
Zhang, Q., Zhang, M., Chen, T., Sun, Z., Ma, Y., & Yu, B. (2019) · Neurocomputing · doi:10.1016/j.neucom.2018.09.038 · Cited by 434
Automated Systolic Array Architecture Synthesis for High Throughput CNN Inference on FPGAs
Wei, X., Yu, C. H., Zhang, P., Chen, Y., Wang, Y., Hu, H., Liang, Y., & Cong, J. (2017) · Proceedings of the 54th Annual Design Automation Conference 2017 · doi:10.1145/3061639.3062207 · Cited by 426
PUMA: A Programmable Ultra-efficient Memristor-based Accelerator for Machine Learning Inference
Ankit, A., Hajj, I. E., Chalamalasetti, S. R., Ndu, G., Foltin, M., Williams, R. S., Faraboschi, P., Hwu, W.-M. W., Strachan, J. P., Roy, K., et al. (2019) · Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3297858.3304049 · Cited by 424
Computer vision algorithms and hardware implementations: A survey
Feng, X., Jiang, Y., Yang, X., Du, M., & Li, X. (2019) · Integration · doi:10.1016/j.vlsi.2019.07.005 · Cited by 349
Minimizing Computation in Convolutional Neural Networks
Cong, J., & Xiao, B. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-11179-7_36 · Cited by 372
NeuFlow: A runtime reconfigurable dataflow processor for vision
Farabet, C., Martini, B., Corda, B., Akselrod, P., Culurciello, E., & LeCun, Y. (2011) · CVPR 2011 WORKSHOPS · doi:10.1109/cvprw.2011.5981829 · Cited by 369
HarDNet: A Low Memory Traffic Network
Chao, P., Kao, C.-Y., Ruan, Y., Huang, C.-H., & Lin, Y.-L. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00365 · Cited by 324
From high-level deep neural models to FPGAs
Sharma, H., Park, J., Mahajan, D., Amaro, E., Kim, J. K., Shao, C., Mishra, A., & Esmaeilzadeh, H. (2016) · 2016 49th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2016.7783720 · Cited by 365
DianNao: a small-footprint high-throughput accelerator for ubiquitous machine-learning
Chen, T., Du, Z., Sun, N., Wang, J., Wu, C., Chen, Y., & Temam, O. (2014) · ACM SIGARCH Computer Architecture News · doi:10.1145/2654822.2541967 · Cited by 335
FlexFlow: A Flexible Dataflow Accelerator Architecture for Convolutional Neural Networks
Lu, W., Yan, G., Li, J., Gong, S., Han, Y., & Li, X. (2017) · 2017 IEEE International Symposium on High Performance Computer Architecture (HPCA) · doi:10.1109/hpca.2017.29 · Cited by 333
Memory-centric accelerator design for Convolutional Neural Networks
Peemen, M., Setio, A. A. A., Mesman, B., & Corporaal, H. (2013) · 2013 IEEE 31st International Conference on Computer Design (ICCD) · doi:10.1109/iccd.2013.6657019 · Cited by 332
Khanam, R., Hussain, M., Hill, R., & Allen, P. (2024) · IEEE Access · doi:10.1109/access.2024.3425166 · Cited by 237
A 240 G-ops/s Mobile Coprocessor for Deep Neural Networks
Gokhale, V., Jin, J., Dundar, A., Martini, B., & Culurciello, E. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2014.106 · Cited by 300
A high performance FPGA-based accelerator for large-scale convolutional neural networks
Li, H., Fan, X., Jiao, L., Cao, W., Zhou, X., & Wang, L. (2016) · 2016 26th International Conference on Field Programmable Logic and Applications (FPL) · doi:10.1109/fpl.2016.7577308 · Cited by 299
Caffeine: towards uniformed representation and acceleration for deep convolutional neural networks
Zhang, C., Fang, Z., Zhou, P., Pan, P., & Cong, J. (2016) · Proceedings of the 35th International Conference on Computer-Aided Design · doi:10.1145/2966986.2967011 · Cited by 299
Hardware for machine learning: Challenges and opportunities
Sze, V., Chen, Y.-H., Emer, J., Suleiman, A., & Zhang, Z. (2017) · 2017 IEEE Custom Integrated Circuits Conference (CICC) · doi:10.1109/cicc.2017.7993626 · Cited by 193
Maximizing CNN Accelerator Efficiency Through Resource Partitioning
Shen, Y., Ferdman, M., & Milder, P. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080221 · Cited by 284
DianNao: a small-footprint high-throughput accelerator for ubiquitous machine-learning
Chen, T., Du, Z., Sun, N., Wang, J., Wu, C., Chen, Y., & Temam, O. (2014) · ACM SIGPLAN Notices · doi:10.1145/2644865.2541967 · Cited by 281
Caffeine: Toward Uniformed Representation and Acceleration for Deep Convolutional Neural Networks
Zhang, C., Sun, G., Fang, Z., Zhou, P., Pan, P., & Cong, J. (2019) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2017.2785257 · Cited by 270
AxNN: energy-efficient neuromorphic systems using approximate computing
Venkataramani, S., Ranjan, A., Roy, K., & Raghunathan, A. (2014) · Proceedings of the 2014 international symposium on Low power electronics and design · doi:10.1145/2627369.2627613 · Cited by 261
Cambricon: an instruction set architecture for neural networks
Liu, S., Du, Z., Tao, J., Han, D., Luo, T., Xie, Y., Chen, Y., & Chen, T. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001179 · Cited by 243
Capra, M., Bussolino, B., Marchisio, A., Masera, G., Martina, M., & Shafique, M. (2020) · IEEE Access · doi:10.1109/access.2020.3039858 · Cited by 222
Energy-Efficient CNN Implementation on a Deeply Pipelined FPGA Cluster
Zhang, C., Wu, D., Sun, J., Sun, G., Luo, G., & Cong, J. (2016) · Proceedings of the 2016 International Symposium on Low Power Electronics and Design · doi:10.1145/2934583.2934644 · Cited by 227
Deep Learning on FPGAs: Past, Present, and Future
Lacey, G., Taylor, G. W., & Areibi, S. M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.04283 · Cited by 148
Zhou, X., Du, Z., Guo, Q., Liu, S., Liu, C., Wang, C., Zhou, X., Li, L., Chen, T., & Chen, Y. (2018) · 2018 51st Annual IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2018.00011 · Cited by 214
“[66] designed a systolic-like coprocessor to handle 2D convolution efficiently.”
MethodImproving the Performance of OpenCL-based FPGA Accelerator for Convolutional Neural Network
Zhang, J., & Li, J. (2017) · Proceedings of the 2017 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays · doi:10.1145/3020078.3021698 · Cited by 208
Design space exploration of FPGA-based Deep Convolutional Neural Networks
Motamedi, M., Gysel, P., Akella, V., & Ghiasi, S. (2016) · 2016 21st Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/aspdac.2016.7428073 · Cited by 206
Analog architectures for neural network acceleration based on non-volatile memory
Xiao, T. P., Bennett, C. H., Feinberg, B., Agarwal, S., & Marinella, M. J. (2020) · Applied Physics Reviews · doi:10.1063/1.5143815 · Cited by 193
DianNao family: energy-efficient hardware accelerators for machine learning
Chen, Y., Chen, T., Xu, Z., Sun, N., & Temam, O. (2016) · Communications of the ACM · doi:10.1145/2996864 · Cited by 205
Exploring Heterogeneous Algorithms for Accelerating Deep Convolutional Neural Networks on FPGAs
Xiao, Q., Liang, Y., Lu, L., Yan, S., & Tai, Y.-W. (2017) · Proceedings of the 54th Annual Design Automation Conference 2017 · doi:10.1145/3061639.3062244 · Cited by 202
ScaleDeep: A Scalable Compute Architecture for Learning and Evaluating Deep Networks
Venkataramani, S., Ranjan, A., Banerjee, S., Das, D., Avancha, S., Jagannathan, A., Durg, A., Nagaraj, D., Kaul, B., Dubey, P., et al. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080244 · Cited by 188
RedEye: analog ConvNet image sensor architecture for continuous mobile vision
LiKamWa, R., Hou, Y., Gao, J., Polansky, M., & Zhong, L. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001164 · Cited by 189
A Bi-layered Parallel Training Architecture for Large-Scale Convolutional Neural Networks
Chen, J., Li, K., Bilal, K., Zhou, X., Li, K., & Yu, P. S. (2019) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2018.2877359 · Cited by 185
Fathom: reference workloads for modern deep learning methods
Adolf, R., Rama, S., Reagen, B., Wei, G.-Y., & Brooks, D. (2016) · 2016 IEEE International Symposium on Workload Characterization (IISWC) · doi:10.1109/iiswc.2016.7581275 · Cited by 169
Evaluating Fast Algorithms for Convolutional Neural Networks on FPGAs
Liang, Y., Lu, L., Xiao, Q., & Yan, S. (2020) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2019.2897701 · Cited by 159
Enable Deep Learning on Mobile Devices: Methods, Systems, and Applications
Cai, H., Lin, J., Lin, Y., Liu, Z., Tang, H., Wang, H., Zhu, L., & Han, S. (2022) · ACM Transactions on Design Automation of Electronic Systems · doi:10.1145/3486618 · Cited by 197
ShiDianNao: shifting vision processing closer to the sensor
Du, Z., Fasthuber, R., Chen, T., Ienne, P., Li, L., Luo, T., Feng, X., Chen, Y., & Temam, O. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/2872887.2750389 · Cited by 148
fpgaConvNet: Mapping regular and irregular convolutional neural networks on FPGAs
Venieris, S. I., & Bouganis, C.-S. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2844093 · Cited by 161
“With the evaluation of the performance model’s accuracy with respect to the real measured performance presented in [13] and [14], the rest of this section focuses on the comparison with (1) highly optimised designs targeting an embedded GPU and (2) state-of-the-art ConvNet designs on FPGAs.”
BackgroundInfluentialOPU: An FPGA-Based Overlay Processor for Convolutional Neural Networks
Yu, Y., Wu, C. H., Zhao, T., Wang, K., & He, L. (2019) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2019.2939726 · Cited by 172
Efficient Hardware Architectures for Accelerating Deep Neural Networks: Survey
Pudi, D., Boppu, S., Manikandan, M. S., & Cenkeramaddi, L. R. (2022) · IEEE Access · doi:10.1109/access.2022.3229767 · Cited by 180
Using Dataflow to Optimize Energy Efficiency of Deep Neural Network Accelerators
Chen, Y.-H., Emer, J., & Sze, V. (2017) · IEEE Micro · doi:10.1109/mm.2017.54 · Cited by 139
Cambricon: An Instruction Set Architecture for Neural Networks
Liu, S., Du, Z., Tao, J., Han, D., Luo, T., Xie, Y., Chen, Y., & Chen, T. (2016) · 2016 ACM/IEEE 43rd Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca.2016.42 · Cited by 121
A defect-tolerant accelerator for emerging high-performance applications
Temam, O. (2012) · ACM SIGARCH Computer Architecture News · doi:10.1145/2366231.2337200 · Cited by 139
Understanding the impact of precision quantization on the accuracy and energy of neural networks
Hashemi, S., Anthony, N., Tann, H., Bahar, R. I., & Reda, S. (2017) · Design, Automation, and Test in Europe · doi:10.23919/date.2017.7927224 · Cited by 170
DOTA: detect and omit weak attentions for scalable transformer acceleration
Qu, Z., Liu, L., Tu, F., Chen, Z., Ding, Y., & Xie, Y. (2022) · Proceedings of the 27th ACM International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3503222.3507738 · Cited by 130
Modeling Deep Learning Accelerator Enabled GPUs
Raihan, A., Goli, N., & Aamodt, T. M. (2019) · IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS) · doi:10.1109/ispass.2019.00016 · Cited by 163
Big/little deep neural network for ultra low power inference
Park, E., Kim, D., Kim, S., Kim, Y.-D., Kim, G., Yoon, S., & Yoo, S. (2015) · 2015 International Conference on Hardware/Software Codesign and System Synthesis (CODES+ISSS) · doi:10.1109/codesisss.2015.7331375 · Cited by 130
Efficient Processing of Deep Neural Networks
Sze, V., Chen, Y., Yang, T.-J., & Emer, J. (2020) · Synthesis lectures on computer architecture · doi:10.2200/s01004ed1v01y202004cac050 · Cited by 185
Gong, L., Wang, C., Li, X., Chen, H., & Zhou, X. (2018) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2018.2857078 · Cited by 118
ANT: Exploiting Adaptive Numerical Data Type for Low-bit Deep Neural Network Quantization
Guo, C., Zhang, C., Leng, J., Liu, Z., Yang, F., Liu, Y., Guo, M., & Zhu, Y. (2022) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro56248.2022.00095 · Cited by 166
F-CNN: An FPGA-based framework for training Convolutional Neural Networks
Zhao, W., Fu, H., Luk, W. W., Yu, T., Wang, S., Feng, B., Ma, Y., & Yang, G. (2016) · IEEE International Conference on Application-specific Systems, Architectures and Processors (ASAP) · doi:10.1109/asap.2016.7760779 · Cited by 147
Throughput-Optimized FPGA Accelerator for Deep Convolutional Neural Networks
Liu, Z., Dou, Y., Jiang, J., Xu, J., Li, S., Zhou, Y., & Xu, Y. (2017) · ACM Transactions on Reconfigurable Technology and Systems · doi:10.1145/3079758 · Cited by 116
GAMMA: automating the HW mapping of DNN models on accelerators via genetic algorithm
Kao, S.-C., & Krishna, T. (2020) · doi:10.1145/3400302.3415639 · Cited by 212
ConfuciuX: Autonomous Hardware Resource Assignment for DNN Accelerators using Reinforcement Learning
Kao, S.-C., Jeong, G., & Krishna, T. (2020) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro50266.2020.00058 · Cited by 150
Maximizing CNN Accelerator Efficiency Through Resource Partitioning
Shen, Y., Ferdman, M., & Milder, P. A. (2017) · ACM SIGARCH Computer Architecture News · doi:10.1145/3140659.3080221 · Cited by 124
OpenVDAP: An Open Vehicular Data Analytics Platform for CAVs
Zhang, Q., Wang, Y., Zhang, X., Liu, L., Wu, X., Shi, W., & Zhong, H. (2018) · 2018 IEEE 38th International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2018.00131 · Cited by 103
Song, L., Wang, Y., Han, Y., Zhao, X., Liu, B., & Li, X. (2016) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1145/2897937.2897995 · Cited by 122
Efficient hardware architecture of softmax layer in deep neural network
Yuan, B. (2016) · 2016 29th IEEE International System-on-Chip Conference (SOCC) · doi:10.1109/socc.2016.7905501 · Cited by 101
Optimizing Memory Efficiency for Deep Convolutional Neural Networks on GPUs
Li, C., Yang, Y., Feng, M., Chakradhar, S., & Zhou, H. (2016) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1109/sc.2016.53 · Cited by 130
Self-citationAn FPGA-Based CNN Accelerator Integrating Depthwise Separable Convolution
Liu, B., Zou, D., Feng, L., Feng, S., Fu, P., & Li, J. (2019) · Electronics · doi:10.3390/electronics8030281 · Cited by 117
Zhang, J., Rangineni, K., Ghodsi, Z., & Garg, S. (2018) · Proceedings of the 55th Annual Design Automation Conference · doi:10.1145/3195970.3196129 · Cited by 87
Efficient training algorithms for neural networks based on memristive crossbar circuits
Kataeva, I., Merrikh-Bayat, F., Zamanidoost, E., & Strukov, D. (2015) · 2015 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2015.7280785 · Cited by 103
Escher: A CNN Accelerator with Flexible Buffering to Minimize Off-Chip Transfer
Shen, Y., Ferdman, M., & Milder, P. (2017) · 2017 IEEE 25th Annual International Symposium on Field-Programmable Custom Computing Machines (FCCM) · doi:10.1109/fccm.2017.47 · Cited by 106
DRQ: Dynamic Region-based Quantization for Deep Neural Network Acceleration
Song, Z., Fu, B., Wu, F., Jiang, Z., Jiang, L., Jing, N., & Liang, X. (2020) · 2020 ACM/IEEE 47th Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca45697.2020.00086 · Cited by 91
Hardware for machine learning: Challenges and opportunities
Sze, V., Chen, Y.-H., Emer, J., Suleiman, A., & Zhang, Z. (2018) · 2018 IEEE Custom Integrated Circuits Conference (CICC) · doi:10.1109/cicc.2018.8357072 · Cited by 97
An FPGA Implementation of Deep Spiking Neural Networks for Low-Power and Fast Classification
Ju, X., Fang, B., Yan, R., Xu, X., & Tang, H. (2019) · Neural Computation · doi:10.1162/neco_a_01245 · Cited by 107
Accelerating CNN Inference on ASICs: A Survey
Moolchandani, D., Kumar, A., & Sarangi, S. R. (2020) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2020.101887 · Cited by 110
Efficient FPGA Acceleration of Convolutional Neural Networks Using Logical-3D Compute Array
Rahman, A., Lee, J., & Choi, K. (2016) · Design, Automation, and Test in Europe · doi:10.3850/9783981537079_0833 · Cited by 120
A defect-tolerant accelerator for emerging high-performance applications
Temam, O. (2012) · 2012 39th Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca.2012.6237031 · Cited by 92
Yonekawa, H., & Nakahara, H. (2017) · IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum · doi:10.1109/ipdpsw.2017.95 · Cited by 100
An FPGA-Based Reconfigurable CNN Accelerator for YOLO
Zhang, S., Cao, J., Zhang, Q., Zhang, Q., Zhang, Y., & Wang, Y. (2020) · International Conference on Electronics Technology (ICET) · doi:10.1109/icet49382.2020.9119500 · Cited by 97
An FPGA-based accelerator implementation for deep convolutional neural networks
Zhou, Y., & Jiang, J. (2015) · International Conference on Computer Science and Network Technology (ICCSNT) · doi:10.1109/iccsnt.2015.7490869 · Cited by 96
Optimizing CNN-Based Object Detection Algorithms on Embedded FPGA Platforms
Zhao, R., Niu, X., Wu, Y., Luk, W. W., & Liu, Q. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-56258-2_22 · Cited by 102
RaPiD: AI Accelerator for Ultra-low Precision Training and Inference
Venkataramani, S., Srinivasan, V., Wang, W., Sen, S., Zhang, J., Agrawal, A., Kar, M., Jain, S., Mannari, A., Tran, H., et al. (2021) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1109/isca52012.2021.00021 · Cited by 120
A deep convolutional neural network based on nested residue number system
Nakahara, H., & Sasao, T. (2015) · International Conference on Field Programmable Logic and Applications (FPL) · doi:10.1109/fpl.2015.7293933 · Cited by 82
Multiplier-less Artificial Neurons Exploiting Error Resiliency for Energy-Efficient Neural Computing
Sarwar, S. S., Venkataramani, S., Raghunathan, A., & Roy, K. (2016) · Design, Automation, and Test in Europe · doi:10.3850/9783981537079_0848 · Cited by 93
Energy-Efficient Neural Computing with Approximate Multipliers
Sarwar, S. S., Venkataramani, S., Ankit, A., Raghunathan, A., & Roy, K. (2018) · ACM Journal on Emerging Technologies in Computing Systems · doi:10.1145/3097264 · Cited by 86
Moini, S., Alizadeh, B., Emad, M., & Ebrahimpour, R. (2017) · IEEE Transactions on Circuits & Systems II Express Briefs · doi:10.1109/tcsii.2017.2690919 · Cited by 82
Efficient AI System Design With Cross-Layer Approximate Computing
Venkataramani, S., Sun, X. N., Wang, N., Chen, C., Choi, J., Kang, M., Agarwal, A., Oh, J., Jain, S., Babinsky, T., et al. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2020.3029453 · Cited by 82
Metadata
- Authors
- Chakradhar, S., Sankaradas, M., Jakkula, V., & Cadambi, S.
- Affiliations
- NEC Laboratories America, Inc., Princeton, NJ, USA
- Venue
- Proceedings of the 37th annual international symposium on Computer architecture
- Publisher
- ACM
- Published
- 2010-06-19
- Pages
- 247-257
- ISSN
- 1063-6897 (ISSN-L)
- OpenAlex
- W2009832130
- Cited by
- 343
- References
- 36
- Citations by year
- 2025: 3 · 2024: 8 · 2023: 11 · 2022: 17 · 2021: 25 · 2020: 46 · 2019: 49 · 2018: 51 · 2017: 56 · 2016: 42 · 2015: 14 · 2014: 9 · 2013: 2 · 2012: 7
- FWCI
- 2.33
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Proceedings - International Symposium on Computer Architecture/Proceedings (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Hardware and Architecture › Embedded Systems Design Techniques
- Keywords
- convolutional neural networks, coprocessor architecture, parallelism, off-chip memory bandwidth, object detection, image recognition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.