A dynamically configurable coprocessor for convolutional neural networks
The DOI matches its Crossref record; 34 of the 36 references it cites were found in a registry or an index.
Abstract
Convolutional neural networks (CNN) applications range from recognition and reasoning (such as handwriting recognition, facial expression recognition and video surveillance) to intelligent text applications such as semantic text analysis and natural language processing applications. Two key observations drive the design of a new architecture for CNN. First, CNN workloads exhibit a widely varying mix of three types of parallelism: parallelism within a convolution operation, intra-output parallelism where multiple input sources (features) are combined to create a single output, and inter-output parallelism where multiple, independent outputs (features) are computed simultaneously. Workloads differ significantly across different CNN applications, and across different layers of a CNN. Second, the number of processing elements in an architecture continues to scale (as per Moore's law) much faster than off-chip memory bandwidth (or pin-count) of chips. Based on these two observations, we show that for a given number of processing elements and off-chip memory bandwidth, a new CNN hardware architecture that dynamically configures the hardware on-the-fly to match the specific mix of parallelism in a given workload gives the best throughput performance. Our CNN compiler automatically translates high abstraction network specification into a parallel microprogram (a sequence of low-level VLIW instructions) that is mapped, scheduled and executed by the coprocessor. Compared to a 2.3 GHz quad-core, dual socket Intel Xeon, 1.35 GHz C870 GPU, and a 200 MHz FPGA implementation, our 120 MHz dynamically configurable architecture is 4x to 8x faster. This is the first CNN architecture to achieve real-time video stream processing (25 to 30 frames per second) on a wide range of object detection and recognition tasks.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Another option is to use field programable gate arrays (FPGAs), which consume much less energy than GPUs while providing an intermediate computing efficiency between CPUs and GPUs13–17.”
From Hardware implementation of memristor-based artificial neural networks (2024) · cites this paper as [16]
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Neural Networks And Learning Machines
Haykin, S. (2010) · Cited by 7,534
A unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058 · cited 1×
“Feed-forward, multi-layer artificial neural networks like the Convolutional Neural Networks (CNN) [2][11][13][16][17][20][23] have found increasing use in several new applications because they have the potential to process vast amounts of labeled data to automatically learn and extract complex…”
BackgroundFace recognition: a convolutional neural-network approach
Lawrence, S., Giles, C. L., Tsoi, A. C., & Back, A. D. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.554195 · Cited by 3,092
Lee, H., Grosse, R., Ranganath, R., & Ng, A. Y. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553453 · Cited by 2,412
Object Recognition with Features Inspired by Visual Cortex
Serre, T., Wolf, L., & Poggio, T. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.254 · Cited by 821
Large-scale deep unsupervised learning using graphics processors
Raina, R., Madhavan, A., & Ng, A. Y. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553486 · Cited by 742 · cited 2×
“…to match the exact computational workload of any layer of a CNN. Note that by replacing the convolver primitive with a different functional unit, we can easily implement different feed-forward neural networks and classifiers such as HMAX [17][27], Deep Belief Networks [29][30] and HoG methods [28].”
MethodMulticlass Object Recognition with Sparse, Localized Features
Mutch, J., & Lowe, D. G. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.200 · Cited by 453
Fast support vector machine training and classification on graphics processors
Catanzaro, B., Sundaram, N., & Keutzer, K. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390170 · Cited by 372
Cited by
Items 101–200 of 350
Angel-Eye: A Complete Design Flow for Mapping CNN onto Customized Hardware
Guo, K., Sui, L., Qiu, J., Yao, S., Han, S., Wang, Y., & Yang, H. (2016) · IEEE Computer Society Annual Symposium on VLSI · doi:10.1109/isvlsi.2016.129 · Cited by 79
Runtime configurable deep neural networks for energy-accuracy trade-off
Tann, H., Hashemi, S., Bahar, R. I., & Reda, S. (2016) · International Conference on Hardware/Software Codesign and System Synthesis · doi:10.1145/2968456.2968458 · Cited by 90
PUMA: A Programmable Ultra-efficient Memristor-based Accelerator for Machine Learning InferencePreprint
Ankit, A., Hajj, I. E., Chalamalasetti, S. R., Ndu, G., Foltín, M., Williams, R. S., Faraboschi, P., Hwu, W., Strachan, J. P., Roy, K., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.10351 · Cited by 73
Automatic code generation of convolutional neural networks in FPGA implementation
Liu, Z., Dou, Y., Jiang, J., & Xu, J. (2016) · International Conference on Field-Programmable Technology (FPT) · doi:10.1109/fpt.2016.7929190 · Cited by 79
Hill, P., Jain, A., Hill, M., Zamirai, B., Hsu, C.-H., Laurenzano, M. A., Mahlke, S., Tang, L., & Mars, J. (2017) · Proceedings of the 50th Annual IEEE/ACM International Symposium on Microarchitecture · doi:10.1145/3123939.3123970 · Cited by 57
Designing Hardware for Machine Learning: The Important Role Played by Circuit Designers
Sze, V. (2017) · IEEE Solid-State Circuits Magazine · doi:10.1109/mssc.2017.2745798 · Cited by 64
A High Throughput Acceleration for Hybrid Neural Networks With Efficient Resource Management on FPGA
Yin, S., Tang, S., Lin, X., Ouyang, P., Tu, F., Liu, L., & Wei, S. (2018) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2018.2821561 · Cited by 60
FPGA‐accelerated deep convolutional neural networks for high throughput and energy efficiency
Qiao, Y., Shen, J., Xiao, T., Yang, Q., Wen, M., & Zhang, C. (2016) · Concurrency and Computation Practice and Experience · doi:10.1002/cpe.3850 · Cited by 62
Shah, N., Chaudhari, P., & Varghese, K. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2815085 · Cited by 58
Jointly optimizing preprocessing and inference for DNN-based visual analytics
Kang, D. D., Mathur, A., Veeramacheneni, T., Bailis, P. D., & Zaharia, M. (2020) · Proceedings of the VLDB Endowment · doi:10.14778/3425879.3425881 · Cited by 64
Accelerating neuromorphic vision algorithms for recognition
Maashri, A. A., DeBole, M., Cotter, M. J., Chandramoorthy, N., Yang, X., Narayanan, V., & Chakrabarti, C. (2012) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1145/2228360.2228465 · Cited by 54
GradPIM: A Practical Processing-in-DRAM Architecture for Gradient Descent
Kim, H., Park, H., Kim, T., Cho, K., Lee, E., Ryu, S., Lee, H., Choi, K., & Lee, J. (2021) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca51647.2021.00030 · Cited by 65
Eager pruning: algorithm and architecture support for fast training of deep neural networks
Zhang, J., Chen, X., Song, M., & Li, T. (2019) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1145/3307650.3322263 · Cited by 81
Low-Complexity Approximate Convolutional Neural Networks
Cintra, R. J., Duffner, S., García, C., & Leite, A. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2815435 · Cited by 54
Neuromorphic computing's yesterday, today, and tomorrow – an evolutional view
Chen, Y., Li, H. H., Wu, C., Song, C., Li, S. K., Min, C., Cheng, H.-P., Wen, W., & Liu, X. (2017) · Integration · doi:10.1016/j.vlsi.2017.11.001 · Cited by 51
Shortcut Mining: Exploiting Cross-Layer Shortcut Reuse in DCNN Accelerators
Mazreah, A. A., & Chen, L. (2019) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca.2019.00030 · Cited by 51
An efficient implementation of 2D convolution in CNN
Chang, J., & Sha, J. (2016) · IEICE Electronics Express · doi:10.1587/elex.13.20161134 · Cited by 48
Accelerator Implementation of Lenet-5 Convolution Neural Network Based on FPGA with HLS
Dai, R., & Tang, Y. (2019) · International Conference on Circuits, Systems and Simulation (ICCSS) · doi:10.1109/cirsyssim.2019.8935599 · Cited by 50
FPGA Based Implementations of RNN and CNN: A Brief Analysis
Mahreen, Z., Usmani, A. R., Mehrban, S., & Hussain, M. (2019) · International Conference on Innovative Computing (ICIC) · doi:10.1109/icic48496.2019.8966676 · Cited by 48
Overcoming resource underutilization in spatial CNN accelerators
Shen, Y., Ferdman, M., & Milder, P. A. (2016) · International Conference on Field Programmable Logic and Applications (FPL) · doi:10.1109/fpl.2016.7577315 · Cited by 48
Service-Oriented Architecture on FPGA-Based MPSoC
Wang, C., Li, X., Chen, Y., Zhang, Y., Diessel, O., & Zhou, X. (2017) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2017.2701828 · Cited by 46
A Design Methodology for Efficient Implementation of Deconvolutional Neural Networks on an FPGAPreprint
Zhang, X., Das, S., Neopane, O., & Kreutz-Delgado, K. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.02583 · Cited by 51
An FPGA-based processor for training convolutional neural networks
Liu, Z., Dou, Y., Jiang, J., Wang, Q., & Chow, P. (2017) · International Conference on Field-Programmable Technology (FPT) · doi:10.1109/fpt.2017.8280142 · Cited by 48
Pre-defined Sparsity for Low-Complexity Convolutional Neural Networks
Kundu, S., Nazemi, M., Pedram, M., Chugg, K. M., & Beerel, P. A. (2020) · IEEE Transactions on Computers · doi:10.1109/tc.2020.2972520 · Cited by 51
A survey of neural network accelerators
Li, Z., Wang, Y., Zhi, T., & Chen, T. (2017) · Frontiers of Computer Science · doi:10.1007/s11704-016-6159-1 · Cited by 46
SPARCNet: A Hardware Accelerator for Efficient Deployment of Sparse Convolutional Networks
Page, A., Jafari, A., Shea, C., & Mohsenin, T. (2017) · ACM Journal on Emerging Technologies in Computing Systems · doi:10.1145/3005448 · Cited by 43
Hardware-Software Co-Design for an Analog-Digital Accelerator for Machine Learning
Ambrosi, J., Ankit, A., Antunes, R., Chalamalasetti, S. R., Chatterjee, S., Hajj, I. E., Fachini, G. J. D. A., Faraboschi, P., Foltín, M., Huang, S., et al. (2018) · IEEE International Conference on Rebooting Computing (ICRC) · doi:10.1109/icrc.2018.8638612 · Cited by 48
SPACX: Silicon Photonics-based Scalable Chiplet Accelerator for DNN Inference
Li, Y., Louri, A., & Karanth, A. (2022) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca53966.2022.00066 · Cited by 44
Efficient embedded learning for IoT devices
Venkataramani, S., Roy, K., & Raghunathan, A. (2016) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/aspdac.2016.7428029 · Cited by 46
Motamedi, M., Fong, D. D., & Ghiasi, S. (2017) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3126555 · Cited by 42
El-Maksoud, A. J. A., Ebbed, M. R., Khalil, A. H., & Mostafa, H. (2021) · IEEE Access · doi:10.1109/access.2021.3126838 · Cited by 39
FeatherCNN: Fast Inference Computation with TensorGEMM on ARM Architectures
Lan, H., Meng, J., Hundt, C., Schmidt, B., Deng, M., Wang, X., Liu, W., Qiao, Y., & Feng, S. (2019) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2019.2939785 · Cited by 39
APNAS: Accuracy-and-Performance-Aware Neural Architecture Search for Neural Hardware Accelerators
Achararit, P., Hanif, M. A., Putra, R. V. W., Shafique, M., & Hara–Azumi, Y. (2020) · IEEE Access · doi:10.1109/access.2020.3022327 · Cited by 42
A High-Throughput Neural Network Accelerator
Chen, T., Du, Z., Sun, N., Wang, J., Wu, C., Chen, Y., & Temam, O. (2015) · IEEE Micro · doi:10.1109/mm.2015.41 · Cited by 37
A Fast and Scalable Architecture to Run Convolutional Neural Networks in Low Density FPGAs
Véstias, M. P., Duarte, R. P., de Sousa, J. T., & Neto, H. C. (2020) · Microprocessors and Microsystems · doi:10.1016/j.micpro.2020.103136 · Cited by 33
Han, X., Zhou, D., Wang, S., & Kimura, S. (2016) · IEEE International Conference on Computer Design: VLSI in Computers and Processors (ICCD) · doi:10.1109/iccd.2016.7753296 · Cited by 39
An Approach of Feed-Forward Neural Network Throughput-Optimized Implementation in FPGA
Novickis, R., Justs, D. J., Ozols, K., & Greitāns, M. (2020) · Electronics · doi:10.3390/electronics9122193 · Cited by 35
Perspective: Uniform switching of artificial synapses for large-scale neuromorphic arrays
Tan, S. H., Lin, P., Yeon, H., Choi, S., Park, Y., & Kim, J. (2018) · APL Materials · doi:10.1063/1.5049137 · Cited by 33
Simplifying deep neural networks for neuromorphic architectures
Chung, J., & Shin, T. (2016) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1145/2897937.2898092 · Cited by 34
Re-architecting the on-chip memory sub-system of machine-learning accelerator for embedded devices
Wang, Y., Li, H., & Li, X. (2016) · doi:10.1145/2966986.2967068 · Cited by 32
A high-throughput reconfigurable processing array for neural networks
Wu, E., Zhang, X., Berman, D., & Cho, I. (2017) · International Conference on Field Programmable Logic and Applications (FPL) · doi:10.23919/fpl.2017.8056794 · Cited by 37
VR-DANN: Real-Time Video Recognition via Decoder-Assisted Neural Network Acceleration
Song, Z., Wu, F., Liu, X., Ke, J., Jing, N., & Liang, X. (2020) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro50266.2020.00063 · Cited by 38
Ascend: A Scalable and Energy-Efficient Deep Neural Network Accelerator With Photonic Interconnects
Li, Y., Wang, K., Zheng, H., Louri, A., & Karanth, A. (2022) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2022.3169953 · Cited by 33
Fast Algorithms for Quaternion-Valued Convolutional Neural Networks
Cariow, A., & Cariowa, G. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2979682 · Cited by 30
Li, Y., Louri, A., & Karanth, A. (2021) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2021.3139015 · Cited by 29
A reconfigurable accelerator for neuromorphic object recognition
Sabarad, J., Kestur, S., Park, M. S., Dantara, D., Narayanan, V., Chen, Y., & Khosla, D. (2012) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/aspdac.2012.6165067 · Cited by 30
NNest: Early-Stage Design Space Exploration Tool for Neural Network Inference Accelerators
Ke, L., He, X. J., & Zhang, X. (2018) · International Symposium on Low Power Electronics and Design (ISLPED) · doi:10.1145/3218603.3218647 · Cited by 40
DUET: Boosting Deep Neural Network Efficiency on Dual-Module Architecture
Liu, L., Qu, Z., Deng, L., Tu, F., Li, S., Hu, X., Gu, Z., Ding, Y., & Xie, Y. (2020) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro50266.2020.00066 · Cited by 31
UniWiG: Unified Winograd-GEMM Architecture for Accelerating CNN on FPGAs
Kala, S., Mathew, J., Jose, B. R., & Nalesh, S. (2019) · International Conference on VLSI Design · doi:10.1109/vlsid.2019.00055 · Cited by 29
Wearable on-device deep learning system for hand gesture recognition based on FPGA accelerator
Jiang, W., Xuelin, Y., Chen, R., Su, F., Lin, M., Ma, Y., Zhu, Y., & Huang, S. (2020) · Mathematical Biosciences & Engineering · doi:10.3934/mbe.2021007 · Cited by 30
PLACID: A Platform for FPGA-Based Accelerator Creation for DCNNs
Motamedi, M., Gysel, P., & Ghiasi, S. (2017) · ACM Transactions on Multimedia Computing, Communications, and Applications · doi:10.1145/3131289 · Cited by 28
mRNA: Enabling Efficient Mapping Space Exploration for a Reconfiguration Neural Accelerator
Zhao, Z., Kwon, H., Kuhar, S., Sheng, W., Mao, Z., & Krishna, T. (2019) · IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS) · doi:10.1109/ispass.2019.00040 · Cited by 34
A Primer on Deep Learning Architectures and Applications in Speech Processing
Ogunfunmi, T., Ramachandran, R. P., Togneri, R. B., Zhao, Y., & Xia, X. (2019) · Circuits Systems and Signal Processing · doi:10.1007/s00034-019-01157-3 · Cited by 29
Dey, S., Kalliatakis, G., Saha, S., Singh, A. K., Ehsan, S., & McDonald-Maier, K. D. (2018) · NASA/ESA Conference on Adaptive Hardware and Systems (AHS) · doi:10.1109/ahs.2018.8541406 · Cited by 27
Reconfigurable Convolutional Kernels for Neural Networks on FPGAs
Hardieck, M., Kumm, M., Möller, K., & Zipf, P. (2019) · ACM/SIGDA International Symposium on Field-Programmable Gate Arrays (FPGA) · doi:10.1145/3289602.3293905 · Cited by 31
FATE: fast and accurate timing error prediction framework for low power DNN accelerator design
Zhang, J. J., & Garg, S. (2018) · doi:10.1145/3240765.3240809 · Cited by 27
Manna: An Accelerator for Memory-Augmented Neural Networks
Stevens, J. R., Ranjan, A., Das, D., Kaul, B., & Raghunathan, A. (2019) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1145/3352460.3358304 · Cited by 29
Stochastic-Based Deep Convolutional Networks with Reconfigurable Logic Fabric
Alawad, M., & Lin, M. (2016) · IEEE Transactions on Multi-Scale Computing Systems · doi:10.1109/tmscs.2016.2601326 · Cited by 26
Zhu, Z., Guglielmo, G. D., Cheng, Q., Glick, M. S., Kwon, J., Guan, H., Carloni, L. P., & Bergman, K. (2020) · Journal of Lightwave Technology · doi:10.1109/jlt.2020.2975976 · Cited by 29
Memory-Efficient Probabilistic 2-D Finite Impulse Response (FIR) Filter
Alawad, M., & Lin, M. (2017) · IEEE Transactions on Multi-Scale Computing Systems · doi:10.1109/tmscs.2017.2695588 · Cited by 24
Hardware accelerator systems for artificial intelligence and machine learning
(2020) · Advances in computers · doi:10.1016/bs.adcom.2020.11.005 · Cited by 24
PYNQ FPGA Hardware implementation of LeNet-5-Based Traffic Sign Recognition Application
Maraoui, A., Messaoud, S., Bouaafia, S., Ammari, A. C., Khriji, L., & Machhout, M. (2021) · International Multi-Conference on Systems, Signals & Devices (SSD) · doi:10.1109/ssd52085.2021.9429480 · Cited by 24
A pipelined and scalable dataflow implementation of convolutional neural networks on FPGA
Bacis, M., Natale, G., Sozzo, E. D., & Santambrogio, M. D. (2017) · IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum · doi:10.1109/ipdpsw.2017.44 · Cited by 25
Khorasani, F., Esfeden, H. A., Abu‐Ghazaleh, N., & Sarkar, V. (2018) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2018.00038 · Cited by 32
A survey on CNN and RNN implementations
Hoffmann, J., Navarro, O., Kästner, F., Janßen, B., & Hübner, M. (2017) · Cited by 37
Parana: A Parallel Neural Architecture Considering Thermal Problem of 3D Stacked Memory
Yin, S., Tang, S., Lin, X., Ouyang, P., Tu, F., Liu, L., Zhao, J., Xu, C., Li, S., Xie, Y., et al. (2018) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2018.2858230 · Cited by 24
FPGA-Based Training Accelerator Utilizing Sparseness of Convolutional Neural Network
Nakahara, H., Sada, Y., Shimoda, M., Sayama, K., Jinguji, A., & Sato, S. (2019) · International Conference on Field Programmable Logic and Applications (FPL) · doi:10.1109/fpl.2019.00036 · Cited by 31
Safety Design of a Convolutional Neural Network Accelerator with Error Localization and Correction
Xu, Z. G., & Abraham, J. A. (2019) · IEEE International Test Conference (ITC) · doi:10.1109/itc44170.2019.9000149 · Cited by 28
Test Architecture for Systolic Array of Edge-Based AI Accelerator
Solangi, U. S., Ibtesam, M., Ansari, M. A., Kim, J., & Park, S. (2021) · IEEE Access · doi:10.1109/access.2021.3094741 · Cited by 25
A Threshold Neuron Pruning for a Binarized Deep Neural Network on an FPGA
Fujii, T., Sato, S., & Nakahara, H. (2018) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2017rcp0013 · Cited by 27
Convolutional Autoencoder-Based Transfer Learning for Multi-Task Image Inferences
Lu, J., Verma, N., & Jha, N. K. (2021) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2021.3068063 · Cited by 25
FALCON: Feature driven selective classification for energy-efficient image recognition
Panda, P., Ankit, A., Wijesinghe, P., & Roy, K. (2017) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2017.2681075 · Cited by 21
“In [23] and [24], application-specific NN designs and programmable neuromorphic processors have been proposed.”
An FPGA Overlay for CNN Inference with Fine-grained Flexible Parallelism
Choudhury, Z., Shrivastava, S., Ramapantulu, L., & Purini, S. (2022) · ACM Transactions on Architecture and Code Optimization · doi:10.1145/3519598 · Cited by 22
Zhang, J. J., Raj, P., Zarar, S., Ambardekar, A., & Garg, S. (2019) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3358178 · Cited by 21
InS-DLA: An In-SSD Deep Learning Accelerator for Near-Data Processing
Liang, S., Wang, Y., Liu, C., Li, H., & Li, X. (2019) · International Conference on Field Programmable Logic and Applications (FPL) · doi:10.1109/fpl.2019.00035 · Cited by 33
Customizable Computing—From Single Chip to Datacenters
Cong, J., Fang, Z., Huang, M., Wei, P., Wu, D., & Yu, C. H. (2018) · Proceedings of the IEEE · doi:10.1109/jproc.2018.2876372 · Cited by 26
A Holistic Approach for Optimizing DSP Block Utilization of a CNN implementation on FPGA
Abdelouahab, K., Bourrasset, C., Pelcat, M., Berry, F., Quinton, J., & Sérot, J. (2016) · ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC) · doi:10.1145/2967413.2967430 · Cited by 24
AI accelerator on IBM Telum processor: industrial product
Lichtenau, C., Buyuktosunoglu, A., Bertran, R., Figuli, P., Jacobi, C., Papandreou, N., Pozidis, H., Saporito, A., Sica, A., & Tzortzatos, E. (2022) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1145/3470496.3533042 · Cited by 27
A performance analysis framework for exploiting GPU microarchitectural capability
Zhou, K., Tan, G., Zhang, X., Wang, C., & Sun, N. (2017) · International Conference on Supercomputing · doi:10.1145/3079079.3079083 · Cited by 19
A CNN Accelerator on FPGA with a Flexible Structure
Shan, D., Cong, G., & Lu, W. D. (2020) · International Conference on Computational Intelligence and Applications (ICCIA) · doi:10.1109/iccia49625.2020.00047 · Cited by 19
Addressing Sparsity in Deep Neural Networks
Zhou, X., Chen, Y., Du, Z., Zhang, S., Zhang, L., Lan, H., Liu, S., Li, L., Guo, Q., & Chen, T. (2018) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2018.2864289 · Cited by 21
An Energy-Efficient Implementation of Group Pruned CNNs on FPGA
Pang, W., Wu, C., & Lu, S. (2020) · IEEE Access · doi:10.1109/access.2020.3041464 · Cited by 20
Hardware Compilation of Deep Neural Networks: An Overview
Zhao, R., Liu, S., Ng, H.-C., Wang, E., Davis, J. J., Niu, X., Wang, X., Shi, H.-F., Constantinides, G. A., Cheung, P. Y. K., et al. (2018) · IEEE International Conference on Application-specific Systems, Architectures and Processors (ASAP) · doi:10.1109/asap.2018.8445088 · Cited by 23
CNN Acceleration With Hardware-Efficient Dataflow for Super-Resolution
Lee, S., Joo, S., Ahn, H. K., & Jung, S. (2020) · IEEE Access · doi:10.1109/access.2020.3031055 · Cited by 18
AnalogNet: Convolutional Neural Network Inference on Analog Focal Plane Sensor ProcessorsPreprint
Wong, M. Z., Guillard, B., Murai, R., Sajad Saeedi, G., & Kelly, P. H. J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.01765 · Cited by 21
SAMBA: S parsity A ware In- M emory Computing B ased Machine Learning A ccelerator
Kim, D. E., Ankit, A., Wang, C., & Roy, K. (2023) · IEEE Transactions on Computers · doi:10.1109/tc.2023.3257513 · Cited by 17
Towards General-Purpose Neural Network Computing
Eldridge, S., Waterland, A., Seltzer, M., Appavoo, J., & Joshi, A. (2015) · International Conference on Parallel Architectures and Compilation Techniques (PACT) · doi:10.1109/pact.2015.21 · Cited by 19
Dyhard-DNN: even more DNN acceleration with dynamic hardware reconfiguration
Putic, M., Venkataramani, S., Eldridge, S., Buyuktosunoglu, A., Bose, P. K., & Stan, M. R. (2018) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1145/3195970.3196033 · Cited by 21
Scalable FPGA Accelerator for Deep Convolutional Neural Networks with Stochastic Streaming
Alawad, M., & Lin, M. (2018) · IEEE Transactions on Multi-Scale Computing Systems · doi:10.1109/tmscs.2018.2886266 · Cited by 18
Early Experience in Benchmarking Edge AI Processors with Object Detection Workloads
Hui, Y., Lien, J. S., & Lu, X. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-49556-5_3 · Cited by 17
Performance Analysis of Convolutional Neural Network Models
Kala, S., Paul, D., Jose, B. R., Mathew, J., & Nalesh, S. (2019) · International Conference on Advances in Computing and Communications (ICACC) · doi:10.1109/icacc48162.2019.8986201 · Cited by 17
Efficiency Optimization of Trainable Feature Extractors for a Consumer Platform
Peemen, M., Mesman, B., & Corporaal, H. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-23687-7_27 · Cited by 17
An FPGA Realization of a Deep Convolutional Neural Network Using a Threshold Neuron Pruning
Fujii, T., Sato, S., Nakahara, H., & Motomura, M. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-56258-2_23 · Cited by 17
A Multithreaded CGRA for Convolutional Neural Network Processing
Ando, K., Takamaeda-Yamazaki, S., Ikebe, M., Asai, T., & Motomura, M. (2017) · Circuits and Systems · doi:10.4236/cs.2017.86010 · Cited by 18
Exploiting Sparsity to Accelerate Fully Connected Layers of CNN-Based Applications on Mobile SoCs
Xie, X., Du, D., Li, Q., Liang, Y. E., Tang, W. T., Ong, Z., Lu, M., Huynh, H. P., & Goh, R. S. M. (2017) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3122788 · Cited by 20
VHDL generator for a high performance convolutional neural network FPGA-based accelerator
Hamdan, M. K. A., & Rover, D. T. (2017) · International Conference on ReConFigurable Computing and FPGAs (ReConFig) · doi:10.1109/reconfig.2017.8279827 · Cited by 17
Review of prominent strategies for mapping CNNs onto embedded systems
Arredondo-Velázquez, M., Díaz-Carmona, J., Gutiérrez, A. I. B., & Torres-Huitzil, C. (2020) · IEEE Latin America Transactions · doi:10.1109/tla.2020.9082927 · Cited by 16
Automatic generation of software pipelines for heterogeneous parallel systems
Pienaar, J. A., Chakradhar, S., & Raghunathan, A. (2012) · IEEE International Conference on High Performance Computing, Data, and Analytics · doi:10.5555/2388996.2389029 · Cited by 17
Self-citationReconfigurable Architecture for Neural Approximation in Multimedia Computing
Tu, F., Yin, S., Ouyang, P., Liu, L., & Wei, S. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2812781 · Cited by 19
Metadata
- Authors
- Chakradhar, S., Sankaradas, M., Jakkula, V., & Cadambi, S.
- Affiliations
- NEC Laboratories America, Inc., Princeton, NJ, USA
- Venue
- Proceedings of the 37th annual international symposium on Computer architecture
- Publisher
- ACM
- Published
- 2010-06-19
- Pages
- 247-257
- ISSN
- 1063-6897 (ISSN-L)
- OpenAlex
- W2009832130
- Cited by
- 343
- References
- 36
- Citations by year
- 2025: 3 · 2024: 8 · 2023: 11 · 2022: 17 · 2021: 25 · 2020: 46 · 2019: 49 · 2018: 51 · 2017: 56 · 2016: 42 · 2015: 14 · 2014: 9 · 2013: 2 · 2012: 7
- FWCI
- 2.33
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Proceedings - International Symposium on Computer Architecture/Proceedings (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Hardware and Architecture › Embedded Systems Design Techniques
- Keywords
- convolutional neural networks, coprocessor architecture, parallelism, off-chip memory bandwidth, object detection, image recognition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.