UNPU: An Energy-Efficient Deep Neural Network Accelerator With Fully Variable Weight Bit Precision
The DOI matches its Crossref record; 34 of the 39 references it cites were found in a registry or an index.
Abstract
An energy-efficient deep neural network (DNN) accelerator, unified neural processing unit (UNPU), is proposed for mobile deep learning applications. The UNPU can support both convolutional layers (CLs) and recurrent or fully connected layers (FCLs) to support versatile workload combinations to accelerate various mobile deep learning applications. In addition, the UNPU is the first DNN accelerator ASIC that can support fully variable weight bit precision from 1 to 16 bit. It enables the UNPU to operate on the accuracy-energy optimal point. Moreover, the lookup table (LUT)-based bit-serial processing element (LBPE) in the UNPU achieves the energy consumption reduction compared to the conventional fixed-point multiply-and-accumulate (MAC) array by 23.1%, 27.2%, 41%, and 53.6% for the 16-, 8-, 4-, and 1-bit weight precision, respectively. Besides the energy efficiency improvement, the unified DNN core architecture of the UNPU improves the peak performance for CL by 1.15 $\times$ compared to the previous work. It makes the UNPU operate on the lower voltage and frequency for the given DNN to increase energy efficiency. The UNPU is implemented in 65-nm CMOS technology and occupies the $4 \times 4$ mm2 die area. The UNPU can operates from 0.63- to 1.1-V supply voltage with maximum frequency of 200 MHz. The UNPU has peak performance of 345.6 GOPS for 16-bit weight precision and 7372 GOPS for 1-bit weight precision. The wide operating range of UNPU makes the UNPU achieve the power effi…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“such scaling will enable NeuRRAM to deliver higher energy and area efficiency than today’s state-of-the-art edge inference accelerators58–61.”
From A compute-in-memory chip based on resistive random-access memory (2022) · cites this paper as [60]
Citations
Cites
In-Datacenter Performance Analysis of a Tensor Processing Unit
Jouppi, N. P., Young, C., Patil, N., Patterson, D., Agrawal, G., Bajwa, R., Bates, S., Bhatia, S., Boden, N., Borchers, A., et al. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080246 · Cited by 4,537 · cited 4×
“However, [20] and [21] could not accelerate a given DNN at the energy-accuracy optimal point.”
BackgroundInfluentialXNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks
Rastegari, M., Ordonez, V., Redmon, J., & Farhadi, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_32 · Cited by 4,408
Eyeriss: An Energy-Efficient Reconfigurable Accelerator for Deep Convolutional Neural Networks
Chen, Y.-H., Krishna, T., Emer, J. S., & Sze, V. (2017) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2016.2616357 · Cited by 3,247
In-Datacenter Performance Analysis of a Tensor Processing Unit
Jouppi, N. P., Young, C., Patil, N., Patterson, D., Agrawal, G., Bajwa, R., Bates, S., Bhatia, S., Boden, N., Borchers, A., et al. (2017) · ACM SIGARCH Computer Architecture News · doi:10.1145/3140659.3080246 · Cited by 1,240
Pruning Convolutional Neural Networks for Resource Efficient Inference
Molchanov, P. A., Tyree, S., Karras, T., Aila, T., & Kautz, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.06440 · Cited by 1,239
Quantized Convolutional Neural Networks for Mobile Devices
Wu, J., Leng, C., Wang, Y., Hu, Q., & Cheng, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.521 · Cited by 1,212
Zhu, C., Han, S., Mao, H., & Dally, W. J. (2016) · arXiv · doi:10.48550/arxiv.1612.01064 · Cited by 865
DeepSense: A Unified Deep Learning Framework for Time-Series Mobile Sensing Data Processing
Yao, S., Hu, S., Zhao, Y., Zhang, A., & Abdelzaher, T. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052577 · Cited by 667 · cited 1×
“deep learning to mobile applications such as face recognition, speech recognition, and user identification [1], [2].”
BackgroundMoons, B., Uytterhoeven, R., Dehaene, W., & Verhelst, M. (2017) · 2017 IEEE International Solid-State Circuits Conference (ISSCC) · doi:10.1109/isscc.2017.7870353 · Cited by 479
DeepX: A Software Accelerator for Low-Power Deep Learning Inference on Mobile Devices
Lane, N. D., Bhattacharya, S., Georgiev, P., Forlivesi, C., Jiao, L., Qendro, L., & Kawsar, F. (2016) · 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN) · doi:10.1109/ipsn.2016.7460664 · Cited by 450
Stripes: Bit-serial deep neural network computing
Judd, P., Albericio, J., Hetherington, T., Aamodt, T. M., & Moshovos, A. (2016) · 2016 49th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2016.7783722 · Cited by 333
14.2 DNPU: An 8.1TOPS/W reconfigurable CNN-RNN processor for general-purpose deep neural networks
Shin, D., Lee, J., Lee, J., & Yoo, H.-J. (2017) · 2017 IEEE International Solid-State Circuits Conference (ISSCC) · doi:10.1109/isscc.2017.7870350 · Cited by 307
Self-citationLee, J., Kim, C., Kang, S., Shin, D., Kim, S., & Yoo, H.-J. (2018) · 2018 IEEE International Solid - State Circuits Conference - (ISSCC) · doi:10.1109/isscc.2018.8310262 · Cited by 303
Self-citationDesoli, G., Chawla, N., Boesch, T., Singh, S.-P., Guidetti, E., De Ambroggi, F., Majo, T., Zambotti, P., Ayodhyawasi, M., Singh, H., et al. (2017) · 2017 IEEE International Solid-State Circuits Conference (ISSCC) · doi:10.1109/isscc.2017.7870349 · Cited by 174
Whatmough, P. N., Lee, S. K., Lee, H., Rama, S., Brooks, D., & Wei, G.-Y. (2017) · 2017 IEEE International Solid-State Circuits Conference (ISSCC) · doi:10.1109/isscc.2017.7870351 · Cited by 164
A 0.3–2.6 TOPS/W precision-scalable processor for real-time large-scale ConvNets
Moons, B., & Verhelst, M. (2016) · 2016 IEEE Symposium on VLSI Circuits (VLSI-Circuits) · doi:10.1109/vlsic.2016.7573525 · Cited by 161
Sim, J., Park, J.-S., Kim, M., Bae, D., Choi, Y., & Kim, L.-S. (2016) · 2016 IEEE International Solid-State Circuits Conference (ISSCC) · doi:10.1109/isscc.2016.7418008 · Cited by 140
Deep Learning for Mobile Multimedia: A Survey
Ota, K., Dao, M. S., Mezaris, V., & Natale, F. G. B. D. (2017) · ACM Transactions on Multimedia Computing, Communications, and Applications · doi:10.1145/3092831 · Cited by 135
Mathur, A., Lane, N. D., Bhattacharya, S., Boran, A., Forlivesi, C., & Kawsar, F. (2017) · Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3081333.3081359 · Cited by 128
Bong, K., Choi, S., Kim, C., Han, D., & Yoo, H. (2017) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2017.2767705 · Cited by 128
Self-citationCompression of Deep Convolutional Neural Networks for Fast and Low Power Mobile Applications
Kim, Y., Park, E., Yoo, S., Choi, T., Lu, Y., & Shin, D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06530 · Cited by 111
Self-citationUeyoshi, K., Ando, K., Hirose, K., Takamaeda-Yamazaki, S., Kadomoto, J., Miyata, T., Hamada, M., Kuroda, T., & Motomura, M. (2018) · Digest of technical papers/Digest of technical papers - IEEE International Solid-State Circuits Conference · doi:10.1109/isscc.2018.8310261 · Cited by 111
DeepSense: A Unified Deep Learning Framework for Time-Series Mobile Sensing Data Processing
Yao, S., Hu, S., Zhao, Y., Zhang, A., & Abdelzaher, T. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01942 · Cited by 102
DeepRebirth: Accelerating Deep Neural Network Execution on Mobile Devices
Li, D., Wang, X., & Kong, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11876 · Cited by 94
A 1.06-to-5.09 TOPS/W reconfigurable hybrid-neural-network processor for deep learning applications
Yin, S., Ouyang, P., Tang, S., Tu, F., Li, X., Liu, L., & Wei, S. (2017) · 2017 Symposium on VLSI Circuits · doi:10.23919/vlsic.2017.8008534 · Cited by 93
Ando, K., Ueyoshi, K., Orimo, K., Yonekawa, H., Sato, S., Nakahara, H., Ikebe, M., Asai, T., Takamaeda-Yamazaki, S., Kuroda, T., et al. (2017) · 2017 Symposium on VLSI Circuits · doi:10.23919/vlsic.2017.8008533 · Cited by 87
Deep Convolutional Neural Network Inference with Floating-point Weights and Fixed-point Activations
Lai, L., Suda, N., & Chandra, V. (2017) · arXiv · doi:10.48550/arxiv.1703.03073 · Cited by 81 · cited 2×
“2(a), different DNNs have different optimal weight precision [26].”
BackgroundPaul, N., Lee, S. K., Lee, H., Rama, S., David, B., & Wei, G.-Y. (2017) · IEEE Conference Proceedings · Cited by 77
Effective Quantization Methods for Recurrent Neural Networks
He, Q., Wen, H., Zhou, S., Wu, Y., Yao, C., Zhou, X., & Zou, Y. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.10176 · Cited by 56
MobiRNN: Efficient Recurrent Neural Network Execution on Mobile GPU
Cao, Q., Balasubramanian, N., & Balasubramanian, A. (2017) · Proceedings of the 1st International Workshop on Deep Learning for Mobile Systems and Applications · doi:10.1145/3089801.3089804 · Cited by 49
Bit Fusion: Bit-Level Dynamically Composable Architecture for Accelerating Deep Neural NetworksPreprint
Sharma, H., Park, J., Suda, N., Lai, L., Chau, B., Kim, J. K., Chandra, V., & Esmaeilzadeh, H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.01507 · Cited by 49
fpgaConvNet: A Toolflow for Mapping Diverse Convolutional Neural Networks on Embedded FPGAsPreprint
Venieris, S. I., & Bouganis, C.-S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.08740 · Cited by 31
High performance ultra-low-precision convolutions on mobile devicesPreprint
Tulloch, A., & Jia, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.02427 · Cited by 27
MobiRNN: Efficient Recurrent Neural Network Execution on Mobile GPUPreprint
Cao, Q., Balasubramanian, N., & Balasubramanian, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.00878 · Cited by 11
Research works printed but not linked: 4
- bang, 2017, A $288~\mu\text{W}$ programmable deep-learning processor with 270 KB on-chip weight storage using non-uniform memory hierarchy for mobile intelligence, IEEE Int Solid-State Circuits Conf (ISSCC) Dig Tech Papers, 250
- whatmough, 2017, A 28 nm SoC with a 1.2 GHz 568 nJ/prediction sparse deep-neural-network engine with >0.1 timing error rate tolerance for IoT applications, IEEE Int Solid-State Circuits Conf (ISSCC) Dig Tech Papers, 242
- desoli, 2017, A 2.9 TOPS/W deep convolutional neural network SoC in FD-SOI 28 nm for intelligent embedded systems, IEEE Int Solid-State Circuits Conf (ISSCC) Dig Tech Papers, 238
- moons, 2017, Envision: A 0.26-to-10 TOPS/W subword-parallel dynamic-voltage-accuracy-frequency-scalable convolutional neural network processor 28 nm FDSOI, IEEE Int Solid-State Circuits Conf (ISSCC) Dig Tech Papers, 246
Cited by
Model Compression and Hardware Acceleration for Neural Networks: A Comprehensive Survey
Deng, B. L., Li, G., Han, S., Shi, L., & Xie, Y. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2020.2976475 · Cited by 996
“Two ways are utilized in this context: bit-serial [12], [278] and bit-decomposed [279], which are depicted in Figs.”
MethodA compute-in-memory chip based on resistive random-access memory
Wan, W., Kubendran, R., Schaefer, C., Eryilmaz, S. B., Zhang, W., Wu, D., Deiss, S., Raina, P., Qian, H., Gao, B., et al. (2022) · Nature · doi:10.1038/s41586-022-04992-8 · Cited by 943
An on-chip photonic deep neural network for image classification
Ashtiani, F., Geers, A. J., & Aflatouni, F. (2022) · Nature · doi:10.1038/s41586-022-04714-0 · Cited by 699
Hardware implementation of memristor-based artificial neural networks
Aguirre, F., Sebastian, A., Le Gallo, M., Song, W., Wang, T., Yang, J. J., Lu, W., Chang, M.-F., Ielmini, D., Yang, Y., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-45670-9 · Cited by 564
Internet of Underwater Things and Big Marine Data Analytics—A Comprehensive Survey
Jahanbakht, M., Xiang, W., Hanzo, L., & Rahimi Azghadi, M. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3053118 · Cited by 425
Metadata
- Authors
- Lee, J., Kim, C., Kang, S., Shin, D., Kim, S., & Yoo, H.-J.
- Affiliations
- Korea Advanced Institute of Science and Technology (KR)
- Venue
- IEEE Journal of Solid-State Circuits
- Published
- 2019-01
- Volume
- 54
- Issue
- 1
- Pages
- 173-185
- ISSN
- 0018-9200 (ISSN-L)
- 1558-173X
- OpenAlex
- W2895531329
- Semantic Scholar
- e349760a79f4c2cc2041fb5582f617df593cc555
- Cited by
- 335
- References
- 39
- Citations by year
- 2026: 18 · 2025: 41 · 2024: 51 · 2023: 50 · 2022: 54 · 2021: 55 · 2020: 48 · 2019: 17
- FWCI
- 15.13
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Journal of Solid-State Circuits (publishedVersion)
- Funders
- National Research Foundation of Korea
- Ministry of Science, ICT and Future Planning (NRF-2015R1A2A1A05001889)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Low-power high-performance VLSI design
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Keywords
- deep neural network accelerators, energy efficiency, low-bit quantization, convolutional layers, mobile deep learning, power efficiency, low-voltage operation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.