Big/little deep neural network for ultra low power inference
The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
Deep neural networks (DNNs) have recently proved their effectiveness in complex data analyses such as object/speech recognition. As their applications are being expanded to mobile devices, their energy efficiencies are becoming critical. In this paper, we propose a novel concept called big/LITTLE DNN (BL-DNN) which significantly reduces energy consumption required for DNN execution at a negligible loss of inference accuracy. The BL-DNN consists of a little DNN (consuming low energy) and a full-fledged big DNN. In order to reduce energy consumption, the BL-DNN aims at avoiding the execution of the big DNN whenever possible. The key idea for this goal is to execute the little DNN first for inference (without big DNN execution) and simply use its result as the final inference result as long as the result is estimated to be accurate. On the other hand, if the result from the little DNN is not considered to be accurate, the big DNN is executed to give the final inference result. This approach reduces the total energy consumption by obtaining the inference result only with the little, energy-efficient DNN in most cases, while maintaining the similar level of inference accuracy through selectively utilizing the big DNN execution. We present design-time and runtime methods to control the execution of big DNN under a trade-off between energy consumption and inference accuracy. Experiments with state-of-the-art DNNs for ImageNet and MNIST show that our proposed BL-DNN can offer up to 5…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
DeepFace: Closing the Gap to Human-Level Performance in Face Verification
Taigman, Y., Yang, M., Ranzato, M., & Wolf, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.220 · Cited by 6,542
CNN Features Off-the-Shelf: An Astounding Baseline for Recognition
Razavian, A. S., Azizpour, H., Sullivan, J., & Carlsson, S. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2014.131 · Cited by 4,451
Return of the Devil in the Details: Delving Deep into Convolutional Nets
Chatfield, K., Simonyan, K., Vedaldi, A., & Zisserman, A. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.6 · Cited by 3,335
ImageNet: A large-scale hierarchical image database
Deng, J. H., Dong, W. F., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206848 · Cited by 2,714
OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks
Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., & LeCun, Y. (2013) · arXiv · doi:10.48550/arxiv.1312.6229 · Cited by 2,680 · cited 2×
“Big/Little Deep Neural Network for Ultra Low Power Inference Eunhyeok Park1 canusglow@gmail.com Dongyoung Kim1 dongyoung42@gmail.com Soobeom Kim1 Soobeom15@gmail.com Yong-Deok Kim2 yd.mlg.kim@samsung.com Gunhee Kim3 gunhee@snu.ac.kr Sungroh Yoon4 sryoon@snu.ac.kr Sungjoo Yoo1 sungjoo.yoo@gmail.com Computing Memory Arc…”
BackgroundOptimizing FPGA-based Accelerator Design for Deep Convolutional Neural Networks
Zhang, C., Li, P., Sun, G., Guan, Y., Xiao, B., & Cong, J. (2015) · Proceedings of the 2015 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays · doi:10.1145/2684746.2689060 · Cited by 2,158 · cited 6×
“We adopted a tile-based architecture in [10, 32] and ran maximum 512 neurons in parallel.”
BackgroundMethodInfluentialDaDianNao: A Machine-Learning Supercomputer
Chen, Y., Luo, T., Liu, S., Zhang, S., He, L., Wang, J., Li, L., Chen, T., Xu, Z., Sun, N., et al. (2014) · 2014 47th Annual IEEE/ACM International Symposium on Microarchitecture · doi:10.1109/micro.2014.58 · Cited by 1,492
Deep Convolutional Network Cascade for Facial Point Detection
Sun, Y., Wang, X., & Tang, X. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.446 · Cited by 1,382
DianNao: a small-footprint high-throughput accelerator for ubiquitous machine-learning
Chen, T., Du, Z., Sun, N., Wang, J., Wu, C., Chen, Y., & Temam, O. (2014) · Proceedings of the 19th international conference on Architectural support for programming languages and operating systems · doi:10.1145/2541940.2541967 · Cited by 1,297
A survey of multiple classifier systems as hybrid systems
Woźniak, M., Graña, M., & Corchado, E. (2014) · Information Fusion · doi:10.1016/j.inffus.2013.04.006 · Cited by 912
DRAMSim2: A Cycle Accurate Memory System Simulator
Rosenfeld, P., Cooper-Balis, E., & Jacob, B. (2011) · IEEE Computer Architecture Letters · doi:10.1109/l-ca.2011.4 · Cited by 908
Low-Power Digital Signal Processing Using Approximate Adders
Gupta, V., Mohapatra, D., Raghunathan, A., & Roy, K. (2013) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2012.2217962 · Cited by 845
Domain Adaptation for Statistical Classifiers
Daume III, H., & Marcu, D. (2006) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1872 · Cited by 816
Extensive Facial Landmark Localization with Coarse-to-Fine Convolutional Network Cascade
Zhou, E., Fan, H., Cao, Z., Jiang, Y., & Yin, Q. (2013) · 2013 IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2013.58 · Cited by 356
A dynamically configurable coprocessor for convolutional neural networks
Chakradhar, S., Sankaradas, M., Jakkula, V., & Cadambi, S. (2010) · Proceedings of the 37th annual international symposium on Computer architecture · doi:10.1145/1815961.1815993 · Cited by 343
Memory-centric accelerator design for Convolutional Neural Networks
Peemen, M., Setio, A. A. A., Mesman, B., & Corporaal, H. (2013) · 2013 IEEE 31st International Conference on Computer Design (ICCD) · doi:10.1109/iccd.2013.6657019 · Cited by 332
AxNN: energy-efficient neuromorphic systems using approximate computing
Venkataramani, S., Ranjan, A., Roy, K., & Raghunathan, A. (2014) · Proceedings of the 2014 international symposium on Low power electronics and design · doi:10.1145/2627369.2627613 · Cited by 261
On reconfiguration-oriented approximate adder design and its application
Ye, R., Wang, T., Yuan, F., Kumar, R., & Xu, Q. (2013) · 2013 IEEE/ACM International Conference on Computer-Aided Design (ICCAD) · doi:10.1109/iccad.2013.6691096 · Cited by 209
ApproxANN: An Approximate Computing Framework for Artificial Neural Network
Zhang, Q., Wang, T., Tian, Y., Yuan, F., & Xu, Q. (2015) · Design, Automation & Test in Europe Conference & Exhibition (DATE), 2015 · doi:10.7873/date.2015.0618 · Cited by 158
Du, Z., Lingamneni, A., Chen, Y., Palem, K., Temam, O., & Wu, C. (2014) · 2014 19th Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/aspdac.2014.6742890 · Cited by 114
Scalable-effort classifiers for energy-efficient machine learning
Venkataramani, S., Raghunathan, A., Liu, J., & Shoaib, M. (2015) · Proceedings of the 52nd Annual Design Automation Conference · doi:10.1145/2744769.2744904 · Cited by 107
NeuFlow: Dataflow vision processing system-on-a-chip
Pham, P.-H., Jelaca, D., Farabet, C., Martini, B., LeCun, Y., & Culurciello, E. (2012) · 2012 IEEE 55th International Midwest Symposium on Circuits and Systems (MWSCAS) · doi:10.1109/mwscas.2012.6292202 · Cited by 86
Serial Combination of Multiple Experts: A Unified Evaluation
Rahman, F., & Fairhurst, M. C. (1999) · Pattern Analysis and Applications · doi:10.1007/s100440050038 · Cited by 45
Yoo, H., Park, S., Bong, K., Shin, D., Lee, J., & Choi, S. (2015) · Cited by 40
Termenón, M., & Graña, M. (2011) · Neural Processing Letters · doi:10.1007/s11063-011-9200-2 · Cited by 34
Gehlhaar, J. (2014) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/2541940.2564710 · Cited by 23
Lee, Y., Choi, Y., Lee, M., et al. (2009) · EURASIP Journal on Embedded Systems · doi:10.1155/2009/258921 · Cited by 15
Research works printed but not linked: 2
- park, 2015, 93TOPS/W scalable deep learning/inference processor with tetra-parallel MIMD architecture for big-data applications, Proc Int l Solid-States Circuits Conf (ISSCC)
- 0, DDR3 SDRAM System-Power Calculator
Cited by
Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing
Zhou, Z., Chen, X., Li, E., Zeng, L., Luo, K., & Zhang, J. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2918951 · Cited by 2,455
“[102] propose a big/little DNN model selection framework.”
BackgroundDynamic Neural Networks: A Survey
Han, Y., Huang, G., Song, S., Yang, L., Wang, H., & Wang, Y. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3117837 · Cited by 848
Efficient Acceleration of Deep Learning Inference on Resource-Constrained Edge Devices: A Review
Shuvo, M. M. H., Islam, S. K., Cheng, J., & Morshed, B. I. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2022.3226481 · Cited by 436
“Two DL models of different sizes (big and little) can be used for classification during inference [210].”
MethodAutonomous Vehicles Enabled by the Integration of IoT, Edge Intelligence, 5G, and Blockchain
Biswas, A., & Wang, H.-C. (2023) · Sensors · doi:10.3390/s23041963 · Cited by 274
Designing adaptive neural networks for energy-constrained image classification
Stamoulis, D., Chin, T.-W. (., Prakash, A. K., Fang, H., Sajja, S., Bognar, M., & Marculescu, D. (2018) · Proceedings of the International Conference on Computer-Aided Design · doi:10.1145/3240765.3240796 · Cited by 63
Metadata
- Authors
- Park, E., Kim, D., Kim, S., Kim, Y.-D., Kim, G., Yoon, S., & Yoo, S.
- Affiliations
- Seoul National University (KR)
- Samsung (South Korea) (KR)
- Venue
- 2015 International Conference on Hardware/Software Codesign and System Synthesis (CODES+ISSS)
- Publisher
- IEEE
- Published
- 2015-10
- Pages
- 124-132
- OpenAlex
- W4243928383
- Cited by
- 130
- References
- 35
- Citations by year
- 2026: 3 · 2025: 5 · 2024: 19 · 2023: 19 · 2022: 22 · 2021: 21 · 2020: 15 · 2019: 12 · 2018: 6 · 2017: 3 · 2016: 5
- FWCI
- 1.90
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Hardware/Software Codesign and System Synthesis (publishedVersion)
- Seoul National University Open Repository (Seoul National University) (submittedVersion)
- International Conference on Hardware/Software Codesign and System Synthesis
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Low-power high-performance VLSI design
- Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques
- Keywords
- deep neural network inference, ultra-low power, energy efficiency, energy-accuracy trade-off, mobile devices, image classification, handwritten digit recognition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.