DeLight: Adding Energy Dimension To Deep Neural Networks
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Physical viability, in particular energy efficiency, is a key challenge in realizing the true potential of Deep Neural Networks (DNNs). In this paper, we aim to incorporate the energy dimension as a design parameter in the higher-level hierarchy of DNN training and execution to optimize for the energy resources and constraints. We use energy characterization to bound the network size in accordance to the pertinent physical resources. An automated customization methodology is proposed to adaptively conform the DNN configurations to the underlying hardware characteristics while minimally affecting the inference accuracy. The key to our approach is a new context and resource aware projection of data to a lower-dimensional embedding by which learning the correlation between data samples requires significantly smaller number of neurons. We leverage the performance gain achieved as a result of the data projection to enable the training of different DNN architectures which can be aggregated together to further boost the inference accuracy. Accompanying APIs are provided to facilitate rapid prototyping of an arbitrary DNN application customized to the underlying platform. Proof-of-concept evaluations for deployment of different visual, audio, and smart-sensing benchmarks demonstrate up to 100-fold energy improvement compared to the prior-art DL solutions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Deep Learning: Methods and Applications
Deng, L., & Yu, D. (2014) · Foundations and Trends® in Signal Processing · doi:10.1561/2000000039 · Cited by 3,480 · cited 1×
“Deep Neural Networks (DNNs) and Convolutional Neural Networks (CNNs) are the two main topologies widely used in deep learning domain [9].”
BackgroundRecent advances in deep learning for speech research at Microsoft
Deng, L., Li, J., Huang, J.-T., Yao, K., Yu, D., Seide, F., Seltzer, M., Zweig, G., He, X., Williams, J., et al. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639345 · Cited by 801 · cited 1×
“The existing DNN realizations for resource-limited platforms are mostly cloud-based models that provide, for example, speech and object recognition in mobile commercial services [3].”
Background
Cited by
Estimation of energy consumption in machine learning
García-Martín, E., Rodrigues, C. F., Riley, G., & Grahn, H. (2019) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2019.07.007 · Cited by 558
A systematic review of Green AI
Verdecchia, R., Sallou, J., & Cruz, L. (2023) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1507 · Cited by 375
A Survey on optimized implementation of deep learning models on the NVIDIA Jetson platform
Mittal, S. (2019) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2019.01.011 · Cited by 294
HyperPower: Power- and memory-constrained hyper-parameter optimization for neural networks
Stamoulis, D., Cai, E., Juan, D.-C., & Marculescu, D. (2018) · 2018 Design, Automation & Test in Europe Conference & Exhibition (DATE) · doi:10.23919/date.2018.8341973 · Cited by 67
Designing adaptive neural networks for energy-constrained image classification
Stamoulis, D., Chin, T.-W. (., Prakash, A. K., Fang, H., Sajja, S., Bognar, M., & Marculescu, D. (2018) · Proceedings of the International Conference on Computer-Aided Design · doi:10.1145/3240765.3240796 · Cited by 63
Metadata
- Authors
- Rouhani, B. D., Mirhoseini, A., & Koushanfar, F.
- Venue
- Proceedings of the 2016 International Symposium on Low Power Electronics and Design
- Publisher
- ACM
- Published
- 2016-08-08
- Pages
- 112-117
- OpenAlex
- W2488255893
- Cited by
- 43
- References
- 3
- FWCI
- 2.11
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: DeLight: Adding Energy Dimension To Deep Neural Networks. https://app.cochat.ai/papers/10.1145/2934583.2934599
- The paper
- Rouhani, B. D., Mirhoseini, A., & Koushanfar, F. (2016). DeLight: Adding Energy Dimension To Deep Neural Networks. Proceedings of the 2016 International Symposium on Low Power Electronics and Design. https://doi.org/10.1145/2934583.2934599
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.