The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Estimation of energy consumption in machine learning
Open accessAbstract
Energy consumption has been widely studied in the computer architecture field for decades. While the adoption of energy as a metric in machine learning is emerging, the majority of research is still primarily focused on obtaining high levels of accuracy without any computational constraint. We believe that one of the reasons for this lack of interest is due to their lack of familiarity with approaches to evaluate energy consumption. To address this challenge, we present a review of the different approaches to estimate energy consumption in general and machine learning applications in particular. Our goal is to provide useful guidelines to the machine learning community giving them the fundamental knowledge to use and build specific energy estimation methods for machine learning algorithms. We also present the latest software tools that give energy estimation values, together with two use cases that enhance the study of energy consumption in machine learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015
(2017) · Cited by 11,625
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Computer Architecture: A Quantitative Approach
Hennessy, J. L., & Patterson, D. A. (1989) · UCLA - Biblioteca de Ciencias y Tecnologia Felix Morales Bueno · Cited by 9,375
The proof and measurement of association between two things
Spearman, C. (1904) · The American Journal of Psychology · doi:10.2307/1412159 · Cited by 8,039
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
Iandola, F. N., Han, S., Moskewicz, M. W., Ashraf, K., Dally, W. J., & Keutzer, K. (2016) · arXiv · doi:10.48550/arxiv.1602.07360 · Cited by 6,201
In-Datacenter Performance Analysis of a Tensor Processing Unit
Jouppi, N. P., Young, C., Patil, N., Patterson, D., Agrawal, G., Bajwa, R., Bates, S., Bhatia, S., Boden, N., Borchers, A., et al. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080246 · Cited by 4,537
2008 IEEE Conference on Computer Vision and Pattern Recognition
(2008) · doi:10.1109/cvpr12618.2008 · Cited by 4,212
Research works printed but not linked: 15
- Bellosa, 2003, Event-driven energy accounting for dynamic thermal management, vol. 22
- Brooks, 2003, New methodology for early-stage, microarchitecture-level power-performance analysis of microprocessors, IBM J. Res. Dev., 47, 653, 10.1147/rd.475.0653 · doi:10.1147/rd.475.0653
- E. Cai, D.-C. Juan, D. Stamoulis, D. Marculescu, NeuralPower: Predict and deploy energy-efficient convolutional neural networks, in: Asian Conference on Machine Learning, 2017, pp. 622–637.
- X. Dai, P. Zhang, B. Wu, H. Yin, F. Sun, Y. Wang, M. Dukhan, Y. Hu, Y. Wu, Y. Jia, et al. ChamNet: Towards efficient network design through platform-aware model adaptation, arXiv preprint arXiv:1812.08934, 2018. · DOI · Paper page
- S. Eranian, Perfmon2: a flexible performance monitoring interface for Linux, in: Proc. of the 2006 Ottawa Linux Symposium, 2006, pp. 269–288.
- B. Goel, S.A. McKee, A Methodology for modeling dynamic and static power consumption for multicore processors, in: IPDPS, 2016, pp. 273–282. · doi:10.1109/ipdps.2016.118
- S. Han, H. Mao, W.J. Dally, Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding, arXiv preprint arXiv:1510.00149, 2015. · arXiv
- Hill, 1993, Wisconsin architectural research tool set, ACM SIGARCH Comput. Archit. News, 21, 8, 10.1145/165496.165500 · doi:10.1145/165496.165500
- Kaxiras, 2008, Computer architecture techniques for power-efficiency, Synth. Lect. Comput. Archit., 3, 1
- Moudgill, 1999, Environment for PowerPC microarchitecture exploration, IEEE Micro, 19, 15, 10.1109/40.768496 · doi:10.1109/40.768496
- Nose, 2000, Analysis and future trend of short-circuit power, IEEE Trans. Comput.-Aided Des. Integr. Circuits Syst., 19, 1023, 10.1109/43.863642 · doi:10.1109/43.863642
- A. Samajdar, Y. Zhu, P. Whatmough, M. Mattina, T. Krishna, Scale-sim: Systolic CNN accelerator, arXiv preprint arXiv:1811.02883, 2018. · arXiv
- Sami, 2002, An instruction-level energy model for embedded VLIW architectures, IEEE Trans. Comput.-Aided Des. Integr. Circuits Syst., 21, 998, 10.1109/TCAD.2002.801105 · doi:10.1109/tcad.2002.801105
- Talarico, 2005, A new framework for power estimation of embedded systems, Computer, 71, 10.1109/MC.2005.39 · doi:10.1109/mc.2005.39
- M. Tan, B. Chen, R. Pang, V. Vasudevan, Q.V. Le, Mnasnet: Platform-aware neural architecture search for mobile, arXiv preprint arXiv:1807.11626, 2018. · DOI · Paper page
Cited by
The renewable energy role in the global energy Transformations
Hassan, Q., Viktor, P., J. Al-Musawi, T., Mahmood Ali, B., Algburi, S., Alzoubi, H. M., Khudhair Al-Jiboory, A., Zuhair Sameen, A., Salman, H. M., & Jaszczur, M. (2024) · Renewable Energy Focus · doi:10.1016/j.ref.2024.100545 · Cited by 1,692
RetractedCowls, J., Tsamados, A., Taddeo, M., & Floridi, L. (2023) · AI & SOCIETY · doi:10.1007/s00146-021-01294-x · Cited by 552
Cowls, J., Tsamados, A., Taddeo, M., & Floridi, L. (2021) · doi:10.2139/ssrn.3804983 · Cited by 552
The Computational Limits of Deep Learning
Thompson, N. C., Greenewald, K., Lee, K., & Manso, G. F. (2020) · arXiv · doi:10.48550/arxiv.2007.05558 · Cited by 538
The Ethics of Artificial Intelligence: Principles, Challenges, and Opportunities
Floridi, L. (2023) · doi:10.1093/oso/9780198883098.001.0001 · Cited by 507
The Computational Limits of Deep Learning
Thompson, N., Greenewald, K., Lee, K., & Manso, G. F. (2023) · Ninth Computing within Limits 2023 · doi:10.21428/bf6fb269.1f033948 · Cited by 495
Artificial intelligence, systemic risks, and sustainability
Galaz, V., Centeno, M. A., Callahan, P. W., Causevic, A., Patterson, T., Brass, I., Baum, S., Farber, D., Fischer, J., Garcia, D., et al. (2021) · Technology in Society · doi:10.1016/j.techsoc.2021.101741 · Cited by 497
A systematic review of Green AI
Verdecchia, R., Sallou, J., & Cruz, L. (2023) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1507 · Cited by 375
Digital innovations for sustainable and resilient agricultural systems
Finger, R. (2023) · European Review of Agricultural Economics · doi:10.1093/erae/jbad021 · Cited by 304
Trustworthy ai: A computational perspective
Liu, H., Wang, Y., Fan, W., Liu, X., Li, Y., Jain, S., Liu, Y., Jain, A., & Tang, J. (2023) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3546872 · Cited by 261
Lead federated neuromorphic learning for wireless edge artificial intelligence
Yang, H., Lam, K.-Y., Xiao, L., Xiong, Z., Hu, H., Niyato, D., & Vincent Poor, H. (2022) · Nature Communications · doi:10.1038/s41467-022-32020-w · Cited by 127
Sponge Examples: Energy-Latency Attacks on Neural Networks
Shumailov, I., Zhao, Y., Bates, D., Papernot, N., Mullins, R., & Anderson, R. (2021) · 2021 IEEE European Symposium on Security and Privacy (EuroS&P) · doi:10.1109/eurosp51992.2021.00024 · Cited by 125
A reimbursement framework for artificial intelligence in healthcare
Abràmoff, M. D., Roehrenbeck, C., Trujillo, S., Goldstein, J., Graves, A. S., Repka, M. X., & Silva III, E. “. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00621-w · Cited by 117
Green AI: do deep learning frameworks have different costs?
Georgiou, S., Kechagia, M., Sharma, T., Sarro, F., & Zou, Y. (2022) · Proceedings of the 44th International Conference on Software Engineering · doi:10.1145/3510003.3510221 · Cited by 102
Potential reduction in healthcare carbon footprint by autonomous artificial intelligence
Wolf, R. M., Abramoff, M. D., Channa, R., Tava, C., Clarida, W., & Lehmann, H. P. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00605-w · Cited by 63
“The training of a single AI system may create up to 5 × 10 8 g CO 2 -eq emissions 28 , though inference — the calculation of a single output — may be only a fraction thereof 29 , and newer AI algorithms have shown improved GHG emission ef fi ciency 30 .”
BackgroundCicceri, G., Tricomi, G., D’Agati, L., Longo, F., Merlino, G., & Puliafito, A. (2023) · Sensors · doi:10.3390/s23094549 · Cited by 58
More than Extraction: Rethinking Data's Colonial Political Economy
Gray, C. (2023) · International Political Sociology · doi:10.1093/ips/olad007 · Cited by 48
Light Residual Network for Human Activity Recognition using Wearable Sensor Data
Calatrava-Nicolás, F. M., & Mozos, O. M. (2023) · IEEE Sensors Letters · doi:10.1109/lsens.2023.3311623 · Cited by 22
A Unified Framework for Assessing Energy Efficiency of Machine Learning
Fischer, R., Jakobs, M., Mücke, S., & Morik, K. (2023) · Communications in Computer and Information Science · doi:10.1007/978-3-031-23618-1_3 · Cited by 16
Does Machine Understanding Require Consciousness?
Pepperell, R. (2022) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2022.788486 · Cited by 11
Metadata
- Authors
- García-Martín, E., Rodrigues, C. F., Riley, G., & Grahn, H.
- Venue
- Journal of Parallel and Distributed Computing
- Publisher
- Elsevier BV
- Published
- 2019-12
- Volume
- 134
- Pages
- 75-88
- ISSN
- 0743-7315 (ISSN-L)
- OpenAlex
- W2969580338
- Cited by
- 558
- References
- 59
- FWCI
- 46.92
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- creativecommons.org/licenses/by-nc-nd/4.0/ (vor)
- Funders
- FP7 Research infrastructures
- Stiftelsen för Kunskaps- och Kompetensutveckling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.