The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Estimation of energy consumption in machine learning
Open accessAbstract
Energy consumption has been widely studied in the computer architecture field for decades. While the adoption of energy as a metric in machine learning is emerging, the majority of research is still primarily focused on obtaining high levels of accuracy without any computational constraint. We believe that one of the reasons for this lack of interest is due to their lack of familiarity with approaches to evaluate energy consumption. To address this challenge, we present a review of the different approaches to estimate energy consumption in general and machine learning applications in particular. Our goal is to provide useful guidelines to the machine learning community giving them the fundamental knowledge to use and build specific energy estimation methods for machine learning algorithms. We also present the latest software tools that give energy estimation values, together with two use cases that enhance the study of energy consumption in machine learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015
(2017) · Cited by 11,625
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Computer Architecture: A Quantitative Approach
Hennessy, J. L., & Patterson, D. A. (1989) · UCLA - Biblioteca de Ciencias y Tecnologia Felix Morales Bueno · Cited by 9,370
The proof and measurement of association between two things
Spearman, C. (1904) · The American Journal of Psychology · doi:10.2307/1412159 · Cited by 8,039
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
Iandola, F. N., Han, S., Moskewicz, M. W., Ashraf, K., Dally, W. J., & Keutzer, K. (2016) · arXiv · doi:10.48550/arxiv.1602.07360 · Cited by 6,201
In-Datacenter Performance Analysis of a Tensor Processing Unit
Jouppi, N. P., Young, C., Patil, N., Patterson, D., Agrawal, G., Bajwa, R., Bates, S., Bhatia, S., Boden, N., Borchers, A., et al. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080246 · Cited by 4,537
2008 IEEE Conference on Computer Vision and Pattern Recognition
(2008) · doi:10.1109/cvpr12618.2008 · Cited by 4,212
Computer architecture: a quantitative approach
Shute, M. (1993) · Microelectronics Journal · doi:10.1016/0026-2692(93)90111-q · Cited by 3,336
Eyeriss: An Energy-Efficient Reconfigurable Accelerator for Deep Convolutional Neural Networks
Chen, Y.-H., Krishna, T., Emer, J. S., & Sze, V. (2017) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2016.2616357 · Cited by 3,247
The SimpleScalar tool set, version 2.0
Burger, D., & Austin, T. M. (1997) · ACM SIGARCH Computer Architecture News · doi:10.1145/268806.268810 · Cited by 3,048
Wattch: a framework for architectural-level power analysis and optimizations
Brooks, D., Tiwari, V., & Martonosi, M. (2000) · Proceedings of the 27th annual international symposium on Computer architecture - ISCA '00 · doi:10.1145/339647.339657 · Cited by 2,578
Li, S., Ahn, J. H., Strong, R. D., Brockman, J. B., Tullsen, D. M., & Jouppi, N. P. (2009) · Proceedings of the 42nd Annual IEEE/ACM International Symposium on Microarchitecture · doi:10.1145/1669112.1669172 · Cited by 2,376
Mining high-speed data streams
Domingos, P., & Hulten, G. (2000) · Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/347090.347107 · Cited by 2,185
SPEC CPU2006 benchmark descriptions
Henning, J. L. (2006) · ACM SIGARCH Computer Architecture News · doi:10.1145/1186736.1186737 · Cited by 1,970
Mining time-changing data streams
Hulten, G., Spencer, L., & Domingos, P. (2001) · Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/502512.502529 · Cited by 1,748
Learning both Weights and Connections for Efficient Neural Networks
Han, S., Pool, J., Tran, J., & Dally, W. J. (2015) · arXiv · doi:10.48550/arxiv.1506.02626 · Cited by 1,481
In-Datacenter Performance Analysis of a Tensor Processing Unit
Jouppi, N. P., Young, C., Patil, N., Patterson, D., Agrawal, G., Bajwa, R., Bates, S., Bhatia, S., Boden, N., Borchers, A., et al. (2017) · ACM SIGARCH Computer Architecture News · doi:10.1145/3140659.3080246 · Cited by 1,240
BifetAlbert, HolmesGeoff, KirkbyRichard, & PfahringerBernhard (2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1859903 · Cited by 771
Designing Energy-Efficient Convolutional Neural Networks Using Energy-Aware Pruning
Yang, T.-J., Chen, Y.-H., & Sze, V. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.643 · Cited by 732
The Scalable Heterogeneous Computing (SHOC) benchmark suite
Danalis, A., Marin, G., McCurdy, C., Meredith, J. S., Roth, P. C., Spafford, K., Tipparaju, V., & Vetter, J. S. (2010) · Proceedings of the 3rd Workshop on General-Purpose Computation on Graphics Processing Units · doi:10.1145/1735688.1735702 · Cited by 671
RAPL: memory power estimation and capping
David, H., Gorbatov, E., Hanebutte, U. R., Khanna, R., & Le, C. (2010) · Proceedings of the 16th ACM/IEEE international symposium on Low power electronics and design · doi:10.1145/1840845.1840883 · Cited by 597
Adaptive Learning from Evolving Data Streams
Bifet, A., & Gavaldà, R. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-03915-7_22 · Cited by 486
Collecting Performance Data with PAPI-C
Terpstra, D., Jagode, H., You, H., & Dongarra, J. (2010) · Tools for High Performance Computing 2009 · doi:10.1007/978-3-642-11261-4_11 · Cited by 338
An Evaluation of High-Level Mechanistic Core Models
Carlson, T. E., Heirman, W., Eyerman, S., Hur, I., & Eeckhout, L. (2014) · ACM Transactions on Architecture and Code Optimization · doi:10.1145/2629677 · Cited by 334
Full-System Power Analysis and Modeling for Server Environments
Economou, D., Rivoire, S., Kozyrakis, C., & Ranganathan, P. (2006) · Cited by 317
Real time power estimation and thread scheduling via performance counters
Singh, K., Bhadauria, M., & McKee, S. A. (2009) · ACM SIGARCH Computer Architecture News · doi:10.1145/1577129.1577137 · Cited by 301
Power prediction for intel XScale® processors using performance monitoring unit events
Contreras, G., & Martonosi, M. (2005) · Proceedings of the 2005 international symposium on Low power electronics and design - ISLPED '05 · doi:10.1145/1077603.1077657 · Cited by 288
Measuring energy consumption for short code paths using RAPL
Hähnel, M., Döbel, B., Völp, M., & Härtig, H. (2012) · ACM SIGMETRICS Performance Evaluation Review · doi:10.1145/2425248.2425252 · Cited by 271
Run-time power estimation in high performance microprocessors
Joseph, R., & Martonosi, M. (2001) · Proceedings of the 2001 international symposium on Low power electronics and design - ISLPED '01 · doi:10.1145/383082.383119 · Cited by 248
Lane, N. D., Bhattacharya, S., Georgiev, P., Forlivesi, C., & Kawsar, F. (2015) · Proceedings of the 2015 International Workshop on Internet of Things towards Applications · doi:10.1145/2820975.2820980 · Cited by 228
Memory exploration for low power, embedded systems
Shiue, W.-T., & Chakrabarti, C. (1999) · Proceedings of the 36th annual ACM/IEEE Design Automation Conference · doi:10.1145/309847.309902 · Cited by 196
Decomposable and responsive power models for multicore processors using performance counters
Bertran, R., González, M., Martorell, X., Navarro, N., & Ayguadé, E. (2010) · ACM International Conference on Supercomputing (ICS) · doi:10.1145/1810085.1810108 · Cited by 162
Understanding GPU Power: A Survey of Profiling, Modeling, and Simulation Methods
Bridges, R. A., Imam, N., & Mintz, T. M. (2016) · ACM Computing Surveys · doi:10.1145/2962131 · Cited by 127
Modeling, Profiling, and Debugging the Energy Consumption of Mobile Devices
Hoque, M. A., Siekkinen, M., Khan, K. N., Xiao, Y., & Tarkoma, S. (2015) · ACM Computing Surveys · doi:10.1145/2840723 · Cited by 124
A Validation of DRAM RAPL Power Measurements
Desrochers, S., Paradis, C., & Weaver, V. M. (2016) · Proceedings of the Second International Symposium on Memory Systems · doi:10.1145/2989081.2989088 · Cited by 106
Accurate and Stable Run-Time Power Modeling for Mobile and Embedded CPUs
Walker, M. J. P., Diestelhorst, S., Hansson, A., Das, A. K., Yang, S., Al‐Hashimi, B. M., & Merrett, G. V. (2016) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2016.2562920 · Cited by 105
A Survey of Power and Energy Predictive Models in HPC Systems and Applications
O'Brien, K. M., Pietri, I., Manumachu, R. R., Lastovetsky, A., & Sakellariou, R. (2017) · ACM Computing Surveys · doi:10.1145/3078811 · Cited by 102
(1962) · Journal of the Franklin Institute · doi:10.1016/0016-0032(62)91111-0 · Cited by 90
2010 VLSI technology symposium
(2010) · Symposium on VLSI Technology · doi:10.1109/vlsit.2010.5556141 · Cited by 83
Energy Characterization and Instruction-Level Energy Model of Intel’s Xeon Phi Processor
Shao, Y. S., & Brooks, D. M. (2013) · Cited by 80
Proceedings of the 2002 international symposium on Low power electronics and design
De, V. K., Irwin, M. J., Verbauwhede, I. M. R., & Piguet, C. (2002) · Cited by 72
HyperPower: Power- and memory-constrained hyper-parameter optimization for neural networks
Stamoulis, D., Cai, E., Juan, D.-C., & Marculescu, D. (2018) · 2018 Design, Automation & Test in Europe Conference & Exhibition (DATE) · doi:10.23919/date.2018.8341973 · Cited by 67
Tools for High Performance Computing 2009
Müller, M. S., Nagel, W. E., Schulz, A., & Resch, M. M. (2010) · Springer eBooks · doi:10.1007/978-3-642-11261-4 · Cited by 67
Ahmad, R. W., Gani, A., Hamid, S. H. A., Xia, F., & Shiraz, M. (2015) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2015.09.002 · Cited by 60
System-level power estimation tool for embedded processor based platforms
Rethinagiri, S. K., Palomar, O., Atitallah, R. B., Niar, S., Ünsal, O., & Kestelman, A. C. (2014) · Rapid Simulation and Performance Evaluation: Methods and Tools · doi:10.1145/2555486.2555491 · Cited by 55
Low-power image recognition challenge
Gauen, K., Rangan, R., Mohan, A., Lu, Y.-H., Liu, W., & Berg, A. C. (2017) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/aspdac.2017.7858303 · Cited by 53
RAPL: Memory power estimation and capping
Mba, D., Gorbatov, Hanebutte, Khanna, & Le (2010) · Cited by 53
DeLight: Adding Energy Dimension To Deep Neural Networks
Rouhani, B. D., Mirhoseini, A., & Koushanfar, F. (2016) · International Symposium on Low Power Electronics and Design (ISLPED) · doi:10.1145/2934583.2934599 · Cited by 46
Identification of Energy Hotspots: A Case Study of the Very Fast Decision Tree
García-Martín, E., Lavesson, N., & Grahn, H. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-57186-7_21 · Cited by 28
Self-citationFine-grained energy profiling for deep convolutional neural networks on the Jetson TX1
Rodrigues, C. F., Riley, G. D., & Luján, M. (2017) · IEEE International Symposium on Workload Characterization · doi:10.1109/iiswc.2017.8167764 · Cited by 26
Self-citationRodrigues, C. F., Riley, G. D., & Luján, M. (2018) · Research Explorer (The University of Manchester) · doi:10.13140/rg.2.2.36489.54881 · Cited by 26
Self-citationTechniques to Measure, Model, and Manage Power
Goel, B., McKee, S. A., & Själander, M. (2012) · Advances in computers · doi:10.1016/b978-0-12-396528-8.00002-x · Cited by 22
How to Measure Energy Consumption in Machine Learning Algorithms
García-Martín, E., Lavesson, N., Grahn, H., Casalicchio, E., & Boeva, V. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-13453-2_20 · Cited by 22
Self-citationProceedings of the 2015 International Workshop on Internet of Things towards Applications
Xu, C., SenSys '15: The 13th ACM Conference on Embedded Network Sensor Systems 2015 Seoul South Korea, Association for Computing Machinery-Digital Library, ACM Special Interest Group on Computer Architecture, ACM Special Interest Group on Embedded Systems, ACM Special Interest Group on Data Communication, ACM Special Interest Group on Measurement and Evaluation, ACM Special Interest Group on Mobility of Systems, U., ACM Special Interest Group on Operating Systems, & SIGs, A. (2015) · doi:10.1145/2820975 · Cited by 12
Research works printed but not linked: 15
- Bellosa, 2003, Event-driven energy accounting for dynamic thermal management, vol. 22
- Brooks, 2003, New methodology for early-stage, microarchitecture-level power-performance analysis of microprocessors, IBM J. Res. Dev., 47, 653, 10.1147/rd.475.0653 · doi:10.1147/rd.475.0653
- E. Cai, D.-C. Juan, D. Stamoulis, D. Marculescu, NeuralPower: Predict and deploy energy-efficient convolutional neural networks, in: Asian Conference on Machine Learning, 2017, pp. 622–637.
- X. Dai, P. Zhang, B. Wu, H. Yin, F. Sun, Y. Wang, M. Dukhan, Y. Hu, Y. Wu, Y. Jia, et al. ChamNet: Towards efficient network design through platform-aware model adaptation, arXiv preprint arXiv:1812.08934, 2018. · DOI · Paper page
- S. Eranian, Perfmon2: a flexible performance monitoring interface for Linux, in: Proc. of the 2006 Ottawa Linux Symposium, 2006, pp. 269–288.
- B. Goel, S.A. McKee, A Methodology for modeling dynamic and static power consumption for multicore processors, in: IPDPS, 2016, pp. 273–282. · doi:10.1109/ipdps.2016.118
- S. Han, H. Mao, W.J. Dally, Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding, arXiv preprint arXiv:1510.00149, 2015. · arXiv
- Hill, 1993, Wisconsin architectural research tool set, ACM SIGARCH Comput. Archit. News, 21, 8, 10.1145/165496.165500 · doi:10.1145/165496.165500
- Kaxiras, 2008, Computer architecture techniques for power-efficiency, Synth. Lect. Comput. Archit., 3, 1
- Moudgill, 1999, Environment for PowerPC microarchitecture exploration, IEEE Micro, 19, 15, 10.1109/40.768496 · doi:10.1109/40.768496
- Nose, 2000, Analysis and future trend of short-circuit power, IEEE Trans. Comput.-Aided Des. Integr. Circuits Syst., 19, 1023, 10.1109/43.863642 · doi:10.1109/43.863642
- A. Samajdar, Y. Zhu, P. Whatmough, M. Mattina, T. Krishna, Scale-sim: Systolic CNN accelerator, arXiv preprint arXiv:1811.02883, 2018. · arXiv
- Sami, 2002, An instruction-level energy model for embedded VLIW architectures, IEEE Trans. Comput.-Aided Des. Integr. Circuits Syst., 21, 998, 10.1109/TCAD.2002.801105 · doi:10.1109/tcad.2002.801105
- Talarico, 2005, A new framework for power estimation of embedded systems, Computer, 71, 10.1109/MC.2005.39 · doi:10.1109/mc.2005.39
- M. Tan, B. Chen, R. Pang, V. Vasudevan, Q.V. Le, Mnasnet: Platform-aware neural architecture search for mobile, arXiv preprint arXiv:1807.11626, 2018. · DOI · Paper page
Cited by
The renewable energy role in the global energy Transformations
Hassan, Q., Viktor, P., J. Al-Musawi, T., Mahmood Ali, B., Algburi, S., Alzoubi, H. M., Khudhair Al-Jiboory, A., Zuhair Sameen, A., Salman, H. M., & Jaszczur, M. (2024) · Renewable Energy Focus · doi:10.1016/j.ref.2024.100545 · Cited by 1,692
RetractedCowls, J., Tsamados, A., Taddeo, M., & Floridi, L. (2023) · AI & SOCIETY · doi:10.1007/s00146-021-01294-x · Cited by 552
Cowls, J., Tsamados, A., Taddeo, M., & Floridi, L. (2021) · doi:10.2139/ssrn.3804983 · Cited by 552
The Computational Limits of Deep Learning
Thompson, N. C., Greenewald, K., Lee, K., & Manso, G. F. (2020) · arXiv · doi:10.48550/arxiv.2007.05558 · Cited by 538
The Ethics of Artificial Intelligence: Principles, Challenges, and Opportunities
Floridi, L. (2023) · doi:10.1093/oso/9780198883098.001.0001 · Cited by 507
Metadata
- Authors
- García-Martín, E., Rodrigues, C. F., Riley, G., & Grahn, H.
- Venue
- Journal of Parallel and Distributed Computing
- Publisher
- Elsevier BV
- Published
- 2019-12
- Volume
- 134
- Pages
- 75-88
- ISSN
- 0743-7315 (ISSN-L)
- OpenAlex
- W2969580338
- Cited by
- 558
- References
- 59
- FWCI
- 46.92
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- creativecommons.org/licenses/by-nc-nd/4.0/ (vor)
- Funders
- FP7 Research infrastructures
- Stiftelsen för Kunskaps- och Kompetensutveckling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.