CoChat

Applying Reinforcement Learning towards automating energy efficient virtual machine consolidation in cloud data centers

Shaw, Rachael, Howley, Enda, Barrett, Enda · 2022 · Information Systems
Cited by 112

The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.

Abstract

Abstract Energy awareness presents an immense challenge for cloud computing infrastructure and the development of next generation data centers. Virtual Machine (VM) consolidation is one technique that can be harnessed to reduce energy related costs and environmental sustainability issues of data centers. In recent times intelligent learning approaches have proven to be effective for managing resources in cloud data centers. In this paper we explore the application of Reinforcement Learning (RL) algorithms for the VM consolidation problem demonstrating their capacity to optimize the distribution of virtual machines across the data center for improved resource management. Determining efficient policies in dynamic environments can be a difficult task, however, the proposed RL approach learns optimal behaviour in the absence of complete knowledge due to its innate ability to reason under uncertainty. Using real workload data we provide a comparative analysis of popular RL algorithms including SARSA and Q-learning. Our empirical results demonstrate how our approach improves energy efficiency by 25% while also reducing service violations by 63% over the popular Power-Aware heuristic algorithm.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.is.2021.101722

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 1 references

Research works printed but not linked: 30

  1. Vasques, 2019, A review on energy efficiency and demand response with focus on small and medium data centers, Energy Effic., 1
  2. Avgerinou, 2017, Trends in data centre energy consumption under the european code of conduct for data centre energy efficiency, Energies, 10, 1470, 10.3390/en10101470 · DOI · Paper page
  3. Stryjak, 2019, The mobile economy 2019, GSMA Intell.
  4. Lee, 2012, Energy efficient utilisation of resources in cloud computing systems, J. Supercomput., 60, 268, 10.1007/s11227-010-0421-3 · DOI · Paper page
  5. Gong Chen, Wenbo He, Jie Liu, Suman Nath, Leonidas Rigas, Lin Xiao, Feng Zhao, Energy-aware server provisioning and load dispatching for connection-intensive internet services, in: Proceedings of the 5th USENIX Symposium on Networked Systems Design and Implementation, 2008, pp. 337–350.
  6. Rahmanian, 2018, A learning automata-based ensemble resource usage prediction algorithm for cloud computing environment, Future Gener. Comput. Syst., 79, 55, 10.1016/j.future.2017.09.049 · DOI
  7. Farahnakian, 2016, Energy-aware vm consolidation in cloud data centers using utilisation prediction model, IEEE Trans. Cloud Comput.
  8. Ahmad, 2015, A survey on virtual machine migration and server consolidation frameworks for cloud data centers, J. Netw. Comput. Appl., 52, 11, 10.1016/j.jnca.2015.02.002 · DOI · Paper page
  9. Silva Filho, 2018, Approaches for optimizing virtual machine placement and migration in cloud environments: A survey, J. Parallel Distrib. Comput., 111, 220
  10. Beloglazov, 2012, Energy-aware resource allocation heuristics for efficient management of data centers for cloud computing, Future Gener. Comput. Syst., 28, 755, 10.1016/j.future.2011.04.017 · DOI · Paper page
  11. Beloglazov, 2012, Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in cloud data centers, Concurr. Comput.: Pract. Exper., 24, 1397, 10.1002/cpe.1867 · DOI · Paper page
  12. Chen, 2018, Improving resource utilization via virtual machine placement in data center networks, Mob. Netw. Appl., 23, 227, 10.1007/s11036-017-0925-7 · doi:10.1007/s11036-017-0925-7
  13. Fu, 2017, Predicted affinity based virtual machine placement in cloud computing environments, IEEE Trans. Cloud Comput.
  14. Duggan, 2019, A multitime steps ahead prediction approach for scheduling live migration in cloud data centers, Softw. - Pract. Exp., 49, 617, 10.1002/spe.2635 · DOI
  15. Hicham, 2017, Comparative study of neural networks algorithms for cloud computing CPU scheduling, Int. J. Electr. Comput. Eng. (IJECE), 7, 3570, 10.11591/ijece.v7i6.pp3570-3577 · DOI
  16. Khalil, 2019, Economic LSTM approach for recurrent neural networks, IEEE Trans. Circuits Syst. II: Express Briefs, 66, 1885
  17. A. Verma, P. Ahuja, A. Neogi, pMapper: power and migration cost aware application placement in virtualized systems, in: Proc. the 9th ACM/IFIP/USENIX International Conference on Middleware, 2008, pp. 243–264. · DOI · Paper page
  18. Beloglazov, 2012, Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in cloud data centers, Concurr. Comput.: Pract. Exper., 24, 1397, 10.1002/cpe.1867 · DOI · Paper page
  19. Beloglazov, 2012, Energy-aware resource allocation heuristics for efficient management of data centers for cloud computing, Future Gener. Comput. Syst., 28, 755, 10.1016/j.future.2011.04.017 · DOI · Paper page
  20. Nguyen, 2017, Virtual machine consolidation with multiple usage prediction for energy-efficient cloud data centers, IEEE Trans. Serv. Comput.
  21. Shaw, 2019, An energy efficient anti-correlated virtual machine placement algorithm using resource usage predictions, Simul. Model. Pract. Theory, 10.1016/j.simpat.2018.09.019 · DOI
  22. Duggan, 2017, A network aware approach for the scheduling of virtual machine migration during peak loads, Cluster Comput., 20, 2083, 10.1007/s10586-017-0948-7 · DOI
  23. Jia Rao, Xiangping Bu, Cheng-Zhong Xu, Leyi Wang, George Yin, VCONF: a reinforcement learning approach to virtual machines auto-configuration, in: Proceedings of the 6th International Conference on Autonomic Computing, 2009, pp. 137–146. · DOI · Paper page
  24. Rajarshi Das, Jeffrey O. Kephart, Charles Lefurgy, Gerald Tesauro, David W. Levine, Hoi Chan, VCONF: Autonomic multi-agent management of power and performance in data centers, in: Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent Systems: Industrial Track, 2008, pp. 107–114.
  25. Xavier Dutreilh, Sergey Kirgizov, Olga Melekhova, Jacques Malenfant, Nicolas Rivierre, Isis Truck, Using reinforcement learning for autonomic resource allocation in clouds: towards a fully automated workflow, in: ICAS 2011, The Seventh International Conference on Autonomic and Autonomous Systems, 2011, pp. 67–74.
  26. Wiering, 2012, Reinforcement learning, 3, 10.1007/978-3-642-27645-3 · DOI · Paper page
  27. Barrett, 2013, Applying reinforcement learning towards automating resource allocation and application scalability in the cloud, Concurr. Comput.: Pract. Exper., 25, 1656, 10.1002/cpe.2864 · DOI · Paper page
  28. Patrick Mannion, Jim Duggan, Enda Howley, Parallel learning using heterogeneous agents, in: Proceedings of the Adaptive and Learning Agents workshop (at AAMAS 2015), 2015.
  29. Patrick Mannion, Jim Duggan, Enda Howley, Learning traffic signal control with advice, in: Proceedings of the Adaptive and Learning Agents workshop (at AAMAS 2015), 2015.
  30. Mannion, 2015, An experimental review of reinforcement learning algorithms for adaptive traffic signal control

Cited by

See all 112

Metadata

Authors
Shaw, R., Howley, E., & Barrett, E.
Venue
Information Systems
Publisher
Elsevier BV
Published
2022-07
Volume
107
Pages
101722
ISSN
0306-4379 (ISSN-L)
OpenAlex
W3125245221
Cited by
112
References
1
FWCI
18.24
Type
journal article
Language
en
Open access
closed
Funders
Irish Research Council

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Applying Reinforcement Learning towards automating energy efficient virtual machine consolidation in cloud data centers. https://app.cochat.ai/papers/10.1016/j.is.2021.101722
The paper
Shaw, R., Howley, E., & Barrett, E. (2022). Applying Reinforcement Learning towards automating energy efficient virtual machine consolidation in cloud data centers. Information Systems. https://doi.org/10.1016/j.is.2021.101722

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.