Applying Reinforcement Learning towards automating energy efficient virtual machine consolidation in cloud data centers
The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
Abstract Energy awareness presents an immense challenge for cloud computing infrastructure and the development of next generation data centers. Virtual Machine (VM) consolidation is one technique that can be harnessed to reduce energy related costs and environmental sustainability issues of data centers. In recent times intelligent learning approaches have proven to be effective for managing resources in cloud data centers. In this paper we explore the application of Reinforcement Learning (RL) algorithms for the VM consolidation problem demonstrating their capacity to optimize the distribution of virtual machines across the data center for improved resource management. Determining efficient policies in dynamic environments can be a difficult task, however, the proposed RL approach learns optimal behaviour in the absence of complete knowledge due to its innate ability to reason under uncertainty. Using real workload data we provide a comparative analysis of popular RL algorithms including SARSA and Q-learning. Our empirical results demonstrate how our approach improves energy efficiency by 25% while also reducing service violations by 63% over the popular Power-Aware heuristic algorithm.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
On Global Electricity Usage of Communication Technology: Trends to 2030
Andrae, A., & Edler, T. (2015) · Challenges · doi:10.3390/challe6010117 · Cited by 1,334
Research works printed but not linked: 30
- Vasques, 2019, A review on energy efficiency and demand response with focus on small and medium data centers, Energy Effic., 1
- Avgerinou, 2017, Trends in data centre energy consumption under the european code of conduct for data centre energy efficiency, Energies, 10, 1470, 10.3390/en10101470 · DOI · Paper page
- Stryjak, 2019, The mobile economy 2019, GSMA Intell.
- Lee, 2012, Energy efficient utilisation of resources in cloud computing systems, J. Supercomput., 60, 268, 10.1007/s11227-010-0421-3 · DOI · Paper page
- Gong Chen, Wenbo He, Jie Liu, Suman Nath, Leonidas Rigas, Lin Xiao, Feng Zhao, Energy-aware server provisioning and load dispatching for connection-intensive internet services, in: Proceedings of the 5th USENIX Symposium on Networked Systems Design and Implementation, 2008, pp. 337–350.
- Rahmanian, 2018, A learning automata-based ensemble resource usage prediction algorithm for cloud computing environment, Future Gener. Comput. Syst., 79, 55, 10.1016/j.future.2017.09.049 · DOI
- Farahnakian, 2016, Energy-aware vm consolidation in cloud data centers using utilisation prediction model, IEEE Trans. Cloud Comput.
- Ahmad, 2015, A survey on virtual machine migration and server consolidation frameworks for cloud data centers, J. Netw. Comput. Appl., 52, 11, 10.1016/j.jnca.2015.02.002 · DOI · Paper page
- Silva Filho, 2018, Approaches for optimizing virtual machine placement and migration in cloud environments: A survey, J. Parallel Distrib. Comput., 111, 220
- Beloglazov, 2012, Energy-aware resource allocation heuristics for efficient management of data centers for cloud computing, Future Gener. Comput. Syst., 28, 755, 10.1016/j.future.2011.04.017 · DOI · Paper page
- Beloglazov, 2012, Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in cloud data centers, Concurr. Comput.: Pract. Exper., 24, 1397, 10.1002/cpe.1867 · DOI · Paper page
- Chen, 2018, Improving resource utilization via virtual machine placement in data center networks, Mob. Netw. Appl., 23, 227, 10.1007/s11036-017-0925-7 · doi:10.1007/s11036-017-0925-7
- Fu, 2017, Predicted affinity based virtual machine placement in cloud computing environments, IEEE Trans. Cloud Comput.
- Duggan, 2019, A multitime steps ahead prediction approach for scheduling live migration in cloud data centers, Softw. - Pract. Exp., 49, 617, 10.1002/spe.2635 · DOI
- Hicham, 2017, Comparative study of neural networks algorithms for cloud computing CPU scheduling, Int. J. Electr. Comput. Eng. (IJECE), 7, 3570, 10.11591/ijece.v7i6.pp3570-3577 · DOI
- Khalil, 2019, Economic LSTM approach for recurrent neural networks, IEEE Trans. Circuits Syst. II: Express Briefs, 66, 1885
- A. Verma, P. Ahuja, A. Neogi, pMapper: power and migration cost aware application placement in virtualized systems, in: Proc. the 9th ACM/IFIP/USENIX International Conference on Middleware, 2008, pp. 243–264. · DOI · Paper page
- Beloglazov, 2012, Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in cloud data centers, Concurr. Comput.: Pract. Exper., 24, 1397, 10.1002/cpe.1867 · DOI · Paper page
- Beloglazov, 2012, Energy-aware resource allocation heuristics for efficient management of data centers for cloud computing, Future Gener. Comput. Syst., 28, 755, 10.1016/j.future.2011.04.017 · DOI · Paper page
- Nguyen, 2017, Virtual machine consolidation with multiple usage prediction for energy-efficient cloud data centers, IEEE Trans. Serv. Comput.
- Shaw, 2019, An energy efficient anti-correlated virtual machine placement algorithm using resource usage predictions, Simul. Model. Pract. Theory, 10.1016/j.simpat.2018.09.019 · DOI
- Duggan, 2017, A network aware approach for the scheduling of virtual machine migration during peak loads, Cluster Comput., 20, 2083, 10.1007/s10586-017-0948-7 · DOI
- Jia Rao, Xiangping Bu, Cheng-Zhong Xu, Leyi Wang, George Yin, VCONF: a reinforcement learning approach to virtual machines auto-configuration, in: Proceedings of the 6th International Conference on Autonomic Computing, 2009, pp. 137–146. · DOI · Paper page
- Rajarshi Das, Jeffrey O. Kephart, Charles Lefurgy, Gerald Tesauro, David W. Levine, Hoi Chan, VCONF: Autonomic multi-agent management of power and performance in data centers, in: Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent Systems: Industrial Track, 2008, pp. 107–114.
- Xavier Dutreilh, Sergey Kirgizov, Olga Melekhova, Jacques Malenfant, Nicolas Rivierre, Isis Truck, Using reinforcement learning for autonomic resource allocation in clouds: towards a fully automated workflow, in: ICAS 2011, The Seventh International Conference on Autonomic and Autonomous Systems, 2011, pp. 67–74.
- Wiering, 2012, Reinforcement learning, 3, 10.1007/978-3-642-27645-3 · DOI · Paper page
- Barrett, 2013, Applying reinforcement learning towards automating resource allocation and application scalability in the cloud, Concurr. Comput.: Pract. Exper., 25, 1656, 10.1002/cpe.2864 · DOI · Paper page
- Patrick Mannion, Jim Duggan, Enda Howley, Parallel learning using heterogeneous agents, in: Proceedings of the Adaptive and Learning Agents workshop (at AAMAS 2015), 2015.
- Patrick Mannion, Jim Duggan, Enda Howley, Learning traffic signal control with advice, in: Proceedings of the Adaptive and Learning Agents workshop (at AAMAS 2015), 2015.
- Mannion, 2015, An experimental review of reinforcement learning algorithms for adaptive traffic signal control
Cited by
Zhu, H., Zhang, D., Goh, H. H., Wang, S., Ahmad, T., Mao, D., Liu, T., Zhao, H., & Wu, T. (2023) · Sustainable Cities and Society · doi:10.1016/j.scs.2022.104322 · Cited by 164
ADT: Time series anomaly detection for cyber-physical systems via deep reinforcement learning
Yang, X., Howley, E., & Schukat, M. (2024) · Computers & Security · doi:10.1016/j.cose.2024.103825 · Cited by 47
Self-citationCFWS: DRL-Based Framework for Energy Cost and Carbon Footprint Optimization in Cloud Data Centers
Zhao, D., Zhou, J.-T., & Li, K. (2025) · IEEE Transactions on Sustainable Computing · doi:10.1109/tsusc.2024.3391791 · Cited by 32
Alex, M., Ojo, S. O., & Awuor, F. M. (2025) · Computers · doi:10.3390/computers14070280 · Cited by 22
Metadata
- Authors
- Shaw, R., Howley, E., & Barrett, E.
- Venue
- Information Systems
- Publisher
- Elsevier BV
- Published
- 2022-07
- Volume
- 107
- Pages
- 101722
- ISSN
- 0306-4379 (ISSN-L)
- OpenAlex
- W3125245221
- Cited by
- 112
- References
- 1
- FWCI
- 18.24
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- doi.org/10.15223/policy-017 (stm-asf)
- doi.org/10.15223/policy-037 (stm-asf)
- doi.org/10.15223/policy-012 (stm-asf)
- doi.org/10.15223/policy-029 (stm-asf)
- doi.org/10.15223/policy-004 (stm-asf)
- Funders
- Irish Research Council
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Applying Reinforcement Learning towards automating energy efficient virtual machine consolidation in cloud data centers. https://app.cochat.ai/papers/10.1016/j.is.2021.101722
- The paper
- Shaw, R., Howley, E., & Barrett, E. (2022). Applying Reinforcement Learning towards automating energy efficient virtual machine consolidation in cloud data centers. Information Systems. https://doi.org/10.1016/j.is.2021.101722
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.