Q-learning based dynamic task scheduling for energy-efficient cloud computing
The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
Abstract High energy consumption has become a growing concern in the operation of complex cloud data centers due to the ever-expanding size of cloud computing facilities and the ever-increasing number of users. It is critical to find viable solutions to cloud task scheduling so that cloud resources can be utilized in an energy-efficient way while still meeting diverse user requirements in real time. In this research we propose a Q-learning based task scheduling framework for energy-efficient cloud computing (QEEC). QEEC has two phases. In the first phase a centralized task dispatcher is used to implement the M/M/S queueing model, by which the arriving user requests are assigned to each server in a cloud. In the second phase a Q-learning based scheduler on each server first prioritizes all the requests by task laxity and task life time, then uses a continuously-updating policy to assign tasks to virtual machines, applying incentives to reward the assignments that can minimize task response time and maximize each server’s CPU utilization. We have conducted simulation experiments, which have confirmed that implementing a M/M/S queueing system in a cloud can help to reduce the average task response time. The experiments have also demonstrated that the QEEC approach is the most energy-efficient as compared to other task scheduling policies, which can be largely credited to the M/M/S queueing model and the Q-learning strategy implemented in QEEC.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
The NIST definition of cloud computing
Mell, P. M., & Grance, T. (2011) · doi:10.6028/nist.sp.800-145 · Cited by 11,795
Armbrust, M., Fox, A., Griffith, R., Joseph, A. D., Katz, R., Konwinski, A., Lee, G., Patterson, D., Rabkin, A., Stoica, I., et al. (2010) · Communications of the ACM · doi:10.1145/1721654.1721672 · Cited by 9,464
Calheiros, R. N., Ranjan, R., Beloglazov, A., De Rose, C. A. F., & Buyya, R. (2011) · Software: Practice and Experience · doi:10.1002/spe.995 · Cited by 4,948
Beloglazov, A., Abawajy, J., & Buyya, R. (2012) · Future Generation Computer Systems · doi:10.1016/j.future.2011.04.017 · Cited by 2,761
A Taxonomy and Survey of Energy-Efficient Data Centers and Cloud Computing Systems
Beloglazov, A., Buyya, R., Lee, Y. C., & Zomaya, A. (2011) · Advances in Computers · doi:10.1016/b978-0-12-385512-1.00003-7 · Cited by 777
A survey on resource scheduling in cloud computing: issues and challenges
Singh, S., & Chana, I. (2016) · Journal of Grid Computing · doi:10.1007/s10723-015-9359-2 · Cited by 466
Performance Analysis of Cloud Computing Centers Using M/G/m/m+r Queuing Systems
Khazaei, H., Misic, J., & Misic, V. B. (2012) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2011.199 · Cited by 394
A Hybrid Reinforcement Learning Approach to Autonomic Resource Allocation
Tesauro, G., Jong, N. K., Das, R., & Bennani, M. N. (2006) · 2006 IEEE International Conference on Autonomic Computing · doi:10.1109/icac.2006.1662383 · Cited by 365
Liu, N., Li, Z., Xu, J., Xu, Z., Lin, S., Qiu, Q., Tang, J., & Wang, Y. (2017) · 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2017.123 · Cited by 299
DejaVu: accelerating resource allocation in virtualized environments
Vasić, N., Novaković, D., Miučin, S., Kostić, D., & Bianchini, R. (2012) · Proceedings of the seventeenth international conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/2150976.2151021 · Cited by 174
Energy-Efficient Virtual Machines Consolidation in Cloud Data Centers Using Reinforcement Learning
Farahnakian, F., Liljeberg, P., & Plosila, J. (2014) · 2014 22nd Euromicro International Conference on Parallel, Distributed, and Network-Based Processing · doi:10.1109/pdp.2014.109 · Cited by 163
Optimal Cloud Resource Auto-Scaling for Web Applications
Jiang, J. B., Lü, J., Zhang, G., & Long, G. (2013) · IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid) · doi:10.1109/ccgrid.2013.73 · Cited by 140
Random task scheduling scheme based on reinforcement learning in cloud computing
Peng, Z., Cui, D., Zuo, J., Li, Q., Xu, B., & Lin, W. (2015) · Cluster Computing · doi:10.1007/s10586-015-0484-2 · Cited by 133
On the use of hybrid reinforcement learning for autonomic resource allocation
Tesauro, G. J., Jong, N. K., Das, R., & Bennani, M. N. (2007) · Cluster Computing · doi:10.1007/s10586-007-0035-6 · Cited by 121
(1962) · Journal of the Franklin Institute · doi:10.1016/0016-0032(62)91111-0 · Cited by 90
Cloud computing: The beliefs and perceptions of Swedish school principals
Lim, N., Grönlund, Å., & Andersson, A. (2015) · Computers & Education · doi:10.1016/j.compedu.2015.01.009 · Cited by 73
Experimental and quantitative analysis of server power model for cloud data centers
Lin, W., Wu, W., Wang, H., Wang, J. Z., & Hsu, C. (2016) · Future Generation Computer Systems · doi:10.1016/j.future.2016.11.034 · Cited by 47
A Reinforcement Learning-Based Power Management Framework for Green Computing Data Centers
Lin, X., Wang, Y., & Pedram, M. (2016) · IEEE International Conference on Cloud Engineering · doi:10.1109/ic2e.2016.33 · Cited by 44
Energy-efficient cloud resource management
Dabbagh, M., Hamdaoui, B., Guizani, M., & Rayes, A. (2014) · IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS) · doi:10.1109/infcomw.2014.6849263 · Cited by 39
Resource pre-allocation algorithms for low-energy task scheduling of cloud computing
Xu, X., Cao, L., & Wang, X. (2016) · Journal of Systems Engineering and Electronics · doi:10.1109/jsee.2016.00047 · Cited by 39
Energy management strategy in cloud computing: a perspective study
Chaâbouni, T., & Khemakhem, M. A. (2017) · The Journal of Supercomputing · doi:10.1007/s11227-017-2154-z · Cited by 31
Policy of Energy Optimal Management for Cloud Computing Platform with Stochastic Tasks
Tan, Y.-M., Zeng, G., & Wang, W. (2012) · Journal of Software · doi:10.3724/sp.j.1001.2012.04143 · Cited by 31
Iturriaga, S., Dorronsoro, B., & Nesmachnow, S. (2016) · International Transactions in Operational Research · doi:10.1111/itor.12294 · Cited by 26
An energy-saving strategy based on multi-server vacation queuing theory in cloud data center
Yin, C., & Jin, S. (2018) · The Journal of Supercomputing · doi:10.1007/s11227-018-2513-4 · Cited by 22
Energy and performance management in large data centers: A queuing theory perspective
Liao, D., Li, K., Sun, G., Anand, V., Gong, Y., & Tan, Z. (2015) · 2012 International Conference on Computing, Networking and Communications (ICNC) · doi:10.1109/iccnc.2015.7069356 · Cited by 18
Hussin, M. B., Lee, Y. C., & Zomaya, A. Y. (2011) · Proceedings of the International Conference on Parallel Processing · doi:10.1109/icpp.2011.18 · Cited by 17
Cloud Resource Allocation from the User Perspective: A Bare-Bones Reinforcement Learning Approach
Kontarinis, A., Kantere, V., & Koziris, N. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-48740-3_34 · Cited by 11
Cited by
Using the internet of things in smart energy systems and networks
Ahmad, T., & Zhang, D. (2021) · Sustainable Cities and Society · doi:10.1016/j.scs.2021.102783 · Cited by 332
Parsafar, P. (2025) · The Journal of Supercomputing · doi:10.1007/s11227-024-06510-1 · Cited by 9
Metadata
- Authors
- Ding, D., Fan, X., Zhao, Y., Kang, K., Yin, Q., & Zeng, J.
- Venue
- Future Generation Computer Systems
- Publisher
- Elsevier BV
- Published
- 2020-07
- Volume
- 108
- Pages
- 361-371
- ISSN
- 0167-739X (ISSN-L)
- OpenAlex
- W3008115759
- Cited by
- 242
- References
- 29
- FWCI
- 28.59
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.