The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Machine Learning Based Workload Prediction in Cloud Computing
Abstract
As a widely used IT service, more and more companies shift their services to cloud datacenters. It is important for cloud service providers (CSPs) to provide cloud service resources with high elasticity and cost-effectiveness and then achieve good quality of service (QoS) for their clients. However, meeting QoS with cost-effective resource is a challenging problem for CSPs because the workloads of Virtual Machines (VMs) experience variation over time. It is highly necessary to provide an accurate VMs workload prediction method for resource provisioning to efficiently manage cloud resources. In this paper, we first compare the performance of representative state-of-the-art workload prediction methods. We suggest a method to conduct the prediction a certain time before the predicted time point in order to allow sufficient time for task scheduling based on predicted workload. To further improve the prediction accuracy, we introduce a clustering based workload prediction method, which first clusters all the tasks into several categories and then trains a prediction model for each category respectively. The trace-driven experiments based on Google cluster trace demonstrates that our clustering based workload prediction methods outperform other comparison methods and improve the prediction accuracy to around 90% both in CPU and memory.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
A tutorial on support vector regression
Smola, A. J., & Schölkopf, B. (2004) · Statistics and Computing · doi:10.1023/b:stco.0000035301.49549.88 · Cited by 13,387
Armbrust, M., Fox, A., Griffith, R., Joseph, A. D., Katz, R., Konwinski, A., Lee, G., Patterson, D., Rabkin, A., Stoica, I., et al. (2010) · Communications of the ACM · doi:10.1145/1721654.1721672 · Cited by 9,464
The Levenberg-Marquardt algorithm: Implementation and theory
Moré, J. J. (1978) · Lecture Notes in Mathematics · doi:10.1007/bfb0067700 · Cited by 5,773
Park, T., & Casella, G. (2008) · Journal of the American Statistical Association · doi:10.1198/016214508000000337 · Cited by 2,934
A break in the clouds: towards a cloud definition
Vaquero, L. M., Rodero-Merino, L., Caceres, J., & Lindner, M. (2008) · ACM SIGCOMM Computer Communication Review · doi:10.1145/1496091.1496100 · Cited by 2,611
Training linear SVMs in linear time
Joachims, T. (2006) · Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1150402.1150429 · Cited by 1,920
Krishna, K., & Narasimha Murty, M. (1999) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/3477.764879 · Cited by 1,717
Density-Based Clustering in Spatial Databases: The Algorithm GDBSCAN and Its Applications
Sander, J., Ester, M., Kriegel, H.-P., & Xu, X. (1998) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009745219419 · Cited by 1,495
Gaussian parsimonious clustering models
Celeux, G., & Govaert, G. (1995) · Pattern Recognition · doi:10.1016/0031-3203(94)00125-6 · Cited by 872
(2024) · Multivariate Biomarker Discovery · doi:10.1017/9781009006767.012 · Cited by 809
Zhang, F., & O'Donnell, L. J. (2020) · Machine Learning · doi:10.1016/b978-0-12-815739-8.00007-9 · Cited by 737
Empirical prediction models for adaptive resource provisioning in the cloud
Islam, S., Keung, J., Lee, K., & Liu, A. (2012) · Future Generation Computer Systems · doi:10.1016/j.future.2011.05.027 · Cited by 631
Workload Prediction Using ARIMA Model and Its Impact on Cloud Applications’ QoS
Calheiros, R. N., Masoumi, E., Ranjan, R., & Buyya, R. (2015) · IEEE Transactions on Cloud Computing · doi:10.1109/tcc.2014.2350475 · Cited by 617
Efficient Autoscaling in the Cloud Using Predictive Models for Workload Forecasting
Roy, N., Dubey, A., & Gokhale, A. (2011) · 2011 IEEE 4th International Conference on Cloud Computing · doi:10.1109/cloud.2011.42 · Cited by 591
PRESS: PRedictive Elastic ReSource Scaling for cloud systems
Gong, Z., Gu, X., & Wilkes, J. (2010) · 2010 International Conference on Network and Service Management · doi:10.1109/cnsm.2010.5691343 · Cited by 544
Beloglazov, A., & Buyya, R. (2013) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2012.240 · Cited by 497
Online Prediction of Time Series Data With Kernels
Richard, C., Bermudez, J. C. M., & Honeiné, P. (2008) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2008.2009895 · Cited by 470
Kumar, J., Goomer, R., & Singh, A. K. (2018) · Procedia Computer Science · doi:10.1016/j.procs.2017.12.087 · Cited by 399
Wei, W., Fan, X., Song, H., Fan, X., & Yang, J. (2018) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2016.2528246 · Cited by 348
Workload characterization and prediction in the cloud: A multiple time series approach
Khan, A., Yan, X., Tao, S., & Anerousis, N. (2012) · 2012 IEEE Network Operations and Management Symposium · doi:10.1109/noms.2012.6212065 · Cited by 305
Smartly Handling Renewable Energy Instability in Supporting A Cloud Datacenter
Gao, J., Wang, H., & Shen, H. (2020) · 2020 IEEE International Parallel and Distributed Processing Symposium (IPDPS) · doi:10.1109/ipdps47924.2020.00084 · Cited by 272
Self-citationJaleta, A. (2020) · Cited by 269
An Efficient Deep Learning Model to Predict Cloud Workload for Industry Informatics
Zhang, Q., Yang, L. T., Yan, Z., Chen, Z., & Li, P. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2808910 · Cited by 231
Farahnakian, F., Liljeberg, P., & Plosila, J. (2013) · 2013 39th Euromicro Conference on Software Engineering and Advanced Applications · doi:10.1109/seaa.2013.23 · Cited by 184
Task Failure Prediction in Cloud Data Centers Using Deep Learning
Gao, J., Wang, H., & Shen, H. (2019) · 2019 IEEE International Conference on Big Data (Big Data) · doi:10.1109/bigdata47090.2019.9006011 · Cited by 170
Self-citationHost load prediction with long short-term memory in cloud computing
Song, B., Yu, Y., Zhou, Y., Wang, Z., & Du, S. (2018) · The Journal of Supercomputing · doi:10.1007/s11227-017-2044-4 · Cited by 166
A deep learning approach for VM workload prediction in the cloud
Qiu, F., Zhang, B., & Guo, J. H. (2016) · ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD) · doi:10.1109/snpd.2016.7515919 · Cited by 99
Towards an Autonomic Auto-scaling Prediction System for Cloud Resource Provisioning
Nikravesh, A. Y., Ajila, S. A., & Lung, C. (2015) · International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS) · doi:10.1109/seams.2015.22 · Cited by 85
Bankole, A. A., & Ajila, S. A. (2013) · IEEE International Symposium on Service-Oriented System Engineering (SOSE) · doi:10.1109/sose.2013.40 · Cited by 84
ASAP: A Self-Adaptive Prediction System for Instant Cloud Resource Demand Provisioning
Jiang, Y., Perng, C.-S., Li, T., & Chang, R. (2011) · Proceedings · doi:10.1109/icdm.2011.25 · Cited by 80
Xu, M., & Buyya, R. (2019) · ACM Computing Surveys · doi:10.1145/3234151 · Cited by 70
Resource requests prediction in the cloud computing environment with a deep belief network
Zhang, W., Duan, P., Yang, L. T., Xia, F., Li, Z., Lu, Q., Gong, W., & Yang, S. (2016) · Software Practice and Experience · doi:10.1002/spe.2426 · Cited by 59
Improving the Smartness of Cloud Management via Machine Learning Based Workload Prediction
Yu, Y., Jindal, V., Bastani, F., Li, F., & Yen, I. (2018) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac.2018.10200 · Cited by 37
Imam, T., Miskhat, S. F., Rahman, R. M., & Amin, M. A. (2011) · International Conference on Computer and Information Technology (ICCIT) · doi:10.1109/iccitechn.2011.6164809 · Cited by 32
Shen, H., & Chen, L. (2017) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2017.2759276 · Cited by 30
Self-citation
Metadata
- Authors
- Gao, J., Wang, H., & Shen, H.
- Venue
- 2020 29th International Conference on Computer Communications and Networks (ICCCN)
- Publisher
- IEEE
- Published
- 2020-08
- Pages
- 1-9
- ISSN
- 1095-2055 (ISSN-L)
- OpenAlex
- W3089344842
- Cited by
- 311
- References
- 36
- FWCI
- 40.28
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.