Workload characterization and prediction in the cloud: A multiple time series approach
The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
Cloud computing promises high scalability, flexibility and cost-effectiveness to satisfy emerging computing requirements. To efficiently provision computing resources in the cloud, system administrators need the capabilities of characterizing and predicting workload on the Virtual Machines (VMs). In this paper, we use data traces obtained from a real data center to develop such capabilities. First, we search for repeatable workload patterns by exploring cross-VM workload correlations resulted from the dependencies among applications running on different VMs. Treating workload data samples as time series, we develop a co-clustering technique to identify groups of VMs that frequently exhibit correlated workload patterns, and also the time periods in which these VM groups are active. Then, we introduce a method based on Hidden Markov Modeling (HMM) to characterize the temporal correlations in the discovered VM clusters and to predict variations of workload patterns. The experimental results show that our method can not only help better understand group-level workload characteristics, but also make more accurate predictions on workload changes in a cloud.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743 · cited 1×
“(6), the first term, P (Ht|Ot), can be determined using the Viterbi’s algorithm [22], while the second and third terms are the state transition probabilities and observation probabilities that have been estimated.”
MethodArmbrust, M., Fox, A., Griffith, R., Joseph, A. D., Katz, R., Konwinski, A., Lee, G., Patterson, D., Rabkin, A., Stoica, I., et al. (2010) · Communications of the ACM · doi:10.1145/1721654.1721672 · Cited by 9,464
Generating representative Web workloads for network and server performance evaluation
Barford, P., & Crovella, M. (1998) · Proceedings of the 1998 ACM SIGMETRICS joint international conference on Measurement and modeling of computer systems · doi:10.1145/277851.277897 · Cited by 1,431
Dynamic Placement of Virtual Machines for Managing SLA Violations
Bobroff, N., Kochut, A., & Beaty, K. (2007) · 2007 10th IFIP/IEEE International Symposium on Integrated Network Management · doi:10.1109/inm.2007.374776 · Cited by 808
Web server workload characterization: the search for invariants
Arlitt, M. F., & Williamson, C. L. (1996) · ACM SIGMETRICS Performance Evaluation Review · doi:10.1145/233008.233034 · Cited by 747
Internet Web servers: workload characterization and performance implications
Arlitt, M. F., & Williamson, C. L. (1997) · IEEE/ACM Transactions on Networking · doi:10.1109/90.649565 · Cited by 730
Energy-aware server provisioning and load dispatching for connection-intensive internet services
Gong, C., He, W., Liu, J., Nath, S., Rigas, L., Xiao, L., & Zhao, F. (2008) · Cited by 654
An analytical model for multi-tier internet services and its applications
Urgaonkar, B., Pacifici, G., Shenoy, P., Spreitzer, M., & Tantawi, A. (2005) · Proceedings of the 2005 ACM SIGMETRICS international conference on Measurement and modeling of computer systems · doi:10.1145/1064212.1064252 · Cited by 545
PRESS: PRedictive Elastic ReSource Scaling for cloud systems
Gong, Z., Gu, X., & Wilkes, J. (2010) · 2010 International Conference on Network and Service Management · doi:10.1109/cnsm.2010.5691343 · Cited by 544
Generating representative Web workloads for network and server performance evaluation
Barford, P., & Crovella, M. (1998) · ACM SIGMETRICS Performance Evaluation Review · doi:10.1145/277858.277897 · Cited by 442
Cited by
Cortez, E., Bonde, A., Muzio, A., Russinovich, M., Fontoura, M., & Bianchini, R. (2017) · Proceedings of the 26th Symposium on Operating Systems Principles · doi:10.1145/3132747.3132772 · Cited by 633
Machine Learning Based Workload Prediction in Cloud Computing
Gao, J., Wang, H., & Shen, H. (2020) · 2020 29th International Conference on Computer Communications and Networks (ICCCN) · doi:10.1109/icccn49398.2020.9209730 · Cited by 311
Liu, N., Li, Z., Xu, J., Xu, Z., Lin, S., Qiu, Q., Tang, J., & Wang, Y. (2017) · 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2017.123 · Cited by 299
Workload prediction in cloud using artificial neural network and adaptive differential evolution
Kumar, J., & Singh, A. K. (2018) · Future Generation Computer Systems · doi:10.1016/j.future.2017.10.047 · Cited by 273
Quality-of-service in cloud computing: modeling techniques and their applications
Ardagna, D., Casale, G., Ciavotta, M., Pérez, J. F., & Wang, W. (2014) · Journal of Internet Services and Applications · doi:10.1186/s13174-014-0011-3 · Cited by 267
Machine Learning Methods for Reliable Resource Provisioning in Edge-Cloud Computing: A Survey
Duc, T. L., Leiva, R. G., Casari, P., & Östberg, P.-O. (2020) · ACM Computing Surveys · doi:10.1145/3341145 · Cited by 203
“Similarly, Reference [48] proposes to predict the CPU workload on VMs by joining time series autocorrelation measurements and similarity clustering.”
BackgroundMethodTseng, F.-H., Wang, X., Chou, L.-D., Chao, H.-C., & Leung, V. C. M. (2018) · IEEE Systems Journal · doi:10.1109/jsyst.2017.2722476 · Cited by 202
“, workload modeling [13], workload characterization and prediction [14], predictive model for workload forecasting [15], and traffic reduction [16].”
BackgroundA survey and classification of the workload forecasting methods in cloud computing
Masdari, M., & Khoshnevis, A. (2020) · Cluster Computing · doi:10.1007/s10586-019-03010-3 · Cited by 181
“For example, in [92], Khan et al. provide a co-clustering solution to find groups of VMs that Fig.”
MethodA novel VM workload prediction using Grey Forecasting model in cloud data center
Jheng, J.-J., Tseng, F.-H., Chao, H.-C., & Chou, L.-D. (2014) · The International Conference on Information Networking 2014 (ICOIN2014) · doi:10.1109/icoin.2014.6799662 · Cited by 50
Rapid and accurate energy models through calibration with IPMI and RAPL
Kavanagh, R., & Djemame, K. (2019) · Concurrency and Computation: Practice and Experience · doi:10.1002/cpe.5124 · Cited by 23
Methodology for energy aware adaptive management of virtualized data centers
Cioara, T., Anghel, I., & Salomie, I. (2017) · Energy Efficiency · doi:10.1007/s12053-016-9467-2 · Cited by 8
“Studies have shown that to efficiently manage computing resources in the DCs, models for characterizing and predicting the incoming workload are needed (Khan et al. 2012).”
Background
Metadata
- Authors
- Khan, A., Yan, X., Tao, S., & Anerousis, N.
- Venue
- 2012 IEEE Network Operations and Management Symposium
- Publisher
- IEEE
- Published
- 2012-04
- Pages
- 1287-1294
- OpenAlex
- W2143039774
- Cited by
- 305
- References
- 20
- FWCI
- 17.94
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.