The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Resource Central: Understanding and Predicting Workloads for Improved Resource Management in Large Cloud Platforms
Abstract
Cloud research to date has lacked data on the characteristics of the production virtual machine (VM) workloads of large cloud providers. A thorough understanding of these characteristics can inform the providers' resource management systems, e.g. VM scheduler, power manager, server health manager. In this paper, we first introduce an extensive characterization of Microsoft Azure's VM workload, including distributions of the VMs' lifetime, deployment size, and resource consumption. We then show that certain VM behaviors are fairly consistent over multiple lifetimes, i.e. history is an accurate predictor of future behavior. Based on this observation, we next introduce Resource Central (RC), a system that collects VM telemetry, learns these behaviors offline, and provides predictions online to various resource managers via a general client-side library. As an example of RC's online use, we modify Azure's VM scheduler to leverage predictions in oversubscribing servers (with oversubscribable VM types), while retaining high VM performance. Using real VM traces, we then show that the prediction-informed schedules increase utilization and prevent physical resource exhaustion. We conclude that providers can exploit their workloads' characteristics and machine learning to improve resource management substantially.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
TensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Heterogeneity and dynamicity of clouds at scale: Google trace analysis
Reiss, C., Tumanov, A., Ganger, G. R., Katz, R. H., & Kozuch, M. A. (2012) · Proceedings of the Third ACM Symposium on Cloud Computing · doi:10.1145/2391229.2391236 · Cited by 1,063
CloudCmp: comparing public cloud providers
Li, A., Yang, X., Kandula, S., & Zhang, M. (2010) · Proceedings of the 10th ACM SIGCOMM conference on Internet measurement · doi:10.1145/1879141.1879143 · Cited by 882
Dynamic Placement of Virtual Machines for Managing SLA Violations
Bobroff, N., Kochut, A., & Beaty, K. (2007) · 2007 10th IFIP/IEEE International Symposium on Integrated Network Management · doi:10.1109/inm.2007.374776 · Cited by 808
Energy Efficient Resource Management in Virtualized Cloud Data Centers
Beloglazov, A., & Buyya, R. (2010) · 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing · doi:10.1109/ccgrid.2010.46 · Cited by 760
Quasar: resource-efficient and QoS-aware cluster management
Delimitrou, C., & Kozyrakis, C. (2014) · Proceedings of the 19th international conference on Architectural support for programming languages and operating systems · doi:10.1145/2541940.2541941 · Cited by 702
pMapper: Power and Migration Cost Aware Application Placement in Virtualized Systems
Verma, A., Ahuja, P., & Neogi, A. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-89856-6_13 · Cited by 649
Empirical prediction models for adaptive resource provisioning in the cloud
Islam, S., Keung, J., Lee, K., & Liu, A. (2012) · Future Generation Computer Systems · doi:10.1016/j.future.2011.05.027 · Cited by 631
Workload Prediction Using ARIMA Model and Its Impact on Cloud Applications’ QoS
Calheiros, R. N., Masoumi, E., Ranjan, R., & Buyya, R. (2015) · IEEE Transactions on Cloud Computing · doi:10.1109/tcc.2014.2350475 · Cited by 617
Cited by
Shahrad, M., Fonseca, R., Goiri, Í., Chaudhry, G., Batum, P., Cooke, J., Laureano, E., Tresness, C., Russinovich, M., & Bianchini, R. (2020) · arXiv · doi:10.48550/arxiv.2003.03423 · Cited by 391
“For example, data from Azure [12] shows that 63% of all VM allocations last longer than 15 minutes, and only less than 8% of the VMs last less 5 minutes or less.”
MethodSelf-citationPond: CXL-Based Memory Pooling Systems for Cloud Platforms
Li, H., Berger, D. S., Hsu, L., Ernst, D., Zardoshti, P., Novakovic, S., Shah, M., Rajadnya, S., Lee, S., Agarwal, I., et al. (2023) · Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2 · doi:10.1145/3575693.3578835 · Cited by 341
Self-citationTirmazi, M., Barker, A., Deng, N., Haque, M. E., Qin, Z. G., Hand, S., Harchol-Balter, M., & Wilkes, J. (2020) · Proceedings of the Fifteenth European Conference on Computer Systems · doi:10.1145/3342195.3387517 · Cited by 325
Characterizing Microservice Dependency and Performance: Alibaba Trace Analysis
Luo, S., Xu, H., Lu, C., Ye, K., Xu, G., Zhang, L., Ding, Y., He, J., & Xu, C. (2021) · Proceedings of the ACM Symposium on Cloud Computing · doi:10.1145/3472883.3487003 · Cited by 293
Who limits the resource efficiency of my datacenter: an analysis of Alibaba datacenter traces
Guo, J., Chang, Z., Wang, S., Ding, H., Feng, Y., Mao, L., & Bao, Y. (2019) · Proceedings of the International Symposium on Quality of Service · doi:10.1145/3326285.3329074 · Cited by 287
AI-based fog and edge computing: A systematic review, taxonomy and future directions
Iftikhar, S., Gill, S. S., Song, C., Xu, M., Aslanpour, M. S., Toosi, A. N., Du, J., Wu, H., Ghosh, S., Chowdhury, D., et al. (2023) · Internet of Things · doi:10.1016/j.iot.2022.100674 · Cited by 260
esDNN: Deep Neural Network Based Multivariate Workload Prediction in Cloud Computing Environments
Xu, M., Song, C., Wu, H., Gill, S. S., Ye, K., & Xu, C. (2022) · ACM Transactions on Internet Technology · doi:10.1145/3524114 · Cited by 142
Reducing the Carbon Impact of Generative AI Inference (today and in 2035)
Chien, A. A., Lin, L., Nguyen, H., Rao, V., Sharma, T., & Wijayawardana, R. (2023) · Proceedings of the 2nd Workshop on Sustainable Computer Systems · doi:10.1145/3604930.3605705 · Cited by 128
AI for IT Operations (AIOps) on Cloud Platforms: Reviews, Opportunities and Challenges
Cheng, Q., Sahoo, D., Saha, A., Yang, W., Liu, C., Woo, G., Singh, M., Saverese, S., & Hoi, S. C. H. (2023) · arXiv · doi:10.48550/arxiv.2304.04661 · Cited by 23
Shao, T., Chowdhury, D., Gill, S. S., & Buyya, R. (2022) · Internet Technology Letters · doi:10.1002/itl2.355 · Cited by 18
Adaptive Capacity Provisioning for Carbon-Aware Data Centers: A Digital Twin-Based Approach
Cao, Z., Wang, R., Zhou, X., Tan, R., Wen, Y., Yan, Y., & Wang, Z. (2025) · IEEE Transactions on Sustainable Computing · doi:10.1109/tsusc.2025.3526192 · Cited by 16
“We use publicly available cloud workload trace from Azure [42] in our evaluation.”
On the Cluster Admission Problem for Cloud Computing
Dierks, L., Kash, I., & Seuken, S. (2019) · Proceedings of the 14th Workshop on the Economics of Networks, Systems and Computation · doi:10.1145/3338506.3340274 · Cited by 8
Metadata
- Authors
- Cortez, E., Bonde, A., Muzio, A., Russinovich, M., Fontoura, M., & Bianchini, R.
- Venue
- Proceedings of the 26th Symposium on Operating Systems Principles
- Publisher
- ACM
- Published
- 2017-10-14
- Pages
- 153-167
- OpenAlex
- W2764100055
- Cited by
- 633
- References
- 22
- FWCI
- 34.73
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.