AutoScale: Dynamic, Robust Capacity Management for Multi-Tier Data Centers
The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Energy costs for data centers continue to rise, already exceeding $15 billion yearly. Sadly much of this power is wasted. Servers are only busy 10--30% of the time on average, but they are often left on, while idle, utilizing 60% or more of peak power when in the idle state. We introduce a dynamic capacity management policy, AutoScale , that greatly reduces the number of servers needed in data centers driven by unpredictable, time-varying load, while meeting response time SLAs. AutoScale scales the data center capacity, adding or removing servers as needed. AutoScale has two key features: (i) it autonomically maintains just the right amount of spare capacity to handle bursts in the request rate; and (ii) it is robust not just to changes in the request rate of real-world traces, but also request size and server efficiency. We evaluate our dynamic capacity management approach via implementation on a 38-server multi-tier data center, serving a web site of the type seen in Facebook or Amazon, with a key-value store workload. We demonstrate that AutoScale vastly improves upon existing dynamic capacity management policies with respect to meeting SLAs and robustness.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Above the Clouds: A Berkeley View of Cloud Computing
Armbrust, M., Fox, A., Griffith, R., Joseph, A. D., Katz, R. H., Konwinski, A., Lee, G., Patterson, D. A., Rabkin, A., Stoica, I. G., et al. (2009) · UC Berkeley · Cited by 6,274
Newman (2005) · doi:10.1080/00107510500052444 · Cited by 5,749
(2007) · doi:10.1145/1294261.1294281 · Cited by 3,447
The Case for Energy-Proportional Computing
Barroso, L. A., & Hölzle, U. (2007) · Computer · doi:10.1109/mc.2007.443 · Cited by 2,491
Queueing Systems. Volume 1: Theory
Kleinrock, L. (1975) · Cited by 1,972
Power provisioning for a warehouse-sized computer
Fan, X., Weber, W.-D., & Barroso, L. A. (2007) · Proceedings of the 34th annual international symposium on Computer architecture · doi:10.1145/1250662.1250665 · Cited by 1,797
Managing energy and server resources in hosting centers
Chase, J. S., Anderson, D. C., Thakar, P. N., Vahdat, A. M., & Doyle, R. P. (2001) · Proceedings of the eighteenth ACM symposium on Operating systems principles · doi:10.1145/502034.502045 · Cited by 1,284
kvm : the Linux Virtual Machine Monitor
Kivity, A. (2007) · Cited by 1,267
Black-box and gray-box strategies for virtual machine migration
Wood, T., Shenoy, P. J., Venkataramani, A., & Yousif, M. S. (2007) · Networked Systems Design and Implementation · Cited by 920
PowerNap: eliminating server idle power
Meisner, D., Gold, B. T., & Wenisch, T. F. (2009) · Proceedings of the 14th international conference on Architectural support for programming languages and operating systems · doi:10.1145/1508244.1508269 · Cited by 901
httperf—a tool for measuring web server performance
Mosberger, D., & Jin, T. (1998) · ACM SIGMETRICS Performance Evaluation Review · doi:10.1145/306225.306235 · Cited by 828
Dynamic Placement of Virtual Machines for Managing SLA Violations
Bobroff, N., Kochut, A., & Beaty, K. (2007) · 2007 10th IFIP/IEEE International Symposium on Integrated Network Management · doi:10.1109/inm.2007.374776 · Cited by 808
Energy-aware server provisioning and load dispatching for connection-intensive internet services
Gong, C., He, W., Liu, J., Nath, S., Rigas, L., Xiao, L., & Zhao, F. (2008) · Cited by 654
Accessibility of cities in the digital economy
Tranos, E., Reggiani, A., & Nijkamp, P. (2013) · Cities · doi:10.1016/j.cities.2012.03.001 · Cited by 580
Q-clouds: managing performance interference effects for QoS-aware clouds
Nathuji, R., Kansal, A., & Ghaffarkhah, A. (2010) · Proceedings of the 5th European conference on Computer systems · doi:10.1145/1755913.1755938 · Cited by 568
Managing server energy and operational costs in hosting centers
Chen, Y., Das, A., Qin, W., Sivasubramaniam, A., Wang, Q., & Gautam, N. (2005) · Proceedings of the 2005 ACM SIGMETRICS international conference on Measurement and modeling of computer systems · doi:10.1145/1064212.1064253 · Cited by 556
An analytical model for multi-tier internet services and its applications
Urgaonkar, B., Pacifici, G., Shenoy, P., Spreitzer, M., & Tantawi, A. (2005) · Proceedings of the 2005 ACM SIGMETRICS international conference on Measurement and modeling of computer systems · doi:10.1145/1064212.1064252 · Cited by 545
Power management of online data-intensive services
Meisner, D., Sadler, C. M., Barroso, L. A., Weber, W.-D., & Wenisch, T. F. (2011) · Proceedings of the 38th annual international symposium on Computer architecture · doi:10.1145/2000064.2000103 · Cited by 404
Server workload analysis for power minimization using consolidation
Verma, A., Dasgupta, G., Nayak, T. K., De, P., & Kothari, R. (2009) · Cited by 381
Dynamic knobs for responsive power-aware computing
Hoffmann, H., Sidiroglou, S., Carbin, M., Misailovic, S., Agarwal, A., & Rinard, M. (2011) · Proceedings of the sixteenth international conference on Architectural support for programming languages and operating systems · doi:10.1145/1950365.1950390 · Cited by 304
Policies for dynamic clock scheduling
Grunwald, D. C., Morrey, C. B., Levis, P. A., Neufeld, M., & Farkas, K. I. (2000) · doi:10.5555/1251229.1251235 · Cited by 286
Energy-Efficient Server Clusters
Elnozahy, E. N. M., Kistler, M., & Rajamony, R. (2002) · Cited by 281
Cluster-level feedback power control for performance optimization
Wang, X., & Chen, M. (2008) · Proceedings - International Symposium on High-Performance Computer Architecture/Proceedings · doi:10.1109/hpca.2008.4658631 · Cited by 222
Feedback Control Architecture and Design Methodology for Service Delay Guarantees in Web Servers
Lu, C., Lu, Y., Abdelzaher, T. F., Stankovic, J. A., & Son, S. H. (2006) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2006.123 · Cited by 204
Statistical machine learning makes automatic control practical for internet datacenters
Bodík, P., Griffith, R., Sutton, C. A., Fox, A., Jordan, M. I., & Patterson, D. A. (2009) · Cited by 198
NapSAC: design and implementation of a power-proportional web cluster
Krioukov, A., Mohan, P., Alspaugh, S., Keys, L., Culler, D., & Katz, R. H. (2010) · Proceedings of the first ACM SIGCOMM workshop on Green networking · doi:10.1145/1851290.1851294 · Cited by 171
Quantitative comparison of power management algorithms
Lu, Y.-H., Chung, E.-Y., Simunic, T., Benini, L., & Micheli, G. D. (2000) · Design, Automation, and Test in Europe · doi:10.1145/343647.343688 · Cited by 146
Multi-mode energy management for multi-tier server clusters
Horváth, T., & Kevin Skadron, Y. (2008) · International Conference on Parallel Architectures and Compilation Techniques (PACT) · doi:10.1145/1454115.1454153 · Cited by 127
iBOM: A Platform for Intelligent Business Operation Management
Castellanos, M., Casati, F., Shan, M.-C., & Dayal, U. (2005) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde.2005.73 · Cited by 87
A dynamic energy management scheme for multi-tier data centers
Lim, S.-H., Sharma, B., Tak, B. C., & Das, C. R. (2011) · IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS) · doi:10.1109/ispass.2011.5762742 · Cited by 29
Power-Aware Resource Management Techniques for Low-Power Embedded Systems
Kim, J., & Simunic, T. (2007) · Chapman & Hall/CRC computer and information science series · doi:10.1201/9781420011746.ch6 · Cited by 13
Cited by
Using Ant Colony System to Consolidate VMs for Green Cloud Computing
Farahnakian, F., Ashraf, A., Pahikkala, T., Liljeberg, P., Plosila, J., Porres, I., & Tenhunen, H. (2015) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2014.2382555 · Cited by 328
Statistical Characterization of Business-Critical Workloads Hosted in Cloud Datacenters
Shen, S., Van Beek, V., & Iosup, A. (2015) · 2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing · doi:10.1109/ccgrid.2015.60 · Cited by 286
Auto-Scaling Web Applications in Clouds: A Taxonomy and Survey
Qu, C., Calheiros, R. N., & Buyya, R. (2019) · ACM Computing Surveys · doi:10.1145/3148149 · Cited by 260
A Case for Managed and Model-less Inference Serving
Yadwadkar, N. J., Romero, F., Li, Q., & Kozyrakis, C. (2019) · Proceedings of the Workshop on Hot Topics in Operating Systems · doi:10.1145/3317550.3321443 · Cited by 31
Metadata
- Authors
- Gandhi, A., Harchol-Balter, M., Raghunathan, R., & Kozuch, M. A.
- Venue
- ACM Transactions on Computer Systems
- Published
- 2012-11
- Volume
- 30
- Issue
- 4
- Pages
- 1-26
- ISSN
- 0734-2071 (ISSN-L)
- 1557-7333
- OpenAlex
- W2075233755
- Cited by
- 301
- References
- 31
- FWCI
- 67.27
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.