A machine learning approach to live migration modeling
The DOI matches its Crossref record; 47 of the 48 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
Live migration is one of the key technologies to improve data center utilization, power efficiency, and maintenance. Various live migration algorithms have been proposed; each exhibiting distinct characteristics in terms of completion time, amount of data transferred, virtual machine (VM) downtime, and VM performance degradation. To make matters worse, not only the migration algorithm but also the applications running inside the migrated VM affect the different performance metrics. With service-level agreements and operational constraints in place, choosing the optimal live migration technique has so far been an open question. In this work, we propose an adaptive machine learning-based model that is able to predict with high accuracy the key characteristics of live migration in dependence of the migration algorithm and the workload running inside the VM. We discuss the important input parameters for accurately modeling the target metrics, and describe how to profile them with little overhead. Compared to existing work, we are not only able to model all commonly used migration algorithms but also predict important metrics that have not been considered so far such as the performance degradation of the VM. In a comparison with the state-of-the-art, we show that the proposed model outperforms existing work by a factor 2 to 5.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The techniques like autoregressive integrated moving average [71], support vector regression [72], linear regression, SVR with bootstrap aggregation [73] were also used for VM migration.”
From Energy efficiency in cloud computing data centers: a survey on software technologies (2023) · cites this paper as [73]
Citations
Cites
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb00917.x · Cited by 48,949
A mathematical theory of communication
Hockett, C. F., Shannon, C., & Weaver, W. (1948) · MOCO · doi:10.1145/584091.584093 · Cited by 30,543
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325 · cited 2×
“It is known [7] that in general bagging outperforms single models.”
BackgroundMethodThe PARSEC benchmark suite: characterization and architectural implications
Bienia, C., Kumar, S., Singh, J. P., & Li, K. (2008) · Proceedings of the 17th international conference on Parallel architectures and compilation techniques · doi:10.1145/1454115.1454128 · Cited by 3,444
Live migration of virtual machines
Clark, C. J., Fraser, K. A., Hand, S., Hansen, J. G., Jul, E., Limpach, C., Pratt, I., & Warfield, A. (2005) · doi:10.5555/1251203.1251223 · Cited by 2,562
QEMU, a fast and portable dynamic translator
Bellard, F. (2005) · USENIX Annual Technical Conference · Cited by 2,207
The DaCapo benchmarks: java benchmarking development and analysis
Blackburn, S. M., Garner, R., Hoffmann, C., Khang, A. M., McKinley, K. S., Bentzur, R., Diwan, A., Feinberg, D., Frampton, D., Guyer, S. Z., et al. (2006) · Proceedings of the 21st annual ACM SIGPLAN conference on Object-oriented programming systems, languages, and applications · doi:10.1145/1167473.1167488 · Cited by 1,600
An R-squared measure of goodness of fit for some common nonlinear regression models
Colin Cameron, A., & Windmeijer, F. A. G. (1997) · Journal of Econometrics · doi:10.1016/s0304-4076(96)01818-0 · Cited by 1,180
Quasar: resource-efficient and QoS-aware cluster management
Delimitrou, C., & Kozyrakis, C. (2014) · Proceedings of the 19th international conference on Architectural support for programming languages and operating systems · doi:10.1145/2541940.2541941 · Cited by 702
Fast transparent migration for virtual machines
Nelson, M. N., Lim, B.-H., & Hutchins, G. (2005) · Cited by 565
Cost of Virtual Machine Live Migration in Clouds: A Performance Evaluation
Voorsluys, W., Broberg, J., & Venugopal, S. (2010) · Cited by 490
Entropy: a consolidation manager for clusters
Hermenier, F., Lorca, X., Menaud, J.-M., Muller, G., & Lawall, J. (2009) · Proceedings of the 2009 ACM SIGPLAN/SIGOPS international conference on Virtual execution environments · doi:10.1145/1508293.1508300 · Cited by 479
Post-copy based live virtual machine migration using adaptive pre-paging and dynamic self-ballooning
Hines, M. R., & Gopalan, K. (2009) · Proceedings of the 2009 ACM SIGPLAN/SIGOPS international conference on Virtual execution environments · doi:10.1145/1508293.1508301 · Cited by 409
OLTP-Bench: an extensible testbed for benchmarking relational databases
Difallah, D. E., Pavlo, A., Curino, C., & Cudre-Mauroux, P. (2013) · Proceedings of the VLDB Endowment · doi:10.14778/2732240.2732246 · Cited by 392
Preemptable remote execution facilities for the V-system
Theimer, M. M., Lantz, K. A., & Cheriton, D. R. (1985) · ACM SIGOPS Operating Systems Review · doi:10.1145/323627.323629 · Cited by 334
Cost of Virtual Machine Live Migration in Clouds: A Performance Evaluation
Voorsluys, W., Broberg, J., Venugopal, S., & Buyya, R. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-10665-1_23 · Cited by 322
Live virtual machine migration with adaptive, memory compression
Jin, H., Deng, L., Wu, S., Shi, X., & Pan, X. (2009) · 2009 IEEE International Conference on Cluster Computing and Workshops · doi:10.1109/clustr.2009.5289170 · Cited by 306
Predicting the Performance of Virtual Machine Migration
Akoush, S., Sohan, R., Rice, A., Moore, A. W., & Hopper, A. (2010) · 2010 IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems · doi:10.1109/mascots.2010.13 · Cited by 292
Performance and energy modeling for live migration of virtual machines
Liu, H., Jin, H., Xu, C.-Z., & Liao, X. (2013) · Cluster Computing · doi:10.1007/s10586-011-0194-3 · Cited by 287
AGILE: elastic distributed resource scaling for Infrastructure-as-a-Service
Nguyen, H., Shen, Z., Gu, X., Subbiah, S., & Wilkes, J. (2013) · International Conference on Autonomic Computing · Cited by 278
Dynamic resource management using virtual machine migrations
Mishra, M., Das, A., Kulkarni, P., & Sahoo, A. (2012) · IEEE Communications Magazine · doi:10.1109/mcom.2012.6295709 · Cited by 270
Novaković, D., Vasić, N., Novaković, S., Kostić, D., & Bianchini, R. (2013) · IMDEA Networks Institute Digital Repository · Cited by 230
Machine Learning Applications for Data Center Optimization
Gao, J. (2014) · Cited by 222
iAware: Making Live Migration of Virtual Machines Interference-Aware in the Cloud
Xu, F., Liu, F., Liu, L., Jin, H., Li, B., & Li, B. (2014) · IEEE Transactions on Computers · doi:10.1109/tc.2013.185 · Cited by 207
Preemptable remote execution facilities for the V-system
Theimer, M. M., Lantz, K. A., & Cheriton, D. R. (1985) · Proceedings of the tenth ACM symposium on Operating systems principles · doi:10.1145/323647.323629 · Cited by 178
QoS-Aware scheduling in heterogeneous datacenters with paragon
Delimitrou, C., & Kozyrakis, C. (2013) · ACM Transactions on Computer Systems · doi:10.1145/2556583 · Cited by 175
Evaluation of delta compression techniques for efficient live migration of large virtual machines
Svärd, P., Hudzia, B., Tordsson, J., & Elmroth, E. (2011) · Proceedings of the 7th ACM SIGPLAN/SIGOPS international conference on Virtual execution environments · doi:10.1145/1952682.1952698 · Cited by 161
Modeling virtualized applications using machine learning techniques
Kundu, S., Rangaswami, R., Gulati, A., Zhao, M. X., & Dutta, K. (2012) · ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE) · doi:10.1145/2151024.2151028 · Cited by 121
Performance Modeling of Virtual Machine Live Migration
Wu, Y., & Zhao, M. X. (2011) · IEEE ... International Conference on Cloud Computing · doi:10.1109/cloud.2011.109 · Cited by 115
Profiling-Based Workload Consolidation and Migration in Virtualized Data Centers
Ye, K., Wu, Z., Wang, C., Zhou, B. B., Si, W., Jiang, X., & Zomaya, A. Y. (2014) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2014.2313335 · Cited by 96
Remedy: Network-Aware Steady State VM Management for Data Centers
Mann, V., Gupta, A., Dutta, P., Vishnoi, A., Bhattacharya, P., Poddar, R., & Iyer, A. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-30045-5_15 · Cited by 94
Efficient live migration of virtual machines using shared storage
Jo, C., Gustafsson, E., Son, J., & Egger, B. (2013) · ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE) · doi:10.1145/2451512.2451524 · Cited by 94
Self-citationThe Green and Virtual Data Center
Schulz, G. (2010) · Auerbach Publications eBooks · doi:10.1201/9781420086676 · Cited by 84
VMbuddies: Coordinating Live Migration of Multi-Tier Applications in Cloud Environments
Liu, H., & He, B. (2014) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2014.2316152 · Cited by 83
Towards a comprehensive performance model of virtual machine live migration
Nathan, S., Bellur, U., & Kulkarni, P. (2015) · ACM Symposium on Cloud Computing (SoCC) · doi:10.1145/2806777.2806838 · Cited by 63
Delay guaranteed live migration of Virtual Machines
Zhang, J., Ren, F., & Lin, C. (2014) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom.2014.6847982 · Cited by 63
Pacer: A Progress Management System for Live Virtual Machine Migration in Cloud Computing
Zheng, J., Ng, T. S. E., Sripanidkulchai, K., & Liu, Z. (2013) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2013.111013.130522 · Cited by 62
Matrix: Achieving Predictable Virtual Machine Performance in the Clouds
Chiang, R. C., Hwang, J., Huang, H. H., & Wood, T. (2014) · International Conference on Autonomic Computing · Cited by 59
Resource availability based performance benchmarking of virtual machine migrations
Nathan, S., Kulkarni, P., & Bellur, U. (2013) · ACM/SPEC International Conference on Performance Engineering (ICPE) · doi:10.1145/2479871.2479932 · Cited by 48
Principles and Performance Characteristics of Algorithms for Live VM Migration
Svärd, P., Hudzia, B., Walsh, S., Tordsson, J., & Elmroth, E. (2015) · ACM SIGOPS Operating Systems Review · doi:10.1145/2723872.2723894 · Cited by 47
Xen Live Migration with Slowdown Scheduling Algorithm
Liu, Z., Qu, W., Liu, W., & Li, K. (2010) · International Conference on Parallel and Distributed Computing, Applications and Technologies (PDCAT) · doi:10.1109/pdcat.2010.88 · Cited by 42
On Selecting the Right Optimizations for Virtual Machine Migration
Nathan, S., Bellur, U., & Kulkarni, P. (2016) · ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE) · doi:10.1145/2892242.2892247 · Cited by 21
Analytic Performance Modeling and Optimization of Live VM Migration
Aldhalaan, A., & Menascé, D. A. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-40725-3_4 · Cited by 20
iMIG: Toward an Adaptive Live Migration Method for KVM Virtual Machines
Li, J., Zhao, J., Li, Y., Cui, L., Li, B., Liu, L., & Panneerselvam, J. (2014) · The Computer Journal · doi:10.1093/comjnl/bxu065 · Cited by 18
Optimizing Live Migration for Virtual Desktop Clouds
Jo, C., & Egger, B. (2013) · IEEE International Conference on Cloud Computing Technology and Science · doi:10.1109/cloudcom.2013.21 · Cited by 11
Self-citationMigration Cost Aware Mitigating Hot Nodes in the Cloud
Deng, L. X., Jin, H., Chen, H., & Wu, S. (2013) · doi:10.1109/cloudcom-asia.2013.72 · Cited by 5
Next-Generation Virtual Data centers
Schulz, G. (2009) · Auerbach Publications eBooks · doi:10.1201/9781420086676-p2 · Cited by 5
Research works printed but not linked: 13
- Amazon EC2 - Virtual Server Hosting 2017. https://aws.amazon.com/ec2/. (2017). Online ; accessed August 2017 . Amazon EC2 - Virtual Server Hosting 2017. https://aws.amazon.com/ec2/. (2017). Online; accessed August 2017.
- 10.5555/1247360.1247401 · doi:10.5555/1247360.1247401
- Google Compute Engine 2017. https://cloud.google.com/compute. (2017). Online ; accessed August 2017 . Google Compute Engine 2017. https://cloud.google.com/compute. (2017). Online; accessed August 2017.
- Google Compute Engine uses Live Migration technology to service infrastructure without application downtime 2017. https://goo.gl/Ui3HFd. (2017). Online ; accessed August 2017 . Google Compute Engine uses Live Migration technology to service infrastructure without application downtime 2017. https://goo.gl/Ui3HFd. (2017). Online; accessed August 2017.
- Jonathan Koomey . 2011. Growth in data center electricity use 2005 to 2010 . A report by Analytical Press , completed at the request of The New York Times 9 (2011). Jonathan Koomey. 2011. Growth in data center electricity use 2005 to 2010. A report by Analytical Press, completed at the request of The New York Times 9 (2011).
- Memcached - a distributed memory object caching system 2017. https://memcached.org/. (2017). Online ; accessed August 2017 . Memcached - a distributed memory object caching system 2017. https://memcached.org/. (2017). Online; accessed August 2017.
- Microsoft Azure - Virtual Machines 2017. https://azure.microsoft.com/en-us/services/virtual-machines/. (2017). Online ; accessed August 2017 . Microsoft Azure - Virtual Machines 2017. https://azure.microsoft.com/en-us/services/virtual-machines/. (2017). Online; accessed August 2017.
- M Player - The Movie Player 2017. http://www.mplayerhq.hu/design7/news.html. (2017). Online ; accessed August 2017 . MPlayer - The Movie Player 2017. http://www.mplayerhq.hu/design7/news.html. (2017). Online; accessed August 2017.
- 10.5555/1247360.1247385 · doi:10.5555/1247360.1247385
- scikit-learn - Machine Learning in Python 2017. http://scikit-learn.org/stable/. (2017). Online ; accessed August 2017 . scikit-learn - Machine Learning in Python 2017. http://scikit-learn.org/stable/. (2017). Online; accessed August 2017.
- SPECweb2009 2017. https://www.spec.org/web2009/. (2017). Online ; accessed August 2017 . SPECweb2009 2017. https://www.spec.org/web2009/. (2017). Online; accessed August 2017.
- The Xen Project 2017. https://www.xenproject.org/. (2017). Online ; accessed August 2017 . The Xen Project 2017. https://www.xenproject.org/. (2017). Online; accessed August 2017.
- V Mware Virtualization Solutions 2017. http://www.vmware.com/. (2017). Online ; accessed August 2017 . VMware Virtualization Solutions 2017. http://www.vmware.com/. (2017). Online; accessed August 2017.
Cited by
Energy efficiency in cloud computing data centers: a survey on software technologies
Katal, A., Dahiya, S., & Choudhury, T. (2023) · Cluster Computing · doi:10.1007/s10586-022-03713-0 · Cited by 516
“The techniques like autoregressive integrated moving average [71], support vector regression [72], linear regression, SVR with bootstrap aggregation [73] were also used for VM migration.”
MethodCloud-Native Computing: A Survey From the Perspective of Services
Deng, S., Zhao, H., Huang, B., Zhang, C., Chen, F., Deng, Y., Yin, J., Dustdar, S., & Zomaya, A. Y. (2024) · Proceedings of the IEEE · doi:10.1109/jproc.2024.3353855 · Cited by 179
Kumar, Y., Kaul, S., & Hu, Y. (2022) · Sustainable Computing Informatics and Systems · doi:10.1016/j.suscom.2022.100780 · Cited by 95
Energy, performance and cost efficient cloud datacentres: A survey
Khan, A. A., & Zakarya, M. (2021) · Computer Science Review · doi:10.1016/j.cosrev.2021.100390 · Cited by 77
Sustainable computing across datacenters: A review of enabling models and techniques
Zakarya, M., Khan, A. A., Qazani, M. R. C., Ali, H., Al-Bahri, M., Khan, A. U. R., Ali, A., & Khan, R. (2024) · Computer Science Review · doi:10.1016/j.cosrev.2024.100620 · Cited by 76
Metadata
- Authors
- Jo, C., Cho, Y., & Egger, B.
- Affiliations
- Seoul National University (KR)
- Venue
- Proceedings of the 2017 Symposium on Cloud Computing
- Publisher
- ACM
- Published
- 2017-09-24
- Pages
- 351-364
- OpenAlex
- W2760528149
- Cited by
- 66
- References
- 48
- Citations by year
- 2026: 1 · 2025: 6 · 2024: 9 · 2023: 8 · 2022: 8 · 2021: 12 · 2020: 11 · 2019: 9 · 2018: 2
- FWCI
- 4.62
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Symposium on Cloud Computing (publishedVersion)
- Funders
- Seoul National University, Korea (Promising-Pioneering Researcher Program of Seoul National University (2015))
- National Research Foundation of Korea (2016R1A2B4009193)
- Topics
- Physical Sciences › Computer Science › Information Systems › Cloud Computing and Resource Management
- Physical Sciences › Computer Science › Hardware and Architecture › Energy Efficiency in Computing
- Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques
- Keywords
- live migration, virtual machines, machine learning prediction models, workload profiling, power efficiency, service level agreements
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.