Skip to main content
Log in

VMSA: a performance preserving online VM splitting and placement algorithm in dynamic cloud environments

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

Server consolidation schemes whereby each server is replaced with a virtual machine (VM) and multiple such VMs are run on a single physical server can reduce the number of physical servers needed, and in turn, both the cost and energy consumption in data centers. However, existing schemes have not fully exploited the flexibility in the usage and allocation of virtualization resources, so as to allow one application originally deployed on a single large VM (LVM) to be split and hosted by multiple smaller VMs (SVM). Using multiple SVMs instead of an LVM enables resource allocation at a smaller granularity and thus may further increase the utilization and reduce the number of physical servers. However, a major challenge to overcome when deploying multiple SVMs for one application is to preserve the performance of the application in terms of response delay. In this paper, we show through theoretical analysis and experiments that in order to preserve the performance of the application, one needs to allocate sufficient resources to each SVM, and the total amount of resources required by all the SVMs will exceed that required by the LVM. Nevertheless, we also show that by using the proposed heuristic algorithm called VM splitting and assignment (VMSA), we can substantially improve the utilization and reduce the number of physical servers.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Beloglazov A, Buyya R (2010) Energy Efficient Allocation of Virtual Machines in Cloud Data Centers. In: 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing. IEEE, New Jersey, pp. 577–578. doi:10.1109/CCGRID.2010.45

  2. Bianchini R, Rajamony R (2004) Power and energy management for server systems. Computer 37(11):68–76. doi:10.1109/MC.2004.217

    Article  Google Scholar 

  3. Breitgand D, Epstein A (2012) Improving consolidation of virtual machines with risk-aware bandwidth oversubscription in compute clouds. In: 2012 Proceedings IEEE INFOCOM, pp. 2861–2865. doi:10.1109/INFCOM.2012.6195716

  4. Chen G, He W, Liu J, Nath S, Rigas L, Xiao L, Zhao F (2008) Energy-aware server provisioning and load dispatching for connection-intensive internet services. NSDI 8:337–350

    Google Scholar 

  5. Chieu TC, Mohindra A, Karve AA, Segal A (2009) Dynamic scaling of web applications in a virtualized cloud computing environment. In: IEEE International Conference on, e-Business Engineering, 2009, ICEBE’09. IEEE, New Jersey, pp 281–286

  6. Di H, Yu H, Anand V, Li L, Sun G, Dong B (2012) Efficient online virtual network mapping using resource evaluation. J Netw Syst Manag 20(4):468–488. doi:10.1007/s10922-012-9249-x

    Article  Google Scholar 

  7. Elnozahy M, Kistler M, Rajamony R (2003) Energy conservation policies for web servers. In: Proceedings of the 4th Conference on USENIX Symposium on Internet Technologies and Systems, vol 4, USITS’03, pp 8. USENIX Association, Berkeley, CA, USA. http://dl.acm.org/citation.cfm?id=1251460.1251468

  8. Goudarzi H, Ghasemazar M, Pedram M (2012) SLA-based Optimization of Power and Migration Cost in Cloud Computing. In: 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012). IEEE, New Jersey, pp 172–179. doi:10.1109/CCGrid.2012.112

  9. Guazzone M, Anglano C, Canonico M (2011) Energy-Efficient Resource Management for Cloud Computing Infrastructures. In: 2011 IEEE Third International Conference on Cloud Computing Technology and Science. IEEE, New Jersey, pp 424–431. doi:10.1109/CloudCom.2011.63

  10. Guenter B, Jain N, Williams C (2011) Managing cost, performance, and reliability tradeoffs for energy-aware server provisioning. In: 2011 Proceedings IEEE INFOCOM. IEEE, New Jersey, pp 1332–1340. doi:10.1109/INFCOM.2011.5934917

  11. Horvath T, Abdelzaher T, Skadron K, Liu X (2007) Dynamic voltage scaling in multitier web servers with end-to-end delay control. IEEE Trans Comput 56(4):444–458

    Article  MathSciNet  Google Scholar 

  12. Hsu CH, Chen SC, Lee CC, Chang HY, Lai KC, Li KC, Rong C (2011) Energy-Aware Task Consolidation Technique for Cloud Computing. In: 2011 IEEE Third International Conference on Cloud Computing Technology and Science. IEEE, New Jersey, pp 115–121. doi:10.1109/CloudCom.2011.25

  13. Ilyas MS, Raza S, Chen CC, Uzmi ZA, Chuah CN (2012) RED-BL: Energy solution for loading data centers. In: 2012 Proceedings IEEE INFOCOM. IEEE, New Jersey, pp 2866–2870. doi:10.1109/INFCOM.2012.6195717

  14. Intel (2004) Enhanced Intel(R) SpeedStep(R) Technology for the Intel(R) Pentium(R) M Processor. http://www.intel.com/design/intarch/papers/301174.htm

  15. Kleinrock L (1975) Queueing systems. volume 1: Theory. Wiley-Interscience

  16. Kusic D, Kephart JO, Hanson JE, Kandasamy N, Jiang G (2009) Power and performance management of virtualized computing environments via lookahead control. Clust Comput 12(1):1–15

    Article  Google Scholar 

  17. von Laszewski G, Wang L, Younge AJ, He X (2009) Power-aware scheduling of virtual machines in dvfs-enabled clusters. In: IEEE International Conference on Cluster Computing and Workshops, 2009, CLUSTER’09. IEEE, New Jersey, pp 1–10

  18. Leon X, Navarro L (2011) Limits of energy saving for the allocation of data center resources to networked applications. In: 2011 Proceedings IEEE INFOCOM. IEEE, New Jersey, pp 216–220. doi:10.1109/INFCOM.2011.5935029

  19. Lin M, Wierman A, Andrew LLH, Thereska E (2011) Dynamic right-sizing for power-proportional data centers. In: 2011 Proceedings IEEE INFOCOM. IEEE, New Jersey, pp 1098–1106. doi:10.1109/INFCOM.2011.5934885

  20. Lu T, Chen M (2012) Simple and effective dynamic provisioning for power-proportional data centers. In: IEEE 2012 46th Annual Conference on Information Sciences and Systems (CISS). IEEE, New Jersey, pp 1–6

  21. Magklis G, Semeraro G, Albonesi DH, Dropsho SG, Dwarkadas S, Scott ML (2003) Dynamic frequency and voltage scaling for a multiple-clock-domain microprocessor. IEEE Micro 23(6):62–68

    Article  Google Scholar 

  22. Meng X, Pappas V, Zhang L (2010) Improving the Scalability of Data Center Networks with Traffic-aware Virtual Machine Placement. In: INFOCOM, 2010 Proceedings. IEEE, New Jersey, pp 1–9

  23. Padala P, Hou KY, Shin KG, Zhu X, Uysal M, Wang Z, Singhal S, Merchant A (2009) Automated control of multiple virtualized resources. In: Proceedings of the 4th ACM European conference on Computer systems, EuroSys ’09. New York, pp 13–26

  24. Petrucci V, Carrera EV, Loques O, Leite JC, Mossé D (2011) Optimized management of power and performance for virtualized heterogeneous server clusters. In: 2011 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid). IEEE, New Jersey, pp 23–32

  25. Sun G, Yu H, Anand V, Li L (2013) A cost efficient framework and algorithm for embedding dynamic virtual network requests. Future Generation Computer Systems 29(5):1265–1277. Special section: Hybrid Cloud Computing. doi:10.1016/j.future.2012.08.002. http://www.sciencedirect.com/science/article/pii/S0167739X12001586

  26. Viswanathan H, Lee E, Rodero I, Pompili D, Parashar M, Gamell M (2011) Energy-Aware Application-Centric VM Allocation for HPC Workloads. In: IEEE International Symposium on Parallel and Distributed Processing Workshops and Phd Forum. IEEE, New Jersey, pp 890–897. doi:10.1109/IPDPS.2011.234

  27. Wang M, Meng X, Zhang L (2011) Consolidating virtual machines with dynamic bandwidth demand in data centers. In: 2011 Proceedings IEEE INFOCOM. IEEE, New Jersey, pp 71–75. doi:10.1109/INFCOM.2011.5935254

  28. Wee S, Liu H (2010) Client-side load balancer using cloud. In: Proceedings of the 2010 ACM Symposium on Applied Computing. ACM, New York, pp 399–405

  29. Yu H, Anand V, Qiao C, Di H, Wei X (2011) A cost efficient design of virtual infrastructures with joint node and link mapping. J Netw Syst Manag 20(1):97–115. doi:10.1007/s10922-011-9209-x

    Article  Google Scholar 

Download references

Acknowledgments

This work is supported in part by the 973 Program under Grant no. 2013CB329103, the 863 Program under Grant no. 2015AA016102, the National Natural Science Foundation of China under Grant no. 61271171, the Open Foundation of State Key Laboratory of Networking and Switching Technology under Grant no. SKLNST-2014-1-09, the Huawei Research funding No. YB2013120161, and the Ralph E. Powe Junior Faculty Enhancement Award from Oak Ridge Associated Universities.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Liu Liu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, L., Xu, J., Yu, H. et al. VMSA: a performance preserving online VM splitting and placement algorithm in dynamic cloud environments. J Supercomput 72, 3169–3193 (2016). https://doi.org/10.1007/s11227-015-1590-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-015-1590-x

Keywords

Navigation