ABSTRACT
Virtual machine (VM) consolidation has become increasingly important for improving efficiencies of resource usage and power consumption in datacenters. Previous work has addressed the problem of placing and replacing VMs in servers, in order to optimize resource management for different criteria, including performance, power and temperature. However, most work has focused on optimizing only one or at most two of these criteria, by separately managing either the platform layer (e.g., power and thermal management) or the virtualization layer (e.g., application performance management). In this paper, a cross-layer control system is proposed to manage the dynamic mapping of VMs to physical resources. The controller unifies the information from different layers to determine control actions such as when, which and where VMs need to be moved, optimizing multiple and potentially conflicting goals. A prototype of the proposed controller and two other competing ones (one without stabilization and the other using a single-objective approach) are implemented on an IBM BladeCenter. Experimental evaluations are conducted using a mix of types of workloads to emulate the variety and dynamics of datacenter workloads. The results indicate that the proposed multi-objective optimization with stabilization significantly reduces unnecessary VM migration by up to 80%, avoids unstable host selection, and also improves the application performance by up to 30% and the efficiencies of power usage by up to 20%.
- R. Bianchini and R. Rajamony, "Power and Energy Management for Server Systems," IEEE Computer, volume 37, number 11, 2004. Google ScholarDigital Library
- N. Bobroff, A. Kochut, and K. Beaty, "Dynamic placement of virtual machines for managing SLA violations," in Proc. of 10th IFIP/IEEE International Symposium on Integrated Network Management, 2007.Google Scholar
- M. Cardosa, M. Korupolu, and A. Singh, "Shares and utilities based power consolidation in virtualized server environments," in Proc. of the 11th IFIP/IEEE intern. conf. on Integrated Network Management. Google ScholarDigital Library
- Y. Chen, D. Gmach, C. Hyser, Z. Wang, C. Bash, C. Hoover, S. Singhal, "Integrated Management of Application Performance, Power and Cooling in Data Centers," in Proc. of 2010 IEEE/IFIP Network Operations and Management Symposium, 2010.Google Scholar
- C. Clark, K. Fraser, S. Hand, J. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield. "Live migration of virtual machines," in Proc. of 2nd Symp. on Networked Systems Design & Implementation USENIX. Google ScholarDigital Library
- M. Elnozahy, M. Kistler, and R. Rajamony, "Energy-Efficient Server Clusters," in Proceedings of the Second Workshop on Power Aware Computing Systems, 2002. Google ScholarDigital Library
- X. Fan, W.Weber, and L.Barroso, "Power provisioning for a warehouse-sized computer," in Proc. of the 34th annual international symposium on Computer architecture, 2007. Google ScholarDigital Library
- I. Hermenier, X. Lorca, J. Menaud, G. Muller, and J. Lawall, "Entropy: a consolidation manager for clusters," In Proc. of the 2009 ACM SIGPLAN/SIGOPS international conference on Virtual execution environments (VEE '09). Google ScholarDigital Library
- G. Jung, M. Hiltunen, K. Joshi, R. Schlichting, and C. Pu, "Mistral: Dynamically Managing Power, Performance, and Adaptation Cost in Cloud Infrastructures", in Proceedings of the 30th IEEE International Conference on Distributed Computing Systems (ICDCS 2010). Google ScholarDigital Library
- K. Kant and J. Alexander, "Proactive vs. Reactive Idle Power Control," in Proc. of Design and Test Tech. Conf., 2008.Google Scholar
- A. Karve, T. Kimbrel, G. Pacifici, M. Spreitzer, M. Steinder, M. Sviridenko, and A. Tantawi, "Dynamic placement for clustered web applications", in Proc. of the 15th International Conf. on WWW, 2006. Google ScholarDigital Library
- G. Khanna, K. Beaty, G. Kar, and A. Kochut, "Application performance management in virtualized server environments," in Proc. of the IEEE Network Ops. and Mgmt. Sym., Apr. 2006.Google Scholar
- A. Krum, F. Kreith, ed., "The CRC Handbook of Thermal Engineering," CRC Press, 2000, pp. 2.1--2.92.Google Scholar
- S. Kumar, V. Talwar, V. Kumar, P. Ranganathan, and K. Schwan, "vManage: loosely coupled platform and virtualization management in data centers", in Proc. of the 6th international conf. on Autonomic computing (ICAC '09). Google ScholarDigital Library
- C. Lien, Y. Bai, and M. Lin, "Estimation by Software for the Power Consumption," IEEE Trans. On Instrumentation and Measurement, Vol 56, No 5, October 2007.Google Scholar
- M. Y. Lim, F. Rawson, T. Bletsch, and V. Freeh, "PADD: Power-Aware Domain Distribution," In Proc. Of the 29th International Conference on Distributed Computing Systems (ICDCS 2009). Google ScholarDigital Library
- J. Moore, J. Chase, P. Ranganathan, and R. Sharma, "Making scheduling "cool": temperature-aware workload placement in data centers," in Proceedings of the annual conference on USENIX Annual Technical Conference (ATEC '05). Google ScholarDigital Library
- P. Padala, K. Shin, X. Zhu, M. Uysal, Z. Wang, S. Singhal, A. Merchant, and K. Salem, "Adaptive control of virtualized resources in utility computing environments," EuroSys 2007. Google ScholarDigital Library
- P. Ranganathan, P. Leech, D. Irwin, and J. Chase, "Ensemble-level Power Management for Dense Blade Servers," in Proc. of the 33rd annual international symposium on Computer Architecture, 2006. Google ScholarDigital Library
- L. Ramos and R. Bianchini, "C-Oracle: Predictive Thermal Management for Data Centers," in Proc. of the 14th International Symposium on High-Performance Computer Architecture (HPCA 14).Google Scholar
- Q. Tang, S. Gupta and G. Varsamopoulos, "Energy-Efficient, Thermal-Aware Task Scheduling for Homogeneous, High Performance Computing Data Centers: A Cyber-Physical Approach," Transactions on Parallel and Distributed Systems, 19:(11) 2008. Google ScholarDigital Library
- A. Verma, G. Dasgupta, T. Nayak, P. De, and R. Kothari, "Server Workload Analysis for Power Minimization using Consolidation," Usenix ATC, 2009. Google ScholarDigital Library
- A. Verma, P. Ahuja, and A. Neogi, "pMapper: power and migration cost aware application placement in virtualized systems," in Proc. of the 9th ACM/IFIP/USENIX International Conf on Middleware, 2008. Google ScholarDigital Library
- T. Wood, P. Shenoy, A. Venkataramani, and M. Yousif "Black-box and Gray-box Strategies for Virtual Machine Migration", in Proceedings of the Fourth Symposium on Networked Systems Design and Implementation (NSDI), 2007. Google ScholarDigital Library
- J. Xu and J. Fortes, "Multi-objective Virtual Machine Placement in Virtualized Data Center Environments," accepted by the 2010 IEEE/ACM International Conference on Green Computing and Communications (GreenCom2010). Google ScholarDigital Library
- L. Yang, I. Foster, and J. Schopf, "Homeostatic and Tendency-Based CPU Load Predictions," in Proc. of the 17th international Symposium on Parallel and Distributed Processing, 2003. Google ScholarDigital Library
- http://www.lm-sensors.org/Google Scholar
Index Terms
- A multi-objective approach to virtual machine management in datacenters
Recommendations
Urgent Virtual Machine Eviction with Enlightened Post-Copy
VEE '16Virtual machine (VM) migration demands distinct properties under resource oversubscription and workload surges. We present enlightened post-copy, a new mechanism for VMs under contention that evicts the target VM with fast execution transfer and short ...
Urgent Virtual Machine Eviction with Enlightened Post-Copy
VEE '16: Proceedings of the12th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution EnvironmentsVirtual machine (VM) migration demands distinct properties under resource oversubscription and workload surges. We present enlightened post-copy, a new mechanism for VMs under contention that evicts the target VM with fast execution transfer and short ...
Virtual Machine Migration Method between Different Hypervisor Implementations and Its Evaluation
WAINA '12: Proceedings of the 2012 26th International Conference on Advanced Information Networking and Applications WorkshopsVirtualization technologies are an important building block for cloud services. Each service will run on virtual machines (VMs) deployed over different hyper visors in the future. Therefore, a VM migration method between different hyper visor ...
Comments