Server consolidation with migration control for virtualized data centers

https://doi.org/10.1016/j.future.2011.04.016Get rights and content

Abstract

Virtualization has become a key technology for simplifying service management and reducing energy costs in data centers. One of the challenges faced by data centers is to decide when, how, and which virtual machines (VMs) have to be consolidated into a single physical server. Server consolidation involves VM migration, which has a direct impact on service response time. Most of the existing solutions for server consolidation rely on eager migrations, which try to minimize the number of physical servers running VMs. These solutions generate unnecessary migrations due to unpredictable workloads that require VM resizing. This paper proposes an LP formulation and heuristics to control VM migration, which prioritize virtual machines with steady capacity. We performed experiments using TU-Berlin and Google data center workloads to compare our migration control strategy against existing eager-migration-based solutions. We observed that avoiding migration of VMs with steady capacity reduces the number of migrations with minimal penalty in the number of physical servers.

Highlights

► An LP formulation and heuristics to enable dynamic consolidation controlling the migration of virtual machines with steady capacity demand. ► Detailed evaluation using workloads from real data centers: TU-Berlin and Google. ► As main finding: this work shows that avoiding migration of VMs with steady capacity reduces the number of migrations with minimal penalty for the number of physical servers.

Introduction

Virtualization has become a fundamental asset in several areas of Computer Science. Despite being an old concept (initially used by IBM 370 mainframes [1]), virtualization assists current organizations in dealing with problems such as unpredicted demand of computing resources, high management and energy costs, and security. As a consequence, there has been an increasing number of commercial and open-source software products (e.g. [2], [3], [4], [5]) and investments of major hardware companies to provide better support for virtualization in their products (e.g. [6], [7]).

One of the benefits of virtualization is the possibility of gathering several virtual machines (VMs) into a single physical server. This process, known as server consolidation, is used by data centers to increase resource utilization and reduce electric power consumption costs. Server consolidation is particularly important when user workloads are unpredictable and need to be revisited periodically. Whenever a user demand changes, VMs can be resized and migrated to other physical servers if necessary.

Our research hypothesis is that a more conservative approach can be used to provide steadier performance guarantees. Our proposal extends current server consolidation solutions by including constraints to define that virtual machines with steady usage are not migrated and virtual machines with variable capacity can be migrated to reduce the number of required physical servers. We call this new approach as dynamic consolidation with migration control. Thus, the contributions of this paper are (i) an LP formulation and heuristics to control VM migration, which prioritize virtual machines with steady capacity and (ii) an extensive evaluation based on TU-Berlin and Google data center workloads that compares our approach with existing ones and corroborates our research hypothesis.

The obtained results are encouraging, since they show that a more conservative migration approach can reduce the number of migrations with minimal penalty in the number of physical servers compared to eager-migration-based solutions [8], [9], [10], [11], [12], [13], [14], [15]. This research thus has a direct impact on service response times and cost saving in data centers.

Section snippets

Related work

There are several research groups in both academia and industry working on server consolidation [8], [9], [10], [11], [12], [13], [14], [15]. This section presents studies and systems from some of these groups.

Khanna et al. [8] proposed a dynamic management algorithm, which is triggered when a physical server becomes overloaded or underloaded. The main goals of their algorithm are to: (i) guarantee that SLAs are not violated (SLAs are specified considering mainly response time and throughput);

Server consolidation with migration control

Server consolidation aims at minimizing the number of physical servers required to host a group of virtual machines. This problem can be mapped to the multidimensional bin-packing problem [16]. In this problem, the goal is to map several items, where each item represents a tuple containing its dimensions, into the smallest number of bins as possible. In our case, we consider each virtual machine as an item and the dimensions as its capacities, and the goal is to minimize the number of physical

Evaluation

The evaluation of the LP and heuristic-based solutions for the dynamic consolidation with migration control problem was performed using two different workloads. The first workload is composed of traces from servers of the Technical University of Berlin (TU-Berlin), which are normally used by researchers and students to execute computational experiments. The second workload is composed of traces from Google servers. Both workloads present periodic samples of CPU and memory utilization for

Conclusions

Server consolidation allows data centers to increase resource utilization and reduce electric power consumption by gathering multiple virtual machines into physical servers. The consolidation process may involve resizing of virtual machines and their migration between physical servers. This process may then reduce the Quality-of-Service that users perceive from the environment and in worst scenarios violate SLAs. SLA (Service Level Agreement) is a formal contract between a consumer and a

Tiago C. Ferreto is an Assistant Professor in the Computer Science Department at the Pontifical Catholic University of Rio Grande do Sul (PUCRS), Brazil, where he obtained his Ph.D. in Computer Science (2010). His primary academic research interests are resource management, high performance computing, grid computing, cloud computing and virtualization.

References (22)

  • T. Wood et al.

    Sandpiper: black-box and gray-box resource management for virtual machines

    Computer Networks

    (2009)
  • R.J. Creasy

    The origin of the vm/370 time-sharing system

    IBM Journal of Research and Development

    (1981)
  • P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauery, I. Pratt, A. Warfield, Xen and the art of...
  • I. VMware, Vmware—virtualization software, 2009....
  • SWsoft, Welcome to openvz—server virtualization open source project, 2009....
  • Microsoft, Microsoft Hyper-V Server, 2009....
  • I. Corporation, Virtualization technologies from intel, 2009....
  • I. Advanced Micro Devices, Amd’s virtualization solutions, 2009....
  • G. Khanna, K. Beaty, G. Kar, A. Kochut, Application performance management in virtualized server environments, in:...
  • M. Bichler, T. Setzer, B. Speitkamp, Capacity planning for virtualized servers, in: Proceedings of the 16th Annual...
  • B. Speitkamp, M. Bichler, A mathematical programming approach for server consolidation problems in virtualized data...
  • Cited by (0)

    Tiago C. Ferreto is an Assistant Professor in the Computer Science Department at the Pontifical Catholic University of Rio Grande do Sul (PUCRS), Brazil, where he obtained his Ph.D. in Computer Science (2010). His primary academic research interests are resource management, high performance computing, grid computing, cloud computing and virtualization.

    Marco A.S. Netto received his Ph.D. in Computer Science from the University of Melbourne, Australia (2010), and Bachelor’s (2002) and Master’s degree (2004) in Computer Science, both from the Pontifical Catholic University of Rio Grande do Sul (PUCRS), Brazil. He has been working with resource management and job scheduling for high performance computing environments since 2000. Marco’s current research effort is on performance evaluation of systems on virtualized environments and SLA management policies.

    Rodrigo N. Calheiros obtained his Ph.D. degree in Computer Science from Pontifical Catholic University of Rio Grande do Sul (PUCRS), Porto Alegre, Brazil. He received his Master’s degree from the same university in 2006. He currently holds a post-doctoral researcher position at the University of Melbourne, Australia. His research interests include resource management and scheduling, application of virtualization, and programming in grid computing and distributed systems.

    César A.F. De Rose is an Associate Professor in the Computer Science Department at the Pontifical Catholic University of Rio Grande do Sul (PUCRS), Porto Alegre, Brazil. His primary research interests are parallel and distributed computing and parallel architectures. He is currently conducting research on a variety of topics applied to clusters and grids, including resource management, resource monitoring, distributed allocation strategies and virtualization. Dr. De Rose received his doctoral degree in Computer Science from the University Karlsruhe, Germany, in 1998.

    View full text