Server consolidation with migration control for virtualized data centers
01 Oct 2011-Future Generation Computer Systems (Elsevier Science Publishers B. V.)-Vol. 27, Iss: 8, pp 1027-1034
TL;DR: This paper proposes an LP formulation and heuristics to control VM migration, which prioritize virtual machines with steady capacity, and observes that avoiding migration of VMs with steadycapacity reduces the number of migrations with minimal penalty in thenumber of physical servers.
About: This article is published in Future Generation Computer Systems.The article was published on 2011-10-01. It has received 292 citations till now. The article focuses on the topics: Data migration & Server.
Citations
More filters
TL;DR: By addressing the whole service life cycle, taking into account several cloud architectures, and by taking a holistic approach to sustainable service provisioning, the toolkit aims to provide a foundation for a reliable, sustainable, and trustful cloud computing industry.
410 citations
TL;DR: A novel cloud brokering approach that optimizes placement of virtual infrastructures across multiple clouds and also abstracts the deployment and management of infrastructure components in these clouds.
366 citations
Cites background from "Server consolidation with migration..."
...[19] study various server consolidation schemes for data centers and compare a linear programming formulation for VM placement with greedy heuristics such as first-fit, best-fit, and worst-fit....
[...]
...Finally, we remark that heuristics such as greedy formulations [19] can be employed, with the potential to quickly solve very large scale problems....
[...]
TL;DR: The way LM and DR are currently being performed and their operation in long-distance networking environments are presented, discussing related issues and bottlenecks and surveying other works.
Abstract: We study the virtual machine live migration (LM) and disaster recovery (DR) from a networking perspective, considering long-distance networks, for example, between data centers. These networks are usually constrained by limited available bandwidth, increased latency and congestion, or high cost of use when dedicated network resources are used, while their exact characteristics cannot be controlled. LM and DR present several challenges due to the large amounts of data that need to be transferred over long-distance networks, which increase with the number of migrated or protected resources. In this context, our work presents the way LM and DR are currently being performed and their operation in long-distance networking environments, discussing related issues and bottlenecks and surveying other works. We also present the way networks are evolving today and the new technologies and protocols (e.g., software-defined networking, or SDN, and flexible optical networks) that can be used to boost the efficiency of LM and DR over long distances. Traffic redirection in a long-distance environment is also an important part of the whole equation, since it directly affects the transparency of LM and DR. Related works and solutions both from academia and the industry are presented.
331 citations
TL;DR: This paper reviews state-of-the-art bandwidth optimization schemes, server consolidation frameworks, DVFS-enabled power optimization, and storage optimization methods over WAN links and investigates the critical aspects of virtual machine migration schemes.
318 citations
Cites background or methods from "Server consolidation with migration..."
...LP-formulation (Ferreto et al., 2011) STATIC/ DYNAMIC N/A N/A YES CHB N/A...
[...]
...These attributes are either static (Ferreto et al., 2011) or dynamic (Beloglazov and Buyya, 2010c; Mi et al....
[...]
...Server consolidation frameworks (Beloglazov and Buyya, 2010a, 2010c, 2013; Ferreto et al., 2011; Kakadia et al., 2013) either consider pre-copy or post-copy migration patterns to move VMs across servers....
[...]
...Deciding on migration triggering based on heuristics approaches (Beloglazov and Buyya, 2010b; Ferreto et al., 2011; Huang et al., 2013) leads to unnecessary migration if not managed properly....
[...]
...Alternatively, a static (Ferreto et al., 2011) resource assignment policy configures VMs according to the workload's peak resource demand in a single step (Ferreto et al....
[...]
13 May 2013
TL;DR: Experimental results show the benefits of combining the allocation and migration algorithms and demonstrate their ability to achieve significant energy savings while maintaining feasible convergence times when compared with the best fit heuristic.
Abstract: This paper presents two exact algorithms for energy efficient scheduling of virtual machines (VMs) in cloud data centers. Modeling of energy aware allocation and consolidation to minimize overall energy consumption leads us to the combination of an optimal allocation algorithm with a consolidation algorithm relying on migration of VMs at service departures. The optimal allocation algorithm is solved as a bin packing problem with a minimum power consumption objective. It is compared with an energy aware best fit algorithm. The exact migration algorithm results from a linear and integer formulation of VM migration to adapt placement when resources are released. The proposed migration is general and goes beyond the current state of the art by minimizing both the number of migrations needed for consolidation and energy consumption in a single algorithm with a set of valid inequalities and conditions. Experimental results show the benefits of combining the allocation and migration algorithms and demonstrate their ability to achieve significant energy savings while maintaining feasible convergence times when compared with the best fit heuristic.
208 citations
Cites background from "Server consolidation with migration..."
...One of the closest work to our paper is found in [11]....
[...]
References
More filters
19 Oct 2003
TL;DR: Xen, an x86 virtual machine monitor which allows multiple commodity operating systems to share conventional hardware in a safe and resource managed fashion, but without sacrificing either performance or functionality, considerably outperform competing commercial and freely available solutions.
Abstract: Numerous systems have been designed which use virtualization to subdivide the ample resources of a modern computer. Some require specialized hardware, or cannot support commodity operating systems. Some target 100% binary compatibility at the expense of performance. Others sacrifice security or functionality for speed. Few offer resource isolation or performance guarantees; most provide only best-effort provisioning, risking denial of service.This paper presents Xen, an x86 virtual machine monitor which allows multiple commodity operating systems to share conventional hardware in a safe and resource managed fashion, but without sacrificing either performance or functionality. This is achieved by providing an idealized virtual machine abstraction to which operating systems such as Linux, BSD and Windows XP, can be ported with minimal effort.Our design is targeted at hosting up to 100 virtual machine instances simultaneously on a modern server. The virtualization approach taken by Xen is extremely efficient: we allow operating systems such as Linux and Windows XP to be hosted simultaneously for a negligible performance overhead --- at most a few percent compared with the unvirtualized case. We considerably outperform competing commercial and freely available solutions in a range of microbenchmarks and system-wide tests.
6,326 citations
02 May 2005
TL;DR: The design options for migrating OSes running services with liveness constraints are considered, the concept of writable working set is introduced, and the design, implementation and evaluation of high-performance OS migration built on top of the Xen VMM are presented.
Abstract: Migrating operating system instances across distinct physical hosts is a useful tool for administrators of data centers and clusters: It allows a clean separation between hard-ware and software, and facilitates fault management, load balancing, and low-level system maintenance.By carrying out the majority of migration while OSes continue to run, we achieve impressive performance with minimal service downtimes; we demonstrate the migration of entire OS instances on a commodity cluster, recording service downtimes as low as 60ms. We show that that our performance is sufficient to make live migration a practical tool even for servers running interactive loads.In this paper we consider the design options for migrating OSes running services with liveness constraints, focusing on data center and cluster environments. We introduce and analyze the concept of writable working set, and present the design, implementation and evaluation of high-performance OS migration built on top of the Xen VMM.
3,186 citations
"Server consolidation with migration..." refers background in this paper
...Similarly, Verma et al. [13] developed the pMapper architecture and a set of server consolidation algorithms for heterogeneous virtualized resources....
[...]
01 Dec 2008
TL;DR: This work investigates the design, implementation, and evaluation of a power-aware application placement controller in the context of an environment with heterogeneous virtualized server clusters, and presents the pMapper architecture and placement algorithms to solve one practical formulation of the problem: minimizing power subject to a fixed performance requirement.
Abstract: Workload placement on servers has been traditionally driven by mainly performance objectives. In this work, we investigate the design, implementation, and evaluation of a power-aware application placement controller in the context of an environment with heterogeneous virtualized server clusters. The placement component of the application management middleware takes into account the power and migration costs in addition to the performance benefit while placing the application containers on the physical servers. The contribution of this work is two-fold: first, we present multiple ways to capture the cost-aware application placement problem that may be applied to various settings. For each formulation, we provide details on the kind of information required to solve the problems, the model assumptions, and the practicality of the assumptions on real servers. In the second part of our study, we present the pMapper architecture and placement algorithms to solve one practical formulation of the problem: minimizing power subject to a fixed performance requirement. We present comprehensive theoretical and experimental evidence to establish the efficacy of pMapper.
938 citations
"Server consolidation with migration..." refers background in this paper
...Despite being an old concept (initially used by IBM 370 mainframes [1]), virtualization assists current organizations in dealing with problems such as unpredicted demand of computing resources, high management and energy costs, and security....
[...]
...Keywords: Server Consolidation, Virtualization, Data Centers, Migration Control 1Corresponding author: tiago.ferreto@pucrs.br Preprint submitted to Future Generation Computer Systems April 17, 2011...
[...]
IBM1
TL;DR: A dynamic server migration and consolidation algorithm is introduced and is shown to provide substantial improvement over static server consolidation in reducing the amount of required capacity and the rate of service level agreement violations.
Abstract: A dynamic server migration and consolidation algorithm is introduced. The algorithm is shown to provide substantial improvement over static server consolidation in reducing the amount of required capacity and the rate of service level agreement violations. Benefits accrue for workloads that are variable and can be forecast over intervals shorter than the time scale of demand variability. The management algorithm reduces the amount of physical capacity required to support a specified rate of SLA violations for a given workload by as much as 50% as compared to static consolidation approach. Another result is that the rate of SLA violations at fixed capacity may be reduced by up to 20%. The results are based on hundreds of production workload traces across a variety of operating systems, applications, and industries.
910 citations
"Server consolidation with migration..." refers background in this paper
...Despite being an old concept (initially used by IBM 370 mainframes [1]), virtualization assists current organizations in dealing with problems such as unpredicted demand of computing resources, high management and energy costs, and security....
[...]
...Keywords: Server Consolidation, Virtualization, Data Centers, Migration Control 1Corresponding author: tiago.ferreto@pucrs.br Preprint submitted to Future Generation Computer Systems April 17, 2011...
[...]
22 Nov 2009
TL;DR: In this paper, the authors evaluate the effects of live migration of virtual machines on the performance of applications running inside Xen VMs and show that, in most cases, migration overhead is acceptable but cannot be disregarded, especially in systems where availability and responsiveness are governed by strict Service Level Agreements.
Abstract: Virtualization has become commonplace in modern data centers, often referred as "computing clouds". The capability of virtual machine live migration brings benefits such as improved performance, manageability and fault tolerance, while allowing workload movement with a short service downtime. However, service levels of applications are likely to be negatively affected during a live migration. For this reason, a better understanding of its effects on system performance is desirable. In this paper, we evaluate the effects of live migration of virtual machines on the performance of applications running inside Xen VMs. Results show that, in most cases, migration overhead is acceptable but cannot be disregarded, especially in systems where availability and responsiveness are governed by strict Service Level Agreements. Despite that, there is a high potential for live migration applicability in data centers serving modern Internet applications. Our results are based on a workload covering the domain of multi-tier Web 2.0 applications.
609 citations