Application-Centric resource provisioning for amazon EC2 spot instances
Sunirmal Khatua,Nandini Mukherjee +1 more
- pp 267-278
Reads0
Chats0
TLDR
In this article, the authors study various checkpointing schemes to increase the reliability over spot instances and devise a novel checkpointing scheme on top of application-centric resource provisioning framework that increases the reliability while reducing the cost significantly.Abstract:
In late 2009, Amazon introduced spot instances to offer their unused resources at lower cost with reduced reliability. Amazon's spot instances allow customers to bid on unused Amazon EC2 capacity and run those instances for as long as their bid exceeds the current spot price. The spot price changes periodically based on supply and demand of spot instances, and customers whose bid exceeds it gain access to the available spot instances. Customers may expect their services at lower cost with spot instances compared to on-demand or reserved. However the reliability is compromised since the instances (IaaS) providing the service (SaaS) may become unavailable at any time without any notice to the customer. In this paper, we study various checkpointing schemes to increase the reliability over spot instances. Also we devise a novel checkpointing scheme on top of application-centric resource provisioning framework that increases the reliability while reducing the cost significantly.read more
Citations
More filters
Proceedings ArticleDOI
SpotOn: a batch computing service for the spot market
TL;DR: The design of a batch computing service for the spot market is presented, called SpotOn, that automatically selects a spot market and fault-tolerance mechanism to mitigate the impact of spot revocations without requiring application modification.
Proceedings ArticleDOI
SpotCheck: designing a derivative IaaS cloud on the spot market
TL;DR: This paper proposes a derivative cloud platform, called SpotCheck, that transparently manages the risks associated with using spot servers for users, and achieves nearly 5x cost savings compared to using equivalent types of on-demand VMs, and eliminates any risk of losing VM state.
Proceedings ArticleDOI
Flint: batch-interactive data-intensive processing on transient servers
TL;DR: Flint is designed, which is based on Spark and includes automated checkpointing and server selection policies that support batch and interactive applications and dynamically adapt to application characteristics, and yields cost savings of up to 90% compared to using on-demand servers.
Proceedings ArticleDOI
Exploiting Spot and Burstable Instances for Improving the Cost-efficacy of In-Memory Caches on the Public Cloud
TL;DR: This work devise novel ideas and enabling modeling and optimization techniques for combining conventional Amazon EC2 instances with the cheaper spot and burstable instances to overcome performance degradation resulting from spot instance revocations and implement all their ideas in an EC2-based memcached prototype.
Proceedings ArticleDOI
Exploiting redundancy for cost-effective, time-constrained execution of HPC applications on amazon EC2
Aniruddha Marathe,Rachel Harris,David K. Lowenthal,Bronis R. de Supinski,Barry Rountree,Martin Schulz +5 more
TL;DR: This work design and implement multiple techniques to reduce expected cost by exploiting redundancy in the EC2 spot market, and designs and implements an adaptive algorithm that selects a scheduling algorithm and determines the bid price.
References
More filters
Journal ArticleDOI
Xen and the art of virtualization
Paul Barham,Boris Dragovic,Keir Fraser,Steven Hand,Tim Harris,Alex Ho,Rolf Neugebauer,Ian Pratt,Andrew Warfield +8 more
TL;DR: Xen, an x86 virtual machine monitor which allows multiple commodity operating systems to share conventional hardware in a safe and resource managed fashion, but without sacrificing either performance or functionality, considerably outperform competing commercial and freely available solutions.
Proceedings ArticleDOI
Market-Oriented Cloud Computing: Vision, Hype, and Reality for Delivering IT Services as Computing Utilities
TL;DR: The need for convergence of competing IT paradigms for delivering the 21st century vision of computing is concluded.
Proceedings ArticleDOI
A Particle Swarm Optimization-Based Heuristic for Scheduling Workflow Applications in Cloud Computing Environments
TL;DR: This paper presents a particle swarm optimization (PSO) based heuristic to schedule applications to cloud resources that takes into account both computation cost and data transmission cost, and shows that PSO can achieve as much as 3 times cost savings as compared to BRS.
Market-Oriented Cloud Computing: Vision, Hype, and Reality for Delivering IT Services as Computing Utilities
TL;DR: The need for convergence of competing IT paradigms for delivering the 21st century vision of computing is concluded.
Proceedings ArticleDOI
Adaptive control of virtualized resources in utility computing environments
Pradeep Padala,Kang G. Shin,Xiaoyun Zhu,Mustafa Uysal,Zhikui Wang,Sharad Singhal,Arif Merchant,Kenneth Salem +7 more
TL;DR: An adaptive resource control system that dynamically adjusts the resource shares to individual tiers in order to meet application-level quality of service (QoS) goals while achieving high resource utilization in the data center is developed.