This chapter presents CloudBay, an online resource trading and leasing platform for multi-party resource sharing. It is a proof-of-concept design bridging the gap between resource providers and resource customers. With the help of CloudBay, the untapped computing power privately owned by multiple organizations is unleashed. The design and implementation of the CloudBay project presents the most challenge to our exploration of cost-effective resource management strategy design. Following a market-oriented design principle, CloudBay provides an abstraction of a shared virtual resource space across multiple administration domains, and features enhanced functionalities for scalable and automatic resource management and efficient service provisioning. CloudBay distinguishes itself from existing research and contributes in mainly two aspects. First, it leverages scalable network virtualization and self-configurable virtual appliances to facilitate resource federation and parallel application deployment. Second, CloudBay adopts an eBay-style transaction model that supports differentiated services with different levels of job priorities. For cost-sensitive users, CloudBay implements an efficient matchmaking algorithm based on the auction theory and enables opportunistic resource access through preemptive service scheduling. The proposed CloudBay platform stands between HPC service sellers and buyers, and offers a comprehensive solution for resource advertising and stitching, transaction management, and application-to-infrastructure mapping. In this chapter, we present the design details of CloudBay, and briefly discuss lessons learnt and challenges encountered in the implementation process.

Xiaolin Li

Papers

Flexible Resource Sharing Management