TL;DR: A strategy-proof, VCG-based resource pricing scheme for resource allocation in dynamic markets where users behave rationally in meeting their own interest, as compared to both traditional and combinatorial auctions.
Abstract: Resource sharing on the Internet is becoming increasingly pervasive. Recently, there is growing interest in distributed systems such as peer-to-peer and grid, with efforts being directed towards resource allocation strategies that incentivize users to share resources. While combinatorial auctions can perform multiple resource type allocations, it is computationally a NP-complete problem. Thus, allocation in large distributed resource sharing systems focuses mainly on a single resource type. We propose a strategy-proof, VCG-based resource pricing scheme for resource allocation in dynamic markets where users behave rationally in meeting their own interest. Our mechanism is designed to meet the needs of large distributed systems, delivering the following key properties: multiple resource type allocations, individual rationality, incentive compatibility for both buyers and sellers, budget balance and computational efficiency. Simulation evaluation of our prototype based on a centralized implementation demonstrates the viability of our approach, as compared to both traditional and combinatorial auctions.
Currently, there is growing interest in large scale resource sharing [5].
Users of such systems share their resources such as compute cycles, files, and bandwidth, while benefiting from the services provided by the network.
Increasingly, peer-to-peer systems, mobile computing, e-commerce and grid computing develop into such multi-agent systems where each entity tries to maximize its own benefit [5, 17].
The authors investigate how mechanism design and computational economies can be used to create a pricing scheme for strategy-proof resource allocation, both fast and efficient in the context of large distributed systems where an agent can both provide and consume resources of more than one type.
Section 5 presents a summary of related work, and Section 6 concludes this paper.
2 Preliminaries
A market refers to the environment, expressed in terms of rules and mechanisms, where resources within an economy are exchanged.
Different markets may employ distinct mechanisms for setting the prices of the traded resources.
The allocation with the best economic efficiency, also called Pareto-optimal, is achieved when, given an allocation, no Pareto improvement can be performed [6].
Informally, best economic efficiency is achieved when social welfare is maximized.
The concept of economic efficiency is different from the engineering approach commonly used in computer science.
2.1 Mechanism Design
The authors use mechanism design [12] as a framework to create an incentive compatible pricing scheme for resource allocation.
This section provides an overview of essential concepts in mechanism design and introduces the notations used in their proofs.
Thus, by ensuring that agents stand to gain from participation, the mechanism provides incentives for rational agents to get resources and requests into the system.
A Pareto-optimal resource allocation is achieved when the total welfare of all agents is maximized.
Indeed, VCG mechanisms are not budget-balanced [13] and require a third-party agent (called a market-maker) to mediate between seller and buyer agents and to provide the surplus or deficit budget.
3 Proposed Pricing Mechanism
Resource allocation is a complex process, which can be divided in several independent steps, such as resource location, pricing, allocation administration, etc.
Thus, the authors consider a virtual economy in which common currency provides the basis for a utilitarian function that can be exploited by their mechanism.
Market-based Resource Allocation Problem Given a market containing requests submitted by buyers and resources offered by sellers, each participant is modeled by a rational agent i with private information ti.
This is an optimization problem, since the output specification is given by a positive real valued objective function, g(x, t), and the output ominimizes g, also known as More formally.
An allocation is determined by a market-maker agent and represents an exchange between one buyer agent and at least one seller agent.
3.1 Winner Determination for Multiple Resource Types
The authors scheme is designed for pricing and allocation of multiple resource types in dynamic markets, where buyer and seller agents may join and leave at any time.
The authors describe the buyer request and seller available resource, and their strategy for selecting winners.
The authors use tRdb to denote the buyer’s maximum declared price, as opposed to tRb which is the private maximum price.
Furthermore, the authors present the proofs for the properties achieved by their mechanism.
3.4 Achieved Properties
Theorem 1. The proposed mechanism is individual rational.
From Equation 3, the authors see that seller utility is always positive.
3.5 Generalized Algorithm and Example
Assume a market consisting of buyer requests and seller available resources published to a market-maker agent, together with their reserved prices, ti (private information).
For each resource type (line 4), the market-maker sorts the seller queue for that resource type based on the reserved price, ts (line 5).
Finally, the authors compute the buyer payment pb (line 13) and inform the winners of the allocation if their welfare is greater than 0 (lines 14–15).
A solution that is pareto-optimal, but not budget-balanced, may be achieved using VCG payments for both buyers and sellers, as below.
4 Evaluation
Welfare measures the economic efficiency and the algorithm runtime represents the computational efficiency.
Global efficiency for buyers is defined as the total number of successful buyer requests, and for sellers as the average resource utilization of all seller agents, i.e. total resources utilized over total available seller resources.
Using simulation, the authors first compare their mechanism with traditional auctions.
The authors evaluate the impact of untruthful users in a balanced market under different market conditions.
For simplicity, the authors consider a centralized implementation characterized by a single market-maker agent to which sellers and buyers submit their requests and available resources.
4.1 Comparison with Traditional Auctions
For comparison with traditional one-sided auctions, the authors have developed a discrete-event auctions simulator with a request queue holding all outstanding buyer requests, and a resource queue containing seller agents published resources.
First, the authors consider a balanced market to study the impact of untruthfulness on global efficiency of buyers, i.e. total number of successful buyer requests.
Next, the authors compare the proposed scheme with traditional onesided auctions under different market scenarios.
Market conditions are modeled by varying the arrival rates of buyers and sellers.
Table 4 compares 10,000 buyer requests under different market scenarios and with different market diversity.
4.2 Comparison with Combinatorial Auctions
In this section the authors compare the proposed scheme with combinatorial auctions using the open-source combinatorial auctions simulator jCase [16].
The authors select for comparison the pure VCG and the Threshold algorithms proposed by Parkes et al. [13].
Each buyer request consists of many resource types sampled from a uniform distribution between 1 and 10.
Overall, their scheme is comparable to combinatorial auctions both in economic efficiency, measured in terms of overall welfare, and global efficiency, average seller resource utilization and percentage of successful buyer requests.
1The authors experiments are performed on a 8-core Intel Xeon, 1.86 GHz server with 4GB RAM.
5 Related Work
Spawn [18] is one of the first implementations of a marketbased system that utilizes idle computer resources in a distributed network.
Thus, many of such systems [8, 14, 18] focus on allocating only one type of resource such as CPU cycles.
The combinatorial auction scheme [9, 11] addresses resource allocation for multiple resource types.
Systems designed to allocate “bundles” of resources include Bellagio [1] and Mirage [3].
The authors model is designed for such dynamic markets and achieves key properties such as incentive compatibility, budget balance and computational efficiency.
TL;DR: The results proved that the combinatorial double auction-based resource allocation model is an appropriate market-based model for cloud computing because it allows double-sided competition and bidding on an unrestricted number of items, which causes it to be economically efficient.
Abstract: Users and providers have different requirements and objectives in an investment market. Users will pay the lowest price possible with certain guaranteed levels of service at a minimum and providers would follow the strategy of achieving the highest return on their investment. Designing an optimal market-based resource allocation that considers the benefits for both the users and providers is a fundamental criterion of resource management in distributed systems, especially in cloud computing services. Most of the current market-based resource allocation models are biased in favor of the provider over the buyer in an unregulated trading environment. In this study, the problem was addressed by proposing a new market model called the Combinatorial Double Auction Resource Allocation (CDARA), which is applicable in cloud computing environments. The CDARA was prototyped and simulated using CloudSim, a Java-based simulator for simulating cloud computing environments, to evaluate its efficiency from an economic perspective. The results proved that the combinatorial double auction-based resource allocation model is an appropriate market-based model for cloud computing because it allows double-sided competition and bidding on an unrestricted number of items, which causes it to be economically efficient. Furthermore, the proposed model is incentive-compatible, which motivates the participants to reveal their true valuation during bidding.
261 citations
Cites background from "A Strategy-proof Pricing Scheme for..."
...In 2009, the Vickrey–Clarke–Groves (VCG) resource pricing scheme was proposed for resource allocation in dynamic markets [11]....
[...]
...[11] Grid U U...
[...]
...However, this scheme considered the allocation of only one resource instead of multiple resources [11]....
TL;DR: This paper presents a dyanmic pricing scheme suitable for rational users requests containing multiple resource types, and shows that user welfare and the percentage of successful requests is increased by using dynamic pricing.
Abstract: Current large distributed systems allow users to share and trade resources. In cloud computing, users purchase different types of resources from one or more resource providers using a fixed pricing scheme. Federated clouds, a topic of recent interest, allows different cloud providers to share resources for increased scalability and reliability. However, users and providers of cloud resources are rational and maximize their own interest when consuming and contributing shared resources. In this paper, we present a dyanmic pricing scheme suitable for rational users requests containing multiple resource types. Using simulations, we compare the efficiency of our proposed strategy-proof dynamic scheme with fixed pricing, and show that user welfare and the percentage of successful requests is increased by using dynamic pricing.
199 citations
Cites background or methods from "A Strategy-proof Pricing Scheme for..."
...Auctions are usually carried out by a third party, called the market-maker, which collects the bids, selects the winners and computes the payments....
[...]
...Publish and request messages are sent to the market-maker node using the FreePastry routing process, which then performs the reverse auctions using the first-come-firstserve policy and computes the payments using the algorithm described in [12]....
TL;DR: This paper proposes a dynamic pricing mechanism for the allocation of shared resources, and performs both theoretical and simulation analysis to evaluate the economic and computational efficiency of the allocation and the scalability of the mechanism.
Abstract: There is growing interest in large-scale systems where globally distributed and commoditized resources can be shared and traded, such as peer-to-peer networks, grids, and cloud computing. Users of these systems are rational and maximize their own interest when consuming and contributing shared resources, even if by doing so they affect the overall efficiency of the system. To manage rational users, resource pricing and allocation can provide the necessary incentives for users to behave such that the overall efficiency can be maximized. In this paper, we propose a dynamic pricing mechanism for the allocation of shared resources, and evaluate its performance. In contrast with several existing trading models, our scheme is designed to allocate a request with multiple resource types, such that the user does not have to aggregate different resource types manually. We formally prove the economic properties of our pricing scheme using the mechanism design framework. We perform both theoretical and simulation analysis to evaluate the economic and computational efficiency of the allocation and the scalability of the mechanism. Our simulations are validated against a prototype implementation on PlanetLab.
40 citations
Cites methods from "A Strategy-proof Pricing Scheme for..."
...…allows us to analyze the performance of the proposed pricing scheme in two different environments: the Free Pastry simulator, where we can simulate a large resource market, and PlanetLab, where we deploy our framework to validate the simulator results on a smaller number of distributed nodes....
TL;DR: This paper proposes a dynamic pricing scheme for multiple types of shared resources in federated clouds and evaluates its performance, and shows that the user utility is increased, while the percentage of successful buyer requests and the Percentage of allocated seller resources is higher with dynamic pricing.
Abstract: There is growing interest in large-scale resource sharing with emerging architectures such as cloud computing, where globally distributed and commoditized resources can be shared and traded Federated clouds, a topic of recent interest, aims to integrate different types of cloud resources from different providers, to increase scalability and reliability In federated clouds, users are rational and maximize their own interest when consuming and contributing shared resources, while globally distributed resource supply and demand changes as users join and leave the cloud dynamically over time In this paper, we propose a dynamic pricing scheme for multiple types of shared resources in federated clouds and evaluate its performance Fixed pricing, currently used by cloud providers, does not reflect the dynamic resource price due to the changes in supply and demand Using simulations, we compare the economic and computational efficiencies of our proposed dynamic pricing scheme with fixed pricing We show that the user utility is increased, while the percentage of successful buyer requests and the percentage of allocated seller resources is higher with dynamic pricing.
TL;DR: Effective and efficient economics-inspired double-sided mechanisms, focussing on attaining the allocative efficiency and truthfulness, are proposed, maintaining Budget-Balance, Individual Rationality, Computational Tractability, and Truthfulness for single-minded buyers.
Abstract: The increasingly growing supply and demand for infrastructure as a service (IaaS) makes cloud trading possible in an open exchange (OCX) marketplace. The mechanisms based on economic principles show promise in addressing the problem of efficient cloud resource provisioning in such a marketplace, including resources allocation and pricing. Therefore, this article proposes effective and efficient economics-inspired double-sided mechanisms, focussing on attaining the allocative efficiency and truthfulness. Given non-deterministic polynomial time (NP) complexity of the considered problem and the computational tractability requirement for the practical solutions, we design and evaluate the approximation mechanisms for such markets. We propose a combinatorial greedy allocation mechanism to determine the distribution of cloud resources based on the sorted order of allocation candidates. We design the pricing mechanisms that derive the buyer prices based on critical-value, and the seller payments are determined via a mixed surplus-distribution rule that relies on direct and proportional-value payment. The theoretical analysis of the economic properties proves that the proposed mechanisms maintain Budget-Balance (BB), Individual Rationality (IR), Computational Tractability (CT), and achieve Truthfulness (T) for single-minded buyers. The experimental investigation of the approximation quality and the seller strategic manipulation reveal near-optimal allocation performance and near-truthful strategic incentive in our pricing mechanisms.
TL;DR: This paper analyzes the problem of inducing the members of an organization to behave as if they formed a team and exhibits a particular set of compensation rules, an optimal incentive structure, that leads to team behavior.
Abstract: This paper analyzes the problem of inducing the members of an organization to behave as if they formed a team. Considered is a conglomerate-type organization consisting of a set of semi-autonomous subunits that are coordinated by the organization's head. The head's incentive problem is to choose a set of employee compensation rules that will induce his subunit managers to communicate accurate information and take optimal decisions. The main result exhibits a particular set of compensation rules, an optimal incentive structure, that leads to team behavior. Particular attention is directed to the informational aspects of the problem. An extended example of a resource allocation model is discussed and the optimal incentive structure is interpreted in terms of prices charged by the head for resources allocated to the subunits.
3,347 citations
"A Strategy-proof Pricing Scheme for..." refers background in this paper
...However, one thing to note is that achieving pareto-optimality usually requires an algorithm with exponential complexity, making the trade-off both in terms of budget-balance (-2-2+5 yields in $1 deficit in the case of VCG payments), and computational efficiency....
TL;DR: In this article, the seller's valuation and the buyer's valuation for a single object are assumed to be independent random variables, and each individual's valuation is unknown to the other.
Abstract: We consider bargaining problems between one buyer and one seller for a single object. The seller’s valuation and the buyer’s valuation for the object are assumed to be independent random variables, and each individual’s valuation is unknown to the other. We characterize the set of allocation mechanisms that are Bayesian incentive compatible and individually rational, and show the general impossibility of ex post efficient mechanisms without outside subsidies. For a wide class of problems we show how to compute mechanisms that maximize expected total gains from trade, and mechanisms that can maximize a broker’s expected profit. Journal of Economic Literature Classification Number: 026.
2,435 citations
"A Strategy-proof Pricing Scheme for..." refers background in this paper
...However, one thing to note is that achieving pareto-optimality usually requires an algorithm with exponential complexity, making the trade-off both in terms of budget-balance (-2-2+5 yields in $1 deficit in the case of VCG payments), and computational efficiency....
[...]
...However, it has been shown that no budgetbalanced system that provides incentives can maximize the overall welfare [10]....
TL;DR: This work considers algorithmic problems in a distributed setting where the participants cannot be assumed to follow the algorithm but rather their own self-interest, and suggests a framework for studying such algorithms.
Abstract: We consider algorithmic problems in a distributed setting where the participants cannot be assumed to follow the algorithm but rather their own self-interest. As such participants, termed agents, are capable of manipulating the algorithm, the algorithm designer should ensure in advance that the agents' interests are best served by behaving correctly. Following notions from the field of mechanism design, we suggest a framework for studying such algorithms. Our main technical contribution concerns the study of a representative task scheduling problem for which the standard mechanism design tools do not suffice. Journal of Economic Literature Classification Numbers: C60, C72, D61, D70, D80.
TL;DR: The algorithm allows combinatorial auctions to scale up to significantly larger numbers of items and bids than prior approaches to optimal winner determination by capitalizing on the fact that the space of bids is sparsely populated in practice.
Abstract: Combinatorial auctions, that is, auctions where bidders can bid on combinations of items, tend to lead to more efficient allocations than traditional auction mechanisms in multi-item auctions where the agents' valuations of the items are not additive. However, determining the winners so as to maximize revenue is NP-complete. First, we analyze existing approaches for tackling this problem: exhaustive enumeration, dynamic programming, and restricting the allowable combinations. Second, we study the possibility of approximate winner determination, proving inapproximability in the general case, and discussing approximation algorithms for special cases. We then present our search algorithm for optimal winner determination. Experiments are shown on several bid distributions which we introduce. The algorithm allows combinatorial auctions to scale up to significantly larger numbers of items and bids than prior approaches to optimal winner determination by capitalizing on the fact that the space of bids is sparsely populated in practice. The algorithm does this by provably sufficient selective generation of children in the search tree, by using a secondary search for fast child generation, by using heuristics that are admissible and optimized for speed, and by preprocessing the search space in four ways. Incremental winner determination and quote computation techniques are presented.
TL;DR: The proposed Nimrod/G grid-enabled resource management and scheduling system builds on the earlier work on Nimrod and follows a modular and component-based architecture enabling extensibility, portability, ease of development, and interoperability of independently developed components.
Abstract: The availability of powerful microprocessors and high-speed networks as commodity components has enabled high-performance computing on distributed systems (wide-area cluster computing). In this environment, as the resources are usually distributed geographically at various levels (department, enterprise or worldwide), there is a great challenge in integrating, coordinating and presenting them as a single resource to the user, thus forming a computational grid. Another challenge comes from the distributed ownership of resources, with each resource having its own access policy, cost and mechanism. The proposed Nimrod/G grid-enabled resource management and scheduling system builds on our earlier work on Nimrod (D. Abramson et al., 1994, 1995, 1997, 2000) and follows a modular and component-based architecture enabling extensibility, portability, ease of development, and interoperability of independently developed components. It uses the GUSTO (GlobUS TOolkit) services and can be easily extended to operate with any other emerging grid middleware services. It focuses on the management and scheduling of computations over dynamic resources scattered geographically across the Internet at department, enterprise or global levels, with particular emphasis on developing scheduling schemes based on the concept of computational economy for a real testbed, namely the Globus testbed (GUSTO).