Journal ArticleDOI
Non zero-sum stochastic games in admission, service and routing control in queueing systems
TLDR
This paper investigates situations of non-cooperative dynamic control of queueing systems by two agents, having different objectives, and establishes the equilibrium of a policy pair for which the router uses the intuitive “Join the shortest queue” policy.Abstract:
The purpose of this paper is to investigate situations of non-cooperative dynamic control of queueing systems by two agents, having different objectives. The main part of the paper is devoted to analyzing a problem of an admission and a service (vacation) control. The admission controller has to decide whether to allow arrivals to occur. Once the queue empties, the server goes on vacation, and controls the vacations duration (according to the state and past history of the queue). The immediate costs for each controller are increasing in the number of customers, but no convexity assumptions are made. The controllers are shown to have a stationary equilibrium policy pair, for which each controller uses a stationary threshold type policy with randomization in at most one state. We then investigate a problem of a non-zero sum stochastic game between a router into several queues, and a second controller that allocates some extra service capacity to one of the queues. We establish the equilibrium of a policy pair for which the router uses the intuitive “Join the shortest queue” policy.read more
Citations
More filters
Journal ArticleDOI
A survey on networking games in telecommunications
TL;DR: This survey summary summarizes different modeling and solution concepts of networking games, as well as a number of different applications in telecommunications that make use of or can make useof networking games.
Book ChapterDOI
Applications of Markov Decision Processes in Communication Networks
TL;DR: This chapter presents in this chapter a survey on applications of MDPs to communication networks and the theoretical tools that have been developed to model and to solve the resulting control problems.
Market mechanisms for network resource sharing
Nemo Semret,Aurel A. Lazar +1 more
TL;DR: The Progressive Second Price auction (PSP) is presented, a new decentralized mechanism for allocating variable-size shares of a resource among multiple users and an optimal truthful strategy for coordinated bidding for a player participating in auctions on multiple resource elements is derived, and the equilibrium and efficiency results still hold.
Journal ArticleDOI
Decentralized Q-Learning for Stochastic Teams and Games
Gurdal Arslan,Serdar Yüksel +1 more
TL;DR: In this article, decentralized Q-learning algorithms for stochastic games are presented, and their convergence for weakly acyclic case is studied for team problems as an important special case, where each decision maker has access only to its own decisions and cost realizations as well as state transitions.
Book ChapterDOI
Nonzero-sum Stochastic Games
TL;DR: In this article, a survey of stochastic Markov games with general state spaces is presented. But the authors focus on nonzero-sum games and provide a detailed survey of selected recent results.
References
More filters
Journal ArticleDOI
A further generalization of the kakutani fixed point theorem, with application to nash equilibrium points
TL;DR: In this article, it was shown that Kakutani's fixed point theorem may be extended to convex linear topological spaces and implies the minimax theorem for continuous games with continuous payoff and the existence of Nash equilibrium points.
Journal ArticleDOI
On the regulation of queue size by levying tolls
TL;DR: In this paper, the authors demonstrate that analogous conclusions can be drawn for queueing models if two basic conditions are satisfied: (i) the individual car driver on making an optimal routing choice for himself-does not optimize the system at large, and (ii) the traffic load is not maximized by the individual driver.