Random walks are ubiquitous in the sciences, and they are interesting from both theoretical and practical perspectives. They are one of the most fundamental types of stochastic processes; can be used to model numerous phenomena, including diffusion, interactions, and opinions among humans and animals; and can be used to extract information about important entities or dense groups of entities in a network. Random walks have been studied for many decades on both regular lattices and (especially in the last couple of decades) on networks with a variety of structures. In the present article, we survey the theory and applications of random walks on networks, restricting ourselves to simple cases of single and non-adaptive random walkers. We distinguish three main types of random walks: discrete-time random walks, node-centric continuous-time random walks, and edge-centric continuous-time random walks. We first briefly survey random walks on a line, and then we consider random walks on various types of networks. We extensively discuss applications of random walks, including ranking of nodes (e.g., PageRank), community detection, respondent-driven sampling, and opinion models such as voter models.

Random walks and diffusion on networks

https://research-information.bris.ac.uk/files/125866845/Full_text_PDF_accepted_author_manuscript_.pdf

This paper is devoted to the game theoretic analysis of decision situations, in which the players have veto power over the actions undertaken by certain other players. We give a full characterization of the dividends in these games with a permission structure. We find that the collection of these games forms a subspace of the vector space of all games with side payments on a specified player set. Two applications of these results are provided. The first one deals with the projection of additive games on a permission structure. It is shown that the Shapley value of these projected games can be interpreted as an index that measures the power of the players in the permission structure. The second application applies the derived results on games, where the organization structure can be analysed separately from the production capacities of the participating players.

Games with permission structures : The conjunctive approach

Cooperative games are considered where only those coalitions of players are feasible that respect a given precedence structure on the set of players. Strengthening the classical symmetry axiom, we obtain three axioms that give rise to a unique Shapley value in this model. The Shapley value is seen to reflect the expected marginal contribution of a player to a feasible random coalition, which allows us to evaluate the Shapley value nondeterministically. We show that every exact algorithm for the Shapley value requires an exponential number of operations already in the classical case and that even restriction to simple games is #P-hard in general. Furthermore, we outline how the multi-choice cooperative games of Hsiao and Raghavan can be treated in our context, which leads to a Shapley value that does not depend on pre-assigned weights. Finally, the relationship between the Shapley value and the permission value of Gilles, Owen and van den Brink is discussed. Both refer to formally similar models of cooperative games but reflect complementary interpretations of the precedence constraints and thus give rise to fundamentally different solution concepts.

The Shapley value for cooperative games under precedence constraints

Abstract We consider a deteriorating installation, which supplies input to a subsequent production system. The installation is provided with a buffer to cope with unexpected failures of the installation, which may cause interruptions of the production process. By preventive maintenance on the installation a further improvement of the production process can be obtained. In this paper we consider a preventive maintenance policy, which is based not only on the information about the age of the installation but also on the content of the subsequent buffer. For this integrated maintenance-production problem, we analyse a class of control limit policies which are nearly optimal and easy to implement. The analysis is based on the embedding technique from Markov decision theory. In addition, we provide a characterization of the overall optimal policy and report on numerical comparisons of the best control limit policy with the overall optimal policy and other reference policies.

J.R. van den Brink

Papers

Ranking the nodes in directed and weighted directed graphs