scispace - formally typeset
Journal ArticleDOI

Distributed Energy-Aware Diffusion Least Mean Squares: Game-Theoretic Learning

TLDR
The convergence analysis shows that the parameter estimates weakly converge to the true parameter across the network, yet the global activation behavior along the way tracks the set of correlated equilibria of the underlying activation control game.
Abstract
This paper presents a game-theoretic approach to node activation control in parameter estimation via diffusion least mean squares (LMS). Nodes cooperate by exchanging estimates over links characterized by the connectivity graph of the network. The energy-aware activation control is formulated as a noncooperative repeated game where nodes autonomously decide when to activate based on a utility function that captures the trade-off between individual node's contribution and energy expenditure. The diffusion LMS stochastic approximation is combined with a game-theoretic learning algorithm such that the overall energy-aware diffusion LMS has two timescales: the fast timescale corresponds to the game-theoretic activation mechanism, whereby nodes distributively learn their optimal activation strategies, whereas the slow timescale corresponds to the diffusion LMS. The convergence analysis shows that the parameter estimates weakly converge to the true parameter across the network, yet the global activation behavior along the way tracks the set of correlated equilibria of the underlying activation control game.

read more

Citations
More filters
Book

Adaptation, Learning, and Optimization Over Networks

TL;DR: The limits of performance of distributed solutions are examined and procedures that help bring forth their potential more fully are discussed and a useful statistical framework is adopted and performance results that elucidate the mean-square stability, convergence, and steady-state behavior of the learning networks are derived.

Adaptive Networks

TL;DR: Under reasonable technical conditions on the data, the adaptive networks are shown to be mean square stable in the slow adaptation regime, and their mean square error performance and convergence rate are characterized in terms of the network topology and data statistical moments.
Journal ArticleDOI

Diffusion LMS Over Multitask Networks

TL;DR: This paper conducts a theoretical analysis on the stochastic behavior of diffusion LMS in the case where the single-task hypothesis is violated and proposes an unsupervised clustering strategy that allows each node to select, via adaptive adjustments of combination weights, the neighboring nodes with which it can collaborate to estimate a common parameter vector.
Journal ArticleDOI

Artificial Intelligence for Vehicle-to-Everything: A Survey

TL;DR: This paper presents a comprehensive survey of the research works that have utilized AI to address various research challenges in V2X systems and summarized the contribution and categorized them according to the application domains.
Journal ArticleDOI

On the Learning Behavior of Adaptive Networks—Part I: Transient Analysis

TL;DR: A detailed transient analysis of the learning behavior of multiagent networks reveals how combination policies influence the learning process of networked agents, and how these policies can steer the convergence point toward any of many possible Pareto optimal solutions.
References
More filters
Book

Stochastic approximation and recursive algorithms and applications

TL;DR: A review of continuous time models can be found in this paper, where the authors present an algorithm for the Ergodic Cost Problem: Formulation and Algorithms 7.1 Formulation of the control problem 7.2 A Jacobi Type Iteration 7.3 Approximation in Policy Space 7.4 Numerical Methods 7.5 The Control Problem 7.6 The Interpolated Process 7.7 Computations 7.8 Linear Programming 7.
BookDOI

Adaptive Algorithms and Stochastic Approximations

TL;DR: The juxtaposition of these two expressions in the title reflects the ambition of the authors to produce a reference work, both for engineers who use adaptive algorithms and for probabilists or statisticians who would like to study stochastic approximations in terms of problems arising from real applications.

Parallel and distributed computation

TL;DR: This book focuses on numerical algorithms suited for parallelization for solving systems of equations and optimization problems, with emphasis on relaxation methods of the Jacobi and Gauss-Seidel type.
Journal ArticleDOI

Correlated Equilibrium as an Expression of Bayesian Rationality

Robert J. Aumann
- 01 Jan 1987 - 
TL;DR: In this article, the authors make use of the common prior assumption that differences in probability assessments by different individuals are due to the different information that they have (where "information" may be interpreted broadly, to include experience, upbringing, and genetic makeup).
Journal ArticleDOI

A simple adaptive procedure leading to correlated equilibrium

TL;DR: In this article, regret-matching is proposed for playing a game, where players may depart from their current play with probabilities that are proportional to measures of regret for not having used other strategies in the past.
Related Papers (5)