scispace - formally typeset
Search or ask a question

Showing papers on "Distributed algorithm published in 2017"


Journal ArticleDOI
TL;DR: This paper reviews distributed algorithms for offline solution of optimal power flow (OPF) problems as well as online algorithms for real-time solution of OPF, optimal frequency control, optimal voltage control, and optimal wide-area control problems.
Abstract: Historically, centrally computed algorithms have been the primary means of power system optimization and control. With increasing penetrations of distributed energy resources requiring optimization and control of power systems with many controllable devices, distributed algorithms have been the subject of significant research interest. This paper surveys the literature of distributed algorithms with applications to optimization and control of power systems. In particular, this paper reviews distributed algorithms for offline solution of optimal power flow (OPF) problems as well as online algorithms for real-time solution of OPF, optimal frequency control, optimal voltage control, and optimal wide-area control problems.

800 citations


Journal ArticleDOI
TL;DR: This paper introduces a distributed algorithm, referred to as DIGing, based on a combination of a distributed inexact gradient method and a gradient tracking technique that converges to a global and consensual minimizer over time-varying graphs.
Abstract: This paper considers the problem of distributed optimization over time-varying graphs. For the case of undirected graphs, we introduce a distributed algorithm, referred to as DIGing, based on a combination of a distributed inexact gradient method and a gradient tracking technique. The DIGing algorithm uses doubly stochastic mixing matrices and employs fixed step-sizes and, yet, drives all the agents' iterates to a global and consensual minimizer. When the graphs are directed, in which case the implementation of doubly stochastic mixing matrices is unrealistic, we construct an algorithm that incorporates the push-sum protocol into the DIGing structure, thus obtaining the Push-DIGing algorithm. Push-DIGing uses column stochastic matrices and fixed step-sizes, but it still converges to a global and consensual minimizer. Under the strong convexity assumption, we prove that the algorithms converge at R-linear (geometric) rates as long as the step-sizes do not exceed some upper bounds. We establish explicit est...

795 citations


Proceedings ArticleDOI
24 Sep 2017
TL;DR: Stateless functions are a natural fit for data processing in future computing environments as mentioned in this paper, based on recent trends in network bandwidth and the advent of disaggregated storage, and stateless functions represent a viable platform for these users, eliminating cluster management overhead, fulfilling the promise of elasticity.
Abstract: Distributed computing remains inaccessible to a large number of users, in spite of many open source platforms and extensive commercial offerings. While distributed computation frameworks have moved beyond a simple map-reduce model, many users are still left to struggle with complex cluster management and configuration tools, even for running simple embarrassingly parallel jobs. We argue that stateless functions represent a viable platform for these users, eliminating cluster management overhead, fulfilling the promise of elasticity. Furthermore, using our prototype implementation, PyWren, we show that this model is general enough to implement a number of distributed computing models, such as BSP, efficiently. Extrapolating from recent trends in network bandwidth and the advent of disaggregated storage, we suggest that stateless functions are a natural fit for data processing in future computing environments.

369 citations


Journal ArticleDOI
TL;DR: Simulation results show that the proposed distributed algorithms can achieve almost the same results as that given by the centralized clustering algorithms.
Abstract: This paper is concerned with developing a distributed ${k}$ -means algorithm and a distributed fuzzy ${c}$ -means algorithm for wireless sensor networks (WSNs) where each node is equipped with sensors. The underlying topology of the WSN is supposed to be strongly connected. The consensus algorithm in multiagent consensus theory is utilized to exchange the measurement information of the sensors in WSN. To obtain a faster convergence speed as well as a higher possibility of having the global optimum, a distributed ${k}$ -means++ algorithm is first proposed to find the initial centroids before executing the distributed ${k}$ -means algorithm and the distributed fuzzy ${c}$ -means algorithm. The proposed distributed ${k}$ -means algorithm is capable of partitioning the data observed by the nodes into measure-dependent groups which have small in-group and large out-group distances, while the proposed distributed fuzzy ${c}$ -means algorithm is capable of partitioning the data observed by the nodes into different measure-dependent groups with degrees of membership values ranging from 0 to 1. Simulation results show that the proposed distributed algorithms can achieve almost the same results as that given by the centralized clustering algorithms.

256 citations


Proceedings ArticleDOI
21 May 2017
TL;DR: This work proposes a hierarchical cloud-based Vehicular Edge Computing (VEC) offloading framework, where a backup computing server in the neighborhood is introduced to make up for the deficit computing resources of MEC servers.
Abstract: The increasing number of smart vehicles and their resource hungry applications pose new challenges in terms of computation and processing for providing reliable and efficient vehicular services. Mobile Edge Computing (MEC) is a new paradigm with potential to improve vehicular services through computation offloading in close proximity to mobile vehicles. However, in the road with dense traffic flow, the computation limitation of these MEC servers may endanger the quality of offloading service. To address the problem, we propose a hierarchical cloud-based Vehicular Edge Computing (VEC) offloading framework, where a backup computing server in the neighborhood is introduced to make up for the deficit computing resources of MEC servers. Based on this framework, we adopt a Stackelberg game theoretic approach to design an optimal multilevel offloading scheme, which maximizes the utilities of both the vehicles and the computing servers. Furthermore, to obtain the optimal offloading strategies, we present an iterative distributed algorithm and prove its convergence. Numerical results indicate that our proposed scheme greatly enhances the utility of the offloading service providers.

236 citations


Proceedings ArticleDOI
Ning Liu1, Zhe Li1, Jielong Xu1, Zhiyuan Xu1, Sheng Lin1, Qinru Qiu1, Jian Tang1, Yanzhi Wang1 
05 Jun 2017
TL;DR: The emerging deep reinforcement learning (DRL) technique, which can deal with complicated control problems with large state space, is adopted to solve the global tier problem and the proposed framework can achieve the best trade-off between latency and power/energy consumption in a server cluster.
Abstract: Automatic decision-making approaches, such as reinforcement learning (RL), have been applied to (partially) solve the resource allocation problem adaptively in the cloudcomputing system. However, a complete cloud resource allocation framework exhibits high dimensions in state and action spaces, which prohibit the usefulness of traditional RL techniques. In addition, high power consumption has become one of the critical concerns in design and control of cloud computing systems, which degrades system reliability and increases cooling cost. An effective dynamic power management (DPM) policy should minimize power consumption while maintaining performance degradationwithin an acceptable level. Thus, a joint virtual machine (VM) resource allocation and power management framework is critical to the overall cloud computing system. Moreover, novel solution framework is necessary to address the even higher dimensions in state and action spaces. In this paper, we propose a novel hierarchical framework forsolving the overall resource allocation and power management problem in cloud computing systems. The proposed hierarchical framework comprises a global tier for VM resource allocation to the servers and a local tier for distributed power management of local servers. The emerging deep reinforcement learning (DRL) technique, which can deal with complicated control problems with large state space, is adopted to solve the global tier problem. Furthermore, an autoencoder and a novel weight sharing structure are adopted to handle the high-dimensional state space and accelerate the convergence speed. On the other hand, the local tier of distributed server power managements comprises an LSTM based workload predictor and a model-free RL based power manager, operating in a distributed manner. Experiment results using actual Google cluster traces showthat our proposed hierarchical framework significantly savesthe power consumption and energy usage than the baselinewhile achieving no severe latency degradation. Meanwhile, the proposed framework can achieve the best trade-off between latency and power/energy consumption in a server cluster.

227 citations


Journal ArticleDOI
TL;DR: In this article, a general algorithmic framework for the minimization of a nonconvex smooth function subject to non-linear smooth constraints is proposed, and the algorithm solves a sequence of (separable) strongly convex problems and maintains feasibility at each iteration.
Abstract: In this two-part paper, we propose a general algorithmic framework for the minimization of a nonconvex smooth function subject to nonconvex smooth constraints, and also consider extensions to some structured, nonsmooth problems. The algorithm solves a sequence of (separable) strongly convex problems and maintains feasibility at each iteration. Convergence to a stationary solution of the original nonconvex optimization is established. Our framework is very general and flexible and unifies several existing successive convex approximation (SCA)-based algorithms. More importantly, and differently from current SCA approaches, it naturally leads to distributed and parallelizable implementations for a large class of nonconvex problems. This Part I is devoted to the description of the framework in its generality. In Part II, we customize our general methods to several (multiagent) optimization problems in communications, networking, and machine learning; the result is a new class of centralized and distributed algorithms that compare favorably to existing ad-hoc (centralized) schemes.

226 citations


Journal ArticleDOI
TL;DR: A bidirectional framework for solving the demand-side management problem in a distributed way to substantially improve the search efficiency and dual fast gradient and convex relaxation are applied to tackle the sub-problem for customers' best response.
Abstract: This paper introduces a distributed algorithm for sparse load shifting in demand-side management with a focus on the scheduling problem of residential smart appliances. By the sparse load shifting strategy, customers’ discomfort is reduced. Although there are many game theoretic models for the demand-side management problem, the computational efficiency of finding Nash equilibrium that globally minimizes the total energy consumption cost and the peak-to-average ratio is still an outstanding issue. We develop a bidirectional framework for solving the demand-side management problem in a distributed way to substantially improve the search efficiency. A Newton method is employed to accelerate the centralized coordination of demand side management strategies that superlinearly converge to a better Nash equilibrium minimizing the peak-to-average ratio. Furthermore, dual fast gradient and convex relaxation are applied to tackle the sub-problem for customers’ best response, which is able to relieve customers’ discomfort from load shifting or interrupting. Detailed results from illustrative case studies are presented and discussed, which shows the costs of energy consumption and daily peak demand by our algorithm are reduced. Finally, some conclusions are drawn.

208 citations


Journal ArticleDOI
TL;DR: An algorithm based on the gradient push-sum method is proposed to solve the EDP in a distributed manner over communication networks potentially with time-varying topologies and communication delays.
Abstract: In power system operation, the economic dispatch problem (EDP) aims to minimize the total generation cost while meeting the demand and satisfying generator capacity limits. This paper proposes an algorithm based on the gradient push-sum method to solve the EDP in a distributed manner over communication networks potentially with time-varying topologies and communication delays. This paper shows that the proposed algorithm is guaranteed to solve the EDP if the time-varying directed communication network is uniformly jointly strongly connected. Moreover, the proposed algorithm is also able to handle arbitrarily large but bounded time-varying delays on communication links. Numerical simulations are used to illustrate and validate the proposed algorithm.

199 citations


Journal ArticleDOI
TL;DR: A fully decentralized algorithm without the central controller is proposed in Algorithm 2 with a new communication strategy, in which only limited information on boundary buses are exchanged among adjacent subsystems, and a general guidance for subsystem partitioning is proposed and verified via large-scale power systems.
Abstract: This paper discusses a consensus-based alternating direction method of multipliers (ADMMs) approach for solving the dynamic dc optimal power flow (DC-OPF) problem with demand response in a distributed manner. In smart grid, emerging techniques together with distributed nature of data and information, significantly increase the complexity of power systems operation and stimulate the needs for distributed optimization. In this paper, the distributed DC-OPF approach solves local OPF problems of individual subsystems in parallel, which are coordinated via global consensus variables (i.e., phase angles on boundary buses of adjacent subsystems). Three distributed DC-OPF algorithms are discussed with different convergence performance and/or communication requirement. All three distributed algorithms can effectively handle prevailing constraints for the transmission network, generating units, and demand response in individual subsystems, while the global convergence can be guaranteed. In particular, based on the traditional distributed ADMM approach, a fully decentralized algorithm without the central controller is proposed in Algorithm 2 with a new communication strategy, in which only limited information on boundary buses are exchanged among adjacent subsystems. In addition, the accelerated ADMM is discussed in Algorithm 3 for improving the convergence performance. In recognizing distributed OPF approaches in literature, one major research focus on this paper is to quantify the impact of key parameters and subsystem partitioning strategies on the convergence performance and the data traffic via numerical case studies. A general guidance for subsystem partitioning is proposed and verified via large-scale power systems.

193 citations


Journal ArticleDOI
TL;DR: A novel distributed-consensus alternating direction method of multipliers (ADMM) algorithm, which contains a dynamic average consensus algorithm and distributed ADMM algorithm, is presented to solve the optimal energy management problem of energy Internet.
Abstract: In this paper, a novel energy management framework for energy Internet with many energy bodies is presented, which features multicoupling of different energy forms, diversified energy roles, and peer-to-peer energy supply/demand, etc. The energy body as an integrated energy unit, which may have various functionalities and play multiple roles at the same time, is formulated for the system model development. Forecasting errors, confidence intervals, and penalty factor are also taken into account to model renewable energy resources to provide tradeoff between optimality and possibility. Furthermore, a novel distributed-consensus alternating direction method of multipliers (ADMM) algorithm, which contains a dynamic average consensus algorithm and distributed ADMM algorithm, is presented to solve the optimal energy management problem of energy Internet. The proposed algorithm can effectively handle the problems of power-heat-gas-coupling, global constraint limits, and nonlinear objective function. With this effort, not only the optimal energy market clearing price but also the optimal energy outputs/demands can be obtained through only local communication and computation. Simulation results are presented to illustrate the effectiveness of the proposed distributed algorithm.

Journal ArticleDOI
TL;DR: The convergence of the non-smooth algorithm for the distributed game is proved by taking advantage of its special structure and also combining the techniques of the variational inequality and Lyapunov function.

Journal ArticleDOI
TL;DR: In this paper, the event-triggered semiglobal consensus problem is investigated for general linear multi-agent systems subjected to input saturation, by utilizing the algebraic Riccati equation-based low-gain feedback technique.
Abstract: In this paper, the event-triggered semiglobal consensus problem is investigated for general linear multi-agent systems subjected to input saturation, by utilizing the algebraic Riccati equation-based low-gain feedback technique. Two scenarios for systems with or without updating delays are considered, and fully distributed event-triggered control schemes are proposed to guarantee the semiglobal consensus of the connected systems, in which each agent is asymptotically null controllable with bounded controls. Strictly positive lower bounds for both the sampling intervals and the updating delays are captured for each agent to eliminate the Zeno behaviors in these two event-triggered processes. Finally, the effectiveness of these event-triggered control schemes are verified by simulations.

Journal ArticleDOI
TL;DR: This paper proposes the network Newton (NN) method as a distributed algorithm that incorporates second-order information via distributed implementation of approximations of a suitably chosen Newton step and proves convergence to a point close to the optimal argument at a rate that is at least linear.
Abstract: We study the problem of minimizing a sum of convex objective functions, where the components of the objective are available at different nodes of a network and nodes are allowed to only communicate with their neighbors. The use of distributed gradient methods is a common approach to solve this problem. Their popularity notwithstanding, these methods exhibit slow convergence and a consequent large number of communications between nodes to approach the optimal argument because they rely on first-order information only. This paper proposes the network Newton (NN) method as a distributed algorithm that incorporates second-order information. This is done via distributed implementation of approximations of a suitably chosen Newton step. The approximations are obtained by truncation of the Newton step's Taylor expansion. This leads to a family of methods defined by the number $K$ of Taylor series terms kept in the approximation. When keeping $K$ terms of the Taylor series, the method is called NN- $K$ and can be implemented through the aggregation of information in $K$ -hop neighborhoods. Convergence to a point close to the optimal argument at a rate that is at least linear is proven and the existence of a tradeoff between convergence time and the distance to the optimal argument is shown. The numerical experiments corroborate reductions in the number of iterations and the communication cost that are necessary to achieve convergence relative to first-order alternatives.

Journal ArticleDOI
TL;DR: A new distributed algorithm based on alternating direction method of multipliers (ADMM) to minimize sum of locally known convex functions using communication over a network and highlights the effect of network and communication weights on the convergence rate through degrees of the nodes, the smallest nonzero eigenvalue, and operator norm of the communication matrix.
Abstract: We propose a new distributed algorithm based on alternating direction method of multipliers (ADMM) to minimize sum of locally known convex functions using communication over a network. This optimization problem emerges in many applications in distributed machine learning and statistical estimation. Our algorithm allows for a general choice of the communication weight matrix, which is used to combine the iterates at different nodes. We show that when functions are convex, both the objective function values and the feasibility violation converge with rate $O(1/T)$ , where $T$ is the number of iterations. We then show that when functions are strongly convex and have Lipschitz continuous gradients, the sequence generated by our algorithm converges linearly to the optimal solution. In particular, an $\epsilon$ -optimal solution can be computed with $O\left(\sqrt{\kappa _f} \log (1/\epsilon) \right)$ iterations, where $\kappa _f$ is the condition number of the problem. Our analysis highlights the effect of network and communication weights on the convergence rate through degrees of the nodes, the smallest nonzero eigenvalue, and operator norm of the communication matrix.

Journal ArticleDOI
TL;DR: The novel concept of Kernel Dataset, which can represent the vast information carried by big sensory data with the information loss rate being less than $\epsilon$, and two distributed algorithms of maintaining the correlation coefficients among sensor nodes are developed are developed.
Abstract: The amount of sensory data manifests an explosive growth due to the increasing popularity of Wireless Sensor Networks (WSNs). The scale of sensory data in many applications has already exceeded several petabytes annually, which is beyond the computation and transmission capabilities of conventional WSNs. On the other hand, the information carried by big sensory data has high redundancy because of strong correlation among sensory data. In this paper, we introduce the novel concept of $\epsilon$ -Kernel Dataset , which is only a small data subset and can represent the vast information carried by big sensory data with the information loss rate being less than $\epsilon$ , where $\epsilon$ can be arbitrarily small. We prove that drawing the minimum $\epsilon$ -Kernel Dataset is polynomial time solvable and provide a centralized algorithm with $O(n^3)$ time complexity. Furthermore, a distributed algorithm with constant complexity $O(1)$ is designed. It is shown that the result returned by the distributed algorithm can satisfy the $\epsilon$ requirement with a near optimal size. Furthermore, two distributed algorithms of maintaining the correlation coefficients among sensor nodes are developed. Finally, the extensive real experiment results and simulation results are presented. The results indicate that all the proposed algorithms have high performance in terms of accuracy and energy efficiency.

Journal ArticleDOI
TL;DR: In this article, the authors consider the problem of distributed learning where a network of agents collectively aim to agree on a hypothesis that best explains a set of distributed observations of conditionally independent random processes.
Abstract: We consider the problem of distributed learning , where a network of agents collectively aim to agree on a hypothesis that best explains a set of distributed observations of conditionally independent random processes. We propose a distributed algorithm and establish consistency, as well as a nonasymptotic, explicit, and geometric convergence rate for the concentration of the beliefs around the set of optimal hypotheses. Additionally, if the agents interact over static networks, we provide an improved learning protocol with better scalability with respect to the number of nodes in the network.

Journal ArticleDOI
TL;DR: This paper designs a novel information-centric heterogeneous networks framework aiming at enabling content caching and computing, and forms the virtual resource allocation strategy as a joint optimization problem, where the gains of not only virtualization but also caching and Computing are taken into consideration.
Abstract: In order to better accommodate the dramatically increasing demand for data caching and computing services, storage and computation capabilities should be endowed to some of the intermediate nodes within the network, therefore increasing the data throughput and reducing the network operation cost. In this paper, we design a novel information-centric heterogeneous networks framework aiming at enabling content caching and computing. Furthermore, due to the virtualization of the whole system, communication, computing, and caching resources can be shared among all users associated with different virtual service providers. We formulate the virtual resource allocation strategy as a joint optimization problem, where the gains of not only virtualization but also caching and computing are taken into consideration in the proposed information-centric heterogeneous networks virtualization architecture. In addition, a distributed algorithm based on alternating direction method of multipliers is adopted in order to solve the formulated problem. Since each base station only needs to solve its own problem without exchange of channel state information by using the distributed algorithm, the computational complexity and signaling overhead can be greatly reduced. Finally, extensive simulations are presented to show the effectiveness of the proposed scheme under different system parameters.

Journal ArticleDOI
TL;DR: In this paper, the authors proposed a distributed algorithm that preserves differential privacy by perturbing the public signals with additive noise, whose magnitude is determined by the sensitivity of the projection operation onto user-specified constraints.
Abstract: Many resource allocation problems can be formulated as an optimization problem whose constraints contain sensitive information about participating users. This paper concerns a class of resource allocation problems whose objective function depends on the aggregate allocation (i.e., the sum of individual allocations); in particular, we investigate distributed algorithmic solutions that preserve the privacy of participating users. Without privacy considerations, existing distributed algorithms normally consist of a central entity computing and broadcasting certain public coordination signals to participating users. However, the coordination signals often depend on user information, so that an adversary who has access to the coordination signals can potentially decode information on individual users and put user privacy at risk. We present a distributed optimization algorithm that preserves differential privacy, which is a strong notion that guarantees user privacy regardless of any auxiliary information an adversary may have. The algorithm achieves privacy by perturbing the public signals with additive noise, whose magnitude is determined by the sensitivity of the projection operation onto user-specified constraints. By viewing the differentially private algorithm as an implementation of stochastic gradient descent, we are able to derive a bound for the suboptimality of the algorithm. We illustrate the implementation of our algorithm via a case study of electric vehicle charging. Specifically, we derive the sensitivity and present numerical simulations for the algorithm. Through numerical simulations, we are able to investigate various aspects of the algorithm when being used in practice, including the choice of step size, number of iterations, and the trade-off between privacy level and suboptimality.

Proceedings ArticleDOI
19 Jun 2017
TL;DR: The result can be viewed as showing that the only obstacle to getting efficient determinstic algorithms in the LOCAL model is an efficient algorithm to approximately round fractional values into integer values.
Abstract: This paper is centered on the complexity of graph problems in the well-studied LOCAL model of distributed computing, introduced by Linial [FOCS '87]. It is widely known that for many of the classic distributed graph problems (including maximal independent set (MIS) and (Δ+1)-vertex coloring), the randomized complexity is at most polylogarithmic in the size n of the network, while the best deterministic complexity is typically 2O(√logn). Understanding and potentially narrowing down this exponential gap is considered to be one of the central long-standing open questions in the area of distributed graph algorithms. We investigate the problem by introducing a complexity-theoretic framework that allows us to shed some light on the role of randomness in the LOCAL model. We define the SLOCAL model as a sequential version of the LOCAL model. Our framework allows us to prove completeness results with respect to the class of problems which can be solved efficiently in the SLOCAL model, implying that if any of the complete problems can be solved deterministically in logn rounds in the LOCAL model, we can deterministically solve all efficient SLOCAL-problems (including MIS and (Δ+1)-coloring) in logn rounds in the LOCAL model. Perhaps most surprisingly, we show that a rather rudimentary looking graph coloring problem is complete in the above sense: Color the nodes of a graph with colors red and blue such that each node of sufficiently large polylogarithmic degree has at least one neighbor of each color. The problem admits a trivial zero-round randomized solution. The result can be viewed as showing that the only obstacle to getting efficient determinstic algorithms in the LOCAL model is an efficient algorithm to approximately round fractional values into integer values. In addition, our formal framework also allows us to develop polylogarithmic-time randomized distributed algorithms in a simpler way. As a result, we provide a polylog-time distributed approximation scheme for arbitrary distributed covering and packing integer linear programs.

Journal ArticleDOI
TL;DR: A distributed and fast economic dispatch algorithm is provided to share the power generation task in an optimized fashion among a set of distributed energy resources, which can address both generation-demand equality and generation capacity inequality constraints.
Abstract: The physical power infrastructure is moving from the centralized structure to the distributed structure for enabling integration of distributed energy resources. Due to the large number of distributed energy resources, optimal resource allocation is an important and challenging problem. To solve this problem, a distributed and fast economic dispatch algorithm is provided to share the power generation task in an optimized fashion among a set of distributed energy resources, which can address both generation-demand equality and generation capacity inequality constraints. Different from most existing economic dispatch algorithms, the finite-time convergence to the optimal value is achieved, which makes more sense in real applications. Several case studies are discussed and tested to validate the proposed methods.

Journal ArticleDOI
TL;DR: In this paper, the authors studied the cache placement problem in fog radio access networks (Fog-RANs), by taking into account flexible physical-layer transmission schemes and diverse content preferences of different users.
Abstract: To deal with the rapid growth of high-speed and/or ultra-low latency data traffic for massive mobile users, fog radio access networks (Fog-RANs) have emerged as a promising architecture for next-generation wireless networks. In Fog-RANs, the edge nodes and user terminals possess storage, computation and communication functionalities to various degrees, which provide high flexibility for network operation, i.e., from fully centralized to fully distributed operation. In this paper, we study the cache placement problem in Fog-RANs, by taking into account flexible physical-layer transmission schemes and diverse content preferences of different users. We develop both centralized and distributed transmission aware cache placement strategies to minimize users’ average download delay subject to the storage capacity constraints. In the centralized mode, the cache placement problem is transformed into a matroid constrained submodular maximization problem, and an approximation algorithm is proposed to find a solution within a constant factor to the optimum. In the distributed mode, a belief propagation-based distributed algorithm is proposed to provide a suboptimal solution, with iterative updates at each BS based on locally collected information. Simulation results show that by exploiting caching and cooperation gains, the proposed transmission aware caching algorithms can greatly reduce the users’ average download delay.

Journal ArticleDOI
TL;DR: This work proposes a novel distributed algorithm to minimize the sum of the agents’ objective functions subject to both local and coupling constraints, where dual decomposition and proximal minimization are combined in an iterative scheme.

Journal ArticleDOI
TL;DR: This paper proposes a centralized algorithm by employing a semidefinite relaxation approach, and proves that this centralized algorithm learns efficient caching by deriving a sub-linear learning regret bound, and proposes a distributed algorithm based on alternating direction method of multipliers, where each BS only solves their own problems by exchanging local information with neighbor BSs.
Abstract: Content caching at base stations (BSs) is a promising technique for future wireless networks by reducing network traffic and alleviating server bottleneck. However, in practice, the content popularity distribution may change with spatio-temporal variation but be unknown for BSs, which is an intractable obstacle for efficient caching strategy design. In this paper, considering unknown popularity distribution, we explore the content caching problem by jointly optimizing the content caching in cooperative BSs, content sharing among BSs, and cost of content retrieving. We tackle the problem from a multi-armed bandit learning perspective, where the learning of the popularity distribution is incorporated with the content caching and sharing process. Specifically, we first propose a centralized algorithm by employing a semidefinite relaxation approach, and we prove that this centralized algorithm learns efficient caching by deriving a sub-linear learning regret bound. To further reduce computational complexity, we propose a distributed algorithm based on alternating direction method of multipliers, where each BS only solves their own problems by exchanging local information with neighbor BSs. Extensive simulation results show the effectiveness of the proposed algorithms in terms of learning content popularity distributions of individual BSs, offloading traffic from the content server, and reducing cost of content retrieving.

Journal ArticleDOI
TL;DR: Compared with existing consensus algorithms for distributed optimization with diminishing step sizes, the proposed algorithms with fixed step size have better convergence rate.
Abstract: In this technical note, we are concerned with constrained consensus algorithms for distributed convex optimization with a sum of convex objective functions subject to local bound and equality constraints. In multiagent networks, each agent has its own data on objective function and constraints. All the agents cooperatively find the minimizer, while each agent can only communicate with its neighbors. The consensus of multiagent networks with time-invariant and undirected graphs is proven by the Lyapunov method. Compared with existing consensus algorithms for distributed optimization with diminishing step sizes, the proposed algorithms with fixed step size have better convergence rate. Simulation results on a numerical example are presented to substantiate the performance and characteristics of the proposed algorithms.

Journal ArticleDOI
TL;DR: The decentralized Broyden–Fletcher–Goldfarb–Shanno (D-BFGS) method is introduced as a variation of the BFGS quasi-Newton method for solving decentralized optimization problems.
Abstract: We introduce the decentralized Broyden–Fletcher–Goldfarb–Shanno (D-BFGS) method as a variation of the BFGS quasi-Newton method for solving decentralized optimization problems. Decentralized quasi-Newton methods are of interest in problems that are not well conditioned, making first-order decentralized methods ineffective, and in which second-order information is not readily available, making second-order decentralized methods impossible. D-BFGS is a fully distributed algorithm in which nodes approximate curvature information of themselves and their neighbors through the satisfaction of a secant condition. We additionally provide a formulation of the algorithm in asynchronous settings. Convergence of D-BFGS is established formally in both the synchronous and asynchronous settings and strong performance advantages relative to existing methods are shown numerically.

Journal ArticleDOI
TL;DR: This work extends the concept of population dynamics for nonwell-mixed populations in order to deal with distributed information structures that are characterized by noncomplete graphs and proves mass conservation and convergence to Nash equilibrium.
Abstract: Population dynamics have been widely used in the design of learning and control systems for networked engineering applications, where the information dependency among elements of the network has become a relevant issue. Classic population dynamics (e.g., replicator, logit choice, Smith, and projection) require full information to evolve to the solution (Nash equilibrium). The main reason is that classic population dynamics are deduced by assuming well-mixed populations, which limits the applications where this theory can be implemented. In this paper, we extend the concept of population dynamics for nonwell-mixed populations in order to deal with distributed information structures that are characterized by noncomplete graphs. Although the distributed population dynamics proposed in this paper use partial information, they preserve similar characteristics and properties of their classic counterpart. Specifically, we prove mass conservation and convergence to Nash equilibrium. To illustrate the performance of the proposed dynamics, we show some applications in the solution of optimization problems, classic games, and the design of distributed controllers.

Journal ArticleDOI
TL;DR: A joint user association and power control optimization algorithm is developed to determine the traffic load in energy-cooperation enabled NOMA HetNets, which achieves much higher energy efficiency performance than existing schemes.
Abstract: This paper focuses on resource allocation in energy-cooperation enabled two-tier heterogeneous networks (HetNets) with non-orthogonal multiple access (NOMA), where base stations (BSs) are powered by both renewable energy sources and the conventional grid. Each BS can serve multiple users at the same time and frequency band. To deal with the fluctuation of renewable energy harvesting, we consider that renewable energy can be shared between BSs via the smart grid. In such networks, user association and power control need to be re-designed, since existing approaches are based on OMA. Therefore, we formulate a problem to find the optimum user association and power control schemes for maximizing the energy efficiency of the overall network, under quality-of-service constraints. To deal with this problem, we first propose a distributed algorithm to provide the optimal user association solution for the fixed transmit power. Furthermore, a joint user association and power control optimization algorithm is developed to determine the traffic load in energy-cooperation enabled NOMA HetNets, which achieves much higher energy efficiency performance than existing schemes. Our simulation results demonstrate the effectiveness of the proposed algorithm, and show that NOMA can achieve higher energy efficiency performance than OMA in the considered networks.

Proceedings ArticleDOI
01 Jun 2017
TL;DR: This paper first elaborately model the joint problem of sensing task assignment and scheduling while considering partial fulfillment, attribute diversity, and price diversity as a reverse auction, and proposes two distributed auction schemes, cost-preferred auction scheme (CPAS) and time schedule-pre Preferred Auction scheme (TPAS), which differ on the methods of task scheduling, winner determination, and payment computation.
Abstract: With the emergence of Mobile Crowdsensing Systems (MCSs), many auction schemes have been proposed to incentivize mobile users to participate in sensing activities. However, in most of the existing work, the heterogeneity of MCSs has not been fully exploited. To tackle this issue, in this paper, we study the joint problem of sensing task assignment and scheduling while considering partial fulfillment, attribute diversity, and price diversity. We first elaborately model the problem as a reverse auction and design a distributed auction framework. Then, based on this framework, we propose two distributed auction schemes, cost-preferred auction scheme (CPAS) and time schedule-preferred auction scheme (TPAS), which differ on the methods of task scheduling, winner determination, and payment computation. We further rigorously prove that both CPAS and TPAS can achieve computational-efficiency, individual-rationality, budget-balance, and truthfulness. Finally, the simulation results validate the effectiveness of both CPAS and TPAS in terms of sensing task's allocation efficiency, mobile user's working time utilization and utility, and truthfulness.

Journal ArticleDOI
TL;DR: It is formally proven using Lyapunov techniques that, using the new distributed IKCF, the estimates of all sensors reach converge to consensus values that give locally optimal estimates of the state of the target.