Coding for Distributed Fog Computing
Reads0
Chats0
TLDR
In this paper, the authors demonstrate the transformational role of coding in fog computing for leveraging such redundancy to substantially reduce the bandwidth consumption and latency of computing, and discuss two recently proposed coding concepts, minimum bandwidth codes and minimum latency codes.Abstract:Â
Redundancy is abundant in fog networks (i.e., many computing and storage points) and grows linearly with network size. We demonstrate the transformational role of coding in fog computing for leveraging such redundancy to substantially reduce the bandwidth consumption and latency of computing. In particular, we discuss two recently proposed coding concepts, minimum bandwidth codes and minimum latency codes, and illustrate their impacts on fog computing. We also review a unified coding framework that includes the above two coding techniques as special cases, and enables a trade-off between computation latency and communication load to optimize system performance. At the end, we will discuss several open problems and future research directions.read more
Citations
More filters
Posted Content
Coded Fourier Transform
TL;DR: In this article, the authors consider the problem of computing the Fourier transform of high-dimensional vectors, distributedly over a cluster of machines consisting of a master node and multiple worker nodes, where the worker nodes can only store and process a fraction of the inputs.
Proceedings ArticleDOI
Wireless Map-Reduce Distributed Computing with Full-Duplex Radios and Imperfect CSI
TL;DR: In this paper, a superposition coding based scheme is proposed that is demonstrated to outperform both coded multicasting and cooperative transmission under the assumption of imperfect CSI, and it is shown that the scheme is able to reduce the high-Signal-to-Noise Ratio communication load by half in the presence of full-duplex nodes and perfect transmit-side CSI.
Posted Content
Numerically Stable Binary Gradient Coding
TL;DR: This work presents a binary scheme which avoids operations over the real or complex numbers, thereby enabling numerically stable distributed computation of the gradient, and some restricting assumptions in prior work are dropped, and a more efficient decoding is given.
Journal ArticleDOI
Coded Computing for Secure Boolean Computations
TL;DR: In this article, the problem of computing a Boolean function in a distributed computing system with particular focus on security against Byzantine workers is considered, and three different schemes are proposed: coded algebraic normal form, coded disjunctive normal form and coded polynomial threshold function (PTF).
References
More filters
Journal ArticleDOI
MapReduce: simplified data processing on large clusters
Jeffrey Dean,Sanjay Ghemawat +1 more
TL;DR: This paper presents the implementation of MapReduce, a programming model and an associated implementation for processing and generating large data sets that runs on a large cluster of commodity machines and is highly scalable.
Journal ArticleDOI
MapReduce: simplified data processing on large clusters
Jeffrey Dean,Sanjay Ghemawat +1 more
TL;DR: This presentation explains how the underlying runtime system automatically parallelizes the computation across large-scale clusters of machines, handles machine failures, and schedules inter-machine communication to make efficient use of the network and disks.
Proceedings Article
Spark: cluster computing with working sets
TL;DR: Spark can outperform Hadoop by 10x in iterative machine learning jobs, and can be used to interactively query a 39 GB dataset with sub-second response time.
Proceedings ArticleDOI
Fog computing and its role in the internet of things
TL;DR: This paper argues that the above characteristics make the Fog the appropriate platform for a number of critical Internet of Things services and applications, namely, Connected Vehicle, Smart Grid, Smart Cities, and, in general, Wireless Sensors and Actuators Networks (WSANs).
Book ChapterDOI
Fog Computing and Its Role in the Internet of Things
TL;DR: This chapter argues that the above characteristics make the Fog the appropriate platform for a number of critical internet of things services and applications, namely connected vehicle, smart grid, smart cities, and in general, wireless sensors and actuators networks (WSANs).