Adaptive Federated Learning in Resource Constrained Edge Computing Systems
Shiqiang Wang,Tiffany Tuor,Theodoros Salonidis,Kin K. Leung,Christian Makaya,Ting He,Kevin S. Chan +6 more
Reads0
Chats0
TLDR
In this paper, the authors consider the problem of learning model parameters from data distributed across multiple edge nodes, without sending raw data to a centralized place, and propose a control algorithm that determines the best tradeoff between local update and global parameter aggregation to minimize the loss function under a given resource budget.Abstract:
Emerging technologies and applications including Internet of Things, social networking, and crowd-sourcing generate large amounts of data at the network edge. Machine learning models are often built from the collected data, to enable the detection, classification, and prediction of future events. Due to bandwidth, storage, and privacy concerns, it is often impractical to send all the data to a centralized location. In this paper, we consider the problem of learning model parameters from data distributed across multiple edge nodes, without sending raw data to a centralized place. Our focus is on a generic class of machine learning models that are trained using gradient-descent-based approaches. We analyze the convergence bound of distributed gradient descent from a theoretical point of view, based on which we propose a control algorithm that determines the best tradeoff between local update and global parameter aggregation to minimize the loss function under a given resource budget. The performance of the proposed algorithm is evaluated via extensive experiments with real datasets, both on a networked prototype system and in a larger-scale simulated environment. The experimentation results show that our proposed approach performs near to the optimum with various machine learning models and different data distributions.read more
Citations
More filters
Journal ArticleDOI
Dynamic Scheduling for Heterogeneous Federated Learning in Private 5G Edge Networks
TL;DR: In this article , a dynamic scheduling policy for heterogeneous federated learning (FL) in private 5G edge networks is proposed to minimize the global loss function, with the consideration of straggler and limited device energy issues.
Journal ArticleDOI
E-Tree Learning: A Novel Decentralized Model Learning Framework for Edge AI
TL;DR: E-Tree, a novel decentralized model learning approach, which makes use of a well-designed tree structure imposed on the edge devices, significantly outperforms the benchmark approaches such as federated learning and Gossip learning under NonIID data in terms of model accuracy and convergency.
Journal ArticleDOI
Handling Privacy-Sensitive Medical Data With Federated Learning: Challenges and Future Directions
TL;DR: In this article , the authors provide a broad overview of the emerging deployment of federated learning in the medical field and outline several directions of future work that are relevant to solving existing problems in federated healthcare, with a particular focus on security and privacy issues.
Proceedings ArticleDOI
Ubiquitous Computing and Distributed Machine Learning in Smart Cities
TL;DR: The article deals with the main provisions of the concept of smart city, technologies of ubiquitous computing, features of methods of distributed machine learning and their introduction into urban systems management.
Posted Content
Wireless Edge Computing with Latency and Reliability Guarantees
Mohammed S. Elbamby,Cristina Perfecto,Chen-Feng Liu,Jihong Park,Sumudu Samarakoon,Xianfu Chen,Mehdi Bennis +6 more
TL;DR: The applications that the network edge must provide are discussed, with a special emphasis on the ensuing challenges in enabling ultrareliable and low-latency edge computing services for mission-critical applications such as virtual reality (VR), vehicle-to-everything (V2X), edge artificial intelligence (AI), and so on.