Adaptive Federated Learning in Resource Constrained Edge Computing Systems
Shiqiang Wang,Tiffany Tuor,Theodoros Salonidis,Kin K. Leung,Christian Makaya,Ting He,Kevin S. Chan +6 more
Reads0
Chats0
TLDR
In this paper, the authors consider the problem of learning model parameters from data distributed across multiple edge nodes, without sending raw data to a centralized place, and propose a control algorithm that determines the best tradeoff between local update and global parameter aggregation to minimize the loss function under a given resource budget.Abstract:
Emerging technologies and applications including Internet of Things, social networking, and crowd-sourcing generate large amounts of data at the network edge. Machine learning models are often built from the collected data, to enable the detection, classification, and prediction of future events. Due to bandwidth, storage, and privacy concerns, it is often impractical to send all the data to a centralized location. In this paper, we consider the problem of learning model parameters from data distributed across multiple edge nodes, without sending raw data to a centralized place. Our focus is on a generic class of machine learning models that are trained using gradient-descent-based approaches. We analyze the convergence bound of distributed gradient descent from a theoretical point of view, based on which we propose a control algorithm that determines the best tradeoff between local update and global parameter aggregation to minimize the loss function under a given resource budget. The performance of the proposed algorithm is evaluated via extensive experiments with real datasets, both on a networked prototype system and in a larger-scale simulated environment. The experimentation results show that our proposed approach performs near to the optimum with various machine learning models and different data distributions.read more
Citations
More filters
Journal ArticleDOI
Cloud-Edge Collaboration in Industrial Internet of Things: A Joint Offloading Scheme Based on Resource Prediction
TL;DR: In this paper , an optimal joint offloading scheme based on resource occupancy prediction was proposed for the problem of computing offloading with limited edge resources. But the authors did not consider the task offloading failure rate.
Journal ArticleDOI
DEEP-FEL: Decentralized, Efficient and Privacy-Enhanced Federated Edge Learning for Healthcare Cyber Physical Systems
TL;DR: This work proposes a decentralized, efficient, and privacy-enhanced federated edge learning system called DEEP-FEL, which enables medical devices in different institutions to collaboratively train a global model without raw data mutual exchange.
Proceedings ArticleDOI
Learning Cooperation Schemes for Mobile Edge Computing Empowered Internet of Vehicles
TL;DR: In this article, the authors leverage federated learning in MEC empowered internet of vehicles to protect task data privacy and propose optimized learning cooperation schemes, which adaptively take smart vehicles and road side units to act as learning agents, and significantly reduce the learning costs in task execution.
Journal ArticleDOI
PerFED-GAN: Personalized Federated Learning via Generative Adversarial Networks
TL;DR: A federated learning method based on cotraining and generative adversarial networks (GANs) that allows each client to design its own model to participate in federatedLearning training independently without sharing any model architecture or parameter information with other clients or a center is proposed.
Proceedings ArticleDOI
Learning for Learning: Predictive Online Control of Federated Learning with Edge Provisioning
TL;DR: In this paper, the authors formulate a non-linear mixed integer program to minimize the long-term cumulative cost of federated learning system while guaranteeing the desired convergence of the machine learning models being trained.