Adaptive Federated Learning in Resource Constrained Edge Computing Systems
Shiqiang Wang,Tiffany Tuor,Theodoros Salonidis,Kin K. Leung,Christian Makaya,Ting He,Kevin S. Chan +6 more
Reads0
Chats0
TLDR
In this paper, the authors consider the problem of learning model parameters from data distributed across multiple edge nodes, without sending raw data to a centralized place, and propose a control algorithm that determines the best tradeoff between local update and global parameter aggregation to minimize the loss function under a given resource budget.Abstract:
Emerging technologies and applications including Internet of Things, social networking, and crowd-sourcing generate large amounts of data at the network edge. Machine learning models are often built from the collected data, to enable the detection, classification, and prediction of future events. Due to bandwidth, storage, and privacy concerns, it is often impractical to send all the data to a centralized location. In this paper, we consider the problem of learning model parameters from data distributed across multiple edge nodes, without sending raw data to a centralized place. Our focus is on a generic class of machine learning models that are trained using gradient-descent-based approaches. We analyze the convergence bound of distributed gradient descent from a theoretical point of view, based on which we propose a control algorithm that determines the best tradeoff between local update and global parameter aggregation to minimize the loss function under a given resource budget. The performance of the proposed algorithm is evaluated via extensive experiments with real datasets, both on a networked prototype system and in a larger-scale simulated environment. The experimentation results show that our proposed approach performs near to the optimum with various machine learning models and different data distributions.read more
Citations
More filters
Journal ArticleDOI
PerFED-GAN: Personalized Federated Learning via Generative Adversarial Networks
TL;DR: In this paper , a federated learning method based on co-training and generative adversarial networks (GANs) is proposed, which allows each client to design its own model to participate in federated training independently without sharing any model architecture or parameter information with other clients or a center.
Posted Content
A Dispersed Federated Learning Framework for 6G-Enabled Autonomous Driving Cars.
TL;DR: In this article, a distributed federated learning (DFL) framework for autonomous driving cars is proposed to offer robust, communication resource-efficient, and privacy-aware learning, where a mixed-integer nonlinear optimization problem is formulated to jointly minimize the loss in federated Learning model accuracy due to packet errors and transmission latency.
Journal ArticleDOI
Privacy-Preserving Federated Transfer Learning for Driver Drowsiness Detection
TL;DR: The proposed federated transfer learning method with the privacy-preserving protocol for driver drowsiness detection, named PFTL-DDD, can reduce the communication cost of the system, and the CKKS-based security protocol can protect personal privacy.
Journal ArticleDOI
Fuzzy Logic Based Client Selection for Federated Learning in Vehicular Networks
Narisu Cha,Zhaoyang Du,Celimuge Wu,Tsutomu Yoshinaga,Lei Zhong,Jing Ma,Fuqiang Liu,Yusheng Ji +7 more
TL;DR: A fuzzy logic based client selection scheme that considers the number of local samples, samples freshness, computation capability, and available network throughput based on a fuzzy logic approach and outperforms other baselines.
Journal ArticleDOI
Wireless Distributed Edge Learning: How Many Edge Devices Do We Need?
Jaeyoung Song,Marios Kountouris +1 more
TL;DR: How many edge devices are needed to minimize the average completion time while guaranteeing convergence is derived and a necessary condition for adding edge devices in two asymptotic regimes, namely the large dataset and the high accuracy regime is found.