Adaptive Federated Learning in Resource Constrained Edge Computing Systems
Shiqiang Wang,Tiffany Tuor,Theodoros Salonidis,Kin K. Leung,Christian Makaya,Ting He,Kevin S. Chan +6 more
Reads0
Chats0
TLDR
In this paper, the authors consider the problem of learning model parameters from data distributed across multiple edge nodes, without sending raw data to a centralized place, and propose a control algorithm that determines the best tradeoff between local update and global parameter aggregation to minimize the loss function under a given resource budget.Abstract:
Emerging technologies and applications including Internet of Things, social networking, and crowd-sourcing generate large amounts of data at the network edge. Machine learning models are often built from the collected data, to enable the detection, classification, and prediction of future events. Due to bandwidth, storage, and privacy concerns, it is often impractical to send all the data to a centralized location. In this paper, we consider the problem of learning model parameters from data distributed across multiple edge nodes, without sending raw data to a centralized place. Our focus is on a generic class of machine learning models that are trained using gradient-descent-based approaches. We analyze the convergence bound of distributed gradient descent from a theoretical point of view, based on which we propose a control algorithm that determines the best tradeoff between local update and global parameter aggregation to minimize the loss function under a given resource budget. The performance of the proposed algorithm is evaluated via extensive experiments with real datasets, both on a networked prototype system and in a larger-scale simulated environment. The experimentation results show that our proposed approach performs near to the optimum with various machine learning models and different data distributions.read more
Citations
More filters
Proceedings ArticleDOI
TailorFL: Dual-Personalized Federated Learning under System and Data Heterogeneity
TL;DR: TailorFL as discussed by the authors proposes a dual-personalized federated learning framework, which tailors a submodel for each device with personalized structure for training and personalized parameters for local inference.
Journal ArticleDOI
Heterogeneous Training Intensity for Federated Learning: A Deep Reinforcement Learning Approach
TL;DR: Wang et al. as mentioned in this paper proposed a novel Heterogeneous Training Intensity assignment (HTI_FL) problem for federated learning, aiming at reducing the largest training latency gap among clients.
Proceedings ArticleDOI
Blockchain and Federated Learning-enabled Distributed Secure and Privacy-preserving Computing Architecture for IoT Network
TL;DR: In this paper , the authors identify the research gaps and propose a blockchain and federated learning-enabled distributed secure and privacy-preserving computing architecture for IoT network, which introduces the lightweight authentication and model training algorithms to build secure and robust system.
Journal ArticleDOI
User Selection for Federated Learning in a Wireless Environment: A Process to Minimize the Negative Effect of Training Data Correlation and Improve Performance
TL;DR: In this article , a federated learning protocol with user selection is proposed to reduce the negative effect of correlation within training data while limiting wireless channel resource utilization, and an exclusion zone is applied to maintain separation during user selection.
Journal ArticleDOI
Network Support for High-Performance Distributed Machine Learning
TL;DR: In this article , the authors propose a system model that captures such aspects in the context of supervised machine learning, accounting for both learning nodes (that perform computations) and information nodes(that provide data).