Adaptive Federated Learning in Resource Constrained Edge Computing Systems
Shiqiang Wang,Tiffany Tuor,Theodoros Salonidis,Kin K. Leung,Christian Makaya,Ting He,Kevin S. Chan +6 more
Reads0
Chats0
TLDR
In this paper, the authors consider the problem of learning model parameters from data distributed across multiple edge nodes, without sending raw data to a centralized place, and propose a control algorithm that determines the best tradeoff between local update and global parameter aggregation to minimize the loss function under a given resource budget.Abstract:
Emerging technologies and applications including Internet of Things, social networking, and crowd-sourcing generate large amounts of data at the network edge. Machine learning models are often built from the collected data, to enable the detection, classification, and prediction of future events. Due to bandwidth, storage, and privacy concerns, it is often impractical to send all the data to a centralized location. In this paper, we consider the problem of learning model parameters from data distributed across multiple edge nodes, without sending raw data to a centralized place. Our focus is on a generic class of machine learning models that are trained using gradient-descent-based approaches. We analyze the convergence bound of distributed gradient descent from a theoretical point of view, based on which we propose a control algorithm that determines the best tradeoff between local update and global parameter aggregation to minimize the loss function under a given resource budget. The performance of the proposed algorithm is evaluated via extensive experiments with real datasets, both on a networked prototype system and in a larger-scale simulated environment. The experimentation results show that our proposed approach performs near to the optimum with various machine learning models and different data distributions.read more
Citations
More filters
Journal ArticleDOI
Computing in the Sky: A Survey on Intelligent Ubiquitous Computing for UAV-Assisted 6G Networks and Industry 4.0/5.0
Saeed H. Alsamhi,Alexey V. Shvetsov,Santosh Kumar,Jahan Hassan,Mohammed A. Alhartomi,Svetlana V. Shvetsova,Radhya Sahal,Ammar Hawbani +7 more
TL;DR: The utility of UAV computing and the critical role of Federated Learning (FL) in meeting the challenges related to energy, security, task offloading, and latency of IoT data in smart environments are highlighted.
Posted Content
Distributed Machine Learning for Wireless Communication Networks: Techniques, Architectures, and Applications
TL;DR: In this article, a comprehensive survey of distributed machine learning techniques for wireless networks is presented, focusing on power control, spectrum management, user association, and edge cloud computing, and potential adversarial attacks faced by DML applications.
Journal ArticleDOI
Distributed Machine Learning for Wireless Communication Networks: Techniques, Architectures, and Applications
TL;DR: The latest applications of DML in power control, spectrum management, user association, and edge cloud computing, and the potential adversarial attacks faced by DML applications are reviewed, and state-of-the-art countermeasures to preserve privacy and security are described.
Journal ArticleDOI
An Asynchronous and Real-Time Update Paradigm of Federated Learning for Fault Diagnosis
Xue Ma,Chenglin Wen,Tao Wen +2 more
TL;DR: This paper adopts the linear fusion method based on sequential filtering and fuse the parameters of federated center asynchronously considering communication delay and establishes the real-time identification method for the clients based on linear filtering with the new labelled samples obtained at non-equal intervals.
Proceedings ArticleDOI
A Collaborative Learning Framework via Federated Meta-Learning
Sen Lin,Guang Yang,Junshan Zhang +2 more
TL;DR: In this paper, a federated meta-learning approach is proposed to train a model across a set of source edge nodes and adapt it to learn a new task at the target edge node, using a few samples only.