A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks
Reads0
Chats0
TLDR
In this paper, a joint learning, wireless resource allocation, and user selection problem is formulated as an optimization problem whose goal is to minimize an FL loss function that captures the performance of the FL algorithm.Abstract:
In this article, the problem of training federated learning (FL) algorithms over a realistic wireless network is studied. In the considered model, wireless users execute an FL algorithm while training their local FL models using their own data and transmitting the trained local FL models to a base station (BS) that generates a global FL model and sends the model back to the users. Since all training parameters are transmitted over wireless links, the quality of training is affected by wireless factors such as packet errors and the availability of wireless resources. Meanwhile, due to the limited wireless bandwidth, the BS needs to select an appropriate subset of users to execute the FL algorithm so as to build a global FL model accurately. This joint learning, wireless resource allocation, and user selection problem is formulated as an optimization problem whose goal is to minimize an FL loss function that captures the performance of the FL algorithm. To seek the solution, a closed-form expression for the expected convergence rate of the FL algorithm is first derived to quantify the impact of wireless factors on FL. Then, based on the expected convergence rate of the FL algorithm, the optimal transmit power for each user is derived, under a given user selection and uplink resource block (RB) allocation scheme. Finally, the user selection and uplink RB allocation is optimized so as to minimize the FL loss function. Simulation results show that the proposed joint federated learning and communication framework can improve the identification accuracy by up to 1.4%, 3.5% and 4.1%, respectively, compared to: 1) An optimal user selection algorithm with random resource allocation, 2) a standard FL algorithm with random user selection and resource allocation, and 3) a wireless optimization algorithm that minimizes the sum packet error rates of all users while being agnostic to the FL parameters.read more
Citations
More filters
Journal ArticleDOI
CVC: A Collaborative Video Caching Framework Based on Federated Learning at the Edge
TL;DR: Wang et al. as mentioned in this paper proposed a collaborative video caching framework at the edge to improve the quality of user experience, which can also reduce the overall system's communication cost and caching cost.
Energy management in wireless communications : from convex optimization to machine learning
TL;DR: This work investigates machine learning algorithms for different stochastic optimization problems, and can successfully integrate the renewable energy in single-cell and multi-cell SGPCSs and proposes two time-scale resource allocation algorithms that can trade grid-energy expenditure for the end-to-end delay of user equipments inMulti-cellSGPCS.
Posted Content
An Incentive Mechanism for Federated Learning in Wireless Cellular network: An Auction Approach.
Tra Huong Thi Le,Nguyen H. Tran,Yan Kyaw Tun,Minh N. H. Nguyen,Shashi Raj Pandey,Zhu Han,Choong Seon Hong +6 more
TL;DR: This paper considers a FL system that involves one base station (BS) and multiple mobile users, and proposes the primal-dual greedy auction mechanism, which can guarantee three economic properties, namely, truthfulness, individual rationality and efficiency.
Journal ArticleDOI
Blockchain Assisted Federated Learning Over Wireless Channels: Dynamic Resource Allocation and Client Scheduling
TL;DR: Wang et al. as mentioned in this paper proposed a joint optimization problem of training client selection and resource allocation (i.e., the transmit power and computation frequency at the client side), and solved the long-term mixed integer non-linear program based on a Lyapunov technique.
Journal ArticleDOI
FedPCC: Parallelism of Communication and Computation for Federated Learning in Wireless Networks
TL;DR: In this paper , the authors proposed an efficient approach based on the parallelism of communication and computation among devices for FL in wireless networks, which considers the difference in communication and computational capabilities between different devices and optimizes the training schedule for devices selected in each round.
References
More filters
Posted Content
Communication-Efficient Learning of Deep Networks from Decentralized Data
TL;DR: This work presents a practical method for the federated learning of deep networks based on iterative model averaging, and conducts an extensive empirical evaluation, considering five different model architectures and four datasets.
Proceedings Article
Communication-Efficient Learning of Deep Networks from Decentralized Data
TL;DR: In this paper, the authors presented a decentralized approach for federated learning of deep networks based on iterative model averaging, and conduct an extensive empirical evaluation, considering five different model architectures and four datasets.
Posted Content
Federated Learning: Strategies for Improving Communication Efficiency
Jakub Konečný,H. Brendan McMahan,Felix X. Yu,Peter Richtárik,Ananda Theertha Suresh,Dave Bacon +5 more
TL;DR: Two ways to reduce the uplink communication costs are proposed: structured updates, where the user directly learns an update from a restricted space parametrized using a smaller number of variables, e.g. either low-rank or a random mask; and sketched updates, which learn a full model update and then compress it using a combination of quantization, random rotations, and subsampling.
Journal ArticleDOI
A Vision of 6G Wireless Systems: Applications, Trends, Technologies, and Open Research Problems
TL;DR: This article identifies the primary drivers of 6G systems, in terms of applications and accompanying technological trends, and identifies the enabling technologies for the introduced 6G services and outlines a comprehensive research agenda that leverages those technologies.
Journal ArticleDOI
Federated Learning: Challenges, Methods, and Future Directions
TL;DR: In this paper, the authors discuss the unique characteristics and challenges of federated learning, provide a broad overview of current approaches, and outline several directions of future work that are relevant to a wide range of research communities.