J
Jakub Konečný
Researcher at Google
Publications - 40
Citations - 11194
Jakub Konečný is an academic researcher from Google. The author has contributed to research in topics: Convex function & Stochastic gradient descent. The author has an hindex of 22, co-authored 35 publications receiving 7333 citations. Previous affiliations of Jakub Konečný include Comenius University in Bratislava & University of Edinburgh.
Papers
More filters
Posted Content
Federated Learning: Strategies for Improving Communication Efficiency
Jakub Konečný,H. Brendan McMahan,Felix X. Yu,Peter Richtárik,Ananda Theertha Suresh,Dave Bacon +5 more
TL;DR: Two ways to reduce the uplink communication costs are proposed: structured updates, where the user directly learns an update from a restricted space parametrized using a smaller number of variables, e.g. either low-rank or a random mask; and sketched updates, which learn a full model update and then compress it using a combination of quantization, random rotations, and subsampling.
Posted Content
Towards Federated Learning at Scale: System Design
Keith Bonawitz,Hubert Eichner,Wolfgang Grieskamp,Dzmitry Huba,Alex Ingerman,Vladimir Ivanov,Chloe Kiddon,Jakub Konečný,Stefano Mazzocchi,H. Brendan McMahan,Timon Van Overveldt,David Petrou,Daniel Ramage,Jason Roselander +13 more
TL;DR: In this paper, a scalable production system for federated learning in the domain of mobile devices, based on TensorFlow, is presented. Butler et al. describe the resulting high-level design, sketch some of the challenges and their solutions, and touch upon the open problems and future directions.
Posted Content
Federated Optimization: Distributed Machine Learning for On-Device Intelligence
TL;DR: A new and increasingly relevant setting for distributed optimization in machine learning, where the data defining the optimization are unevenly distributed over an extremely large number of nodes, is introduced, to train a high-quality centralized model.
Posted Content
Advances and Open Problems in Federated Learning
Peter Kairouz,H. Brendan McMahan,Brendan Avent,Aurélien Bellet,Mehdi Bennis,Arjun Nitin Bhagoji,Kallista Bonawitz,Zachary Charles,Graham Cormode,Rachel Cummings,Rafael G. L. D'Oliveira,Hubert Eichner,Salim El Rouayheb,David Evans,Josh Gardner,Zachary Garrett,Adrià Gascón,Badih Ghazi,Phillip B. Gibbons,Marco Gruteser,Zaid Harchaoui,Chaoyang He,Lie He,Zhouyuan Huo,Ben Hutchinson,Justin Hsu,Martin Jaggi,Tara Javidi,Gauri Joshi,Mikhail Khodak,Jakub Konečný,Aleksandra Korolova,Farinaz Koushanfar,Sanmi Koyejo,Tancrède Lepoint,Yang Liu,Prateek Mittal,Mehryar Mohri,Richard Nock,Ayfer Ozgur,Rasmus Pagh,Mariana Raykova,Hang Qi,Daniel Ramage,Ramesh Raskar,Dawn Song,Weikang Song,Sebastian U. Stich,Ziteng Sun,Ananda Theertha Suresh,Florian Tramèr,Praneeth Vepakomma,Jianyu Wang,Li Xiong,Zheng Xu,Qiang Yang,Felix X. Yu,Han Yu,Sen Zhao +58 more
TL;DR: Motivated by the explosive growth in FL research, this paper discusses recent advances and presents an extensive collection of open problems and challenges.
Posted Content
LEAF: A Benchmark for Federated Settings
Sebastian Caldas,Peter Wu,Tian Li,Jakub Konečný,H. Brendan McMahan,Virginia Smith,Ameet Talwalkar +6 more
TL;DR: LEAF is proposed, a modular benchmarking framework for learning in federated settings that includes a suite of open-source federated datasets, a rigorous evaluation framework, and a set of reference implementations, all geared towards capturing the obstacles and intricacies of practical federated environments.