LEAF: A Benchmark for Federated Settings
Citations
1,107 citations
895 citations
701 citations
Cites background from "LEAF: A Benchmark for Federated Set..."
...• LEAF: An open source framework [84] of datasets...
[...]
580 citations
Cites background or methods from "LEAF: A Benchmark for Federated Set..."
...The federated version of EMNIST (Caldas et al., 2018) partitions the digits by their author....
[...]
...Federated EMNIST (Caldas et al., 2018) partitions the digits by their author, introducing natural heterogeneity due to variance in writing styles....
[...]
579 citations
Cites background or methods from "LEAF: A Benchmark for Federated Set..."
...…have been observed in a wide range of tasks and applications, including in natural language processing (Geva et al., 2019), automatic speech recognition (Koenecke et al., 2020; Tatman, 2017), federated learning (Li et al., 2019b; Caldas et al., 2018), and medical imaging (Badgeley et al., 2019)....
[...]
...These models can perform well on average but poorly on some individuals (Tatman, 2017; Caldas et al., 2018; Li et al., 2019b; Koenecke et al., 2020)....
[...]
...This follows the federated learning literature, where it is standard to measure model performance on devices and users at various percentiles in an effort to encourage good performance across many devices (Caldas et al., 2018; Li et al., 2019b)....
[...]
...These models can perform well on average but poorly on some users (Tatman, 2017; Caldas et al., 2018; Li et al., 2019b; Koenecke et al., 2020)....
[...]
References
7,027 citations
6,273 citations
"LEAF: A Benchmark for Federated Set..." refers background in this paper
...• CelebA, which partitions the Large-scale CelebFaces Attributes Dataset 3 [21] by the celebrity on the picture....
[...]
5,936 citations
"LEAF: A Benchmark for Federated Set..." refers background or methods or result in this paper
...In particular, we highlight three of LEAF’s characteristics4: LEAF enables reproducible science: To demonstrate the reproducibility enabled via LEAF, we focus on qualitatively reproducing the results that [22] obtained on the Shakespeare dataset for a next character prediction task....
[...]
...Currently, this set is limited to the federated learning paradigm, and in particular includes reference implementations of minibatch SGD, FedAvg [22] and Mocha [30]....
[...]
..., FaceScrub in [25], Shakespeare in [22] and Reddit in [13, 24, 3]....
[...]
..., artificial partitions of MNIST, MNIST-fashion or CIFAR-10 [22, 13, 8, 3, 11, 32, 34]; (2) realistic but proprietary federated datasets, e....
[...]
...With data increasingly being generated on federated networks of remote devices, there is growing interest in empowering on-device applications with models that make use of such data [22, 23, 30, 19, 37]....
[...]
5,333 citations
4,075 citations