A
Alexandre Sablayrolles
Researcher at Facebook
Publications - 33
Citations - 1303
Alexandre Sablayrolles is an academic researcher from Facebook. The author has contributed to research in topics: Computer science & Nearest neighbor search. The author has an hindex of 12, co-authored 25 publications receiving 1014 citations.
Papers
More filters
Posted Content
Training data-efficient image transformers & distillation through attention
Hugo Touvron,Matthieu Cord,Matthijs Douze,Francisco Massa,Alexandre Sablayrolles,Hervé Jégou +5 more
TL;DR: In this article, a teacher-student strategy was proposed to train a convolution-free transformer on Imagenet only, achieving state-of-the-art performance on ImageNet.
Proceedings Article
Training data-efficient image transformers & distillation through attention
Posted Content
White-box vs Black-box: Bayes Optimal Strategies for Membership Inference.
TL;DR: This paper derives the optimal strategy for membership inference with a few assumptions on the distribution of the parameters, and shows that optimal attacks only depend on the loss function, and thus black-box attacks are as good as white- box attacks.
Proceedings Article
Large Memory Layers with Product Keys
TL;DR: A structured memory which can be easily integrated into a neural network and significantly increases the capacity of the architecture, by up to a billion parameters with a negligible computational overhead is introduced.
Posted Content
Going deeper with Image Transformers
TL;DR: In this article, the authors investigated the interplay of architecture and optimization of deep transformers for image classification and achieved state-of-the-art performance on Imagenet with Reassessed labels and match frequency.