J
Jeffrey Dean
Researcher at Google
Publications - 255
Citations - 207859
Jeffrey Dean is an academic researcher from Google. The author has contributed to research in topics: Deep learning & Web search query. The author has an hindex of 83, co-authored 242 publications receiving 179031 citations. Previous affiliations of Jeffrey Dean include University of Washington & World Health Organization.
Papers
More filters
Patent
System and method for searching an extended database
TL;DR: In this paper, a standard index is searched based on the search query, and an extended index is then obtained from the extended index and at least a portion of the extended search results are transmitted towards a user.
Patent
Cross-lingual indexing and information retrieval
TL;DR: In this paper, a user makes a query in a first language, and a group of documents that were previously machine-translated into the first language are searched for information responsive to the query.
Journal ArticleDOI
Efficiently Scaling Transformer Inference
Reiner Pope,Sholto Douglas,Aakanksha Chowdhery,Jacob Devlin,James Bradbury,Anselm Levskaya,Jonathan Heek,Kefan Xiao,Shivani Agrawal,Jeffrey Dean +9 more
TL;DR: In this article , a simple analytical model for inference efficiency was developed to select the best multi-dimensional partitioning techniques optimized for TPU v4 slices based on the application requirements. And they combined these with a suite of low-level optimizations to achieve a new Pareto frontier on the latency and model FLOPS utilization (MFU) tradeoffs on 500B+ parameter models that outperforms the FasterTransformer suite of benchmarks.
Journal ArticleDOI
A Review of Sparse Expert Models in Deep Learning
TL;DR: The concept of sparse expert models is reviewed, a basic description of the common algorithms is provided, the advances in the deep learning era are contextualized, and areas for future work are highlighted.