L
Luke Zettlemoyer
Researcher at Facebook
Publications - 344
Citations - 65369
Luke Zettlemoyer is an academic researcher from Facebook. The author has contributed to research in topics: Computer science & Parsing. The author has an hindex of 82, co-authored 278 publications receiving 40896 citations. Previous affiliations of Luke Zettlemoyer include Princeton University & Massachusetts Institute of Technology.
Papers
More filters
Proceedings ArticleDOI
Prompting Contrastive Explanations for Commonsense Reasoning Tasks
Posted Content
Luna: Linear Unified Nested Attention
TL;DR: Luna as discussed by the authors proposes a linear unified nested attention mechanism that approximates softmax attention with two nested linear attention functions, yielding only linear (as opposed to quadratic) time and space complexity.
Journal ArticleDOI
Toward Human Readable Prompt Tuning: Kubrick's The Shining is a good movie, and a good prompt too?
TL;DR: The authors investigate common attributes shared by effective prompts and propose a human readable prompt tuning method based on Langevin dynamics that incorporates a fluency constraint to find a diverse distribution of effective and fluent prompts.
Journal ArticleDOI
MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers
TL;DR: The authors proposed Megabyte, a multi-scale decoder architecture that enables end-to-end differentiable modeling of sequences of over one million bytes and achieved state-of-the-art performance on ImageNet.
Posted Content
Learning Programmatic Idioms for Scalable Semantic Parsing
TL;DR: This paper introduced an iterative method to extract code idioms from large source code corpora by repeatedly collapsing most-frequent depth-2 subtrees of their syntax trees, and train semantic parsers to apply these idioms during decoding.