A
Andrew M. Dai
Researcher at Google
Publications - 97
Citations - 14162
Andrew M. Dai is an academic researcher from Google. The author has contributed to research in topics: Computer science & Language model. The author has an hindex of 32, co-authored 83 publications receiving 8724 citations. Previous affiliations of Andrew M. Dai include University of Edinburgh & Northwestern University.
Papers
More filters
Proceedings ArticleDOI
Generating Sentences from a Continuous Space
TL;DR: This work introduces and study an RNN-based variational autoencoder generative model that incorporates distributed latent representations of entire sentences that allows it to explicitly model holistic properties of sentences such as style, topic, and high-level syntactic features.
Journal ArticleDOI
Natural Questions: A Benchmark for Question Answering Research
Tom Kwiatkowski,Jennimaria Palomaki,Olivia Redfield,Michael Collins,Ankur P. Parikh,Chris Alberti,Danielle Epstein,Illia Polosukhin,Jacob Devlin,Kenton Lee,Kristina Toutanova,Llion Jones,Matthew Kelcey,Ming-Wei Chang,Andrew M. Dai,Jakob Uszkoreit,Quoc V. Le,Slav Petrov +17 more
TL;DR: The Natural Questions corpus, a question answering data set, is presented, introducing robust metrics for the purposes of evaluating question answering systems; demonstrating high human upper bounds on these metrics; and establishing baseline results using competitive methods drawn from related literature.
Journal Article
PaLM: Scaling Language Modeling with Pathways
Aakanksha Chowdhery,Sharan Narang,Jacob Devlin,Maarten Bosma,Gaurav Mishra,Adam Roberts,Paul Barham,Hyung Won Chung,Charles Sutton,Sebastian Gehrmann,Parker Schuh,Kensen Shi,Sasha Tsvyashchenko,Joshua Maynez,Abhishek Rao,Parker Barnes,Yi Tay,Noam Shazeer,Velu Prabhakaran,Emily Reif,Nan Du,B. C. Hutchinson,Reiner Pope,James Bradbury,Jacob Austin,Michael Isard,Guy Gur-Ari,Peng Yin,Toju Duke,Anselm Levskaya,Sanjay Ghemawat,Sunipa Dev,Henryk Michalewski,Xavier Garcia,Vedant Misra,Kevin Robinson,L Fedus,Denny Zhou,Daphne Ippolito,David Luan,Hyeontaek Lim,Barret Zoph,Alexander Spiridonov,Ryan Sepassi,David Dohan,Shivani Agrawal,Mark Omernick,Andrew M. Dai,Thanumalayan Sankaranarayana Pillai,Marie Pellat,Aitor Lewkowycz,Erica Oliveira Moreira,Rewon Child,Oleksandr Polozov,Katherine Lee,Zong Tuan Zhou,Xuezhi Wang,Brennan Saeta,Mark Díaz,Orhan Firat,M. Catasta,Jason Loh Seong Wei,Kathleen S. Meier-Hellstern,Douglas Eck,Jeffrey Dean,Slav Petrov,Noah Fiedel +66 more
TL;DR: A 540-billion parameter, densely activated, Transformer language model, which is called PaLM achieves breakthrough performance, outperforming the state-of-the-art on a suite of multi-step reasoning tasks, and outperforming average human performance on the recently released BIG-bench benchmark.
Journal ArticleDOI
Scalable and accurate deep learning with electronic health records
Alvin Rajkomar,Alvin Rajkomar,Eyal Oren,Kai Chen,Andrew M. Dai,Nissan Hajaj,Michaela Hardt,Peter J. Liu,Xiaobing Liu,Jake Marcus,Mimi Sun,Patrik Sundberg,Hector Yee,Kun Zhang,Yi Zhang,Gerardo Flores,Gavin E. Duggan,Jamie Irvine,Quoc V. Le,Kurt Litsch,Alexander Mossin,Justin Tansuwan,De Wang,James Wexler,Jimbo Wilson,Dana Ludwig,Samuel L. Volchenboum,Katherine Chou,Michael Pearson,Srinivasan Madabushi,Nigam H. Shah,Atul J. Butte,Michael D. Howell,Claire Cui,Greg S. Corrado,Jeffrey Dean +35 more
TL;DR: A representation of patients’ entire raw EHR records based on the Fast Healthcare Interoperability Resources (FHIR) format is proposed, and it is demonstrated that deep learning methods using this representation are capable of accurately predicting multiple medical events from multiple centers without site-specific data harmonization.
Journal ArticleDOI
Scalable and accurate deep learning for electronic health records
Alvin Rajkomar,Eyal Oren,Kai Chen,Andrew M. Dai,Nissan Hajaj,Peter J. Liu,Xiaobing Liu,Mimi Sun,Patrik Sundberg,Hector Yee,Kun Zhang,Gavin E. Duggan,Gerardo Flores,Michaela Hardt,Jamie Irvine,Quoc V. Le,Kurt Litsch,Jake Marcus,Alexander Mossin,Justin Tansuwan,De Wang,James Wexler,Jimbo Wilson,Dana Ludwig,Samuel L. Volchenboum,Katherine Chou,Michael Pearson,Srinivasan Madabushi,Nigam H. Shah,Atul J. Butte,Michael D. Howell,Claire Cui,Greg S. Corrado,Jeffrey Dean +33 more
TL;DR: In this paper, the authors proposed a representation of patients' entire, raw EHR records based on the Fast Healthcare Interoperability Resources (FHIR) format and demonstrated that deep learning methods using this representation are capable of accurately predicting multiple medical events from multiple centers without site-specific data harmonization.