Q
Quoc V. Le
Publications - 4
Citations - 404
Quoc V. Le is an academic researcher. The author has contributed to research in topics: Computer science & Chip. The author has an hindex of 2, co-authored 4 publications receiving 404 citations.
Papers
More filters
Journal ArticleDOI
Scaling Instruction-Finetuned Language Models
Hyung Won Chung,Le Hou,Shayne Longpre,Barret Zoph,Yi Tay,William Fedus,Eric Li,Xuezhi Wang,Mostafa Dehghani,Siddhartha Brahma,Albert Webson,Shixiang Gu,Zhuyun Dai,Mirac M. Suzgun,Xinyun Chen,Aakanksha Chowdhery,Dasha Valter,Sharan Narang,Gaurav Mishra,Adams Wei Yu,Vincent Zhao,Yanping Huang,Andrew M. Dai,Hongkun Yu,Slav Petrov,Ed H. Chi,Jeffrey Dean,Jacob Devlin,Adam Roberts,Denny Zhou,Quoc V. Le,Jason Loh Seong Wei +31 more
TL;DR: This result shows that instruction and UL2 continued pre-training are complementary compute-efficient methods to improve the performance of language models without increasing model scale.
Posted ContentDOI
The Carbon Footprint of Machine Learning Training Will Plateau, Then Shrink
David A. Patterson,Joseph E. Gonzalez,Urs Palo Alto Holzle,Quoc V. Le,Chen Liang,Lluís-Miquel Munguía,Daniel Rothchild,David R. So,Maud Texier,Jeffrey Dean +9 more
TL;DR: In this article , the authors show four best practices to reduce ML training energy and carbon dioxide emissions, and they predict that by 2030, total carbon emissions from training will decline significantly.
Journal ArticleDOI
Author Correction: A graph placement methodology for fast chip design
Journal ArticleDOI