基本信息
views: 314

Bio
I'm working to make machines more helpful through unsupervised learning that scales.
I developed the Sparse Transformer with Scott Gray, and also coauthored work showing the emergent capabilities of large language models in a variety of settings (GPT-2, GPT-3, Image GPT, and more).
More recently I've worked on reducing the limitations of those techniques (very deep VAEs) while continuing to apply them on larger supercomputers (MT-NLG and PaLM).
I developed the Sparse Transformer with Scott Gray, and also coauthored work showing the emergent capabilities of large language models in a variety of settings (GPT-2, GPT-3, Image GPT, and more).
More recently I've worked on reducing the limitations of those techniques (very deep VAEs) while continuing to apply them on larger supercomputers (MT-NLG and PaLM).
Research Interests
Papers共 16 篇Author StatisticsCo-AuthorSimilar Experts
By YearBy Citation主题筛选期刊级别筛选合作者筛选合作机构筛选
时间
引用量
主题
期刊级别
合作者
合作机构
Contact Jordan,Boyd-Graber,Leonard Adolphs, Benjamin Boerschinger, Michelle Chen Buck, Massimiliano Huebscher, Lasse Cia-66 ramita, Thomas Espeholt, Hofmann, Yannic, Sascha Kilcher, Pier Giuseppe Rothe, Sessa,Akari Asai,Kazuma Hashimoto,Hannaneh Hajishirzi, A. Aula, Natalie Jhaveri, Mika Käki., Infor-67,Steven Bird,Ewan Klein,E. Loper, Nat-67,Tom Brown,Benjamin Mann,Nick Ryder,Melanie Subbiah,Jared Kaplan,Prafulla Dhariwal,Arvind Neelakantan,Pranav Shyam,Girish Sastry,Amanda Askell,Sandhini Agarwal,Ariel Herbert-Voss,Gretchen Krueger,T. Henighan,Rewon Child, A. Ramesh,Daniel M. Ziegler, Jeffrey Wu,Clemens Winter,Chris Hesse,Mark Chen,Eric Sigler,Mateusz Litwin, S. Gray,Benjamin Chess,Jack Clark,Christopher Berner,Sam McCandlish
semanticscholar(2023)
Cited0Views0Bibtex
0
0
Aakanksha Chowdhery,Sharan Narang,Jacob Devlin,Maarten Bosma,Gaurav Mishra,Adam Roberts,Paul Barham,Hyung Won Chung,Charles Sutton,Sebastian Gehrmann,Parker Schuh,Kensen Shi,Sasha Tsvyashchenko,Joshua Maynez,Abhishek Rao,Parker Barnes,Yi Tay,Noam Shazeer,Vinodkumar Prabhakaran,Emily Reif,Nan Du,Ben Hutchinson,Reiner Pope,James Bradbury,Jacob Austin,Michael Isard,Guy Gur-Ari,Pengcheng Yin,Toju Duke,Anselm Levskaya,Sanjay Ghemawat,Sunipa Dev,Henryk Michalewski,Xavier Garcia,Vedant Misra,Kevin Robinson,Liam Fedus,Denny Zhou,Daphne Ippolito,David Luan,Hyeontaek Lim,Barret Zoph,Alexander Spiridonov,Ryan Sepassi,David Dohan,Shivani Agrawal,Mark Omernick,Andrew M. Dai,Thanumalayan Sankaranarayana Pillai,Marie Pellat,Aitor Lewkowycz,Erica Moreira,Rewon Child,Oleksandr Polozov,Katherine Lee,Zongwei Zhou,Xuezhi Wang,Brennan Saeta,Mark Diaz,Orhan Firat,Michele Catasta,Jason Wei,Kathy Meier-Hellstern,Douglas Eck,Jeff Dean,Slav Petrov,Noah Fiedel
JOURNAL OF MACHINE LEARNING RESEARCH (2023)
Shaden Smith,Mostofa Patwary,Brandon Norick,Patrick LeGresley,Samyam Rajbhandari,Jared Casper,Zhun Liu,Shrimai Prabhumoye,George Zerveas,Vijay Korthikanti,Elton Zhang,Rewon Child,Reza Yazdani Aminabadi,Julie Bernauer,Xia Song,Mohammad Shoeybi,Yuxiong He,Michael Houston,Saurabh Tiwary,Bryan Catanzaro
CoRR (2022)
Antonis Maronikolakis,Hinrich Schütze, Mark Stevenson, T. B. Brown, Benjamin F. Mann, N. C. Ryder,Melanie Subbiah,Jared Kaplan,Prafulla Dhariwal,Arvind Neelakantan,Pranav Shyam,Girish Sastry,Amanda Askell,Sandhini Agarwal, Andreas Voss,Gretchen Krueger,Tom Henighan,Rewon Child,A. Ramesh,Daniel M. Ziegler,Jeffrey C.S. Wu,Clemens Winter,Chris Hesse,Mark Chen, Eric J. Sigler,Mateusz Litwin,Scott Gray,Benjamin Chess, Jack A. Clark,Christopher Berner,Ashish Vaswani,Noam Shazeer,Niki Parmar,Jakob Uszkoreit,Llion Jones,Aidan N. Gomez,Rowan Zellers,Ari Holtzman,Hannah Rashkin,Yonatan Bisk,Jens Lemmens,Ilia Markov, Walter Daelemans, Valerio Basile, Cristina Bosco,Elisabetta Fersini,Debora Nozza,Viviana Patti, Francisco Manuel, George Lakoff, Mark Metaphors,Fabián Pedregosa,Gaël Varoquaux,A Gramfort, Vincent Michel,B Thirion,Olivier Grisel, Marion Blondel,Peter Prettenhofer
openalex(2021)
CoRR (2020)
Cited3497Views0EIBibtex
3497
0
Tom B. Brown,Benjamin Mann,Nick Ryder,Melanie Subbiah,Jared Kaplan,Prafulla Dhariwal,Arvind Neelakantan,Pranav Shyam,Girish Sastry,Amanda Askell,Sandhini Agarwal,Ariel Herbert-Voss,Gretchen Krueger,Tom Henighan,Rewon Child,Aditya Ramesh,Daniel M. Ziegler,Jeffrey Wu,Clemens Winter,Christopher Hesse,Mark Chen,Eric Sigler,Mateusz Litwin,Scott Gray,Benjamin Chess,Jack Clark,Christopher Berner,Sam McCandlish,Alec Radford,Ilya Sutskever,Dario Amodei
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020 (2020)
International Conference on Machine Learningpp.1691-1703, (2020)
Cited1991Views0EIBibtex
1991
0
Load More
Author Statistics
#Papers: 16
#Citation: 61551
H-Index: 12
G-Index: 13
Sociability: 5
Diversity: 1
Activity: 3
Co-Author
Co-Institution
D-Core
- 合作者
- 学生
- 导师
Data Disclaimer
The page data are from open Internet sources, cooperative publishers and automatic analysis results through AI technology. We do not make any commitments and guarantees for the validity, accuracy, correctness, reliability, completeness and timeliness of the page data. If you have any questions, please contact us by email: report@aminer.cn