基本信息
views: 49
Career Trajectory
Bio
i specialize in building big systems to crunch through big data and develop big models.
i have previously developed one of the largest reinforcement learning systems at openai for openai five, along with llm training infrastructure at meta ai / fair that created opt-175b.
opt-175b was the first release in the industry to include:
a 175b parameter model for research use
a 114-page logbook detailing the challenges encountered during the 56 days it took to train a 175b llm on new hardware for the first time
the entire training codebase
a full suite of smaller-scale models ranging from 125M to 66B in size for studying scaling laws.
before getting into ai systems, i worked on scaling out data infrastructure and processing pipelines across various cloud providers.
i have previously developed one of the largest reinforcement learning systems at openai for openai five, along with llm training infrastructure at meta ai / fair that created opt-175b.
opt-175b was the first release in the industry to include:
a 175b parameter model for research use
a 114-page logbook detailing the challenges encountered during the 56 days it took to train a 175b llm on new hardware for the first time
the entire training codebase
a full suite of smaller-scale models ranging from 125M to 66B in size for studying scaling laws.
before getting into ai systems, i worked on scaling out data infrastructure and processing pipelines across various cloud providers.
Research Interests
Papers共 11 篇Author StatisticsCo-AuthorSimilar Experts
By YearBy Citation主题筛选期刊级别筛选合作者筛选合作机构筛选
时间
引用量
主题
期刊级别
合作者
合作机构
CoRR (2023)
Lili Yu,Bowen Shi,Ramakanth Pasunuru,Benjamin Muller,Olga Golovneva,Tianlu Wang,Arun Babu,Binh Tang,Brian Karrer,Shelly Sheynin,Candace Ross,Adam Polyak,Russell Howes,Vasu Sharma,Puxin Xu,Hovhannes Tamoyan,Oron Ashual,Uriel Singer,Shang-Wen Li,Susan Zhang, Richard James,Gargi Ghosh,Yaniv Taigman,Maryam Fazel-Zarandi,Asli Celikyilmaz,Luke Zettlemoyer,Armen Aghajanyan
CoRR (2023)
CoRR (2023)
NeurIPS 2023 (2023)
Cited3Views0Bibtex
3
0
CoRR (2022)
arXiv (Cornell University) (2019)
Berner Christopher,Brockman Greg,Chan Brooke,Cheung Vicki, Dębiak Przemysław,Dennison Christy,Farhi David, Fischer Quirin, Hashme Shariq,Hesse Chris,Józefowicz Rafal,Gray Scott,Olsson Catherine,Pachocki Jakub,Petrov Michael, Pinto Henrique Pondé de Oliveira,Raiman Jonathan,Salimans Tim, Schlatter Jeremy,Schneider Jonas,Sidor Szymon,Sutskever Ilya, Tang Jie,Wolski Filip,Zhang Susan
CoRR (2019)
Cited962Views0EIBibtex
962
0
arxiv(2019)
Cited0Views0Bibtex
0
0
Juan M. Huerta,Susan Zhang,Evan Picard,Alexandra Dango, Ranqi Zhu,Jonathan Lenaghan, Steve Milton,Kevin Brackney,Amol Kapila, Roman Shraga, Rachit Srivastava,Carmem Domingues Khoa Pham, Eliza Chang
Proceedings of 20th ACM SIGKDD Conference on Knowledge Discovery and Data Mining - ADKDD'14 (2014)
Load More
Author Statistics
#Papers: 11
#Citation: 3948
H-Index: 5
G-Index: 5
Sociability: 4
Diversity: 0
Activity: 8
Co-Author
Co-Institution
D-Core
- 合作者
- 学生
- 导师
Data Disclaimer
The page data are from open Internet sources, cooperative publishers and automatic analysis results through AI technology. We do not make any commitments and guarantees for the validity, accuracy, correctness, reliability, completeness and timeliness of the page data. If you have any questions, please contact us by email: report@aminer.cn