基本信息
浏览量:96
职业迁徙
个人简介
He works on developing high performance infrastructures for accelerating large scale deep learning training and inference on parallel and distributed systems. He designed systems such as ZeRO and 3D parallelism that have been adopted many DL frameworks, has become the staple engine for training large language models, and has made it possible to train models like Turing-NLG 17.2B, Megtron-Turing 530B, and Bloom 176B, etc.
研究兴趣
论文共 46 篇作者统计合作学者相似作者
按年份排序按引用量排序主题筛选期刊级别筛选合作者筛选合作机构筛选
时间
引用量
主题
期刊级别
合作者
合作机构
Connor Holmes,Masahiro Tanaka, Michael Wyatt,Ammar Ahmad Awan,Jeff Rasley,Samyam Rajbhandari,Reza Yazdani Aminabadi,Heyang Qin, Arash Bakhtiari, Lev Kurilenko,Yuxiong He
arxiv(2024)
引用0浏览0引用
0
0
Guanhua Wang,Heyang Qin, Sam Ade Jacobs,Xiaoxia Wu,Connor Holmes,Zhewei Yao,Samyam Rajbhandari,Olatunji Ruwase,Feng Yan,Lei Yang,Yuxiong He
ICLR 2024 (2024)
引用0浏览0引用
0
0
PROCEEDINGS OF THE 37TH INTERNATIONAL CONFERENCE ON SUPERCOMPUTING, ACM ICS 2023pp.203-214, (2023)
Sam Ade Jacobs,Masahiro Tanaka,Chengming Zhang,Minjia Zhang, Leon Song,Samyam Rajbhandari,Yuxiong He
CoRR (2023)
引用0浏览0EI引用
0
0
Zhewei Yao,Reza Yazdani Aminabadi,Olatunji Ruwase,Samyam Rajbhandari,Xiaoxia Wu,Ammar Ahmad Awan,Jeff Rasley,Minjia Zhang,Conglong Li,Connor Holmes, Zhongzhu Zhou, Michael Wyatt,
CoRR (2023)
加载更多
作者统计
合作学者
合作机构
D-Core
- 合作者
- 学生
- 导师
数据免责声明
页面数据均来自互联网公开来源、合作出版商和通过AI技术自动分析结果,我们不对页面数据的有效性、准确性、正确性、可靠性、完整性和及时性做出任何承诺和保证。若有疑问,可以通过电子邮件方式联系我们:report@aminer.cn