基本信息
views: 189
Career Trajectory
Bio
In my scientific work, I have largely focused on the role of optimization in the success of deep learning. My main contribution is largely resolving the mystery why learning rate, a fundamental hyperparameter, impacts generalization in deep learning. In the process we have discovered that all deep learning trainings go through chaotic phase in the beginning of training. This in particular has been part of Understanding Deep Learning book (Prince, MIT press). For more details see our ICLR 2020 paper (spotlight). This is closely related to the Edge of Stability phenomenon.
I do my best to contribute to the broad machine learning community. Currently, I serve as an Action Editor for TMLR and an area chair for ICLR 2023 (before that NeurIPS 2020-23, ICML 2020-22, ICLR 2020-22).
I do my best to contribute to the broad machine learning community. Currently, I serve as an Action Editor for TMLR and an area chair for ICLR 2023 (before that NeurIPS 2020-23, ICML 2020-22, ICLR 2020-22).
Research Interests
Papers共 59 篇Author StatisticsCo-AuthorSimilar Experts
By YearBy Citation主题筛选期刊级别筛选合作者筛选合作机构筛选
时间
引用量
主题
期刊级别
合作者
合作机构
Maksym Korablyov,Cheng-Hao Liu,Moksh Jain,Almer M. van der Sloot, Eric Jolicoeur,Edward Ruediger,Andrei Cristian Nica,Emmanuel Bengio, Kostiantyn Lapchevskyi,Daniel St-Cyr,Doris Alexandra Schuetz,Victor Ion Butoi,Jarrid Rector-Brooks, Simon Blackburn,Leo Feng,Hadi Nekoei, SaiKrishna Gottipati,Priyesh Vijayan,Prateek Gupta,Ladislav Rampášek,Sasikanth Avancha,Pierre-Luc Bacon,William L. Hamilton,Brooks Paige,Sanchit Misra,Stanislaw Kamil Jastrzebski,Bharat Kaul,Doina Precup,José Miguel Hernández-Lobato,Marwin Segler,Michael Bronstein,Anne Marinier,Mike Tyers,Yoshua Bengio
arXiv (Cornell University) (2024)
Jungkyu Park,Jakub Chledowski,Stanislaw Jastrzebski,Jan Witowski,Yanqi Xu,Linda Du,Sushma Gaddam,Eric Kim,Alana Lewin,Ujas Parikh,Anastasia Plaunova,Sardius Chen,Alexandra Millet,James Park,Kristine Pysarenko,Shalin Patel,Julia Goldberg,Melanie Wegener,Linda Moy,Laura Heacock,Beatriu Reig,Krzysztof J. Geras
CoRR (2023)
JOURNAL OF CHEMICAL INFORMATION AND MODELINGno. 11 (2023): 3238-3247
Jungkyu Park,Jakub Chledowski,Stanislaw Jastrzebski,Jan Witowski,Yanqi Xu,Linda Du,Sushma Gaddam,Eric Kim,Alana Lewin,Ujas Parikh,Anastasia Plaunova,Sardius Chen,Alexandra Millet,James Park,Kristine Pysarenko,Shalin Patel,Julia Goldberg,Melanie Wegener,Linda Moy,Laura Heacock,Beatriu Reig,Krzysztof J. Geras
CoRR (2022)
International Conference on Machine Learningpp.24043-24055, (2022)
Proceedings of the AAAI Conference on Artificial Intelligenceno. 11 (2022): 12949-12950
Load More
Author Statistics
#Papers: 60
#Citation: 8420
H-Index: 23
G-Index: 42
Sociability: 5
Diversity: 2
Activity: 19
Co-Author
Co-Institution
D-Core
- 合作者
- 学生
- 导师
Data Disclaimer
The page data are from open Internet sources, cooperative publishers and automatic analysis results through AI technology. We do not make any commitments and guarantees for the validity, accuracy, correctness, reliability, completeness and timeliness of the page data. If you have any questions, please contact us by email: report@aminer.cn