ADOPT: Modified Adam Can Converge with Any $\beta_2$ with the Optimal Rate

Shohei Taniguchi, Keno Harada, Gouki Minegishi, Yuta Oshima, Seong Cheol Jeong, Go Nagahara, Tomoshi Iiyama,Masahiro Suzuki,Yusuke Iwasawa, Yutaka Matsuo

NeurIPS 2024（2024）

Cited 0|Views0

Key words

Adam,convergence analysis,adaptive gradient method

AI Read Science

Must-Reading Tree

Example

Generate MRT to find the research sequence of this paper

Chat Paper

Summary is being generated by the instructions you defined