A Comprehensive and Modularized Statistical Framework for Gradient Norm Equality in Deep Neural Networks

IEEE Transactions on Pattern Analysis and Machine Intelligence(2022)

引用 26|浏览145
暂无评分
摘要
The rapid development of deep neural networks (DNNs) in recent years can be attributed to the various techniques that address gradient explosion and vanishing. In order to understand the principle behind these techniques and develop new methods, plenty of metrics have been proposed to identify networks that are free of gradient explosion and vanishing. However, due to the diversity of network comp...
更多
查看译文
关键词
Jacobian matrices,Explosions,Measurement,Biological neural networks,Probability,Libraries
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要