On the expressive power of deep neural networksEI

摘要

We study the expressive power of deep neural networks before and aftertraining. Considering neural nets after random initialization, we show thatthree natural measures of expressivity all display an exponential dependenceon the depth of the network. We prove, theoretically and experimentally,that all of these measures are in fact related to a fourth quantity, trajectorylength. This quantity grows exponentially in the depth of the network, andis responsible for the depth sensitivity observed. These results translateto consequences for ...更多
个人信息

 

您的评分 :

ICML, 2016.

被引用次数183|引用|4
标签
作者
评论