On the expressive power of deep neural networks
international conference on machine learning, 2017.
We study the expressive power of deep neural networks before and aftertraining. Considering neural nets after random initialization, we show thatthree natural measures of expressivity all display an exponential dependenceon the depth of the network. We prove, theoretically and experimentally,that all of these measures are in fact related ...More
PPT (Upload PPT)