A simple geometric proof for the benefit of depth in ReLU networks

Asaf Amrami
Cited by: 0|Views4

Abstract:

We present a simple proof for the benefit of depth in multi-layer feedforward network with rectified activation ("depth separation"). Specifically we present a sequence of classification problems indexed by $m$ such that (a) for any fixed depth rectified network there exist an $m$ above which classifying problem $m$ correctly requires e...More

Code:

Data:

ZH
Full Text
Bibtex