Identity Crisis: Memorization and Generalization Under Extreme Overparameterization

ICLR, 2020.

Cited by: 29|Views106
EI

Abstract:

We study the interplay between memorization and generalization of overparameterized networks in the extreme case of a single training example and an identity-mapping task. We examine fully-connected and convolutional networks (FCN and CNN), both linear and nonlinear, initialized randomly and then trained to minimize the reconstruction err...More

Code:

Data:

Your rating :
0

 

Tags
Comments