Cross-Iteration Batch Normalization

Cited by: 0|Bibtex|Views58
Other Links: arxiv.org

Abstract:

A well-known issue of Batch Normalization is its significantly reduced effectiveness in the case of small mini-batch sizes. When a mini-batch contains few examples, the statistics upon which the normalization is defined cannot be reliably estimated from it during a training iteration. To address this problem, we present Cross-Iteration ...More

Code:

Data:

Full Text
Your rating :
0

 

Tags
Comments