Faster Neural Network Training with Data Echoing

Shallue Christopher J.
Shallue Christopher J.
Cited by: 8|Views25

Abstract:

In the twilight of Moore's law, GPUs and other specialized hardware accelerators have dramatically sped up neural network training. However, earlier stages of the training pipeline, such as disk I/O and data preprocessing, do not run on accelerators. As accelerators continue to improve, these earlier stages will increasingly become the ...More

Code:

Data:

Full Text
Bibtex
Your rating :
0

 

Tags
Comments