SwapAdvisor: Pushing Deep Learning Beyond the GPU Memory Limit via Smart Swapping
ASPLOS '20: Architectural Support for Programming Languages and Operating Systems Lausanne Switzerland March, 2020, pp. 1341-1355, 2020.
It is known that deeper and wider neural networks can achieve better accuracy. But it is difficult to continue the trend to increase model size due to limited GPU memory. One promising solution is to support swapping between GPU and CPU memory. However, existing work on swapping only handle certain models and do not achieve satisfactory p...More
Full Text (Upload PDF)
PPT (Upload PPT)