LAMP: Large Deep Nets with Automated Model Parallelism for Image Segmentation
medical image computing and computer assisted intervention, pp. 374-384, 2020.
Deep Learning (DL) models are becoming larger, because the increase in model size might offer significant accuracy gain. To enable the training of large deep networks, data parallelism and model parallelism are two well-known approaches for parallel training. However, data parallelism does not help reduce memory footprint per device. In t...More
Full Text (Upload PDF)
PPT (Upload PPT)