Good Subnetworks Provably Exist: Pruning via Greedy Forward Selection
ICML, pp. 10820-10830, 2020.
Recent empirical works show that large deep neural networks are often highly redundant and one can find much smaller subnetworks without a significant drop of accuracy. However, most existing methods of network pruning are empirical and heuristic, leaving it open whether good subnetworks provably exist, how to find them efficiently, and...More
PPT (Upload PPT)