Light Multi-segment Activation for Model Compression
national conference on artificial intelligence, 2020.
Model compression has become necessary when applying neural networks (NN) into many real application tasks that can accept slightly-reduced model accuracy with strict tolerance to model complexity. Recently, Knowledge Distillation, which distills the knowledge from well-trained and highly complex teacher model into a compact student mod...More
PPT (Upload PPT)