Embedding Compression with Isotropic Iterative Quantization
national conference on artificial intelligence, 2020.
Continuous representation of words is a standard component in deep learning-based NLP models. However, representing a large vocabulary requires significant memory, which can cause problems, particularly on resource-constrained platforms. Therefore, in this paper we propose an isotropic iterative quantization (IIQ) approach for compressi...More
PPT (Upload PPT)