Revisiting Block-based Quantisation: What is Important for Sub-8-bit LLM Inference?
EMNLP 2023(2023)
Key words
large language model,LLM,quantization,NLP
AI Read Science
Must-Reading Tree
Example

Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined