Agile-Quant: Activation-Guided Quantization for Faster Inference of LLMs on the Edge
THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 17(2024)
Key words
Software Development
AI Read Science
Must-Reading Tree
Example
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined