Chrome Extension
WeChat Mini Program
Use on ChatGLM

KVSharer: Efficient Inference Via Layer-Wise Dissimilar KV Cache Sharing

Yifei Yang,Zouying Cao, Qiguang Chen,Libo Qin, Dongjie Yang,Hai Zhao,Zhi Chen

CoRR(2024)

Cited 0|Views3
AI Read Science
Must-Reading Tree
Example
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined