Chrome Extension
WeChat Mini Program
Use on ChatGLM

PyramidKV: Dynamic KV Cache Compression Based on Pyramidal Information Funneling.

Zefan Cai, Yichi Zhang,Bofei Gao, Yuliang Liu,Tianyu Liu,Keming Lu,Wayne Xiong, Yue Dong,Baobao Chang, Junjie Hu, Wen Xiao

CoRR(2024)

Cited 0|Views53
AI Read Science
Must-Reading Tree
Example
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined