Chrome Extension
WeChat Mini Program
Use on ChatGLM

INT-FlashAttention: Enabling Flash Attention for INT8 Quantization

Shimao Chen,Zirui Liu, Zhiying Wu, Ce Zheng,Peizhuang Cong, Zihan Jiang,Yuhan Wu, Lei Su,Tong Yang

CoRR(2024)

Cited 0|Views14
No score
AI Read Science
Must-Reading Tree
Example
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined