Chrome Extension
WeChat Mini Program
Use on ChatGLM

Leftovers for LLaMA

PROCEEDINGS OF THE 15TH ACM/SPEC INTERNATIONAL CONFERENCE ON PERFORMANCE ENGINEERING, ICPE 2024(2024)

Cited 0|Views4
Key words
LLMs,Leftover capacity,Distributed inference,Optimal block placement
AI Read Science
Must-Reading Tree
Example
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined