S^3: Increasing GPU Utilization During Generative Inference for Higher Throughput
NeurIPS 2023（2023）
Key words
Throughput,GPU utilization,Sequence length prediction
AI Read Science
Must-Reading Tree
Example
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined