Eloquent: A More Robust Transmission Scheme for LLM Token Streaming
PROCEEDINGS OF THE 2024 SIGCOMM WORKSHOP ON NETWORKS FOR AI COMPUTING, NAIC 2024（2024）
Key words
Real-Time Communication,Large Language Models,Token Streaming
AI Read Science
Must-Reading Tree
Example
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined