Chrome Extension
WeChat Mini Program
Use on ChatGLM

Why Do Small Language Models Underperform? Studying Language Model Saturation Via the Softmax Bottleneck

COLM 2024(2024)

Cited 0|Views45
Key words
Language Modeling,Statistical Language Modeling,Hidden Markov Models,Topic Modeling,Pretrained Models
AI Read Science
Must-Reading Tree
Example
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined