Understanding and Minimising Outlier Features in Transformer Training
NeurIPS 2024（2024）
Key words
Outlier Features,Training Dynamics,Normalisation Layers,Signal Propagation,NN Optimisers,NN Architectures,Transformers,Understanding Deep Learning
AI Read Science
Must-Reading Tree
Example
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined