Uncovering Hidden Geometry in Transformers Via Disentangling Position and Context
ICLR 2024（2024）
Key words
Transformers,Positional embeddings,Incoherence,Induction head,Attention,Interpreting neural nets,Visualization
AI Read Science
Must-Reading Tree
Example
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined