Neuromodulation Gated Transformer

Kobe Knowles,Joshua Bensemann,Diana Benavides Prado,Vithya Yogarajan,Michael Witbrock,Gillian Dobbie,Yang Chen

CoRR（2023）

引用 0|浏览5

暂无评分

摘要

We introduce a novel architecture, the Neuromodulation Gated Transformer (NGT), which is a simple implementation of neuromodulation in transformers via a multiplicative effect. We compare it to baselines and show that it results in the best average performance on the SuperGLUE benchmark validation sets.

查看译文

关键词

transformer,neuromodulation

AI 理解论文

溯源树

样例

生成溯源树，研究论文发展脉络

Chat Paper

正在生成论文摘要