Emergent Language Generalization and Acquisition Speed are not tied to Compositionality

Proceedings of the Third BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP(2020)

引用 9|浏览98
暂无评分
摘要
Studies of discrete languages emerging when neural agents communicate to solve a joint task often look for evidence of compositional structure. This stems for the expectation that such a structure would allow languages to be acquired faster by the agents and enable them to generalize better. We argue that these beneficial properties are only loosely connected to compositionality. In two experiments, we demonstrate that, depending on the task, non-compositional languages might show equal, or better, generalization performance and acquisition speed than compositional ones. Further research in the area should be clearer about what benefits are expected from compositionality, and how the latter would lead to them.
更多
查看译文
关键词
generalization,language,acquisition speed
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要