If beam search is the answer, what was the question?

Clara Meister
Clara Meister
Ryan Cotterell
Ryan Cotterell

EMNLP 2020, pp. 2173-2185, 2020.

Cited by: 0|Views57
Weibo:
We find that beam search enforces uniform information density in text, a property motivated by cognitive science

Abstract:

Quite surprisingly, exact maximum a posteriori (MAP) decoding of neural language generators frequently leads to low-quality results. Rather, most state-of-the-art results on language generation tasks are attained using beam search despite its overwhelmingly high search error rate. This implies that the MAP objective alone does not express...More

Code:

Data:

0
Full Text
Bibtex
Weibo
Your rating :
0

 

Tags
Comments