If beam search is the answer, what was the question?
EMNLP 2020, pp. 2173-2185, 2020.
We find that beam search enforces uniform information density in text, a property motivated by cognitive science
Quite surprisingly, exact maximum a posteriori (MAP) decoding of neural language generators frequently leads to low-quality results. Rather, most state-of-the-art results on language generation tasks are attained using beam search despite its overwhelmingly high search error rate. This implies that the MAP objective alone does not express...More
PPT (Upload PPT)