BERT has a Mouth, and It Must Speak: BERT as a Markov Random Field Language Model
Proceedings of the Workshop on Methods for Optimizing and Evaluating Neural Language Generation(2019)
摘要
We show that BERT (Devlin et al., 2018) is a Markov random field language model. This formulation gives way to a natural procedure to sample sentences from BERT. We generate from BERT and find that it can produce high quality, fluent generations. Compared to the generations of a traditional left-to-right language model, BERT generates sentences that are more diverse but of slightly worse quality.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络