In Neural Machine Translation, What Does Transfer Learning Transfer?
ACL, pp. 7701-7710, 2020.
Transfer learning is a common method for lowresource neural machine translation
Transfer learning improves quality for lowresource machine translation, but it is unclear what exactly it transfers. We perform several ablation studies that limit information transfer, then measure the quality impact across three language pairs to gain a black-box understanding of transfer learning. Word embeddings play an important role...More
PPT (Upload PPT)