LAMAL: LAnguage Modeling Is All You Need for Lifelong Language Learning
international conference on learning representations, 2020.
Most research on lifelong learning (LLL) applies to images or games, but not language. We present LAMAL, a simple yet effective method for LLL based on language modeling. LAMAL replays pseudo-samples of previous tasks while requiring no extra memory or model capacity. Specifically, LAMAL is a language model that simultaneously learns to s...More
PPT (Upload PPT)