ERNIE 2.0: A Continual Pre-training Framework for Language Understanding
national conference on artificial intelligence, 2020.
Recently, pre-trained models have achieved state-of-the-art results in various language understanding tasks, which indicates that pre-training on large-scale corpora may play a crucial role in natural language processing. Current pre-training procedures usually focus on training the model with several simple tasks to grasp the co-occurr...More
PPT (Upload PPT)