Pre-trained Models for Natural Language Processing: A Survey
Science China-technological Sciences, pp. 1872-1897, 2020.
Recently, the emergence of pre-trained models (PTMs) has brought natural language processing (NLP) to a new era. In this survey, we provide a comprehensive review of PTMs for NLP. We first briefly introduce language representation learning and its research progress. Then we systematically categorize existing PTMs based on a taxonomy from ...More
PPT (Upload PPT)