Pre-trained Models for Natural Language Processing: A Survey

Sun Tianxiang
Sun Tianxiang
Xu Yige
Xu Yige
Shao Yunfan
Shao Yunfan
Dai Ning
Dai Ning

Science China-technological Sciences, pp. 1872-1897, 2020.

Cited by: 1|Bibtex|Views181|DOI:https://doi.org/10.1007/S11431-020-1647-3
Other Links: arxiv.org|academic.microsoft.com

Abstract:

Recently, the emergence of pre-trained models (PTMs) has brought natural language processing (NLP) to a new era. In this survey, we provide a comprehensive review of PTMs for NLP. We first briefly introduce language representation learning and its research progress. Then we systematically categorize existing PTMs based on a taxonomy from ...More

Code:

Data:

Full Text
Your rating :
0

 

Tags
Comments