SentiLARE: Sentiment Aware Language Representation Learning with Linguistic Knowledge
EMNLP 2020, 2020.
We introduce the linguistic knowledge from SentiWordNet and design label-aware masked language model to enable our model to utilize the knowledge in sentiment analysis tasks
Most of the existing pre-trained language representation models neglect to consider the linguistic knowledge of texts, whereas we argue that such knowledge can promote language understanding in various NLP tasks. In this paper, we propose a novel language representation model called SentiLR, which introduces word-level linguistic knowle...More
PPT (Upload PPT)