Aspect-based sentiment analysis for German : analyzing 'talk of literature' surrounding literary prizes on social media

Since the rise of social media, the authority of traditional professional literary critics has been supplemented – or undermined, depending on the point of view – by technological developments and the emergence of community-driven online layperson literary criticism. So far, relatively little research (Allington 2016, Kellermann et al. 2016, Kellermann and Mehling 2017, Bogaert 2017, Pianzola et al. 2020) has examined this layperson user-generated evaluative “talk of literature” instead of addressing traditional forms of consecration. In this paper,1 we examine the professional and layperson literary criticism pertaining to a prominent German-language literary award: the Ingeborg-Bachmann-Preis, awarded during the Tage der deutschsprachigen Literatur (TDDL). We propose an aspect-based sentiment analysis (ABSA) approach to discern the evaluative criteria used to differentiate between ‘good’ and ‘bad’ literature. To this end, we collected a corpus of German social media reviews retrieved from Twitter, Instagram and Goodreads and enriched it with manual ABSA annotations: aspects and aspect categories (E.g., TEXT Motifs Themes, JURY Discussion Valuation), sentiment expressions and named entities. In a next step, the manual annotations are used as training data for our ABSA pipeline including 1) aspect term extraction, 2) aspect term category prediction and 3) aspect term polarity classification. Each pipeline ncomponent is developed using state-of-the-art pre-trained BERT models. Two sets of experiments were conducted for the aspect polarity detection: one where only the aspect embeddings were used and another where an additional context window of five adjoining words in either direction of the aspect was considered. We present the classification results for the aspect category and aspect sentiment prediction subtasks for the Twitter corpus as well as the next steps to tackle aspect term extraction. These preliminary experimental results show a good performance and accuracy for the aspect category classification, with an F1-score of 0.81, and for the aspect sentiment subtask, which uses an additional context window, with an F1-score of 0.72.