Overview of the NTCIR-14 short text generation subtask: emotion generation challenge

This paper describes an overview of the Emotion Generation subtask at NTCIR-14. The goal of the emotion generation subtask is to investigate how well a chatting machine can express feelings by generating a textual response to an input post. The task is defined as follows: given a post and a pre-specified emotion class of the generated response, the task is to generate a response that is appropriate in both topic and emotion. This challenge has attracted more 40 teams registered, and 11 teams finally submitted results. In this overview paper, we reported the details of this challenge, including task definition, data preparation, annotation schema, submission statistics, and evaluation results.