Towards Automatic Evaluation of Reused Answers in Community Question Answering.
AIRS(2019)
摘要
We consider the problem of reused answer retrieval for community question answering (CQA): given a question q , retrieve answers posted in response to other questions , where serves as an answer to q . While previous work evaluated this task by manually annotating the relationship between q and , this approach does not scale for large-scale CQA sites. We therefore explore an automatic evaluation method for reused answer retrieval, which computes nDCG by defining the gain value of each retrieved answer as a ROUGE score that treats the original answers to q as gold summaries. Our answer retrieval experiment suggests that effective reused answer retrieval systems may not be the same as effective gold answer retrieval systems. We provide case studies to discuss the benefits and limitations of our approach.
更多查看译文
关键词
Answer retrieval, Community question answering, ROUGE
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络