Analyzing Coherency in Facet-based Clarification Prompt Generation for Search
CoRR(2024)
摘要
Clarifying user's information needs is an essential component of modern
search systems. While most of the approaches for constructing clarifying
prompts rely on query facets, the impact of the quality of the facets is
relatively unexplored. In this work, we concentrate on facet quality through
the notion of facet coherency and assess its importance for overall usefulness
for clarification in search. We find that existing evaluation procedures do not
account for facet coherency, as evident by the poor correlation of coherency
with automated metrics. Moreover, we propose a coherency classifier and assess
the prevalence of incoherent facets in a well-established dataset on
clarification. Our findings can serve as motivation for future work on the
topic.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要