Tasks, Queries, and Rankers in Pre-Retrieval Performance Prediction.
ADCS(2017)
摘要
Query performance prediction estimates the effectiveness of a in advance of human judgements. Accurate prediction could be used, for example, to trigger special processing, select variants, or choose whether to search at all. Prediction evaluations have not distinguished effects due to wording from effects due to the underlying information need, nor from effects due to performance of the retrieval system itself. Here we use five rankers, 100 tasks, and 28,869 queries to distinguish these three effects over six pre-retrieval predictors. We see that task effects dominate those due to or ranker; that many query performance predictors are in fact predicting task difficulty; and that this makes it difficult to use these algorithms.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络