Efficient Test Collection Construction via Active Learning
arXiv: Information Retrieval, Volume abs/1801.05605, 2018.
To create a new IR test collection at minimal cost, we must carefully select which documents merit human relevance judgments. Shared task campaigns such as NIST TREC determine this by pooling search results from many participating systems (and often interactive runs as well), thereby identifying the most likely relevant documents in a giv...More
Full Text (Upload PDF)
PPT (Upload PPT)