Building Pseudo-Desktop Collections

Research on the desktop search has been constrained by the lack of reusable test collections. This led to a high entry barrier for new researchers and diculty in the compara- tive evaluation of existing methods. To address this point, we introduce a method for creating reusable pseudo-desktop collections by gathering documents and generating queries that have similar characteristics to actual collections. Our method involves a new query generation method and a tech- nique for evaluating the similarity of generated queries with user-generated queries.