Building an information retrieval test collection for spontaneous conversational speech
SIGIR, pp. 41-48, 2004.
test collectionautomatic speech recognition resultinformation retrieval systemspontaneous conversational speechformative evaluationMore(11+)
Test collections model use cases in ways that facilitate evaluation of information retrieval systems. This paper describes the use of search-guided relevance assessment to create a test collection for retrieval of spontaneous conversational speech. Approximately 10,000 thematically coherent segments were manually identified in 625 hours o...More
PPT (Upload PPT)