Efficient Online Scalar Annotation with Bounded Support

meeting of the association for computational linguistics, Volume abs/1806.01170, 2018.

Cited by: 3|Bibtex|Views23
EI
Other Links: dblp.uni-trier.de|academic.microsoft.com|arxiv.org

Abstract:

We describe a novel method for efficiently eliciting scalar annotations for dataset construction and system quality estimation by human judgments. We contrast direct assessment (annotators assign scores to items directly), online pairwise ranking aggregation (scores derive from annotator comparison of items), and a hybrid approach (EASL: ...More

Code:

Data:

Full Text
Your rating :
0

 

Tags
Comments