Analyzing the Impact of Prevalence on the Evaluation of a Manual Annotation Campaign

LREC 2012 - EIGHTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, pp. 1474-1480, 2012.

Cited by: 14|Views14
EI

Abstract:

This article details work aiming at evaluating the quality of the manual annotation of gene renaming couples in scientific abstracts, which generates sparse annotations. To evaluate these annotations, we compare the results obtained using the commonly advocated inter-annotator agreement coefficients such as S, kappa and pi, the less known...More

Code:

Data:

Full Text
Bibtex
Your rating :
0

 

Tags
Comments