Let's agree to disagree: on the evaluation of vocabulary alignment
K-CAP, pp. 65-72, 2011.
Gold standard mappings created by experts are at the core of alignment evaluation. At the same time, the process of manual evaluation is rarely discussed. While the practice of having multiple raters evaluate results is accepted, their level of agreement is often not measured. In this paper we describe three experiments in manual evaluati...More
PPT (Upload PPT)