SemRel2024: A Collection of Semantic Textual Relatedness Datasets for 13 Languages
CoRR(2024)
摘要
Exploring and quantifying semantic relatedness is central to representing
language and holds significant implications across various NLP tasks. While
earlier NLP research primarily focused on semantic similarity, often within the
English language context, we instead investigate the broader phenomenon of
semantic relatedness. In this paper, we present SemRel, a new semantic
relatedness dataset collection annotated by native speakers across 13
languages: Afrikaans, Algerian Arabic, Amharic, English, Hausa, Hindi,
Indonesian, Kinyarwanda, Marathi, Moroccan Arabic, Modern Standard Arabic,
Spanish, and Telugu. These languages originate from five distinct
language families and are predominantly spoken in Africa and Asia – regions
characterised by a relatively limited availability of NLP resources. Each
instance in the SemRel datasets is a sentence pair associated with a score that
represents the degree of semantic textual relatedness between the two
sentences. The scores are obtained using a comparative annotation framework. We
describe the data collection and annotation processes, challenges when building
the datasets, baseline experiments, and their impact and utility in NLP.
更多查看译文
AI 理解论文
溯源树
样例
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要