SummEval: Re-evaluating Summarization Evaluation

Wojciech Kryściński
Wojciech Kryściński
Bryan McCann
Bryan McCann
Cited by: 1|Bibtex|Views61
Other Links: arxiv.org

Abstract:

The scarcity of comprehensive up-to-date studies on evaluation metrics for text summarization and the lack of consensus regarding evaluation protocols continues to inhibit progress. We address the existing shortcomings of summarization evaluation methods along five dimensions: 1) we re-evaluate 12 automatic evaluation metrics in a compr...More

Code:

Data:

Full Text
Your rating :
0

 

Tags
Comments